[2025-10-07T17:00:02.217854] [INFO ] [MAIN ] Using last completed trading day: 2025-10-07 [2025-10-07T17:00:02.456895] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-07T17:00:02.457103] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-07T17:00:02.668505] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-07T17:00:02.669075] [WARN ] [STATE ] State set to: RUNNING [2025-10-07T17:00:02.669160] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-07T17:00:02.669208] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-07T17:00:02.669297] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-07T17:00:02.669334] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-07T17:00:04.229848] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-07T17:00:04.230037] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-07T17:00:04.230286] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-07T17:00:04.231178] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-07T17:00:04.231239] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-07T17:00:04.231271] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-07T17:00:04.231330] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-07T17:00:04.231363] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-07T17:00:04.231393] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-07T17:00:04.231805] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-07T17:00:04.231858] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-07T17:00:04.232015] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-07T17:00:04.232049] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-07T17:00:04.232079] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-07T17:00:04.232109] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-07T17:00:04.258194] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-07T17:00:04.284392] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-07T17:00:04.284508] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-07T17:00:04.284544] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-07T17:00:04.284573] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-07T17:00:04.284633] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-07T17:00:04.285024] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-07T17:00:04.285066] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-07T17:00:04.285098] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-10-07T17:00:04.285127] [INFO ] [MAIN ] Running in parallel mode [2025-10-07T17:00:04.285365] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-10-07T17:00:04.904905] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:04.903482] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:05.030450] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:05.031288] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-07T17:00:05.050495] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-07T17:00:05.074678] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-07T17:00:05.074252] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:05.075009] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-07T17:00:05.075133] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-07T17:00:05.075273] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-07T17:00:05.075445] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-07T17:00:05.075335] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-07T17:00:05.075664] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-07T17:00:05.081084] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-07T17:00:05.110802] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-07T17:00:05.116295] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-07T17:00:05.706877] [DEBUG] [LOCAL ] AA: Loaded 53616 existing records from primary storage. [2025-10-07T17:00:05.728832] [DEBUG] [LOCAL ] A: Loaded 50749 existing records from primary storage. [2025-10-07T17:00:05.750076] [INFO ] [MAIN ] A: Loaded 50749 existing records. [2025-10-07T17:00:05.734323] [INFO ] [MAIN ] AA: Loaded 53616 existing records. [2025-10-07T17:00:06.182986] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:06.156740] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:06.266821] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-07T17:00:06.247512] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-07T17:00:06.329856] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:06.353217] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:06.353304] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-07T17:00:06.353471] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-07T17:00:06.353553] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-07T17:00:06.353677] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-07T17:00:06.355122] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-07T17:00:06.355190] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-07T17:00:06.387026] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-07T17:00:06.420021] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-07T17:00:06.671910] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:00:06.757890] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-07T17:00:06.783333] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:00:06.854498] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-07T17:00:06.899112] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-07T17:00:06.879464] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-07T17:00:06.938285] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:00:06.959772] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-07T17:00:07.037020] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-07T17:00:07.064364] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-07T17:00:07.103145] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:07.103292] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-07T17:00:07.122207] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-07T17:00:07.132681] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.7s. Estimated remaining: 1h 52m 28s. Rate: 21.1 symbols/min [2025-10-07T17:00:07.166714] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:07.200827] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-07T17:00:07.347605] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:07.411288] [DEBUG] [LOCAL ] AAP: Loaded 51911 existing records from primary storage. [2025-10-07T17:00:07.411700] [INFO ] [MAIN ] AAP: Loaded 51911 existing records. [2025-10-07T17:00:07.505174] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-07T17:00:07.516848] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-07T17:00:07.611191] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:07.611417] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-07T17:00:07.611469] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-07T17:00:07.613296] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-07T17:00:07.613386] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-07T17:00:07.946588] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-07T17:00:07.958947] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-07T17:00:08.044539] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:08.044933] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-07T17:00:08.356141] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-07T17:00:08.357343] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-07T17:00:08.691183] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-07T17:00:08.692223] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-07T17:00:08.933851] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T17:00:08.945352] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-07T17:00:08.950401] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-07T17:00:08.952054] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-07T17:00:09.127095] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T17:00:09.145188] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-07T17:00:09.210097] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-07T17:00:09.211921] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-07T17:00:09.720138] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-07T17:00:09.721339] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-07T17:00:09.770328] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T17:00:09.780844] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-07T17:00:10.084882] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-07T17:00:10.085982] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-07T17:00:10.467810] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-07T17:00:10.468801] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-07T17:00:10.510497] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T17:00:10.520806] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-07T17:00:10.932894] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T17:00:10.933589] [INFO ] [REMOTE ] AAM: Full fetch complete (939 records). [2025-10-07T17:00:10.933686] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-07T17:00:11.120748] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-07T17:00:11.120987] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:00:11.121131] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:00:11.121314] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-07T17:00:11.121462] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-07T17:00:11.121536] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-07T17:00:11.121678] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-07T17:00:11.121812] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.8s. Estimated remaining: 2h 14m 58s. Rate: 17.6 symbols/min [2025-10-07T17:00:11.321118] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:11.322738] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-07T17:00:11.335042] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-07T17:00:11.366870] [DEBUG] [LOCAL ] AAT: Loaded 30297 existing records from primary storage. [2025-10-07T17:00:11.367159] [INFO ] [MAIN ] AAT: Loaded 30297 existing records. [2025-10-07T17:00:11.552872] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:11.553193] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-07T17:00:11.553271] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-07T17:00:11.562509] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-07T17:00:11.578300] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-07T17:00:11.642895] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T17:00:11.691192] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-07T17:00:11.963027] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:11.963372] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-07T17:00:12.266618] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T17:00:12.276907] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-07T17:00:13.073586] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T17:00:13.084222] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-07T17:00:13.442317] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T17:00:13.448569] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-07T17:00:13.548955] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T17:00:13.558820] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-07T17:00:13.837342] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T17:00:13.849951] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-07T17:00:14.193165] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T17:00:14.198813] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-07T17:00:15.057015] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T17:00:15.069550] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-07T17:00:15.508507] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T17:00:15.541407] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-07T17:00:15.552364] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-07T17:00:15.554898] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T17:00:15.573297] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-07T17:00:15.574086] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-07T17:00:17.007307] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T17:00:17.014747] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-07T17:00:17.218050] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T17:00:17.230147] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-07T17:00:17.565018] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-07T17:00:17.577277] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-07T17:00:17.630028] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-07T17:00:17.642234] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-07T17:00:18.367361] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T17:00:18.375064] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-07T17:00:19.001758] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T17:00:19.012350] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-07T17:00:19.181151] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T17:00:19.193286] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-07T17:00:19.378687] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T17:00:19.390413] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-07T17:00:19.499277] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T17:00:19.505758] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-07T17:00:20.441840] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T17:00:20.452965] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-07T17:00:20.566676] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T17:00:20.578451] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-07T17:00:21.122811] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T17:00:21.129488] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-07T17:00:21.370128] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T17:00:21.382134] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-07T17:00:22.151158] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T17:00:22.180883] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-07T17:00:22.199748] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T17:00:22.212600] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-07T17:00:22.304193] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T17:00:22.315718] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-07T17:00:23.523337] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-07T17:00:23.537009] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-07T17:00:23.930355] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T17:00:23.937443] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-07T17:00:24.020276] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T17:00:24.035197] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-07T17:00:24.107050] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T17:00:24.118182] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-07T17:00:24.905448] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T17:00:24.912236] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-07T17:00:25.076942] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T17:00:25.090556] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-07T17:00:25.601124] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T17:00:25.606113] [INFO ] [REMOTE ] A: Full fetch complete (73140 records). [2025-10-07T17:00:25.606242] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-07T17:00:26.004317] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-07T17:00:26.004451] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-07T17:00:26.005226] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-07T17:00:26.005343] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-07T17:00:26.035932] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T17:00:26.036100] [DEBUG] [LOCAL ] A: Trimmed 73140 records to 50745 (keeping 200 days of data) [2025-10-07T17:00:26.048602] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-07T17:00:26.279499] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T17:00:26.284153] [INFO ] [REMOTE ] AAT: Full fetch complete (42759 records). [2025-10-07T17:00:26.285442] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-07T17:00:26.764671] [DEBUG] [LOCAL ] A: Primary data saved (50745 records). [2025-10-07T17:00:26.775397] [INFO ] [MAIN ] A: Full history saved. [2025-10-07T17:00:26.775537] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-07T17:00:26.776557] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. A took 22.5s. Estimated remaining: 4h 55m 53s. Rate: 8.0 symbols/min [2025-10-07T17:00:26.776826] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-07T17:00:26.777387] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-07T17:00:26.782931] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-07T17:00:26.879343] [DEBUG] [LOCAL ] AAT: Trimmed 42759 records to 30309 (keeping 200 days of data) [2025-10-07T17:00:27.044425] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:27.047720] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-07T17:00:27.052131] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-07T17:00:27.052487] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-07T17:00:27.055176] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-07T17:00:27.058936] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-07T17:00:27.068391] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-07T17:00:27.253039] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-07T17:00:27.283602] [DEBUG] [LOCAL ] AAT: Primary data saved (30309 records). [2025-10-07T17:00:27.335224] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-07T17:00:27.334266] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-07T17:00:27.354725] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAT took 16.2s. Estimated remaining: 3h 47m 31s. Rate: 10.4 symbols/min [2025-10-07T17:00:27.768898] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:27.782408] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:27.783468] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-07T17:00:27.815217] [DEBUG] [LOCAL ] AB: Loaded 26855 existing records from primary storage. [2025-10-07T17:00:27.815539] [INFO ] [MAIN ] AB: Loaded 26855 existing records. [2025-10-07T17:00:27.946694] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-07T17:00:27.991819] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:00:27.990988] [INFO ] [REMOTE ] AAP: Full fetch complete (74986 records). [2025-10-07T17:00:28.032561] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-07T17:00:28.036788] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:28.037122] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:00:28.037337] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-07T17:00:28.037056] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-07T17:00:28.037464] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-07T17:00:28.037829] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-07T17:00:28.038120] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:00:28.038381] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-07T17:00:28.038457] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-07T17:00:28.038497] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-07T17:00:28.038537] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-07T17:00:28.038610] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAUC took 1.3s. Estimated remaining: 3h 7m 20s. Rate: 12.6 symbols/min [2025-10-07T17:00:28.061502] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-07T17:00:28.094123] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-07T17:00:28.601937] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:29.142091] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-07T17:00:29.155090] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-07T17:00:29.157128] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-07T17:00:29.157408] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-07T17:00:29.248598] [DEBUG] [LOCAL ] ABBV: Loaded 53685 existing records from primary storage. [2025-10-07T17:00:29.254996] [INFO ] [MAIN ] ABBV: Loaded 53685 existing records. [2025-10-07T17:00:29.246637] [DEBUG] [LOCAL ] AAP: Trimmed 74986 records to 51875 (keeping 200 days of data) [2025-10-07T17:00:29.324822] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-07T17:00:29.452493] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:29.527697] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-07T17:00:29.547880] [INFO ] [REMOTE ] AA: Full fetch complete (77540 records). [2025-10-07T17:00:29.554954] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-07T17:00:29.852986] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:29.869887] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-07T17:00:29.870451] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-07T17:00:29.908395] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-07T17:00:29.918705] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-07T17:00:30.613059] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-07T17:00:30.621382] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-07T17:00:30.642993] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-07T17:00:30.643723] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-07T17:00:30.760498] [DEBUG] [LOCAL ] AA: Trimmed 77540 records to 53620 (keeping 200 days of data) [2025-10-07T17:00:30.787837] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:30.870468] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-07T17:00:30.944293] [DEBUG] [LOCAL ] AAP: Primary data saved (51875 records). [2025-10-07T17:00:30.956010] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-07T17:00:30.959051] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AAP took 23.8s. Estimated remaining: 2h 55m 14s. Rate: 13.5 symbols/min [2025-10-07T17:00:31.279162] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:31.282002] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T17:00:31.290111] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-07T17:00:31.394160] [DEBUG] [LOCAL ] AA: Primary data saved (53620 records). [2025-10-07T17:00:31.403518] [INFO ] [MAIN ] AA: Full history saved. [2025-10-07T17:00:31.404008] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AA took 27.1s. Estimated remaining: 2h 32m 38s. Rate: 15.5 symbols/min [2025-10-07T17:00:31.404527] [DEBUG] [LOCAL ] ABCB: Loaded 30452 existing records from primary storage. [2025-10-07T17:00:31.416892] [INFO ] [MAIN ] ABCB: Loaded 30452 existing records. [2025-10-07T17:00:31.732291] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:31.748425] [DEBUG] [LOCAL ] ABEV: No existing data file found in primary storage. [2025-10-07T17:00:31.765140] [WARN ] [MAIN ] ABEV: No existing data found, performing full refresh instead. [2025-10-07T17:00:31.770518] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:31.770926] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-07T17:00:31.771149] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-07T17:00:31.771218] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-07T17:00:31.771375] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-07T17:00:31.771516] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-10-07T17:00:31.771691] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-07T17:00:31.802962] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-07T17:00:31.835940] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-07T17:00:32.556958] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:32.586326] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-07T17:00:32.585972] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:32.588132] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-07T17:00:32.641871] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T17:00:32.670874] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-07T17:00:32.672015] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T17:00:32.680366] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-07T17:00:34.134271] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T17:00:34.140897] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-07T17:00:34.173137] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T17:00:34.183504] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-07T17:00:34.409437] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T17:00:34.421083] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-07T17:00:35.033922] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-07T17:00:35.045600] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-07T17:00:35.475006] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T17:00:35.491470] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-07T17:00:35.510686] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T17:00:35.521476] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-07T17:00:36.394288] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-07T17:00:36.405742] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-07T17:00:36.427585] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-07T17:00:36.434850] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-07T17:00:36.560906] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T17:00:36.571525] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-07T17:00:37.056294] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T17:00:37.065892] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-07T17:00:37.922407] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T17:00:37.929813] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-07T17:00:38.138087] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T17:00:38.147690] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-07T17:00:38.284545] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-07T17:00:38.295050] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-07T17:00:38.686462] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-07T17:00:38.699334] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-07T17:00:39.162977] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T17:00:39.168989] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-07T17:00:39.315430] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T17:00:39.323570] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-07T17:00:40.152713] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T17:00:40.164190] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-07T17:00:40.234599] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T17:00:40.243979] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-07T17:00:40.452862] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T17:00:40.459226] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-07T17:00:40.925578] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-07T17:00:40.936938] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-07T17:00:41.031810] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T17:00:41.037699] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-07T17:00:41.767142] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T17:00:41.772566] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-07T17:00:41.978388] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T17:00:41.989802] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-07T17:00:42.436778] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T17:00:42.444113] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-07T17:00:42.691229] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T17:00:42.696816] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-07T17:00:42.769108] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T17:00:42.780490] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-07T17:00:43.606782] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T17:00:43.609084] [INFO ] [REMOTE ] AB: Full fetch complete (45259 records). [2025-10-07T17:00:43.609199] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-07T17:00:43.944224] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T17:00:44.009907] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-07T17:00:44.070427] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-07T17:00:44.070573] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-07T17:00:44.071190] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-07T17:00:44.071308] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-07T17:00:44.073853] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-07T17:00:44.086053] [DEBUG] [LOCAL ] AB: Trimmed 45259 records to 26634 (keeping 200 days of data) [2025-10-07T17:00:44.086997] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-07T17:00:44.255168] [DEBUG] [LOCAL ] AB: Primary data saved (26634 records). [2025-10-07T17:00:44.255312] [INFO ] [MAIN ] AB: Full history saved. [2025-10-07T17:00:44.255402] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 16.9s. Estimated remaining: 3h 16m 46s. Rate: 12.0 symbols/min [2025-10-07T17:00:44.430147] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:44.449911] [DEBUG] [LOCAL ] ABG: Loaded 18626 existing records from primary storage. [2025-10-07T17:00:44.450338] [INFO ] [MAIN ] ABG: Loaded 18626 existing records. [2025-10-07T17:00:44.641078] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:44.641360] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-07T17:00:44.641555] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-07T17:00:44.642427] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-07T17:00:44.642491] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-07T17:00:44.994423] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-07T17:00:45.043885] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:45.044777] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-07T17:00:45.045129] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-07T17:00:45.690181] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T17:00:45.697409] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-07T17:00:45.759853] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T17:00:45.770566] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-07T17:00:46.201949] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T17:00:46.205362] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-07T17:00:46.813205] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T17:00:46.815409] [INFO ] [REMOTE ] ABCB: Full fetch complete (44376 records). [2025-10-07T17:00:46.815519] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-07T17:00:46.816258] [FATAL] [VALIDATOR ] ABCB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:00:46.816359] [FATAL] [MAIN ] ABCB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:00:46.816426] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:00:46.816502] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-07T17:00:46.816597] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-07T17:00:46.816682] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-10-07T17:00:46.816983] [DEBUG] [LOCAL ] ABCB: Deleted derivative data file. [2025-10-07T17:00:46.817084] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 15.9s. Estimated remaining: 3h 6m 2s. Rate: 12.7 symbols/min [2025-10-07T17:00:47.015936] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:47.016527] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-07T17:00:47.016710] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-07T17:00:47.016946] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-07T17:00:47.017102] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-07T17:00:47.030639] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-07T17:00:47.031320] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-07T17:00:47.038845] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T17:00:47.149819] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-07T17:00:47.198524] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-07T17:00:47.273464] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-07T17:00:47.495136] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:47.495481] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-07T17:00:47.682970] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T17:00:47.694989] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-07T17:00:48.293756] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T17:00:48.297712] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-07T17:00:49.074037] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T17:00:49.080414] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-07T17:00:49.214976] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T17:00:49.227232] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-07T17:00:49.415747] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T17:00:49.421143] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-07T17:00:49.539567] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-07T17:00:49.551670] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-07T17:00:49.985479] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T17:00:49.994832] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-07T17:00:50.648040] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T17:00:50.654600] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-07T17:00:50.999479] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T17:00:51.011901] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-07T17:00:51.098832] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T17:00:51.104890] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-07T17:00:51.188147] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T17:00:51.200241] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-07T17:00:51.302404] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T17:00:51.306762] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-07T17:00:51.966296] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T17:00:51.970586] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-10-07T17:00:51.970763] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-07T17:00:52.251892] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T17:00:52.267444] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-07T17:00:52.479403] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-07T17:00:52.479891] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-07T17:00:52.481191] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-07T17:00:52.481292] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-07T17:00:52.501175] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T17:00:52.508268] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 53685 (keeping 200 days of data) [2025-10-07T17:00:52.509137] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-07T17:00:52.851706] [DEBUG] [LOCAL ] ABBV: Primary data saved (53685 records). [2025-10-07T17:00:52.851887] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-07T17:00:52.851978] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABBV took 24.8s. Estimated remaining: 3h 11m 7s. Rate: 12.4 symbols/min [2025-10-07T17:00:52.962322] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-07T17:00:52.974917] [INFO ] [REMOTE ] ABEV: Full fetch complete (77221 records). [2025-10-07T17:00:52.985817] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-07T17:00:53.094169] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:53.533062] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T17:00:53.536242] [DEBUG] [LOCAL ] ABR: Loaded 52007 existing records from primary storage. [2025-10-07T17:00:53.535260] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-07T17:00:53.540245] [INFO ] [MAIN ] ABR: Loaded 52007 existing records. [2025-10-07T17:00:53.540070] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-07T17:00:53.562433] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-07T17:00:53.541370] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-07T17:00:53.573593] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-07T17:00:53.649298] [DEBUG] [LOCAL ] ABEV: Trimmed 77221 records to 53279 (keeping 200 days of data) [2025-10-07T17:00:53.792437] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:53.793240] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-07T17:00:53.819076] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-07T17:00:53.830950] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-07T17:00:53.831064] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-07T17:00:54.238699] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T17:00:54.282389] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-07T17:00:54.382411] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:54.384852] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-07T17:00:54.497493] [DEBUG] [LOCAL ] ABEV: Primary data saved (53279 records). [2025-10-07T17:00:54.497635] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-07T17:00:54.497756] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 23.1s. Estimated remaining: 2h 59m 33s. Rate: 13.1 symbols/min [2025-10-07T17:00:54.681122] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:54.682191] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T17:00:54.687278] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-07T17:00:54.743257] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-10-07T17:00:54.743634] [INFO ] [MAIN ] ABT: Loaded 53620 existing records. [2025-10-07T17:00:54.921095] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:00:54.921371] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-07T17:00:54.921426] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-07T17:00:54.923040] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-07T17:00:54.923105] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-07T17:00:55.278012] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:55.278321] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-07T17:00:55.439084] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T17:00:55.444979] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-07T17:00:55.492145] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T17:00:55.496311] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-07T17:00:56.270613] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T17:00:56.280819] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-07T17:00:56.453189] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T17:00:56.455663] [INFO ] [REMOTE ] ABG: Full fetch complete (26625 records). [2025-10-07T17:00:56.455909] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-07T17:00:56.645440] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-07T17:00:56.760244] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-07T17:00:56.887484] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-07T17:00:56.887705] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-07T17:00:56.888095] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-07T17:00:56.888179] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-07T17:00:56.889289] [DEBUG] [LOCAL ] ABG: Trimmed 26625 records to 18537 (keeping 200 days of data) [2025-10-07T17:00:57.007527] [DEBUG] [LOCAL ] ABG: Primary data saved (18537 records). [2025-10-07T17:00:57.008037] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-07T17:00:57.008344] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 12.8s. Estimated remaining: 2h 52m 44s. Rate: 13.7 symbols/min [2025-10-07T17:00:57.195557] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T17:00:57.210613] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-07T17:00:57.232326] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:00:57.233408] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-07T17:00:57.233497] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-07T17:00:57.233686] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-07T17:00:57.233749] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-07T17:00:57.233798] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-07T17:00:57.233844] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-07T17:00:57.598152] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:00:57.598682] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-07T17:00:57.721187] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T17:00:57.732727] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-07T17:00:57.816112] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T17:00:57.824736] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-07T17:00:59.109897] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T17:00:59.114396] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-07T17:00:59.794436] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-07T17:00:59.822183] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-07T17:00:59.823481] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T17:00:59.831587] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-07T17:01:00.475355] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-07T17:01:00.500577] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-07T17:01:00.501087] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T17:01:00.507277] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-07T17:01:01.611726] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T17:01:01.619889] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-07T17:01:01.840582] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-07T17:01:01.846194] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-07T17:01:02.654329] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-10-07T17:01:02.669226] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-07T17:01:02.830918] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T17:01:02.838536] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-07T17:01:03.239878] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T17:01:03.242703] [INFO ] [REMOTE ] ABM: Full fetch complete (45037 records). [2025-10-07T17:01:03.242827] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-07T17:01:03.675602] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-07T17:01:03.675711] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-07T17:01:03.676187] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-07T17:01:03.676234] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-07T17:01:03.677284] [DEBUG] [LOCAL ] ABM: Trimmed 45037 records to 32062 (keeping 200 days of data) [2025-10-07T17:01:03.872811] [DEBUG] [LOCAL ] ABM: Primary data saved (32062 records). [2025-10-07T17:01:03.872965] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-07T17:01:03.873051] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 17.1s. Estimated remaining: 3h 0m 8s. Rate: 13.1 symbols/min [2025-10-07T17:01:04.043972] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:01:04.081118] [DEBUG] [LOCAL ] ACCO: Loaded 37176 existing records from primary storage. [2025-10-07T17:01:04.081449] [INFO ] [MAIN ] ACCO: Loaded 37176 existing records. [2025-10-07T17:01:04.273478] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:01:04.290688] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-07T17:01:04.291820] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-07T17:01:04.292562] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T17:01:04.299557] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-07T17:01:04.300841] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-07T17:01:04.301039] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-07T17:01:04.708756] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:01:04.709909] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-07T17:01:04.711770] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (4.21 seconds). [2025-10-07T17:01:04.725265] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-07T17:01:04.766132] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-07T17:01:04.779006] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-07T17:01:05.687209] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T17:01:05.692901] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-07T17:01:06.270512] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T17:01:06.277890] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-07T17:01:06.655786] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T17:01:06.668730] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-07T17:01:06.702747] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T17:01:06.715215] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-07T17:01:06.747486] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T17:01:06.752593] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-07T17:01:07.639605] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T17:01:07.647537] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-07T17:01:07.750402] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T17:01:07.756019] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-07T17:01:08.379915] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T17:01:08.391746] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-07T17:01:08.606717] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T17:01:08.618925] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-07T17:01:08.709348] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T17:01:08.716607] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-07T17:01:08.828297] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T17:01:08.834261] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-07T17:01:09.753183] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T17:01:09.764828] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-07T17:01:09.778738] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T17:01:09.783853] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-07T17:01:10.218227] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T17:01:10.227122] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-07T17:01:10.462027] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T17:01:10.477682] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-07T17:01:10.570000] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T17:01:10.571968] [INFO ] [REMOTE ] ACA: Full fetch complete (34391 records). [2025-10-07T17:01:10.572058] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-07T17:01:10.961623] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-07T17:01:10.961743] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-07T17:01:10.962133] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-07T17:01:10.962179] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-07T17:01:10.963258] [DEBUG] [LOCAL ] ACA: Trimmed 34391 records to 23241 (keeping 200 days of data) [2025-10-07T17:01:11.103076] [DEBUG] [LOCAL ] ACA: Primary data saved (23241 records). [2025-10-07T17:01:11.103216] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-07T17:01:11.103295] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 14.1s. Estimated remaining: 3h 7m 29s. Rate: 12.6 symbols/min [2025-10-07T17:01:11.283618] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:01:11.314258] [DEBUG] [LOCAL ] ACEL: Loaded 26688 existing records from primary storage. [2025-10-07T17:01:11.314631] [INFO ] [MAIN ] ACEL: Loaded 26688 existing records. [2025-10-07T17:01:11.500584] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:01:11.500980] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-07T17:01:11.501161] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-07T17:01:11.501526] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-07T17:01:11.501620] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-07T17:01:11.691325] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T17:01:11.806903] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-07T17:01:11.917557] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:01:11.917943] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-07T17:01:11.955562] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-07T17:01:11.998492] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T17:01:12.647701] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-07T17:01:13.088706] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-07T17:01:13.184985] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T17:01:13.447684] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-07T17:01:14.108538] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T17:01:14.247675] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-07T17:01:14.583899] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T17:01:15.047704] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-07T17:01:15.847623] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-07T17:01:16.039530] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T17:01:16.099099] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T17:01:16.647704] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-07T17:01:17.415346] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T17:01:17.447695] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-07T17:01:18.247723] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-07T17:01:18.519013] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T17:01:19.010410] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-07T17:01:19.047601] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-07T17:01:19.306705] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T17:01:19.847672] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-07T17:01:20.647705] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-07T17:01:20.978881] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T17:01:21.249937] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T17:01:21.447778] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-07T17:01:22.247750] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-07T17:01:22.364879] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T17:01:22.368504] [INFO ] [REMOTE ] ABT: Full fetch complete (77596 records). [2025-10-07T17:01:22.368675] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-07T17:01:22.781532] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-07T17:01:22.781631] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-07T17:01:22.782451] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-07T17:01:22.782516] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-07T17:01:22.784277] [DEBUG] [LOCAL ] ABT: Trimmed 77596 records to 53623 (keeping 200 days of data) [2025-10-07T17:01:23.026920] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-07T17:01:23.032096] [INFO ] [REMOTE ] ABR: Full fetch complete (75260 records). [2025-10-07T17:01:23.033698] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-07T17:01:23.052822] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-07T17:01:23.427708] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T17:01:23.583163] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-07T17:01:23.583491] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-07T17:01:23.584254] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-07T17:01:23.584635] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-07T17:01:23.588777] [DEBUG] [LOCAL ] ABR: Trimmed 75260 records to 51989 (keeping 200 days of data) [2025-10-07T17:01:23.715965] [DEBUG] [LOCAL ] ABT: Primary data saved (53623 records). [2025-10-07T17:01:23.716796] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-07T17:01:23.719030] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABT took 29.2s. Estimated remaining: 3h 27m 56s. Rate: 11.3 symbols/min [2025-10-07T17:01:23.850011] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-07T17:01:23.909798] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:01:24.076974] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-07T17:01:24.078225] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-07T17:01:24.288786] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:01:24.294618] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-07T17:01:24.294811] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-07T17:01:24.329628] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-07T17:01:24.355856] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-07T17:01:24.737718] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T17:01:24.818703] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-07T17:01:24.817898] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:01:24.823545] [DEBUG] [LOCAL ] ABR: Primary data saved (51989 records). [2025-10-07T17:01:24.823835] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-07T17:01:24.824040] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABR took 32.0s. Estimated remaining: 3h 17m 34s. Rate: 11.9 symbols/min [2025-10-07T17:01:25.017468] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T17:01:25.050342] [INFO ] [REMOTE ] ACCO: Full fetch complete (53748 records). [2025-10-07T17:01:25.069490] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:01:25.069736] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-07T17:01:25.070962] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:01:25.071093] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:01:25.071177] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:01:25.071273] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-07T17:01:25.071356] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-07T17:01:25.071396] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-07T17:01:25.071599] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-10-07T17:01:25.072831] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 21.2s. Estimated remaining: 3h 6m 27s. Rate: 12.6 symbols/min [2025-10-07T17:01:25.252812] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:01:25.294029] [DEBUG] [LOCAL ] ACI: Loaded 53254 existing records from primary storage. [2025-10-07T17:01:25.294590] [INFO ] [MAIN ] ACI: Loaded 53254 existing records. [2025-10-07T17:01:25.454417] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-07T17:01:25.503524] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:01:25.516445] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-07T17:01:25.518184] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-07T17:01:25.519494] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-07T17:01:25.519448] [DEBUG] [LOCAL ] ACM: Loaded 43034 existing records from primary storage. [2025-10-07T17:01:25.519883] [INFO ] [MAIN ] ACM: Loaded 43034 existing records. [2025-10-07T17:01:25.519756] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-07T17:01:25.875264] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:01:25.929521] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-07T17:01:25.944747] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-07T17:01:25.964285] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-07T17:01:25.991535] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-07T17:01:26.227439] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:01:26.252716] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-07T17:01:26.353210] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T17:01:26.536058] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:01:27.047694] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-07T17:01:27.847759] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-07T17:01:28.135213] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-07T17:01:28.268085] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-07T17:01:28.359068] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T17:01:28.537968] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T17:01:28.647759] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-07T17:01:29.447756] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-07T17:01:29.827166] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T17:01:30.247741] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-07T17:01:30.988760] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T17:01:31.047755] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-07T17:01:31.847746] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-07T17:01:32.647715] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-07T17:01:32.694906] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T17:01:32.794332] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-07T17:01:33.363362] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T17:01:33.447758] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-07T17:01:33.820237] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T17:01:34.247725] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-07T17:01:35.051936] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-07T17:01:35.060788] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T17:01:35.848523] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-07T17:01:35.852206] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T17:01:36.647706] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-07T17:01:37.443450] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-07T17:01:37.457592] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-07T17:01:37.690508] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T17:01:37.724933] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-07T17:01:38.247731] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-07T17:01:39.047716] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-07T17:01:39.186461] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T17:01:39.847736] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-07T17:01:40.647729] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-07T17:01:40.870390] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T17:01:40.873275] [INFO ] [REMOTE ] ACEL: Full fetch complete (38697 records). [2025-10-07T17:01:40.873407] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-07T17:01:41.179255] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.93 seconds). [2025-10-07T17:01:41.347370] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-07T17:01:41.374353] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-07T17:01:41.374771] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-07T17:01:41.375381] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-07T17:01:41.375492] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-07T17:01:41.376975] [DEBUG] [LOCAL ] ACEL: Trimmed 38697 records to 26706 (keeping 200 days of data) [2025-10-07T17:01:41.464500] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-07T17:01:41.546973] [DEBUG] [LOCAL ] ACEL: Primary data saved (26706 records). [2025-10-07T17:01:41.547152] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-07T17:01:41.547248] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 30.4s. Estimated remaining: 3h 31m 54s. Rate: 11.1 symbols/min [2025-10-07T17:01:41.728636] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:01:41.789376] [DEBUG] [LOCAL ] ACN: Loaded 53428 existing records from primary storage. [2025-10-07T17:01:41.789935] [INFO ] [MAIN ] ACN: Loaded 53428 existing records. [2025-10-07T17:01:42.000219] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:01:42.000690] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-07T17:01:42.000874] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-07T17:01:42.001257] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-07T17:01:42.001329] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-07T17:01:42.258712] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-07T17:01:42.401160] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:01:42.427758] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T17:01:43.047735] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-07T17:01:43.847684] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-07T17:01:43.895115] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-07T17:01:44.130711] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T17:01:44.595207] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T17:01:44.647696] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-07T17:01:45.447728] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-07T17:01:45.486407] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T17:01:46.247745] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-07T17:01:46.291073] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T17:01:46.821416] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T17:01:47.047696] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-07T17:01:47.847747] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-07T17:01:48.647792] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-07T17:01:48.698469] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T17:01:48.988343] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-07T17:01:49.326357] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T17:01:49.447696] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-07T17:01:50.177260] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T17:01:50.247717] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-07T17:01:50.997999] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T17:01:51.047745] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-07T17:01:51.847760] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-07T17:01:52.647769] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-07T17:01:52.806513] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T17:01:52.903286] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-07T17:01:53.447627] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-07T17:01:53.620603] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T17:01:54.247722] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-07T17:01:54.329035] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T17:01:55.047690] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-07T17:01:55.847631] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-07T17:01:55.986405] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T17:01:56.034821] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-07T17:01:56.588590] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T17:01:56.591837] [INFO ] [REMOTE ] ACI: Full fetch complete (76655 records). [2025-10-07T17:01:56.592008] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-07T17:01:56.593098] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:01:56.593199] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:01:56.593243] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:01:56.593286] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-07T17:01:56.593364] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-07T17:01:56.593438] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-10-07T17:01:56.593770] [DEBUG] [LOCAL ] ACI: Deleted derivative data file. [2025-10-07T17:01:56.595259] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACI took 31.8s. Estimated remaining: 3h 51m 43s. Rate: 10.2 symbols/min [2025-10-07T17:01:56.658851] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-07T17:01:56.773330] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:01:56.813426] [DEBUG] [LOCAL ] ACP: Loaded 30961 existing records from primary storage. [2025-10-07T17:01:56.813741] [INFO ] [MAIN ] ACP: Loaded 30961 existing records. [2025-10-07T17:01:56.994507] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:01:56.994775] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-07T17:01:56.994837] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-07T17:01:56.995029] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-07T17:01:56.995088] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-07T17:01:57.252317] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T17:01:57.293823] [INFO ] [REMOTE ] ACM: Full fetch complete (62788 records). [2025-10-07T17:01:57.294043] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-07T17:01:57.476191] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-07T17:01:57.482600] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:01:57.805160] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-07T17:01:57.805275] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-07T17:01:57.805913] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-07T17:01:57.805985] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-07T17:01:57.807524] [DEBUG] [LOCAL ] ACM: Trimmed 62788 records to 43061 (keeping 200 days of data) [2025-10-07T17:01:58.089010] [DEBUG] [LOCAL ] ACM: Primary data saved (43061 records). [2025-10-07T17:01:58.089161] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-07T17:01:58.090112] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACM took 33.0s. Estimated remaining: 3h 42m 58s. Rate: 10.5 symbols/min [2025-10-07T17:01:58.257865] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-07T17:01:58.261780] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:01:58.273017] [DEBUG] [LOCAL ] ACR: Loaded 5753 existing records from primary storage. [2025-10-07T17:01:58.273283] [INFO ] [MAIN ] ACR: Loaded 5753 existing records. [2025-10-07T17:01:58.458082] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:01:58.458324] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-07T17:01:58.462035] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-07T17:01:58.462261] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-07T17:01:58.462321] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-07T17:01:58.819609] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:01:59.047723] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-07T17:01:59.368220] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-07T17:01:59.489073] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T17:01:59.528074] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T17:01:59.764360] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-07T17:01:59.847634] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-07T17:02:00.647704] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-07T17:02:01.404341] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T17:02:01.447700] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-07T17:02:01.890324] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-07T17:02:02.159952] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T17:02:02.247615] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-07T17:02:03.047640] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-07T17:02:03.077329] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T17:02:03.847737] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-07T17:02:04.647687] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-07T17:02:04.746155] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T17:02:05.260405] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T17:02:05.447687] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-07T17:02:06.247754] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-07T17:02:06.847226] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T17:02:07.047690] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-07T17:02:07.277077] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-07T17:02:07.847703] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-07T17:02:08.448159] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T17:02:08.488799] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-07T17:02:08.522722] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T17:02:08.647688] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-07T17:02:09.447709] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-07T17:02:10.247696] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-07T17:02:10.304457] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T17:02:11.047704] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-07T17:02:11.078244] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T17:02:11.847699] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-07T17:02:12.031027] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-07T17:02:12.035261] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-07T17:02:12.035457] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-07T17:02:12.507162] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-07T17:02:12.507429] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-07T17:02:12.508531] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-07T17:02:12.508625] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-07T17:02:12.510792] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-07T17:02:12.589798] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T17:02:12.647707] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-07T17:02:12.938021] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T17:02:12.958900] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-07T17:02:12.959781] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-07T17:02:12.961093] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 49.2s. Estimated remaining: 3h 59m 59s. Rate: 9.8 symbols/min [2025-10-07T17:02:13.160084] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:02:13.206700] [DEBUG] [LOCAL ] ACRE: Loaded 33652 existing records from primary storage. [2025-10-07T17:02:13.207356] [INFO ] [MAIN ] ACRE: Loaded 33652 existing records. [2025-10-07T17:02:13.450287] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-07T17:02:13.486666] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:02:13.488704] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-07T17:02:13.488817] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-07T17:02:13.489922] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-07T17:02:13.490032] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-07T17:02:14.098420] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:02:14.134567] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T17:02:14.247720] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-07T17:02:14.877915] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T17:02:15.047688] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-07T17:02:15.281010] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T17:02:15.632783] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-07T17:02:15.847711] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-07T17:02:16.647710] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-07T17:02:17.080325] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T17:02:17.447686] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-07T17:02:18.063556] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T17:02:18.247700] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-07T17:02:18.927044] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T17:02:19.047762] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-07T17:02:19.847724] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-07T17:02:20.243423] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-07T17:02:20.246493] [INFO ] [REMOTE ] ACN: Full fetch complete (76761 records). [2025-10-07T17:02:20.246608] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-07T17:02:20.247430] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:02:20.247524] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:02:20.247569] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:02:20.247610] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-07T17:02:20.247759] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-07T17:02:20.247818] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-10-07T17:02:20.248142] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-10-07T17:02:20.249449] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 38.7s. Estimated remaining: 4h 1m 57s. Rate: 9.7 symbols/min [2025-10-07T17:02:20.436053] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:02:20.436425] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-07T17:02:20.436495] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-07T17:02:20.442596] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-07T17:02:20.442720] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-07T17:02:20.457029] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-07T17:02:20.457485] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-07T17:02:20.492624] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T17:02:20.654094] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-07T17:02:20.842120] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:02:20.944763] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T17:02:21.447742] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-07T17:02:21.959220] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T17:02:22.105202] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-07T17:02:22.247719] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-07T17:02:23.047725] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-07T17:02:23.394413] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T17:02:23.396714] [INFO ] [REMOTE ] ACP: Full fetch complete (46774 records). [2025-10-07T17:02:23.396879] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-07T17:02:23.397700] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:02:23.397797] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:02:23.397849] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:02:23.397917] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-07T17:02:23.397992] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-07T17:02:23.398031] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-07T17:02:23.398291] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-07T17:02:23.398466] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACP took 26.8s. Estimated remaining: 3h 56m 42s. Rate: 9.9 symbols/min [2025-10-07T17:02:23.591313] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:02:23.645150] [DEBUG] [LOCAL ] ACVA: Loaded 49225 existing records from primary storage. [2025-10-07T17:02:23.645508] [INFO ] [MAIN ] ACVA: Loaded 49225 existing records. [2025-10-07T17:02:23.820677] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:02:23.820938] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-07T17:02:23.820988] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-07T17:02:23.821491] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-07T17:02:23.821553] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-07T17:02:23.852833] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-07T17:02:24.187852] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:02:24.445992] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T17:02:24.471533] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T17:02:24.472513] [INFO ] [REMOTE ] ACR: Full fetch complete (8597 records). [2025-10-07T17:02:24.472599] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-07T17:02:24.654087] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-07T17:02:24.924371] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-07T17:02:24.924464] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-07T17:02:24.924701] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-07T17:02:24.924775] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-07T17:02:24.925241] [DEBUG] [LOCAL ] ACR: Trimmed 8597 records to 5692 (keeping 200 days of data) [2025-10-07T17:02:24.964816] [DEBUG] [LOCAL ] ACR: Primary data saved (5692 records). [2025-10-07T17:02:24.964960] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-07T17:02:24.965068] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 26.9s. Estimated remaining: 3h 49m 17s. Rate: 10.2 symbols/min [2025-10-07T17:02:25.142047] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:02:25.142276] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-07T17:02:25.142320] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-07T17:02:25.142436] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-07T17:02:25.142482] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-07T17:02:25.142525] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-07T17:02:25.142559] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-07T17:02:25.453159] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-07T17:02:25.549030] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:02:25.642094] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T17:02:26.247725] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-07T17:02:26.739238] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T17:02:26.873545] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T17:02:27.047745] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-07T17:02:27.652104] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T17:02:27.847688] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-07T17:02:28.647758] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-07T17:02:29.335087] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T17:02:29.447702] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-07T17:02:29.650901] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:02:29.651211] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-07T17:02:29.651301] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:02:29.651352] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-07T17:02:29.651416] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:02:29.651494] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-07T17:02:29.651564] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-07T17:02:29.651721] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-07T17:02:29.651790] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-07T17:02:29.651843] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 4.7s. Estimated remaining: 3h 47m 21s. Rate: 10.3 symbols/min [2025-10-07T17:02:29.829226] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:02:29.877223] [DEBUG] [LOCAL ] ADC: Loaded 46204 existing records from primary storage. [2025-10-07T17:02:29.877546] [INFO ] [MAIN ] ADC: Loaded 46204 existing records. [2025-10-07T17:02:30.062668] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:02:30.063071] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-07T17:02:30.063214] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-07T17:02:30.063557] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-07T17:02:30.063629] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-07T17:02:30.195562] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T17:02:30.253390] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-07T17:02:30.498947] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:02:31.047700] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-07T17:02:31.114997] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T17:02:31.847727] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-07T17:02:32.208786] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T17:02:32.623615] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T17:02:32.647702] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-07T17:02:33.447731] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-07T17:02:33.956693] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T17:02:34.247736] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-07T17:02:34.932053] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T17:02:35.047628] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-07T17:02:35.847686] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-07T17:02:35.916841] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T17:02:36.583559] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T17:02:36.647778] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-07T17:02:37.225287] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T17:02:37.447699] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-07T17:02:38.158400] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T17:02:38.247600] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-07T17:02:38.652479] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T17:02:39.047719] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-07T17:02:39.847696] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-07T17:02:40.062726] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T17:02:40.394174] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-07T17:02:40.647703] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-07T17:02:40.688917] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T17:02:41.245101] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T17:02:41.447756] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-07T17:02:42.247752] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-07T17:02:43.047733] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-07T17:02:43.109144] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T17:02:43.409595] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T17:02:43.847685] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-07T17:02:43.876047] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T17:02:44.647786] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-07T17:02:45.447750] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-07T17:02:45.528325] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T17:02:46.065839] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T17:02:46.224099] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T17:02:46.247610] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-07T17:02:47.047744] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-07T17:02:47.646378] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T17:02:47.847678] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-07T17:02:47.973898] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T17:02:47.976140] [INFO ] [REMOTE ] ACRE: Full fetch complete (50187 records). [2025-10-07T17:02:47.976232] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-07T17:02:47.977106] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:02:47.977195] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:02:47.977238] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:02:47.977279] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-07T17:02:47.977354] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-07T17:02:47.977411] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-10-07T17:02:47.977751] [DEBUG] [LOCAL ] ACRE: Deleted derivative data file. [2025-10-07T17:02:47.977847] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 35.0s. Estimated remaining: 4h 6m 4s. Rate: 9.5 symbols/min [2025-10-07T17:02:48.155681] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:02:48.155903] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-07T17:02:48.155942] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-07T17:02:48.156060] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-07T17:02:48.156109] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-07T17:02:48.156152] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-07T17:02:48.156186] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-07T17:02:48.532566] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:02:48.647693] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-07T17:02:49.447706] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-07T17:02:49.506978] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T17:02:50.247753] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-07T17:02:50.427571] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T17:02:51.047744] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-07T17:02:51.074447] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T17:02:51.208357] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T17:02:51.847705] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-07T17:02:52.647694] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-07T17:02:52.718489] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T17:02:53.328726] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T17:02:53.418046] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T17:02:53.447691] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-07T17:02:54.249269] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-07T17:02:54.253379] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T17:02:54.255451] [INFO ] [REMOTE ] ACV: Full fetch complete (10147 records). [2025-10-07T17:02:54.255690] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-07T17:02:54.667738] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-07T17:02:54.667834] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-07T17:02:54.668059] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-07T17:02:54.668105] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-07T17:02:54.668966] [DEBUG] [LOCAL ] ACV: Trimmed 10147 records to 7506 (keeping 200 days of data) [2025-10-07T17:02:54.722531] [DEBUG] [LOCAL ] ACV: Primary data saved (7506 records). [2025-10-07T17:02:54.722746] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-07T17:02:54.722847] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACV took 34.5s. Estimated remaining: 4h 6m 37s. Rate: 9.5 symbols/min [2025-10-07T17:02:54.899493] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:02:54.958451] [DEBUG] [LOCAL ] ADM: Loaded 53390 existing records from primary storage. [2025-10-07T17:02:54.958895] [INFO ] [MAIN ] ADM: Loaded 53390 existing records. [2025-10-07T17:02:55.052931] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-07T17:02:55.162522] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:02:55.162785] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-07T17:02:55.162838] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-07T17:02:55.163115] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-07T17:02:55.163175] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-07T17:02:55.560889] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:02:55.850845] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-07T17:02:55.857786] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T17:02:56.605424] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T17:02:56.647755] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-07T17:02:57.447760] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-07T17:02:57.688352] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T17:02:58.084008] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T17:02:58.087286] [INFO ] [REMOTE ] ACVA: Full fetch complete (70159 records). [2025-10-07T17:02:58.087470] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-07T17:02:58.088435] [FATAL] [VALIDATOR ] ACVA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:02:58.088551] [FATAL] [MAIN ] ACVA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:02:58.088597] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:02:58.088687] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-07T17:02:58.088954] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-07T17:02:58.089295] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-10-07T17:02:58.089626] [DEBUG] [LOCAL ] ACVA: Deleted derivative data file. [2025-10-07T17:02:58.091881] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 34.7s. Estimated remaining: 4h 2m 24s. Rate: 9.7 symbols/min [2025-10-07T17:02:58.254758] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-07T17:02:58.294111] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:02:58.348538] [DEBUG] [LOCAL ] ADNT: Loaded 47236 existing records from primary storage. [2025-10-07T17:02:58.348989] [INFO ] [MAIN ] ADNT: Loaded 47236 existing records. [2025-10-07T17:02:58.553548] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:02:58.554090] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-07T17:02:58.554242] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-07T17:02:58.562373] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-07T17:02:58.576974] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-07T17:02:58.578983] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T17:02:58.963683] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:02:59.047700] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-07T17:02:59.847739] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-07T17:03:00.301789] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-07T17:03:00.647623] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-07T17:03:00.976475] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-07T17:03:01.329047] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T17:03:01.447719] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-07T17:03:02.198038] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T17:03:02.247699] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-07T17:03:03.047740] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-07T17:03:03.105498] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T17:03:03.848196] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-07T17:03:04.056773] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T17:03:04.317802] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T17:03:04.647726] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-07T17:03:05.037684] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T17:03:05.447711] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-07T17:03:06.104757] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T17:03:06.247730] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-07T17:03:07.047705] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-07T17:03:07.124186] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T17:03:07.847634] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-07T17:03:07.884915] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T17:03:08.545637] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T17:03:08.647740] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-07T17:03:09.452809] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-07T17:03:09.473885] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T17:03:10.247667] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-07T17:03:10.339675] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T17:03:11.047743] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-07T17:03:11.442702] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T17:03:11.847694] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-07T17:03:11.923173] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T17:03:12.578189] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T17:03:12.647675] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-07T17:03:13.447626] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-07T17:03:13.739518] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T17:03:14.161987] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T17:03:14.164935] [INFO ] [REMOTE ] ADC: Full fetch complete (65966 records). [2025-10-07T17:03:14.165096] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-07T17:03:14.166040] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:03:14.166138] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:03:14.166181] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:03:14.166249] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-07T17:03:14.166317] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-07T17:03:14.166356] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-07T17:03:14.166533] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-07T17:03:14.168339] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 44.5s. Estimated remaining: 4h 15m 35s. Rate: 9.2 symbols/min [2025-10-07T17:03:14.252801] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-07T17:03:14.360711] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:03:14.418159] [DEBUG] [LOCAL ] ADT: Loaded 53450 existing records from primary storage. [2025-10-07T17:03:14.418547] [INFO ] [MAIN ] ADT: Loaded 53450 existing records. [2025-10-07T17:03:14.613717] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:03:14.614003] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-07T17:03:14.614165] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-07T17:03:14.614698] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-07T17:03:14.614833] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-07T17:03:14.749863] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T17:03:15.011319] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:03:15.047598] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-07T17:03:15.847634] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-07T17:03:16.123169] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-07T17:03:16.647780] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-07T17:03:17.085109] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-07T17:03:17.397215] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T17:03:17.447743] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-07T17:03:18.247691] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-07T17:03:18.495716] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T17:03:18.922449] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T17:03:19.047701] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-07T17:03:19.790600] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:03:19.847597] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-07T17:03:20.411733] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T17:03:20.414280] [INFO ] [REMOTE ] ADCT: Full fetch complete (51124 records). [2025-10-07T17:03:20.414390] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-07T17:03:20.415116] [FATAL] [VALIDATOR ] ADCT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:03:20.415218] [FATAL] [MAIN ] ADCT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:03:20.415262] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:03:20.415303] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-07T17:03:20.415362] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-07T17:03:20.415397] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-10-07T17:03:20.415453] [DEBUG] [LOCAL ] ADCT: No derivative data file found to delete. [2025-10-07T17:03:20.415541] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADCT took 32.4s. Estimated remaining: 4h 15m 5s. Rate: 9.2 symbols/min [2025-10-07T17:03:20.588174] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:03:20.623626] [DEBUG] [LOCAL ] ADX: Loaded 27478 existing records from primary storage. [2025-10-07T17:03:20.623924] [INFO ] [MAIN ] ADX: Loaded 27478 existing records. [2025-10-07T17:03:20.654343] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-07T17:03:20.806746] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:03:20.806950] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-07T17:03:20.806995] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-07T17:03:20.807565] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-07T17:03:20.807622] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-07T17:03:21.173551] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:03:21.201509] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T17:03:21.447705] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-07T17:03:22.247753] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-07T17:03:22.841779] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-07T17:03:23.047625] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-07T17:03:23.126929] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T17:03:23.847730] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-07T17:03:23.965314] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T17:03:24.647734] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-07T17:03:24.867227] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-07T17:03:25.407179] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T17:03:25.447739] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-07T17:03:26.045858] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T17:03:26.247725] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-07T17:03:27.047738] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-07T17:03:27.136574] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-07T17:03:27.142105] [INFO ] [REMOTE ] ADM: Full fetch complete (77260 records). [2025-10-07T17:03:27.142291] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-07T17:03:27.572401] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-07T17:03:27.572634] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-07T17:03:27.573495] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-07T17:03:27.573580] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-07T17:03:27.597556] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T17:03:27.604523] [DEBUG] [LOCAL ] ADM: Trimmed 77260 records to 53390 (keeping 200 days of data) [2025-10-07T17:03:27.847932] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-07T17:03:27.954699] [DEBUG] [LOCAL ] ADM: Primary data saved (53390 records). [2025-10-07T17:03:27.954864] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-07T17:03:27.956048] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 33.2s. Estimated remaining: 4h 16m 14s. Rate: 9.1 symbols/min [2025-10-07T17:03:28.140317] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:03:28.146511] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T17:03:28.153146] [INFO ] [REMOTE ] ADNT: Full fetch complete (67988 records). [2025-10-07T17:03:28.153476] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-07T17:03:28.528917] [DEBUG] [LOCAL ] AEE: Loaded 50105 existing records from primary storage. [2025-10-07T17:03:28.545250] [INFO ] [MAIN ] AEE: Loaded 50105 existing records. [2025-10-07T17:03:28.662840] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-07T17:03:28.773518] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-07T17:03:28.778783] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-07T17:03:28.804062] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-07T17:03:28.845736] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-07T17:03:28.845572] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:03:28.846444] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-07T17:03:28.846504] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-07T17:03:28.847069] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-07T17:03:28.847134] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-07T17:03:28.961252] [DEBUG] [LOCAL ] ADNT: Trimmed 67988 records to 47253 (keeping 200 days of data) [2025-10-07T17:03:29.424074] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T17:03:29.507607] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-07T17:03:29.515825] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:03:29.693830] [DEBUG] [LOCAL ] ADNT: Primary data saved (47253 records). [2025-10-07T17:03:29.693990] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-07T17:03:29.695014] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 31.6s. Estimated remaining: 4h 10m 14s. Rate: 9.3 symbols/min [2025-10-07T17:03:29.891905] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:03:29.906120] [DEBUG] [LOCAL ] AEFC: Loaded 8467 existing records from primary storage. [2025-10-07T17:03:29.906362] [INFO ] [MAIN ] AEFC: Loaded 8467 existing records. [2025-10-07T17:03:30.090761] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:03:30.091022] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-07T17:03:30.091100] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-07T17:03:30.091363] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-07T17:03:30.091430] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-07T17:03:30.261242] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-07T17:03:30.483803] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:03:30.505824] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T17:03:30.546953] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T17:03:31.047757] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-07T17:03:31.767701] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T17:03:31.847687] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-07T17:03:31.921302] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T17:03:32.647726] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-07T17:03:33.332206] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T17:03:33.447683] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-07T17:03:34.247711] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-07T17:03:34.542400] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T17:03:34.976231] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T17:03:35.047729] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-07T17:03:35.237467] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T17:03:35.847696] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-07T17:03:36.450583] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T17:03:36.647679] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-07T17:03:37.105392] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T17:03:37.447700] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-07T17:03:37.678130] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T17:03:38.247743] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-07T17:03:39.017698] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T17:03:39.047663] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-07T17:03:39.213321] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-07T17:03:39.847697] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-07T17:03:40.647685] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-07T17:03:40.790228] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T17:03:41.106156] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T17:03:41.428068] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-07T17:03:41.447744] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-07T17:03:42.247748] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-07T17:03:42.390250] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T17:03:43.047875] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-07T17:03:43.847747] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-07T17:03:44.067145] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T17:03:44.518894] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T17:03:44.520753] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:03:44.647734] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-07T17:03:45.375435] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T17:03:45.447608] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-07T17:03:46.076535] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T17:03:46.247722] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-07T17:03:46.995097] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T17:03:47.047716] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-07T17:03:47.847713] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-07T17:03:48.415219] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T17:03:48.415918] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T17:03:48.647694] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-07T17:03:49.447698] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-07T17:03:50.118716] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T17:03:50.119737] [INFO ] [REMOTE ] AEFC: Full fetch complete (12013 records). [2025-10-07T17:03:50.119814] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-07T17:03:50.249674] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-07T17:03:50.514370] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-07T17:03:50.514498] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-07T17:03:50.515005] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-07T17:03:50.515090] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-07T17:03:50.516165] [DEBUG] [LOCAL ] AEFC: Trimmed 12013 records to 8446 (keeping 200 days of data) [2025-10-07T17:03:50.591950] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T17:03:50.616089] [DEBUG] [LOCAL ] AEFC: Primary data saved (8446 records). [2025-10-07T17:03:50.616261] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-07T17:03:50.616375] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. AEFC took 20.9s. Estimated remaining: 4h 27m 15s. Rate: 8.7 symbols/min [2025-10-07T17:03:50.787560] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:03:50.787793] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-10-07T17:03:50.787847] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-10-07T17:03:50.788017] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-07T17:03:50.788072] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-07T17:03:50.788126] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-07T17:03:50.788169] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-07T17:03:51.052902] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-07T17:03:51.144859] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:03:51.847710] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-07T17:03:51.875341] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T17:03:52.523107] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T17:03:52.647687] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-07T17:03:53.274942] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T17:03:53.447682] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-07T17:03:54.247620] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-07T17:03:54.567954] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T17:03:54.612431] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T17:03:55.047746] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-07T17:03:55.847636] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-07T17:03:56.187059] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T17:03:56.507590] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T17:03:56.647671] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-07T17:03:57.447685] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-07T17:03:57.490585] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T17:03:57.837362] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T17:03:58.247780] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-07T17:03:58.824103] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T17:03:59.047749] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-07T17:03:59.846724] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T17:03:59.849782] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-07T17:03:59.851617] [INFO ] [REMOTE ] AEE: Full fetch complete (72714 records). [2025-10-07T17:03:59.851723] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-07T17:04:00.048189] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T17:04:00.119200] [INFO ] [REMOTE ] ADX: Full fetch complete (41903 records). [2025-10-07T17:04:00.169204] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-07T17:04:00.442114] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-07T17:04:00.443451] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-07T17:04:00.451244] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-07T17:04:00.458899] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-07T17:04:00.578621] [DEBUG] [LOCAL ] AEE: Trimmed 72714 records to 50121 (keeping 200 days of data) [2025-10-07T17:04:00.668227] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-07T17:04:00.798618] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-07T17:04:00.799543] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-07T17:04:00.800379] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-07T17:04:00.800814] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-07T17:04:00.806697] [DEBUG] [LOCAL ] ADX: Trimmed 41903 records to 27503 (keeping 200 days of data) [2025-10-07T17:04:01.197873] [DEBUG] [LOCAL ] AEE: Primary data saved (50121 records). [2025-10-07T17:04:01.200891] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-07T17:04:01.202147] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. AEE took 33.2s. Estimated remaining: 4h 31m 25s. Rate: 8.6 symbols/min [2025-10-07T17:04:01.361632] [DEBUG] [LOCAL ] ADX: Primary data saved (27503 records). [2025-10-07T17:04:01.368475] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-07T17:04:01.368619] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. ADX took 41.0s. Estimated remaining: 4h 23m 44s. Rate: 8.9 symbols/min [2025-10-07T17:04:01.397966] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:04:01.592473] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:04:01.619933] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T17:04:01.646188] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-07T17:04:01.671677] [DEBUG] [LOCAL ] AEM: Loaded 53460 existing records from primary storage. [2025-10-07T17:04:01.672122] [INFO ] [MAIN ] AEM: Loaded 53460 existing records. [2025-10-07T17:04:01.888204] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:04:01.889306] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-07T17:04:01.889408] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-07T17:04:01.890412] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-07T17:04:01.890371] [DEBUG] [LOCAL ] AEO: Loaded 53561 existing records from primary storage. [2025-10-07T17:04:01.890520] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-07T17:04:01.895711] [INFO ] [MAIN ] AEO: Loaded 53561 existing records. [2025-10-07T17:04:02.263683] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:04:02.328087] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-07T17:04:02.351624] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-07T17:04:02.361512] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-07T17:04:02.395944] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-07T17:04:02.445898] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:04:02.472065] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-07T17:04:02.876800] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:04:02.879543] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-07T17:04:03.047711] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-07T17:04:03.301413] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T17:04:03.847669] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-07T17:04:04.315504] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T17:04:04.647688] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-07T17:04:05.035778] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T17:04:05.375037] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T17:04:05.447741] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-07T17:04:06.247732] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-07T17:04:06.508585] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T17:04:07.047666] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-07T17:04:07.316194] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T17:04:07.854364] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-07T17:04:07.872894] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T17:04:08.647727] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-07T17:04:08.836241] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T17:04:09.447757] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-07T17:04:09.574024] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T17:04:09.999555] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T17:04:10.247705] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-07T17:04:10.880866] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T17:04:10.884386] [INFO ] [REMOTE ] ADT: Full fetch complete (76799 records). [2025-10-07T17:04:10.884534] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-07T17:04:10.885819] [FATAL] [VALIDATOR ] ADT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:04:10.885912] [FATAL] [MAIN ] ADT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:04:10.885957] [WARN ] [MAIN ] ADT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:04:10.885999] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-07T17:04:10.886060] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-07T17:04:10.886095] [INFO ] [LOCAL ] ADT: Starting deletion of derivative data. [2025-10-07T17:04:10.886292] [DEBUG] [LOCAL ] ADT: Deleted derivative data file. [2025-10-07T17:04:10.887590] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. ADT took 56.7s. Estimated remaining: 4h 26m 35s. Rate: 8.8 symbols/min [2025-10-07T17:04:11.065958] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:04:11.061680] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-07T17:04:11.126258] [DEBUG] [LOCAL ] AER: Loaded 48299 existing records from primary storage. [2025-10-07T17:04:11.126612] [INFO ] [MAIN ] AER: Loaded 48299 existing records. [2025-10-07T17:04:11.307172] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:04:11.307416] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-07T17:04:11.307468] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-07T17:04:11.308005] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-07T17:04:11.308066] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-07T17:04:11.670893] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:04:11.847638] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-07T17:04:12.057228] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T17:04:12.647710] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-07T17:04:12.985373] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T17:04:13.065068] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T17:04:13.447748] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-07T17:04:14.247731] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-07T17:04:14.354761] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T17:04:15.047740] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-07T17:04:15.376776] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T17:04:15.847729] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-07T17:04:16.108074] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T17:04:16.635206] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T17:04:16.647607] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-07T17:04:17.447752] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-07T17:04:17.964188] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T17:04:18.083570] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-07T17:04:18.247690] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-07T17:04:19.047736] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-07T17:04:19.137853] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T17:04:19.847669] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-07T17:04:20.054852] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T17:04:20.647764] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-07T17:04:21.178848] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-07T17:04:21.382819] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:04:21.447607] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-07T17:04:22.238851] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T17:04:22.248365] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-07T17:04:23.047625] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-07T17:04:23.847726] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-07T17:04:24.182415] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T17:04:24.586406] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T17:04:24.590207] [INFO ] [REMOTE ] AEG: Full fetch complete (70322 records). [2025-10-07T17:04:24.590388] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-07T17:04:24.660587] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-07T17:04:25.004705] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-07T17:04:25.004820] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-07T17:04:25.005552] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-07T17:04:25.005600] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-07T17:04:25.007386] [DEBUG] [LOCAL ] AEG: Trimmed 70322 records to 49613 (keeping 200 days of data) [2025-10-07T17:04:25.321176] [DEBUG] [LOCAL ] AEG: Primary data saved (49613 records). [2025-10-07T17:04:25.321419] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-07T17:04:25.321540] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 34.7s. Estimated remaining: 4h 34m 26s. Rate: 8.5 symbols/min [2025-10-07T17:04:25.505373] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T17:04:25.516596] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-07T17:04:26.603721] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (5.16 seconds). [2025-10-07T17:04:26.615430] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-07T17:04:26.724915] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-07T17:04:27.047747] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-07T17:04:27.187098] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T17:04:27.847738] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-07T17:04:28.447578] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T17:04:28.647681] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-07T17:04:28.697999] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T17:04:29.447736] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-07T17:04:29.942855] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-07T17:04:30.184359] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:04:30.247739] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-07T17:04:31.019120] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T17:04:31.025247] [INFO ] [REMOTE ] AEO: Full fetch complete (77445 records). [2025-10-07T17:04:31.025437] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-07T17:04:31.068209] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-07T17:04:31.461676] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-07T17:04:31.461787] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-07T17:04:31.462527] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-07T17:04:31.462574] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-07T17:04:31.464616] [DEBUG] [LOCAL ] AEO: Trimmed 77445 records to 53560 (keeping 200 days of data) [2025-10-07T17:04:31.857755] [DEBUG] [LOCAL ] AEO: Primary data saved (53560 records). [2025-10-07T17:04:31.857919] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-07T17:04:31.859139] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEO took 30.5s. Estimated remaining: 4h 33m 48s. Rate: 8.5 symbols/min [2025-10-07T17:04:32.238849] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T17:04:32.251208] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-07T17:04:33.015964] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T17:04:33.031119] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-07T17:04:34.305974] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-07T17:04:34.309614] [INFO ] [REMOTE ] AEM: Full fetch complete (77192 records). [2025-10-07T17:04:34.309763] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-07T17:04:34.716925] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-07T17:04:34.717019] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-07T17:04:34.717793] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-07T17:04:34.732743] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-07T17:04:34.745520] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T17:04:34.756695] [DEBUG] [LOCAL ] AEM: Trimmed 77192 records to 53464 (keeping 200 days of data) [2025-10-07T17:04:34.759182] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-07T17:04:35.124082] [DEBUG] [LOCAL ] AEM: Primary data saved (53464 records). [2025-10-07T17:04:35.124443] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-07T17:04:35.125853] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEM took 33.9s. Estimated remaining: 4h 29m 55s. Rate: 8.6 symbols/min [2025-10-07T17:04:36.279003] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T17:04:36.289779] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-07T17:04:37.880369] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T17:04:37.884167] [INFO ] [REMOTE ] AER: Full fetch complete (69590 records). [2025-10-07T17:04:37.884291] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-07T17:04:38.290706] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-07T17:04:38.290805] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-07T17:04:38.291491] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-07T17:04:38.291537] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-07T17:04:38.293117] [DEBUG] [LOCAL ] AER: Trimmed 69590 records to 48272 (keeping 200 days of data) [2025-10-07T17:04:38.604833] [DEBUG] [LOCAL ] AER: Primary data saved (48272 records). [2025-10-07T17:04:38.605032] [INFO ] [MAIN ] AER: Full history saved. [2025-10-07T17:04:38.607629] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AER took 27.7s. Estimated remaining: 4h 26m 26s. Rate: 8.7 symbols/min [2025-10-07T17:04:39.223571] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:04:39.282723] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:04:39.296406] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:04:39.301912] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-07T17:04:39.325689] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-07T17:04:39.400744] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:04:39.401093] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-07T17:04:39.401265] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-07T17:04:39.401418] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-07T17:04:39.401801] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-07T17:04:39.505590] [DEBUG] [LOCAL ] AFB: Loaded 11448 existing records from primary storage. [2025-10-07T17:04:39.522527] [INFO ] [MAIN ] AFB: Loaded 11448 existing records. [2025-10-07T17:04:39.832351] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-10-07T17:04:39.944767] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:04:39.905597] [INFO ] [MAIN ] AES: Loaded 53670 existing records. [2025-10-07T17:04:39.966184] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-07T17:04:39.965987] [DEBUG] [LOCAL ] AESI: Loaded 49538 existing records from primary storage. [2025-10-07T17:04:39.971934] [INFO ] [MAIN ] AESI: Loaded 49538 existing records. [2025-10-07T17:04:39.971837] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-07T17:04:40.077688] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-07T17:04:40.099157] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-07T17:04:40.295469] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:04:40.371458] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-07T17:04:40.476350] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:04:40.532789] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-07T17:04:40.532924] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-07T17:04:40.583507] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:04:40.587091] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-07T17:04:40.611543] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-07T17:04:40.621207] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-07T17:04:40.675946] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:04:40.648412] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-07T17:04:40.756105] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-07T17:04:40.784412] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-07T17:04:40.789750] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-07T17:04:40.820696] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:04:40.834468] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-07T17:04:40.864699] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:04:40.911432] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-07T17:04:40.939377] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-07T17:04:40.968961] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-07T17:04:41.016590] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-07T17:04:41.025760] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.4s. Estimated remaining: 4h 22m 7s. Rate: 8.9 symbols/min [2025-10-07T17:04:41.103006] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:04:41.154033] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-07T17:04:41.581216] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:04:41.616573] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-07T17:04:41.630946] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:04:41.734615] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:04:41.735038] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-07T17:04:41.760228] [DEBUG] [LOCAL ] AFG: Loaded 32332 existing records from primary storage. [2025-10-07T17:04:41.760520] [INFO ] [MAIN ] AFG: Loaded 32332 existing records. [2025-10-07T17:04:41.938850] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:04:41.939047] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-07T17:04:41.939095] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-07T17:04:41.939334] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-07T17:04:41.939391] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-07T17:04:42.249905] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T17:04:42.281841] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-07T17:04:42.312274] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:04:42.312712] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-07T17:04:42.991557] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T17:04:43.001093] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-07T17:04:43.174384] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T17:04:43.177481] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-07T17:04:43.329811] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T17:04:43.335181] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-07T17:04:43.775465] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-07T17:04:43.786459] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-07T17:04:43.819096] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T17:04:43.823341] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-07T17:04:44.219276] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T17:04:44.228825] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-07T17:04:44.244499] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T17:04:44.647729] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-07T17:04:44.702274] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T17:04:45.352144] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T17:04:45.447717] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-07T17:04:45.648470] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T17:04:45.965755] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T17:04:46.247703] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-07T17:04:47.047632] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-07T17:04:47.154092] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-07T17:04:47.439267] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T17:04:47.847701] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-07T17:04:48.577827] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T17:04:48.647723] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-07T17:04:49.397213] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T17:04:49.447719] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-07T17:04:50.222907] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T17:04:50.247711] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-07T17:04:50.774417] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-07T17:04:51.047697] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-07T17:04:51.847694] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-07T17:04:51.894782] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T17:04:52.548368] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T17:04:52.647737] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-07T17:04:53.447707] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-07T17:04:54.194023] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-07T17:04:54.247679] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-07T17:04:54.872456] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-07T17:04:55.047688] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-07T17:04:55.712273] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T17:04:55.847716] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-07T17:04:56.157016] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-07T17:04:56.647734] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-07T17:04:57.144795] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-07T17:04:57.251274] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T17:04:57.304247] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-07T17:04:57.447702] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-07T17:04:58.247728] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-07T17:04:58.476299] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T17:04:59.035863] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T17:04:59.047727] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-07T17:04:59.847757] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-07T17:05:00.339033] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T17:05:00.647695] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-07T17:05:01.447749] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-07T17:05:02.104734] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-07T17:05:02.190940] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T17:05:02.247737] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-07T17:05:03.047694] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-07T17:05:03.142207] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T17:05:03.836761] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T17:05:03.847693] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-07T17:05:04.368216] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T17:05:04.370679] [INFO ] [REMOTE ] AFG: Full fetch complete (46189 records). [2025-10-07T17:05:04.370769] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-07T17:05:04.652884] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-07T17:05:04.765628] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-07T17:05:04.765756] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-07T17:05:04.766245] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-07T17:05:04.766292] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-07T17:05:04.767477] [DEBUG] [LOCAL ] AFG: Trimmed 46189 records to 32272 (keeping 200 days of data) [2025-10-07T17:05:04.990375] [DEBUG] [LOCAL ] AFG: Primary data saved (32272 records). [2025-10-07T17:05:04.990526] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-07T17:05:04.990610] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFG took 23.9s. Estimated remaining: 4h 37m 55s. Rate: 8.4 symbols/min [2025-10-07T17:05:05.163896] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:05:05.168483] [DEBUG] [LOCAL ] AFGB: Loaded 2324 existing records from primary storage. [2025-10-07T17:05:05.168803] [INFO ] [MAIN ] AFGB: Loaded 2324 existing records. [2025-10-07T17:05:05.375892] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:05:05.376292] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-07T17:05:05.376544] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-07T17:05:05.376882] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-07T17:05:05.376953] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-07T17:05:05.452205] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-07T17:05:05.527145] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T17:05:05.835866] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T17:05:05.863866] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:05:06.247753] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-07T17:05:07.047723] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-07T17:05:07.632883] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-07T17:05:07.703032] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T17:05:07.847743] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-07T17:05:08.198723] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T17:05:08.612126] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-07T17:05:08.647682] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-07T17:05:09.447727] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-07T17:05:10.247870] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-07T17:05:10.391891] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-07T17:05:10.395493] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-07T17:05:10.395905] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-07T17:05:10.807411] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-07T17:05:10.807507] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-07T17:05:10.808511] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-07T17:05:10.808596] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-07T17:05:10.811192] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53671 (keeping 200 days of data) [2025-10-07T17:05:10.923465] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-07T17:05:11.066116] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-07T17:05:11.188608] [DEBUG] [LOCAL ] AES: Primary data saved (53671 records). [2025-10-07T17:05:11.188801] [INFO ] [MAIN ] AES: Full history saved. [2025-10-07T17:05:11.190261] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AES took 32.6s. Estimated remaining: 4h 36m 56s. Rate: 8.4 symbols/min [2025-10-07T17:05:11.316291] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-07T17:05:11.362939] [INFO ] [REMOTE ] AESI: Full fetch complete (70602 records). [2025-10-07T17:05:11.377218] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-07T17:05:11.429402] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:05:11.552525] [DEBUG] [LOCAL ] AFGC: Loaded 2551 existing records from primary storage. [2025-10-07T17:05:11.558254] [INFO ] [MAIN ] AFGC: Loaded 2551 existing records. [2025-10-07T17:05:11.692813] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T17:05:11.847669] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-07T17:05:12.007884] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:05:12.025443] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-07T17:05:12.025523] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-07T17:05:12.025590] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-07T17:05:12.026400] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-07T17:05:12.025702] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-07T17:05:12.026483] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-07T17:05:12.026835] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-07T17:05:12.026896] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-07T17:05:12.136900] [DEBUG] [LOCAL ] AESI: Trimmed 70602 records to 49549 (keeping 200 days of data) [2025-10-07T17:05:12.558636] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:05:12.567322] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-07T17:05:12.654478] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-07T17:05:12.776720] [DEBUG] [LOCAL ] AESI: Primary data saved (49549 records). [2025-10-07T17:05:12.776904] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-07T17:05:12.777016] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AESI took 34.2s. Estimated remaining: 4h 31m 55s. Rate: 8.6 symbols/min [2025-10-07T17:05:12.951050] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:05:12.955216] [DEBUG] [LOCAL ] AFGD: Loaded 1805 existing records from primary storage. [2025-10-07T17:05:12.955377] [INFO ] [MAIN ] AFGD: Loaded 1805 existing records. [2025-10-07T17:05:13.134412] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:05:13.134711] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-07T17:05:13.134792] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-07T17:05:13.135034] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-07T17:05:13.135121] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-07T17:05:13.455502] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-07T17:05:13.499744] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:05:13.508800] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-07T17:05:14.103217] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T17:05:14.247696] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-07T17:05:14.794619] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-07T17:05:15.047752] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-07T17:05:15.757280] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-07T17:05:15.847713] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-07T17:05:16.193561] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T17:05:16.647759] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-07T17:05:17.188575] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-07T17:05:17.447672] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-07T17:05:18.129058] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T17:05:18.130711] [INFO ] [REMOTE ] AFB: Full fetch complete (16671 records). [2025-10-07T17:05:18.130820] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-07T17:05:18.253007] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-07T17:05:18.573859] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-07T17:05:18.573950] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-07T17:05:18.574212] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-07T17:05:18.574255] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-07T17:05:18.575032] [DEBUG] [LOCAL ] AFB: Trimmed 16671 records to 11472 (keeping 200 days of data) [2025-10-07T17:05:18.650128] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-07T17:05:18.672994] [DEBUG] [LOCAL ] AFB: Primary data saved (11472 records). [2025-10-07T17:05:18.673168] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-07T17:05:18.673319] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFB took 40.1s. Estimated remaining: 4h 30m 50s. Rate: 8.6 symbols/min [2025-10-07T17:05:18.863432] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:05:18.868633] [DEBUG] [LOCAL ] AFGE: Loaded 2441 existing records from primary storage. [2025-10-07T17:05:18.868899] [INFO ] [MAIN ] AFGE: Loaded 2441 existing records. [2025-10-07T17:05:19.052753] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-07T17:05:19.058703] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:05:19.059765] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-07T17:05:19.059823] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-07T17:05:19.059982] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-07T17:05:19.060032] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-07T17:05:19.522504] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:05:19.635345] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-07T17:05:19.847681] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-07T17:05:20.391378] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-07T17:05:20.647711] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-07T17:05:21.309628] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-07T17:05:21.447691] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-07T17:05:21.884036] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-07T17:05:22.247749] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-07T17:05:22.752229] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-07T17:05:23.047724] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-07T17:05:23.526435] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-07T17:05:23.847727] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-07T17:05:24.319139] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-07T17:05:24.647699] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-07T17:05:25.178771] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T17:05:25.447704] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-07T17:05:25.877157] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-07T17:05:26.247680] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-07T17:05:27.047697] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-07T17:05:27.129567] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T17:05:27.410163] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-07T17:05:27.847672] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-07T17:05:28.283792] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-07T17:05:28.647679] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-07T17:05:29.110887] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T17:05:29.447707] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-07T17:05:29.886263] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-07T17:05:30.247685] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-07T17:05:30.758753] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-07T17:05:31.047754] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-07T17:05:31.546444] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-07T17:05:31.847738] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-07T17:05:32.283042] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-07T17:05:32.647747] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-07T17:05:33.102794] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-07T17:05:33.447711] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-07T17:05:33.831096] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-07T17:05:34.247717] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-07T17:05:34.771560] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T17:05:34.772321] [INFO ] [REMOTE ] AFGB: Full fetch complete (3666 records). [2025-10-07T17:05:34.772391] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-07T17:05:35.052805] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-07T17:05:35.144066] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-07T17:05:35.144150] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-07T17:05:35.144267] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-07T17:05:35.144306] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-07T17:05:35.144716] [DEBUG] [LOCAL ] AFGB: Trimmed 3666 records to 2311 (keeping 200 days of data) [2025-10-07T17:05:35.159142] [DEBUG] [LOCAL ] AFGB: Primary data saved (2311 records). [2025-10-07T17:05:35.159280] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-07T17:05:35.159383] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGB took 30.2s. Estimated remaining: 4h 38m 44s. Rate: 8.3 symbols/min [2025-10-07T17:05:35.326994] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:05:35.380800] [DEBUG] [LOCAL ] AFL: Loaded 53156 existing records from primary storage. [2025-10-07T17:05:35.381169] [INFO ] [MAIN ] AFL: Loaded 53156 existing records. [2025-10-07T17:05:35.562279] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:05:35.562525] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-07T17:05:35.562623] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-07T17:05:35.563010] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-07T17:05:35.563080] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-07T17:05:35.852759] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-07T17:05:35.844582] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T17:05:35.937221] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:05:36.307727] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T17:05:36.647699] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-07T17:05:37.082089] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-07T17:05:37.447688] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-07T17:05:37.957270] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-07T17:05:38.247688] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-07T17:05:38.738952] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-07T17:05:39.047710] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-07T17:05:39.381195] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-07T17:05:39.847718] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-07T17:05:40.384222] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T17:05:40.385180] [INFO ] [REMOTE ] AFGC: Full fetch complete (3713 records). [2025-10-07T17:05:40.385259] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-07T17:05:40.652914] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-07T17:05:40.744919] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-07T17:05:40.745000] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-07T17:05:40.745131] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-07T17:05:40.745171] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-07T17:05:40.745511] [DEBUG] [LOCAL ] AFGC: Trimmed 3713 records to 2546 (keeping 200 days of data) [2025-10-07T17:05:40.761488] [DEBUG] [LOCAL ] AFGC: Primary data saved (2546 records). [2025-10-07T17:05:40.761563] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-07T17:05:40.761638] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGC took 29.6s. Estimated remaining: 4h 37m 18s. Rate: 8.4 symbols/min [2025-10-07T17:05:40.931954] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:05:40.987575] [DEBUG] [LOCAL ] AG: Loaded 53642 existing records from primary storage. [2025-10-07T17:05:40.988225] [INFO ] [MAIN ] AG: Loaded 53642 existing records. [2025-10-07T17:05:41.164013] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:05:41.164347] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-07T17:05:41.164406] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-07T17:05:41.165118] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-07T17:05:41.165178] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-07T17:05:41.455545] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-07T17:05:41.547078] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:05:42.076426] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T17:05:42.247619] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-07T17:05:42.435634] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T17:05:43.047771] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-07T17:05:43.482193] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-07T17:05:43.483197] [INFO ] [REMOTE ] AFGD: Full fetch complete (3103 records). [2025-10-07T17:05:43.483274] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-07T17:05:43.855235] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-07T17:05:43.893852] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-07T17:05:43.894016] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-07T17:05:43.894233] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-07T17:05:43.894316] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-07T17:05:43.895377] [DEBUG] [LOCAL ] AFGD: Trimmed 3103 records to 1808 (keeping 200 days of data) [2025-10-07T17:05:43.909536] [DEBUG] [LOCAL ] AFGD: Primary data saved (1808 records). [2025-10-07T17:05:43.909704] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-07T17:05:43.909809] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGD took 31.1s. Estimated remaining: 4h 33m 56s. Rate: 8.5 symbols/min [2025-10-07T17:05:44.081628] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:05:44.081810] [DEBUG] [LOCAL ] AGCO: No existing data file found in primary storage. [2025-10-07T17:05:44.081851] [WARN ] [MAIN ] AGCO: No existing data found, performing full refresh instead. [2025-10-07T17:05:44.081963] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-07T17:05:44.082007] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-07T17:05:44.082081] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-10-07T17:05:44.082141] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-07T17:05:44.372630] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-07T17:05:44.452007] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:05:44.480746] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-07T17:05:44.647670] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-07T17:05:45.447701] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-07T17:05:45.991062] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-07T17:05:46.247689] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-07T17:05:46.622865] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-07T17:05:47.047729] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-07T17:05:47.609331] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T17:05:47.847688] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-07T17:05:48.000086] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T17:05:48.293327] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T17:05:48.647687] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-07T17:05:49.031296] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T17:05:49.032262] [INFO ] [REMOTE ] AFGE: Full fetch complete (3456 records). [2025-10-07T17:05:49.032439] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-07T17:05:49.414334] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-07T17:05:49.414432] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-07T17:05:49.414554] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-07T17:05:49.414592] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-07T17:05:49.415021] [DEBUG] [LOCAL ] AFGE: Trimmed 3456 records to 2430 (keeping 200 days of data) [2025-10-07T17:05:49.430413] [DEBUG] [LOCAL ] AFGE: Primary data saved (2430 records). [2025-10-07T17:05:49.430491] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-07T17:05:49.430564] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 30.8s. Estimated remaining: 4h 32m 36s. Rate: 8.5 symbols/min [2025-10-07T17:05:49.452750] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-07T17:05:49.611844] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:05:49.632395] [DEBUG] [LOCAL ] AGD: Loaded 18278 existing records from primary storage. [2025-10-07T17:05:49.632701] [INFO ] [MAIN ] AGD: Loaded 18278 existing records. [2025-10-07T17:05:49.828298] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:05:49.828585] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-07T17:05:49.828635] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-07T17:05:49.828956] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-07T17:05:49.829014] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-07T17:05:50.184940] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:05:50.247678] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-07T17:05:51.047694] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-07T17:05:51.431381] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-07T17:05:51.486978] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T17:05:51.847687] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-07T17:05:52.611162] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T17:05:52.647631] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-07T17:05:52.921079] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T17:05:53.447753] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-07T17:05:54.210423] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T17:05:54.247677] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-07T17:05:54.799380] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-07T17:05:55.047698] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-07T17:05:55.196797] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-07T17:05:55.847725] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-07T17:05:56.647722] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-07T17:05:56.894536] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T17:05:57.007563] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T17:05:57.447706] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-07T17:05:58.252347] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-07T17:05:58.258253] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T17:05:59.047677] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-07T17:05:59.134172] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T17:05:59.312416] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T17:05:59.847763] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-07T17:06:00.523296] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T17:06:00.647673] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-07T17:06:00.943719] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T17:06:01.447737] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-07T17:06:02.247699] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-07T17:06:02.759169] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T17:06:02.805067] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T17:06:03.047748] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-07T17:06:03.076410] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T17:06:03.847717] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-07T17:06:04.625730] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-07T17:06:04.647608] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-07T17:06:05.190704] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-07T17:06:05.447742] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-07T17:06:06.247691] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-07T17:06:06.314579] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T17:06:06.348357] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T17:06:07.047706] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-07T17:06:07.847785] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-07T17:06:08.300667] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T17:06:08.647615] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-07T17:06:08.864095] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T17:06:08.865870] [INFO ] [REMOTE ] AGD: Full fetch complete (25807 records). [2025-10-07T17:06:08.865946] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-07T17:06:08.898195] [DEBUG] [REMOTE ] AFL: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-07T17:06:08.945163] [WARN ] [REMOTE ] AFL: No data returned for month 2025-05 [2025-10-07T17:06:08.970507] [FATAL] [REMOTE ] AFL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:06:08.982804] [FATAL] [MAIN ] AFL: Failed to fetch primary data. [2025-10-07T17:06:08.995386] [WARN ] [MAIN ] AFL: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:06:08.995563] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-07T17:06:08.998394] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-07T17:06:08.998910] [INFO ] [LOCAL ] AFL: Starting deletion of derivative data. [2025-10-07T17:06:09.016391] [DEBUG] [LOCAL ] AFL: Deleted derivative data file. [2025-10-07T17:06:09.016336] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T17:06:09.022943] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 33.9s. Estimated remaining: 4h 42m 11s. Rate: 8.2 symbols/min [2025-10-07T17:06:09.452530] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:06:09.471074] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-07T17:06:09.500661] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-07T17:06:09.501762] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-07T17:06:09.502220] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-07T17:06:09.502284] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-07T17:06:09.503550] [DEBUG] [LOCAL ] AGD: Trimmed 25807 records to 18378 (keeping 200 days of data) [2025-10-07T17:06:09.647332] [DEBUG] [LOCAL ] AGI: Loaded 53420 existing records from primary storage. [2025-10-07T17:06:09.649795] [DEBUG] [LOCAL ] AGD: Primary data saved (18378 records). [2025-10-07T17:06:09.649981] [INFO ] [MAIN ] AGI: Loaded 53420 existing records. [2025-10-07T17:06:09.681426] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-07T17:06:09.707202] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGD took 20.3s. Estimated remaining: 4h 37m 3s. Rate: 8.4 symbols/min [2025-10-07T17:06:09.998638] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:06:10.016940] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-07T17:06:10.021049] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-07T17:06:10.020952] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:06:10.021633] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-07T17:06:10.021790] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-07T17:06:10.256486] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-07T17:06:10.359408] [DEBUG] [LOCAL ] AGL: Loaded 52469 existing records from primary storage. [2025-10-07T17:06:10.375555] [INFO ] [MAIN ] AGL: Loaded 52469 existing records. [2025-10-07T17:06:10.543477] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:06:10.628273] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:06:10.628553] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-07T17:06:10.628606] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-07T17:06:10.628941] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-07T17:06:10.629001] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-07T17:06:10.990959] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:06:11.047719] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-07T17:06:11.713544] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-07T17:06:11.847638] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-07T17:06:11.928719] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T17:06:12.647617] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-07T17:06:12.676510] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T17:06:13.447610] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-07T17:06:13.489049] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T17:06:14.247774] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-07T17:06:14.301016] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T17:06:15.047764] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-07T17:06:15.361910] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T17:06:15.847675] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-07T17:06:15.921574] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T17:06:16.603157] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T17:06:16.647693] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-07T17:06:17.447728] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-07T17:06:17.934276] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-07T17:06:18.175100] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T17:06:18.247686] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-07T17:06:19.012404] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T17:06:19.047634] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-07T17:06:19.847732] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-07T17:06:20.552348] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T17:06:20.615617] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-07T17:06:20.647626] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-07T17:06:21.447667] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-07T17:06:21.774282] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T17:06:22.247742] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-07T17:06:22.837455] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-07T17:06:22.842514] [INFO ] [REMOTE ] AG: Full fetch complete (77611 records). [2025-10-07T17:06:22.842737] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-07T17:06:23.050267] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-07T17:06:23.270348] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-07T17:06:23.270522] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-07T17:06:23.271412] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-07T17:06:23.271497] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-07T17:06:23.286578] [DEBUG] [LOCAL ] AG: Trimmed 77611 records to 53642 (keeping 200 days of data) [2025-10-07T17:06:23.308745] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T17:06:23.650363] [DEBUG] [LOCAL ] AG: Primary data saved (53642 records). [2025-10-07T17:06:23.650531] [INFO ] [MAIN ] AG: Full history saved. [2025-10-07T17:06:23.651636] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AG took 42.9s. Estimated remaining: 4h 41m 58s. Rate: 8.2 symbols/min [2025-10-07T17:06:23.825000] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:06:23.855029] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-07T17:06:23.862726] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T17:06:23.879455] [DEBUG] [LOCAL ] AGM: Loaded 10345 existing records from primary storage. [2025-10-07T17:06:23.880458] [INFO ] [MAIN ] AGM: Loaded 10345 existing records. [2025-10-07T17:06:24.058470] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:06:24.058767] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-07T17:06:24.058869] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-07T17:06:24.059123] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-07T17:06:24.059179] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-07T17:06:24.412137] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:06:24.610339] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T17:06:24.613740] [INFO ] [REMOTE ] AGCO: Full fetch complete (61857 records). [2025-10-07T17:06:24.613835] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-07T17:06:24.652809] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-07T17:06:25.013469] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-07T17:06:25.013552] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-07T17:06:25.014173] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-07T17:06:25.014240] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-07T17:06:25.015545] [DEBUG] [LOCAL ] AGCO: Trimmed 61857 records to 42359 (keeping 200 days of data) [2025-10-07T17:06:25.281987] [DEBUG] [LOCAL ] AGCO: Primary data saved (42359 records). [2025-10-07T17:06:25.282131] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-07T17:06:25.282208] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 41.4s. Estimated remaining: 4h 37m 43s. Rate: 8.3 symbols/min [2025-10-07T17:06:25.449218] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-07T17:06:25.448951] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:06:25.450630] [DEBUG] [LOCAL ] AGO: No existing data file found in primary storage. [2025-10-07T17:06:25.450877] [WARN ] [MAIN ] AGO: No existing data found, performing full refresh instead. [2025-10-07T17:06:25.451071] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-07T17:06:25.451114] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-07T17:06:25.451156] [DEBUG] [LOCAL ] AGO: No primary data file found to delete. [2025-10-07T17:06:25.451189] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-07T17:06:25.836001] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T17:06:25.876984] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:06:26.247755] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-07T17:06:26.287844] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T17:06:26.620420] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T17:06:27.047616] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-07T17:06:27.077161] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-07T17:06:27.847682] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-07T17:06:28.348687] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-07T17:06:28.647626] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-07T17:06:29.009905] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T17:06:29.151894] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-07T17:06:29.447694] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-07T17:06:30.100600] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T17:06:30.247736] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-07T17:06:30.957719] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T17:06:31.047667] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-07T17:06:31.847715] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-07T17:06:32.587540] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T17:06:32.647608] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-07T17:06:32.716212] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T17:06:33.447731] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-07T17:06:33.664441] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T17:06:34.247682] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-07T17:06:35.047631] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-07T17:06:35.078598] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T17:06:35.234341] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T17:06:35.847747] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-07T17:06:36.515926] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-07T17:06:36.647626] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-07T17:06:36.934968] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-07T17:06:37.447637] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-07T17:06:38.247700] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-07T17:06:38.309144] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T17:06:39.047676] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-07T17:06:39.377466] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T17:06:39.847722] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-07T17:06:40.059097] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T17:06:40.647623] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-07T17:06:41.447748] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-07T17:06:42.966063] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (4.72 seconds). [2025-10-07T17:06:42.977568] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-07T17:06:43.061441] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (3.21 seconds). [2025-10-07T17:06:43.062941] [INFO ] [REMOTE ] AGM: Full fetch complete (12996 records). [2025-10-07T17:06:43.063028] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-07T17:06:43.474104] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-07T17:06:43.474194] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-07T17:06:43.474479] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-07T17:06:43.474520] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-07T17:06:43.475051] [DEBUG] [LOCAL ] AGM: Trimmed 12996 records to 10397 (keeping 200 days of data) [2025-10-07T17:06:43.544391] [DEBUG] [LOCAL ] AGM: Primary data saved (10397 records). [2025-10-07T17:06:43.544544] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-07T17:06:43.544630] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 19.9s. Estimated remaining: 4h 45m 31s. Rate: 8.1 symbols/min [2025-10-07T17:06:43.720690] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:06:43.756165] [DEBUG] [LOCAL ] AGRO: Loaded 33335 existing records from primary storage. [2025-10-07T17:06:43.756547] [INFO ] [MAIN ] AGRO: Loaded 33335 existing records. [2025-10-07T17:06:43.939736] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:06:43.954008] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-07T17:06:43.954869] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-07T17:06:43.955296] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (3.31 seconds). [2025-10-07T17:06:43.960028] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-07T17:06:43.960848] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-07T17:06:43.960926] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-07T17:06:44.322618] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:06:44.323056] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-07T17:06:45.054081] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T17:06:45.088564] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-07T17:06:45.095091] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-07T17:06:45.447740] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-07T17:06:45.653267] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (4.21 seconds). [2025-10-07T17:06:45.947169] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T17:06:46.247723] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-07T17:06:46.506677] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T17:06:47.047621] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-07T17:06:47.847739] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-07T17:06:48.124564] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-07T17:06:48.232585] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-07T17:06:48.283742] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T17:06:48.647745] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-07T17:06:49.197706] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T17:06:49.447695] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-07T17:06:50.247733] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-07T17:06:50.649490] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-07T17:06:50.653244] [INFO ] [REMOTE ] AGI: Full fetch complete (76881 records). [2025-10-07T17:06:50.653366] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-07T17:06:51.049162] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-07T17:06:51.050489] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-07T17:06:51.050594] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-07T17:06:51.051360] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-07T17:06:51.051704] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-07T17:06:51.061569] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T17:06:51.065468] [DEBUG] [LOCAL ] AGI: Trimmed 76881 records to 53421 (keeping 200 days of data) [2025-10-07T17:06:51.066530] [INFO ] [REMOTE ] AGL: Full fetch complete (75578 records). [2025-10-07T17:06:51.066626] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-07T17:06:51.579993] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-07T17:06:51.600496] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-07T17:06:51.611067] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-07T17:06:51.616714] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-07T17:06:51.617234] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-07T17:06:51.624609] [DEBUG] [LOCAL ] AGL: Trimmed 75578 records to 52486 (keeping 200 days of data) [2025-10-07T17:06:51.850201] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-07T17:06:51.970702] [DEBUG] [LOCAL ] AGI: Primary data saved (53421 records). [2025-10-07T17:06:51.971367] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-07T17:06:51.971849] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGI took 42.9s. Estimated remaining: 4h 46m 7s. Rate: 8.1 symbols/min [2025-10-07T17:06:52.304104] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:06:52.378472] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-07T17:06:52.412360] [DEBUG] [LOCAL ] AGX: Loaded 33146 existing records from primary storage. [2025-10-07T17:06:52.414571] [INFO ] [MAIN ] AGX: Loaded 33146 existing records. [2025-10-07T17:06:52.651485] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-07T17:06:52.773533] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:06:52.773871] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-07T17:06:52.776254] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-07T17:06:52.783168] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-07T17:06:52.788859] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-07T17:06:52.966250] [DEBUG] [LOCAL ] AGL: Primary data saved (52486 records). [2025-10-07T17:06:53.006045] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-07T17:06:53.011738] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGL took 43.3s. Estimated remaining: 4h 41m 36s. Rate: 8.2 symbols/min [2025-10-07T17:06:53.491194] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:06:53.496905] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-07T17:06:53.567089] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:06:53.570996] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T17:06:53.617976] [DEBUG] [LOCAL ] AHH: Loaded 40877 existing records from primary storage. [2025-10-07T17:06:53.618339] [INFO ] [MAIN ] AHH: Loaded 40877 existing records. [2025-10-07T17:06:53.797584] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:06:53.797806] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-07T17:06:53.797855] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-07T17:06:53.798129] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-07T17:06:53.798185] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-07T17:06:54.155296] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:06:54.176228] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T17:06:54.247672] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-07T17:06:55.023526] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T17:06:55.047738] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-07T17:06:55.859360] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-07T17:06:55.861998] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T17:06:56.251113] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T17:06:56.647708] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-07T17:06:57.447741] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-07T17:06:57.589335] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T17:06:58.247671] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-07T17:06:58.386844] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T17:06:58.913130] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T17:06:59.047726] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-07T17:06:59.336931] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T17:06:59.847719] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-07T17:07:00.122056] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T17:07:00.647756] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-07T17:07:01.069484] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-07T17:07:01.447683] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-07T17:07:02.002947] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T17:07:02.247712] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-07T17:07:02.817092] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T17:07:03.047696] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-07T17:07:03.302882] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T17:07:03.305054] [INFO ] [REMOTE ] AGO: Full fetch complete (39442 records). [2025-10-07T17:07:03.305130] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-07T17:07:03.676917] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-07T17:07:03.677019] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-07T17:07:03.677460] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-07T17:07:03.677522] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-07T17:07:03.678371] [DEBUG] [LOCAL ] AGO: Trimmed 39442 records to 28004 (keeping 200 days of data) [2025-10-07T17:07:03.847745] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-07T17:07:03.849993] [DEBUG] [LOCAL ] AGO: Primary data saved (28004 records). [2025-10-07T17:07:03.850985] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-07T17:07:03.851078] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 38.6s. Estimated remaining: 4h 43m 53s. Rate: 8.2 symbols/min [2025-10-07T17:07:04.017532] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:07:04.017713] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-07T17:07:04.017761] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-07T17:07:04.017872] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-07T17:07:04.017915] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-07T17:07:04.017958] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-07T17:07:04.017990] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-07T17:07:04.371956] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:07:04.546994] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T17:07:04.647670] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-07T17:07:04.854725] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:07:04.855012] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-07T17:07:04.855109] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:07:04.855160] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-07T17:07:04.855196] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:07:04.855284] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-07T17:07:04.855389] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-07T17:07:04.855441] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-07T17:07:04.855502] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-07T17:07:04.855629] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 1.0s. Estimated remaining: 4h 39m 32s. Rate: 8.3 symbols/min [2025-10-07T17:07:05.060608] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:07:05.109604] [DEBUG] [LOCAL ] AHR: Loaded 49133 existing records from primary storage. [2025-10-07T17:07:05.110008] [INFO ] [MAIN ] AHR: Loaded 49133 existing records. [2025-10-07T17:07:05.284202] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:07:05.284510] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-07T17:07:05.284585] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-07T17:07:05.285186] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-07T17:07:05.285245] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-07T17:07:05.454804] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-07T17:07:05.629830] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T17:07:05.673571] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:07:06.247682] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-07T17:07:07.047632] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-07T17:07:07.096626] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T17:07:07.847753] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-07T17:07:08.015571] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T17:07:08.288053] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T17:07:08.647629] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-07T17:07:09.365686] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T17:07:09.447602] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-07T17:07:09.966675] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T17:07:10.247707] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-07T17:07:10.851055] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T17:07:11.047681] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-07T17:07:11.549427] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T17:07:11.847763] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-07T17:07:12.647692] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-07T17:07:12.752678] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T17:07:12.820062] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T17:07:13.447709] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-07T17:07:13.810316] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T17:07:14.247753] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-07T17:07:14.698017] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T17:07:15.047678] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-07T17:07:15.448705] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T17:07:15.847673] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-07T17:07:15.961458] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T17:07:15.963797] [INFO ] [REMOTE ] AGRO: Full fetch complete (49448 records). [2025-10-07T17:07:15.963881] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-07T17:07:16.328999] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-07T17:07:16.329090] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-07T17:07:16.329593] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-07T17:07:16.329635] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-07T17:07:16.330726] [DEBUG] [LOCAL ] AGRO: Trimmed 49448 records to 33319 (keeping 200 days of data) [2025-10-07T17:07:16.529181] [DEBUG] [LOCAL ] AGRO: Primary data saved (33319 records). [2025-10-07T17:07:16.529329] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-07T17:07:16.530937] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 33.0s. Estimated remaining: 4h 42m 18s. Rate: 8.2 symbols/min [2025-10-07T17:07:16.652761] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-07T17:07:16.701021] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:07:16.709700] [DEBUG] [LOCAL ] AHT: Loaded 6203 existing records from primary storage. [2025-10-07T17:07:16.710256] [INFO ] [MAIN ] AHT: Loaded 6203 existing records. [2025-10-07T17:07:16.882135] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:07:16.882385] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-07T17:07:16.882434] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-07T17:07:16.882617] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-07T17:07:16.882712] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-07T17:07:17.242288] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:07:17.266712] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T17:07:17.447711] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-07T17:07:18.247617] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-07T17:07:18.374079] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T17:07:18.394139] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T17:07:19.047746] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-07T17:07:19.693326] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-07T17:07:19.847726] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-07T17:07:20.022013] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T17:07:20.647701] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-07T17:07:21.426283] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T17:07:21.430268] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T17:07:21.447600] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-07T17:07:22.247774] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-07T17:07:23.023383] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T17:07:23.047616] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-07T17:07:23.527209] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T17:07:23.529284] [INFO ] [REMOTE ] AGX: Full fetch complete (48657 records). [2025-10-07T17:07:23.529388] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-07T17:07:23.860366] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-07T17:07:23.916234] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-07T17:07:23.916402] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-07T17:07:23.917021] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-07T17:07:23.917086] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-07T17:07:23.918250] [DEBUG] [LOCAL ] AGX: Trimmed 48657 records to 33141 (keeping 200 days of data) [2025-10-07T17:07:24.120469] [DEBUG] [LOCAL ] AGX: Primary data saved (33141 records). [2025-10-07T17:07:24.120601] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-07T17:07:24.120703] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 32.1s. Estimated remaining: 4h 42m 21s. Rate: 8.2 symbols/min [2025-10-07T17:07:24.292676] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:07:24.343315] [DEBUG] [LOCAL ] AI: Loaded 53752 existing records from primary storage. [2025-10-07T17:07:24.343667] [INFO ] [MAIN ] AI: Loaded 53752 existing records. [2025-10-07T17:07:24.528787] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:07:24.533951] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-07T17:07:24.534727] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T17:07:24.534896] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-07T17:07:24.538150] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-07T17:07:24.538306] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-07T17:07:24.652752] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-07T17:07:24.683129] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T17:07:24.935506] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:07:25.355205] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T17:07:25.447712] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-07T17:07:26.077700] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T17:07:26.247693] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-07T17:07:27.047677] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-07T17:07:27.619486] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T17:07:27.781818] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T17:07:27.847614] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-07T17:07:28.647729] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-07T17:07:28.667032] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T17:07:29.447689] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-07T17:07:30.026681] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T17:07:30.247732] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-07T17:07:30.689849] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T17:07:30.983768] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T17:07:31.047612] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-07T17:07:31.687498] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T17:07:31.688601] [INFO ] [REMOTE ] AHT: Full fetch complete (9234 records). [2025-10-07T17:07:31.688724] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-07T17:07:31.689160] [FATAL] [VALIDATOR ] AHT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:07:31.689261] [FATAL] [MAIN ] AHT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:07:31.689330] [WARN ] [MAIN ] AHT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:07:31.689415] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-07T17:07:31.689494] [DEBUG] [LOCAL ] AHT: No primary data file found to delete. [2025-10-07T17:07:31.689531] [INFO ] [LOCAL ] AHT: Starting deletion of derivative data. [2025-10-07T17:07:31.689739] [DEBUG] [LOCAL ] AHT: Deleted derivative data file. [2025-10-07T17:07:31.689828] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHT took 15.2s. Estimated remaining: 4h 42m 23s. Rate: 8.2 symbols/min [2025-10-07T17:07:31.857340] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-07T17:07:31.895479] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:07:31.955524] [DEBUG] [LOCAL ] AIG: Loaded 53472 existing records from primary storage. [2025-10-07T17:07:31.955930] [INFO ] [MAIN ] AIG: Loaded 53472 existing records. [2025-10-07T17:07:32.170179] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:07:32.170460] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-07T17:07:32.170543] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-07T17:07:32.171005] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-07T17:07:32.171071] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-07T17:07:32.593029] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:07:32.647619] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-07T17:07:33.274598] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T17:07:33.277480] [INFO ] [REMOTE ] AHH: Full fetch complete (60105 records). [2025-10-07T17:07:33.277593] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-07T17:07:33.449555] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-07T17:07:33.651599] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-07T17:07:33.651718] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-07T17:07:33.652309] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-07T17:07:33.652351] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-07T17:07:33.653626] [DEBUG] [LOCAL ] AHH: Trimmed 60105 records to 40837 (keeping 200 days of data) [2025-10-07T17:07:33.889488] [DEBUG] [LOCAL ] AHH: Primary data saved (40837 records). [2025-10-07T17:07:33.889617] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-07T17:07:33.889726] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHH took 40.8s. Estimated remaining: 4h 39m 4s. Rate: 8.3 symbols/min [2025-10-07T17:07:34.060077] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:07:34.060340] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-07T17:07:34.060395] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-07T17:07:34.060503] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-07T17:07:34.060545] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-07T17:07:34.060590] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-07T17:07:34.060622] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-07T17:07:34.266732] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-07T17:07:34.417227] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:07:34.464457] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T17:07:35.047751] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-07T17:07:35.736465] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T17:07:35.847622] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-07T17:07:36.148624] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-07T17:07:36.488206] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T17:07:36.647745] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-07T17:07:36.851379] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:07:36.851840] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-07T17:07:36.851946] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:07:36.852016] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-07T17:07:36.852073] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:07:36.852170] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-07T17:07:36.852268] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-07T17:07:36.852342] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-07T17:07:36.852415] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-07T17:07:36.852491] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 3.0s. Estimated remaining: 4h 36m 20s. Rate: 8.4 symbols/min [2025-10-07T17:07:37.072029] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:07:37.096333] [DEBUG] [LOCAL ] AIN: Loaded 24606 existing records from primary storage. [2025-10-07T17:07:37.096768] [INFO ] [MAIN ] AIN: Loaded 24606 existing records. [2025-10-07T17:07:37.275502] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T17:07:37.322449] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:07:37.323084] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-07T17:07:37.323139] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-07T17:07:37.323394] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-07T17:07:37.323453] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-07T17:07:37.458004] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-07T17:07:37.673866] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:07:38.247691] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-07T17:07:39.047750] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-07T17:07:39.173598] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T17:07:39.241961] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T17:07:39.847746] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-07T17:07:40.647698] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-07T17:07:41.292734] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T17:07:41.455204] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-07T17:07:41.461208] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-07T17:07:41.729423] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T17:07:42.247682] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-07T17:07:42.786911] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T17:07:43.047631] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-07T17:07:43.712030] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T17:07:43.847595] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-07T17:07:44.522800] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T17:07:44.526054] [INFO ] [REMOTE ] AHR: Full fetch complete (70806 records). [2025-10-07T17:07:44.526165] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-07T17:07:44.652733] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-07T17:07:44.932178] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-07T17:07:44.932265] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-07T17:07:44.933032] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-07T17:07:44.933102] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-07T17:07:44.934601] [DEBUG] [LOCAL ] AHR: Trimmed 70806 records to 49135 (keeping 200 days of data) [2025-10-07T17:07:45.239970] [DEBUG] [LOCAL ] AHR: Primary data saved (49135 records). [2025-10-07T17:07:45.240096] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-07T17:07:45.241087] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AHR took 40.4s. Estimated remaining: 4h 36m 56s. Rate: 8.3 symbols/min [2025-10-07T17:07:45.407407] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:07:45.423393] [DEBUG] [LOCAL ] AIO: Loaded 13376 existing records from primary storage. [2025-10-07T17:07:45.423629] [INFO ] [MAIN ] AIO: Loaded 13376 existing records. [2025-10-07T17:07:45.453638] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-07T17:07:45.609875] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:07:45.610124] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-07T17:07:45.610248] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-07T17:07:45.610623] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-07T17:07:45.610722] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-07T17:07:46.013711] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:07:46.008135] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-07T17:07:46.132862] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-07T17:07:46.247606] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-07T17:07:47.057691] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-07T17:07:47.060672] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-07T17:07:47.847628] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-07T17:07:48.103586] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T17:07:48.173152] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T17:07:48.647730] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-07T17:07:48.675014] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-07T17:07:49.447694] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-07T17:07:50.247706] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-07T17:07:50.535561] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T17:07:51.047633] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-07T17:07:51.269853] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T17:07:51.618908] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-07T17:07:51.847764] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-07T17:07:52.647670] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-07T17:07:52.840614] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T17:07:53.447756] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-07T17:07:53.699234] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T17:07:53.965242] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T17:07:54.247688] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-07T17:07:55.047628] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-07T17:07:55.125914] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T17:07:55.422972] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T17:07:55.847692] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-07T17:07:56.647713] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-07T17:07:56.851792] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-07T17:07:57.447685] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-07T17:07:57.554157] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-07T17:07:58.247752] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-07T17:07:58.430356] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T17:07:58.612873] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-07T17:07:59.047692] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-07T17:07:59.385939] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T17:07:59.847638] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-07T17:08:00.647631] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-07T17:08:00.737550] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T17:08:01.447769] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-07T17:08:01.831639] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T17:08:01.995552] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-07T17:08:02.247729] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-07T17:08:02.963743] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T17:08:02.967411] [INFO ] [REMOTE ] AIG: Full fetch complete (77384 records). [2025-10-07T17:08:02.967528] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-07T17:08:03.052922] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-07T17:08:03.373777] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-07T17:08:03.373920] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-07T17:08:03.374721] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-07T17:08:03.374805] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-07T17:08:03.376478] [DEBUG] [LOCAL ] AIG: Trimmed 77384 records to 53474 (keeping 200 days of data) [2025-10-07T17:08:03.500344] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T17:08:03.747856] [DEBUG] [LOCAL ] AIG: Primary data saved (53474 records). [2025-10-07T17:08:03.748064] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-07T17:08:03.749078] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIG took 32.1s. Estimated remaining: 4h 43m 30s. Rate: 8.1 symbols/min [2025-10-07T17:08:03.851674] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-07T17:08:03.925698] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:08:03.956727] [DEBUG] [LOCAL ] AIR: Loaded 28637 existing records from primary storage. [2025-10-07T17:08:03.957044] [INFO ] [MAIN ] AIR: Loaded 28637 existing records. [2025-10-07T17:08:04.089256] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T17:08:04.168682] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:08:04.168919] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-07T17:08:04.168967] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-07T17:08:04.169305] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-07T17:08:04.169363] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-07T17:08:04.529719] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:08:04.647760] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-07T17:08:05.447722] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-07T17:08:05.923834] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T17:08:06.046953] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T17:08:06.247678] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-07T17:08:06.488241] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-07T17:08:07.049837] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-07T17:08:07.056584] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T17:08:07.847726] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-07T17:08:08.337801] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T17:08:08.647733] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-07T17:08:09.099541] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T17:08:09.447690] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-07T17:08:10.247769] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-07T17:08:10.273950] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T17:08:11.047730] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-07T17:08:11.301284] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T17:08:11.501691] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-07T17:08:11.788052] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T17:08:11.847620] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-07T17:08:12.647708] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-07T17:08:12.916236] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T17:08:13.447703] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-07T17:08:14.247906] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-07T17:08:14.554840] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T17:08:14.556950] [INFO ] [REMOTE ] AIN: Full fetch complete (33556 records). [2025-10-07T17:08:14.557021] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-07T17:08:14.939482] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-07T17:08:14.939637] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-07T17:08:14.940218] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-07T17:08:14.940324] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-07T17:08:14.941463] [DEBUG] [LOCAL ] AIN: Trimmed 33556 records to 24587 (keeping 200 days of data) [2025-10-07T17:08:15.041871] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T17:08:15.045677] [INFO ] [REMOTE ] AIO: Full fetch complete (20159 records). [2025-10-07T17:08:15.046004] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-07T17:08:15.055322] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-07T17:08:15.431202] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-07T17:08:15.487627] [DEBUG] [LOCAL ] AIN: Primary data saved (24587 records). [2025-10-07T17:08:15.518557] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-07T17:08:15.524408] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIN took 38.7s. Estimated remaining: 4h 45m 56s. Rate: 8.1 symbols/min [2025-10-07T17:08:15.524597] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-07T17:08:15.560388] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-07T17:08:15.574386] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-07T17:08:15.588560] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-07T17:08:15.640035] [DEBUG] [LOCAL ] AIO: Trimmed 20159 records to 13422 (keeping 200 days of data) [2025-10-07T17:08:15.774513] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:08:15.813437] [DEBUG] [LOCAL ] AIO: Primary data saved (13422 records). [2025-10-07T17:08:15.814166] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-07T17:08:15.814302] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIO took 30.6s. Estimated remaining: 4h 41m 43s. Rate: 8.2 symbols/min [2025-10-07T17:08:15.814071] [DEBUG] [LOCAL ] AIT: Loaded 27295 existing records from primary storage. [2025-10-07T17:08:15.877182] [INFO ] [MAIN ] AIT: Loaded 27295 existing records. [2025-10-07T17:08:15.868129] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-07T17:08:16.138732] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:08:16.201579] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:08:16.201920] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-07T17:08:16.202029] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-07T17:08:16.202255] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-07T17:08:16.202312] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-07T17:08:16.494865] [DEBUG] [LOCAL ] AIV: Loaded 40739 existing records from primary storage. [2025-10-07T17:08:16.511778] [INFO ] [MAIN ] AIV: Loaded 40739 existing records. [2025-10-07T17:08:16.677857] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T17:08:16.709709] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:08:16.740156] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-07T17:08:16.829584] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:08:16.829855] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-07T17:08:16.829906] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-07T17:08:16.830299] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-07T17:08:16.830359] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-07T17:08:17.193336] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:08:17.447697] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-07T17:08:17.926554] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-07T17:08:17.930033] [INFO ] [REMOTE ] AI: Full fetch complete (77506 records). [2025-10-07T17:08:17.930167] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-07T17:08:17.931146] [FATAL] [VALIDATOR ] AI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:08:17.931244] [FATAL] [MAIN ] AI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:08:17.931288] [WARN ] [MAIN ] AI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:08:17.931329] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-07T17:08:17.931390] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-07T17:08:17.931426] [INFO ] [LOCAL ] AI: Starting deletion of derivative data. [2025-10-07T17:08:17.931633] [DEBUG] [LOCAL ] AI: Deleted derivative data file. [2025-10-07T17:08:17.932578] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AI took 53.8s. Estimated remaining: 4h 38m 39s. Rate: 8.3 symbols/min [2025-10-07T17:08:18.138571] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:08:18.175403] [DEBUG] [LOCAL ] AIZ: Loaded 29808 existing records from primary storage. [2025-10-07T17:08:18.175705] [INFO ] [MAIN ] AIZ: Loaded 29808 existing records. [2025-10-07T17:08:18.248776] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-07T17:08:18.374353] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:08:18.374770] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-07T17:08:18.374967] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-07T17:08:18.378802] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T17:08:18.378846] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-07T17:08:18.379001] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-07T17:08:18.747735] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:08:18.821815] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T17:08:19.047755] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-07T17:08:19.452683] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T17:08:19.847681] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-07T17:08:19.989544] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T17:08:20.647704] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-07T17:08:20.974931] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T17:08:21.447675] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-07T17:08:22.037027] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T17:08:22.247717] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-07T17:08:22.329808] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T17:08:23.047703] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-07T17:08:23.304403] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T17:08:23.847703] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-07T17:08:24.452731] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T17:08:24.647745] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-07T17:08:24.906400] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T17:08:25.447737] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-07T17:08:26.220009] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T17:08:26.247605] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-07T17:08:26.961852] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T17:08:27.047603] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-07T17:08:27.680346] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T17:08:27.847725] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-07T17:08:28.343434] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T17:08:28.647692] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-07T17:08:29.357480] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:08:29.447610] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-07T17:08:29.821905] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T17:08:30.247718] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-07T17:08:30.660706] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T17:08:31.047686] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-07T17:08:31.815470] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T17:08:31.847606] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-07T17:08:32.381926] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T17:08:32.647692] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-07T17:08:33.025010] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T17:08:33.447676] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-07T17:08:34.063876] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T17:08:34.247631] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-07T17:08:34.572906] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T17:08:35.047687] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-07T17:08:35.766597] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T17:08:35.847610] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-07T17:08:36.487262] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T17:08:36.647692] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-07T17:08:37.268334] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T17:08:37.447701] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-07T17:08:38.032338] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T17:08:38.035391] [INFO ] [REMOTE ] AIR: Full fetch complete (39626 records). [2025-10-07T17:08:38.035468] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-07T17:08:38.252920] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-07T17:08:38.416760] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-07T17:08:38.416925] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-07T17:08:38.417892] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-07T17:08:38.417959] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-07T17:08:38.419706] [DEBUG] [LOCAL ] AIR: Trimmed 39626 records to 28749 (keeping 200 days of data) [2025-10-07T17:08:38.590724] [DEBUG] [LOCAL ] AIR: Primary data saved (28749 records). [2025-10-07T17:08:38.590856] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-07T17:08:38.590954] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIR took 34.8s. Estimated remaining: 4h 45m 58s. Rate: 8.0 symbols/min [2025-10-07T17:08:38.713113] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T17:08:38.787904] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:08:38.788076] [DEBUG] [LOCAL ] AIZN: No existing data file found in primary storage. [2025-10-07T17:08:38.788113] [WARN ] [MAIN ] AIZN: No existing data found, performing full refresh instead. [2025-10-07T17:08:38.788228] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-07T17:08:38.788279] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-07T17:08:38.788330] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-10-07T17:08:38.788368] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-07T17:08:39.056513] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-07T17:08:39.138321] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:08:39.847615] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-07T17:08:39.931095] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T17:08:40.112095] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T17:08:40.504710] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T17:08:40.647671] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-07T17:08:41.305486] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T17:08:41.447676] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-07T17:08:41.935800] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T17:08:42.247675] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-07T17:08:43.047735] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-07T17:08:43.549125] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-07T17:08:43.844808] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T17:08:43.853793] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-07T17:08:44.414665] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-07T17:08:44.647704] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-07T17:08:45.447731] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-07T17:08:46.011628] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T17:08:46.247734] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-07T17:08:46.275233] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T17:08:46.887046] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T17:08:47.047759] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-07T17:08:47.847689] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-07T17:08:48.340329] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T17:08:48.647697] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-07T17:08:48.768987] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T17:08:49.447707] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-07T17:08:50.152799] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T17:08:50.157492] [INFO ] [REMOTE ] AIV: Full fetch complete (60082 records). [2025-10-07T17:08:50.157603] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-07T17:08:50.253032] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-07T17:08:50.548426] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-07T17:08:50.548516] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-07T17:08:50.549131] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-07T17:08:50.549195] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-07T17:08:50.551718] [DEBUG] [LOCAL ] AIV: Trimmed 60082 records to 40863 (keeping 200 days of data) [2025-10-07T17:08:50.640317] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T17:08:50.644982] [INFO ] [REMOTE ] AIZ: Full fetch complete (42886 records). [2025-10-07T17:08:50.645625] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-07T17:08:51.044138] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-07T17:08:51.044524] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-07T17:08:51.045374] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-07T17:08:51.045458] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-07T17:08:51.047975] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-07T17:08:51.051955] [DEBUG] [LOCAL ] AIZ: Trimmed 42886 records to 29798 (keeping 200 days of data) [2025-10-07T17:08:51.279145] [DEBUG] [LOCAL ] AIV: Primary data saved (40863 records). [2025-10-07T17:08:51.280297] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-07T17:08:51.283623] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIV took 35.5s. Estimated remaining: 4h 48m 43s. Rate: 8.0 symbols/min [2025-10-07T17:08:51.477058] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:08:51.558073] [DEBUG] [LOCAL ] AIZ: Primary data saved (29798 records). [2025-10-07T17:08:51.558282] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-07T17:08:51.558436] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIZ took 33.6s. Estimated remaining: 4h 44m 41s. Rate: 8.1 symbols/min [2025-10-07T17:08:51.686691] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-07T17:08:51.685775] [DEBUG] [LOCAL ] AJG: Loaded 46800 existing records from primary storage. [2025-10-07T17:08:51.721009] [INFO ] [MAIN ] AJG: Loaded 46800 existing records. [2025-10-07T17:08:51.769673] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:08:51.796313] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-07T17:08:51.832827] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-07T17:08:51.862254] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-07T17:08:51.910187] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-07T17:08:51.914811] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-07T17:08:51.922045] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T17:08:51.937964] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-07T17:08:51.968580] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-07T17:08:52.035848] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:08:52.069804] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-07T17:08:52.079025] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-07T17:08:52.094861] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-07T17:08:52.100985] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-07T17:08:52.566705] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T17:08:52.663345] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-07T17:08:52.724420] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:08:52.812058] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:08:53.352574] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-07T17:08:53.447718] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-07T17:08:53.902863] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-07T17:08:54.247709] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-07T17:08:54.829102] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T17:08:54.830067] [INFO ] [REMOTE ] AIZN: Full fetch complete (5907 records). [2025-10-07T17:08:54.830137] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-07T17:08:55.053370] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-07T17:08:55.196368] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-07T17:08:55.196445] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-07T17:08:55.196608] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-07T17:08:55.196672] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-07T17:08:55.197067] [DEBUG] [LOCAL ] AIZN: Trimmed 5907 records to 4050 (keeping 200 days of data) [2025-10-07T17:08:55.223275] [DEBUG] [LOCAL ] AIZN: Primary data saved (4050 records). [2025-10-07T17:08:55.223400] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-07T17:08:55.223502] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZN took 16.6s. Estimated remaining: 4h 42m 33s. Rate: 8.1 symbols/min [2025-10-07T17:08:55.392913] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:08:55.393118] [DEBUG] [LOCAL ] AKR: No existing data file found in primary storage. [2025-10-07T17:08:55.393157] [WARN ] [MAIN ] AKR: No existing data found, performing full refresh instead. [2025-10-07T17:08:55.393294] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-07T17:08:55.393337] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-07T17:08:55.393378] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-10-07T17:08:55.393409] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-07T17:08:55.750779] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:08:55.847623] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-07T17:08:56.647671] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-07T17:08:56.797021] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T17:08:57.129035] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T17:08:57.447734] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-07T17:08:57.607848] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T17:08:58.247744] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-07T17:08:59.047690] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-07T17:08:59.087923] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T17:08:59.357206] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T17:08:59.847681] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-07T17:09:00.114443] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T17:09:00.308936] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T17:09:00.647716] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-07T17:09:01.447722] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-07T17:09:02.029313] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T17:09:02.247753] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-07T17:09:02.615714] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T17:09:03.047708] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-07T17:09:03.847668] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-07T17:09:04.026319] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T17:09:04.445944] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T17:09:04.599349] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T17:09:04.647604] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-07T17:09:05.447749] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-07T17:09:05.904482] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-07T17:09:06.247687] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-07T17:09:06.250594] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T17:09:07.047739] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-07T17:09:07.366692] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T17:09:07.847699] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-07T17:09:08.259147] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T17:09:08.647723] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-07T17:09:09.147715] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-07T17:09:09.447707] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-07T17:09:09.736994] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-07T17:09:09.738740] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T17:09:10.247727] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-07T17:09:11.047700] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-07T17:09:11.589432] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T17:09:11.847714] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-07T17:09:12.175473] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T17:09:12.177618] [INFO ] [REMOTE ] AIT: Full fetch complete (39246 records). [2025-10-07T17:09:12.177775] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-07T17:09:12.276592] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-07T17:09:12.564817] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-07T17:09:12.564905] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-07T17:09:12.565362] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-07T17:09:12.565406] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-07T17:09:12.566375] [DEBUG] [LOCAL ] AIT: Trimmed 39246 records to 27197 (keeping 200 days of data) [2025-10-07T17:09:12.659007] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-07T17:09:12.741285] [DEBUG] [LOCAL ] AIT: Primary data saved (27197 records). [2025-10-07T17:09:12.741425] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-07T17:09:12.741509] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIT took 57.2s. Estimated remaining: 4h 47m 45s. Rate: 8.0 symbols/min [2025-10-07T17:09:12.919660] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:09:12.962049] [DEBUG] [LOCAL ] AL: Loaded 44414 existing records from primary storage. [2025-10-07T17:09:12.962361] [INFO ] [MAIN ] AL: Loaded 44414 existing records. [2025-10-07T17:09:13.141868] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:09:13.142130] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-07T17:09:13.142191] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-07T17:09:13.142481] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-07T17:09:13.142539] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-07T17:09:13.452744] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-07T17:09:13.546540] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:09:14.247715] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-07T17:09:14.361279] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T17:09:14.717176] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-07T17:09:15.047701] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-07T17:09:15.439077] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T17:09:15.847690] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-07T17:09:16.647683] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-07T17:09:16.680280] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T17:09:17.447790] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-07T17:09:17.507284] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T17:09:17.780027] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-07T17:09:18.247714] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-07T17:09:18.303777] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T17:09:18.624373] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T17:09:18.625119] [INFO ] [REMOTE ] AKA: Full fetch complete (2421 records). [2025-10-07T17:09:18.625189] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-07T17:09:18.807136] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T17:09:18.807338] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:09:18.807384] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:09:18.807449] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-07T17:09:18.807511] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-07T17:09:18.807547] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-07T17:09:18.807584] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-07T17:09:18.807662] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 27.2s. Estimated remaining: 4h 46m 53s. Rate: 8.0 symbols/min [2025-10-07T17:09:18.969214] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:09:19.023534] [DEBUG] [LOCAL ] ALB: Loaded 53274 existing records from primary storage. [2025-10-07T17:09:19.023886] [INFO ] [MAIN ] ALB: Loaded 53274 existing records. [2025-10-07T17:09:19.052921] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-07T17:09:19.199378] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:09:19.199601] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-07T17:09:19.199673] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-07T17:09:19.200168] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-07T17:09:19.200225] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-07T17:09:19.582080] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:09:19.847691] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-07T17:09:20.343136] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T17:09:20.647743] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-07T17:09:21.447634] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-07T17:09:21.646343] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T17:09:22.247709] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-07T17:09:22.300254] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T17:09:23.047682] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-07T17:09:23.298220] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T17:09:23.847684] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-07T17:09:23.970594] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T17:09:24.355927] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T17:09:24.647754] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-07T17:09:25.269555] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T17:09:25.273111] [INFO ] [REMOTE ] AKR: Full fetch complete (65412 records). [2025-10-07T17:09:25.273223] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-07T17:09:25.454691] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-07T17:09:25.728011] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-07T17:09:25.728114] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-07T17:09:25.728829] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-07T17:09:25.728896] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-07T17:09:25.730366] [DEBUG] [LOCAL ] AKR: Trimmed 65412 records to 45872 (keeping 200 days of data) [2025-10-07T17:09:26.009839] [DEBUG] [LOCAL ] AKR: Primary data saved (45872 records). [2025-10-07T17:09:26.009990] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-07T17:09:26.010069] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKR took 30.8s. Estimated remaining: 4h 46m 36s. Rate: 8.0 symbols/min [2025-10-07T17:09:26.183604] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:09:26.211526] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T17:09:26.248865] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-07T17:09:26.270841] [DEBUG] [LOCAL ] ALC: Loaded 50954 existing records from primary storage. [2025-10-07T17:09:26.271329] [INFO ] [MAIN ] ALC: Loaded 50954 existing records. [2025-10-07T17:09:26.447743] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:09:26.447986] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-07T17:09:26.448034] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-07T17:09:26.448260] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-07T17:09:26.448316] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-07T17:09:26.794414] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:09:27.047783] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-07T17:09:27.355978] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T17:09:27.847697] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-07T17:09:27.898639] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T17:09:28.652904] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-07T17:09:28.667847] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T17:09:29.260100] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T17:09:29.447625] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-07T17:09:30.229394] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T17:09:30.247595] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-07T17:09:31.034160] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T17:09:31.047602] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-07T17:09:31.847623] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-07T17:09:31.971765] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T17:09:32.647711] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-07T17:09:32.810417] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T17:09:33.241390] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T17:09:33.447761] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-07T17:09:34.045851] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T17:09:34.247691] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-07T17:09:35.047707] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-07T17:09:35.569321] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-07T17:09:35.729291] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T17:09:35.847622] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-07T17:09:36.373566] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T17:09:36.376793] [INFO ] [REMOTE ] AJG: Full fetch complete (69296 records). [2025-10-07T17:09:36.376902] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-07T17:09:36.658594] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-07T17:09:36.807583] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-07T17:09:36.807734] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-07T17:09:36.808557] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-07T17:09:36.808627] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-07T17:09:36.810500] [DEBUG] [LOCAL ] AJG: Trimmed 69296 records to 46742 (keeping 200 days of data) [2025-10-07T17:09:37.139256] [DEBUG] [LOCAL ] AJG: Primary data saved (46742 records). [2025-10-07T17:09:37.139482] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-07T17:09:37.140602] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AJG took 45.9s. Estimated remaining: 4h 48m 19s. Rate: 8.0 symbols/min [2025-10-07T17:09:37.315329] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:09:37.356171] [DEBUG] [LOCAL ] ALE: Loaded 31117 existing records from primary storage. [2025-10-07T17:09:37.356551] [INFO ] [MAIN ] ALE: Loaded 31117 existing records. [2025-10-07T17:09:37.453815] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-07T17:09:37.551339] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:09:37.551628] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-07T17:09:37.551719] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-07T17:09:37.551990] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-07T17:09:37.552050] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-07T17:09:37.962380] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:09:37.994900] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-07T17:09:38.247669] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-07T17:09:38.334402] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T17:09:39.047635] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-07T17:09:39.209366] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T17:09:39.339159] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T17:09:39.847694] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-07T17:09:40.338122] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T17:09:40.647708] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-07T17:09:40.819523] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T17:09:41.447687] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-07T17:09:42.247745] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-07T17:09:42.470087] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T17:09:42.602977] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T17:09:43.047713] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-07T17:09:43.662084] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T17:09:43.847623] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-07T17:09:44.085284] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T17:09:44.647703] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-07T17:09:45.447630] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-07T17:09:45.576309] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T17:09:46.247744] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-07T17:09:46.621090] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T17:09:46.653300] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T17:09:47.047684] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-07T17:09:47.847707] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-07T17:09:48.136394] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-07T17:09:48.553767] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T17:09:48.556934] [INFO ] [REMOTE ] AL: Full fetch complete (62839 records). [2025-10-07T17:09:48.557033] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-07T17:09:48.652827] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-07T17:09:48.990462] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-07T17:09:48.990612] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-07T17:09:48.991570] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-07T17:09:48.991709] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-07T17:09:49.012604] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T17:09:49.020112] [DEBUG] [LOCAL ] AL: Trimmed 62839 records to 44440 (keeping 200 days of data) [2025-10-07T17:09:49.322362] [DEBUG] [LOCAL ] AL: Primary data saved (44440 records). [2025-10-07T17:09:49.322567] [INFO ] [MAIN ] AL: Full history saved. [2025-10-07T17:09:49.323585] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AL took 36.6s. Estimated remaining: 4h 50m 30s. Rate: 7.9 symbols/min [2025-10-07T17:09:49.447732] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-07T17:09:50.247744] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-07T17:09:50.848716] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-07T17:09:51.047746] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-07T17:09:51.226995] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T17:09:51.414447] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T17:09:51.847719] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-07T17:09:52.647738] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-07T17:09:53.224663] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-07T17:09:53.447796] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-07T17:09:53.635779] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T17:09:54.039962] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T17:09:54.247687] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-07T17:09:55.047785] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-07T17:09:55.705580] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-07T17:09:55.847618] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-07T17:09:55.950254] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T17:09:56.196211] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T17:09:56.647763] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-07T17:09:57.447768] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-07T17:09:57.569072] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-07T17:09:57.572633] [INFO ] [REMOTE ] ALB: Full fetch complete (76882 records). [2025-10-07T17:09:57.572855] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-07T17:09:57.976894] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-07T17:09:57.976979] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-07T17:09:57.977736] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-07T17:09:57.977801] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-07T17:09:57.979336] [DEBUG] [LOCAL ] ALB: Trimmed 76882 records to 53275 (keeping 200 days of data) [2025-10-07T17:09:58.097384] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T17:09:58.247928] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-07T17:09:58.351862] [DEBUG] [LOCAL ] ALB: Primary data saved (53275 records). [2025-10-07T17:09:58.352070] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-07T17:09:58.353195] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALB took 39.5s. Estimated remaining: 4h 51m 4s. Rate: 7.9 symbols/min [2025-10-07T17:09:59.019926] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T17:09:59.023576] [INFO ] [REMOTE ] ALC: Full fetch complete (73138 records). [2025-10-07T17:09:59.023721] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-07T17:09:59.406105] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T17:09:59.431561] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-07T17:09:59.431682] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-07T17:09:59.432430] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-07T17:09:59.432508] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-07T17:09:59.432672] [INFO ] [REMOTE ] ALE: Full fetch complete (43350 records). [2025-10-07T17:09:59.432913] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-07T17:09:59.537600] [DEBUG] [LOCAL ] ALC: Trimmed 73138 records to 50987 (keeping 200 days of data) [2025-10-07T17:09:59.937055] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-07T17:09:59.939440] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-07T17:09:59.941343] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-07T17:09:59.944694] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-07T17:09:59.996778] [DEBUG] [LOCAL ] ALE: Trimmed 43350 records to 31260 (keeping 200 days of data) [2025-10-07T17:10:00.252268] [DEBUG] [LOCAL ] ALC: Primary data saved (50987 records). [2025-10-07T17:10:00.253630] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-07T17:10:00.256601] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 34.2s. Estimated remaining: 4h 48m 11s. Rate: 8.0 symbols/min [2025-10-07T17:10:00.358086] [DEBUG] [LOCAL ] ALE: Primary data saved (31260 records). [2025-10-07T17:10:00.358240] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-07T17:10:00.358330] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALE took 23.2s. Estimated remaining: 4h 44m 30s. Rate: 8.1 symbols/min [2025-10-07T17:10:01.094499] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:01.086997] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:01.206340] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:01.211015] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:01.306878] [DEBUG] [LOCAL ] ALG: Loaded 10048 existing records from primary storage. [2025-10-07T17:10:01.307464] [INFO ] [MAIN ] ALG: Loaded 10048 existing records. [2025-10-07T17:10:01.472999] [DEBUG] [LOCAL ] ALEX: Loaded 31205 existing records from primary storage. [2025-10-07T17:10:01.529835] [INFO ] [MAIN ] ALEX: Loaded 31205 existing records. [2025-10-07T17:10:01.644722] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:01.657165] [DEBUG] [LOCAL ] ALIT: Loaded 52768 existing records from primary storage. [2025-10-07T17:10:01.674054] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-07T17:10:01.663036] [DEBUG] [LOCAL ] ALK: Loaded 53058 existing records from primary storage. [2025-10-07T17:10:01.684605] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-07T17:10:01.684748] [INFO ] [MAIN ] ALIT: Loaded 52768 existing records. [2025-10-07T17:10:01.719274] [INFO ] [MAIN ] ALK: Loaded 53058 existing records. [2025-10-07T17:10:01.713971] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-07T17:10:01.797782] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-07T17:10:02.199786] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:02.295107] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:02.295444] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-07T17:10:02.311038] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-07T17:10:02.334100] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-07T17:10:02.399921] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-07T17:10:02.425028] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-07T17:10:02.468308] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:02.452190] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-07T17:10:02.473590] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-07T17:10:02.486944] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-07T17:10:02.517116] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-07T17:10:02.511910] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-07T17:10:02.673308] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-07T17:10:02.701495] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-07T17:10:02.898248] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:02.904085] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-07T17:10:03.576066] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:03.628061] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-07T17:10:03.690823] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:03.691237] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-07T17:10:03.686181] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:03.692119] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-07T17:10:04.047415] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T17:10:04.050490] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-07T17:10:04.888334] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-07T17:10:04.891437] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-07T17:10:05.210504] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T17:10:05.217369] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-07T17:10:05.668490] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T17:10:05.679281] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-07T17:10:05.709440] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-07T17:10:05.720617] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-07T17:10:05.922781] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T17:10:06.247725] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-07T17:10:06.511064] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T17:10:06.940511] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-07T17:10:07.047638] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-07T17:10:07.226484] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:10:07.816620] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-07T17:10:07.847595] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-07T17:10:08.151486] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T17:10:08.647740] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-07T17:10:09.342906] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T17:10:09.447631] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-07T17:10:09.476133] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T17:10:10.247693] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-07T17:10:11.047631] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-07T17:10:11.091013] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T17:10:11.261382] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T17:10:11.847699] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-07T17:10:12.438230] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T17:10:12.647633] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-07T17:10:12.783245] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T17:10:13.447686] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-07T17:10:14.234457] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T17:10:14.247609] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-07T17:10:15.047632] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-07T17:10:15.108093] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T17:10:15.847618] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-07T17:10:16.035796] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T17:10:16.113990] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T17:10:16.647698] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-07T17:10:17.447637] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-07T17:10:17.973875] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-07T17:10:18.247639] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-07T17:10:18.314981] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T17:10:18.846345] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T17:10:19.047683] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-07T17:10:19.713272] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T17:10:19.807566] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T17:10:19.847606] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-07T17:10:20.647725] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-07T17:10:21.169907] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-07T17:10:21.447688] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-07T17:10:21.641425] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T17:10:22.247691] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-07T17:10:22.894774] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T17:10:22.957947] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T17:10:22.959107] [INFO ] [REMOTE ] ALG: Full fetch complete (15780 records). [2025-10-07T17:10:22.959179] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-07T17:10:23.056415] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-07T17:10:23.330031] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-07T17:10:23.330112] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-07T17:10:23.330430] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-07T17:10:23.330492] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-07T17:10:23.331144] [DEBUG] [LOCAL ] ALG: Trimmed 15780 records to 9968 (keeping 200 days of data) [2025-10-07T17:10:23.395187] [DEBUG] [LOCAL ] ALG: Primary data saved (9968 records). [2025-10-07T17:10:23.395338] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-07T17:10:23.395424] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 23.0s. Estimated remaining: 4h 51m 43s. Rate: 7.8 symbols/min [2025-10-07T17:10:23.566763] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:23.621088] [DEBUG] [LOCAL ] ALL: Loaded 49926 existing records from primary storage. [2025-10-07T17:10:23.621452] [INFO ] [MAIN ] ALL: Loaded 49926 existing records. [2025-10-07T17:10:23.802360] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:23.802574] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-07T17:10:23.802621] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-07T17:10:23.802965] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-07T17:10:23.803021] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-07T17:10:23.856318] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-07T17:10:24.171964] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:24.188263] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T17:10:24.647695] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-07T17:10:25.447741] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-07T17:10:25.706558] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T17:10:26.247633] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-07T17:10:26.353307] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T17:10:27.047739] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-07T17:10:27.224164] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T17:10:27.847620] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-07T17:10:28.084756] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T17:10:28.647679] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-07T17:10:29.026803] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-07T17:10:29.447619] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-07T17:10:29.484043] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T17:10:30.053431] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T17:10:30.247687] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-07T17:10:31.036140] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T17:10:31.047607] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-07T17:10:31.847679] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-07T17:10:32.145007] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-07T17:10:32.505385] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T17:10:32.647667] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-07T17:10:33.447781] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-07T17:10:33.578505] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T17:10:33.582158] [INFO ] [REMOTE ] ALK: Full fetch complete (76838 records). [2025-10-07T17:10:33.582293] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-07T17:10:34.000258] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T17:10:34.004077] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-07T17:10:34.009559] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-07T17:10:34.011373] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-07T17:10:34.011950] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-07T17:10:34.013978] [DEBUG] [LOCAL ] ALK: Trimmed 76838 records to 53059 (keeping 200 days of data) [2025-10-07T17:10:34.247718] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-07T17:10:34.360257] [DEBUG] [LOCAL ] ALK: Primary data saved (53059 records). [2025-10-07T17:10:34.360462] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-07T17:10:34.362412] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALK took 34.0s. Estimated remaining: 4h 53m 8s. Rate: 7.8 symbols/min [2025-10-07T17:10:34.547769] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:34.600969] [DEBUG] [LOCAL ] ALLE: Loaded 44573 existing records from primary storage. [2025-10-07T17:10:34.601461] [INFO ] [MAIN ] ALLE: Loaded 44573 existing records. [2025-10-07T17:10:34.798984] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:34.799349] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-07T17:10:34.799402] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-07T17:10:34.801108] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-07T17:10:34.801178] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-07T17:10:35.050306] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-07T17:10:35.038021] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T17:10:35.091768] [INFO ] [REMOTE ] ALIT: Full fetch complete (76434 records). [2025-10-07T17:10:35.110569] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-07T17:10:35.305944] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:35.676414] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-07T17:10:35.676552] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-07T17:10:35.677361] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-07T17:10:35.677509] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-07T17:10:35.679728] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T17:10:35.689064] [DEBUG] [LOCAL ] ALIT: Trimmed 76434 records to 52769 (keeping 200 days of data) [2025-10-07T17:10:35.858147] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-07T17:10:36.001008] [DEBUG] [LOCAL ] ALIT: Primary data saved (52769 records). [2025-10-07T17:10:36.001167] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-07T17:10:36.002187] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALIT took 35.6s. Estimated remaining: 4h 50m 14s. Rate: 7.9 symbols/min [2025-10-07T17:10:36.170016] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:36.227164] [DEBUG] [LOCAL ] ALLY: Loaded 53227 existing records from primary storage. [2025-10-07T17:10:36.227555] [INFO ] [MAIN ] ALLY: Loaded 53227 existing records. [2025-10-07T17:10:36.446905] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:36.447406] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-07T17:10:36.447555] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-07T17:10:36.449460] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-07T17:10:36.449555] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-07T17:10:36.579385] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T17:10:36.652715] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-07T17:10:36.951958] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:37.085492] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T17:10:37.088133] [INFO ] [REMOTE ] ALEX: Full fetch complete (44725 records). [2025-10-07T17:10:37.088219] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-07T17:10:37.454009] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-07T17:10:37.457612] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-07T17:10:37.457735] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-07T17:10:37.458261] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-07T17:10:37.458308] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-07T17:10:37.459416] [DEBUG] [LOCAL ] ALEX: Trimmed 44725 records to 31218 (keeping 200 days of data) [2025-10-07T17:10:37.669576] [DEBUG] [LOCAL ] ALEX: Primary data saved (31218 records). [2025-10-07T17:10:37.669769] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-07T17:10:37.669887] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALEX took 37.3s. Estimated remaining: 4h 47m 25s. Rate: 8.0 symbols/min [2025-10-07T17:10:37.902878] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:37.959977] [DEBUG] [LOCAL ] ALSN: Loaded 43330 existing records from primary storage. [2025-10-07T17:10:37.960425] [INFO ] [MAIN ] ALSN: Loaded 43330 existing records. [2025-10-07T17:10:38.178086] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T17:10:38.254607] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-07T17:10:38.306002] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:38.306354] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-07T17:10:38.306440] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-07T17:10:38.307986] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-07T17:10:38.308079] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-07T17:10:38.754108] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:39.047668] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-07T17:10:39.197447] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T17:10:39.847622] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-07T17:10:39.980220] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T17:10:40.636533] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T17:10:40.647596] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-07T17:10:41.256048] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T17:10:41.447730] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-07T17:10:41.944114] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T17:10:42.247727] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-07T17:10:43.047667] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-07T17:10:43.275043] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T17:10:43.688603] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T17:10:43.847693] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-07T17:10:44.647630] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-07T17:10:44.764073] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T17:10:45.287434] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T17:10:45.447744] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-07T17:10:46.247668] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-07T17:10:46.363071] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T17:10:46.909627] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T17:10:47.047604] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-07T17:10:47.656160] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T17:10:47.847610] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-07T17:10:48.176821] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T17:10:48.647687] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-07T17:10:49.271574] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T17:10:49.447696] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-07T17:10:50.196694] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T17:10:50.247720] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-07T17:10:51.047698] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-07T17:10:51.346929] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T17:10:51.811126] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T17:10:51.847713] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-07T17:10:52.490131] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T17:10:52.647637] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-07T17:10:53.410362] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T17:10:53.447610] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-07T17:10:54.252940] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-07T17:10:54.273678] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T17:10:55.047674] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-07T17:10:55.283112] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T17:10:55.847639] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-07T17:10:56.017864] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T17:10:56.590541] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T17:10:56.647640] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-07T17:10:57.313883] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:10:57.447702] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-07T17:10:58.118521] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T17:10:58.121766] [INFO ] [REMOTE ] ALL: Full fetch complete (72391 records). [2025-10-07T17:10:58.121871] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-07T17:10:58.259204] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-07T17:10:58.517179] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-07T17:10:58.517284] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-07T17:10:58.518005] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-07T17:10:58.518069] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-07T17:10:58.519554] [DEBUG] [LOCAL ] ALL: Trimmed 72391 records to 49915 (keeping 200 days of data) [2025-10-07T17:10:58.850338] [DEBUG] [LOCAL ] ALL: Primary data saved (49915 records). [2025-10-07T17:10:58.850508] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-07T17:10:58.851601] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 35.5s. Estimated remaining: 4h 53m 24s. Rate: 7.8 symbols/min [2025-10-07T17:10:59.022489] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:10:59.045874] [DEBUG] [LOCAL ] ALTG: Loaded 23567 existing records from primary storage. [2025-10-07T17:10:59.046160] [INFO ] [MAIN ] ALTG: Loaded 23567 existing records. [2025-10-07T17:10:59.077903] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-07T17:10:59.268902] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:10:59.293116] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-07T17:10:59.294022] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-07T17:10:59.296074] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-07T17:10:59.295983] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T17:10:59.305408] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-07T17:10:59.718967] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:10:59.847631] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-07T17:10:59.877610] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T17:11:00.647717] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-07T17:11:01.191702] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T17:11:01.262079] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-07T17:11:01.447682] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-07T17:11:02.247635] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-07T17:11:02.309679] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T17:11:02.672824] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T17:11:03.047730] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-07T17:11:03.814746] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T17:11:03.847606] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-07T17:11:04.647710] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-07T17:11:04.925394] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T17:11:05.219544] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T17:11:05.447728] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-07T17:11:05.939852] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T17:11:05.942839] [INFO ] [REMOTE ] ALLE: Full fetch complete (64634 records). [2025-10-07T17:11:05.942943] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-07T17:11:06.252849] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-07T17:11:06.348266] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-07T17:11:06.348440] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-07T17:11:06.349106] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-07T17:11:06.349170] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-07T17:11:06.350387] [DEBUG] [LOCAL ] ALLE: Trimmed 64634 records to 44491 (keeping 200 days of data) [2025-10-07T17:11:06.633928] [DEBUG] [LOCAL ] ALLE: Primary data saved (44491 records). [2025-10-07T17:11:06.634056] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-07T17:11:06.635347] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALLE took 32.3s. Estimated remaining: 4h 53m 18s. Rate: 7.8 symbols/min [2025-10-07T17:11:06.807058] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:11:06.830864] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T17:11:06.847879] [DEBUG] [LOCAL ] ALUR: Loaded 10746 existing records from primary storage. [2025-10-07T17:11:06.848145] [INFO ] [MAIN ] ALUR: Loaded 10746 existing records. [2025-10-07T17:11:07.041981] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:11:07.042320] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-07T17:11:07.042402] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-07T17:11:07.043019] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-07T17:11:07.043099] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-07T17:11:07.058134] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-07T17:11:07.459835] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:11:07.461353] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T17:11:07.847678] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-07T17:11:08.481183] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-07T17:11:08.647740] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-07T17:11:09.241081] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T17:11:09.447629] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-07T17:11:09.903349] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T17:11:10.247730] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-07T17:11:10.802839] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T17:11:11.047723] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-07T17:11:11.434147] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T17:11:11.847684] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-07T17:11:12.261036] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T17:11:12.647755] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-07T17:11:13.154693] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T17:11:13.447693] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-07T17:11:14.127535] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T17:11:14.131220] [INFO ] [REMOTE ] ALLY: Full fetch complete (76941 records). [2025-10-07T17:11:14.131373] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-07T17:11:14.247869] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-07T17:11:14.359345] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T17:11:14.565533] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-07T17:11:14.565627] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-07T17:11:14.566435] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-07T17:11:14.566495] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-07T17:11:14.568258] [DEBUG] [LOCAL ] ALLY: Trimmed 76941 records to 53228 (keeping 200 days of data) [2025-10-07T17:11:14.894857] [DEBUG] [LOCAL ] ALLY: Primary data saved (53228 records). [2025-10-07T17:11:14.895001] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-07T17:11:14.896062] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 38.9s. Estimated remaining: 4h 53m 25s. Rate: 7.8 symbols/min [2025-10-07T17:11:15.065526] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:11:15.061550] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-07T17:11:15.113956] [DEBUG] [LOCAL ] ALV: Loaded 42223 existing records from primary storage. [2025-10-07T17:11:15.114256] [INFO ] [MAIN ] ALV: Loaded 42223 existing records. [2025-10-07T17:11:15.303335] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:11:15.304002] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-07T17:11:15.304050] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-07T17:11:15.305254] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-07T17:11:15.305314] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-07T17:11:15.396391] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T17:11:15.672973] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:11:15.847710] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-07T17:11:15.974456] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-07T17:11:16.647639] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-07T17:11:17.005775] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T17:11:17.447704] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-07T17:11:18.196128] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T17:11:18.247610] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-07T17:11:19.028970] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T17:11:19.047595] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-07T17:11:19.565758] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T17:11:19.569392] [INFO ] [REMOTE ] ALSN: Full fetch complete (62184 records). [2025-10-07T17:11:19.569563] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-07T17:11:19.860865] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-07T17:11:20.035686] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-07T17:11:20.035817] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-07T17:11:20.036545] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-07T17:11:20.036626] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-07T17:11:20.038215] [DEBUG] [LOCAL ] ALSN: Trimmed 62184 records to 43331 (keeping 200 days of data) [2025-10-07T17:11:20.317867] [DEBUG] [LOCAL ] ALSN: Primary data saved (43331 records). [2025-10-07T17:11:20.318009] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-07T17:11:20.319021] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALSN took 42.6s. Estimated remaining: 4h 52m 18s. Rate: 7.8 symbols/min [2025-10-07T17:11:20.506503] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:11:20.516829] [DEBUG] [LOCAL ] ALX: Loaded 6403 existing records from primary storage. [2025-10-07T17:11:20.517084] [INFO ] [MAIN ] ALX: Loaded 6403 existing records. [2025-10-07T17:11:20.656382] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-07T17:11:20.737925] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T17:11:20.799913] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:11:20.775895] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T17:11:20.802197] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-07T17:11:20.805480] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-07T17:11:20.806039] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-07T17:11:20.806184] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-07T17:11:21.181735] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:11:21.447764] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-07T17:11:21.925484] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T17:11:22.247782] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-07T17:11:22.519861] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T17:11:23.047689] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-07T17:11:23.525008] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T17:11:23.830285] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-07T17:11:23.847596] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-07T17:11:24.647632] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-07T17:11:24.779494] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T17:11:25.447716] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-07T17:11:26.193938] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T17:11:26.247687] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-07T17:11:26.259615] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T17:11:27.033366] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T17:11:27.047629] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-07T17:11:27.847699] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-07T17:11:27.896518] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T17:11:27.898674] [INFO ] [REMOTE ] ALTG: Full fetch complete (33718 records). [2025-10-07T17:11:27.898774] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-07T17:11:28.282421] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-07T17:11:28.282504] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-07T17:11:28.282917] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-07T17:11:28.282980] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-07T17:11:28.283822] [DEBUG] [LOCAL ] ALTG: Trimmed 33718 records to 23593 (keeping 200 days of data) [2025-10-07T17:11:28.420232] [DEBUG] [LOCAL ] ALTG: Primary data saved (23593 records). [2025-10-07T17:11:28.420367] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-07T17:11:28.420473] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 29.6s. Estimated remaining: 4h 52m 22s. Rate: 7.8 symbols/min [2025-10-07T17:11:28.587583] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:11:28.639404] [DEBUG] [LOCAL ] AM: Loaded 52028 existing records from primary storage. [2025-10-07T17:11:28.639748] [INFO ] [MAIN ] AM: Loaded 52028 existing records. [2025-10-07T17:11:28.652808] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-07T17:11:28.822423] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:11:28.822767] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-07T17:11:28.822838] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-07T17:11:28.824208] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-07T17:11:28.824272] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-07T17:11:29.182609] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:11:29.222767] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T17:11:29.313520] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T17:11:29.447629] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-07T17:11:29.958363] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-07T17:11:30.247682] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-07T17:11:31.047680] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-07T17:11:31.566346] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-07T17:11:31.847695] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-07T17:11:32.144920] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T17:11:32.563725] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T17:11:32.647604] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-07T17:11:33.172114] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T17:11:33.173222] [INFO ] [REMOTE ] ALUR: Full fetch complete (20074 records). [2025-10-07T17:11:33.173293] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-07T17:11:33.452821] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-07T17:11:33.540101] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-07T17:11:33.540190] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-07T17:11:33.540520] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-07T17:11:33.540564] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-07T17:11:33.541117] [DEBUG] [LOCAL ] ALUR: Trimmed 20074 records to 10741 (keeping 200 days of data) [2025-10-07T17:11:33.603097] [DEBUG] [LOCAL ] ALUR: Primary data saved (10741 records). [2025-10-07T17:11:33.603232] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-07T17:11:33.603329] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 27.0s. Estimated remaining: 4h 51m 10s. Rate: 7.8 symbols/min [2025-10-07T17:11:33.770194] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:11:33.805936] [DEBUG] [LOCAL ] AMBC: Loaded 36473 existing records from primary storage. [2025-10-07T17:11:33.806235] [INFO ] [MAIN ] AMBC: Loaded 36473 existing records. [2025-10-07T17:11:33.986390] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:11:33.986618] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-07T17:11:33.986698] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-07T17:11:33.987694] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-07T17:11:33.987755] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-07T17:11:34.254305] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-07T17:11:34.344117] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:11:35.034272] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T17:11:35.047605] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-07T17:11:35.737975] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T17:11:35.847625] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-07T17:11:36.111919] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T17:11:36.647716] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-07T17:11:37.454916] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-07T17:11:37.473765] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T17:11:37.904082] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T17:11:37.903398] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-07T17:11:38.247618] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-07T17:11:39.047621] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-07T17:11:39.279969] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T17:11:39.847674] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-07T17:11:40.647739] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-07T17:11:40.737856] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T17:11:41.193363] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-07T17:11:41.447767] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-07T17:11:41.542548] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T17:11:42.247688] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-07T17:11:42.838918] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T17:11:43.053312] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-07T17:11:43.066363] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T17:11:43.847768] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-07T17:11:44.647625] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-07T17:11:44.834895] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T17:11:44.922683] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T17:11:45.227551] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T17:11:45.447617] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-07T17:11:46.001228] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-07T17:11:46.247750] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-07T17:11:47.047736] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-07T17:11:47.774517] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T17:11:47.847676] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-07T17:11:48.647684] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-07T17:11:48.762586] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T17:11:48.993310] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T17:11:49.435342] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T17:11:49.447598] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-07T17:11:50.247757] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-07T17:11:50.907468] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T17:11:51.047612] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-07T17:11:51.474209] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T17:11:51.847685] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-07T17:11:52.405885] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T17:11:52.647636] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-07T17:11:52.693297] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-07T17:11:53.447703] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-07T17:11:54.148755] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T17:11:54.149941] [INFO ] [REMOTE ] ALX: Full fetch complete (7309 records). [2025-10-07T17:11:54.150037] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-07T17:11:54.250113] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-07T17:11:54.559065] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-07T17:11:54.559508] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-07T17:11:54.561056] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-07T17:11:54.559742] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-07T17:11:54.570808] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-07T17:11:54.571840] [DEBUG] [LOCAL ] ALX: Trimmed 7309 records to 6461 (keeping 200 days of data) [2025-10-07T17:11:54.612018] [DEBUG] [LOCAL ] ALX: Primary data saved (6461 records). [2025-10-07T17:11:54.612107] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-07T17:11:54.612181] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 34.3s. Estimated remaining: 4h 56m 37s. Rate: 7.7 symbols/min [2025-10-07T17:11:54.777053] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:11:54.821240] [DEBUG] [LOCAL ] AMBP: Loaded 44851 existing records from primary storage. [2025-10-07T17:11:54.821540] [INFO ] [MAIN ] AMBP: Loaded 44851 existing records. [2025-10-07T17:11:54.995989] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:11:54.996209] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-07T17:11:54.996256] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-07T17:11:54.997355] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-07T17:11:54.997426] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-07T17:11:55.052864] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-07T17:11:55.357216] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:11:55.434785] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T17:11:55.847670] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-07T17:11:56.647733] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-07T17:11:56.674254] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T17:11:57.354977] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T17:11:57.358082] [INFO ] [REMOTE ] ALV: Full fetch complete (61769 records). [2025-10-07T17:11:57.358180] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-07T17:11:57.457246] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-07T17:11:57.753181] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-07T17:11:57.753263] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-07T17:11:57.753889] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-07T17:11:57.753957] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-07T17:11:57.755255] [DEBUG] [LOCAL ] ALV: Trimmed 61769 records to 42166 (keeping 200 days of data) [2025-10-07T17:11:58.021166] [DEBUG] [LOCAL ] ALV: Primary data saved (42166 records). [2025-10-07T17:11:58.021298] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-07T17:11:58.022225] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALV took 43.1s. Estimated remaining: 4h 54m 41s. Rate: 7.7 symbols/min [2025-10-07T17:11:58.197204] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:11:58.197431] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-07T17:11:58.197488] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-07T17:11:58.197600] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-07T17:11:58.197663] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-07T17:11:58.197733] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-07T17:11:58.197768] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-07T17:11:58.255497] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-07T17:11:58.514989] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T17:11:58.602882] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:11:58.894113] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T17:11:59.047631] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-07T17:11:59.485454] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T17:11:59.847717] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-07T17:12:00.041095] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:12:00.041385] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-07T17:12:00.041486] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:12:00.041556] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-07T17:12:00.041621] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:12:00.041755] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-07T17:12:00.041834] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-07T17:12:00.041872] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-07T17:12:00.041926] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-07T17:12:00.041996] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBQ took 2.0s. Estimated remaining: 4h 52m 12s. Rate: 7.8 symbols/min [2025-10-07T17:12:00.213219] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:12:00.268634] [DEBUG] [LOCAL ] AMC: Loaded 53761 existing records from primary storage. [2025-10-07T17:12:00.269035] [INFO ] [MAIN ] AMC: Loaded 53761 existing records. [2025-10-07T17:12:00.450248] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:12:00.450461] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-07T17:12:00.450509] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-07T17:12:00.451944] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-07T17:12:00.452124] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-07T17:12:00.652812] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-07T17:12:00.815998] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:12:00.855237] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T17:12:01.447745] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-07T17:12:01.782705] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T17:12:02.247707] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-07T17:12:02.660723] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T17:12:03.047747] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-07T17:12:03.847775] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-07T17:12:04.260629] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T17:12:04.264078] [INFO ] [REMOTE ] AMBC: Full fetch complete (51503 records). [2025-10-07T17:12:04.264240] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-07T17:12:04.648489] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-07T17:12:04.661580] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-07T17:12:04.663978] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-07T17:12:04.664765] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-07T17:12:04.664900] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-07T17:12:04.700827] [DEBUG] [LOCAL ] AMBC: Trimmed 51503 records to 36458 (keeping 200 days of data) [2025-10-07T17:12:04.703891] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-07T17:12:04.919972] [DEBUG] [LOCAL ] AMBC: Primary data saved (36458 records). [2025-10-07T17:12:04.920142] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-07T17:12:04.921328] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 31.3s. Estimated remaining: 4h 50m 56s. Rate: 7.8 symbols/min [2025-10-07T17:12:05.086548] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:12:05.139179] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-07T17:12:05.139517] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-07T17:12:05.321704] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:12:05.321957] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-07T17:12:05.322011] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-07T17:12:05.322292] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-07T17:12:05.322349] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-07T17:12:05.466951] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-07T17:12:05.555269] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T17:12:05.634004] [INFO ] [REMOTE ] AM: Full fetch complete (75589 records). [2025-10-07T17:12:05.655085] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-07T17:12:05.858713] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:12:06.229627] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-07T17:12:06.229795] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-07T17:12:06.230683] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-07T17:12:06.230753] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-07T17:12:06.232998] [DEBUG] [LOCAL ] AM: Trimmed 75589 records to 52017 (keeping 200 days of data) [2025-10-07T17:12:06.297927] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-07T17:12:06.396605] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T17:12:06.672547] [DEBUG] [LOCAL ] AM: Primary data saved (52017 records). [2025-10-07T17:12:06.672857] [INFO ] [MAIN ] AM: Full history saved. [2025-10-07T17:12:06.674193] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AM took 38.3s. Estimated remaining: 4h 48m 27s. Rate: 7.9 symbols/min [2025-10-07T17:12:06.849016] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:12:06.899471] [DEBUG] [LOCAL ] AME: Loaded 48595 existing records from primary storage. [2025-10-07T17:12:06.899834] [INFO ] [MAIN ] AME: Loaded 48595 existing records. [2025-10-07T17:12:07.055683] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-07T17:12:07.089069] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:12:07.089506] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-07T17:12:07.089572] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-07T17:12:07.090047] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-07T17:12:07.090106] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-07T17:12:07.448983] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:12:07.732776] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-07T17:12:07.847614] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-07T17:12:08.276520] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T17:12:08.570928] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T17:12:08.647684] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-07T17:12:09.447688] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-07T17:12:09.822037] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-07T17:12:09.906713] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T17:12:10.247694] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-07T17:12:10.923439] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T17:12:11.047612] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-07T17:12:11.847682] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-07T17:12:11.943971] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T17:12:12.647633] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-07T17:12:12.783018] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T17:12:13.447678] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-07T17:12:14.247629] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-07T17:12:14.281374] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-07T17:12:14.350701] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T17:12:15.042573] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T17:12:15.051702] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-07T17:12:15.613306] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T17:12:15.847699] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-07T17:12:16.647722] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-07T17:12:16.887076] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T17:12:17.447684] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-07T17:12:18.247737] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-07T17:12:18.366205] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T17:12:18.453686] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-07T17:12:19.047684] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-07T17:12:19.112293] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T17:12:19.847682] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-07T17:12:20.270728] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-07T17:12:20.647678] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-07T17:12:21.422625] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T17:12:21.447609] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-07T17:12:21.533341] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-07T17:12:22.098078] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T17:12:22.247701] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-07T17:12:22.963143] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T17:12:23.047686] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-07T17:12:23.847692] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-07T17:12:24.210149] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-07T17:12:24.647671] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-07T17:12:24.939520] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T17:12:25.247822] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T17:12:25.447696] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-07T17:12:26.247743] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-07T17:12:26.796519] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-07T17:12:26.835123] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T17:12:27.047686] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-07T17:12:27.837317] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T17:12:27.847676] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-07T17:12:28.647626] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-07T17:12:28.958898] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T17:12:29.447702] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-07T17:12:30.015275] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T17:12:30.247693] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-07T17:12:30.512186] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-07T17:12:31.047706] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-07T17:12:31.121449] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T17:12:31.847624] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-07T17:12:32.319207] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-07T17:12:32.647727] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-07T17:12:33.388586] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-07T17:12:33.447635] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-07T17:12:33.488496] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T17:12:33.797282] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T17:12:34.247736] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-07T17:12:35.047709] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-07T17:12:35.822237] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-07T17:12:35.825752] [INFO ] [REMOTE ] AMC: Full fetch complete (77924 records). [2025-10-07T17:12:35.825899] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-07T17:12:35.856247] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-07T17:12:35.956530] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T17:12:36.040814] [INFO ] [REMOTE ] AMCR: Full fetch complete (77679 records). [2025-10-07T17:12:36.099880] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-07T17:12:36.383451] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-07T17:12:36.388909] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-07T17:12:36.395769] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-07T17:12:36.425460] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-07T17:12:36.526384] [DEBUG] [LOCAL ] AMC: Trimmed 77924 records to 53761 (keeping 200 days of data) [2025-10-07T17:12:36.758908] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-07T17:12:36.760323] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-07T17:12:36.762161] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-07T17:12:36.762866] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-07T17:12:36.775417] [DEBUG] [LOCAL ] AMCR: Trimmed 77679 records to 53669 (keeping 200 days of data) [2025-10-07T17:12:37.029214] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T17:12:37.051891] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-07T17:12:37.147540] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T17:12:37.154803] [INFO ] [REMOTE ] AMBP: Full fetch complete (65574 records). [2025-10-07T17:12:37.155209] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-07T17:12:37.268927] [DEBUG] [LOCAL ] AMC: Primary data saved (53761 records). [2025-10-07T17:12:37.280009] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-07T17:12:37.283103] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMC took 37.2s. Estimated remaining: 4h 57m 24s. Rate: 7.6 symbols/min [2025-10-07T17:12:37.770482] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:12:37.913155] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-07T17:12:37.917697] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-07T17:12:37.922393] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-07T17:12:37.931801] [DEBUG] [LOCAL ] AMG: Loaded 20292 existing records from primary storage. [2025-10-07T17:12:37.930951] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-07T17:12:37.933301] [INFO ] [MAIN ] AMG: Loaded 20292 existing records. [2025-10-07T17:12:38.090026] [DEBUG] [LOCAL ] AMBP: Trimmed 65574 records to 44811 (keeping 200 days of data) [2025-10-07T17:12:38.420220] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:12:38.425430] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-07T17:12:38.425609] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-07T17:12:38.426192] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-07T17:12:38.428280] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-07T17:12:38.544579] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-07T17:12:38.556116] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-07T17:12:38.571911] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMCR took 33.7s. Estimated remaining: 4h 54m 43s. Rate: 7.7 symbols/min [2025-10-07T17:12:39.170895] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T17:12:39.192583] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:12:39.250565] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-07T17:12:39.344473] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:12:39.346467] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-07T17:12:39.400194] [DEBUG] [LOCAL ] AMBP: Primary data saved (44811 records). [2025-10-07T17:12:39.400337] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-07T17:12:39.400427] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMBP took 44.8s. Estimated remaining: 4h 51m 54s. Rate: 7.8 symbols/min [2025-10-07T17:12:39.527180] [DEBUG] [LOCAL ] AMH: Loaded 51739 existing records from primary storage. [2025-10-07T17:12:39.542854] [INFO ] [MAIN ] AMH: Loaded 51739 existing records. [2025-10-07T17:12:39.698153] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:12:39.784615] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:12:39.784907] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-07T17:12:39.784963] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-07T17:12:39.785373] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-07T17:12:39.785432] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-07T17:12:40.065741] [DEBUG] [LOCAL ] AMN: Loaded 41794 existing records from primary storage. [2025-10-07T17:12:40.088134] [INFO ] [MAIN ] AMN: Loaded 41794 existing records. [2025-10-07T17:12:40.281469] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:12:40.285591] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-07T17:12:40.369380] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:12:40.369683] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-07T17:12:40.369824] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-07T17:12:40.370242] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-07T17:12:40.381190] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-07T17:12:40.405083] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T17:12:40.449718] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-07T17:12:40.743991] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:12:40.744319] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-07T17:12:40.779569] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T17:12:40.782898] [INFO ] [REMOTE ] AME: Full fetch complete (69911 records). [2025-10-07T17:12:40.782994] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-07T17:12:41.189061] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-07T17:12:41.189165] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-07T17:12:41.189887] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-07T17:12:41.189954] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-07T17:12:41.191498] [DEBUG] [LOCAL ] AME: Trimmed 69911 records to 48666 (keeping 200 days of data) [2025-10-07T17:12:41.450477] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T17:12:41.458592] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-07T17:12:41.534173] [DEBUG] [LOCAL ] AME: Primary data saved (48666 records). [2025-10-07T17:12:41.534333] [INFO ] [MAIN ] AME: Full history saved. [2025-10-07T17:12:41.535478] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 34.9s. Estimated remaining: 4h 49m 39s. Rate: 7.8 symbols/min [2025-10-07T17:12:41.704361] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:12:41.736291] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T17:12:41.776144] [DEBUG] [LOCAL ] AMP: Loaded 32047 existing records from primary storage. [2025-10-07T17:12:41.776450] [INFO ] [MAIN ] AMP: Loaded 32047 existing records. [2025-10-07T17:12:41.955099] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:12:41.955544] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-07T17:12:41.955678] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-07T17:12:41.956194] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-07T17:12:41.956274] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-07T17:12:42.167009] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T17:12:42.252762] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-07T17:12:42.372252] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:12:42.499925] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T17:12:43.047684] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-07T17:12:43.787815] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T17:12:43.847726] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-07T17:12:43.986020] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T17:12:44.647707] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-07T17:12:45.447623] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-07T17:12:45.480407] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T17:12:45.953168] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T17:12:46.247699] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-07T17:12:46.918738] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T17:12:47.047623] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-07T17:12:47.413952] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T17:12:47.847685] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-07T17:12:48.605406] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T17:12:48.647633] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-07T17:12:49.303634] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T17:12:49.447691] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-07T17:12:50.252764] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-07T17:12:50.272770] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T17:12:50.410393] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T17:12:51.047639] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-07T17:12:51.740576] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T17:12:51.847665] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-07T17:12:52.647621] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-07T17:12:52.767964] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T17:12:53.383801] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T17:12:53.426813] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T17:12:53.447601] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-07T17:12:54.247736] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-07T17:12:54.963822] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T17:12:55.047738] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-07T17:12:55.847675] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-07T17:12:56.104175] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T17:12:56.180809] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T17:12:56.532345] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-07T17:12:56.647670] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-07T17:12:57.447681] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-07T17:12:58.247628] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-07T17:12:58.281017] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T17:12:59.047623] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-07T17:12:59.136523] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T17:12:59.702907] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T17:12:59.847624] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-07T17:13:00.070292] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T17:13:00.647752] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-07T17:13:01.333667] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T17:13:01.447704] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-07T17:13:02.248268] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-07T17:13:02.248059] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T17:13:02.359566] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T17:13:03.047701] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-07T17:13:03.855266] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-07T17:13:03.873071] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T17:13:04.647630] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-07T17:13:04.987075] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T17:13:05.305955] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T17:13:05.447716] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-07T17:13:05.729893] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T17:13:05.731524] [INFO ] [REMOTE ] AMG: Full fetch complete (29869 records). [2025-10-07T17:13:05.731596] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-07T17:13:06.105729] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-07T17:13:06.105836] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-07T17:13:06.106223] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-07T17:13:06.106266] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-07T17:13:06.107044] [DEBUG] [LOCAL ] AMG: Trimmed 29869 records to 20226 (keeping 200 days of data) [2025-10-07T17:13:06.236621] [DEBUG] [LOCAL ] AMG: Primary data saved (20226 records). [2025-10-07T17:13:06.236808] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-07T17:13:06.236967] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 28.9s. Estimated remaining: 4h 55m 58s. Rate: 7.7 symbols/min [2025-10-07T17:13:06.257425] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-07T17:13:06.419461] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:06.484908] [DEBUG] [LOCAL ] AMPX: Loaded 52317 existing records from primary storage. [2025-10-07T17:13:06.485407] [INFO ] [MAIN ] AMPX: Loaded 52317 existing records. [2025-10-07T17:13:06.679841] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:13:06.680064] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-07T17:13:06.680111] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-07T17:13:06.680437] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-07T17:13:06.680498] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-07T17:13:07.061231] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-07T17:13:07.061158] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T17:13:07.065814] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:07.760455] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T17:13:07.847692] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-07T17:13:08.496431] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T17:13:08.647698] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-07T17:13:09.185455] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T17:13:09.447673] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-07T17:13:10.135199] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T17:13:10.138692] [INFO ] [REMOTE ] AMH: Full fetch complete (74826 records). [2025-10-07T17:13:10.138811] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-07T17:13:10.252721] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-07T17:13:10.526332] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-07T17:13:10.526677] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-07T17:13:10.527494] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-07T17:13:10.527541] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-07T17:13:10.529059] [DEBUG] [LOCAL ] AMH: Trimmed 74826 records to 51759 (keeping 200 days of data) [2025-10-07T17:13:10.772816] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T17:13:10.777872] [INFO ] [REMOTE ] AMN: Full fetch complete (60145 records). [2025-10-07T17:13:10.784368] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-07T17:13:10.786038] [FATAL] [VALIDATOR ] AMN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:13:10.789016] [FATAL] [MAIN ] AMN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:13:10.792504] [WARN ] [MAIN ] AMN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:13:10.793515] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-07T17:13:10.794142] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-07T17:13:10.794793] [INFO ] [LOCAL ] AMN: Starting deletion of derivative data. [2025-10-07T17:13:10.798924] [DEBUG] [LOCAL ] AMN: Deleted derivative data file. [2025-10-07T17:13:10.799287] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMN took 31.4s. Estimated remaining: 4h 54m 37s. Rate: 7.7 symbols/min [2025-10-07T17:13:11.034093] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:11.049383] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-07T17:13:11.051096] [DEBUG] [LOCAL ] AMH: Primary data saved (51759 records). [2025-10-07T17:13:11.051468] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-07T17:13:11.051708] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 32.5s. Estimated remaining: 4h 51m 42s. Rate: 7.8 symbols/min [2025-10-07T17:13:11.247868] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:11.260039] [DEBUG] [LOCAL ] AMPY: Loaded 38281 existing records from primary storage. [2025-10-07T17:13:11.260386] [INFO ] [MAIN ] AMPY: Loaded 38281 existing records. [2025-10-07T17:13:11.476255] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:13:11.477452] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-07T17:13:11.488114] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-07T17:13:11.488874] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-07T17:13:11.488807] [DEBUG] [LOCAL ] AMR: Loaded 29056 existing records from primary storage. [2025-10-07T17:13:11.488978] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-07T17:13:11.509880] [INFO ] [MAIN ] AMR: Loaded 29056 existing records. [2025-10-07T17:13:11.991992] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T17:13:12.030388] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:13:12.102809] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-07T17:13:12.108580] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-07T17:13:12.108191] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:12.108785] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-07T17:13:12.110310] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-07T17:13:12.110377] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-07T17:13:12.478458] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:12.647613] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-07T17:13:13.024316] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T17:13:13.116773] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T17:13:13.447678] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-07T17:13:13.897563] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T17:13:14.247691] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-07T17:13:15.047631] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-07T17:13:15.379031] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T17:13:15.409252] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T17:13:15.766801] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T17:13:15.847627] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-07T17:13:16.647736] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-07T17:13:16.798469] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T17:13:17.447707] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-07T17:13:18.247633] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-07T17:13:18.386007] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T17:13:18.505509] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T17:13:19.047614] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-07T17:13:19.414851] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T17:13:19.847691] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-07T17:13:20.557990] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T17:13:20.647606] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-07T17:13:21.262286] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T17:13:21.447685] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-07T17:13:22.247687] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-07T17:13:22.426990] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T17:13:22.714682] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T17:13:22.718300] [INFO ] [REMOTE ] AMP: Full fetch complete (47547 records). [2025-10-07T17:13:22.718470] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-07T17:13:23.052753] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-07T17:13:23.102243] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-07T17:13:23.102323] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-07T17:13:23.102856] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-07T17:13:23.102922] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-07T17:13:23.104027] [DEBUG] [LOCAL ] AMP: Trimmed 47547 records to 32027 (keeping 200 days of data) [2025-10-07T17:13:23.316094] [DEBUG] [LOCAL ] AMP: Primary data saved (32027 records). [2025-10-07T17:13:23.316226] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-07T17:13:23.316308] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 41.8s. Estimated remaining: 4h 53m 14s. Rate: 7.7 symbols/min [2025-10-07T17:13:23.498251] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:23.521192] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T17:13:23.562378] [DEBUG] [LOCAL ] AMRC: Loaded 38127 existing records from primary storage. [2025-10-07T17:13:23.562716] [INFO ] [MAIN ] AMRC: Loaded 38127 existing records. [2025-10-07T17:13:23.748861] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:13:23.749108] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-07T17:13:23.749156] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-07T17:13:23.749383] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-07T17:13:23.749446] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-07T17:13:23.851271] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-07T17:13:24.169713] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:24.190460] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T17:13:24.647680] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-07T17:13:24.971865] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T17:13:25.447639] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-07T17:13:26.247745] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-07T17:13:26.462611] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T17:13:26.599730] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T17:13:27.047687] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-07T17:13:27.237165] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T17:13:27.847602] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-07T17:13:28.312493] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T17:13:28.647688] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-07T17:13:29.371275] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T17:13:29.447707] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-07T17:13:29.615755] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T17:13:30.247722] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-07T17:13:30.432455] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T17:13:31.047755] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-07T17:13:31.617667] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T17:13:31.847813] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-07T17:13:32.146807] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T17:13:32.647694] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-07T17:13:33.427916] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T17:13:33.447597] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-07T17:13:33.980894] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T17:13:34.247683] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-07T17:13:34.536627] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T17:13:35.047711] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-07T17:13:35.847629] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-07T17:13:35.932767] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T17:13:36.005911] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T17:13:36.647703] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-07T17:13:37.447635] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-07T17:13:37.556188] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T17:13:37.558715] [INFO ] [REMOTE ] AMR: Full fetch complete (40408 records). [2025-10-07T17:13:37.558800] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-07T17:13:37.749827] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T17:13:37.966865] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-07T17:13:37.966942] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-07T17:13:37.967389] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-07T17:13:37.967428] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-07T17:13:37.968410] [DEBUG] [LOCAL ] AMR: Trimmed 40408 records to 29108 (keeping 200 days of data) [2025-10-07T17:13:38.139056] [DEBUG] [LOCAL ] AMR: Primary data saved (29108 records). [2025-10-07T17:13:38.139194] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-07T17:13:38.139294] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMR took 27.1s. Estimated remaining: 4h 55m 40s. Rate: 7.7 symbols/min [2025-10-07T17:13:38.252866] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-07T17:13:38.307022] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:38.307254] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-07T17:13:38.307298] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-07T17:13:38.307405] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-07T17:13:38.307446] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-07T17:13:38.307491] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-07T17:13:38.307522] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-07T17:13:38.691301] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T17:13:38.697580] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:39.047669] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-07T17:13:39.785153] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T17:13:39.847605] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-07T17:13:40.647734] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-07T17:13:40.856939] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:13:40.857253] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-07T17:13:40.857349] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:13:40.857396] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-07T17:13:40.857466] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:13:40.857573] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-07T17:13:40.857705] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-07T17:13:40.857762] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-07T17:13:40.857804] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-07T17:13:40.857852] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMRZ took 2.7s. Estimated remaining: 4h 53m 42s. Rate: 7.7 symbols/min [2025-10-07T17:13:41.032316] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:41.084828] [DEBUG] [LOCAL ] AMT: Loaded 52434 existing records from primary storage. [2025-10-07T17:13:41.085211] [INFO ] [MAIN ] AMT: Loaded 52434 existing records. [2025-10-07T17:13:41.270944] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:13:41.271491] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-07T17:13:41.271875] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-07T17:13:41.272473] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-07T17:13:41.272534] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-07T17:13:41.454440] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-07T17:13:41.486928] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T17:13:41.673354] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:41.704588] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-07T17:13:42.247729] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-07T17:13:42.755768] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-07T17:13:43.047746] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-07T17:13:43.847705] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-07T17:13:44.092673] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T17:13:44.512123] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T17:13:44.515405] [INFO ] [REMOTE ] AMPY: Full fetch complete (51972 records). [2025-10-07T17:13:44.515491] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-07T17:13:44.656529] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-07T17:13:44.899344] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-07T17:13:44.899425] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-07T17:13:44.899991] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-07T17:13:44.900056] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-07T17:13:44.901283] [DEBUG] [LOCAL ] AMPY: Trimmed 51972 records to 38451 (keeping 200 days of data) [2025-10-07T17:13:45.118632] [DEBUG] [LOCAL ] AMPY: Primary data saved (38451 records). [2025-10-07T17:13:45.118798] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-07T17:13:45.119552] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMPY took 34.3s. Estimated remaining: 4h 52m 20s. Rate: 7.7 symbols/min [2025-10-07T17:13:45.292018] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:45.312570] [DEBUG] [LOCAL ] AMTB: Loaded 20474 existing records from primary storage. [2025-10-07T17:13:45.312904] [INFO ] [MAIN ] AMTB: Loaded 20474 existing records. [2025-10-07T17:13:45.450003] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-07T17:13:45.490777] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:13:45.491944] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-07T17:13:45.492071] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-07T17:13:45.492291] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-07T17:13:45.492347] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-07T17:13:45.862563] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:45.898361] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T17:13:45.918313] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-07T17:13:46.247673] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-07T17:13:47.044673] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T17:13:47.054682] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-07T17:13:47.443222] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T17:13:47.847703] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-07T17:13:48.619543] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T17:13:48.647600] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-07T17:13:49.447755] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-07T17:13:50.072924] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-07T17:13:50.106950] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T17:13:50.247610] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-07T17:13:50.339802] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T17:13:51.047718] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-07T17:13:51.762319] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T17:13:51.847691] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-07T17:13:52.647723] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-07T17:13:53.012675] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-07T17:13:53.016257] [INFO ] [REMOTE ] AMPX: Full fetch complete (74911 records). [2025-10-07T17:13:53.016393] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-07T17:13:53.406697] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-07T17:13:53.406800] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-07T17:13:53.407580] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-07T17:13:53.407631] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-07T17:13:53.409234] [DEBUG] [LOCAL ] AMPX: Trimmed 74911 records to 52317 (keeping 200 days of data) [2025-10-07T17:13:53.457577] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-07T17:13:53.649027] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T17:13:53.685176] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T17:13:53.795022] [DEBUG] [LOCAL ] AMPX: Primary data saved (52317 records). [2025-10-07T17:13:53.795213] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-07T17:13:53.796270] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMPX took 47.6s. Estimated remaining: 4h 52m 32s. Rate: 7.7 symbols/min [2025-10-07T17:13:53.969421] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:53.976669] [DEBUG] [LOCAL ] AMTD: Loaded 3680 existing records from primary storage. [2025-10-07T17:13:53.976903] [INFO ] [MAIN ] AMTD: Loaded 3680 existing records. [2025-10-07T17:13:54.152840] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:13:54.153087] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-07T17:13:54.153157] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-07T17:13:54.153402] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-07T17:13:54.153476] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-07T17:13:54.253213] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-07T17:13:54.506317] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:54.845083] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T17:13:54.848095] [INFO ] [REMOTE ] AMRC: Full fetch complete (53427 records). [2025-10-07T17:13:54.848190] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-07T17:13:55.049440] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-07T17:13:55.161215] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T17:13:55.254907] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-07T17:13:55.254995] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-07T17:13:55.255558] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-07T17:13:55.255598] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-07T17:13:55.256722] [DEBUG] [LOCAL ] AMRC: Trimmed 53427 records to 38121 (keeping 200 days of data) [2025-10-07T17:13:55.485188] [DEBUG] [LOCAL ] AMRC: Primary data saved (38121 records). [2025-10-07T17:13:55.485334] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-07T17:13:55.485417] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRC took 32.2s. Estimated remaining: 4h 50m 17s. Rate: 7.8 symbols/min [2025-10-07T17:13:55.664513] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:13:55.714603] [DEBUG] [LOCAL ] AMTM: Loaded 50676 existing records from primary storage. [2025-10-07T17:13:55.715036] [INFO ] [MAIN ] AMTM: Loaded 50676 existing records. [2025-10-07T17:13:55.859080] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-07T17:13:55.902314] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:13:55.908532] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T17:13:55.908607] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-07T17:13:55.908830] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-07T17:13:55.911799] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-07T17:13:55.911865] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-07T17:13:56.263591] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:13:56.647750] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-07T17:13:56.984409] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T17:13:57.447728] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-07T17:13:58.247723] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-07T17:13:58.488048] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T17:13:58.569087] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T17:13:58.845952] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-07T17:13:59.047689] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-07T17:13:59.687967] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T17:13:59.847702] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-07T17:14:00.654139] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T17:14:00.653122] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-07T17:14:01.128864] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T17:14:01.447761] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-07T17:14:02.247722] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-07T17:14:02.772220] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-07T17:14:02.923299] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T17:14:03.047735] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-07T17:14:03.847753] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-07T17:14:04.647628] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-07T17:14:04.675685] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T17:14:05.447632] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-07T17:14:05.846181] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-07T17:14:05.929204] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T17:14:06.247737] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-07T17:14:07.047717] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-07T17:14:07.156810] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T17:14:07.406971] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T17:14:07.847688] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-07T17:14:08.647631] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-07T17:14:08.978349] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T17:14:09.447721] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-07T17:14:09.586184] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T17:14:09.673105] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T17:14:09.996592] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-07T17:14:10.247685] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-07T17:14:11.047672] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-07T17:14:11.847724] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-07T17:14:12.033894] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T17:14:12.132324] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T17:14:12.135851] [INFO ] [REMOTE ] AMTB: Full fetch complete (29868 records). [2025-10-07T17:14:12.136069] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-07T17:14:12.514485] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-07T17:14:12.514566] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-07T17:14:12.514949] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-07T17:14:12.515011] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-07T17:14:12.515799] [DEBUG] [LOCAL ] AMTB: Trimmed 29868 records to 20513 (keeping 200 days of data) [2025-10-07T17:14:12.637202] [DEBUG] [LOCAL ] AMTB: Primary data saved (20513 records). [2025-10-07T17:14:12.637361] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-07T17:14:12.637456] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 27.5s. Estimated remaining: 4h 53m 25s. Rate: 7.7 symbols/min [2025-10-07T17:14:12.658025] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-07T17:14:12.808188] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:14:12.818109] [DEBUG] [LOCAL ] AMWL: Loaded 9077 existing records from primary storage. [2025-10-07T17:14:12.818320] [INFO ] [MAIN ] AMWL: Loaded 9077 existing records. [2025-10-07T17:14:13.005448] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:14:13.005786] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-07T17:14:13.005869] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-07T17:14:13.006107] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-07T17:14:13.006184] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-07T17:14:13.391816] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:14:13.397831] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T17:14:13.447595] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-07T17:14:13.587416] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T17:14:14.247622] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-07T17:14:14.311810] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T17:14:15.047676] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-07T17:14:15.634465] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T17:14:15.847706] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-07T17:14:16.078019] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T17:14:16.575910] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T17:14:16.647704] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-07T17:14:17.447687] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-07T17:14:18.071554] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T17:14:18.247632] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-07T17:14:18.468951] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T17:14:18.838452] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-07T17:14:19.047684] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-07T17:14:19.448407] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-07T17:14:19.847689] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-07T17:14:20.647682] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-07T17:14:21.447637] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-07T17:14:21.722357] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T17:14:22.142720] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T17:14:22.143627] [INFO ] [REMOTE ] AMTD: Full fetch complete (5581 records). [2025-10-07T17:14:22.143733] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-07T17:14:22.253000] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-07T17:14:22.522496] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-07T17:14:22.522599] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-07T17:14:22.522886] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-07T17:14:22.522946] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-07T17:14:22.523357] [DEBUG] [LOCAL ] AMTD: Trimmed 5581 records to 3692 (keeping 200 days of data) [2025-10-07T17:14:22.545237] [DEBUG] [LOCAL ] AMTD: Primary data saved (3692 records). [2025-10-07T17:14:22.545438] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-07T17:14:22.545598] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 28.7s. Estimated remaining: 4h 54m 1s. Rate: 7.7 symbols/min [2025-10-07T17:14:22.762558] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:14:22.765994] [DEBUG] [LOCAL ] AMX: No existing data file found in primary storage. [2025-10-07T17:14:22.768520] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-07T17:14:22.766791] [WARN ] [MAIN ] AMX: No existing data found, performing full refresh instead. [2025-10-07T17:14:22.780398] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-07T17:14:22.780711] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-07T17:14:22.780803] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-07T17:14:22.781300] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-07T17:14:23.052923] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-07T17:14:23.086608] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T17:14:23.342686] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:14:23.847681] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-07T17:14:24.647697] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-07T17:14:24.934547] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T17:14:25.245633] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T17:14:25.402992] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T17:14:25.447681] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-07T17:14:26.247719] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-07T17:14:26.288256] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T17:14:27.047733] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-07T17:14:27.539408] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T17:14:27.763721] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T17:14:27.847620] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-07T17:14:28.647760] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-07T17:14:29.447748] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-07T17:14:29.532995] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T17:14:30.247710] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-07T17:14:30.864616] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-07T17:14:30.954094] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:14:31.047634] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-07T17:14:31.716810] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T17:14:31.721282] [INFO ] [REMOTE ] AMTM: Full fetch complete (73573 records). [2025-10-07T17:14:31.721475] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-07T17:14:31.722771] [FATAL] [VALIDATOR ] AMTM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:14:31.722918] [FATAL] [MAIN ] AMTM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:14:31.722985] [WARN ] [MAIN ] AMTM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:14:31.723043] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-07T17:14:31.723143] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-10-07T17:14:31.723210] [INFO ] [LOCAL ] AMTM: Starting deletion of derivative data. [2025-10-07T17:14:31.723542] [DEBUG] [LOCAL ] AMTM: Deleted derivative data file. [2025-10-07T17:14:31.724833] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTM took 36.2s. Estimated remaining: 4h 54m 21s. Rate: 7.7 symbols/min [2025-10-07T17:14:31.857518] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-07T17:14:31.934958] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:14:31.972386] [DEBUG] [LOCAL ] AN: Loaded 31749 existing records from primary storage. [2025-10-07T17:14:31.972698] [INFO ] [MAIN ] AN: Loaded 31749 existing records. [2025-10-07T17:14:32.149990] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:14:32.150209] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-07T17:14:32.150258] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-07T17:14:32.150872] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-07T17:14:32.150931] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-07T17:14:32.512527] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:14:32.647697] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-07T17:14:32.673387] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T17:14:32.677057] [INFO ] [REMOTE ] AMT: Full fetch complete (76021 records). [2025-10-07T17:14:32.677183] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-07T17:14:33.087429] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-07T17:14:33.087525] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-07T17:14:33.088280] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-07T17:14:33.088345] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-07T17:14:33.089904] [DEBUG] [LOCAL ] AMT: Trimmed 76021 records to 52437 (keeping 200 days of data) [2025-10-07T17:14:33.427147] [DEBUG] [LOCAL ] AMT: Primary data saved (52437 records). [2025-10-07T17:14:33.427315] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-07T17:14:33.428266] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMT took 52.6s. Estimated remaining: 4h 52m 10s. Rate: 7.7 symbols/min [2025-10-07T17:14:33.459545] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-07T17:14:33.631113] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T17:14:33.632900] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:14:33.700736] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-07T17:14:33.701136] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-07T17:14:33.878765] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:14:33.879048] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-07T17:14:33.879109] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-07T17:14:33.879409] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-07T17:14:33.879467] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-07T17:14:34.248221] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:14:34.248384] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-07T17:14:34.370316] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T17:14:34.500831] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T17:14:35.047741] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-07T17:14:35.847685] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-07T17:14:35.926302] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T17:14:36.496085] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T17:14:36.647707] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-07T17:14:36.752213] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T17:14:37.447691] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-07T17:14:38.247703] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-07T17:14:38.266578] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T17:14:39.020573] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-07T17:14:39.047607] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-07T17:14:39.673234] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T17:14:39.847709] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-07T17:14:40.647700] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-07T17:14:40.738361] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T17:14:40.740253] [INFO ] [REMOTE ] AMWL: Full fetch complete (14270 records). [2025-10-07T17:14:40.740338] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-07T17:14:41.125360] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-07T17:14:41.125497] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-07T17:14:41.125820] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-07T17:14:41.125902] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-07T17:14:41.126517] [DEBUG] [LOCAL ] AMWL: Trimmed 14270 records to 9133 (keeping 200 days of data) [2025-10-07T17:14:41.178918] [DEBUG] [LOCAL ] AMWL: Primary data saved (9133 records). [2025-10-07T17:14:41.179128] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-07T17:14:41.179269] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMWL took 28.5s. Estimated remaining: 4h 52m 2s. Rate: 7.7 symbols/min [2025-10-07T17:14:41.353154] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:14:41.385804] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-07T17:14:41.443164] [DEBUG] [LOCAL ] ANF: Loaded 52099 existing records from primary storage. [2025-10-07T17:14:41.443489] [INFO ] [MAIN ] ANF: Loaded 52099 existing records. [2025-10-07T17:14:41.454468] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-07T17:14:41.623020] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:14:41.623231] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-07T17:14:41.623277] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-07T17:14:41.623576] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-07T17:14:41.623675] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-07T17:14:41.985950] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:14:42.077452] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T17:14:42.247709] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-07T17:14:43.047758] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-07T17:14:43.860144] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-07T17:14:43.862502] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-07T17:14:44.164523] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T17:14:44.486949] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T17:14:44.647745] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-07T17:14:45.447626] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-07T17:14:45.541260] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T17:14:46.247722] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-07T17:14:46.528353] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T17:14:47.047748] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-07T17:14:47.557359] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T17:14:47.781485] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-07T17:14:47.847608] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-07T17:14:48.521286] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T17:14:48.647620] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-07T17:14:49.447772] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-07T17:14:49.971809] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-07T17:14:50.055597] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T17:14:50.247698] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-07T17:14:50.875048] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T17:14:51.047617] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-07T17:14:51.091824] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-07T17:14:51.847753] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-07T17:14:52.647747] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-07T17:14:52.889172] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T17:14:53.447889] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-07T17:14:53.447812] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T17:14:53.935372] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T17:14:54.247764] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-07T17:14:55.047718] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-07T17:14:55.404302] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T17:14:55.559722] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-07T17:14:55.847701] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-07T17:14:56.647627] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-07T17:14:56.763274] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T17:14:56.846522] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T17:14:57.447742] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-07T17:14:58.247637] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-07T17:14:58.446485] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T17:14:59.047686] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-07T17:14:59.086418] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T17:14:59.106599] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T17:14:59.109075] [INFO ] [REMOTE ] AN: Full fetch complete (47421 records). [2025-10-07T17:14:59.109160] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-07T17:14:59.477811] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-07T17:14:59.477904] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-07T17:14:59.478460] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-07T17:14:59.478523] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-07T17:14:59.479598] [DEBUG] [LOCAL ] AN: Trimmed 47421 records to 31743 (keeping 200 days of data) [2025-10-07T17:14:59.677091] [DEBUG] [LOCAL ] AN: Primary data saved (31743 records). [2025-10-07T17:14:59.677247] [INFO ] [MAIN ] AN: Full history saved. [2025-10-07T17:14:59.677336] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AN took 28.0s. Estimated remaining: 4h 55m 27s. Rate: 7.6 symbols/min [2025-10-07T17:14:59.842206] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:14:59.842442] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-07T17:14:59.842498] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-07T17:14:59.842611] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-07T17:14:59.842682] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-07T17:14:59.842745] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-07T17:14:59.842780] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-07T17:14:59.855189] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-07T17:15:00.193450] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:00.656570] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-07T17:15:00.676906] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T17:15:01.447764] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-07T17:15:01.691612] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:15:01.692343] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-07T17:15:01.693011] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:15:01.694443] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T17:15:01.694722] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-07T17:15:01.704899] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:15:01.705279] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-07T17:15:01.705535] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-07T17:15:01.705595] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-07T17:15:01.705685] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-07T17:15:01.705764] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. ANGX took 2.0s. Estimated remaining: 4h 53m 25s. Rate: 7.7 symbols/min [2025-10-07T17:15:01.902716] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:15:01.922685] [DEBUG] [LOCAL ] ANRO: Loaded 19075 existing records from primary storage. [2025-10-07T17:15:01.922953] [INFO ] [MAIN ] ANRO: Loaded 19075 existing records. [2025-10-07T17:15:02.137550] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:15:02.137888] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-07T17:15:02.137944] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-07T17:15:02.138147] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-07T17:15:02.138186] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-07T17:15:02.248282] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-07T17:15:02.524872] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:03.047621] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-07T17:15:03.183807] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-07T17:15:03.856038] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-07T17:15:03.877158] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T17:15:04.522816] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T17:15:04.525865] [INFO ] [REMOTE ] AMX: Full fetch complete (70378 records). [2025-10-07T17:15:04.525993] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-07T17:15:04.526960] [FATAL] [VALIDATOR ] AMX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:15:04.527051] [FATAL] [MAIN ] AMX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:15:04.527094] [WARN ] [MAIN ] AMX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:15:04.527133] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-07T17:15:04.527190] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-07T17:15:04.527227] [INFO ] [LOCAL ] AMX: Starting deletion of derivative data. [2025-10-07T17:15:04.527267] [DEBUG] [LOCAL ] AMX: No derivative data file found to delete. [2025-10-07T17:15:04.527324] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. AMX took 42.0s. Estimated remaining: 4h 51m 40s. Rate: 7.7 symbols/min [2025-10-07T17:15:04.652717] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-07T17:15:04.703051] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:15:04.730034] [DEBUG] [LOCAL ] ANVS: Loaded 23133 existing records from primary storage. [2025-10-07T17:15:04.730318] [INFO ] [MAIN ] ANVS: Loaded 23133 existing records. [2025-10-07T17:15:04.917237] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:15:04.917668] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-07T17:15:04.917799] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-07T17:15:04.918129] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-07T17:15:04.918283] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-07T17:15:05.040565] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T17:15:05.306583] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:05.447706] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-07T17:15:06.247739] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-07T17:15:06.462799] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T17:15:07.047622] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-07T17:15:07.127636] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-07T17:15:07.847611] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-07T17:15:08.106420] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T17:15:08.173896] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T17:15:08.647721] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-07T17:15:09.447689] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-07T17:15:10.062728] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T17:15:10.066215] [INFO ] [REMOTE ] ANF: Full fetch complete (75611 records). [2025-10-07T17:15:10.066335] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-07T17:15:10.250571] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-07T17:15:10.480923] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-07T17:15:10.481448] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-07T17:15:10.482275] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-07T17:15:10.488923] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-07T17:15:10.503323] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T17:15:10.542833] [DEBUG] [LOCAL ] ANF: Trimmed 75611 records to 52101 (keeping 200 days of data) [2025-10-07T17:15:10.545153] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-07T17:15:10.871393] [DEBUG] [LOCAL ] ANF: Primary data saved (52101 records). [2025-10-07T17:15:10.871549] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-07T17:15:10.872728] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANF took 29.7s. Estimated remaining: 4h 51m 5s. Rate: 7.7 symbols/min [2025-10-07T17:15:11.047675] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-07T17:15:11.781723] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T17:15:11.847698] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-07T17:15:12.647681] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-07T17:15:13.106899] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T17:15:13.447717] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-07T17:15:13.643006] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-07T17:15:13.927476] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T17:15:14.126715] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-07T17:15:14.247691] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-07T17:15:15.047703] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-07T17:15:15.635023] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T17:15:15.847693] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-07T17:15:16.317014] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T17:15:16.647638] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-07T17:15:16.943098] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T17:15:17.447775] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-07T17:15:17.555981] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T17:15:18.247683] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-07T17:15:18.293967] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T17:15:19.047616] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-07T17:15:19.444387] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T17:15:19.714528] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T17:15:19.847699] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-07T17:15:20.647630] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-07T17:15:20.681608] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T17:15:20.683556] [INFO ] [REMOTE ] ANRO: Full fetch complete (29318 records). [2025-10-07T17:15:20.683629] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-07T17:15:20.684176] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:15:20.684303] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:15:20.684384] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:15:20.684476] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-07T17:15:20.684555] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-07T17:15:20.684593] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-10-07T17:15:20.684880] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-10-07T17:15:20.684974] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 19.0s. Estimated remaining: 4h 51m 37s. Rate: 7.7 symbols/min [2025-10-07T17:15:21.447706] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-07T17:15:22.713055] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-07T17:15:22.719198] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-07T17:15:22.900462] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-07T17:15:23.047616] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-07T17:15:23.761391] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T17:15:23.847621] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-07T17:15:24.699730] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T17:15:24.705355] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-07T17:15:25.385977] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-07T17:15:25.389462] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-07T17:15:25.389574] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-07T17:15:25.791733] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-07T17:15:25.797042] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-07T17:15:25.804382] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-07T17:15:25.805029] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-07T17:15:25.805453] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T17:15:25.811122] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-07T17:15:25.812696] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 53766 (keeping 200 days of data) [2025-10-07T17:15:26.171501] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-07T17:15:26.171678] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-07T17:15:26.172294] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANET took 52.7s. Estimated remaining: 4h 50m 46s. Rate: 7.7 symbols/min [2025-10-07T17:15:26.864427] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T17:15:26.869066] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-07T17:15:27.835888] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T17:15:27.837786] [INFO ] [REMOTE ] ANVS: Full fetch complete (36037 records). [2025-10-07T17:15:27.837898] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-07T17:15:27.838564] [FATAL] [VALIDATOR ] ANVS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:15:27.838682] [FATAL] [MAIN ] ANVS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:15:27.838738] [WARN ] [MAIN ] ANVS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:15:27.838781] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-07T17:15:27.838840] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-07T17:15:27.838877] [INFO ] [LOCAL ] ANVS: Starting deletion of derivative data. [2025-10-07T17:15:27.839081] [DEBUG] [LOCAL ] ANVS: Deleted derivative data file. [2025-10-07T17:15:27.839176] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 23.3s. Estimated remaining: 4h 48m 44s. Rate: 7.8 symbols/min [2025-10-07T17:15:28.378276] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:15:28.507901] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:15:28.565772] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:15:28.564682] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-07T17:15:28.584172] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-07T17:15:28.584386] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-07T17:15:28.584626] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-07T17:15:28.585956] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:15:28.586031] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-07T17:15:28.586557] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-07T17:15:28.751222] [DEBUG] [LOCAL ] AOMR: Loaded 16487 existing records from primary storage. [2025-10-07T17:15:28.762754] [DEBUG] [LOCAL ] AOD: Loaded 30491 existing records from primary storage. [2025-10-07T17:15:28.763194] [INFO ] [MAIN ] AOMR: Loaded 16487 existing records. [2025-10-07T17:15:28.796413] [INFO ] [MAIN ] AOD: Loaded 30491 existing records. [2025-10-07T17:15:29.205515] [DEBUG] [LOCAL ] AON: Loaded 45253 existing records from primary storage. [2025-10-07T17:15:29.300177] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:15:29.354410] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-07T17:15:29.372109] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:29.363154] [INFO ] [MAIN ] AON: Loaded 45253 existing records. [2025-10-07T17:15:29.413747] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-07T17:15:29.377370] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-07T17:15:29.462051] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:15:29.468614] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-07T17:15:29.492903] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-07T17:15:29.492839] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-07T17:15:29.570925] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-07T17:15:29.652876] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-07T17:15:29.663575] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-07T17:15:29.761771] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:15:29.870443] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:15:29.886367] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-07T17:15:29.955883] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-07T17:15:29.952719] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:15:29.963448] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-07T17:15:29.996216] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-07T17:15:30.057836] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:15:30.070102] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-07T17:15:30.090980] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-07T17:15:30.097689] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-07T17:15:30.172604] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-07T17:15:30.280781] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-07T17:15:30.427080] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:30.438916] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-07T17:15:30.421571] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-07T17:15:30.439287] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.6s. Estimated remaining: 4h 47m 2s. Rate: 7.8 symbols/min [2025-10-07T17:15:30.674131] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:30.744267] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-07T17:15:30.982633] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:15:31.024751] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:31.025529] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-07T17:15:31.059196] [DEBUG] [LOCAL ] AORT: Loaded 29334 existing records from primary storage. [2025-10-07T17:15:31.059606] [INFO ] [MAIN ] AORT: Loaded 29334 existing records. [2025-10-07T17:15:31.311383] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:15:31.311689] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-07T17:15:31.311752] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-07T17:15:31.312032] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-07T17:15:31.312091] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-07T17:15:31.541094] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T17:15:31.546454] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-07T17:15:31.976769] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:31.977332] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-07T17:15:31.980937] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T17:15:31.991318] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-07T17:15:32.339598] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T17:15:32.647744] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-07T17:15:33.012807] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T17:15:33.143767] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T17:15:33.262939] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T17:15:33.325165] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-07T17:15:33.447746] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-07T17:15:34.247707] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-07T17:15:34.507442] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T17:15:35.047711] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-07T17:15:35.708980] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T17:15:35.847613] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-07T17:15:36.303416] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T17:15:36.647739] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-07T17:15:37.262038] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T17:15:37.447636] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-07T17:15:37.713232] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T17:15:38.247734] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-07T17:15:38.695750] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T17:15:39.047630] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-07T17:15:39.256164] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T17:15:39.847700] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-07T17:15:40.647739] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-07T17:15:40.681403] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T17:15:40.737925] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T17:15:41.447709] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-07T17:15:41.897009] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T17:15:42.247696] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-07T17:15:42.591509] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T17:15:43.047685] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-07T17:15:43.847673] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-07T17:15:43.989448] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T17:15:44.122358] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T17:15:44.647723] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-07T17:15:45.059875] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T17:15:45.138848] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-07T17:15:45.447701] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-07T17:15:46.247622] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-07T17:15:46.631629] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T17:15:47.047736] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-07T17:15:47.403541] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T17:15:47.847719] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-07T17:15:48.348511] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T17:15:48.647696] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-07T17:15:49.447638] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-07T17:15:49.603597] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T17:15:49.772431] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T17:15:50.247686] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-07T17:15:50.576975] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T17:15:51.047670] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-07T17:15:51.155733] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T17:15:51.847773] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-07T17:15:52.611509] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T17:15:52.647611] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-07T17:15:53.071335] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T17:15:53.447697] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-07T17:15:54.247669] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-07T17:15:54.418055] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T17:15:54.558149] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T17:15:55.047673] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-07T17:15:55.110230] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T17:15:55.847686] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-07T17:15:56.659050] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-07T17:15:56.666681] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T17:15:57.106187] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T17:15:57.447696] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-07T17:15:57.959820] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T17:15:58.175061] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T17:15:58.176387] [INFO ] [REMOTE ] AOMR: Full fetch complete (23187 records). [2025-10-07T17:15:58.176484] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-07T17:15:58.252745] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-07T17:15:58.552456] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-07T17:15:58.552536] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-07T17:15:58.552901] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-07T17:15:58.552966] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-07T17:15:58.553581] [DEBUG] [LOCAL ] AOMR: Trimmed 23187 records to 16462 (keeping 200 days of data) [2025-10-07T17:15:58.652408] [DEBUG] [LOCAL ] AOMR: Primary data saved (16462 records). [2025-10-07T17:15:58.652550] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-07T17:15:58.652679] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 30.8s. Estimated remaining: 4h 53m 13s. Rate: 7.7 symbols/min [2025-10-07T17:15:58.822540] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:15:58.822834] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-10-07T17:15:58.822888] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-10-07T17:15:58.823019] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-07T17:15:58.823061] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-07T17:15:58.823102] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-07T17:15:58.823135] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-07T17:15:59.055505] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-07T17:15:59.192887] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:15:59.858075] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-07T17:15:59.887605] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T17:16:00.285626] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T17:16:00.647759] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-07T17:16:01.447622] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-07T17:16:01.511811] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T17:16:01.667147] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T17:16:01.670140] [INFO ] [REMOTE ] AON: Full fetch complete (64715 records). [2025-10-07T17:16:01.670264] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-07T17:16:02.083114] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-07T17:16:02.083196] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-07T17:16:02.083865] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-07T17:16:02.083932] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-07T17:16:02.085301] [DEBUG] [LOCAL ] AON: Trimmed 64715 records to 45201 (keeping 200 days of data) [2025-10-07T17:16:02.286491] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-07T17:16:02.398792] [DEBUG] [LOCAL ] AON: Primary data saved (45201 records). [2025-10-07T17:16:02.398944] [INFO ] [MAIN ] AON: Full history saved. [2025-10-07T17:16:02.400263] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AON took 34.5s. Estimated remaining: 4h 51m 51s. Rate: 7.7 symbols/min [2025-10-07T17:16:02.587197] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:16:02.593791] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T17:16:02.597736] [INFO ] [REMOTE ] AOD: Full fetch complete (44294 records). [2025-10-07T17:16:02.597835] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-07T17:16:02.598597] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:16:02.598870] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:16:02.598945] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:16:02.598996] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-07T17:16:02.599058] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-07T17:16:02.599095] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-10-07T17:16:02.599320] [DEBUG] [LOCAL ] AOD: Deleted derivative data file. [2025-10-07T17:16:02.599471] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOD took 34.8s. Estimated remaining: 4h 49m 26s. Rate: 7.8 symbols/min [2025-10-07T17:16:02.710954] [DEBUG] [LOCAL ] AP: Loaded 7211 existing records from primary storage. [2025-10-07T17:16:02.711265] [INFO ] [MAIN ] AP: Loaded 7211 existing records. [2025-10-07T17:16:02.936893] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:16:02.976679] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:16:02.976971] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-07T17:16:02.977024] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-07T17:16:02.977239] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-07T17:16:02.977296] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-07T17:16:03.054161] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-07T17:16:03.316674] [DEBUG] [LOCAL ] APAM: Loaded 36068 existing records from primary storage. [2025-10-07T17:16:03.317243] [INFO ] [MAIN ] APAM: Loaded 36068 existing records. [2025-10-07T17:16:03.535825] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:16:03.593631] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:16:03.593922] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-07T17:16:03.593978] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-07T17:16:03.594225] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-07T17:16:03.594281] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-07T17:16:03.852561] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-07T17:16:04.002984] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:16:04.032632] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T17:16:04.377575] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T17:16:04.487903] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T17:16:04.647619] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-07T17:16:05.447700] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-07T17:16:05.802399] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T17:16:06.247738] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-07T17:16:06.535454] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T17:16:06.537417] [INFO ] [REMOTE ] AORT: Full fetch complete (41860 records). [2025-10-07T17:16:06.537559] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-07T17:16:06.538242] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:16:06.538355] [FATAL] [MAIN ] AORT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:16:06.538445] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:16:06.538548] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-07T17:16:06.538638] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-07T17:16:06.538718] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-10-07T17:16:06.538977] [DEBUG] [LOCAL ] AORT: Deleted derivative data file. [2025-10-07T17:16:06.539102] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AORT took 36.1s. Estimated remaining: 4h 48m 10s. Rate: 7.8 symbols/min [2025-10-07T17:16:06.756433] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:16:06.808002] [DEBUG] [LOCAL ] APD: Loaded 45311 existing records from primary storage. [2025-10-07T17:16:06.808360] [INFO ] [MAIN ] APD: Loaded 45311 existing records. [2025-10-07T17:16:06.905752] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T17:16:07.052956] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-07T17:16:07.060205] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:16:07.061173] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-07T17:16:07.061222] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-07T17:16:07.061540] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-07T17:16:07.061599] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-07T17:16:07.414196] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:16:07.700520] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-07T17:16:07.847679] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-07T17:16:08.647697] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-07T17:16:09.447633] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-07T17:16:09.609164] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T17:16:09.837530] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T17:16:10.247677] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-07T17:16:10.415049] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T17:16:11.047729] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-07T17:16:11.847741] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-07T17:16:11.928253] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T17:16:12.369492] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-07T17:16:12.647919] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-07T17:16:12.647754] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T17:16:13.252257] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T17:16:13.447696] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-07T17:16:14.247692] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-07T17:16:15.047630] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-07T17:16:15.116949] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T17:16:15.847613] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-07T17:16:16.037710] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T17:16:16.139398] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T17:16:16.647691] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-07T17:16:17.447629] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-07T17:16:17.499321] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T17:16:18.247727] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-07T17:16:18.339875] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T17:16:18.371079] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-07T17:16:19.047721] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-07T17:16:19.847688] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-07T17:16:20.014596] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T17:16:20.438368] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T17:16:20.647695] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-07T17:16:21.046639] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T17:16:21.433866] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T17:16:21.447594] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-07T17:16:22.121570] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-07T17:16:22.247689] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-07T17:16:23.047710] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-07T17:16:23.706329] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T17:16:23.847746] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-07T17:16:24.647688] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-07T17:16:24.848864] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T17:16:25.452560] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-07T17:16:25.455846] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T17:16:25.521805] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T17:16:26.247740] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-07T17:16:26.691881] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T17:16:27.047784] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-07T17:16:27.847716] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-07T17:16:27.963962] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T17:16:28.095599] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T17:16:28.579429] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T17:16:28.647711] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-07T17:16:29.447675] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-07T17:16:30.247631] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-07T17:16:30.359082] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T17:16:30.922073] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T17:16:31.047731] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-07T17:16:31.647073] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T17:16:31.647992] [INFO ] [REMOTE ] AP: Full fetch complete (8930 records). [2025-10-07T17:16:31.648063] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-07T17:16:31.648729] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:16:31.648814] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:16:31.648858] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:16:31.648909] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-07T17:16:31.648992] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-07T17:16:31.649030] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-10-07T17:16:31.649216] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-10-07T17:16:31.649304] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 29.2s. Estimated remaining: 4h 53m 12s. Rate: 7.7 symbols/min [2025-10-07T17:16:31.823032] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T17:16:31.858952] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-07T17:16:31.850039] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:16:31.910855] [DEBUG] [LOCAL ] APG: Loaded 50360 existing records from primary storage. [2025-10-07T17:16:31.911176] [INFO ] [MAIN ] APG: Loaded 50360 existing records. [2025-10-07T17:16:32.090247] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:16:32.090517] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-07T17:16:32.090580] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-07T17:16:32.090827] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-07T17:16:32.090884] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-07T17:16:32.438171] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:16:32.647636] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-07T17:16:33.447625] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-07T17:16:33.481506] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T17:16:34.086148] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T17:16:34.089836] [INFO ] [REMOTE ] AOS: Full fetch complete (70626 records). [2025-10-07T17:16:34.089966] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-07T17:16:34.252928] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-07T17:16:34.534110] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-07T17:16:34.534275] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-07T17:16:34.535277] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-07T17:16:34.535375] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-07T17:16:34.561512] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T17:16:34.564869] [DEBUG] [LOCAL ] AOS: Trimmed 70626 records to 48724 (keeping 200 days of data) [2025-10-07T17:16:34.896093] [DEBUG] [LOCAL ] AOS: Primary data saved (48724 records). [2025-10-07T17:16:34.896297] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-07T17:16:34.896392] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 36.2s. Estimated remaining: 4h 51m 43s. Rate: 7.7 symbols/min [2025-10-07T17:16:35.052904] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-07T17:16:35.091174] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:16:35.091546] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-07T17:16:35.091588] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-07T17:16:35.091752] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-07T17:16:35.091802] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-07T17:16:35.091846] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-07T17:16:35.091881] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-07T17:16:35.483213] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:16:35.609842] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T17:16:35.847698] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-07T17:16:36.647629] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-07T17:16:36.898228] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T17:16:37.316693] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T17:16:37.447706] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-07T17:16:38.247670] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-07T17:16:38.647557] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T17:16:38.666317] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T17:16:38.668855] [INFO ] [REMOTE ] APAM: Full fetch complete (51609 records). [2025-10-07T17:16:38.668992] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-07T17:16:38.669841] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:16:38.669953] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:16:38.670029] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:16:38.670127] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-07T17:16:38.670211] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-07T17:16:38.670249] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-07T17:16:38.670501] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-10-07T17:16:38.670615] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 36.1s. Estimated remaining: 4h 50m 25s. Rate: 7.7 symbols/min [2025-10-07T17:16:38.837176] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:16:38.837399] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-07T17:16:38.837456] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-07T17:16:38.837570] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-07T17:16:38.837612] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-07T17:16:38.837681] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-07T17:16:38.837734] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-07T17:16:39.054495] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-07T17:16:39.188940] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:16:39.470768] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T17:16:39.847733] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-07T17:16:40.647725] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-07T17:16:41.011914] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-07T17:16:41.212887] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T17:16:41.447722] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-07T17:16:42.247626] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-07T17:16:42.371170] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T17:16:43.047632] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-07T17:16:43.207928] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T17:16:43.847707] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-07T17:16:43.911013] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T17:16:44.647633] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-07T17:16:44.680428] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T17:16:45.388266] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T17:16:45.447622] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-07T17:16:46.241738] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T17:16:46.251469] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-07T17:16:47.047695] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-07T17:16:47.242995] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T17:16:47.847717] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-07T17:16:47.888277] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T17:16:48.647634] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-07T17:16:48.905115] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T17:16:49.447614] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-07T17:16:49.542737] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T17:16:49.847290] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T17:16:49.850093] [INFO ] [REMOTE ] APD: Full fetch complete (66507 records). [2025-10-07T17:16:49.850225] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-07T17:16:49.851248] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:16:49.851344] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:16:49.851391] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:16:49.851431] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-07T17:16:49.851491] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-10-07T17:16:49.851527] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-10-07T17:16:49.851750] [DEBUG] [LOCAL ] APD: Deleted derivative data file. [2025-10-07T17:16:49.851847] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 43.3s. Estimated remaining: 4h 51m 17s. Rate: 7.7 symbols/min [2025-10-07T17:16:50.020165] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:16:50.086222] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-07T17:16:50.086588] [INFO ] [MAIN ] APO: Loaded 53383 existing records. [2025-10-07T17:16:50.269150] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-07T17:16:50.275329] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:16:50.276322] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-07T17:16:50.276397] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-07T17:16:50.276734] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-07T17:16:50.276807] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-07T17:16:50.663153] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:16:50.728386] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T17:16:51.047744] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-07T17:16:51.847704] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-07T17:16:52.647721] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-07T17:16:52.690693] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-07T17:16:52.775391] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T17:16:53.447677] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-07T17:16:53.507047] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T17:16:54.067740] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-07T17:16:54.247748] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-07T17:16:54.918165] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:16:55.047685] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-07T17:16:55.847758] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-07T17:16:55.920950] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T17:16:56.647685] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-07T17:16:56.975804] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T17:16:57.447628] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-07T17:16:57.946471] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-07T17:16:58.247626] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-07T17:16:58.327766] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T17:16:59.047712] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-07T17:16:59.158293] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T17:16:59.847767] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-07T17:17:00.170698] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T17:17:00.647629] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-07T17:17:00.997805] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T17:17:01.447672] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-07T17:17:01.961110] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-07T17:17:02.247637] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-07T17:17:02.703073] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-07T17:17:02.830281] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T17:17:03.047663] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-07T17:17:03.684841] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T17:17:03.847665] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-07T17:17:04.647727] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-07T17:17:05.091934] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T17:17:05.387519] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T17:17:05.447602] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-07T17:17:05.953483] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T17:17:05.956989] [INFO ] [REMOTE ] APH: Full fetch complete (77691 records). [2025-10-07T17:17:05.957101] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-07T17:17:06.250334] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-07T17:17:06.345662] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-07T17:17:06.345756] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-07T17:17:06.346572] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-07T17:17:06.346635] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-07T17:17:06.348150] [DEBUG] [LOCAL ] APH: Trimmed 77691 records to 53691 (keeping 200 days of data) [2025-10-07T17:17:06.694390] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-07T17:17:06.694594] [INFO ] [MAIN ] APH: Full history saved. [2025-10-07T17:17:06.694738] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APH took 31.8s. Estimated remaining: 4h 53m 45s. Rate: 7.6 symbols/min [2025-10-07T17:17:06.875282] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:17:06.875609] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-07T17:17:06.875752] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-07T17:17:06.875867] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-07T17:17:06.875909] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-07T17:17:06.875951] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-07T17:17:06.875985] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-07T17:17:07.071243] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-07T17:17:07.278089] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:17:07.324908] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T17:17:07.847623] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-07T17:17:08.092924] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T17:17:08.530496] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T17:17:08.533898] [INFO ] [REMOTE ] APG: Full fetch complete (71788 records). [2025-10-07T17:17:08.534004] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-07T17:17:08.652838] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-07T17:17:08.921015] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-07T17:17:08.921108] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-07T17:17:08.921823] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-07T17:17:08.921892] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-07T17:17:08.923300] [DEBUG] [LOCAL ] APG: Trimmed 71788 records to 50426 (keeping 200 days of data) [2025-10-07T17:17:09.241764] [DEBUG] [LOCAL ] APG: Primary data saved (50426 records). [2025-10-07T17:17:09.241941] [INFO ] [MAIN ] APG: Full history saved. [2025-10-07T17:17:09.242054] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APG took 37.6s. Estimated remaining: 4h 52m 6s. Rate: 7.7 symbols/min [2025-10-07T17:17:09.408039] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:17:09.455136] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-07T17:17:09.458270] [DEBUG] [LOCAL ] APTV: Loaded 52044 existing records from primary storage. [2025-10-07T17:17:09.458628] [INFO ] [MAIN ] APTV: Loaded 52044 existing records. [2025-10-07T17:17:09.643075] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:17:09.643392] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-07T17:17:09.643520] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-07T17:17:09.643859] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-07T17:17:09.643920] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-07T17:17:10.005015] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:17:10.039202] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-07T17:17:10.247683] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-07T17:17:11.047736] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-07T17:17:11.583132] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-07T17:17:11.835509] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (3.18 seconds). [2025-10-07T17:17:11.847594] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-07T17:17:12.647637] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-07T17:17:13.110365] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-07T17:17:13.185210] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-07T17:17:13.233019] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T17:17:13.413621] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T17:17:13.417045] [INFO ] [REMOTE ] APLE: Full fetch complete (74377 records). [2025-10-07T17:17:13.417151] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-07T17:17:13.452823] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-07T17:17:13.805740] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-07T17:17:13.805871] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-07T17:17:13.806724] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-07T17:17:13.806797] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-07T17:17:13.808454] [DEBUG] [LOCAL ] APLE: Trimmed 74377 records to 51950 (keeping 200 days of data) [2025-10-07T17:17:14.145297] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-07T17:17:14.168834] [DEBUG] [LOCAL ] APLE: Primary data saved (51950 records). [2025-10-07T17:17:14.169011] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-07T17:17:14.169093] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 35.5s. Estimated remaining: 4h 51m 9s. Rate: 7.7 symbols/min [2025-10-07T17:17:14.252783] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-07T17:17:14.358891] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:17:14.410144] [DEBUG] [LOCAL ] AQN: Loaded 51873 existing records from primary storage. [2025-10-07T17:17:14.410461] [INFO ] [MAIN ] AQN: Loaded 51873 existing records. [2025-10-07T17:17:14.584619] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:17:14.584907] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-07T17:17:14.584955] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-07T17:17:14.585261] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-07T17:17:14.585318] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-07T17:17:14.936249] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:17:15.047792] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-07T17:17:15.847730] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-07T17:17:16.205525] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T17:17:16.647739] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-07T17:17:16.806512] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T17:17:17.379126] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T17:17:17.447608] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-07T17:17:17.627852] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T17:17:18.022003] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T17:17:18.247689] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-07T17:17:19.047674] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-07T17:17:19.767060] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T17:17:19.847626] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-07T17:17:19.893576] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T17:17:20.560525] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T17:17:20.647669] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-07T17:17:21.263482] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T17:17:21.447718] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-07T17:17:22.247727] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-07T17:17:23.047672] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-07T17:17:23.234112] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T17:17:23.751964] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T17:17:23.847613] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-07T17:17:23.935008] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T17:17:24.647672] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-07T17:17:25.298682] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-07T17:17:25.302212] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-10-07T17:17:25.302321] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-07T17:17:25.455285] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-07T17:17:25.703501] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-07T17:17:25.703584] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-07T17:17:25.704405] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-07T17:17:25.704473] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-07T17:17:25.705986] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 53383 (keeping 200 days of data) [2025-10-07T17:17:26.062357] [DEBUG] [LOCAL ] APO: Primary data saved (53383 records). [2025-10-07T17:17:26.062495] [INFO ] [MAIN ] APO: Full history saved. [2025-10-07T17:17:26.064067] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APO took 36.2s. Estimated remaining: 4h 52m 10s. Rate: 7.7 symbols/min [2025-10-07T17:17:26.267546] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-07T17:17:26.267469] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:17:26.278084] [DEBUG] [LOCAL ] AQNB: Loaded 4138 existing records from primary storage. [2025-10-07T17:17:26.278303] [INFO ] [MAIN ] AQNB: Loaded 4138 existing records. [2025-10-07T17:17:26.455747] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:17:26.456077] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-07T17:17:26.470841] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-07T17:17:26.480775] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-07T17:17:26.481190] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-07T17:17:26.481987] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T17:17:26.845981] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:17:26.929438] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T17:17:27.011672] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T17:17:27.047602] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-07T17:17:27.847734] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-07T17:17:28.327017] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T17:17:28.647624] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-07T17:17:29.083297] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T17:17:29.107365] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-07T17:17:29.447697] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-07T17:17:30.247727] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-07T17:17:30.618059] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-07T17:17:30.971874] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T17:17:31.047606] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-07T17:17:31.847748] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-07T17:17:32.431849] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T17:17:32.433260] [INFO ] [REMOTE ] APOS: Full fetch complete (10368 records). [2025-10-07T17:17:32.433438] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-07T17:17:32.433941] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:17:32.434036] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:17:32.434121] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:17:32.434212] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-07T17:17:32.434289] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-07T17:17:32.434331] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-07T17:17:32.434397] [DEBUG] [LOCAL ] APOS: No derivative data file found to delete. [2025-10-07T17:17:32.434475] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APOS took 25.7s. Estimated remaining: 4h 51m 38s. Rate: 7.7 symbols/min [2025-10-07T17:17:32.610221] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:17:32.659751] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-07T17:17:32.663563] [DEBUG] [LOCAL ] AR: Loaded 53587 existing records from primary storage. [2025-10-07T17:17:32.663984] [INFO ] [MAIN ] AR: Loaded 53587 existing records. [2025-10-07T17:17:32.877627] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:17:32.879406] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T17:17:32.879734] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-07T17:17:32.889597] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-07T17:17:32.890825] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-07T17:17:32.890896] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-07T17:17:33.235850] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:17:33.271452] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-07T17:17:33.447613] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-07T17:17:33.801611] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-07T17:17:34.247711] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-07T17:17:35.047703] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-07T17:17:35.646097] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-07T17:17:35.847612] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-07T17:17:35.922405] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T17:17:36.447622] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T17:17:36.647685] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-07T17:17:37.227740] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-07T17:17:37.447684] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-07T17:17:38.247699] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-07T17:17:38.777377] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-07T17:17:39.047680] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-07T17:17:39.295596] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T17:17:39.621569] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T17:17:39.847690] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-07T17:17:40.647708] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-07T17:17:41.447745] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-07T17:17:41.772066] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T17:17:41.981160] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T17:17:41.981979] [INFO ] [REMOTE ] AQNB: Full fetch complete (5631 records). [2025-10-07T17:17:41.982050] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-07T17:17:41.982426] [FATAL] [VALIDATOR ] AQNB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:17:41.982510] [FATAL] [MAIN ] AQNB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:17:41.982554] [WARN ] [MAIN ] AQNB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:17:41.982617] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-07T17:17:41.982749] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-10-07T17:17:41.982807] [INFO ] [LOCAL ] AQNB: Starting deletion of derivative data. [2025-10-07T17:17:41.983015] [DEBUG] [LOCAL ] AQNB: Deleted derivative data file. [2025-10-07T17:17:41.983132] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 15.9s. Estimated remaining: 4h 51m 59s. Rate: 7.7 symbols/min [2025-10-07T17:17:42.153250] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:17:42.200569] [DEBUG] [LOCAL ] ARCO: Loaded 44349 existing records from primary storage. [2025-10-07T17:17:42.200935] [INFO ] [MAIN ] ARCO: Loaded 44349 existing records. [2025-10-07T17:17:42.253778] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-07T17:17:42.390854] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:17:42.391207] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-07T17:17:42.391359] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-07T17:17:42.391809] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-07T17:17:42.391868] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-07T17:17:42.722303] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-07T17:17:42.815665] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:17:43.047702] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-07T17:17:43.847754] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-07T17:17:44.075351] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T17:17:44.647637] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-07T17:17:44.781351] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T17:17:45.250244] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T17:17:45.447684] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-07T17:17:46.223949] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T17:17:46.247630] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-07T17:17:46.822670] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T17:17:47.047727] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-07T17:17:47.659306] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T17:17:47.663146] [INFO ] [REMOTE ] APTV: Full fetch complete (75877 records). [2025-10-07T17:17:47.663305] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-07T17:17:47.862196] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-07T17:17:48.120485] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-07T17:17:48.120622] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-07T17:17:48.121876] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-07T17:17:48.121949] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-07T17:17:48.123793] [DEBUG] [LOCAL ] APTV: Trimmed 75877 records to 52052 (keeping 200 days of data) [2025-10-07T17:17:48.447374] [DEBUG] [LOCAL ] APTV: Primary data saved (52052 records). [2025-10-07T17:17:48.447516] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-07T17:17:48.449787] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 39.2s. Estimated remaining: 4h 51m 28s. Rate: 7.7 symbols/min [2025-10-07T17:17:48.627743] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:17:48.645965] [DEBUG] [LOCAL ] ARDC: Loaded 14954 existing records from primary storage. [2025-10-07T17:17:48.646357] [INFO ] [MAIN ] ARDC: Loaded 14954 existing records. [2025-10-07T17:17:48.658012] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-07T17:17:48.789258] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T17:17:48.875545] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:17:48.875819] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-07T17:17:48.875869] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-07T17:17:48.876162] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-07T17:17:48.876220] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-07T17:17:49.267894] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:17:49.447627] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-07T17:17:49.627364] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T17:17:50.117363] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T17:17:50.247607] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-07T17:17:50.438101] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T17:17:51.047740] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-07T17:17:51.495306] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T17:17:51.847731] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-07T17:17:52.351366] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T17:17:52.647738] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-07T17:17:53.447628] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-07T17:17:53.688479] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T17:17:54.247622] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-07T17:17:54.368223] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T17:17:55.024263] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T17:17:55.047606] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-07T17:17:55.274117] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T17:17:55.847697] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-07T17:17:56.594126] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T17:17:56.647611] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-07T17:17:57.387268] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T17:17:57.447608] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-07T17:17:58.044592] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T17:17:58.247717] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-07T17:17:59.047673] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-07T17:17:59.482127] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T17:17:59.718557] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T17:17:59.829252] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T17:17:59.847630] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-07T17:18:00.647722] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-07T17:18:01.269933] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-07T17:18:01.447691] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-07T17:18:02.247629] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-07T17:18:02.285881] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T17:18:03.047718] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-07T17:18:03.230764] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T17:18:03.847630] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-07T17:18:04.097849] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T17:18:04.170231] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T17:18:04.647676] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-07T17:18:05.239805] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T17:18:05.242981] [INFO ] [REMOTE ] AQN: Full fetch complete (74902 records). [2025-10-07T17:18:05.243110] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-07T17:18:05.243967] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:18:05.244061] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:18:05.244110] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:18:05.244182] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-07T17:18:05.244260] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-07T17:18:05.244305] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-07T17:18:05.244538] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-07T17:18:05.245589] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 51.1s. Estimated remaining: 4h 53m 47s. Rate: 7.6 symbols/min [2025-10-07T17:18:05.414813] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:18:05.449429] [DEBUG] [LOCAL ] ARDT: Loaded 27708 existing records from primary storage. [2025-10-07T17:18:05.448196] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-07T17:18:05.449961] [INFO ] [MAIN ] ARDT: Loaded 27708 existing records. [2025-10-07T17:18:05.631894] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:18:05.632180] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-07T17:18:05.632234] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-07T17:18:05.632716] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-07T17:18:05.632777] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-07T17:18:05.988774] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:18:06.247705] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-07T17:18:06.285726] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T17:18:06.451620] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-07T17:18:07.047699] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-07T17:18:07.530146] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T17:18:07.832119] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T17:18:07.847716] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-07T17:18:08.474088] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T17:18:08.647706] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-07T17:18:09.447687] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-07T17:18:10.097723] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-07T17:18:10.101149] [INFO ] [REMOTE ] ARCO: Full fetch complete (65307 records). [2025-10-07T17:18:10.101329] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-07T17:18:10.252808] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-07T17:18:10.454697] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-07T17:18:10.565945] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-07T17:18:10.566039] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-07T17:18:10.566794] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-07T17:18:10.566864] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-07T17:18:10.568685] [DEBUG] [LOCAL ] ARCO: Trimmed 65307 records to 44383 (keeping 200 days of data) [2025-10-07T17:18:10.834271] [DEBUG] [LOCAL ] ARCO: Primary data saved (44383 records). [2025-10-07T17:18:10.834449] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-07T17:18:10.834562] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. ARCO took 28.9s. Estimated remaining: 4h 53m 2s. Rate: 7.6 symbols/min [2025-10-07T17:18:11.005814] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:18:11.055521] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-07T17:18:11.059076] [DEBUG] [LOCAL ] ARE: Loaded 50684 existing records from primary storage. [2025-10-07T17:18:11.059434] [INFO ] [MAIN ] ARE: Loaded 50684 existing records. [2025-10-07T17:18:11.247202] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:18:11.247458] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-07T17:18:11.247506] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-07T17:18:11.247967] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-07T17:18:11.248025] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-07T17:18:11.609541] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:18:11.626429] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T17:18:11.847632] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-07T17:18:12.118845] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T17:18:12.647685] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-07T17:18:13.405387] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T17:18:13.447598] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-07T17:18:14.247610] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-07T17:18:14.760463] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-07T17:18:15.047666] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-07T17:18:15.126440] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T17:18:15.218995] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T17:18:15.825065] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T17:18:15.847685] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-07T17:18:16.647635] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-07T17:18:16.677578] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T17:18:16.679339] [INFO ] [REMOTE ] ARDC: Full fetch complete (21017 records). [2025-10-07T17:18:16.679410] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-07T17:18:17.040589] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-07T17:18:17.040730] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-07T17:18:17.041110] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-07T17:18:17.041177] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-07T17:18:17.042330] [DEBUG] [LOCAL ] ARDC: Trimmed 21017 records to 15020 (keeping 200 days of data) [2025-10-07T17:18:17.138556] [DEBUG] [LOCAL ] ARDC: Primary data saved (15020 records). [2025-10-07T17:18:17.138741] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-07T17:18:17.138841] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 28.7s. Estimated remaining: 4h 52m 29s. Rate: 7.6 symbols/min [2025-10-07T17:18:17.306278] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:18:17.306518] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-07T17:18:17.306570] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-07T17:18:17.306767] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-07T17:18:17.306835] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-07T17:18:17.306889] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-07T17:18:17.306924] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-07T17:18:17.452909] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-07T17:18:17.667336] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:18:17.868276] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-07T17:18:18.247680] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-07T17:18:19.047749] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-07T17:18:19.557609] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-07T17:18:19.847638] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-07T17:18:19.932244] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T17:18:20.647621] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-07T17:18:20.907815] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T17:18:21.447739] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-07T17:18:21.623038] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T17:18:21.835167] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T17:18:22.247729] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-07T17:18:22.600871] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T17:18:23.047675] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-07T17:18:23.847686] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-07T17:18:23.949386] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T17:18:24.647767] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-07T17:18:24.707836] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T17:18:24.988116] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T17:18:25.447707] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-07T17:18:26.254384] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-07T17:18:26.261203] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T17:18:26.879468] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T17:18:27.047632] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-07T17:18:27.097956] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-07T17:18:27.847769] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-07T17:18:28.621830] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T17:18:28.647618] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-07T17:18:29.252498] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T17:18:29.256007] [INFO ] [REMOTE ] AR: Full fetch complete (77545 records). [2025-10-07T17:18:29.256124] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-07T17:18:29.448434] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-07T17:18:29.690375] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-07T17:18:29.690499] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-07T17:18:29.691529] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-07T17:18:29.691625] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-07T17:18:29.693326] [DEBUG] [LOCAL ] AR: Trimmed 77545 records to 53589 (keeping 200 days of data) [2025-10-07T17:18:30.021983] [DEBUG] [LOCAL ] AR: Primary data saved (53589 records). [2025-10-07T17:18:30.022147] [INFO ] [MAIN ] AR: Full history saved. [2025-10-07T17:18:30.023025] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. AR took 57.6s. Estimated remaining: 4h 53m 41s. Rate: 7.6 symbols/min [2025-10-07T17:18:30.207913] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:18:30.253248] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-07T17:18:30.256159] [DEBUG] [LOCAL ] ARI: Loaded 43598 existing records from primary storage. [2025-10-07T17:18:30.256527] [INFO ] [MAIN ] ARI: Loaded 43598 existing records. [2025-10-07T17:18:30.445263] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:18:30.445676] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-07T17:18:30.445861] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-07T17:18:30.446298] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-07T17:18:30.446442] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-07T17:18:30.591299] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T17:18:30.850765] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:18:31.047633] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-07T17:18:31.080996] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T17:18:31.847691] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-07T17:18:31.996328] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T17:18:32.647672] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-07T17:18:33.030279] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T17:18:33.447731] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-07T17:18:33.526334] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T17:18:34.157307] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T17:18:34.247703] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-07T17:18:35.047620] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-07T17:18:35.126718] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T17:18:35.759729] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T17:18:35.847718] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-07T17:18:36.555453] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:18:36.647687] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-07T17:18:37.447680] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-07T17:18:37.543975] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T17:18:37.606595] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T17:18:38.247765] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-07T17:18:38.438764] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T17:18:39.047724] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-07T17:18:39.847821] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-07T17:18:39.887912] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T17:18:40.478446] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T17:18:40.647738] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-07T17:18:41.306086] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T17:18:41.309754] [INFO ] [REMOTE ] ARE: Full fetch complete (72694 records). [2025-10-07T17:18:41.309878] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-07T17:18:41.452940] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-07T17:18:41.705086] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-07T17:18:41.705175] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-07T17:18:41.705948] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-07T17:18:41.706015] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-07T17:18:41.707514] [DEBUG] [LOCAL ] ARE: Trimmed 72694 records to 50729 (keeping 200 days of data) [2025-10-07T17:18:42.028107] [DEBUG] [LOCAL ] ARE: Primary data saved (50729 records). [2025-10-07T17:18:42.028245] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-07T17:18:42.029309] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARE took 31.2s. Estimated remaining: 4h 54m 38s. Rate: 7.6 symbols/min [2025-10-07T17:18:42.202632] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:18:42.246197] [DEBUG] [LOCAL ] ARIS: Loaded 42261 existing records from primary storage. [2025-10-07T17:18:42.246517] [INFO ] [MAIN ] ARIS: Loaded 42261 existing records. [2025-10-07T17:18:42.257552] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-07T17:18:42.454421] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:18:42.454880] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-07T17:18:42.454957] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-07T17:18:42.455248] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-07T17:18:42.455330] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-07T17:18:42.645328] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T17:18:42.871993] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:18:43.047620] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-07T17:18:43.502830] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T17:18:43.503883] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T17:18:43.847699] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-07T17:18:44.506328] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T17:18:44.647676] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-07T17:18:44.984105] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T17:18:44.986554] [INFO ] [REMOTE ] ARDT: Full fetch complete (41538 records). [2025-10-07T17:18:44.986634] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-07T17:18:45.372009] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-07T17:18:45.372088] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-07T17:18:45.372633] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-07T17:18:45.372749] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-07T17:18:45.374434] [DEBUG] [LOCAL ] ARDT: Trimmed 41538 records to 27787 (keeping 200 days of data) [2025-10-07T17:18:45.457025] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-07T17:18:45.538332] [DEBUG] [LOCAL ] ARDT: Primary data saved (27787 records). [2025-10-07T17:18:45.538488] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-07T17:18:45.538615] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARDT took 40.3s. Estimated remaining: 4h 53m 21s. Rate: 7.6 symbols/min [2025-10-07T17:18:45.734863] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:18:45.778735] [DEBUG] [LOCAL ] ARLO: Loaded 43824 existing records from primary storage. [2025-10-07T17:18:45.779059] [INFO ] [MAIN ] ARLO: Loaded 43824 existing records. [2025-10-07T17:18:45.956902] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:18:45.957095] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-07T17:18:45.957144] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-07T17:18:45.957379] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-07T17:18:45.957445] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-07T17:18:46.248800] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-07T17:18:46.345314] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:18:46.375253] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T17:18:46.889680] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T17:18:47.047678] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-07T17:18:47.847751] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-07T17:18:47.906900] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T17:18:48.467637] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T17:18:48.470744] [INFO ] [REMOTE ] ARES: Full fetch complete (70458 records). [2025-10-07T17:18:48.470860] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-07T17:18:48.471592] [FATAL] [VALIDATOR ] ARES: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:18:48.471712] [FATAL] [MAIN ] ARES: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:18:48.471757] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:18:48.471811] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-07T17:18:48.471969] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-07T17:18:48.472025] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-10-07T17:18:48.472070] [DEBUG] [LOCAL ] ARES: No derivative data file found to delete. [2025-10-07T17:18:48.472126] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 31.3s. Estimated remaining: 4h 51m 55s. Rate: 7.6 symbols/min [2025-10-07T17:18:48.655353] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-07T17:18:48.661517] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:18:48.713495] [DEBUG] [LOCAL ] ARMK: Loaded 50402 existing records from primary storage. [2025-10-07T17:18:48.713917] [INFO ] [MAIN ] ARMK: Loaded 50402 existing records. [2025-10-07T17:18:48.889892] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:18:48.890175] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-07T17:18:48.890226] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-07T17:18:48.890468] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-07T17:18:48.890527] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-07T17:18:49.256823] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:18:49.289436] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T17:18:49.447696] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-07T17:18:49.841705] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T17:18:50.247708] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-07T17:18:51.047684] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-07T17:18:51.248252] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T17:18:51.834621] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T17:18:51.847600] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-07T17:18:52.573963] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T17:18:52.647606] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-07T17:18:53.357093] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T17:18:53.447685] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-07T17:18:54.247696] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-07T17:18:54.316301] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T17:18:54.995341] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T17:18:55.047683] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-07T17:18:55.444746] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T17:18:55.847689] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-07T17:18:56.478439] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T17:18:56.647629] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-07T17:18:56.896508] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T17:18:57.447687] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-07T17:18:57.861378] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T17:18:58.247701] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-07T17:18:58.928450] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T17:18:59.047671] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-07T17:18:59.739138] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T17:18:59.741952] [INFO ] [REMOTE ] ARI: Full fetch complete (62406 records). [2025-10-07T17:18:59.742063] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-07T17:18:59.742869] [FATAL] [VALIDATOR ] ARI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:18:59.742983] [FATAL] [MAIN ] ARI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:18:59.743027] [WARN ] [MAIN ] ARI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:18:59.743068] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-07T17:18:59.743126] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-07T17:18:59.743161] [INFO ] [LOCAL ] ARI: Starting deletion of derivative data. [2025-10-07T17:18:59.743452] [DEBUG] [LOCAL ] ARI: Deleted derivative data file. [2025-10-07T17:18:59.743882] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 29.7s. Estimated remaining: 4h 52m 40s. Rate: 7.6 symbols/min [2025-10-07T17:18:59.852761] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-07T17:18:59.915956] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:18:59.962698] [DEBUG] [LOCAL ] AROC: Loaded 48939 existing records from primary storage. [2025-10-07T17:18:59.963039] [INFO ] [MAIN ] AROC: Loaded 48939 existing records. [2025-10-07T17:19:00.147893] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:19:00.148193] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-07T17:19:00.148333] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-07T17:19:00.148831] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-07T17:19:00.148949] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-07T17:19:00.338182] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T17:19:00.550726] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:19:00.647689] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-07T17:19:01.447716] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-07T17:19:01.627846] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T17:19:01.900829] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T17:19:02.247720] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-07T17:19:03.052807] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-07T17:19:03.067003] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T17:19:03.630134] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T17:19:03.847708] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-07T17:19:04.647633] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-07T17:19:04.802906] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T17:19:05.375831] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T17:19:05.447690] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-07T17:19:06.214074] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T17:19:06.247617] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-07T17:19:07.047619] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-07T17:19:07.216979] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T17:19:07.781485] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T17:19:07.847602] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-07T17:19:08.446346] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T17:19:08.647624] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-07T17:19:09.366606] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T17:19:09.447605] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-07T17:19:09.986233] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T17:19:09.989517] [INFO ] [REMOTE ] ARIS: Full fetch complete (60957 records). [2025-10-07T17:19:09.989627] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-07T17:19:10.252773] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-07T17:19:10.396552] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-07T17:19:10.396677] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-07T17:19:10.397375] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-07T17:19:10.397424] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-07T17:19:10.398814] [DEBUG] [LOCAL ] ARIS: Trimmed 60957 records to 42300 (keeping 200 days of data) [2025-10-07T17:19:10.674698] [DEBUG] [LOCAL ] ARIS: Primary data saved (42300 records). [2025-10-07T17:19:10.674838] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-07T17:19:10.674921] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 28.6s. Estimated remaining: 4h 53m 19s. Rate: 7.6 symbols/min [2025-10-07T17:19:10.856859] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:19:10.888870] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T17:19:10.963296] [DEBUG] [LOCAL ] ARR: Loaded 52043 existing records from primary storage. [2025-10-07T17:19:10.963789] [INFO ] [MAIN ] ARR: Loaded 52043 existing records. [2025-10-07T17:19:11.057731] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-07T17:19:11.138962] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:19:11.139190] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-07T17:19:11.139237] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-07T17:19:11.139576] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-07T17:19:11.139633] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-07T17:19:11.484298] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:19:11.847721] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-07T17:19:12.156206] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-07T17:19:12.538541] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T17:19:12.647708] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-07T17:19:13.447723] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-07T17:19:13.933214] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T17:19:14.247688] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-07T17:19:14.366892] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T17:19:14.865367] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T17:19:15.047637] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-07T17:19:15.847700] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-07T17:19:15.892773] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T17:19:16.339543] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T17:19:16.647752] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-07T17:19:17.123020] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T17:19:17.125756] [INFO ] [REMOTE ] ARLO: Full fetch complete (62617 records). [2025-10-07T17:19:17.125851] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-07T17:19:17.126762] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:19:17.126849] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:19:17.126908] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:19:17.126949] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-07T17:19:17.127010] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-07T17:19:17.127045] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-10-07T17:19:17.127242] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-10-07T17:19:17.128099] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 31.6s. Estimated remaining: 4h 52m 49s. Rate: 7.6 symbols/min [2025-10-07T17:19:17.306049] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:19:17.342682] [DEBUG] [LOCAL ] ARW: Loaded 32957 existing records from primary storage. [2025-10-07T17:19:17.342967] [INFO ] [MAIN ] ARW: Loaded 32957 existing records. [2025-10-07T17:19:17.452856] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-07T17:19:17.527281] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:19:17.527500] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-07T17:19:17.527550] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-07T17:19:17.527856] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-07T17:19:17.527915] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-07T17:19:17.887711] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:19:18.247628] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-07T17:19:18.275340] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T17:19:18.939061] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T17:19:19.047753] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-07T17:19:19.453137] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T17:19:19.847712] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-07T17:19:20.650243] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-07T17:19:20.653674] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T17:19:21.225139] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T17:19:21.447707] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-07T17:19:21.772218] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T17:19:22.247720] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-07T17:19:23.025448] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T17:19:23.047601] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-07T17:19:23.847634] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-07T17:19:23.936638] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T17:19:24.647619] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-07T17:19:25.130575] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T17:19:25.211066] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T17:19:25.447682] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-07T17:19:26.203685] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T17:19:26.247691] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-07T17:19:27.047716] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-07T17:19:27.351873] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T17:19:27.370801] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T17:19:27.374160] [INFO ] [REMOTE ] ARMK: Full fetch complete (72658 records). [2025-10-07T17:19:27.374264] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-07T17:19:27.755842] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-07T17:19:27.755922] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-07T17:19:27.756632] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-07T17:19:27.756713] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-07T17:19:27.758095] [DEBUG] [LOCAL ] ARMK: Trimmed 72658 records to 50378 (keeping 200 days of data) [2025-10-07T17:19:27.851402] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-07T17:19:28.076520] [DEBUG] [LOCAL ] ARMK: Primary data saved (50378 records). [2025-10-07T17:19:28.076762] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-07T17:19:28.076857] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 39.6s. Estimated remaining: 4h 53m 27s. Rate: 7.6 symbols/min [2025-10-07T17:19:28.245360] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:19:28.245517] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-07T17:19:28.245557] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-07T17:19:28.245711] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-07T17:19:28.245766] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-07T17:19:28.245809] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-07T17:19:28.245840] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-07T17:19:28.599484] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:19:28.619320] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T17:19:28.647597] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-07T17:19:29.447761] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-07T17:19:29.680284] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T17:19:30.252850] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-07T17:19:30.264836] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T17:19:30.465326] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:19:30.465671] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-07T17:19:30.465763] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:19:30.465825] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-07T17:19:30.465906] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:19:30.465994] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-07T17:19:30.466083] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-07T17:19:30.466134] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-07T17:19:30.466191] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-07T17:19:30.466276] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 2.4s. Estimated remaining: 4h 51m 56s. Rate: 7.6 symbols/min [2025-10-07T17:19:30.640814] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:19:30.697345] [DEBUG] [LOCAL ] AS: Loaded 53091 existing records from primary storage. [2025-10-07T17:19:30.697845] [INFO ] [MAIN ] AS: Loaded 53091 existing records. [2025-10-07T17:19:30.877548] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:19:30.877790] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-07T17:19:30.877839] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-07T17:19:30.878175] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-07T17:19:30.878231] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-07T17:19:31.058105] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-07T17:19:31.243454] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:19:31.269458] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T17:19:31.847697] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-07T17:19:32.209530] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T17:19:32.647700] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-07T17:19:33.279254] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T17:19:33.447613] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-07T17:19:34.026518] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T17:19:34.247707] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-07T17:19:35.047713] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-07T17:19:35.372772] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T17:19:35.572571] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T17:19:35.847616] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-07T17:19:36.332268] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T17:19:36.647747] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-07T17:19:37.447734] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-07T17:19:37.525621] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T17:19:38.247685] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-07T17:19:38.396905] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T17:19:39.047704] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-07T17:19:39.440374] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-07T17:19:39.820785] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T17:19:39.847603] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-07T17:19:40.647634] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-07T17:19:40.758367] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T17:19:41.448431] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T17:19:41.447624] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-07T17:19:42.247667] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-07T17:19:42.308825] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T17:19:43.047631] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-07T17:19:43.485803] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-07T17:19:43.847685] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-07T17:19:43.963350] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T17:19:44.647680] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-07T17:19:44.885820] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T17:19:44.995222] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T17:19:44.998129] [INFO ] [REMOTE ] ARW: Full fetch complete (48008 records). [2025-10-07T17:19:44.998225] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-07T17:19:45.450675] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-07T17:19:45.450863] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-07T17:19:45.450981] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-07T17:19:45.451871] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-07T17:19:45.452904] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-07T17:19:45.454426] [DEBUG] [LOCAL ] ARW: Trimmed 48008 records to 32930 (keeping 200 days of data) [2025-10-07T17:19:45.672028] [DEBUG] [LOCAL ] ARW: Primary data saved (32930 records). [2025-10-07T17:19:45.672177] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-07T17:19:45.672999] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARW took 28.5s. Estimated remaining: 4h 53m 38s. Rate: 7.6 symbols/min [2025-10-07T17:19:45.841400] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:19:45.858105] [DEBUG] [LOCAL ] ASA: Loaded 14356 existing records from primary storage. [2025-10-07T17:19:45.858349] [INFO ] [MAIN ] ASA: Loaded 14356 existing records. [2025-10-07T17:19:45.976539] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T17:19:46.008450] [INFO ] [REMOTE ] AROC: Full fetch complete (70984 records). [2025-10-07T17:19:46.028786] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-07T17:19:46.049991] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:19:46.050244] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-07T17:19:46.050335] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-07T17:19:46.082002] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-07T17:19:46.121443] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-07T17:19:46.252040] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-07T17:19:46.880947] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-07T17:19:46.884693] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:19:46.884785] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-07T17:19:46.885893] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-07T17:19:46.886273] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-07T17:19:46.888326] [DEBUG] [LOCAL ] AROC: Trimmed 70984 records to 48944 (keeping 200 days of data) [2025-10-07T17:19:47.076831] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-07T17:19:47.208352] [DEBUG] [LOCAL ] AROC: Primary data saved (48944 records). [2025-10-07T17:19:47.208558] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-07T17:19:47.209826] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. AROC took 47.5s. Estimated remaining: 4h 51m 55s. Rate: 7.6 symbols/min [2025-10-07T17:19:47.385605] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:19:47.438845] [DEBUG] [LOCAL ] ASAN: Loaded 52722 existing records from primary storage. [2025-10-07T17:19:47.439246] [INFO ] [MAIN ] ASAN: Loaded 52722 existing records. [2025-10-07T17:19:47.636481] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:19:47.637050] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-07T17:19:47.637361] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-07T17:19:47.648419] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-07T17:19:47.666260] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-07T17:19:47.686397] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-07T17:19:47.854030] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-07T17:19:47.916715] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T17:19:48.111821] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:19:48.114937] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T17:19:48.647707] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-07T17:19:49.447696] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-07T17:19:49.506218] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-07T17:19:49.590451] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-07T17:19:49.594073] [INFO ] [REMOTE ] ARR: Full fetch complete (75264 records). [2025-10-07T17:19:49.594231] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-07T17:19:49.990372] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-07T17:19:49.990495] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-07T17:19:49.991386] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-07T17:19:49.991460] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-07T17:19:49.993433] [DEBUG] [LOCAL ] ARR: Trimmed 75264 records to 52067 (keeping 200 days of data) [2025-10-07T17:19:50.277378] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-07T17:19:50.324729] [DEBUG] [LOCAL ] ARR: Primary data saved (52067 records). [2025-10-07T17:19:50.324912] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-07T17:19:50.327011] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARR took 39.7s. Estimated remaining: 4h 50m 37s. Rate: 7.6 symbols/min [2025-10-07T17:19:50.499257] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:19:50.550695] [DEBUG] [LOCAL ] ASB: Loaded 49543 existing records from primary storage. [2025-10-07T17:19:50.551027] [INFO ] [MAIN ] ASB: Loaded 49543 existing records. [2025-10-07T17:19:50.738779] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:19:50.739003] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-07T17:19:50.739055] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-07T17:19:50.739460] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-07T17:19:50.739519] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-07T17:19:51.052744] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-07T17:19:51.116466] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:19:51.125244] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-07T17:19:51.161337] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T17:19:51.847701] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-07T17:19:52.647708] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-07T17:19:53.204358] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-07T17:19:53.223140] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T17:19:53.407284] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T17:19:53.447715] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-07T17:19:54.247711] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-07T17:19:54.969429] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T17:19:55.047631] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-07T17:19:55.847622] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-07T17:19:56.031746] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T17:19:56.647687] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-07T17:19:56.771997] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T17:19:56.847821] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T17:19:57.447690] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-07T17:19:58.214458] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T17:19:58.247634] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-07T17:19:59.047632] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-07T17:19:59.219961] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T17:19:59.261714] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T17:19:59.847753] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-07T17:20:00.647713] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-07T17:20:00.683663] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-07T17:20:00.931486] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T17:20:01.447683] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-07T17:20:02.247712] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-07T17:20:02.692564] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-07T17:20:02.859063] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T17:20:03.047729] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-07T17:20:03.091569] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T17:20:03.847632] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-07T17:20:04.063180] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T17:20:04.647694] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-07T17:20:05.447717] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-07T17:20:05.809886] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T17:20:06.247670] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-07T17:20:06.303559] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T17:20:07.047743] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-07T17:20:07.509950] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-07T17:20:07.847741] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-07T17:20:07.913347] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T17:20:08.615527] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T17:20:08.619104] [INFO ] [REMOTE ] AS: Full fetch complete (76560 records). [2025-10-07T17:20:08.619244] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-07T17:20:08.650762] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-07T17:20:08.814760] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T17:20:09.038214] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-07T17:20:09.038301] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-07T17:20:09.039337] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-07T17:20:09.039405] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-07T17:20:09.040945] [DEBUG] [LOCAL ] AS: Trimmed 76560 records to 53105 (keeping 200 days of data) [2025-10-07T17:20:09.360203] [DEBUG] [LOCAL ] AS: Primary data saved (53105 records). [2025-10-07T17:20:09.360421] [INFO ] [MAIN ] AS: Full history saved. [2025-10-07T17:20:09.360543] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. AS took 38.9s. Estimated remaining: 4h 53m 13s. Rate: 7.6 symbols/min [2025-10-07T17:20:09.454535] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-07T17:20:09.527069] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:20:09.532779] [DEBUG] [LOCAL ] ASBA: Loaded 3477 existing records from primary storage. [2025-10-07T17:20:09.532949] [INFO ] [MAIN ] ASBA: Loaded 3477 existing records. [2025-10-07T17:20:09.709123] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:20:09.709364] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-07T17:20:09.709411] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-07T17:20:09.709581] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-07T17:20:09.709639] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-07T17:20:10.074912] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:20:10.132313] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T17:20:10.247701] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-07T17:20:10.951194] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T17:20:11.047771] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-07T17:20:11.847778] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-07T17:20:11.909891] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T17:20:12.229033] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T17:20:12.230955] [INFO ] [REMOTE ] ASA: Full fetch complete (19246 records). [2025-10-07T17:20:12.231068] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-07T17:20:12.595801] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-07T17:20:12.595885] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-07T17:20:12.596200] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-07T17:20:12.596242] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-07T17:20:12.596929] [DEBUG] [LOCAL ] ASA: Trimmed 19246 records to 14503 (keeping 200 days of data) [2025-10-07T17:20:12.659010] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-07T17:20:12.688381] [DEBUG] [LOCAL ] ASA: Primary data saved (14503 records). [2025-10-07T17:20:12.688587] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-07T17:20:12.688706] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASA took 27.0s. Estimated remaining: 4h 51m 58s. Rate: 7.6 symbols/min [2025-10-07T17:20:12.863209] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:20:12.906467] [DEBUG] [LOCAL ] ASC: Loaded 37386 existing records from primary storage. [2025-10-07T17:20:12.906837] [INFO ] [MAIN ] ASC: Loaded 37386 existing records. [2025-10-07T17:20:13.081631] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:20:13.081890] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-07T17:20:13.081938] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-07T17:20:13.082170] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-07T17:20:13.082227] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-07T17:20:13.367986] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-07T17:20:13.458740] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-07T17:20:13.467210] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:20:13.658343] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T17:20:14.247757] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-07T17:20:15.047760] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-07T17:20:15.196199] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T17:20:15.640442] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T17:20:15.847668] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-07T17:20:15.937605] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T17:20:16.647759] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-07T17:20:17.447639] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-07T17:20:17.812325] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T17:20:18.008004] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T17:20:18.095256] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T17:20:18.247734] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-07T17:20:19.047726] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-07T17:20:19.847758] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-07T17:20:19.929746] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T17:20:20.480176] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T17:20:20.647708] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-07T17:20:21.221389] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T17:20:21.447719] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-07T17:20:22.247682] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-07T17:20:22.577160] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T17:20:22.632925] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T17:20:23.047770] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-07T17:20:23.574543] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T17:20:23.578133] [INFO ] [REMOTE ] ASB: Full fetch complete (71729 records). [2025-10-07T17:20:23.578294] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-07T17:20:23.752491] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T17:20:23.852897] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-07T17:20:24.001338] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-07T17:20:24.001568] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-07T17:20:24.002348] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-07T17:20:24.002417] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-07T17:20:24.004003] [DEBUG] [LOCAL ] ASB: Trimmed 71729 records to 49558 (keeping 200 days of data) [2025-10-07T17:20:24.331712] [DEBUG] [LOCAL ] ASB: Primary data saved (49558 records). [2025-10-07T17:20:24.331882] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-07T17:20:24.333184] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASB took 34.0s. Estimated remaining: 4h 52m 44s. Rate: 7.6 symbols/min [2025-10-07T17:20:24.463885] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T17:20:24.539489] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:20:24.559473] [DEBUG] [LOCAL ] ASG: Loaded 19758 existing records from primary storage. [2025-10-07T17:20:24.559763] [INFO ] [MAIN ] ASG: Loaded 19758 existing records. [2025-10-07T17:20:24.652856] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-07T17:20:24.733259] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:20:24.733440] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-07T17:20:24.733485] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-07T17:20:24.733713] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-07T17:20:24.733770] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-07T17:20:25.077708] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-07T17:20:25.081232] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:20:25.447671] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-07T17:20:26.247855] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-07T17:20:26.643346] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T17:20:27.047715] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-07T17:20:27.847616] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-07T17:20:27.889074] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T17:20:27.892610] [INFO ] [REMOTE ] ASAN: Full fetch complete (76529 records). [2025-10-07T17:20:27.892752] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-07T17:20:28.291364] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T17:20:28.322488] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-07T17:20:28.322628] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-07T17:20:28.326289] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-07T17:20:28.326864] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-07T17:20:28.327056] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-07T17:20:28.330025] [DEBUG] [LOCAL ] ASAN: Trimmed 76529 records to 52722 (keeping 200 days of data) [2025-10-07T17:20:28.647834] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-07T17:20:28.651913] [DEBUG] [LOCAL ] ASAN: Primary data saved (52722 records). [2025-10-07T17:20:28.652094] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-07T17:20:28.652695] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASAN took 41.4s. Estimated remaining: 4h 51m 45s. Rate: 7.6 symbols/min [2025-10-07T17:20:28.823175] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:20:28.848935] [DEBUG] [LOCAL ] ASGI: Loaded 22716 existing records from primary storage. [2025-10-07T17:20:28.849323] [INFO ] [MAIN ] ASGI: Loaded 22716 existing records. [2025-10-07T17:20:29.041150] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:20:29.041433] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-07T17:20:29.041481] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-07T17:20:29.041769] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-07T17:20:29.041828] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-07T17:20:29.346938] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T17:20:29.427161] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:20:29.447602] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-07T17:20:30.247696] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-07T17:20:30.764074] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T17:20:31.052023] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-07T17:20:31.057375] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T17:20:31.847713] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-07T17:20:32.624268] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T17:20:32.647693] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-07T17:20:32.985295] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T17:20:33.447681] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-07T17:20:33.770567] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T17:20:34.247694] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-07T17:20:34.554769] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T17:20:35.047683] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-07T17:20:35.461513] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T17:20:35.847729] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-07T17:20:36.092564] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T17:20:36.647793] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-07T17:20:37.133493] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T17:20:37.426737] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T17:20:37.447595] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-07T17:20:38.247712] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-07T17:20:38.500088] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T17:20:39.047676] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-07T17:20:39.761339] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T17:20:39.847710] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-07T17:20:39.900558] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T17:20:40.647759] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-07T17:20:41.302795] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T17:20:41.315956] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-07T17:20:41.447679] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-07T17:20:42.247776] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-07T17:20:42.787278] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-07T17:20:42.945742] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T17:20:43.047709] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-07T17:20:43.847687] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-07T17:20:44.172312] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T17:20:44.647704] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-07T17:20:44.945196] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T17:20:45.447699] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-07T17:20:46.003869] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T17:20:46.247680] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-07T17:20:46.319225] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T17:20:46.852313] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T17:20:46.853168] [INFO ] [REMOTE ] ASBA: Full fetch complete (5236 records). [2025-10-07T17:20:46.853240] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-07T17:20:47.052743] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-07T17:20:47.215322] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-07T17:20:47.215398] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-07T17:20:47.215623] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-07T17:20:47.215707] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-07T17:20:47.216867] [DEBUG] [LOCAL ] ASBA: Trimmed 5236 records to 3471 (keeping 200 days of data) [2025-10-07T17:20:47.238702] [DEBUG] [LOCAL ] ASBA: Primary data saved (3471 records). [2025-10-07T17:20:47.238772] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-07T17:20:47.238861] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASBA took 37.9s. Estimated remaining: 4h 54m 8s. Rate: 7.5 symbols/min [2025-10-07T17:20:47.405546] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:20:47.442738] [DEBUG] [LOCAL ] ASGN: Loaded 36354 existing records from primary storage. [2025-10-07T17:20:47.443044] [INFO ] [MAIN ] ASGN: Loaded 36354 existing records. [2025-10-07T17:20:47.619394] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:20:47.619636] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-07T17:20:47.619731] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-07T17:20:47.620178] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-07T17:20:47.620238] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-07T17:20:47.852816] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-07T17:20:47.981200] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:20:48.085792] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T17:20:48.647684] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-07T17:20:49.030627] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T17:20:49.033300] [INFO ] [REMOTE ] ASC: Full fetch complete (56498 records). [2025-10-07T17:20:49.033394] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-07T17:20:49.433175] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-07T17:20:49.433353] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-07T17:20:49.434185] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-07T17:20:49.434252] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-07T17:20:49.435531] [DEBUG] [LOCAL ] ASC: Trimmed 56498 records to 37428 (keeping 200 days of data) [2025-10-07T17:20:49.488235] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-07T17:20:49.661775] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T17:20:49.692134] [DEBUG] [LOCAL ] ASC: Primary data saved (37428 records). [2025-10-07T17:20:49.692297] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-07T17:20:49.693366] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 37.0s. Estimated remaining: 4h 52m 43s. Rate: 7.6 symbols/min [2025-10-07T17:20:50.247684] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-07T17:20:50.572158] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T17:20:51.047626] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-07T17:20:51.365016] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T17:20:51.847744] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-07T17:20:51.927106] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T17:20:52.647693] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-07T17:20:52.911229] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T17:20:53.326314] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T17:20:53.327934] [INFO ] [REMOTE ] ASG: Full fetch complete (31110 records). [2025-10-07T17:20:53.328051] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-07T17:20:53.452802] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-07T17:20:53.759248] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-07T17:20:53.759336] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-07T17:20:53.759757] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-07T17:20:53.759820] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-07T17:20:53.761290] [DEBUG] [LOCAL ] ASG: Trimmed 31110 records to 19702 (keeping 200 days of data) [2025-10-07T17:20:53.877185] [DEBUG] [LOCAL ] ASG: Primary data saved (19702 records). [2025-10-07T17:20:53.877350] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-07T17:20:53.877436] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 29.5s. Estimated remaining: 4h 51m 42s. Rate: 7.6 symbols/min [2025-10-07T17:20:54.247689] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-07T17:20:54.799026] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T17:20:55.047765] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-07T17:20:55.685296] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T17:20:55.847764] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-07T17:20:55.953433] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T17:20:56.647678] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-07T17:20:57.329043] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T17:20:57.447616] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-07T17:20:57.662177] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T17:20:57.664380] [INFO ] [REMOTE ] ASGI: Full fetch complete (33472 records). [2025-10-07T17:20:57.664472] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-07T17:20:58.039531] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-07T17:20:58.039732] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-07T17:20:58.040194] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-07T17:20:58.040239] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-07T17:20:58.041036] [DEBUG] [LOCAL ] ASGI: Trimmed 33472 records to 22719 (keeping 200 days of data) [2025-10-07T17:20:58.179624] [DEBUG] [LOCAL ] ASGI: Primary data saved (22719 records). [2025-10-07T17:20:58.179783] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-07T17:20:58.179866] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 29.5s. Estimated remaining: 4h 50m 44s. Rate: 7.6 symbols/min [2025-10-07T17:20:58.679375] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T17:20:58.688070] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-07T17:21:00.076318] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T17:21:00.083585] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-07T17:21:01.440128] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T17:21:01.447446] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-07T17:21:02.746749] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T17:21:02.755207] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-07T17:21:03.814475] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T17:21:03.828349] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-07T17:21:05.231976] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T17:21:05.241014] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-07T17:21:06.548155] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T17:21:06.551284] [INFO ] [REMOTE ] ASGN: Full fetch complete (52582 records). [2025-10-07T17:21:06.551401] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-07T17:21:06.934960] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-07T17:21:06.935073] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-07T17:21:06.935680] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-07T17:21:06.935745] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-07T17:21:06.937061] [DEBUG] [LOCAL ] ASGN: Trimmed 52582 records to 36349 (keeping 200 days of data) [2025-10-07T17:21:07.155113] [DEBUG] [LOCAL ] ASGN: Primary data saved (36349 records). [2025-10-07T17:21:07.155273] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-07T17:21:07.155362] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 19.9s. Estimated remaining: 4h 50m 51s. Rate: 7.6 symbols/min [2025-10-07T17:21:07.824403] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:21:07.870022] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:21:07.901229] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:21:07.965489] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:21:07.983682] [DEBUG] [LOCAL ] ASR: Loaded 9308 existing records from primary storage. [2025-10-07T17:21:07.984012] [INFO ] [MAIN ] ASR: Loaded 9308 existing records. [2025-10-07T17:21:08.030415] [DEBUG] [LOCAL ] ASIX: Loaded 22788 existing records from primary storage. [2025-10-07T17:21:08.074429] [INFO ] [MAIN ] ASIX: Loaded 22788 existing records. [2025-10-07T17:21:08.293664] [DEBUG] [LOCAL ] ASH: Loaded 37623 existing records from primary storage. [2025-10-07T17:21:08.281203] [DEBUG] [LOCAL ] ASPN: Loaded 49662 existing records from primary storage. [2025-10-07T17:21:08.322730] [INFO ] [MAIN ] ASH: Loaded 37623 existing records. [2025-10-07T17:21:08.342591] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:21:08.347908] [INFO ] [MAIN ] ASPN: Loaded 49662 existing records. [2025-10-07T17:21:08.436243] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-07T17:21:08.441515] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-07T17:21:08.498871] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-07T17:21:08.522567] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-07T17:21:08.723358] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:21:08.763809] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-07T17:21:08.839288] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-07T17:21:08.885830] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:21:08.886112] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-07T17:21:08.886448] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-07T17:21:08.907333] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-07T17:21:08.937863] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-07T17:21:08.958225] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-07T17:21:09.029394] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-07T17:21:09.195018] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:21:09.301504] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-07T17:21:09.338732] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-07T17:21:09.353402] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-07T17:21:09.379756] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-07T17:21:09.682258] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:21:09.758333] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-07T17:21:10.126249] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:21:10.173465] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-07T17:21:10.295521] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:21:10.306428] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-07T17:21:10.375080] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:21:10.375382] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-07T17:21:10.723944] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T17:21:10.726137] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-07T17:21:11.198251] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T17:21:11.201788] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-07T17:21:11.392573] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-07T17:21:11.394580] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-07T17:21:11.572315] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T17:21:11.579039] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-07T17:21:12.065668] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T17:21:12.068183] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-07T17:21:12.257560] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T17:21:12.267758] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-07T17:21:12.542519] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T17:21:12.546831] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-07T17:21:12.704240] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T17:21:12.712116] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-07T17:21:12.765433] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T17:21:12.767631] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-07T17:21:13.053448] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-07T17:21:13.335480] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T17:21:13.447690] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-07T17:21:14.011238] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T17:21:14.119200] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T17:21:14.247631] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-07T17:21:14.420473] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T17:21:15.047706] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-07T17:21:15.589894] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T17:21:15.847690] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-07T17:21:15.924020] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-07T17:21:16.647727] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-07T17:21:17.022209] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T17:21:17.447769] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-07T17:21:18.214036] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T17:21:18.247601] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-07T17:21:18.365232] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T17:21:18.945176] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-07T17:21:19.047740] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-07T17:21:19.847772] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-07T17:21:19.950002] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T17:21:20.641759] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T17:21:20.647587] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-07T17:21:21.324390] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-07T17:21:21.447626] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-07T17:21:22.247708] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-07T17:21:22.354071] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T17:21:23.047703] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-07T17:21:23.231326] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T17:21:23.847689] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-07T17:21:24.626008] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T17:21:24.628544] [INFO ] [REMOTE ] ASR: Full fetch complete (12450 records). [2025-10-07T17:21:24.628679] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-07T17:21:24.652861] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-07T17:21:24.810209] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-07T17:21:25.044505] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-07T17:21:25.044602] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-07T17:21:25.044919] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-07T17:21:25.044981] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-07T17:21:25.045468] [DEBUG] [LOCAL ] ASR: Trimmed 12450 records to 9354 (keeping 200 days of data) [2025-10-07T17:21:25.107942] [DEBUG] [LOCAL ] ASR: Primary data saved (9354 records). [2025-10-07T17:21:25.108102] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-07T17:21:25.108204] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 18.0s. Estimated remaining: 4h 53m 1s. Rate: 7.5 symbols/min [2025-10-07T17:21:25.284242] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:21:25.339321] [DEBUG] [LOCAL ] ASX: Loaded 52844 existing records from primary storage. [2025-10-07T17:21:25.339700] [INFO ] [MAIN ] ASX: Loaded 52844 existing records. [2025-10-07T17:21:25.452738] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-07T17:21:25.528448] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:21:25.528726] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-07T17:21:25.528797] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-07T17:21:25.529038] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-07T17:21:25.529095] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-07T17:21:25.886516] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:21:25.904732] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T17:21:26.247715] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-07T17:21:27.047630] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-07T17:21:27.313873] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T17:21:27.394007] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T17:21:27.847678] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-07T17:21:28.209442] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T17:21:28.647689] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-07T17:21:29.447723] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-07T17:21:29.503269] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T17:21:29.736024] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T17:21:30.247691] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-07T17:21:31.047686] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-07T17:21:31.244620] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T17:21:31.529323] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T17:21:31.847635] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-07T17:21:31.921251] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T17:21:31.923391] [INFO ] [REMOTE ] ASIX: Full fetch complete (30487 records). [2025-10-07T17:21:31.923471] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-07T17:21:32.295254] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-07T17:21:32.295348] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-07T17:21:32.295787] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-07T17:21:32.295852] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-07T17:21:32.296786] [DEBUG] [LOCAL ] ASIX: Trimmed 30487 records to 22844 (keeping 200 days of data) [2025-10-07T17:21:32.436912] [DEBUG] [LOCAL ] ASIX: Primary data saved (22844 records). [2025-10-07T17:21:32.437047] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-07T17:21:32.437130] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 25.3s. Estimated remaining: 4h 52m 45s. Rate: 7.5 symbols/min [2025-10-07T17:21:32.609006] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:21:32.652533] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-07T17:21:32.654123] [DEBUG] [LOCAL ] ATEN: Loaded 39011 existing records from primary storage. [2025-10-07T17:21:32.654386] [INFO ] [MAIN ] ATEN: Loaded 39011 existing records. [2025-10-07T17:21:32.832454] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:21:32.832698] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-07T17:21:32.832757] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-07T17:21:32.833928] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-07T17:21:32.833989] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-07T17:21:33.205512] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:21:33.447713] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-07T17:21:33.504414] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T17:21:34.247705] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-07T17:21:34.531049] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T17:21:34.925341] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T17:21:35.047725] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-07T17:21:35.636275] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T17:21:35.847706] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-07T17:21:36.465988] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T17:21:36.647691] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-07T17:21:37.447761] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-07T17:21:37.648835] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T17:21:38.095086] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T17:21:38.247698] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-07T17:21:38.977546] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T17:21:39.047716] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-07T17:21:39.847745] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-07T17:21:40.108084] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T17:21:40.371977] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T17:21:40.375530] [INFO ] [REMOTE ] ASH: Full fetch complete (55218 records). [2025-10-07T17:21:40.375851] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-07T17:21:40.654235] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-07T17:21:40.772217] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-07T17:21:40.772298] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-07T17:21:40.772946] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-07T17:21:40.773010] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-07T17:21:40.774096] [DEBUG] [LOCAL ] ASH: Trimmed 55218 records to 37636 (keeping 200 days of data) [2025-10-07T17:21:41.001567] [DEBUG] [LOCAL ] ASH: Primary data saved (37636 records). [2025-10-07T17:21:41.001742] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-07T17:21:41.001833] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASH took 33.8s. Estimated remaining: 4h 52m 45s. Rate: 7.5 symbols/min [2025-10-07T17:21:41.172496] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:21:41.207895] [DEBUG] [LOCAL ] ATGE: Loaded 31195 existing records from primary storage. [2025-10-07T17:21:41.208179] [INFO ] [MAIN ] ATGE: Loaded 31195 existing records. [2025-10-07T17:21:41.387138] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:21:41.387483] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-07T17:21:41.387627] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-07T17:21:41.388086] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-07T17:21:41.388253] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-07T17:21:41.450688] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-07T17:21:41.786941] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T17:21:41.790888] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:21:42.247622] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-07T17:21:42.404111] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T17:21:42.860286] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T17:21:43.047730] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-07T17:21:43.847634] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-07T17:21:43.925349] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T17:21:44.373483] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T17:21:44.377327] [INFO ] [REMOTE ] ASPN: Full fetch complete (72387 records). [2025-10-07T17:21:44.377464] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-07T17:21:44.652770] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-07T17:21:44.793803] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-07T17:21:44.793898] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-07T17:21:44.794714] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-07T17:21:44.794782] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-07T17:21:44.796322] [DEBUG] [LOCAL ] ASPN: Trimmed 72387 records to 49688 (keeping 200 days of data) [2025-10-07T17:21:45.084068] [DEBUG] [LOCAL ] ASPN: Primary data saved (49688 records). [2025-10-07T17:21:45.084229] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-07T17:21:45.084322] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 37.9s. Estimated remaining: 4h 51m 45s. Rate: 7.6 symbols/min [2025-10-07T17:21:45.284459] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:21:45.287329] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T17:21:45.328259] [DEBUG] [LOCAL ] ATHM: Loaded 31969 existing records from primary storage. [2025-10-07T17:21:45.328612] [INFO ] [MAIN ] ATHM: Loaded 31969 existing records. [2025-10-07T17:21:45.452813] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-07T17:21:45.515106] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:21:45.515338] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-07T17:21:45.515387] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-07T17:21:45.515623] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-07T17:21:45.515717] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-07T17:21:45.868972] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:21:46.247669] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-07T17:21:46.321717] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T17:21:46.705123] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T17:21:47.047695] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-07T17:21:47.847904] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-07T17:21:47.904857] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T17:21:48.134296] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T17:21:48.647753] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-07T17:21:48.887053] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T17:21:49.447708] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-07T17:21:50.130011] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T17:21:50.247612] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-07T17:21:50.859926] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T17:21:51.047718] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-07T17:21:51.651199] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T17:21:51.847676] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-07T17:21:52.606131] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T17:21:52.647630] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-07T17:21:53.289148] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T17:21:53.447694] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-07T17:21:54.247779] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-07T17:21:54.321936] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T17:21:55.047680] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-07T17:21:55.114003] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T17:21:55.481052] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T17:21:55.847703] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-07T17:21:56.647671] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-07T17:21:56.743060] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T17:21:57.107039] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T17:21:57.447721] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-07T17:21:57.921170] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T17:21:58.247619] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-07T17:21:58.707020] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T17:21:59.047715] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-07T17:21:59.847668] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-07T17:22:00.027803] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T17:22:00.508427] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T17:22:00.647730] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-07T17:22:01.121529] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-07T17:22:01.447716] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-07T17:22:01.567609] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T17:22:02.247709] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-07T17:22:02.623826] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T17:22:03.047753] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-07T17:22:03.311076] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T17:22:03.847736] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-07T17:22:04.647690] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-07T17:22:04.680303] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T17:22:05.447617] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-07T17:22:05.495540] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T17:22:05.772916] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T17:22:06.247714] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-07T17:22:06.825698] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T17:22:07.047628] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-07T17:22:07.478064] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T17:22:07.847707] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-07T17:22:08.642705] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T17:22:08.650481] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-07T17:22:09.447711] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-07T17:22:09.494844] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-07T17:22:09.498989] [INFO ] [REMOTE ] ASX: Full fetch complete (76206 records). [2025-10-07T17:22:09.499161] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-07T17:22:09.500248] [FATAL] [VALIDATOR ] ASX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:22:09.500363] [FATAL] [MAIN ] ASX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:22:09.500414] [WARN ] [MAIN ] ASX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:22:09.500490] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-07T17:22:09.500569] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-10-07T17:22:09.500612] [INFO ] [LOCAL ] ASX: Starting deletion of derivative data. [2025-10-07T17:22:09.501003] [DEBUG] [LOCAL ] ASX: Deleted derivative data file. [2025-10-07T17:22:09.501148] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 44.4s. Estimated remaining: 4h 55m 18s. Rate: 7.5 symbols/min [2025-10-07T17:22:09.686954] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:22:09.696610] [DEBUG] [LOCAL ] ATHS: Loaded 6841 existing records from primary storage. [2025-10-07T17:22:09.696884] [INFO ] [MAIN ] ATHS: Loaded 6841 existing records. [2025-10-07T17:22:09.875625] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:22:09.894061] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-07T17:22:09.894838] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-07T17:22:09.895541] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T17:22:09.903054] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-07T17:22:09.903757] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-07T17:22:10.256610] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-07T17:22:10.262525] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:22:10.574150] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T17:22:11.047779] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-07T17:22:11.239691] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T17:22:11.242141] [INFO ] [REMOTE ] ATEN: Full fetch complete (57120 records). [2025-10-07T17:22:11.242221] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-07T17:22:11.618276] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-07T17:22:11.618377] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-07T17:22:11.619038] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-07T17:22:11.619101] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-07T17:22:11.620228] [DEBUG] [LOCAL ] ATEN: Trimmed 57120 records to 38904 (keeping 200 days of data) [2025-10-07T17:22:11.841424] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T17:22:11.847739] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-07T17:22:11.878210] [DEBUG] [LOCAL ] ATEN: Primary data saved (38904 records). [2025-10-07T17:22:11.878320] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-07T17:22:11.878420] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATEN took 39.4s. Estimated remaining: 4h 53m 55s. Rate: 7.5 symbols/min [2025-10-07T17:22:12.043700] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:22:12.098466] [DEBUG] [LOCAL ] ATI: Loaded 51479 existing records from primary storage. [2025-10-07T17:22:12.098828] [INFO ] [MAIN ] ATI: Loaded 51479 existing records. [2025-10-07T17:22:12.276816] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:22:12.282116] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T17:22:12.282197] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-07T17:22:12.284377] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-07T17:22:12.285032] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-07T17:22:12.285091] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-07T17:22:12.630148] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:22:12.647676] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-07T17:22:13.210428] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T17:22:13.447698] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-07T17:22:14.247737] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-07T17:22:14.423322] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T17:22:14.426159] [INFO ] [REMOTE ] ATHM: Full fetch complete (50821 records). [2025-10-07T17:22:14.426308] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-07T17:22:14.841138] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-07T17:22:14.841228] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-07T17:22:14.841848] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-07T17:22:14.841917] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-07T17:22:14.843083] [DEBUG] [LOCAL ] ATHM: Trimmed 50821 records to 31991 (keeping 200 days of data) [2025-10-07T17:22:15.035858] [DEBUG] [LOCAL ] ATHM: Primary data saved (31991 records). [2025-10-07T17:22:15.036016] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-07T17:22:15.036118] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATHM took 30.0s. Estimated remaining: 4h 52m 43s. Rate: 7.5 symbols/min [2025-10-07T17:22:15.057251] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-07T17:22:15.210709] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:22:15.248315] [DEBUG] [LOCAL ] ATKR: Loaded 35582 existing records from primary storage. [2025-10-07T17:22:15.248692] [INFO ] [MAIN ] ATKR: Loaded 35582 existing records. [2025-10-07T17:22:15.448425] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:22:15.448915] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-07T17:22:15.448969] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-07T17:22:15.450053] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-07T17:22:15.450119] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-07T17:22:15.763186] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-07T17:22:15.868314] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:22:15.862026] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-07T17:22:15.975244] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T17:22:16.647749] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-07T17:22:16.761347] [DEBUG] [REMOTE ] ATI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-07T17:22:16.761695] [WARN ] [REMOTE ] ATI: No data returned for month 2025-01 [2025-10-07T17:22:16.761787] [FATAL] [REMOTE ] ATI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:22:16.761869] [FATAL] [MAIN ] ATI: Failed to fetch primary data. [2025-10-07T17:22:16.761931] [WARN ] [MAIN ] ATI: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:22:16.762006] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-07T17:22:16.762091] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-07T17:22:16.762150] [INFO ] [LOCAL ] ATI: Starting deletion of derivative data. [2025-10-07T17:22:16.762414] [DEBUG] [LOCAL ] ATI: Deleted derivative data file. [2025-10-07T17:22:16.763631] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATI took 4.9s. Estimated remaining: 4h 51m 13s. Rate: 7.6 symbols/min [2025-10-07T17:22:16.934274] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:22:16.982175] [DEBUG] [LOCAL ] ATMU: Loaded 39252 existing records from primary storage. [2025-10-07T17:22:16.982706] [INFO ] [MAIN ] ATMU: Loaded 39252 existing records. [2025-10-07T17:22:17.187046] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:22:17.188911] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T17:22:17.189016] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-07T17:22:17.194464] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-07T17:22:17.195453] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-07T17:22:17.195513] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-07T17:22:17.452844] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-07T17:22:17.582609] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:22:18.247629] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-07T17:22:18.279022] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T17:22:19.047721] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-07T17:22:19.857797] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-07T17:22:19.861078] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T17:22:20.521444] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T17:22:20.647719] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-07T17:22:20.767247] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T17:22:21.447732] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-07T17:22:22.065724] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T17:22:22.247721] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-07T17:22:22.260994] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T17:22:23.047735] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-07T17:22:23.311211] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T17:22:23.313198] [INFO ] [REMOTE ] ATGE: Full fetch complete (46240 records). [2025-10-07T17:22:23.313284] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-07T17:22:23.696077] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-07T17:22:23.696161] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-07T17:22:23.696909] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-07T17:22:23.696991] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-07T17:22:23.698159] [DEBUG] [LOCAL ] ATGE: Trimmed 46240 records to 31178 (keeping 200 days of data) [2025-10-07T17:22:23.794418] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T17:22:23.858207] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-07T17:22:23.899531] [DEBUG] [LOCAL ] ATGE: Primary data saved (31178 records). [2025-10-07T17:22:23.899697] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-07T17:22:23.900798] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATGE took 42.9s. Estimated remaining: 4h 50m 55s. Rate: 7.6 symbols/min [2025-10-07T17:22:24.074143] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:22:24.119612] [DEBUG] [LOCAL ] ATO: Loaded 41911 existing records from primary storage. [2025-10-07T17:22:24.120232] [INFO ] [MAIN ] ATO: Loaded 41911 existing records. [2025-10-07T17:22:24.306263] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:22:24.306521] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-07T17:22:24.306578] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-07T17:22:24.306854] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-07T17:22:24.306913] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-07T17:22:24.652928] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-07T17:22:24.685259] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:22:25.327082] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-07T17:22:25.362141] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T17:22:25.447777] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-07T17:22:26.103950] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-07T17:22:26.247730] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-07T17:22:26.702822] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T17:22:26.703691] [INFO ] [REMOTE ] ATHS: Full fetch complete (9810 records). [2025-10-07T17:22:26.703765] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-07T17:22:27.057037] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-07T17:22:27.050686] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-07T17:22:27.057970] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-07T17:22:27.058216] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-07T17:22:27.058259] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-07T17:22:27.058757] [DEBUG] [LOCAL ] ATHS: Trimmed 9810 records to 6795 (keeping 200 days of data) [2025-10-07T17:22:27.100704] [DEBUG] [LOCAL ] ATHS: Primary data saved (6795 records). [2025-10-07T17:22:27.100822] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-07T17:22:27.100918] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATHS took 17.6s. Estimated remaining: 4h 49m 46s. Rate: 7.6 symbols/min [2025-10-07T17:22:27.275516] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:22:27.312037] [DEBUG] [LOCAL ] ATR: Loaded 30579 existing records from primary storage. [2025-10-07T17:22:27.312349] [INFO ] [MAIN ] ATR: Loaded 30579 existing records. [2025-10-07T17:22:27.494961] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:22:27.495355] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-07T17:22:27.495418] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-07T17:22:27.495763] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-07T17:22:27.495822] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-07T17:22:27.856003] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:22:27.856154] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-07T17:22:28.653279] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-07T17:22:28.660701] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T17:22:28.739173] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T17:22:29.447734] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-07T17:22:30.185469] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T17:22:30.247679] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-07T17:22:31.015546] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T17:22:31.047676] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-07T17:22:31.780063] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T17:22:31.847704] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-07T17:22:31.979523] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-07T17:22:32.647746] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-07T17:22:33.164820] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T17:22:33.447761] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-07T17:22:34.031554] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T17:22:34.247706] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-07T17:22:34.519835] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T17:22:35.047763] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-07T17:22:35.443470] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T17:22:35.847739] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-07T17:22:36.647711] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-07T17:22:36.822399] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T17:22:37.106217] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T17:22:37.447733] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-07T17:22:37.712843] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T17:22:38.247759] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-07T17:22:38.928796] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T17:22:39.047693] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-07T17:22:39.405573] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T17:22:39.847731] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-07T17:22:39.960534] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T17:22:40.647724] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-07T17:22:41.227190] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T17:22:41.447672] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-07T17:22:41.581175] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T17:22:42.247704] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-07T17:22:42.885475] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T17:22:43.047732] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-07T17:22:43.555507] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T17:22:43.847722] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-07T17:22:44.512835] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:22:44.647720] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-07T17:22:45.447688] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-07T17:22:45.516469] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T17:22:46.068191] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-07T17:22:46.247708] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-07T17:22:46.703213] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T17:22:47.047680] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-07T17:22:47.530403] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T17:22:47.847677] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-07T17:22:48.387724] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T17:22:48.647701] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-07T17:22:49.207755] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T17:22:49.447675] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-07T17:22:49.743032] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T17:22:50.247680] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-07T17:22:50.631633] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T17:22:51.047678] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-07T17:22:51.641099] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T17:22:51.847683] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-07T17:22:52.177346] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T17:22:52.647762] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-07T17:22:53.447769] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-07T17:22:54.247754] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-07T17:23:05.303558] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (11.86 seconds). [2025-10-07T17:23:05.314785] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-07T17:23:05.524599] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (13.68 seconds). [2025-10-07T17:23:05.533110] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-07T17:23:05.669725] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (13.02 seconds). [2025-10-07T17:23:05.672238] [INFO ] [REMOTE ] ATMU: Full fetch complete (56482 records). [2025-10-07T17:23:05.672365] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-07T17:23:05.673195] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:23:05.673292] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:23:05.673337] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:23:05.673379] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-07T17:23:05.673456] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-07T17:23:05.673514] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-10-07T17:23:05.673957] [DEBUG] [LOCAL ] ATMU: Deleted derivative data file. [2025-10-07T17:23:05.674066] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATMU took 48.9s. Estimated remaining: 4h 56m 12s. Rate: 7.4 symbols/min [2025-10-07T17:23:05.857548] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:05.876917] [DEBUG] [LOCAL ] ATS: Loaded 17765 existing records from primary storage. [2025-10-07T17:23:05.877236] [INFO ] [MAIN ] ATS: Loaded 17765 existing records. [2025-10-07T17:23:06.063997] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:23:06.064350] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-07T17:23:06.064416] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-07T17:23:06.064813] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-07T17:23:06.064870] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-07T17:23:06.414705] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (12.17 seconds). [2025-10-07T17:23:06.445259] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:06.452376] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-07T17:23:06.453873] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-07T17:23:06.539389] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T17:23:06.548119] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-07T17:23:07.482861] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T17:23:07.485140] [INFO ] [REMOTE ] ATR: Full fetch complete (43741 records). [2025-10-07T17:23:07.485248] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-07T17:23:07.605964] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T17:23:07.619406] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-07T17:23:07.821995] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T17:23:07.885631] [INFO ] [REMOTE ] ATKR: Full fetch complete (53633 records). [2025-10-07T17:23:07.886824] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-07T17:23:07.966039] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-07T17:23:07.997609] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-07T17:23:08.048371] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-07T17:23:08.048715] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-07T17:23:08.050575] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-07T17:23:08.139520] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-07T17:23:08.135521] [DEBUG] [LOCAL ] ATR: Trimmed 43741 records to 30585 (keeping 200 days of data) [2025-10-07T17:23:08.448233] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-07T17:23:08.448354] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-07T17:23:08.449273] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-07T17:23:08.449677] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-07T17:23:08.455517] [DEBUG] [LOCAL ] ATKR: Trimmed 53633 records to 35515 (keeping 200 days of data) [2025-10-07T17:23:08.582919] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T17:23:08.589001] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-07T17:23:08.681933] [DEBUG] [LOCAL ] ATR: Primary data saved (30585 records). [2025-10-07T17:23:08.682842] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-07T17:23:08.683202] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATR took 41.6s. Estimated remaining: 4h 54m 59s. Rate: 7.5 symbols/min [2025-10-07T17:23:08.866187] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:08.980265] [DEBUG] [LOCAL ] ATKR: Primary data saved (35515 records). [2025-10-07T17:23:08.980423] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-07T17:23:08.981108] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATKR took 53.9s. Estimated remaining: 4h 53m 13s. Rate: 7.5 symbols/min [2025-10-07T17:23:09.099864] [DEBUG] [LOCAL ] ATUS: Loaded 49415 existing records from primary storage. [2025-10-07T17:23:09.116399] [INFO ] [MAIN ] ATUS: Loaded 49415 existing records. [2025-10-07T17:23:09.198468] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:09.372327] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:23:09.372690] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-07T17:23:09.372752] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-07T17:23:09.373149] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-07T17:23:09.373206] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-07T17:23:09.517094] [DEBUG] [LOCAL ] AU: Loaded 52996 existing records from primary storage. [2025-10-07T17:23:09.581944] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T17:23:09.600750] [INFO ] [MAIN ] AU: Loaded 52996 existing records. [2025-10-07T17:23:09.607416] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-07T17:23:09.799105] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T17:23:09.829441] [INFO ] [REMOTE ] ATO: Full fetch complete (60273 records). [2025-10-07T17:23:09.840053] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-07T17:23:09.863482] [FATAL] [VALIDATOR ] ATO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:23:09.901001] [FATAL] [MAIN ] ATO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:23:09.937875] [WARN ] [MAIN ] ATO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:23:09.956089] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:09.994066] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:23:09.961495] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-07T17:23:09.994749] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-07T17:23:09.994565] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-07T17:23:09.995608] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-07T17:23:09.994672] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-07T17:23:09.995772] [INFO ] [LOCAL ] ATO: Starting deletion of derivative data. [2025-10-07T17:23:09.996013] [DEBUG] [LOCAL ] ATO: Deleted derivative data file. [2025-10-07T17:23:09.996826] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-07T17:23:09.996761] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATO took 46.1s. Estimated remaining: 4h 51m 37s. Rate: 7.5 symbols/min [2025-10-07T17:23:09.997195] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-07T17:23:10.345233] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:10.531021] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:10.531417] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-07T17:23:10.562474] [DEBUG] [LOCAL ] AUB: Loaded 46259 existing records from primary storage. [2025-10-07T17:23:10.562812] [INFO ] [MAIN ] AUB: Loaded 46259 existing records. [2025-10-07T17:23:10.751076] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:23:10.756906] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-07T17:23:10.757448] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-07T17:23:10.757926] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T17:23:10.762142] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-07T17:23:10.762744] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-07T17:23:10.763066] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-07T17:23:11.118498] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:11.118854] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-07T17:23:11.502037] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T17:23:11.511758] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-07T17:23:11.942598] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T17:23:11.949345] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-07T17:23:12.398314] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T17:23:12.409435] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-07T17:23:12.735624] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T17:23:12.744216] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-07T17:23:12.887554] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T17:23:12.909156] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T17:23:12.908276] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-07T17:23:12.914470] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-07T17:23:13.564506] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-07T17:23:13.568975] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-07T17:23:13.836743] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T17:23:13.847553] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-07T17:23:14.326857] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T17:23:14.335623] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-07T17:23:14.422437] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T17:23:14.432714] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-07T17:23:14.602135] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T17:23:14.609831] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-07T17:23:15.227357] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T17:23:15.237430] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-07T17:23:15.569288] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T17:23:15.576338] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-07T17:23:15.718702] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T17:23:15.847604] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-07T17:23:16.032680] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T17:23:16.482269] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T17:23:16.647731] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-07T17:23:16.805014] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T17:23:17.179794] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T17:23:17.426337] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T17:23:17.427941] [INFO ] [REMOTE ] ATS: Full fetch complete (25669 records). [2025-10-07T17:23:17.428016] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-07T17:23:17.458060] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-07T17:23:17.827287] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-07T17:23:17.827382] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-07T17:23:17.827763] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-07T17:23:17.827828] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-07T17:23:17.828756] [DEBUG] [LOCAL ] ATS: Trimmed 25669 records to 17751 (keeping 200 days of data) [2025-10-07T17:23:17.931501] [DEBUG] [LOCAL ] ATS: Primary data saved (17751 records). [2025-10-07T17:23:17.931677] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-07T17:23:17.931786] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATS took 12.3s. Estimated remaining: 4h 51m 28s. Rate: 7.5 symbols/min [2025-10-07T17:23:18.144231] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:18.153165] [DEBUG] [LOCAL ] AUNA: Loaded 4983 existing records from primary storage. [2025-10-07T17:23:18.153410] [INFO ] [MAIN ] AUNA: Loaded 4983 existing records. [2025-10-07T17:23:18.252880] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-07T17:23:18.381281] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:23:18.381575] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-07T17:23:18.381631] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-07T17:23:18.381956] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-07T17:23:18.382024] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-07T17:23:18.766329] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:19.047752] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-07T17:23:19.690789] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-07T17:23:19.836693] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T17:23:19.847630] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-07T17:23:20.617836] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T17:23:20.647632] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-07T17:23:21.447741] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-07T17:23:21.676436] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T17:23:21.910067] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-07T17:23:22.247750] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-07T17:23:22.404481] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T17:23:23.047685] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-07T17:23:23.855435] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-07T17:23:23.878460] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T17:23:24.363859] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T17:23:24.598131] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T17:23:24.647693] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-07T17:23:25.447739] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-07T17:23:25.890947] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T17:23:26.247702] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-07T17:23:27.047715] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-07T17:23:27.447294] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T17:23:27.513309] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-07T17:23:27.853154] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-07T17:23:27.878359] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T17:23:28.647694] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-07T17:23:29.447750] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-07T17:23:29.509361] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T17:23:29.951167] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T17:23:30.247680] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-07T17:23:30.831826] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T17:23:31.047626] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-07T17:23:31.550826] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-07T17:23:31.847710] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-07T17:23:32.386714] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-07T17:23:32.602099] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T17:23:32.647620] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-07T17:23:33.447746] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-07T17:23:34.126158] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T17:23:34.129341] [INFO ] [REMOTE ] AUB: Full fetch complete (65806 records). [2025-10-07T17:23:34.129443] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-07T17:23:34.252731] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-07T17:23:34.532752] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-07T17:23:34.532842] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-07T17:23:34.533514] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-07T17:23:34.533556] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-07T17:23:34.534862] [DEBUG] [LOCAL ] AUB: Trimmed 65806 records to 46248 (keeping 200 days of data) [2025-10-07T17:23:34.824586] [DEBUG] [LOCAL ] AUB: Primary data saved (46248 records). [2025-10-07T17:23:34.824749] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-07T17:23:34.825513] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. AUB took 24.8s. Estimated remaining: 4h 53m 12s. Rate: 7.5 symbols/min [2025-10-07T17:23:35.011419] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:35.055496] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-07T17:23:35.058719] [DEBUG] [LOCAL ] AVA: Loaded 39355 existing records from primary storage. [2025-10-07T17:23:35.059105] [INFO ] [MAIN ] AVA: Loaded 39355 existing records. [2025-10-07T17:23:35.255432] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:23:35.256013] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-07T17:23:35.256071] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-07T17:23:35.268753] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-07T17:23:35.286405] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-07T17:23:35.368664] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T17:23:35.670697] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T17:23:35.676085] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:35.847607] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-07T17:23:36.108952] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T17:23:36.647709] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-07T17:23:37.287851] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T17:23:37.447735] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-07T17:23:38.047834] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T17:23:38.247688] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-07T17:23:38.368027] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T17:23:39.047701] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-07T17:23:39.575848] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T17:23:39.847758] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-07T17:23:40.647710] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-07T17:23:41.213371] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-07T17:23:41.272536] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T17:23:41.447679] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-07T17:23:42.061010] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T17:23:42.064845] [INFO ] [REMOTE ] ATUS: Full fetch complete (71059 records). [2025-10-07T17:23:42.064993] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-07T17:23:42.252811] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-07T17:23:42.469281] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-07T17:23:42.469370] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-07T17:23:42.470174] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-07T17:23:42.470242] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-07T17:23:42.471750] [DEBUG] [LOCAL ] ATUS: Trimmed 71059 records to 49494 (keeping 200 days of data) [2025-10-07T17:23:42.752953] [DEBUG] [LOCAL ] ATUS: Primary data saved (49494 records). [2025-10-07T17:23:42.753227] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-07T17:23:42.753333] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. ATUS took 34.1s. Estimated remaining: 4h 53m 3s. Rate: 7.5 symbols/min [2025-10-07T17:23:42.859399] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T17:23:42.958050] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:42.959537] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T17:23:42.968255] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-10-07T17:23:42.968943] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-10-07T17:23:42.969378] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-07T17:23:42.969431] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-07T17:23:42.969483] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-07T17:23:42.969525] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-07T17:23:43.052919] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-07T17:23:43.325945] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:43.658126] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T17:23:43.847685] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-07T17:23:44.358849] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-07T17:23:44.647694] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-07T17:23:45.115801] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-07T17:23:45.447701] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-07T17:23:46.247623] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-07T17:23:46.300106] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T17:23:47.047688] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-07T17:23:47.847725] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-07T17:23:48.095366] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-07T17:23:48.099016] [INFO ] [REMOTE ] AU: Full fetch complete (76295 records). [2025-10-07T17:23:48.099143] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-07T17:23:48.541329] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-07T17:23:48.541478] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-07T17:23:48.542327] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-07T17:23:48.542414] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-07T17:23:48.544416] [DEBUG] [LOCAL ] AU: Trimmed 76295 records to 52994 (keeping 200 days of data) [2025-10-07T17:23:48.566951] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T17:23:48.571114] [INFO ] [REMOTE ] AUNA: Full fetch complete (7821 records). [2025-10-07T17:23:48.624501] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-07T17:23:48.633248] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T17:23:48.653459] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-07T17:23:49.062087] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-07T17:23:49.062714] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-07T17:23:49.063457] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-07T17:23:49.064032] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-07T17:23:49.066429] [DEBUG] [LOCAL ] AUNA: Trimmed 7821 records to 5054 (keeping 200 days of data) [2025-10-07T17:23:49.098193] [DEBUG] [LOCAL ] AUNA: Primary data saved (5054 records). [2025-10-07T17:23:49.098826] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-07T17:23:49.099152] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AUNA took 31.2s. Estimated remaining: 4h 52m 34s. Rate: 7.5 symbols/min [2025-10-07T17:23:49.373753] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:49.450408] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-07T17:23:49.499176] [DEBUG] [LOCAL ] AVB: Loaded 42045 existing records from primary storage. [2025-10-07T17:23:49.500239] [INFO ] [MAIN ] AVB: Loaded 42045 existing records. [2025-10-07T17:23:49.615300] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T17:23:49.705036] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:23:49.706091] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-07T17:23:49.706453] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-07T17:23:49.707592] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-07T17:23:49.707691] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-07T17:23:49.812444] [DEBUG] [LOCAL ] AU: Primary data saved (52994 records). [2025-10-07T17:23:49.818235] [INFO ] [MAIN ] AU: Full history saved. [2025-10-07T17:23:49.823468] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AU took 40.8s. Estimated remaining: 4h 50m 57s. Rate: 7.5 symbols/min [2025-10-07T17:23:50.164357] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:50.174809] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-07T17:23:50.179995] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-07T17:23:50.202691] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-07T17:23:50.202757] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-07T17:23:50.215845] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-07T17:23:50.232243] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-07T17:23:50.236761] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:50.252982] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-07T17:23:50.590453] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:51.008099] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T17:23:51.047598] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-07T17:23:51.808925] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T17:23:51.847671] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-07T17:23:52.034239] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T17:23:52.647726] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-07T17:23:52.843731] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:23:52.844041] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-07T17:23:52.844128] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:23:52.844174] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-07T17:23:52.844209] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:23:52.844252] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-07T17:23:52.844325] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-07T17:23:52.844380] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-07T17:23:52.844435] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-07T17:23:52.844507] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVBC took 3.0s. Estimated remaining: 4h 49m 49s. Rate: 7.6 symbols/min [2025-10-07T17:23:53.012175] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:23:53.034055] [DEBUG] [LOCAL ] AVD: Loaded 22424 existing records from primary storage. [2025-10-07T17:23:53.034320] [INFO ] [MAIN ] AVD: Loaded 22424 existing records. [2025-10-07T17:23:53.212752] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:23:53.213121] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-07T17:23:53.213196] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-07T17:23:53.213501] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-07T17:23:53.213560] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-07T17:23:53.405829] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T17:23:53.466520] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-07T17:23:53.618493] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:23:54.247736] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-07T17:23:55.044146] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T17:23:55.052267] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-07T17:23:55.185189] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T17:23:55.847718] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-07T17:23:56.304249] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T17:23:56.647695] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-07T17:23:57.022700] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T17:23:57.447752] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-07T17:23:58.068214] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T17:23:58.247723] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-07T17:23:58.350553] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T17:23:59.047682] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-07T17:23:59.739167] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T17:23:59.847718] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-07T17:24:00.439059] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T17:24:00.647717] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-07T17:24:01.322545] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T17:24:01.447725] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-07T17:24:01.983021] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T17:24:01.985638] [INFO ] [REMOTE ] AVA: Full fetch complete (55698 records). [2025-10-07T17:24:01.985788] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-07T17:24:02.253040] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-07T17:24:02.391590] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-07T17:24:02.391739] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-07T17:24:02.392427] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-07T17:24:02.392479] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-07T17:24:02.393975] [DEBUG] [LOCAL ] AVA: Trimmed 55698 records to 39243 (keeping 200 days of data) [2025-10-07T17:24:02.655507] [DEBUG] [LOCAL ] AVA: Primary data saved (39243 records). [2025-10-07T17:24:02.655699] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-07T17:24:02.656478] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 27.8s. Estimated remaining: 4h 50m 3s. Rate: 7.6 symbols/min [2025-10-07T17:24:02.830333] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:24:02.856274] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T17:24:02.882097] [DEBUG] [LOCAL ] AVK: Loaded 18166 existing records from primary storage. [2025-10-07T17:24:02.882375] [INFO ] [MAIN ] AVK: Loaded 18166 existing records. [2025-10-07T17:24:03.058838] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-07T17:24:03.064905] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:24:03.066929] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-07T17:24:03.067066] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-07T17:24:03.067517] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-07T17:24:03.067595] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-07T17:24:03.393526] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T17:24:03.461794] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:24:03.847746] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-07T17:24:04.049743] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-07T17:24:04.647706] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-07T17:24:04.841586] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T17:24:05.447681] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-07T17:24:05.998947] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T17:24:06.247752] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-07T17:24:06.303592] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-07T17:24:07.047622] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-07T17:24:07.114163] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T17:24:07.847633] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-07T17:24:07.879247] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T17:24:08.647754] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-07T17:24:08.866968] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T17:24:09.447726] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-07T17:24:09.717620] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T17:24:10.247717] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-07T17:24:10.899877] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-07T17:24:10.931463] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T17:24:11.047688] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-07T17:24:11.847703] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-07T17:24:12.651911] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-07T17:24:12.653599] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T17:24:12.998575] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T17:24:13.266505] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T17:24:13.447636] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-07T17:24:14.247370] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T17:24:14.249509] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-07T17:24:15.047706] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-07T17:24:15.172563] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T17:24:15.667762] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-07T17:24:15.847691] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-07T17:24:16.647663] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-07T17:24:16.846614] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-07T17:24:17.447673] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-07T17:24:17.840223] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T17:24:18.247720] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-07T17:24:19.047755] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-07T17:24:19.470709] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-07T17:24:19.496147] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T17:24:19.847688] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-07T17:24:20.144917] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T17:24:20.647618] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-07T17:24:20.932140] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-07T17:24:21.365192] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T17:24:21.366350] [INFO ] [REMOTE ] AVAL: Full fetch complete (14664 records). [2025-10-07T17:24:21.366422] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-07T17:24:21.366876] [FATAL] [VALIDATOR ] AVAL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:24:21.366957] [FATAL] [MAIN ] AVAL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:24:21.366999] [WARN ] [MAIN ] AVAL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:24:21.367044] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-07T17:24:21.367100] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-07T17:24:21.367134] [INFO ] [LOCAL ] AVAL: Starting deletion of derivative data. [2025-10-07T17:24:21.367173] [DEBUG] [LOCAL ] AVAL: No derivative data file found to delete. [2025-10-07T17:24:21.367225] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVAL took 38.6s. Estimated remaining: 4h 52m 5s. Rate: 7.5 symbols/min [2025-10-07T17:24:21.452841] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-07T17:24:21.540282] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:24:21.573711] [DEBUG] [LOCAL ] AVNS: Loaded 33703 existing records from primary storage. [2025-10-07T17:24:21.573992] [INFO ] [MAIN ] AVNS: Loaded 33703 existing records. [2025-10-07T17:24:21.752005] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:24:21.752218] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-07T17:24:21.752266] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-07T17:24:21.752504] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-07T17:24:21.752562] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-07T17:24:22.108574] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:24:22.247693] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-07T17:24:22.917079] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T17:24:22.920255] [INFO ] [REMOTE ] AVB: Full fetch complete (58839 records). [2025-10-07T17:24:22.920368] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-07T17:24:23.063160] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-07T17:24:23.311777] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-07T17:24:23.311965] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-07T17:24:23.312706] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-07T17:24:23.312775] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-07T17:24:23.314192] [DEBUG] [LOCAL ] AVB: Trimmed 58839 records to 42115 (keeping 200 days of data) [2025-10-07T17:24:23.445333] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T17:24:23.608474] [DEBUG] [LOCAL ] AVB: Primary data saved (42115 records). [2025-10-07T17:24:23.608626] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-07T17:24:23.608748] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVB took 34.5s. Estimated remaining: 4h 50m 48s. Rate: 7.5 symbols/min [2025-10-07T17:24:23.815118] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:24:23.815400] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-10-07T17:24:23.815540] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-10-07T17:24:23.815770] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-07T17:24:23.815829] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-07T17:24:23.815910] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-07T17:24:23.815980] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-07T17:24:23.858416] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-07T17:24:23.979568] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-07T17:24:24.207580] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:24:24.647686] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-07T17:24:24.889715] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T17:24:24.891433] [INFO ] [REMOTE ] AVD: Full fetch complete (33421 records). [2025-10-07T17:24:24.891514] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-07T17:24:25.270085] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-07T17:24:25.270185] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-07T17:24:25.270713] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-07T17:24:25.270776] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-07T17:24:25.271515] [DEBUG] [LOCAL ] AVD: Trimmed 33421 records to 22358 (keeping 200 days of data) [2025-10-07T17:24:25.398117] [DEBUG] [LOCAL ] AVD: Primary data saved (22358 records). [2025-10-07T17:24:25.398247] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-07T17:24:25.398341] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 32.6s. Estimated remaining: 4h 49m 27s. Rate: 7.6 symbols/min [2025-10-07T17:24:25.454003] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-07T17:24:25.536787] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-07T17:24:25.591794] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:24:25.644011] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-10-07T17:24:25.644364] [INFO ] [MAIN ] AVTR: Loaded 53567 existing records. [2025-10-07T17:24:25.825241] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:24:25.825482] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-07T17:24:25.825537] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-07T17:24:25.825791] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-07T17:24:25.825850] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-07T17:24:26.195231] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:24:26.247602] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-07T17:24:26.556341] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T17:24:27.047689] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-07T17:24:27.847623] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-07T17:24:28.098922] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T17:24:28.122499] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T17:24:28.647738] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-07T17:24:29.294969] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T17:24:29.447637] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-07T17:24:29.910304] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T17:24:30.247694] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-07T17:24:30.623911] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-07T17:24:31.047677] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-07T17:24:31.852754] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-07T17:24:31.869111] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T17:24:32.046115] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T17:24:32.647626] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-07T17:24:33.034340] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T17:24:33.417783] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T17:24:33.419699] [INFO ] [REMOTE ] AVK: Full fetch complete (26777 records). [2025-10-07T17:24:33.419780] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-07T17:24:33.452709] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-07T17:24:33.792763] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-07T17:24:33.792846] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-07T17:24:33.793286] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-07T17:24:33.793347] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-07T17:24:33.794108] [DEBUG] [LOCAL ] AVK: Trimmed 26777 records to 18202 (keeping 200 days of data) [2025-10-07T17:24:33.903691] [DEBUG] [LOCAL ] AVK: Primary data saved (18202 records). [2025-10-07T17:24:33.903840] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-07T17:24:33.903925] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVK took 31.2s. Estimated remaining: 4h 49m 25s. Rate: 7.6 symbols/min [2025-10-07T17:24:34.070175] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:24:34.113974] [DEBUG] [LOCAL ] AVY: Loaded 37507 existing records from primary storage. [2025-10-07T17:24:34.114260] [INFO ] [MAIN ] AVY: Loaded 37507 existing records. [2025-10-07T17:24:34.255267] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-07T17:24:34.294981] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:24:34.295161] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-07T17:24:34.295207] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-07T17:24:34.295479] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-07T17:24:34.295534] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-07T17:24:34.656845] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:24:34.792563] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T17:24:35.047750] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-07T17:24:35.621829] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T17:24:35.847732] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-07T17:24:36.459029] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T17:24:36.647773] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-07T17:24:36.955992] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T17:24:37.447674] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-07T17:24:38.247763] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-07T17:24:38.670268] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-07T17:24:38.991124] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T17:24:39.047699] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-07T17:24:39.568839] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T17:24:39.847739] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-07T17:24:40.580955] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T17:24:40.647598] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-07T17:24:41.447708] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-07T17:24:42.109568] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-07T17:24:42.252738] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-07T17:24:42.266832] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T17:24:43.053464] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-07T17:24:43.069999] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T17:24:43.847706] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-07T17:24:43.984214] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T17:24:44.394951] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T17:24:44.647740] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-07T17:24:45.447745] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-07T17:24:45.810726] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T17:24:46.211672] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T17:24:46.247598] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-07T17:24:47.047616] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-07T17:24:47.169629] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T17:24:47.533670] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T17:24:47.847718] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-07T17:24:48.438905] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T17:24:48.647748] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-07T17:24:48.983125] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T17:24:49.447742] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-07T17:24:49.992686] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T17:24:50.247738] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-07T17:24:50.500542] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T17:24:51.047713] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-07T17:24:51.855698] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-07T17:24:51.876496] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T17:24:52.647632] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-07T17:24:52.954229] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T17:24:53.275993] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T17:24:53.447706] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-07T17:24:53.966146] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-07T17:24:54.247739] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-07T17:24:55.047677] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-07T17:24:55.440119] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T17:24:55.824077] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T17:24:55.847633] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-07T17:24:56.019414] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T17:24:56.647743] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-07T17:24:56.958931] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T17:24:57.447705] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-07T17:24:57.545114] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-07T17:24:57.547573] [INFO ] [REMOTE ] AVNS: Full fetch complete (48470 records). [2025-10-07T17:24:57.547681] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-07T17:24:57.929298] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-07T17:24:57.929379] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-07T17:24:57.929955] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-07T17:24:57.930020] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-07T17:24:57.931153] [DEBUG] [LOCAL ] AVNS: Trimmed 48470 records to 33660 (keeping 200 days of data) [2025-10-07T17:24:58.127980] [DEBUG] [LOCAL ] AVNS: Primary data saved (33660 records). [2025-10-07T17:24:58.128123] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-07T17:24:58.128209] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNS took 36.8s. Estimated remaining: 4h 52m 29s. Rate: 7.5 symbols/min [2025-10-07T17:24:58.252809] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-07T17:24:58.300918] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:24:58.328060] [DEBUG] [LOCAL ] AWF: Loaded 24363 existing records from primary storage. [2025-10-07T17:24:58.328324] [INFO ] [MAIN ] AWF: Loaded 24363 existing records. [2025-10-07T17:24:58.506307] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:24:58.506586] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-07T17:24:58.506635] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-07T17:24:58.506987] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-07T17:24:58.507043] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-07T17:24:58.874142] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:24:58.929061] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T17:24:59.047730] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-07T17:24:59.847724] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-07T17:25:00.097165] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T17:25:00.214148] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T17:25:00.647705] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-07T17:25:01.337127] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T17:25:01.340111] [INFO ] [REMOTE ] AVY: Full fetch complete (56384 records). [2025-10-07T17:25:01.340230] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-07T17:25:01.452839] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-07T17:25:01.770834] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-07T17:25:01.771068] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-07T17:25:01.771753] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-07T17:25:01.771818] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-07T17:25:01.773181] [DEBUG] [LOCAL ] AVY: Trimmed 56384 records to 37557 (keeping 200 days of data) [2025-10-07T17:25:01.936084] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T17:25:02.058732] [DEBUG] [LOCAL ] AVY: Primary data saved (37557 records). [2025-10-07T17:25:02.058937] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-07T17:25:02.060552] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVY took 28.2s. Estimated remaining: 4h 51m 33s. Rate: 7.5 symbols/min [2025-10-07T17:25:02.242379] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:25:02.247707] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-07T17:25:02.270890] [DEBUG] [LOCAL ] AWI: Loaded 25311 existing records from primary storage. [2025-10-07T17:25:02.271146] [INFO ] [MAIN ] AWI: Loaded 25311 existing records. [2025-10-07T17:25:02.447271] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:25:02.447535] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-07T17:25:02.447591] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-07T17:25:02.447858] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-07T17:25:02.447915] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-07T17:25:02.812103] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:25:02.860210] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T17:25:03.047748] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-07T17:25:03.174814] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T17:25:03.177153] [INFO ] [REMOTE ] AVNT: Full fetch complete (56204 records). [2025-10-07T17:25:03.177240] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-07T17:25:03.178129] [FATAL] [VALIDATOR ] AVNT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:25:03.178214] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:25:03.178257] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:25:03.178297] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-07T17:25:03.178353] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-07T17:25:03.178475] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-10-07T17:25:03.178539] [DEBUG] [LOCAL ] AVNT: No derivative data file found to delete. [2025-10-07T17:25:03.178597] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVNT took 39.6s. Estimated remaining: 4h 50m 5s. Rate: 7.5 symbols/min [2025-10-07T17:25:03.342195] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:25:03.390462] [DEBUG] [LOCAL ] AWK: Loaded 48662 existing records from primary storage. [2025-10-07T17:25:03.390795] [INFO ] [MAIN ] AWK: Loaded 48662 existing records. [2025-10-07T17:25:03.568013] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:25:03.569110] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-07T17:25:03.569168] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-07T17:25:03.569906] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-07T17:25:03.569964] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-07T17:25:03.852860] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-07T17:25:03.917983] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:25:04.647676] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-07T17:25:04.720843] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T17:25:04.724471] [INFO ] [REMOTE ] AVTR: Full fetch complete (77441 records). [2025-10-07T17:25:04.724602] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-07T17:25:05.098393] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T17:25:05.172076] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-07T17:25:05.172166] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-07T17:25:05.172974] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-07T17:25:05.173040] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-07T17:25:05.174574] [DEBUG] [LOCAL ] AVTR: Trimmed 77441 records to 53566 (keeping 200 days of data) [2025-10-07T17:25:05.453738] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-07T17:25:05.495334] [DEBUG] [LOCAL ] AVTR: Primary data saved (53566 records). [2025-10-07T17:25:05.495443] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-07T17:25:05.495523] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 40.1s. Estimated remaining: 4h 48m 51s. Rate: 7.6 symbols/min [2025-10-07T17:25:05.667659] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:25:05.688724] [DEBUG] [LOCAL ] AWP: Loaded 21465 existing records from primary storage. [2025-10-07T17:25:05.689032] [INFO ] [MAIN ] AWP: Loaded 21465 existing records. [2025-10-07T17:25:05.866100] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:25:05.879114] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-07T17:25:05.879200] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-07T17:25:05.880270] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T17:25:05.880340] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-07T17:25:05.880566] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-07T17:25:06.251155] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-07T17:25:06.255105] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:25:06.503770] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T17:25:07.054366] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-07T17:25:07.055466] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T17:25:07.847745] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-07T17:25:08.647633] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-07T17:25:08.702748] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T17:25:08.992190] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T17:25:09.447720] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-07T17:25:09.649588] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T17:25:10.247623] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-07T17:25:10.704205] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T17:25:11.047719] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-07T17:25:11.803192] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T17:25:11.847682] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-07T17:25:11.916295] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T17:25:12.647703] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-07T17:25:13.156361] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T17:25:13.447740] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-07T17:25:13.879079] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T17:25:14.247709] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-07T17:25:15.047631] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-07T17:25:15.183390] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T17:25:15.287091] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T17:25:15.847740] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-07T17:25:16.306860] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T17:25:16.647698] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-07T17:25:17.412327] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T17:25:17.447610] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-07T17:25:17.861336] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T17:25:18.247626] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-07T17:25:18.319762] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T17:25:19.047705] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-07T17:25:19.746673] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T17:25:19.847606] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-07T17:25:20.647681] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-07T17:25:20.763328] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T17:25:20.927834] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T17:25:21.447710] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-07T17:25:21.817314] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T17:25:22.247691] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-07T17:25:23.047639] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-07T17:25:23.087515] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T17:25:23.176253] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-07T17:25:23.847715] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-07T17:25:24.345363] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T17:25:24.647620] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-07T17:25:24.773213] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T17:25:25.447727] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-07T17:25:25.787317] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T17:25:26.247621] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-07T17:25:26.632543] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T17:25:27.047797] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-07T17:25:27.859226] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-07T17:25:27.864830] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T17:25:28.311633] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T17:25:28.647619] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-07T17:25:28.855411] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T17:25:28.857684] [INFO ] [REMOTE ] AWF: Full fetch complete (36125 records). [2025-10-07T17:25:28.857805] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-07T17:25:29.314403] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-07T17:25:29.314585] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-07T17:25:29.315311] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-07T17:25:29.315408] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-07T17:25:29.316937] [DEBUG] [LOCAL ] AWF: Trimmed 36125 records to 24241 (keeping 200 days of data) [2025-10-07T17:25:29.447747] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-07T17:25:29.487153] [DEBUG] [LOCAL ] AWF: Primary data saved (24241 records). [2025-10-07T17:25:29.487305] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-07T17:25:29.487449] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 31.4s. Estimated remaining: 4h 51m 48s. Rate: 7.5 symbols/min [2025-10-07T17:25:29.700465] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:25:29.713759] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T17:25:29.740429] [DEBUG] [LOCAL ] AWR: Loaded 22676 existing records from primary storage. [2025-10-07T17:25:29.740746] [INFO ] [MAIN ] AWR: Loaded 22676 existing records. [2025-10-07T17:25:29.920972] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:25:29.921239] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-07T17:25:29.921287] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-07T17:25:29.921535] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-07T17:25:29.921592] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-07T17:25:30.250893] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-07T17:25:30.272927] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:25:30.664107] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T17:25:31.047694] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-07T17:25:31.138306] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T17:25:31.847702] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-07T17:25:32.205476] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T17:25:32.207639] [INFO ] [REMOTE ] AWI: Full fetch complete (35712 records). [2025-10-07T17:25:32.207764] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-07T17:25:32.602976] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-07T17:25:32.603187] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-07T17:25:32.603755] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-07T17:25:32.603839] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-07T17:25:32.604810] [DEBUG] [LOCAL ] AWI: Trimmed 35712 records to 25292 (keeping 200 days of data) [2025-10-07T17:25:32.660801] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-07T17:25:32.772330] [DEBUG] [LOCAL ] AWI: Primary data saved (25292 records). [2025-10-07T17:25:32.772520] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-07T17:25:32.772631] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 30.7s. Estimated remaining: 4h 50m 46s. Rate: 7.5 symbols/min [2025-10-07T17:25:32.893795] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T17:25:32.970084] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:25:32.998505] [DEBUG] [LOCAL ] AX: Loaded 28224 existing records from primary storage. [2025-10-07T17:25:32.998828] [INFO ] [MAIN ] AX: Loaded 28224 existing records. [2025-10-07T17:25:33.179832] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:25:33.180091] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-07T17:25:33.180154] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-07T17:25:33.180468] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-07T17:25:33.180527] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-07T17:25:33.452816] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-07T17:25:33.553600] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:25:33.566542] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-07T17:25:34.247689] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-07T17:25:34.857568] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T17:25:35.047665] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-07T17:25:35.360010] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T17:25:35.847712] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-07T17:25:36.379802] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T17:25:36.647675] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-07T17:25:37.184753] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T17:25:37.447709] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-07T17:25:37.717956] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T17:25:38.247756] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-07T17:25:38.506673] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T17:25:38.901747] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T17:25:39.047691] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-07T17:25:39.847677] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-07T17:25:40.200295] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T17:25:40.647687] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-07T17:25:41.456972] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-07T17:25:41.466248] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T17:25:41.549449] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T17:25:42.247736] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-07T17:25:42.609121] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T17:25:43.047758] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-07T17:25:43.452066] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T17:25:43.847702] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-07T17:25:44.361467] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T17:25:44.647680] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-07T17:25:44.782290] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-07T17:25:45.447725] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-07T17:25:46.218267] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T17:25:46.221764] [INFO ] [REMOTE ] AWK: Full fetch complete (70722 records). [2025-10-07T17:25:46.221870] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-07T17:25:46.252879] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-07T17:25:46.669235] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-07T17:25:46.669350] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-07T17:25:46.674164] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-07T17:25:46.674945] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-07T17:25:46.675041] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-07T17:25:46.676407] [DEBUG] [LOCAL ] AWK: Trimmed 70722 records to 48693 (keeping 200 days of data) [2025-10-07T17:25:46.981968] [DEBUG] [LOCAL ] AWK: Primary data saved (48693 records). [2025-10-07T17:25:46.982106] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-07T17:25:46.983368] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWK took 43.8s. Estimated remaining: 4h 51m 48s. Rate: 7.5 symbols/min [2025-10-07T17:25:47.056534] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-07T17:25:47.164391] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T17:25:47.167873] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:25:47.232577] [DEBUG] [LOCAL ] AXL: Loaded 50503 existing records from primary storage. [2025-10-07T17:25:47.233030] [INFO ] [MAIN ] AXL: Loaded 50503 existing records. [2025-10-07T17:25:47.409792] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:25:47.409977] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-07T17:25:47.410035] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-07T17:25:47.410384] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-07T17:25:47.410445] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-07T17:25:47.758772] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:25:47.847616] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-07T17:25:48.067882] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T17:25:48.647707] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-07T17:25:49.447713] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-07T17:25:50.058131] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-07T17:25:50.182838] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T17:25:50.247683] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-07T17:25:50.543093] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T17:25:51.047744] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-07T17:25:51.847731] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-07T17:25:51.905512] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T17:25:52.024831] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T17:25:52.026512] [INFO ] [REMOTE ] AWP: Full fetch complete (32200 records). [2025-10-07T17:25:52.026598] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-07T17:25:52.394197] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-07T17:25:52.394309] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-07T17:25:52.394742] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-07T17:25:52.394805] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-07T17:25:52.395568] [DEBUG] [LOCAL ] AWP: Trimmed 32200 records to 21505 (keeping 200 days of data) [2025-10-07T17:25:52.518052] [DEBUG] [LOCAL ] AWP: Primary data saved (21505 records). [2025-10-07T17:25:52.518187] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-07T17:25:52.518266] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWP took 47.0s. Estimated remaining: 4h 51m 12s. Rate: 7.5 symbols/min [2025-10-07T17:25:52.657722] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-07T17:25:52.693346] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:25:52.740853] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T17:25:52.763739] [DEBUG] [LOCAL ] AXP: Loaded 53176 existing records from primary storage. [2025-10-07T17:25:52.764075] [INFO ] [MAIN ] AXP: Loaded 53176 existing records. [2025-10-07T17:25:52.939143] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:25:52.939363] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-07T17:25:52.939412] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-07T17:25:52.939818] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-07T17:25:52.939875] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-07T17:25:53.287135] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:25:53.447606] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-07T17:25:54.247716] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-07T17:25:54.351912] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T17:25:55.047734] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-07T17:25:55.192291] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T17:25:55.375595] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T17:25:55.847766] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-07T17:25:56.432753] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T17:25:56.647774] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-07T17:25:57.447623] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-07T17:25:57.951305] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T17:25:58.030914] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T17:25:58.248008] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-07T17:25:58.643825] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T17:25:59.047678] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-07T17:25:59.847633] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-07T17:25:59.981082] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T17:26:00.027199] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T17:26:00.647683] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-07T17:26:00.802075] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-07T17:26:01.447757] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-07T17:26:02.247762] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-07T17:26:02.558794] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T17:26:03.047634] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-07T17:26:03.269310] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T17:26:03.302770] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T17:26:03.304734] [INFO ] [REMOTE ] AX: Full fetch complete (42470 records). [2025-10-07T17:26:03.304812] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-07T17:26:03.668170] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-07T17:26:03.668250] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-07T17:26:03.668767] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-07T17:26:03.668831] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-07T17:26:03.669723] [DEBUG] [LOCAL ] AX: Trimmed 42470 records to 28121 (keeping 200 days of data) [2025-10-07T17:26:03.831814] [DEBUG] [LOCAL ] AX: Primary data saved (28121 records). [2025-10-07T17:26:03.831970] [INFO ] [MAIN ] AX: Full history saved. [2025-10-07T17:26:03.832058] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AX took 31.1s. Estimated remaining: 4h 51m 41s. Rate: 7.5 symbols/min [2025-10-07T17:26:03.854770] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-07T17:26:04.015097] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:26:04.020923] [DEBUG] [LOCAL ] AXR: Loaded 3009 existing records from primary storage. [2025-10-07T17:26:04.021141] [INFO ] [MAIN ] AXR: Loaded 3009 existing records. [2025-10-07T17:26:04.192714] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:26:04.192973] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-07T17:26:04.193022] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-07T17:26:04.193188] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-07T17:26:04.193245] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-07T17:26:04.540209] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:26:04.647700] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-07T17:26:04.928329] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-07T17:26:04.930381] [INFO ] [REMOTE ] AWR: Full fetch complete (32282 records). [2025-10-07T17:26:04.930462] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-07T17:26:05.315792] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-07T17:26:05.315903] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-07T17:26:05.316385] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-07T17:26:05.316497] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-07T17:26:05.317532] [DEBUG] [LOCAL ] AWR: Trimmed 32282 records to 22714 (keeping 200 days of data) [2025-10-07T17:26:05.456291] [DEBUG] [LOCAL ] AWR: Primary data saved (22714 records). [2025-10-07T17:26:05.448175] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-07T17:26:05.456438] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-07T17:26:05.456553] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AWR took 36.0s. Estimated remaining: 4h 50m 21s. Rate: 7.5 symbols/min [2025-10-07T17:26:05.596934] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-07T17:26:05.670845] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:26:05.706216] [DEBUG] [LOCAL ] AXS: Loaded 38503 existing records from primary storage. [2025-10-07T17:26:05.706536] [INFO ] [MAIN ] AXS: Loaded 38503 existing records. [2025-10-07T17:26:05.887809] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:26:05.888052] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-07T17:26:05.888148] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-07T17:26:05.888635] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-07T17:26:05.888730] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-07T17:26:06.251164] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:26:06.248167] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-07T17:26:06.259136] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T17:26:06.289302] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T17:26:07.047697] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-07T17:26:07.847708] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-07T17:26:08.544519] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-07T17:26:08.647626] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-07T17:26:08.685530] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T17:26:09.447707] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-07T17:26:09.519601] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T17:26:09.871061] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-07T17:26:10.247609] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-07T17:26:10.672665] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-07T17:26:11.047688] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-07T17:26:11.827601] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T17:26:11.847601] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-07T17:26:12.647783] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-07T17:26:13.107731] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T17:26:13.130381] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T17:26:13.239623] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-07T17:26:13.447694] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-07T17:26:14.247773] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-07T17:26:15.050671] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-07T17:26:15.054043] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T17:26:15.847705] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-07T17:26:15.878582] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T17:26:15.961329] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T17:26:16.647770] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-07T17:26:17.305065] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T17:26:17.447682] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-07T17:26:18.247612] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-07T17:26:18.751758] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-07T17:26:18.935585] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T17:26:18.937233] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T17:26:19.047680] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-07T17:26:19.514207] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T17:26:19.847675] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-07T17:26:20.647703] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-07T17:26:21.220344] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-07T17:26:21.447736] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-07T17:26:21.523817] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T17:26:22.010321] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-07T17:26:22.247687] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-07T17:26:23.047720] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-07T17:26:23.765886] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T17:26:23.847705] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-07T17:26:24.279261] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T17:26:24.441198] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T17:26:24.444310] [INFO ] [REMOTE ] AXL: Full fetch complete (72390 records). [2025-10-07T17:26:24.444423] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-07T17:26:24.445340] [FATAL] [VALIDATOR ] AXL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:26:24.445431] [FATAL] [MAIN ] AXL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:26:24.445474] [WARN ] [MAIN ] AXL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:26:24.445551] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-07T17:26:24.445617] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-10-07T17:26:24.445680] [INFO ] [LOCAL ] AXL: Starting deletion of derivative data. [2025-10-07T17:26:24.446004] [DEBUG] [LOCAL ] AXL: Deleted derivative data file. [2025-10-07T17:26:24.447493] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 37.5s. Estimated remaining: 4h 52m 15s. Rate: 7.4 symbols/min [2025-10-07T17:26:24.620805] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:26:24.654814] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-07T17:26:24.676095] [DEBUG] [LOCAL ] AXTA: Loaded 52142 existing records from primary storage. [2025-10-07T17:26:24.676420] [INFO ] [MAIN ] AXTA: Loaded 52142 existing records. [2025-10-07T17:26:24.856603] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:26:24.857014] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-07T17:26:24.857069] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-07T17:26:24.857292] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-07T17:26:24.857348] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-07T17:26:25.215460] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:26:25.216185] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T17:26:25.447695] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-07T17:26:26.247734] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-07T17:26:26.671723] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T17:26:26.672480] [INFO ] [REMOTE ] AXR: Full fetch complete (4690 records). [2025-10-07T17:26:26.672553] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-07T17:26:27.042792] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-07T17:26:27.042895] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-07T17:26:27.043110] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-07T17:26:27.043154] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-07T17:26:27.043718] [DEBUG] [LOCAL ] AXR: Trimmed 4690 records to 2994 (keeping 200 days of data) [2025-10-07T17:26:27.053398] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-07T17:26:27.065810] [DEBUG] [LOCAL ] AXR: Primary data saved (2994 records). [2025-10-07T17:26:27.065968] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-07T17:26:27.066064] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 23.2s. Estimated remaining: 4h 51m 7s. Rate: 7.5 symbols/min [2025-10-07T17:26:27.246875] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T17:26:27.847680] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-07T17:26:28.647764] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-07T17:26:28.934216] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-07T17:26:28.937822] [INFO ] [REMOTE ] AXP: Full fetch complete (76914 records). [2025-10-07T17:26:28.937952] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-07T17:26:29.357006] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:26:29.355295] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-07T17:26:29.366399] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-07T17:26:29.367899] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-07T17:26:29.367969] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-07T17:26:29.369370] [DEBUG] [LOCAL ] AXP: Trimmed 76914 records to 53170 (keeping 200 days of data) [2025-10-07T17:26:29.464342] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-07T17:26:29.712996] [DEBUG] [LOCAL ] AXP: Primary data saved (53170 records). [2025-10-07T17:26:29.713146] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-07T17:26:29.714173] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 37.2s. Estimated remaining: 4h 49m 60s. Rate: 7.5 symbols/min [2025-10-07T17:26:30.115127] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:26:30.247610] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-07T17:26:30.741416] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T17:26:31.047762] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-07T17:26:31.306757] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T17:26:31.847687] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-07T17:26:32.440705] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T17:26:32.647707] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-07T17:26:33.450121] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T17:26:33.458762] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-07T17:26:34.319333] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T17:26:34.330252] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-07T17:26:35.077763] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T17:26:35.086452] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-07T17:26:35.582018] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-07T17:26:35.847714] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-07T17:26:36.449333] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T17:26:36.452153] [INFO ] [REMOTE ] AXS: Full fetch complete (55722 records). [2025-10-07T17:26:36.452259] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-07T17:26:36.833044] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-07T17:26:36.833174] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-07T17:26:36.833988] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-07T17:26:36.834059] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-07T17:26:36.835581] [DEBUG] [LOCAL ] AXS: Trimmed 55722 records to 38558 (keeping 200 days of data) [2025-10-07T17:26:37.120413] [DEBUG] [LOCAL ] AXS: Primary data saved (38558 records). [2025-10-07T17:26:37.120590] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-07T17:26:37.120751] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 31.7s. Estimated remaining: 4h 49m 45s. Rate: 7.5 symbols/min [2025-10-07T17:26:37.373448] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T17:26:37.386121] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-07T17:26:39.200880] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T17:26:39.212773] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-07T17:26:40.844623] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T17:26:40.856232] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-07T17:26:42.385707] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T17:26:42.396835] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-07T17:26:43.797690] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T17:26:43.801324] [INFO ] [REMOTE ] AXTA: Full fetch complete (75119 records). [2025-10-07T17:26:43.801489] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-07T17:26:44.184613] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-07T17:26:44.184738] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-07T17:26:44.185502] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-07T17:26:44.185546] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-07T17:26:44.187038] [DEBUG] [LOCAL ] AXTA: Trimmed 75119 records to 52161 (keeping 200 days of data) [2025-10-07T17:26:44.507067] [DEBUG] [LOCAL ] AXTA: Primary data saved (52161 records). [2025-10-07T17:26:44.507263] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-07T17:26:44.508420] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 20.1s. Estimated remaining: 4h 49m 30s. Rate: 7.5 symbols/min [2025-10-07T17:26:45.066806] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:26:45.209766] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:26:45.214357] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:26:45.211543] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:26:45.215097] [DEBUG] [LOCAL ] AZO: No existing data file found in primary storage. [2025-10-07T17:26:45.215202] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-07T17:26:45.215454] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-07T17:26:45.215408] [WARN ] [MAIN ] AZO: No existing data found, performing full refresh instead. [2025-10-07T17:26:45.215660] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-07T17:26:45.215789] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-07T17:26:45.215842] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-07T17:26:45.215943] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-07T17:26:45.216029] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-10-07T17:26:45.216176] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-07T17:26:45.216270] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-07T17:26:45.238079] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-07T17:26:45.459359] [DEBUG] [LOCAL ] AZZ: Loaded 21927 existing records from primary storage. [2025-10-07T17:26:45.530184] [DEBUG] [LOCAL ] AYI: Loaded 25228 existing records from primary storage. [2025-10-07T17:26:45.514708] [INFO ] [MAIN ] AZZ: Loaded 21927 existing records. [2025-10-07T17:26:45.568473] [INFO ] [MAIN ] AYI: Loaded 25228 existing records. [2025-10-07T17:26:46.251788] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:26:46.349398] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-07T17:26:46.352103] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-07T17:26:46.355462] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:26:46.387928] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-07T17:26:46.405955] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-07T17:26:46.407070] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-07T17:26:46.410546] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:26:46.410707] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-07T17:26:46.405909] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:26:46.411182] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-07T17:26:46.423356] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-07T17:26:46.437784] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-07T17:26:46.472735] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-07T17:26:47.142364] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:26:47.164728] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-07T17:26:47.163311] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:26:47.165368] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-07T17:26:47.549365] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T17:26:47.552864] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-07T17:26:47.818217] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T17:26:47.824992] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-07T17:26:48.326272] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T17:26:48.330851] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-07T17:26:48.390435] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-07T17:26:48.393192] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-07T17:26:48.513321] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T17:26:48.518943] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-07T17:26:48.774853] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T17:26:48.780886] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-07T17:26:48.905253] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-07T17:26:48.907370] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-07T17:26:48.973861] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:26:48.974047] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-07T17:26:48.974149] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:26:48.974252] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-07T17:26:48.974340] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:26:48.974437] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-07T17:26:48.974515] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-07T17:26:48.974553] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-07T17:26:48.974621] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-07T17:26:48.974721] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.4s. Estimated remaining: 4h 48m 44s. Rate: 7.5 symbols/min [2025-10-07T17:26:49.151620] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:26:49.151891] [DEBUG] [LOCAL ] BA: No existing data file found in primary storage. [2025-10-07T17:26:49.157222] [WARN ] [MAIN ] BA: No existing data found, performing full refresh instead. [2025-10-07T17:26:49.163019] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-07T17:26:49.163424] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T17:26:49.167892] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-07T17:26:49.168805] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-07T17:26:49.168896] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-10-07T17:26:49.168981] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-07T17:26:49.517518] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:26:49.517904] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-07T17:26:49.586715] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T17:26:49.935309] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-07T17:26:50.113818] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T17:26:50.247687] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-07T17:26:51.047738] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-07T17:26:51.347788] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T17:26:51.848458] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-07T17:26:51.854719] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-07T17:26:52.142194] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T17:26:52.647750] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-07T17:26:53.027993] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T17:26:53.447736] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-07T17:26:54.247762] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-07T17:26:54.828545] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T17:26:54.940122] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-07T17:26:55.047758] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-07T17:26:55.142912] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T17:26:55.847715] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-07T17:26:56.647774] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-07T17:26:56.710691] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T17:26:57.239987] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-07T17:26:57.442327] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T17:26:57.447564] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-07T17:26:58.247706] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-07T17:26:58.872831] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T17:26:58.981870] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-07T17:26:59.047611] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-07T17:26:59.813460] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T17:26:59.847689] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-07T17:27:00.647760] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-07T17:27:00.792701] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T17:27:00.794384] [INFO ] [REMOTE ] AZO: Full fetch complete (16136 records). [2025-10-07T17:27:00.794482] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-07T17:27:01.195063] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-07T17:27:01.195172] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-07T17:27:01.195464] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-07T17:27:01.195505] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-07T17:27:01.196276] [DEBUG] [LOCAL ] AZO: Trimmed 16136 records to 11286 (keeping 200 days of data) [2025-10-07T17:27:01.270639] [DEBUG] [LOCAL ] AZO: Primary data saved (11286 records). [2025-10-07T17:27:01.270836] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-07T17:27:01.270920] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZO took 16.8s. Estimated remaining: 4h 49m 23s. Rate: 7.5 symbols/min [2025-10-07T17:27:01.443170] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:27:01.447725] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-07T17:27:01.503473] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-07T17:27:01.504005] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-07T17:27:01.689006] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:27:01.689312] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-07T17:27:01.689367] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-07T17:27:01.689722] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-07T17:27:01.689781] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-07T17:27:02.066500] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:27:02.247696] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-07T17:27:02.309272] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T17:27:02.713881] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-07T17:27:03.047746] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-07T17:27:03.847706] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-07T17:27:04.578360] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T17:27:04.647603] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-07T17:27:04.849248] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-07T17:27:05.447703] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-07T17:27:05.483190] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T17:27:06.163192] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-07T17:27:06.247742] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-07T17:27:07.047746] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-07T17:27:07.234051] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T17:27:07.847680] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-07T17:27:07.987382] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-07T17:27:08.647733] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-07T17:27:08.871626] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T17:27:09.296024] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-07T17:27:09.447730] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-07T17:27:10.247693] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-07T17:27:10.352212] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T17:27:11.047679] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-07T17:27:11.362361] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-07T17:27:11.847741] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-07T17:27:12.333957] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T17:27:12.400279] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-07T17:27:12.647613] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-07T17:27:12.675153] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T17:27:13.447620] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-07T17:27:13.694081] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T17:27:14.247768] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-07T17:27:15.047720] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-07T17:27:15.532291] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T17:27:15.847636] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-07T17:27:16.109817] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-07T17:27:16.647620] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-07T17:27:16.961826] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T17:27:17.447690] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-07T17:27:17.682797] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T17:27:17.685197] [INFO ] [REMOTE ] AYI: Full fetch complete (37097 records). [2025-10-07T17:27:17.685280] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-07T17:27:18.076880] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-10-07T17:27:18.103529] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-07T17:27:18.103638] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-07T17:27:18.104473] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-07T17:27:18.104529] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-07T17:27:18.105523] [DEBUG] [LOCAL ] AYI: Trimmed 37097 records to 25223 (keeping 200 days of data) [2025-10-07T17:27:18.203474] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T17:27:18.206966] [INFO ] [REMOTE ] AZZ: Full fetch complete (31038 records). [2025-10-07T17:27:18.207563] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-07T17:27:18.261814] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-07T17:27:18.620245] [DEBUG] [LOCAL ] AYI: Primary data saved (25223 records). [2025-10-07T17:27:18.635959] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-07T17:27:18.641305] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 34.1s. Estimated remaining: 4h 50m 55s. Rate: 7.5 symbols/min [2025-10-07T17:27:18.660348] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-07T17:27:18.680544] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-07T17:27:18.692061] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-07T17:27:18.712351] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-07T17:27:18.762571] [DEBUG] [LOCAL ] AZZ: Trimmed 31038 records to 22027 (keeping 200 days of data) [2025-10-07T17:27:18.923407] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:27:19.002185] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-07T17:27:19.002975] [DEBUG] [LOCAL ] AZZ: Primary data saved (22027 records). [2025-10-07T17:27:19.003167] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-07T17:27:19.003274] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AZZ took 34.5s. Estimated remaining: 4h 49m 25s. Rate: 7.5 symbols/min [2025-10-07T17:27:19.003434] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-07T17:27:19.063103] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-07T17:27:19.344979] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:27:19.358963] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:27:19.359548] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-07T17:27:19.359636] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-07T17:27:19.360002] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-07T17:27:19.360065] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-07T17:27:19.752910] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:27:19.754407] [DEBUG] [LOCAL ] BAH: Loaded 51690 existing records from primary storage. [2025-10-07T17:27:19.754836] [INFO ] [MAIN ] BAH: Loaded 51690 existing records. [2025-10-07T17:27:19.852727] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-07T17:27:19.933326] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:27:19.933545] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-07T17:27:19.933596] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-07T17:27:19.933870] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-07T17:27:19.933929] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-07T17:27:20.289743] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:27:20.647791] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-07T17:27:20.981206] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-07T17:27:21.447737] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-07T17:27:21.529493] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-07T17:27:22.078808] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-07T17:27:22.169617] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T17:27:22.247602] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-07T17:27:23.047702] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-07T17:27:23.847624] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-07T17:27:23.927370] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-07T17:27:23.979955] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T17:27:24.647774] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-07T17:27:25.365329] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-07T17:27:25.447601] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-07T17:27:26.082887] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T17:27:26.247628] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-07T17:27:26.441359] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-07T17:27:27.047683] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-07T17:27:27.765238] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-07T17:27:27.822126] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T17:27:27.825717] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-07T17:27:27.825883] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-07T17:27:27.855574] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-07T17:27:28.233095] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-07T17:27:28.233253] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-07T17:27:28.234227] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-07T17:27:28.234322] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-07T17:27:28.250009] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 53790 (keeping 200 days of data) [2025-10-07T17:27:28.271111] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-07T17:27:28.616455] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-07T17:27:28.616635] [INFO ] [MAIN ] BA: Full history saved. [2025-10-07T17:27:28.616759] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 39.6s. Estimated remaining: 4h 49m 34s. Rate: 7.5 symbols/min [2025-10-07T17:27:28.652893] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-07T17:27:28.787243] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:27:28.826623] [DEBUG] [LOCAL ] BAK: Loaded 39287 existing records from primary storage. [2025-10-07T17:27:28.826954] [INFO ] [MAIN ] BAK: Loaded 39287 existing records. [2025-10-07T17:27:29.003460] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:27:29.003725] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-07T17:27:29.003783] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-07T17:27:29.004036] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-07T17:27:29.004094] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-07T17:27:29.366624] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:27:29.447625] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-07T17:27:30.247725] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-07T17:27:30.293725] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T17:27:30.381146] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-07T17:27:31.047618] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-07T17:27:31.129031] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T17:27:31.847687] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-07T17:27:32.643459] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-07T17:27:32.654112] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-07T17:27:33.332769] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T17:27:33.452799] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-07T17:27:33.473174] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-07T17:27:34.247700] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-07T17:27:34.440136] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T17:27:35.047690] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-07T17:27:35.843524] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-07T17:27:35.854334] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-07T17:27:36.647627] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-07T17:27:36.711615] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T17:27:36.864003] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-07T17:27:37.276031] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T17:27:37.447728] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-07T17:27:38.247741] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-07T17:27:38.704196] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T17:27:39.050028] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-07T17:27:39.056630] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-07T17:27:39.847741] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-07T17:27:40.536630] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T17:27:40.647608] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-07T17:27:40.785882] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-07T17:27:41.281684] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T17:27:41.447736] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-07T17:27:42.247727] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-07T17:27:42.406539] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T17:27:42.877322] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T17:27:43.047768] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-07T17:27:43.847765] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-07T17:27:44.337390] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-07T17:27:44.647748] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-07T17:27:44.804308] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T17:27:45.312945] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:27:45.447735] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-07T17:27:46.247743] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-07T17:27:46.917928] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T17:27:46.922064] [INFO ] [REMOTE ] BAH: Full fetch complete (74511 records). [2025-10-07T17:27:46.922260] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-07T17:27:46.923699] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:27:46.923864] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:27:46.923922] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:27:46.924003] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-07T17:27:46.924103] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-07T17:27:46.924159] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-10-07T17:27:46.924409] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-10-07T17:27:46.924565] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAH took 27.9s. Estimated remaining: 4h 51m 14s. Rate: 7.4 symbols/min [2025-10-07T17:27:47.052736] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-07T17:27:47.069339] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-07T17:27:47.099173] [INFO ] [REMOTE ] BABA: Full fetch complete (77593 records). [2025-10-07T17:27:47.131424] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:27:47.131596] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-07T17:27:47.133868] [FATAL] [VALIDATOR ] BABA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:27:47.133982] [FATAL] [MAIN ] BABA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:27:47.134029] [WARN ] [MAIN ] BABA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:27:47.134074] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-07T17:27:47.134246] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-07T17:27:47.134306] [INFO ] [LOCAL ] BABA: Starting deletion of derivative data. [2025-10-07T17:27:47.134509] [DEBUG] [LOCAL ] BABA: Deleted derivative data file. [2025-10-07T17:27:47.135104] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BABA took 45.9s. Estimated remaining: 4h 49m 44s. Rate: 7.5 symbols/min [2025-10-07T17:27:47.346717] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:27:47.363266] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-07T17:27:47.363345] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-07T17:27:47.363521] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-07T17:27:47.363589] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-07T17:27:47.363694] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-07T17:27:47.363745] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-07T17:27:47.535176] [DEBUG] [LOCAL ] BALL: Loaded 51811 existing records from primary storage. [2025-10-07T17:27:47.574690] [INFO ] [MAIN ] BALL: Loaded 51811 existing records. [2025-10-07T17:27:47.985384] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T17:27:47.991625] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:27:48.030741] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-07T17:27:48.039199] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:27:48.040935] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-07T17:27:48.041569] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-07T17:27:48.042377] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-07T17:27:48.042456] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-07T17:27:48.409806] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:27:48.647693] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-07T17:27:48.909128] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T17:27:49.447765] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-07T17:27:49.515931] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-07T17:27:50.247691] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-07T17:27:50.286929] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T17:27:50.625599] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-07T17:27:51.047699] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-07T17:27:51.648731] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T17:27:51.852739] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-07T17:27:51.865955] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T17:27:52.647703] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-07T17:27:53.447750] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-07T17:27:53.499391] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T17:27:54.101483] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T17:27:54.256860] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-07T17:27:54.262677] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T17:27:55.047754] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-07T17:27:55.680843] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-07T17:27:55.847706] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-07T17:27:56.627912] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-07T17:27:56.647623] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-07T17:27:57.026229] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T17:27:57.029339] [INFO ] [REMOTE ] BAK: Full fetch complete (57131 records). [2025-10-07T17:27:57.029462] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-07T17:27:57.405197] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-07T17:27:57.405292] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-07T17:27:57.405944] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-07T17:27:57.406009] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-07T17:27:57.407239] [DEBUG] [LOCAL ] BAK: Trimmed 57131 records to 39374 (keeping 200 days of data) [2025-10-07T17:27:57.459218] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-07T17:27:57.632413] [DEBUG] [LOCAL ] BAK: Primary data saved (39374 records). [2025-10-07T17:27:57.632565] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-07T17:27:57.632671] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAK took 29.0s. Estimated remaining: 4h 50m 1s. Rate: 7.5 symbols/min [2025-10-07T17:27:57.801675] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:27:57.854983] [DEBUG] [LOCAL ] BAM: Loaded 52007 existing records from primary storage. [2025-10-07T17:27:57.855312] [INFO ] [MAIN ] BAM: Loaded 52007 existing records. [2025-10-07T17:27:58.027405] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:27:58.027660] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-07T17:27:58.027722] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-07T17:27:58.028367] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-07T17:27:58.028448] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-07T17:27:58.253341] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-07T17:27:58.378841] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:27:58.903407] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-07T17:27:59.047717] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-07T17:27:59.087816] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T17:27:59.282020] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-07T17:27:59.847732] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-07T17:28:00.611009] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T17:28:00.647680] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-07T17:28:01.377310] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-07T17:28:01.381145] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-07T17:28:01.381310] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-07T17:28:01.456728] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-07T17:28:01.851087] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-07T17:28:01.851205] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-07T17:28:01.852219] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-07T17:28:01.852293] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-07T17:28:01.853999] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-10-07T17:28:02.253267] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-07T17:28:02.267482] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T17:28:02.267920] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T17:28:02.287719] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-07T17:28:02.287940] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-07T17:28:02.289470] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BAC took 43.6s. Estimated remaining: 4h 49m 18s. Rate: 7.5 symbols/min [2025-10-07T17:28:02.467046] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:28:02.522626] [DEBUG] [LOCAL ] BANC: Loaded 51268 existing records from primary storage. [2025-10-07T17:28:02.523115] [INFO ] [MAIN ] BANC: Loaded 51268 existing records. [2025-10-07T17:28:02.703341] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:28:02.703746] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-07T17:28:02.703811] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-07T17:28:02.704030] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-07T17:28:02.704072] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-07T17:28:03.054261] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-07T17:28:03.078356] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:28:03.847715] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-07T17:28:03.918011] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T17:28:04.303191] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-07T17:28:04.472285] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T17:28:04.647729] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-07T17:28:05.447611] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-07T17:28:05.531009] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T17:28:06.247694] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-07T17:28:06.915601] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T17:28:06.916911] [INFO ] [REMOTE ] BALY: Full fetch complete (16733 records). [2025-10-07T17:28:06.916984] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-07T17:28:06.917666] [FATAL] [VALIDATOR ] BALY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:28:06.917854] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:28:06.917926] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:28:06.918004] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-07T17:28:06.918070] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-07T17:28:06.918107] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-07T17:28:06.918147] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-07T17:28:06.918201] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALY took 19.8s. Estimated remaining: 4h 48m 35s. Rate: 7.5 symbols/min [2025-10-07T17:28:07.048925] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-07T17:28:07.155616] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:28:07.153895] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T17:28:07.196059] [DEBUG] [LOCAL ] BAP: Loaded 26098 existing records from primary storage. [2025-10-07T17:28:07.196344] [INFO ] [MAIN ] BAP: Loaded 26098 existing records. [2025-10-07T17:28:07.371220] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:28:07.371464] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-07T17:28:07.371512] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-07T17:28:07.371868] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-07T17:28:07.371925] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-07T17:28:07.763561] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:28:07.847686] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-07T17:28:08.647774] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-07T17:28:08.776012] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T17:28:09.365739] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T17:28:09.447617] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-07T17:28:10.259546] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-07T17:28:10.267195] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T17:28:10.635017] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T17:28:11.047690] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-07T17:28:11.847685] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-07T17:28:11.977963] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T17:28:12.567888] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T17:28:12.647719] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-07T17:28:13.288517] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T17:28:13.447718] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-07T17:28:14.115870] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T17:28:14.247736] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-07T17:28:14.731939] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T17:28:15.047690] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-07T17:28:15.710012] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T17:28:15.847610] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-07T17:28:15.993323] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T17:28:16.647771] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-07T17:28:17.453248] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-07T17:28:17.458919] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T17:28:18.152675] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T17:28:18.247667] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-07T17:28:19.047629] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-07T17:28:19.320582] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T17:28:19.847697] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-07T17:28:20.012204] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T17:28:20.436542] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T17:28:20.647683] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-07T17:28:21.050487] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T17:28:21.447696] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-07T17:28:22.247702] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-07T17:28:22.432123] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T17:28:22.460435] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T17:28:23.047680] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-07T17:28:23.847723] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-07T17:28:23.901074] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T17:28:24.647847] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-07T17:28:24.987338] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T17:28:25.253803] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T17:28:25.447733] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-07T17:28:26.247668] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-07T17:28:26.365910] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T17:28:26.899060] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T17:28:27.047693] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-07T17:28:27.461438] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T17:28:27.847677] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-07T17:28:28.647716] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-07T17:28:28.680603] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T17:28:28.796683] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T17:28:29.447699] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-07T17:28:30.247624] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-07T17:28:30.442171] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T17:28:30.631856] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T17:28:31.047706] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-07T17:28:31.847703] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-07T17:28:31.960301] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T17:28:32.236126] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T17:28:32.240038] [INFO ] [REMOTE ] BAM: Full fetch complete (74516 records). [2025-10-07T17:28:32.240191] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-07T17:28:32.654153] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-07T17:28:32.657972] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-07T17:28:32.659046] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-07T17:28:32.659899] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-07T17:28:32.659965] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-07T17:28:32.661800] [DEBUG] [LOCAL ] BAM: Trimmed 74516 records to 52009 (keeping 200 days of data) [2025-10-07T17:28:33.020569] [DEBUG] [LOCAL ] BAM: Primary data saved (52009 records). [2025-10-07T17:28:33.020801] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-07T17:28:33.022082] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BAM took 35.4s. Estimated remaining: 4h 51m 32s. Rate: 7.4 symbols/min [2025-10-07T17:28:33.194785] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:28:33.238111] [DEBUG] [LOCAL ] BARK: Loaded 37923 existing records from primary storage. [2025-10-07T17:28:33.238473] [INFO ] [MAIN ] BARK: Loaded 37923 existing records. [2025-10-07T17:28:33.428763] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:28:33.429182] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-07T17:28:33.429342] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-07T17:28:33.437427] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T17:28:33.440005] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-07T17:28:33.440560] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-07T17:28:33.453461] [INFO ] [REMOTE ] BALL: Full fetch complete (74983 records). [2025-10-07T17:28:33.471311] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-07T17:28:33.471436] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-07T17:28:33.497408] [FATAL] [VALIDATOR ] BALL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:28:33.512894] [FATAL] [MAIN ] BALL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:28:33.534809] [WARN ] [MAIN ] BALL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:28:33.545068] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-07T17:28:33.545219] [DEBUG] [LOCAL ] BALL: No primary data file found to delete. [2025-10-07T17:28:33.545594] [INFO ] [LOCAL ] BALL: Starting deletion of derivative data. [2025-10-07T17:28:33.556335] [DEBUG] [LOCAL ] BALL: Deleted derivative data file. [2025-10-07T17:28:33.556482] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BALL took 46.6s. Estimated remaining: 4h 50m 7s. Rate: 7.4 symbols/min [2025-10-07T17:28:33.907780] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:28:33.998757] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:28:34.042495] [DEBUG] [LOCAL ] BAX: Loaded 53502 existing records from primary storage. [2025-10-07T17:28:34.042861] [INFO ] [MAIN ] BAX: Loaded 53502 existing records. [2025-10-07T17:28:34.220613] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:28:34.221066] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-07T17:28:34.221128] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-07T17:28:34.221413] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-07T17:28:34.221472] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-07T17:28:34.258220] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-07T17:28:34.331927] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T17:28:34.340916] [INFO ] [REMOTE ] BANC: Full fetch complete (74323 records). [2025-10-07T17:28:34.351903] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-07T17:28:34.888973] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:28:35.025967] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-07T17:28:35.026110] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-07T17:28:35.034179] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-07T17:28:35.049069] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-07T17:28:35.048897] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T17:28:35.048042] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-07T17:28:35.059735] [DEBUG] [LOCAL ] BANC: Trimmed 74323 records to 51275 (keeping 200 days of data) [2025-10-07T17:28:35.454148] [DEBUG] [LOCAL ] BANC: Primary data saved (51275 records). [2025-10-07T17:28:35.454328] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-07T17:28:35.455515] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 33.2s. Estimated remaining: 4h 48m 57s. Rate: 7.5 symbols/min [2025-10-07T17:28:35.705817] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:28:35.783950] [DEBUG] [LOCAL ] BB: Loaded 52943 existing records from primary storage. [2025-10-07T17:28:35.784571] [INFO ] [MAIN ] BB: Loaded 52943 existing records. [2025-10-07T17:28:35.848035] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-07T17:28:36.016463] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:28:36.016959] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-07T17:28:36.017062] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-07T17:28:36.017552] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-07T17:28:36.017623] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-07T17:28:36.178139] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T17:28:36.500020] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:28:36.647678] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-07T17:28:36.805220] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T17:28:37.043069] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T17:28:37.447694] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-07T17:28:37.815427] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T17:28:38.247692] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-07T17:28:38.593585] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T17:28:39.047707] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-07T17:28:39.699100] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T17:28:39.847686] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-07T17:28:40.084501] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T17:28:40.086798] [INFO ] [REMOTE ] BAP: Full fetch complete (37421 records). [2025-10-07T17:28:40.086958] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-07T17:28:40.458947] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-07T17:28:40.459035] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-07T17:28:40.459502] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-07T17:28:40.459543] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-07T17:28:40.460481] [DEBUG] [LOCAL ] BAP: Trimmed 37421 records to 25960 (keeping 200 days of data) [2025-10-07T17:28:40.617771] [DEBUG] [LOCAL ] BAP: Primary data saved (25960 records). [2025-10-07T17:28:40.617904] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-07T17:28:40.617987] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 33.7s. Estimated remaining: 4h 48m 20s. Rate: 7.5 symbols/min [2025-10-07T17:28:40.652808] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-07T17:28:40.786949] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:28:40.837831] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-07T17:28:40.838255] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-07T17:28:41.024767] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:28:41.024987] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-07T17:28:41.025035] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-07T17:28:41.025383] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-07T17:28:41.025444] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-07T17:28:41.412783] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:28:41.414799] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T17:28:41.447599] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-07T17:28:42.247711] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-07T17:28:42.565160] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-07T17:28:42.832414] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T17:28:43.047720] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-07T17:28:43.847705] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-07T17:28:44.451469] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-07T17:28:44.647707] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-07T17:28:44.893346] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T17:28:45.447628] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-07T17:28:45.521279] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-07T17:28:46.137619] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T17:28:46.247613] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-07T17:28:46.592414] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T17:28:47.047730] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-07T17:28:47.847706] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-07T17:28:48.286728] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-07T17:28:48.647638] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-07T17:28:48.773575] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T17:28:49.447749] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-07T17:28:50.252764] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-07T17:28:50.275530] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-07T17:28:50.477168] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T17:28:51.047753] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-07T17:28:51.227243] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T17:28:51.590267] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T17:28:51.847688] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-07T17:28:52.647683] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-07T17:28:53.453961] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-07T17:28:53.473068] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-07T17:28:53.560177] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T17:28:54.050343] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T17:28:54.247763] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-07T17:28:54.841066] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T17:28:55.047734] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-07T17:28:55.847732] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-07T17:28:56.274386] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T17:28:56.647774] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-07T17:28:57.012632] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-07T17:28:57.413500] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T17:28:57.447683] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-07T17:28:58.247775] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-07T17:28:58.393695] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T17:28:59.047718] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-07T17:28:59.399231] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T17:28:59.847766] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-07T17:29:00.434366] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-07T17:29:00.531771] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T17:29:00.534412] [INFO ] [REMOTE ] BARK: Full fetch complete (56100 records). [2025-10-07T17:29:00.534514] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-07T17:29:00.652777] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-07T17:29:00.915295] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-07T17:29:00.915376] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-07T17:29:00.916262] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-07T17:29:00.916327] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-07T17:29:00.917620] [DEBUG] [LOCAL ] BARK: Trimmed 56100 records to 37946 (keeping 200 days of data) [2025-10-07T17:29:01.130600] [DEBUG] [LOCAL ] BARK: Primary data saved (37946 records). [2025-10-07T17:29:01.130777] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-07T17:29:01.130867] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BARK took 28.1s. Estimated remaining: 4h 50m 17s. Rate: 7.4 symbols/min [2025-10-07T17:29:01.304757] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:01.344935] [DEBUG] [LOCAL ] BBAR: Loaded 41588 existing records from primary storage. [2025-10-07T17:29:01.345384] [INFO ] [MAIN ] BBAR: Loaded 41588 existing records. [2025-10-07T17:29:01.455368] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-07T17:29:01.551519] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T17:29:01.557285] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:29:01.567540] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-07T17:29:01.567620] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-07T17:29:01.568461] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-07T17:29:01.568523] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-07T17:29:01.930561] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:02.247775] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-07T17:29:03.047723] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-07T17:29:03.327051] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-07T17:29:03.477399] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-07T17:29:03.847619] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-07T17:29:04.098894] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T17:29:04.323001] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T17:29:04.647705] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-07T17:29:05.447694] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-07T17:29:06.147145] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-07T17:29:06.247717] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-07T17:29:06.556367] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T17:29:06.864456] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T17:29:07.047758] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-07T17:29:07.847748] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-07T17:29:08.647731] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-07T17:29:08.886965] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-07T17:29:09.169794] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T17:29:09.400753] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T17:29:09.447612] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-07T17:29:10.247750] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-07T17:29:10.292595] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T17:29:10.999586] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T17:29:11.047605] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-07T17:29:11.847697] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-07T17:29:12.587719] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-07T17:29:12.622713] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T17:29:12.647605] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-07T17:29:13.447680] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-07T17:29:13.646109] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T17:29:13.649772] [INFO ] [REMOTE ] BB: Full fetch complete (76990 records). [2025-10-07T17:29:13.649927] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-07T17:29:14.056021] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-07T17:29:14.056155] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-07T17:29:14.057026] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-07T17:29:14.057165] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-07T17:29:14.058905] [DEBUG] [LOCAL ] BB: Trimmed 76990 records to 52944 (keeping 200 days of data) [2025-10-07T17:29:14.240339] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T17:29:14.250396] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-07T17:29:14.446311] [DEBUG] [LOCAL ] BB: Primary data saved (52944 records). [2025-10-07T17:29:14.446466] [INFO ] [MAIN ] BB: Full history saved. [2025-10-07T17:29:14.447721] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BB took 39.0s. Estimated remaining: 4h 51m 1s. Rate: 7.4 symbols/min [2025-10-07T17:29:14.617265] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:14.671908] [DEBUG] [LOCAL ] BBD: Loaded 53215 existing records from primary storage. [2025-10-07T17:29:14.672263] [INFO ] [MAIN ] BBD: Loaded 53215 existing records. [2025-10-07T17:29:14.847180] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:29:14.847397] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-07T17:29:14.847445] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-07T17:29:14.847722] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-07T17:29:14.847780] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-07T17:29:15.055988] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-07T17:29:15.214904] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:15.247835] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T17:29:15.847691] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-07T17:29:16.521702] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:29:16.647747] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-07T17:29:16.887146] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-07T17:29:17.447697] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-07T17:29:17.471979] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T17:29:17.475713] [INFO ] [REMOTE ] BAX: Full fetch complete (77440 records). [2025-10-07T17:29:17.475846] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-07T17:29:17.872828] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-07T17:29:17.873022] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-07T17:29:17.873969] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-07T17:29:17.874039] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-07T17:29:17.875625] [DEBUG] [LOCAL ] BAX: Trimmed 77440 records to 53504 (keeping 200 days of data) [2025-10-07T17:29:18.247073] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T17:29:18.250072] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-07T17:29:18.281163] [DEBUG] [LOCAL ] BAX: Primary data saved (53504 records). [2025-10-07T17:29:18.281303] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-07T17:29:18.281695] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BAX took 44.7s. Estimated remaining: 4h 50m 11s. Rate: 7.4 symbols/min [2025-10-07T17:29:18.476866] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:18.509850] [DEBUG] [LOCAL ] BBDC: Loaded 32900 existing records from primary storage. [2025-10-07T17:29:18.510194] [INFO ] [MAIN ] BBDC: Loaded 32900 existing records. [2025-10-07T17:29:18.715148] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:29:18.715417] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-07T17:29:18.715507] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-07T17:29:18.715791] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-07T17:29:18.715856] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-07T17:29:19.055503] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-07T17:29:19.126384] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:19.157682] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T17:29:19.847769] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-07T17:29:20.549581] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T17:29:20.647599] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-07T17:29:20.899305] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-07T17:29:20.902919] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-07T17:29:20.903040] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-07T17:29:21.294185] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-07T17:29:21.294387] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-07T17:29:21.295201] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-07T17:29:21.295266] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-07T17:29:21.297025] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-07T17:29:21.460280] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-07T17:29:21.617705] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-07T17:29:21.617870] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-07T17:29:21.618506] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAI took 41.0s. Estimated remaining: 4h 49m 16s. Rate: 7.4 symbols/min [2025-10-07T17:29:21.792919] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:21.802535] [DEBUG] [LOCAL ] BBDO: Loaded 4950 existing records from primary storage. [2025-10-07T17:29:21.803005] [INFO ] [MAIN ] BBDO: Loaded 4950 existing records. [2025-10-07T17:29:21.987124] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:29:21.987486] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-07T17:29:21.987539] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-07T17:29:21.987868] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-07T17:29:21.987938] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-07T17:29:22.357302] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:22.357797] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-07T17:29:22.418904] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-07T17:29:22.430290] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T17:29:23.047713] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-07T17:29:23.242187] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T17:29:23.847619] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-07T17:29:23.998953] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-07T17:29:24.274178] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T17:29:24.356403] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-07T17:29:24.647685] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-07T17:29:25.447740] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-07T17:29:26.051866] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T17:29:26.247713] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-07T17:29:26.791968] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-07T17:29:27.047702] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-07T17:29:27.599405] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T17:29:27.847742] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-07T17:29:28.496314] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T17:29:28.647928] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-07T17:29:29.447719] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-07T17:29:29.459806] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T17:29:29.463215] [INFO ] [REMOTE ] BBAR: Full fetch complete (60991 records). [2025-10-07T17:29:29.463356] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-07T17:29:29.848569] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-07T17:29:29.848760] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-07T17:29:29.849522] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-07T17:29:29.849572] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-07T17:29:29.851160] [DEBUG] [LOCAL ] BBAR: Trimmed 60991 records to 41683 (keeping 200 days of data) [2025-10-07T17:29:30.098031] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T17:29:30.115949] [DEBUG] [LOCAL ] BBAR: Primary data saved (41683 records). [2025-10-07T17:29:30.116085] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-07T17:29:30.117164] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBAR took 29.0s. Estimated remaining: 4h 49m 12s. Rate: 7.4 symbols/min [2025-10-07T17:29:30.259557] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-07T17:29:30.291024] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:30.292391] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-07T17:29:30.292996] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-07T17:29:30.293292] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-07T17:29:30.293359] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-07T17:29:30.293416] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-07T17:29:30.293457] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-07T17:29:30.691757] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T17:29:30.713487] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:31.047676] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-07T17:29:31.123353] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-07T17:29:31.847716] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-07T17:29:32.647639] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-07T17:29:33.091348] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-07T17:29:33.225356] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T17:29:33.297967] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T17:29:33.447712] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-07T17:29:34.247691] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-07T17:29:34.779600] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T17:29:35.047626] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-07T17:29:35.201698] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T17:29:35.847752] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-07T17:29:36.631790] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T17:29:36.647614] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-07T17:29:36.672475] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T17:29:37.447705] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-07T17:29:38.247670] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-07T17:29:38.396858] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T17:29:38.443078] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T17:29:39.047697] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-07T17:29:39.267437] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T17:29:39.847742] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-07T17:29:40.615819] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T17:29:40.647605] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-07T17:29:40.703804] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T17:29:41.447728] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-07T17:29:42.247639] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-07T17:29:42.436041] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T17:29:42.503324] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T17:29:42.899275] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-07T17:29:43.047718] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-07T17:29:43.847747] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-07T17:29:44.525668] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T17:29:44.647672] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-07T17:29:45.447698] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-07T17:29:45.700902] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T17:29:45.872244] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-07T17:29:46.247706] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-07T17:29:47.047714] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-07T17:29:47.216344] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T17:29:47.285722] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-07T17:29:47.289373] [INFO ] [REMOTE ] BBD: Full fetch complete (77112 records). [2025-10-07T17:29:47.289499] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-07T17:29:47.677956] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-07T17:29:47.678076] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-07T17:29:47.678949] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-07T17:29:47.679023] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-07T17:29:47.680562] [DEBUG] [LOCAL ] BBD: Trimmed 77112 records to 53239 (keeping 200 days of data) [2025-10-07T17:29:47.849893] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-07T17:29:48.002180] [DEBUG] [LOCAL ] BBD: Primary data saved (53239 records). [2025-10-07T17:29:48.002329] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-07T17:29:48.003282] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBD took 33.6s. Estimated remaining: 4h 50m 40s. Rate: 7.4 symbols/min [2025-10-07T17:29:48.125351] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T17:29:48.203964] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:48.204168] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-07T17:29:48.204205] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-07T17:29:48.204348] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-07T17:29:48.204391] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-07T17:29:48.204449] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-07T17:29:48.204481] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-07T17:29:48.546716] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:48.647682] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-07T17:29:48.719213] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T17:29:49.447689] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-07T17:29:49.769592] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T17:29:50.164316] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T17:29:50.247781] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-07T17:29:50.897211] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T17:29:51.047732] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-07T17:29:51.847731] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-07T17:29:52.032070] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:29:52.032317] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-07T17:29:52.032401] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:29:52.032447] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-07T17:29:52.032508] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:29:52.032581] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-07T17:29:52.032672] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-07T17:29:52.032730] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-07T17:29:52.032776] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-07T17:29:52.032823] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBT took 4.0s. Estimated remaining: 4h 49m 52s. Rate: 7.4 symbols/min [2025-10-07T17:29:52.201551] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:52.210136] [DEBUG] [LOCAL ] BBU: Loaded 4930 existing records from primary storage. [2025-10-07T17:29:52.210364] [INFO ] [MAIN ] BBU: Loaded 4930 existing records. [2025-10-07T17:29:52.345677] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T17:29:52.414854] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:29:52.415097] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-07T17:29:52.415149] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-07T17:29:52.415400] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-07T17:29:52.415460] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-07T17:29:52.647719] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-07T17:29:52.770186] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:53.222701] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T17:29:53.223786] [INFO ] [REMOTE ] BBDO: Full fetch complete (7645 records). [2025-10-07T17:29:53.223855] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-07T17:29:53.457846] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-07T17:29:53.577838] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-07T17:29:53.577922] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-07T17:29:53.578151] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-07T17:29:53.578191] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-07T17:29:53.578620] [DEBUG] [LOCAL ] BBDO: Trimmed 7645 records to 4997 (keeping 200 days of data) [2025-10-07T17:29:53.607724] [DEBUG] [LOCAL ] BBDO: Primary data saved (4997 records). [2025-10-07T17:29:53.607832] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-07T17:29:53.607915] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBDO took 32.0s. Estimated remaining: 4h 48m 41s. Rate: 7.4 symbols/min [2025-10-07T17:29:53.780100] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:53.795389] [DEBUG] [LOCAL ] BBUC: Loaded 13388 existing records from primary storage. [2025-10-07T17:29:53.795638] [INFO ] [MAIN ] BBUC: Loaded 13388 existing records. [2025-10-07T17:29:53.969302] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:29:53.969539] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-07T17:29:53.969587] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-07T17:29:53.969799] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-07T17:29:53.969858] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-07T17:29:54.255389] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-07T17:29:54.272324] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T17:29:54.333558] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:55.047679] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-07T17:29:55.598521] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T17:29:55.601221] [INFO ] [REMOTE ] BBDC: Full fetch complete (48524 records). [2025-10-07T17:29:55.601311] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-07T17:29:55.714026] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-07T17:29:55.853225] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-07T17:29:55.982487] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-07T17:29:55.982574] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-07T17:29:55.983207] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-07T17:29:55.983273] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-07T17:29:55.984388] [DEBUG] [LOCAL ] BBDC: Trimmed 48524 records to 32890 (keeping 200 days of data) [2025-10-07T17:29:56.188468] [DEBUG] [LOCAL ] BBDC: Primary data saved (32890 records). [2025-10-07T17:29:56.188635] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-07T17:29:56.188827] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDC took 37.9s. Estimated remaining: 4h 47m 40s. Rate: 7.5 symbols/min [2025-10-07T17:29:56.353668] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:29:56.402894] [DEBUG] [LOCAL ] BBVA: Loaded 49200 existing records from primary storage. [2025-10-07T17:29:56.403230] [INFO ] [MAIN ] BBVA: Loaded 49200 existing records. [2025-10-07T17:29:56.576543] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:29:56.576826] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-07T17:29:56.576882] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-07T17:29:56.577240] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-07T17:29:56.577301] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-07T17:29:56.652815] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-07T17:29:56.805412] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T17:29:56.945536] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:29:57.447678] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-07T17:29:57.645935] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T17:29:58.060180] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-07T17:29:58.247618] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-07T17:29:58.795394] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T17:29:59.047699] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-07T17:29:59.847730] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-07T17:30:00.629056] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T17:30:00.647600] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-07T17:30:00.787632] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T17:30:01.448822] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-07T17:30:01.451398] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T17:30:02.247737] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-07T17:30:02.628253] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-07T17:30:03.047634] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-07T17:30:03.243075] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-07T17:30:03.847688] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-07T17:30:04.258831] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T17:30:04.501929] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T17:30:04.647694] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-07T17:30:05.447694] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-07T17:30:05.891497] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-07T17:30:06.247637] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-07T17:30:06.387591] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T17:30:06.806251] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-07T17:30:07.047700] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-07T17:30:07.847679] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-07T17:30:07.996898] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T17:30:07.998221] [INFO ] [REMOTE ] BBN: Full fetch complete (26160 records). [2025-10-07T17:30:07.998333] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-07T17:30:07.998965] [FATAL] [VALIDATOR ] BBN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:30:07.999062] [FATAL] [MAIN ] BBN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:30:07.999106] [WARN ] [MAIN ] BBN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:30:07.999180] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-07T17:30:07.999290] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-07T17:30:07.999346] [INFO ] [LOCAL ] BBN: Starting deletion of derivative data. [2025-10-07T17:30:07.999390] [DEBUG] [LOCAL ] BBN: No derivative data file found to delete. [2025-10-07T17:30:07.999447] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBN took 37.9s. Estimated remaining: 4h 48m 8s. Rate: 7.5 symbols/min [2025-10-07T17:30:08.168456] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:30:08.200162] [DEBUG] [LOCAL ] BBW: Loaded 26836 existing records from primary storage. [2025-10-07T17:30:08.200497] [INFO ] [MAIN ] BBW: Loaded 26836 existing records. [2025-10-07T17:30:08.382234] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:30:08.382452] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-07T17:30:08.382508] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-07T17:30:08.382763] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-07T17:30:08.382821] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-07T17:30:08.652567] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-07T17:30:08.731987] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:30:09.447684] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-07T17:30:09.621894] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T17:30:09.905629] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T17:30:10.247682] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-07T17:30:10.866006] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T17:30:11.053682] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-07T17:30:11.057060] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T17:30:11.847684] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-07T17:30:12.471248] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T17:30:12.647706] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-07T17:30:13.447613] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-07T17:30:13.838027] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T17:30:13.875997] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T17:30:14.090136] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T17:30:14.247689] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-07T17:30:14.881456] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T17:30:15.047682] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-07T17:30:15.841192] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T17:30:15.847591] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-07T17:30:16.647723] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-07T17:30:16.784005] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T17:30:17.447670] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-07T17:30:17.591475] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T17:30:18.093485] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T17:30:18.247729] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-07T17:30:19.047627] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-07T17:30:19.054492] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T17:30:19.847680] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-07T17:30:20.426265] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T17:30:20.647720] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-07T17:30:21.447622] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-07T17:30:21.555410] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T17:30:21.619532] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T17:30:22.247752] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-07T17:30:22.393559] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T17:30:22.395528] [INFO ] [REMOTE ] BBUC: Full fetch complete (18384 records). [2025-10-07T17:30:22.395639] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-07T17:30:22.765226] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-07T17:30:22.765318] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-07T17:30:22.765631] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-07T17:30:22.765710] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-07T17:30:22.766404] [DEBUG] [LOCAL ] BBUC: Trimmed 18384 records to 13427 (keeping 200 days of data) [2025-10-07T17:30:22.848477] [DEBUG] [LOCAL ] BBUC: Primary data saved (13427 records). [2025-10-07T17:30:22.848626] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-07T17:30:22.848748] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBUC took 29.2s. Estimated remaining: 4h 49m 5s. Rate: 7.4 symbols/min [2025-10-07T17:30:23.017003] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:30:23.051009] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-07T17:30:23.074705] [DEBUG] [LOCAL ] BBWI: Loaded 53581 existing records from primary storage. [2025-10-07T17:30:23.075072] [INFO ] [MAIN ] BBWI: Loaded 53581 existing records. [2025-10-07T17:30:23.258699] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:30:23.258944] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-07T17:30:23.259009] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-07T17:30:23.259439] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-07T17:30:23.259517] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-07T17:30:23.621475] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:30:23.847622] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-07T17:30:23.910604] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T17:30:23.912817] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T17:30:24.647750] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-07T17:30:25.447676] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-07T17:30:25.662108] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T17:30:26.252415] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-07T17:30:26.258303] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T17:30:26.518336] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T17:30:27.047688] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-07T17:30:27.814635] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T17:30:27.847601] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-07T17:30:28.090448] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T17:30:28.647690] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-07T17:30:29.447673] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-07T17:30:29.540038] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T17:30:29.541347] [INFO ] [REMOTE ] BBU: Full fetch complete (6912 records). [2025-10-07T17:30:29.541417] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-07T17:30:29.844259] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-07T17:30:29.966697] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-07T17:30:29.966807] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-07T17:30:29.967077] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-07T17:30:29.967121] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-07T17:30:29.967529] [DEBUG] [LOCAL ] BBU: Trimmed 6912 records to 5038 (keeping 200 days of data) [2025-10-07T17:30:30.000878] [DEBUG] [LOCAL ] BBU: Primary data saved (5038 records). [2025-10-07T17:30:30.001003] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-07T17:30:30.001094] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBU took 38.0s. Estimated remaining: 4h 48m 48s. Rate: 7.4 symbols/min [2025-10-07T17:30:30.177040] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:30:30.231975] [DEBUG] [LOCAL ] BBY: Loaded 53463 existing records from primary storage. [2025-10-07T17:30:30.232392] [INFO ] [MAIN ] BBY: Loaded 53463 existing records. [2025-10-07T17:30:30.253532] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-07T17:30:30.417517] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:30:30.417781] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-07T17:30:30.417832] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-07T17:30:30.418146] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-07T17:30:30.418204] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-07T17:30:30.741919] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T17:30:30.799981] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:30:31.047629] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-07T17:30:31.847621] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-07T17:30:32.172631] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T17:30:32.647701] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-07T17:30:32.827060] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T17:30:33.447634] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-07T17:30:33.481376] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T17:30:33.872279] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T17:30:34.247702] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-07T17:30:34.907550] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T17:30:35.047613] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-07T17:30:35.847622] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-07T17:30:36.048440] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T17:30:36.638908] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T17:30:36.651533] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-07T17:30:37.061332] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T17:30:37.447691] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-07T17:30:37.598263] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T17:30:37.600955] [INFO ] [REMOTE ] BBW: Full fetch complete (39484 records). [2025-10-07T17:30:37.601035] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-07T17:30:38.018702] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-07T17:30:38.018819] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-07T17:30:38.019404] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-07T17:30:38.019472] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-07T17:30:38.020469] [DEBUG] [LOCAL ] BBW: Trimmed 39484 records to 27006 (keeping 200 days of data) [2025-10-07T17:30:38.199898] [DEBUG] [LOCAL ] BBW: Primary data saved (27006 records). [2025-10-07T17:30:38.200042] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-07T17:30:38.200129] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBW took 30.2s. Estimated remaining: 4h 48m 41s. Rate: 7.4 symbols/min [2025-10-07T17:30:38.256400] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-07T17:30:38.372108] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:30:38.413318] [DEBUG] [LOCAL ] BC: Loaded 44177 existing records from primary storage. [2025-10-07T17:30:38.413675] [INFO ] [MAIN ] BC: Loaded 44177 existing records. [2025-10-07T17:30:38.590325] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:30:38.590622] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-07T17:30:38.590735] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-07T17:30:38.591188] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-07T17:30:38.591263] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-07T17:30:38.956739] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:30:38.983912] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T17:30:39.047614] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-07T17:30:39.847714] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-07T17:30:39.918858] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T17:30:40.643549] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T17:30:40.652986] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-07T17:30:41.447741] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-07T17:30:41.551422] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T17:30:41.762272] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T17:30:42.247705] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-07T17:30:42.972565] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T17:30:43.047731] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-07T17:30:43.211502] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T17:30:43.847699] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-07T17:30:44.564035] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T17:30:44.567635] [INFO ] [REMOTE ] BBVA: Full fetch complete (71591 records). [2025-10-07T17:30:44.567793] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-07T17:30:44.652736] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-07T17:30:44.967353] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-07T17:30:44.967458] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-07T17:30:44.968218] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-07T17:30:44.968284] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-07T17:30:44.969755] [DEBUG] [LOCAL ] BBVA: Trimmed 71591 records to 49183 (keeping 200 days of data) [2025-10-07T17:30:45.264634] [DEBUG] [LOCAL ] BBVA: Primary data saved (49183 records). [2025-10-07T17:30:45.264916] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-07T17:30:45.265036] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBVA took 49.1s. Estimated remaining: 4h 48m 24s. Rate: 7.4 symbols/min [2025-10-07T17:30:45.438224] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:30:45.447710] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-07T17:30:45.493878] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T17:30:45.516591] [DEBUG] [LOCAL ] BCAT: Loaded 34068 existing records from primary storage. [2025-10-07T17:30:45.516964] [INFO ] [MAIN ] BCAT: Loaded 34068 existing records. [2025-10-07T17:30:45.695759] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:30:45.695968] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-07T17:30:45.696017] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-07T17:30:45.696337] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-07T17:30:45.696395] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-07T17:30:46.044575] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:30:46.247690] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-07T17:30:46.286423] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T17:30:47.047671] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-07T17:30:47.298907] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T17:30:47.847738] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-07T17:30:47.911150] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T17:30:48.404204] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T17:30:48.647730] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-07T17:30:49.447708] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-07T17:30:49.515786] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T17:30:50.247730] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-07T17:30:50.901430] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T17:30:50.936693] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-07T17:30:51.047694] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-07T17:30:51.553814] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T17:30:51.847711] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-07T17:30:52.647629] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-07T17:30:52.775733] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T17:30:52.779384] [INFO ] [REMOTE ] BBWI: Full fetch complete (77439 records). [2025-10-07T17:30:52.779504] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-07T17:30:53.190357] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-07T17:30:53.190477] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-07T17:30:53.191444] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-07T17:30:53.191585] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-07T17:30:53.221769] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T17:30:53.219636] [DEBUG] [LOCAL ] BBWI: Trimmed 77439 records to 53581 (keeping 200 days of data) [2025-10-07T17:30:53.452288] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-07T17:30:53.577897] [DEBUG] [LOCAL ] BBWI: Primary data saved (53581 records). [2025-10-07T17:30:53.578065] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-07T17:30:53.578681] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBWI took 30.7s. Estimated remaining: 4h 48m 18s. Rate: 7.4 symbols/min [2025-10-07T17:30:53.750239] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:30:53.801250] [DEBUG] [LOCAL ] BCC: Loaded 28240 existing records from primary storage. [2025-10-07T17:30:53.801555] [INFO ] [MAIN ] BCC: Loaded 28240 existing records. [2025-10-07T17:30:54.003384] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:30:54.003634] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-07T17:30:54.003717] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-07T17:30:54.004160] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-07T17:30:54.004217] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-07T17:30:54.252887] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-07T17:30:54.400942] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:30:54.691418] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-07T17:30:54.879995] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T17:30:55.047697] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-07T17:30:55.436782] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T17:30:55.847737] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-07T17:30:56.034438] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T17:30:56.647707] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-07T17:30:57.223263] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T17:30:57.447705] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-07T17:30:57.572986] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T17:30:58.247679] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-07T17:30:58.915532] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T17:30:59.047724] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-07T17:30:59.847710] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-07T17:31:00.283903] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T17:31:00.319921] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T17:31:00.647629] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-07T17:31:00.970540] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T17:31:01.447678] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-07T17:31:02.247695] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-07T17:31:02.560217] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T17:31:02.620048] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-07T17:31:03.047699] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-07T17:31:03.384724] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T17:31:03.847700] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-07T17:31:04.647629] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-07T17:31:04.723290] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T17:31:04.727088] [INFO ] [REMOTE ] BC: Full fetch complete (63707 records). [2025-10-07T17:31:04.727235] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-07T17:31:05.135815] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-07T17:31:05.143284] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-07T17:31:05.144302] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-07T17:31:05.144395] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-07T17:31:05.146559] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T17:31:05.155770] [DEBUG] [LOCAL ] BC: Trimmed 63707 records to 44173 (keeping 200 days of data) [2025-10-07T17:31:05.440395] [DEBUG] [LOCAL ] BC: Primary data saved (44173 records). [2025-10-07T17:31:05.440551] [INFO ] [MAIN ] BC: Full history saved. [2025-10-07T17:31:05.441519] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BC took 27.2s. Estimated remaining: 4h 48m 45s. Rate: 7.4 symbols/min [2025-10-07T17:31:05.449681] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-07T17:31:05.619906] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:31:05.685586] [DEBUG] [LOCAL ] BCE: Loaded 52216 existing records from primary storage. [2025-10-07T17:31:05.685958] [INFO ] [MAIN ] BCE: Loaded 52216 existing records. [2025-10-07T17:31:05.894496] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:31:05.896516] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T17:31:05.896630] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-07T17:31:05.903584] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-07T17:31:05.904857] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-07T17:31:05.904933] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-07T17:31:06.249877] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-07T17:31:06.253595] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:31:07.049471] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-07T17:31:07.051419] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T17:31:07.847701] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-07T17:31:08.008940] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T17:31:08.208099] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T17:31:08.647684] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-07T17:31:09.351908] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T17:31:09.447612] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-07T17:31:10.247615] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-07T17:31:10.474243] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-07T17:31:10.477825] [INFO ] [REMOTE ] BBY: Full fetch complete (77231 records). [2025-10-07T17:31:10.477941] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-07T17:31:10.880272] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T17:31:10.915985] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-07T17:31:10.916447] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-07T17:31:10.917662] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-07T17:31:10.917767] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-07T17:31:10.919816] [DEBUG] [LOCAL ] BBY: Trimmed 77231 records to 53455 (keeping 200 days of data) [2025-10-07T17:31:11.050401] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-07T17:31:11.256404] [DEBUG] [LOCAL ] BBY: Primary data saved (53455 records). [2025-10-07T17:31:11.256539] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-07T17:31:11.256635] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BBY took 41.3s. Estimated remaining: 4h 48m 16s. Rate: 7.4 symbols/min [2025-10-07T17:31:11.440681] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:31:11.472991] [DEBUG] [LOCAL ] BCH: Loaded 29704 existing records from primary storage. [2025-10-07T17:31:11.473460] [INFO ] [MAIN ] BCH: Loaded 29704 existing records. [2025-10-07T17:31:11.557977] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T17:31:11.671495] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:31:11.671779] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-07T17:31:11.671832] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-07T17:31:11.672076] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-07T17:31:11.672114] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-07T17:31:11.858180] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-07T17:31:12.038198] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:31:12.342711] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T17:31:12.345242] [INFO ] [REMOTE ] BCAT: Full fetch complete (50084 records). [2025-10-07T17:31:12.345344] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-07T17:31:12.652786] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-07T17:31:12.734909] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-07T17:31:12.735003] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-07T17:31:12.735597] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-07T17:31:12.735666] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-07T17:31:12.736929] [DEBUG] [LOCAL ] BCAT: Trimmed 50084 records to 34059 (keeping 200 days of data) [2025-10-07T17:31:12.951475] [DEBUG] [LOCAL ] BCAT: Primary data saved (34059 records). [2025-10-07T17:31:12.951635] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-07T17:31:12.951767] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 27.7s. Estimated remaining: 4h 47m 9s. Rate: 7.4 symbols/min [2025-10-07T17:31:13.120596] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:31:13.147226] [DEBUG] [LOCAL ] BCO: Loaded 25863 existing records from primary storage. [2025-10-07T17:31:13.147483] [INFO ] [MAIN ] BCO: Loaded 25863 existing records. [2025-10-07T17:31:13.319617] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:31:13.319881] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-07T17:31:13.319927] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-07T17:31:13.320224] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-07T17:31:13.320280] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-07T17:31:13.466072] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-07T17:31:13.671466] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:31:13.847061] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T17:31:13.994607] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T17:31:14.247635] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-07T17:31:14.506456] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T17:31:15.047746] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-07T17:31:15.264977] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T17:31:15.847678] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-07T17:31:16.017389] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T17:31:16.647685] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-07T17:31:16.917704] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T17:31:17.447672] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-07T17:31:18.250864] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-07T17:31:18.254204] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T17:31:18.438776] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T17:31:19.047614] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-07T17:31:19.370809] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T17:31:19.847726] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-07T17:31:20.292973] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T17:31:20.647678] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-07T17:31:20.961383] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T17:31:21.447739] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-07T17:31:22.257479] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-07T17:31:22.263402] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T17:31:22.760269] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T17:31:23.047637] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-07T17:31:23.067893] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T17:31:23.847627] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-07T17:31:24.070600] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T17:31:24.073751] [INFO ] [REMOTE ] BCC: Full fetch complete (40720 records). [2025-10-07T17:31:24.073880] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-07T17:31:24.074700] [FATAL] [VALIDATOR ] BCC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:31:24.074805] [FATAL] [MAIN ] BCC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:31:24.074879] [WARN ] [MAIN ] BCC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:31:24.074978] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-07T17:31:24.075065] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-07T17:31:24.075109] [INFO ] [LOCAL ] BCC: Starting deletion of derivative data. [2025-10-07T17:31:24.075345] [DEBUG] [LOCAL ] BCC: Deleted derivative data file. [2025-10-07T17:31:24.075457] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 30.5s. Estimated remaining: 4h 47m 29s. Rate: 7.4 symbols/min [2025-10-07T17:31:24.293382] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:31:24.354002] [DEBUG] [LOCAL ] BCS: Loaded 53449 existing records from primary storage. [2025-10-07T17:31:24.354711] [INFO ] [MAIN ] BCS: Loaded 53449 existing records. [2025-10-07T17:31:24.529566] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:31:24.529860] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-07T17:31:24.529910] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-07T17:31:24.530362] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-07T17:31:24.530422] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-07T17:31:24.652769] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-07T17:31:24.909592] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:31:25.231335] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T17:31:25.447693] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-07T17:31:25.956047] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T17:31:26.247725] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-07T17:31:27.047632] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-07T17:31:27.124392] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T17:31:27.847610] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-07T17:31:28.149891] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T17:31:28.221919] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T17:31:28.647745] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-07T17:31:29.151067] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-07T17:31:29.447687] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-07T17:31:30.247713] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-07T17:31:30.415084] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T17:31:30.485098] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T17:31:31.047692] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-07T17:31:31.847700] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-07T17:31:32.142683] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T17:31:32.253663] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T17:31:32.647741] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-07T17:31:33.107636] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-07T17:31:33.447743] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-07T17:31:34.247769] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-07T17:31:34.511972] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T17:31:34.564713] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T17:31:35.047720] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-07T17:31:35.408678] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T17:31:35.847770] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-07T17:31:36.647691] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-07T17:31:36.860707] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T17:31:37.447707] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-07T17:31:37.671984] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T17:31:37.733070] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T17:31:38.247734] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-07T17:31:39.047635] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-07T17:31:39.150202] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T17:31:39.329763] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T17:31:39.332323] [INFO ] [REMOTE ] BCH: Full fetch complete (40920 records). [2025-10-07T17:31:39.332410] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-07T17:31:39.699729] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-07T17:31:39.699818] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-07T17:31:39.700306] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-07T17:31:39.700347] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-07T17:31:39.701236] [DEBUG] [LOCAL ] BCH: Trimmed 40920 records to 29740 (keeping 200 days of data) [2025-10-07T17:31:39.856312] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-07T17:31:39.875139] [DEBUG] [LOCAL ] BCH: Primary data saved (29740 records). [2025-10-07T17:31:39.875253] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-07T17:31:39.876127] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCH took 28.6s. Estimated remaining: 4h 48m 31s. Rate: 7.4 symbols/min [2025-10-07T17:31:40.052748] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:31:40.089290] [DEBUG] [LOCAL ] BCSF: Loaded 27719 existing records from primary storage. [2025-10-07T17:31:40.089560] [INFO ] [MAIN ] BCSF: Loaded 27719 existing records. [2025-10-07T17:31:40.268635] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T17:31:40.281271] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:31:40.286963] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-07T17:31:40.287370] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-07T17:31:40.287927] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-07T17:31:40.287985] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-07T17:31:40.625036] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:31:40.647601] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-07T17:31:41.447623] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-07T17:31:41.603399] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-07T17:31:41.871060] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T17:31:42.247688] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-07T17:31:42.912050] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T17:31:43.047623] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-07T17:31:43.442800] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T17:31:43.847634] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-07T17:31:44.073356] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T17:31:44.647736] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-07T17:31:44.911432] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-07T17:31:45.447731] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-07T17:31:46.247739] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-07T17:31:46.417273] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T17:31:47.047716] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-07T17:31:47.284022] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T17:31:47.372360] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T17:31:47.847680] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-07T17:31:48.481472] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T17:31:48.647704] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-07T17:31:48.749268] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T17:31:49.447722] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-07T17:31:49.723659] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T17:31:49.725184] [INFO ] [REMOTE ] BCO: Full fetch complete (36418 records). [2025-10-07T17:31:49.725262] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-07T17:31:49.725973] [FATAL] [VALIDATOR ] BCO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:31:49.726056] [FATAL] [MAIN ] BCO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:31:49.726101] [WARN ] [MAIN ] BCO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:31:49.726170] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-07T17:31:49.726237] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-10-07T17:31:49.726273] [INFO ] [LOCAL ] BCO: Starting deletion of derivative data. [2025-10-07T17:31:49.726481] [DEBUG] [LOCAL ] BCO: Deleted derivative data file. [2025-10-07T17:31:49.726574] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCO took 36.8s. Estimated remaining: 4h 48m 39s. Rate: 7.4 symbols/min [2025-10-07T17:31:49.893921] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:31:49.916103] [DEBUG] [LOCAL ] BCX: Loaded 21592 existing records from primary storage. [2025-10-07T17:31:49.916378] [INFO ] [MAIN ] BCX: Loaded 21592 existing records. [2025-10-07T17:31:50.117863] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:31:50.118112] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-07T17:31:50.118162] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-07T17:31:50.118401] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-07T17:31:50.118468] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-07T17:31:50.258287] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-07T17:31:50.474251] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:31:50.725825] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T17:31:50.729942] [INFO ] [REMOTE ] BCE: Full fetch complete (75959 records). [2025-10-07T17:31:50.730136] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-07T17:31:51.052742] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-07T17:31:51.132551] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-07T17:31:51.132634] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-07T17:31:51.133457] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-07T17:31:51.133507] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-07T17:31:51.135171] [DEBUG] [LOCAL ] BCE: Trimmed 75959 records to 52205 (keeping 200 days of data) [2025-10-07T17:31:51.457127] [DEBUG] [LOCAL ] BCE: Primary data saved (52205 records). [2025-10-07T17:31:51.457267] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-07T17:31:51.458689] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCE took 46.0s. Estimated remaining: 4h 47m 33s. Rate: 7.4 symbols/min [2025-10-07T17:31:51.632463] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:31:51.659437] [DEBUG] [LOCAL ] BDC: Loaded 24628 existing records from primary storage. [2025-10-07T17:31:51.659725] [INFO ] [MAIN ] BDC: Loaded 24628 existing records. [2025-10-07T17:31:51.838852] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:31:51.856772] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-07T17:31:51.856880] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-07T17:31:51.856569] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-07T17:31:51.858960] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T17:31:51.859009] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-07T17:31:51.866148] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-07T17:31:52.216434] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:31:52.647715] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-07T17:31:52.869572] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T17:31:52.961105] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T17:31:53.447731] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-07T17:31:53.658907] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T17:31:54.247714] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-07T17:31:55.047676] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-07T17:31:55.268107] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T17:31:55.362666] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T17:31:55.847762] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-07T17:31:56.254578] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T17:31:56.647739] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-07T17:31:56.910065] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T17:31:57.447685] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-07T17:31:57.596842] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T17:31:58.247632] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-07T17:31:58.509920] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T17:31:59.047752] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-07T17:31:59.469034] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T17:31:59.847705] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-07T17:32:00.647630] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-07T17:32:00.807577] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T17:32:01.001722] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T17:32:01.447703] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-07T17:32:01.941774] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T17:32:02.247730] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-07T17:32:02.443166] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T17:32:03.047718] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-07T17:32:03.847701] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-07T17:32:04.254746] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T17:32:04.335975] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-07T17:32:04.647638] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-07T17:32:04.975988] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T17:32:05.447730] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-07T17:32:05.803273] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T17:32:06.247691] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-07T17:32:06.603349] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T17:32:07.047677] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-07T17:32:07.643910] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T17:32:07.648741] [INFO ] [REMOTE ] BCS: Full fetch complete (76943 records). [2025-10-07T17:32:07.649043] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-07T17:32:07.650887] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:32:07.651010] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:32:07.651054] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:32:07.651109] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-07T17:32:07.651196] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-07T17:32:07.651234] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-10-07T17:32:07.651429] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-10-07T17:32:07.651960] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCS took 43.6s. Estimated remaining: 4h 48m 38s. Rate: 7.4 symbols/min [2025-10-07T17:32:07.847712] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-07T17:32:08.058129] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T17:32:08.647700] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-07T17:32:09.352929] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T17:32:09.354990] [INFO ] [REMOTE ] BCSF: Full fetch complete (38449 records). [2025-10-07T17:32:09.355069] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-07T17:32:09.355678] [FATAL] [VALIDATOR ] BCSF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:32:09.355764] [FATAL] [MAIN ] BCSF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:32:09.355814] [WARN ] [MAIN ] BCSF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:32:09.355896] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-07T17:32:09.355994] [DEBUG] [LOCAL ] BCSF: No primary data file found to delete. [2025-10-07T17:32:09.356085] [INFO ] [LOCAL ] BCSF: Starting deletion of derivative data. [2025-10-07T17:32:09.356279] [DEBUG] [LOCAL ] BCSF: Deleted derivative data file. [2025-10-07T17:32:09.357268] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCSF took 29.5s. Estimated remaining: 4h 47m 33s. Rate: 7.4 symbols/min [2025-10-07T17:32:09.447626] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-07T17:32:09.736836] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T17:32:10.247762] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-07T17:32:10.611710] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T17:32:11.047627] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-07T17:32:11.311179] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T17:32:11.847754] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-07T17:32:12.258441] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T17:32:12.647739] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-07T17:32:12.971670] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T17:32:13.447681] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-07T17:32:13.826819] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T17:32:14.247685] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-07T17:32:14.589454] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T17:32:14.592146] [INFO ] [REMOTE ] BCX: Full fetch complete (33702 records). [2025-10-07T17:32:14.592236] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-07T17:32:14.593173] [FATAL] [VALIDATOR ] BCX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:32:14.593264] [FATAL] [MAIN ] BCX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:32:14.593310] [WARN ] [MAIN ] BCX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:32:14.593357] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-07T17:32:14.593499] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-07T17:32:14.593569] [INFO ] [LOCAL ] BCX: Starting deletion of derivative data. [2025-10-07T17:32:14.593884] [DEBUG] [LOCAL ] BCX: Deleted derivative data file. [2025-10-07T17:32:14.594018] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCX took 24.9s. Estimated remaining: 4h 46m 59s. Rate: 7.4 symbols/min [2025-10-07T17:32:15.583780] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T17:32:15.591875] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-07T17:32:16.722771] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T17:32:16.728565] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-07T17:32:17.824340] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T17:32:17.829789] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-07T17:32:18.773378] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T17:32:18.775438] [INFO ] [REMOTE ] BDC: Full fetch complete (35953 records). [2025-10-07T17:32:18.775524] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-07T17:32:19.142701] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-07T17:32:19.142792] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-07T17:32:19.143244] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-07T17:32:19.143335] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-07T17:32:19.144573] [DEBUG] [LOCAL ] BDC: Trimmed 35953 records to 24590 (keeping 200 days of data) [2025-10-07T17:32:19.304156] [DEBUG] [LOCAL ] BDC: Primary data saved (24590 records). [2025-10-07T17:32:19.304295] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-07T17:32:19.304378] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 27.8s. Estimated remaining: 4h 46m 21s. Rate: 7.4 symbols/min [2025-10-07T17:32:19.935160] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:32:19.931958] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:32:20.008819] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:32:20.037425] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:32:20.038181] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-07T17:32:20.038485] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-07T17:32:20.038719] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-07T17:32:20.038810] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-07T17:32:20.038895] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-07T17:32:20.038945] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-07T17:32:20.226182] [DEBUG] [LOCAL ] BDJ: Loaded 28945 existing records from primary storage. [2025-10-07T17:32:20.304488] [INFO ] [MAIN ] BDJ: Loaded 28945 existing records. [2025-10-07T17:32:20.380164] [DEBUG] [LOCAL ] BDN: Loaded 47524 existing records from primary storage. [2025-10-07T17:32:20.435535] [INFO ] [MAIN ] BDN: Loaded 47524 existing records. [2025-10-07T17:32:20.487814] [DEBUG] [LOCAL ] BDX: Loaded 52322 existing records from primary storage. [2025-10-07T17:32:20.545945] [INFO ] [MAIN ] BDX: Loaded 52322 existing records. [2025-10-07T17:32:20.841580] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:32:20.894881] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-07T17:32:21.046858] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:32:21.162852] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-07T17:32:21.230703] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:32:21.231088] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-07T17:32:21.231169] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-07T17:32:21.231469] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-07T17:32:21.231532] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-07T17:32:21.237564] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-07T17:32:21.301273] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-07T17:32:21.356763] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-07T17:32:21.365299] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:32:21.467118] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-07T17:32:21.515388] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-07T17:32:21.564729] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-07T17:32:21.624814] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-07T17:32:22.224893] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:32:22.356222] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:32:22.350882] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-07T17:32:22.380667] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-07T17:32:22.510035] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:32:22.510400] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-07T17:32:22.961588] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-07T17:32:22.972286] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-07T17:32:23.581542] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T17:32:23.587947] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-07T17:32:24.099380] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T17:32:24.114405] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-07T17:32:24.149897] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T17:32:24.160480] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-07T17:32:24.656232] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T17:32:24.667082] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-07T17:32:24.851461] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T17:32:24.858143] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-07T17:32:25.624538] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:32:25.635342] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-07T17:32:25.669043] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T17:32:25.846693] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T17:32:26.099022] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T17:32:26.247686] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-07T17:32:27.047706] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-07T17:32:27.200278] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T17:32:27.847695] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-07T17:32:28.152431] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-07T17:32:28.245633] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-07T17:32:28.647768] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-07T17:32:29.332487] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T17:32:29.447606] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-07T17:32:29.739569] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-07T17:32:30.247699] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-07T17:32:30.815322] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T17:32:31.047623] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-07T17:32:31.084557] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T17:32:31.847711] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-07T17:32:32.647711] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-07T17:32:33.181395] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-07T17:32:33.367716] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T17:32:33.447603] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-07T17:32:33.548851] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T17:32:34.247692] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-07T17:32:35.025122] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T17:32:35.047711] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-07T17:32:35.635090] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T17:32:35.847630] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-07T17:32:36.647727] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-07T17:32:36.881781] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T17:32:37.447734] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-07T17:32:37.753409] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T17:32:38.247682] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-07T17:32:38.665674] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-07T17:32:38.825030] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T17:32:39.047711] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-07T17:32:39.847749] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-07T17:32:39.982732] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T17:32:40.647617] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-07T17:32:40.744970] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-07T17:32:40.982565] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T17:32:41.447687] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-07T17:32:42.135961] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T17:32:42.247742] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-07T17:32:43.047669] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-07T17:32:43.188311] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T17:32:43.190471] [INFO ] [REMOTE ] BDJ: Full fetch complete (42913 records). [2025-10-07T17:32:43.190552] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-07T17:32:43.581548] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-07T17:32:43.616710] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-07T17:32:43.617239] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-07T17:32:43.618202] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-07T17:32:43.618796] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-07T17:32:43.620192] [DEBUG] [LOCAL ] BDJ: Trimmed 42913 records to 29018 (keeping 200 days of data) [2025-10-07T17:32:43.818233] [DEBUG] [LOCAL ] BDJ: Primary data saved (29018 records). [2025-10-07T17:32:43.818427] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-07T17:32:43.818542] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 24.5s. Estimated remaining: 4h 48m 39s. Rate: 7.4 symbols/min [2025-10-07T17:32:43.854742] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-07T17:32:44.026151] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:32:44.026390] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-07T17:32:44.026467] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-07T17:32:44.026665] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-07T17:32:44.026747] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-07T17:32:44.026848] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-07T17:32:44.026925] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-07T17:32:44.463437] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:32:44.647680] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-07T17:32:45.065890] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-07T17:32:45.447745] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-07T17:32:45.636279] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T17:32:46.247619] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-07T17:32:46.277169] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-07T17:32:46.314487] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T17:32:47.047696] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-07T17:32:47.830947] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T17:32:47.834274] [INFO ] [REMOTE ] BDX: Full fetch complete (75628 records). [2025-10-07T17:32:47.834384] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-07T17:32:47.855321] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-07T17:32:48.212488] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-07T17:32:48.238948] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-07T17:32:48.239041] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-07T17:32:48.239910] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-07T17:32:48.239983] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-07T17:32:48.241624] [DEBUG] [LOCAL ] BDX: Trimmed 75628 records to 52271 (keeping 200 days of data) [2025-10-07T17:32:48.585941] [DEBUG] [LOCAL ] BDX: Primary data saved (52271 records). [2025-10-07T17:32:48.586197] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-07T17:32:48.586300] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDX took 29.3s. Estimated remaining: 4h 48m 1s. Rate: 7.4 symbols/min [2025-10-07T17:32:48.652952] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-07T17:32:48.757728] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:32:48.808399] [DEBUG] [LOCAL ] BEKE: Loaded 53233 existing records from primary storage. [2025-10-07T17:32:48.808834] [INFO ] [MAIN ] BEKE: Loaded 53233 existing records. [2025-10-07T17:32:48.986450] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:32:48.986881] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-07T17:32:48.986958] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-07T17:32:48.987402] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-07T17:32:48.987463] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-07T17:32:49.346948] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-07T17:32:49.387888] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:32:49.447624] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-07T17:32:50.156375] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T17:32:50.247733] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-07T17:32:51.047618] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-07T17:32:51.413024] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T17:32:51.847677] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-07T17:32:52.647724] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-07T17:32:52.733355] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T17:32:52.822409] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-07T17:32:52.958362] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-07T17:32:53.447680] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-07T17:32:53.482255] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T17:32:54.247669] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-07T17:32:54.701637] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-07T17:32:55.047460] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T17:32:55.047626] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-07T17:32:55.847677] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-07T17:32:56.306505] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-07T17:32:56.647633] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-07T17:32:56.930285] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-07T17:32:57.447697] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-07T17:32:57.735447] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-07T17:32:57.960096] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T17:32:58.247670] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-07T17:32:59.047701] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-07T17:32:59.847769] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-07T17:33:00.647686] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-07T17:33:00.706387] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T17:33:00.709795] [INFO ] [REMOTE ] BDN: Full fetch complete (69246 records). [2025-10-07T17:33:00.709935] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-07T17:33:00.928077] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-07T17:33:01.003446] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-07T17:33:01.015628] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-07T17:33:01.022845] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-07T17:33:01.281167] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-07T17:33:01.301704] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-07T17:33:01.303992] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-07T17:33:01.319765] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-07T17:33:01.420187] [DEBUG] [LOCAL ] BDN: Trimmed 69246 records to 47541 (keeping 200 days of data) [2025-10-07T17:33:01.447857] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-07T17:33:01.652192] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-07T17:33:01.652759] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-07T17:33:01.654802] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-07T17:33:01.655197] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-07T17:33:01.661075] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53659 (keeping 200 days of data) [2025-10-07T17:33:01.904283] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T17:33:01.963465] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-07T17:33:02.168420] [DEBUG] [LOCAL ] BDN: Primary data saved (47541 records). [2025-10-07T17:33:02.169426] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-07T17:33:02.170560] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDN took 42.9s. Estimated remaining: 4h 48m 41s. Rate: 7.4 symbols/min [2025-10-07T17:33:02.247989] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-07T17:33:02.440839] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:33:02.471582] [DEBUG] [LOCAL ] BE: Primary data saved (53659 records). [2025-10-07T17:33:02.485887] [INFO ] [MAIN ] BE: Full history saved. [2025-10-07T17:33:02.486071] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BE took 43.1s. Estimated remaining: 4h 47m 24s. Rate: 7.4 symbols/min [2025-10-07T17:33:02.632792] [DEBUG] [LOCAL ] BEN: Loaded 53043 existing records from primary storage. [2025-10-07T17:33:02.659283] [INFO ] [MAIN ] BEN: Loaded 53043 existing records. [2025-10-07T17:33:02.732820] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:33:02.872979] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:33:02.873300] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-07T17:33:02.873351] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-07T17:33:02.873687] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-07T17:33:02.873744] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-07T17:33:03.076356] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-07T17:33:03.113319] [DEBUG] [LOCAL ] BEP: Loaded 38802 existing records from primary storage. [2025-10-07T17:33:03.141073] [INFO ] [MAIN ] BEP: Loaded 38802 existing records. [2025-10-07T17:33:03.477149] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:33:03.500258] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:33:03.500631] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-07T17:33:03.500982] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-07T17:33:03.500445] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-07T17:33:03.501952] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-07T17:33:03.502013] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-07T17:33:03.856873] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-07T17:33:03.861992] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:33:04.235273] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-07T17:33:04.238680] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T17:33:04.647683] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-07T17:33:05.447727] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-07T17:33:06.247631] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-07T17:33:06.295111] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T17:33:06.930170] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T17:33:06.930968] [INFO ] [REMOTE ] BEDU: Full fetch complete (1383 records). [2025-10-07T17:33:06.931040] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-07T17:33:06.931548] [FATAL] [VALIDATOR ] BEDU: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:33:06.931694] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:33:06.931766] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:33:06.931844] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-07T17:33:06.931910] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-07T17:33:06.931946] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-07T17:33:06.932002] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-07T17:33:06.932095] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 23.1s. Estimated remaining: 4h 46m 45s. Rate: 7.4 symbols/min [2025-10-07T17:33:07.053972] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-07T17:33:07.165157] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:33:07.170442] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T17:33:07.221917] [DEBUG] [LOCAL ] BEPC: Loaded 46439 existing records from primary storage. [2025-10-07T17:33:07.222288] [INFO ] [MAIN ] BEPC: Loaded 46439 existing records. [2025-10-07T17:33:07.410624] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:33:07.410994] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-07T17:33:07.411053] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-07T17:33:07.411701] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-07T17:33:07.411776] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-07T17:33:07.758425] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:33:07.847691] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-07T17:33:08.439785] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T17:33:08.647681] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-07T17:33:09.447638] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-07T17:33:09.672738] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T17:33:10.247689] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-07T17:33:10.300914] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T17:33:11.047616] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-07T17:33:11.362285] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T17:33:11.424468] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T17:33:11.847719] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-07T17:33:12.647729] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-07T17:33:13.149786] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-07T17:33:13.447744] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-07T17:33:13.697400] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T17:33:14.253906] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-07T17:33:14.277613] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T17:33:14.768394] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T17:33:15.047708] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-07T17:33:15.786426] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T17:33:15.847631] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-07T17:33:16.647779] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-07T17:33:16.717085] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T17:33:17.447670] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-07T17:33:17.531503] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T17:33:18.010319] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T17:33:18.247680] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-07T17:33:19.047713] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-07T17:33:19.252221] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T17:33:19.711153] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T17:33:19.847667] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-07T17:33:20.647693] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-07T17:33:20.920509] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T17:33:21.447739] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-07T17:33:21.489422] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T17:33:21.493287] [INFO ] [REMOTE ] BEKE: Full fetch complete (77188 records). [2025-10-07T17:33:21.493399] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-07T17:33:21.917302] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-07T17:33:21.917412] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-07T17:33:21.918554] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-07T17:33:21.918634] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-07T17:33:21.920266] [DEBUG] [LOCAL ] BEKE: Trimmed 77188 records to 53231 (keeping 200 days of data) [2025-10-07T17:33:22.167805] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T17:33:22.257012] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-07T17:33:22.283322] [DEBUG] [LOCAL ] BEKE: Primary data saved (53231 records). [2025-10-07T17:33:22.283487] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-07T17:33:22.283576] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEKE took 33.7s. Estimated remaining: 4h 47m 39s. Rate: 7.4 symbols/min [2025-10-07T17:33:22.454804] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:33:22.462020] [DEBUG] [LOCAL ] BEPH: Loaded 5361 existing records from primary storage. [2025-10-07T17:33:22.462260] [INFO ] [MAIN ] BEPH: Loaded 5361 existing records. [2025-10-07T17:33:22.650952] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:33:22.651192] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-07T17:33:22.651241] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-07T17:33:22.651471] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-07T17:33:22.651555] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-07T17:33:23.021572] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:33:23.047630] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-07T17:33:23.213564] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T17:33:23.684873] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T17:33:23.798879] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T17:33:23.847741] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-07T17:33:24.647720] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-07T17:33:25.139682] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-07T17:33:25.318168] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T17:33:25.447681] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-07T17:33:26.052126] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T17:33:26.247700] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-07T17:33:26.848879] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T17:33:27.047787] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-07T17:33:27.655835] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T17:33:27.847710] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-07T17:33:28.647738] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-07T17:33:29.447638] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-07T17:33:29.567356] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T17:33:30.247713] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-07T17:33:30.394061] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T17:33:31.047617] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-07T17:33:31.324637] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T17:33:31.847705] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-07T17:33:32.028470] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T17:33:32.267493] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T17:33:32.647725] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-07T17:33:33.447783] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-07T17:33:33.742409] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T17:33:34.247691] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-07T17:33:34.499716] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T17:33:34.554464] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T17:33:34.558615] [INFO ] [REMOTE ] BEP: Full fetch complete (58580 records). [2025-10-07T17:33:34.558841] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-07T17:33:34.949862] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-07T17:33:34.949941] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-07T17:33:34.950582] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-07T17:33:34.950626] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-07T17:33:34.952030] [DEBUG] [LOCAL ] BEP: Trimmed 58580 records to 38827 (keeping 200 days of data) [2025-10-07T17:33:35.048106] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-07T17:33:35.197148] [DEBUG] [LOCAL ] BEP: Primary data saved (38827 records). [2025-10-07T17:33:35.197297] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-07T17:33:35.197392] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 32.7s. Estimated remaining: 4h 48m 12s. Rate: 7.4 symbols/min [2025-10-07T17:33:35.368174] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:33:35.374380] [DEBUG] [LOCAL ] BEPI: Loaded 3572 existing records from primary storage. [2025-10-07T17:33:35.374565] [INFO ] [MAIN ] BEPI: Loaded 3572 existing records. [2025-10-07T17:33:35.553995] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:33:35.554184] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-07T17:33:35.554231] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-07T17:33:35.554420] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-07T17:33:35.554476] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-07T17:33:35.849923] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-07T17:33:35.851672] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T17:33:35.933961] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:33:35.964143] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T17:33:36.647682] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-07T17:33:37.447715] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-07T17:33:37.500947] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T17:33:38.203989] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T17:33:38.247702] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-07T17:33:38.296444] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T17:33:38.635086] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-07T17:33:39.047695] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-07T17:33:39.537861] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T17:33:39.847688] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-07T17:33:40.647735] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-07T17:33:41.376182] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T17:33:41.447636] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-07T17:33:42.131672] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T17:33:42.247720] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-07T17:33:42.840950] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T17:33:42.843777] [INFO ] [REMOTE ] BEPC: Full fetch complete (68246 records). [2025-10-07T17:33:42.843873] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-07T17:33:42.844718] [FATAL] [VALIDATOR ] BEPC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:33:42.844806] [FATAL] [MAIN ] BEPC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:33:42.844849] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:33:42.844889] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-07T17:33:42.844947] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-07T17:33:42.845026] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-10-07T17:33:42.845272] [DEBUG] [LOCAL ] BEPC: Deleted derivative data file. [2025-10-07T17:33:42.845948] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEPC took 35.9s. Estimated remaining: 4h 47m 60s. Rate: 7.4 symbols/min [2025-10-07T17:33:43.014088] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:33:43.014338] [DEBUG] [LOCAL ] BEPJ: No existing data file found in primary storage. [2025-10-07T17:33:43.014394] [WARN ] [MAIN ] BEPJ: No existing data found, performing full refresh instead. [2025-10-07T17:33:43.014510] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-07T17:33:43.014552] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-07T17:33:43.014594] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-10-07T17:33:43.014626] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-07T17:33:43.056286] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-07T17:33:43.372191] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:33:43.514148] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-07T17:33:43.850850] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-07T17:33:43.856898] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T17:33:44.302395] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-07T17:33:44.647715] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-07T17:33:45.209616] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T17:33:45.447753] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-07T17:33:45.935501] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T17:33:46.247704] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-07T17:33:46.768581] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-07T17:33:47.047625] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-07T17:33:47.664842] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T17:33:47.847695] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-07T17:33:48.303440] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-07T17:33:48.647732] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-07T17:33:49.206149] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-07T17:33:49.447727] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-07T17:33:50.247692] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-07T17:33:50.714051] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-07T17:33:51.047713] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-07T17:33:51.248311] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T17:33:51.252229] [INFO ] [REMOTE ] BEN: Full fetch complete (76910 records). [2025-10-07T17:33:51.252345] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-07T17:33:51.699395] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-07T17:33:51.699545] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-07T17:33:51.700409] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-07T17:33:51.700474] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-07T17:33:51.701975] [DEBUG] [LOCAL ] BEN: Trimmed 76910 records to 53046 (keeping 200 days of data) [2025-10-07T17:33:51.818154] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T17:33:51.847673] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-07T17:33:52.061789] [DEBUG] [LOCAL ] BEN: Primary data saved (53046 records). [2025-10-07T17:33:52.061932] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-07T17:33:52.062016] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEN took 49.9s. Estimated remaining: 4h 48m 1s. Rate: 7.4 symbols/min [2025-10-07T17:33:52.226106] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:33:52.259793] [DEBUG] [LOCAL ] BFAM: Loaded 33360 existing records from primary storage. [2025-10-07T17:33:52.260081] [INFO ] [MAIN ] BFAM: Loaded 33360 existing records. [2025-10-07T17:33:52.418309] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-07T17:33:52.438843] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:33:52.440811] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-07T17:33:52.440911] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-07T17:33:52.441180] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-07T17:33:52.441239] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-07T17:33:52.698319] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-07T17:33:52.895214] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:33:53.397069] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T17:33:53.447685] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-07T17:33:53.983092] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-07T17:33:54.247753] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-07T17:33:54.869927] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-07T17:33:55.047675] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-07T17:33:55.847735] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-07T17:33:56.304986] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-07T17:33:56.418551] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T17:33:56.647688] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-07T17:33:57.414357] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T17:33:57.415342] [INFO ] [REMOTE ] BEPH: Full fetch complete (7704 records). [2025-10-07T17:33:57.415411] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-07T17:33:57.452915] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-07T17:33:57.773106] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-07T17:33:57.773188] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-07T17:33:57.773413] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-07T17:33:57.773454] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-07T17:33:57.773890] [DEBUG] [LOCAL ] BEPH: Trimmed 7704 records to 5357 (keeping 200 days of data) [2025-10-07T17:33:57.806110] [DEBUG] [LOCAL ] BEPH: Primary data saved (5357 records). [2025-10-07T17:33:57.806251] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-07T17:33:57.806395] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPH took 35.5s. Estimated remaining: 4h 47m 32s. Rate: 7.4 symbols/min [2025-10-07T17:33:57.974711] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:33:57.974913] [DEBUG] [LOCAL ] BFH: No existing data file found in primary storage. [2025-10-07T17:33:57.974952] [WARN ] [MAIN ] BFH: No existing data found, performing full refresh instead. [2025-10-07T17:33:57.975063] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-07T17:33:57.975105] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-07T17:33:57.975145] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-07T17:33:57.975177] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-07T17:33:58.079527] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-07T17:33:58.252751] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-07T17:33:58.345125] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:33:58.924832] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T17:33:59.047716] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-07T17:33:59.627158] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T17:33:59.847684] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-07T17:34:00.647753] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-07T17:34:01.272872] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T17:34:01.409487] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T17:34:01.447757] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-07T17:34:02.247746] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-07T17:34:02.875997] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T17:34:03.047633] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-07T17:34:03.542081] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T17:34:03.847672] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-07T17:34:04.084065] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T17:34:04.305871] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-07T17:34:04.647692] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-07T17:34:05.447678] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-07T17:34:06.171969] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T17:34:06.172833] [INFO ] [REMOTE ] BEPI: Full fetch complete (4876 records). [2025-10-07T17:34:06.172903] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-07T17:34:06.249630] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-07T17:34:06.566815] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T17:34:06.609592] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-07T17:34:06.609715] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-07T17:34:06.610084] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-07T17:34:06.610142] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-07T17:34:06.610538] [DEBUG] [LOCAL ] BEPI: Trimmed 4876 records to 3587 (keeping 200 days of data) [2025-10-07T17:34:06.633359] [DEBUG] [LOCAL ] BEPI: Primary data saved (3587 records). [2025-10-07T17:34:06.633426] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-07T17:34:06.633497] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPI took 31.4s. Estimated remaining: 4h 47m 30s. Rate: 7.4 symbols/min [2025-10-07T17:34:06.736912] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-07T17:34:06.807622] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:34:06.825753] [DEBUG] [LOCAL ] BFK: Loaded 13725 existing records from primary storage. [2025-10-07T17:34:06.826000] [INFO ] [MAIN ] BFK: Loaded 13725 existing records. [2025-10-07T17:34:07.000665] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:34:07.000905] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-07T17:34:07.000954] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-07T17:34:07.001458] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-07T17:34:07.001524] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-07T17:34:07.053764] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-07T17:34:07.356606] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:34:07.847679] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-07T17:34:08.647773] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-07T17:34:08.800905] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T17:34:09.082311] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T17:34:09.088230] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T17:34:09.089597] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4487 records). [2025-10-07T17:34:09.089701] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-07T17:34:09.454219] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-07T17:34:09.463993] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-07T17:34:09.464077] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-07T17:34:09.464231] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-07T17:34:09.464273] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-07T17:34:09.464674] [DEBUG] [LOCAL ] BEPJ: Trimmed 4487 records to 3141 (keeping 200 days of data) [2025-10-07T17:34:09.484449] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3141 records). [2025-10-07T17:34:09.484546] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-07T17:34:09.484613] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPJ took 26.6s. Estimated remaining: 4h 46m 38s. Rate: 7.4 symbols/min [2025-10-07T17:34:09.652539] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:34:09.702496] [DEBUG] [LOCAL ] BFLY: Loaded 51804 existing records from primary storage. [2025-10-07T17:34:09.702858] [INFO ] [MAIN ] BFLY: Loaded 51804 existing records. [2025-10-07T17:34:09.891216] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:34:09.891465] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-07T17:34:09.891512] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-07T17:34:09.891840] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-07T17:34:09.891898] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-07T17:34:10.249451] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-07T17:34:10.251769] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:34:11.003015] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T17:34:11.047627] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-07T17:34:11.705444] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T17:34:11.847731] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-07T17:34:12.505105] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T17:34:12.647719] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-07T17:34:13.182814] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T17:34:13.447734] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-07T17:34:13.962931] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T17:34:14.247727] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-07T17:34:14.969791] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T17:34:15.029741] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T17:34:15.047606] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-07T17:34:15.847739] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-07T17:34:15.869748] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T17:34:16.647689] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-07T17:34:17.353388] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T17:34:17.447616] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-07T17:34:18.145960] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T17:34:18.247609] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-07T17:34:19.047734] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-07T17:34:19.224027] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T17:34:19.309211] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T17:34:19.688532] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T17:34:19.847677] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-07T17:34:20.647740] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-07T17:34:20.843327] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-07T17:34:21.447722] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-07T17:34:22.167729] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T17:34:22.247752] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-07T17:34:23.020010] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T17:34:23.039630] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T17:34:23.047597] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-07T17:34:23.840019] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T17:34:23.847601] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-07T17:34:24.647765] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-07T17:34:25.300561] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-07T17:34:25.447722] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-07T17:34:25.625088] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T17:34:26.247726] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-07T17:34:26.877863] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T17:34:26.881153] [INFO ] [REMOTE ] BFH: Full fetch complete (59797 records). [2025-10-07T17:34:26.881266] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-07T17:34:27.058244] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-07T17:34:27.274205] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-07T17:34:27.274311] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-07T17:34:27.275188] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-07T17:34:27.275254] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-07T17:34:27.276578] [DEBUG] [LOCAL ] BFH: Trimmed 59797 records to 41518 (keeping 200 days of data) [2025-10-07T17:34:27.525096] [DEBUG] [LOCAL ] BFH: Primary data saved (41518 records). [2025-10-07T17:34:27.525227] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-07T17:34:27.525297] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFH took 29.7s. Estimated remaining: 4h 47m 53s. Rate: 7.4 symbols/min [2025-10-07T17:34:27.695234] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:34:27.706154] [DEBUG] [LOCAL ] BFS: Loaded 9256 existing records from primary storage. [2025-10-07T17:34:27.706379] [INFO ] [MAIN ] BFS: Loaded 9256 existing records. [2025-10-07T17:34:27.850265] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-07T17:34:27.894574] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:34:27.896412] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-07T17:34:27.896524] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-07T17:34:27.896805] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-07T17:34:27.896868] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-07T17:34:28.131905] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-07T17:34:28.303687] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:34:28.498766] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T17:34:28.647668] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-07T17:34:28.891942] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T17:34:29.447750] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-07T17:34:29.762837] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T17:34:30.247687] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-07T17:34:31.047719] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-07T17:34:31.275257] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T17:34:31.380472] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T17:34:31.847734] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-07T17:34:31.905273] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T17:34:32.647704] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-07T17:34:32.997457] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T17:34:33.447716] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-07T17:34:33.713498] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T17:34:34.247711] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-07T17:34:34.300249] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T17:34:35.047708] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-07T17:34:35.684948] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T17:34:35.850498] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-07T17:34:35.851278] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-07T17:34:35.853695] [INFO ] [REMOTE ] BFK: Full fetch complete (19128 records). [2025-10-07T17:34:35.853777] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-07T17:34:36.247878] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-07T17:34:36.247960] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-07T17:34:36.248309] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-07T17:34:36.248348] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-07T17:34:36.249000] [DEBUG] [LOCAL ] BFK: Trimmed 19128 records to 13628 (keeping 200 days of data) [2025-10-07T17:34:36.331003] [DEBUG] [LOCAL ] BFK: Primary data saved (13628 records). [2025-10-07T17:34:36.331156] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-07T17:34:36.331254] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFK took 29.7s. Estimated remaining: 4h 47m 50s. Rate: 7.4 symbols/min [2025-10-07T17:34:36.500539] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:34:36.515484] [DEBUG] [LOCAL ] BFZ: Loaded 11936 existing records from primary storage. [2025-10-07T17:34:36.515741] [INFO ] [MAIN ] BFZ: Loaded 11936 existing records. [2025-10-07T17:34:36.654224] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-07T17:34:36.701768] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-07T17:34:36.706027] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:34:36.706328] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-07T17:34:36.708954] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-07T17:34:36.709208] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-07T17:34:36.709267] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-07T17:34:37.065288] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:34:37.447717] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-07T17:34:38.206043] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-07T17:34:38.247618] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-07T17:34:38.390225] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T17:34:39.038187] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T17:34:39.047590] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-07T17:34:39.799709] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T17:34:39.847738] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-07T17:34:40.647722] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-07T17:34:41.447774] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-07T17:34:41.686539] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T17:34:42.161040] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T17:34:42.247715] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-07T17:34:42.346435] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T17:34:43.047698] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-07T17:34:43.851681] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-07T17:34:43.857826] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T17:34:44.020060] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-07T17:34:44.025076] [INFO ] [REMOTE ] BFLY: Full fetch complete (75294 records). [2025-10-07T17:34:44.025243] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-07T17:34:44.424519] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-07T17:34:44.424628] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-07T17:34:44.425441] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-07T17:34:44.425495] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-07T17:34:44.427037] [DEBUG] [LOCAL ] BFLY: Trimmed 75294 records to 51810 (keeping 200 days of data) [2025-10-07T17:34:44.647855] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-07T17:34:44.728261] [DEBUG] [LOCAL ] BFLY: Primary data saved (51810 records). [2025-10-07T17:34:44.728441] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-07T17:34:44.729048] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFLY took 35.2s. Estimated remaining: 4h 47m 44s. Rate: 7.4 symbols/min [2025-10-07T17:34:44.899521] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:34:44.899724] [DEBUG] [LOCAL ] BG: No existing data file found in primary storage. [2025-10-07T17:34:44.899773] [WARN ] [MAIN ] BG: No existing data found, performing full refresh instead. [2025-10-07T17:34:44.899883] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-07T17:34:44.899944] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-07T17:34:44.900028] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-07T17:34:44.900070] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-07T17:34:45.182771] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T17:34:45.207454] [INFO ] [REMOTE ] BFAM: Full fetch complete (47078 records). [2025-10-07T17:34:45.237723] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-07T17:34:45.295600] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:34:45.452974] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-07T17:34:45.660665] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-07T17:34:45.660828] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-07T17:34:45.661395] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-07T17:34:45.661438] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-07T17:34:45.662537] [DEBUG] [LOCAL ] BFAM: Trimmed 47078 records to 33486 (keeping 200 days of data) [2025-10-07T17:34:45.860854] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T17:34:45.890367] [DEBUG] [LOCAL ] BFAM: Primary data saved (33486 records). [2025-10-07T17:34:45.890528] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-07T17:34:45.891523] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFAM took 53.8s. Estimated remaining: 4h 46m 38s. Rate: 7.4 symbols/min [2025-10-07T17:34:46.055972] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:34:46.084939] [DEBUG] [LOCAL ] BGB: Loaded 17794 existing records from primary storage. [2025-10-07T17:34:46.085266] [INFO ] [MAIN ] BGB: Loaded 17794 existing records. [2025-10-07T17:34:46.254257] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-07T17:34:46.259096] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:34:46.260428] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-07T17:34:46.260479] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-07T17:34:46.260734] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-07T17:34:46.260793] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-07T17:34:46.606812] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:34:47.047705] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-07T17:34:47.107045] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T17:34:47.424534] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T17:34:47.773507] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T17:34:47.847732] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-07T17:34:48.647694] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-07T17:34:48.765961] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T17:34:49.268671] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-07T17:34:49.447696] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-07T17:34:50.247689] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-07T17:34:50.556837] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T17:34:51.047636] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-07T17:34:51.142200] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T17:34:51.847736] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-07T17:34:52.075771] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T17:34:52.647709] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-07T17:34:52.724149] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T17:34:52.725568] [INFO ] [REMOTE ] BFS: Full fetch complete (12803 records). [2025-10-07T17:34:52.725667] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-07T17:34:53.120352] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-07T17:34:53.120496] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-07T17:34:53.121115] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-07T17:34:53.121211] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-07T17:34:53.122533] [DEBUG] [LOCAL ] BFS: Trimmed 12803 records to 9327 (keeping 200 days of data) [2025-10-07T17:34:53.189559] [DEBUG] [LOCAL ] BFS: Primary data saved (9327 records). [2025-10-07T17:34:53.189813] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-07T17:34:53.189936] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFS took 25.7s. Estimated remaining: 4h 46m 23s. Rate: 7.4 symbols/min [2025-10-07T17:34:53.371324] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:34:53.392221] [DEBUG] [LOCAL ] BGH: Loaded 17115 existing records from primary storage. [2025-10-07T17:34:53.392623] [INFO ] [MAIN ] BGH: Loaded 17115 existing records. [2025-10-07T17:34:53.455861] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-07T17:34:53.644555] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:34:53.644904] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-07T17:34:53.644960] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-07T17:34:53.645210] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-07T17:34:53.645270] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-07T17:34:54.040485] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:34:54.115523] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T17:34:54.247688] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-07T17:34:54.355839] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T17:34:54.842954] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T17:34:55.047696] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-07T17:34:55.775468] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T17:34:55.847621] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-07T17:34:56.639400] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T17:34:56.647589] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-07T17:34:57.447680] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-07T17:34:57.806503] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T17:34:58.252667] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T17:34:58.251504] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-07T17:34:59.047724] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-07T17:34:59.086946] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-07T17:34:59.847729] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-07T17:35:00.059671] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T17:35:00.566212] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T17:35:00.647696] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-07T17:35:01.447777] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-07T17:35:02.247640] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-07T17:35:02.484192] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T17:35:02.755792] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-07T17:35:03.047689] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-07T17:35:03.345527] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T17:35:03.847723] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-07T17:35:03.973624] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-07T17:35:04.628548] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-07T17:35:04.647670] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-07T17:35:05.447689] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-07T17:35:05.510518] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T17:35:06.235847] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T17:35:06.247590] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-07T17:35:07.047689] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-07T17:35:07.071772] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T17:35:07.812767] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T17:35:07.847631] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-07T17:35:08.647751] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-07T17:35:08.672157] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T17:35:09.447723] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-07T17:35:10.252790] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-07T17:35:10.260437] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T17:35:10.420020] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T17:35:10.941399] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-07T17:35:11.047616] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-07T17:35:11.847750] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-07T17:35:12.023131] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T17:35:12.655943] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-07T17:35:12.659157] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T17:35:13.447622] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-07T17:35:13.751814] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T17:35:14.069959] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T17:35:14.071609] [INFO ] [REMOTE ] BFZ: Full fetch complete (17837 records). [2025-10-07T17:35:14.071730] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-07T17:35:14.252795] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-07T17:35:14.652523] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-07T17:35:14.652683] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-07T17:35:14.653385] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-07T17:35:14.653464] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-07T17:35:14.654541] [DEBUG] [LOCAL ] BFZ: Trimmed 17837 records to 11914 (keeping 200 days of data) [2025-10-07T17:35:14.768754] [DEBUG] [LOCAL ] BFZ: Primary data saved (11914 records). [2025-10-07T17:35:14.768968] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-07T17:35:14.769121] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 38.4s. Estimated remaining: 4h 48m 5s. Rate: 7.3 symbols/min [2025-10-07T17:35:15.043176] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:35:15.047676] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-07T17:35:15.061546] [DEBUG] [LOCAL ] BGR: Loaded 13477 existing records from primary storage. [2025-10-07T17:35:15.061898] [INFO ] [MAIN ] BGR: Loaded 13477 existing records. [2025-10-07T17:35:15.262328] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:35:15.263789] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-07T17:35:15.263555] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T17:35:15.265789] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-07T17:35:15.265931] [INFO ] [REMOTE ] BGH: Full fetch complete (22446 records). [2025-10-07T17:35:15.266073] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-07T17:35:15.266371] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-07T17:35:15.267007] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-07T17:35:15.266960] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:35:15.305258] [FATAL] [MAIN ] BGH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:35:15.345623] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:35:15.368506] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-07T17:35:15.378862] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-07T17:35:15.379221] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-10-07T17:35:15.400193] [DEBUG] [LOCAL ] BGH: Deleted derivative data file. [2025-10-07T17:35:15.405416] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 22.2s. Estimated remaining: 4h 46m 55s. Rate: 7.4 symbols/min [2025-10-07T17:35:15.751954] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:35:15.818561] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:35:15.848816] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-07T17:35:15.871945] [DEBUG] [LOCAL ] BGS: Loaded 50464 existing records from primary storage. [2025-10-07T17:35:15.872281] [INFO ] [MAIN ] BGS: Loaded 50464 existing records. [2025-10-07T17:35:16.050606] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:35:16.050907] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-07T17:35:16.050954] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-07T17:35:16.051227] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-07T17:35:16.051283] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-07T17:35:16.158574] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T17:35:16.411477] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:35:16.647709] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-07T17:35:17.010117] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T17:35:17.447747] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-07T17:35:18.218021] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T17:35:18.247601] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-07T17:35:18.321246] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T17:35:18.323344] [INFO ] [REMOTE ] BGB: Full fetch complete (27144 records). [2025-10-07T17:35:18.323425] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-07T17:35:18.702509] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-07T17:35:18.702588] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-07T17:35:18.702994] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-07T17:35:18.703056] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-07T17:35:18.703783] [DEBUG] [LOCAL ] BGB: Trimmed 27144 records to 17853 (keeping 200 days of data) [2025-10-07T17:35:18.815014] [DEBUG] [LOCAL ] BGB: Primary data saved (17853 records). [2025-10-07T17:35:18.815160] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-07T17:35:18.815290] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGB took 32.9s. Estimated remaining: 4h 46m 8s. Rate: 7.4 symbols/min [2025-10-07T17:35:18.986020] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:35:18.995690] [DEBUG] [LOCAL ] BGSF: Loaded 7637 existing records from primary storage. [2025-10-07T17:35:18.995865] [INFO ] [MAIN ] BGSF: Loaded 7637 existing records. [2025-10-07T17:35:19.056873] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-07T17:35:19.172736] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:35:19.173149] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-07T17:35:19.173202] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-07T17:35:19.173367] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-07T17:35:19.173424] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-07T17:35:19.550550] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:35:19.847673] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-07T17:35:19.933417] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T17:35:20.025516] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T17:35:20.388574] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-07T17:35:20.647674] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-07T17:35:21.285341] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T17:35:21.447684] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-07T17:35:22.247735] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-07T17:35:23.047680] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-07T17:35:23.294475] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T17:35:23.719751] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:35:23.720237] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T17:35:23.847703] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-07T17:35:24.647898] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-07T17:35:25.447681] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-07T17:35:25.475795] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T17:35:25.509419] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T17:35:26.247697] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-07T17:35:27.047715] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-07T17:35:27.289268] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T17:35:27.312761] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T17:35:27.341626] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-07T17:35:27.847722] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-07T17:35:28.647692] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-07T17:35:29.450158] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-07T17:35:29.453250] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T17:35:29.473911] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T17:35:29.985510] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-07T17:35:30.247682] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-07T17:35:31.047704] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-07T17:35:31.700688] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-07T17:35:31.778668] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T17:35:31.847705] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-07T17:35:32.647760] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-07T17:35:33.447632] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-07T17:35:33.547953] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T17:35:33.580888] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T17:35:34.247691] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-07T17:35:35.047715] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-07T17:35:35.075257] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T17:35:35.250219] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T17:35:35.847618] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-07T17:35:36.317745] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T17:35:36.321206] [INFO ] [REMOTE ] BG: Full fetch complete (72762 records). [2025-10-07T17:35:36.321326] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-07T17:35:36.431494] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T17:35:36.662707] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-07T17:35:36.725271] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-07T17:35:36.725361] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-07T17:35:36.726204] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-07T17:35:36.726272] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-07T17:35:36.727753] [DEBUG] [LOCAL ] BG: Trimmed 72762 records to 50444 (keeping 200 days of data) [2025-10-07T17:35:37.040025] [DEBUG] [LOCAL ] BG: Primary data saved (50444 records). [2025-10-07T17:35:37.040204] [INFO ] [MAIN ] BG: Full history saved. [2025-10-07T17:35:37.040313] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BG took 52.3s. Estimated remaining: 4h 47m 22s. Rate: 7.3 symbols/min [2025-10-07T17:35:37.211896] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:35:37.230517] [DEBUG] [LOCAL ] BGT: Loaded 16588 existing records from primary storage. [2025-10-07T17:35:37.230819] [INFO ] [MAIN ] BGT: Loaded 16588 existing records. [2025-10-07T17:35:37.424970] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:35:37.425569] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-07T17:35:37.425634] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-07T17:35:37.425962] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-07T17:35:37.426023] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-07T17:35:37.459554] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-07T17:35:37.542340] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-07T17:35:37.803080] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:35:38.247708] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-07T17:35:39.047677] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-07T17:35:39.130904] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T17:35:39.147675] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T17:35:39.847706] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-07T17:35:39.870188] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-07T17:35:40.647692] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-07T17:35:40.681409] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T17:35:41.200516] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T17:35:41.447721] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-07T17:35:42.247675] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-07T17:35:42.500524] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T17:35:43.047737] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-07T17:35:43.066405] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T17:35:43.847677] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-07T17:35:44.355837] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T17:35:44.647717] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-07T17:35:45.367669] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T17:35:45.368978] [INFO ] [REMOTE ] BGR: Full fetch complete (20152 records). [2025-10-07T17:35:45.369054] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-07T17:35:45.448736] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-07T17:35:45.686551] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T17:35:45.783307] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-07T17:35:45.783386] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-07T17:35:45.783747] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-07T17:35:45.783809] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-07T17:35:45.784348] [DEBUG] [LOCAL ] BGR: Trimmed 20152 records to 13482 (keeping 200 days of data) [2025-10-07T17:35:45.868266] [DEBUG] [LOCAL ] BGR: Primary data saved (13482 records). [2025-10-07T17:35:45.868445] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-07T17:35:45.868540] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGR took 31.1s. Estimated remaining: 4h 47m 19s. Rate: 7.3 symbols/min [2025-10-07T17:35:46.032160] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:35:46.045068] [DEBUG] [LOCAL ] BGX: Loaded 11087 existing records from primary storage. [2025-10-07T17:35:46.045298] [INFO ] [MAIN ] BGX: Loaded 11087 existing records. [2025-10-07T17:35:46.219755] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:35:46.219946] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-07T17:35:46.219992] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-07T17:35:46.220193] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-07T17:35:46.220250] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-07T17:35:46.250775] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-07T17:35:46.510555] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T17:35:46.590932] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:35:47.047733] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-07T17:35:47.847696] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-07T17:35:47.990234] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T17:35:48.223451] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T17:35:48.225252] [INFO ] [REMOTE ] BGSF: Full fetch complete (9235 records). [2025-10-07T17:35:48.225322] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-07T17:35:48.597731] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-07T17:35:48.597832] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-07T17:35:48.598074] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-07T17:35:48.598115] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-07T17:35:48.598573] [DEBUG] [LOCAL ] BGSF: Trimmed 9235 records to 7706 (keeping 200 days of data) [2025-10-07T17:35:48.644838] [DEBUG] [LOCAL ] BGSF: Primary data saved (7706 records). [2025-10-07T17:35:48.644958] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-07T17:35:48.645037] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGSF took 29.8s. Estimated remaining: 4h 46m 27s. Rate: 7.4 symbols/min [2025-10-07T17:35:48.655887] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-07T17:35:48.811934] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T17:35:48.842619] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:35:48.863500] [DEBUG] [LOCAL ] BGY: Loaded 22014 existing records from primary storage. [2025-10-07T17:35:48.863790] [INFO ] [MAIN ] BGY: Loaded 22014 existing records. [2025-10-07T17:35:49.039264] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:35:49.039502] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-07T17:35:49.039549] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-07T17:35:49.039864] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-07T17:35:49.039922] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-07T17:35:49.428527] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:35:49.447630] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-07T17:35:49.581715] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T17:35:50.247706] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-07T17:35:50.844938] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T17:35:51.008437] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T17:35:51.047600] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-07T17:35:51.847697] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-07T17:35:51.865313] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T17:35:52.647686] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-07T17:35:52.901371] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T17:35:53.447623] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-07T17:35:53.537455] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T17:35:54.247678] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-07T17:35:55.047615] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-07T17:35:55.172392] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T17:35:55.369130] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T17:35:55.532160] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T17:35:55.847682] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-07T17:35:56.647679] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-07T17:35:57.447729] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-07T17:35:57.664129] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T17:35:57.706493] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T17:35:58.247693] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-07T17:35:58.667786] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-07T17:35:58.996510] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T17:35:59.047603] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-07T17:35:59.847629] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-07T17:35:59.944290] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T17:36:00.647672] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-07T17:36:01.364539] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-07T17:36:01.447682] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-07T17:36:01.702729] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T17:36:02.098489] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T17:36:02.247697] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-07T17:36:03.047625] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-07T17:36:03.422149] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T17:36:03.847695] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-07T17:36:03.859987] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T17:36:04.647700] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-07T17:36:05.370036] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T17:36:05.395160] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T17:36:05.398565] [INFO ] [REMOTE ] BGS: Full fetch complete (72489 records). [2025-10-07T17:36:05.398702] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-07T17:36:05.452917] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-07T17:36:05.811442] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-07T17:36:05.811530] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-07T17:36:05.812507] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-07T17:36:05.812597] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-07T17:36:05.814269] [DEBUG] [LOCAL ] BGS: Trimmed 72489 records to 50456 (keeping 200 days of data) [2025-10-07T17:36:06.133706] [DEBUG] [LOCAL ] BGS: Primary data saved (50456 records). [2025-10-07T17:36:06.133879] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-07T17:36:06.134006] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGS took 50.7s. Estimated remaining: 4h 47m 34s. Rate: 7.3 symbols/min [2025-10-07T17:36:06.253368] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-07T17:36:06.366992] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:36:06.385680] [DEBUG] [LOCAL ] BH: Loaded 16097 existing records from primary storage. [2025-10-07T17:36:06.385974] [INFO ] [MAIN ] BH: Loaded 16097 existing records. [2025-10-07T17:36:06.566892] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T17:36:06.670361] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:36:06.670689] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-07T17:36:06.670767] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-07T17:36:06.671036] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-07T17:36:06.671129] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-07T17:36:07.052909] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-07T17:36:07.251266] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T17:36:07.289832] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:36:07.847738] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-07T17:36:08.041743] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T17:36:08.647747] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-07T17:36:08.744337] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-07T17:36:09.245939] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T17:36:09.447745] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-07T17:36:10.229606] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T17:36:10.247606] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-07T17:36:11.025185] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T17:36:11.026832] [INFO ] [REMOTE ] BGX: Full fetch complete (16307 records). [2025-10-07T17:36:11.026930] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-07T17:36:11.055574] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-07T17:36:11.392135] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-07T17:36:11.392254] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-07T17:36:11.392580] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-07T17:36:11.392625] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-07T17:36:11.393236] [DEBUG] [LOCAL ] BGX: Trimmed 16307 records to 11063 (keeping 200 days of data) [2025-10-07T17:36:11.460527] [DEBUG] [LOCAL ] BGX: Primary data saved (11063 records). [2025-10-07T17:36:11.460691] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-07T17:36:11.460786] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGX took 25.6s. Estimated remaining: 4h 47m 3s. Rate: 7.3 symbols/min [2025-10-07T17:36:11.624070] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:36:11.672868] [DEBUG] [LOCAL ] BHC: Loaded 46871 existing records from primary storage. [2025-10-07T17:36:11.673188] [INFO ] [MAIN ] BHC: Loaded 46871 existing records. [2025-10-07T17:36:11.820005] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T17:36:11.850969] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-07T17:36:11.863740] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:36:11.863988] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-07T17:36:11.864272] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-07T17:36:11.865686] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-07T17:36:11.865748] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-07T17:36:12.242269] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:36:12.647722] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-07T17:36:12.701214] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T17:36:12.703563] [INFO ] [REMOTE ] BGT: Full fetch complete (24220 records). [2025-10-07T17:36:12.703746] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-07T17:36:12.704603] [FATAL] [VALIDATOR ] BGT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:36:12.704746] [FATAL] [MAIN ] BGT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:36:12.704801] [WARN ] [MAIN ] BGT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:36:12.704880] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-07T17:36:12.704965] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-10-07T17:36:12.705023] [INFO ] [LOCAL ] BGT: Starting deletion of derivative data. [2025-10-07T17:36:12.705268] [DEBUG] [LOCAL ] BGT: Deleted derivative data file. [2025-10-07T17:36:12.705371] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGT took 35.7s. Estimated remaining: 4h 45m 60s. Rate: 7.4 symbols/min [2025-10-07T17:36:12.869491] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:36:12.892072] [DEBUG] [LOCAL ] BHE: Loaded 24339 existing records from primary storage. [2025-10-07T17:36:12.892352] [INFO ] [MAIN ] BHE: Loaded 24339 existing records. [2025-10-07T17:36:13.070747] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:36:13.072053] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-07T17:36:13.072114] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-07T17:36:13.072825] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-07T17:36:13.072885] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-07T17:36:13.421993] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:36:13.447613] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-07T17:36:14.247619] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-07T17:36:14.511871] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T17:36:14.639263] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T17:36:15.047610] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-07T17:36:15.200266] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T17:36:15.847790] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-07T17:36:16.506506] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T17:36:16.647696] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-07T17:36:16.680230] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T17:36:17.447755] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-07T17:36:17.797485] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-07T17:36:18.024001] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T17:36:18.247620] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-07T17:36:19.047744] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-07T17:36:19.676150] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-07T17:36:19.847730] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-07T17:36:19.907178] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T17:36:20.595913] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-07T17:36:20.647694] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-07T17:36:21.447624] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-07T17:36:21.829987] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T17:36:22.247630] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-07T17:36:22.565194] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T17:36:22.915463] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T17:36:23.047715] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-07T17:36:23.847718] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-07T17:36:24.537092] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T17:36:24.647725] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-07T17:36:25.243285] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T17:36:25.447671] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-07T17:36:25.591113] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T17:36:26.247712] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-07T17:36:26.687105] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T17:36:27.047625] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-07T17:36:27.293304] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T17:36:27.847715] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-07T17:36:28.346603] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T17:36:28.647706] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-07T17:36:29.018402] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T17:36:29.447735] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-07T17:36:29.731730] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T17:36:30.247746] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-07T17:36:30.946833] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-07T17:36:31.047604] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-07T17:36:31.098128] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T17:36:31.847629] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-07T17:36:31.971882] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T17:36:31.973698] [INFO ] [REMOTE ] BGY: Full fetch complete (33135 records). [2025-10-07T17:36:31.973780] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-07T17:36:32.333726] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-07T17:36:32.333872] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-07T17:36:32.334437] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-07T17:36:32.334505] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-07T17:36:32.335416] [DEBUG] [LOCAL ] BGY: Trimmed 33135 records to 22024 (keeping 200 days of data) [2025-10-07T17:36:32.468580] [DEBUG] [LOCAL ] BGY: Primary data saved (22024 records). [2025-10-07T17:36:32.468760] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-07T17:36:32.468859] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 43.8s. Estimated remaining: 4h 47m 23s. Rate: 7.3 symbols/min [2025-10-07T17:36:32.640056] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:36:32.647672] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-07T17:36:32.666305] [DEBUG] [LOCAL ] BHK: Loaded 23146 existing records from primary storage. [2025-10-07T17:36:32.666596] [INFO ] [MAIN ] BHK: Loaded 23146 existing records. [2025-10-07T17:36:32.842171] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:36:32.842508] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-07T17:36:32.843351] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-07T17:36:32.843717] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-07T17:36:32.843795] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-07T17:36:33.198208] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:36:33.218468] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T17:36:33.447673] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-07T17:36:34.247714] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-07T17:36:34.318679] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T17:36:34.369031] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T17:36:35.047624] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-07T17:36:35.236898] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T17:36:35.847720] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-07T17:36:36.647623] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-07T17:36:36.752451] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T17:36:36.806360] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T17:36:37.447673] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-07T17:36:37.941170] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T17:36:38.247638] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-07T17:36:38.945841] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T17:36:38.948916] [INFO ] [REMOTE ] BHC: Full fetch complete (67056 records). [2025-10-07T17:36:38.949039] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-07T17:36:39.048222] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-07T17:36:39.156201] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T17:36:39.253695] [INFO ] [REMOTE ] BH: Full fetch complete (19780 records). [2025-10-07T17:36:39.256433] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-07T17:36:39.465369] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-07T17:36:39.473857] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-07T17:36:39.477982] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-07T17:36:39.478079] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-07T17:36:39.542799] [DEBUG] [LOCAL ] BHC: Trimmed 67056 records to 46839 (keeping 200 days of data) [2025-10-07T17:36:39.863757] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-07T17:36:39.894754] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-07T17:36:39.897740] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-07T17:36:39.898725] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-07T17:36:39.943537] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-07T17:36:39.987100] [DEBUG] [LOCAL ] BH: Trimmed 19780 records to 16167 (keeping 200 days of data) [2025-10-07T17:36:40.004449] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T17:36:40.171565] [DEBUG] [LOCAL ] BH: Primary data saved (16167 records). [2025-10-07T17:36:40.172628] [INFO ] [MAIN ] BH: Full history saved. [2025-10-07T17:36:40.173081] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 34.0s. Estimated remaining: 4h 47m 11s. Rate: 7.3 symbols/min [2025-10-07T17:36:40.310174] [DEBUG] [LOCAL ] BHC: Primary data saved (46839 records). [2025-10-07T17:36:40.330161] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-07T17:36:40.332994] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHC took 28.9s. Estimated remaining: 4h 46m 0s. Rate: 7.3 symbols/min [2025-10-07T17:36:40.412737] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:36:40.561839] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:36:40.600950] [DEBUG] [LOCAL ] BHR: Loaded 21645 existing records from primary storage. [2025-10-07T17:36:40.615400] [INFO ] [MAIN ] BHR: Loaded 21645 existing records. [2025-10-07T17:36:40.648561] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-07T17:36:40.682665] [DEBUG] [LOCAL ] BHP: Loaded 53370 existing records from primary storage. [2025-10-07T17:36:40.712623] [INFO ] [MAIN ] BHP: Loaded 53370 existing records. [2025-10-07T17:36:40.922710] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:36:40.928955] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-07T17:36:40.939431] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-07T17:36:40.980857] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-07T17:36:40.983092] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-07T17:36:41.027788] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:36:41.046310] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T17:36:41.046550] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-07T17:36:41.061935] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-07T17:36:41.088551] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-07T17:36:41.129838] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-07T17:36:41.451471] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-07T17:36:41.726448] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:36:41.792882] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:36:41.804062] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T17:36:42.247682] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-07T17:36:42.861180] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T17:36:43.047692] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-07T17:36:43.847706] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-07T17:36:44.145018] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T17:36:44.234379] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T17:36:44.647619] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-07T17:36:44.965366] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T17:36:45.447634] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-07T17:36:45.704534] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-07T17:36:46.247633] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-07T17:36:46.397689] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T17:36:47.047784] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-07T17:36:47.847739] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-07T17:36:48.120804] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-07T17:36:48.138296] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T17:36:48.140711] [INFO ] [REMOTE ] BHE: Full fetch complete (36501 records). [2025-10-07T17:36:48.140823] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-07T17:36:48.530025] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-07T17:36:48.530113] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-07T17:36:48.530599] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-07T17:36:48.530639] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-07T17:36:48.531510] [DEBUG] [LOCAL ] BHE: Trimmed 36501 records to 24238 (keeping 200 days of data) [2025-10-07T17:36:48.647739] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-07T17:36:48.697192] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T17:36:48.709216] [DEBUG] [LOCAL ] BHE: Primary data saved (24238 records). [2025-10-07T17:36:48.709366] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-07T17:36:48.709464] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 36.0s. Estimated remaining: 4h 45m 54s. Rate: 7.3 symbols/min [2025-10-07T17:36:48.874330] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:36:48.874479] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-07T17:36:48.874515] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-07T17:36:48.874631] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-07T17:36:48.874723] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-07T17:36:48.874792] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-07T17:36:48.874827] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-07T17:36:49.240937] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:36:49.447703] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-07T17:36:49.539147] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T17:36:50.247680] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-07T17:36:50.709698] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-07T17:36:51.047677] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-07T17:36:51.261194] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T17:36:51.847670] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-07T17:36:52.189004] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T17:36:52.516458] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T17:36:52.647671] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-07T17:36:53.447674] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-07T17:36:53.805875] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-07T17:36:54.247693] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-07T17:36:54.510047] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-07T17:36:54.773729] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-07T17:36:55.047722] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-07T17:36:55.847732] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-07T17:36:56.647770] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-07T17:36:56.776809] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T17:36:56.777708] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T17:36:57.447699] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-07T17:36:57.787573] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-07T17:36:58.036470] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T17:36:58.247694] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-07T17:36:59.047782] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-07T17:36:59.393242] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-07T17:36:59.473824] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T17:36:59.847712] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-07T17:37:00.126234] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-07T17:37:00.647713] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-07T17:37:01.096723] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T17:37:01.447714] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-07T17:37:02.247687] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-07T17:37:02.656474] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-07T17:37:02.723483] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T17:37:03.047712] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-07T17:37:03.847689] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-07T17:37:04.076367] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T17:37:04.078675] [INFO ] [REMOTE ] BHK: Full fetch complete (30565 records). [2025-10-07T17:37:04.078758] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-07T17:37:04.289741] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T17:37:04.482167] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-07T17:37:04.482249] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-07T17:37:04.482675] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-07T17:37:04.482738] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-07T17:37:04.483551] [DEBUG] [LOCAL ] BHK: Trimmed 30565 records to 23307 (keeping 200 days of data) [2025-10-07T17:37:04.624069] [DEBUG] [LOCAL ] BHK: Primary data saved (23307 records). [2025-10-07T17:37:04.624198] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-07T17:37:04.624277] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 32.2s. Estimated remaining: 4h 46m 46s. Rate: 7.3 symbols/min [2025-10-07T17:37:04.652936] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-07T17:37:04.796086] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:37:04.844742] [DEBUG] [LOCAL ] BHVN: Loaded 50061 existing records from primary storage. [2025-10-07T17:37:04.845077] [INFO ] [MAIN ] BHVN: Loaded 50061 existing records. [2025-10-07T17:37:05.019924] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:37:05.020142] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-07T17:37:05.020188] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-07T17:37:05.020580] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-07T17:37:05.020636] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-07T17:37:05.370522] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:37:05.447596] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-07T17:37:05.894606] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T17:37:06.247682] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-07T17:37:07.047623] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-07T17:37:07.117528] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T17:37:07.170327] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T17:37:07.498963] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T17:37:07.847682] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-07T17:37:08.220798] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-07T17:37:08.221452] [INFO ] [REMOTE ] BHV: Full fetch complete (1366 records). [2025-10-07T17:37:08.221520] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-07T17:37:08.402204] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-07T17:37:08.402436] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:37:08.402507] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:37:08.402579] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-07T17:37:08.402673] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-07T17:37:08.402745] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-07T17:37:08.402816] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-07T17:37:08.402902] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHV took 19.7s. Estimated remaining: 4h 46m 3s. Rate: 7.3 symbols/min [2025-10-07T17:37:08.567896] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:37:08.617305] [DEBUG] [LOCAL ] BILL: Loaded 52370 existing records from primary storage. [2025-10-07T17:37:08.617729] [INFO ] [MAIN ] BILL: Loaded 52370 existing records. [2025-10-07T17:37:08.652727] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-07T17:37:08.806284] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:37:08.806542] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-07T17:37:08.806592] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-07T17:37:08.806826] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-07T17:37:08.806884] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-07T17:37:09.166322] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:37:09.447672] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-07T17:37:10.252843] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-07T17:37:10.261685] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T17:37:10.562372] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-07T17:37:11.047714] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-07T17:37:11.761605] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:37:11.847600] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-07T17:37:12.629285] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T17:37:12.647604] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-07T17:37:13.170353] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T17:37:13.447688] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-07T17:37:14.247746] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-07T17:37:14.548063] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T17:37:15.047625] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-07T17:37:15.129488] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T17:37:15.419024] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T17:37:15.847740] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-07T17:37:16.490321] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T17:37:16.647697] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-07T17:37:17.447715] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-07T17:37:17.591112] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T17:37:18.247636] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-07T17:37:18.369272] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T17:37:18.918129] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T17:37:18.939747] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-07T17:37:19.047679] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-07T17:37:19.847638] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-07T17:37:20.074094] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T17:37:20.647710] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-07T17:37:21.447694] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-07T17:37:21.675832] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-07T17:37:21.679340] [INFO ] [REMOTE ] BHP: Full fetch complete (77255 records). [2025-10-07T17:37:21.679451] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-07T17:37:22.120879] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-07T17:37:22.120962] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-07T17:37:22.121759] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-07T17:37:22.121825] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-07T17:37:22.123344] [DEBUG] [LOCAL ] BHP: Trimmed 77255 records to 53371 (keeping 200 days of data) [2025-10-07T17:37:22.247855] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-07T17:37:22.475891] [DEBUG] [LOCAL ] BHP: Primary data saved (53371 records). [2025-10-07T17:37:22.476192] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-07T17:37:22.476310] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHP took 42.3s. Estimated remaining: 4h 46m 40s. Rate: 7.3 symbols/min [2025-10-07T17:37:22.713460] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T17:37:22.717675] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:37:22.721058] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-07T17:37:22.763110] [DEBUG] [LOCAL ] BIO: Loaded 24576 existing records from primary storage. [2025-10-07T17:37:22.763411] [INFO ] [MAIN ] BIO: Loaded 24576 existing records. [2025-10-07T17:37:22.943024] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:37:22.943289] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-07T17:37:22.943375] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-07T17:37:22.943635] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-07T17:37:22.943728] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-07T17:37:23.052808] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-07T17:37:23.316422] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:37:23.754422] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T17:37:23.847703] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-07T17:37:24.647617] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-07T17:37:24.915516] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T17:37:25.002337] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T17:37:25.447728] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-07T17:37:26.022568] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T17:37:26.247719] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-07T17:37:26.350888] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-07T17:37:26.353069] [INFO ] [REMOTE ] BHR: Full fetch complete (31133 records). [2025-10-07T17:37:26.353158] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-07T17:37:26.736001] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-07T17:37:26.736085] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-07T17:37:26.736506] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-07T17:37:26.736548] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-07T17:37:26.737531] [DEBUG] [LOCAL ] BHR: Trimmed 31133 records to 21777 (keeping 200 days of data) [2025-10-07T17:37:26.869170] [DEBUG] [LOCAL ] BHR: Primary data saved (21777 records). [2025-10-07T17:37:26.869308] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-07T17:37:26.869389] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHR took 46.5s. Estimated remaining: 4h 46m 3s. Rate: 7.3 symbols/min [2025-10-07T17:37:27.038420] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:37:27.047744] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-07T17:37:27.086185] [DEBUG] [LOCAL ] BIP: Loaded 39429 existing records from primary storage. [2025-10-07T17:37:27.086516] [INFO ] [MAIN ] BIP: Loaded 39429 existing records. [2025-10-07T17:37:27.277139] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:37:27.277397] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-07T17:37:27.277448] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-07T17:37:27.277953] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-07T17:37:27.278015] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-07T17:37:27.688902] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:37:27.847688] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-07T17:37:28.060454] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T17:37:28.647685] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-07T17:37:28.941496] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T17:37:28.972804] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T17:37:29.447752] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-07T17:37:30.247682] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-07T17:37:30.396185] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T17:37:30.419970] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T17:37:31.047745] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-07T17:37:31.269988] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T17:37:31.847678] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-07T17:37:32.036768] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T17:37:32.647688] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-07T17:37:33.251970] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T17:37:33.447729] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-07T17:37:33.655135] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T17:37:34.247734] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-07T17:37:34.879173] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T17:37:35.047695] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-07T17:37:35.846439] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T17:37:35.855413] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-07T17:37:36.521485] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:37:36.647692] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-07T17:37:37.447626] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-07T17:37:37.531565] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T17:37:37.535116] [INFO ] [REMOTE ] BHVN: Full fetch complete (70063 records). [2025-10-07T17:37:37.535292] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-07T17:37:37.950784] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-07T17:37:37.950924] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-07T17:37:37.951744] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-07T17:37:37.951827] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-07T17:37:37.953372] [DEBUG] [LOCAL ] BHVN: Trimmed 70063 records to 50123 (keeping 200 days of data) [2025-10-07T17:37:38.062202] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T17:37:38.251134] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-07T17:37:38.285301] [DEBUG] [LOCAL ] BHVN: Primary data saved (50123 records). [2025-10-07T17:37:38.285464] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-07T17:37:38.286862] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BHVN took 33.7s. Estimated remaining: 4h 46m 20s. Rate: 7.3 symbols/min [2025-10-07T17:37:38.453679] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:37:38.494878] [DEBUG] [LOCAL ] BIPC: Loaded 41260 existing records from primary storage. [2025-10-07T17:37:38.495220] [INFO ] [MAIN ] BIPC: Loaded 41260 existing records. [2025-10-07T17:37:38.668894] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:37:38.669175] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-07T17:37:38.669225] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-07T17:37:38.669757] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-07T17:37:38.669818] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-07T17:37:39.025125] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:37:39.047602] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-07T17:37:39.082798] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T17:37:39.449695] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T17:37:39.847703] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-07T17:37:40.086537] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T17:37:40.647690] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-07T17:37:41.017963] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T17:37:41.447698] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-07T17:37:42.247714] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-07T17:37:42.534903] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T17:37:42.945559] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T17:37:43.047603] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-07T17:37:43.261915] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T17:37:43.847736] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-07T17:37:44.277959] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T17:37:44.647716] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-07T17:37:44.978486] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T17:37:45.447683] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-07T17:37:46.247741] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-07T17:37:46.437902] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T17:37:46.954602] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T17:37:47.047681] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-07T17:37:47.706723] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T17:37:47.847619] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-07T17:37:48.230828] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T17:37:48.647696] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-07T17:37:49.260093] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T17:37:49.263542] [INFO ] [REMOTE ] BILL: Full fetch complete (75840 records). [2025-10-07T17:37:49.263674] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-07T17:37:49.453834] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-07T17:37:49.656404] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-07T17:37:49.656497] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-07T17:37:49.657348] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-07T17:37:49.657417] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-07T17:37:49.658957] [DEBUG] [LOCAL ] BILL: Trimmed 75840 records to 52380 (keeping 200 days of data) [2025-10-07T17:37:49.972609] [DEBUG] [LOCAL ] BILL: Primary data saved (52380 records). [2025-10-07T17:37:49.972805] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-07T17:37:49.973551] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BILL took 41.6s. Estimated remaining: 4h 46m 38s. Rate: 7.3 symbols/min [2025-10-07T17:37:50.100925] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T17:37:50.187309] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:37:50.193602] [DEBUG] [LOCAL ] BIPH: Loaded 2559 existing records from primary storage. [2025-10-07T17:37:50.193886] [INFO ] [MAIN ] BIPH: Loaded 2559 existing records. [2025-10-07T17:37:50.255428] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-07T17:37:50.371000] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:37:50.371232] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-07T17:37:50.371284] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-07T17:37:50.371502] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-07T17:37:50.371562] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-07T17:37:50.719590] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:37:51.047634] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-07T17:37:51.184999] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T17:37:51.693790] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T17:37:51.714532] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T17:37:51.847624] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-07T17:37:52.418113] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T17:37:52.647694] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-07T17:37:53.447713] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-07T17:37:53.921095] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-07T17:37:54.190924] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T17:37:54.247690] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-07T17:37:54.725100] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T17:37:55.047715] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-07T17:37:55.613543] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T17:37:55.847691] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-07T17:37:56.647742] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-07T17:37:57.072132] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T17:37:57.447702] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-07T17:37:58.077937] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T17:37:58.081129] [INFO ] [REMOTE ] BIP: Full fetch complete (57047 records). [2025-10-07T17:37:58.081245] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-07T17:37:58.253247] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-07T17:37:58.461164] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-07T17:37:58.461260] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-07T17:37:58.462103] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-07T17:37:58.462170] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-07T17:37:58.463440] [DEBUG] [LOCAL ] BIP: Trimmed 57047 records to 39410 (keeping 200 days of data) [2025-10-07T17:37:58.716035] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-07T17:37:58.757336] [DEBUG] [LOCAL ] BIP: Primary data saved (39410 records). [2025-10-07T17:37:58.757506] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-07T17:37:58.757598] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIP took 31.9s. Estimated remaining: 4h 46m 34s. Rate: 7.3 symbols/min [2025-10-07T17:37:59.047757] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-07T17:37:59.492470] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-07T17:37:59.564285] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T17:37:59.847702] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-07T17:38:00.647746] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-07T17:38:01.139717] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T17:38:01.444526] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T17:38:01.452088] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-07T17:38:02.025336] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-07T17:38:02.247768] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-07T17:38:02.681250] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T17:38:03.047730] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-07T17:38:03.500513] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T17:38:03.847687] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-07T17:38:04.647691] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-07T17:38:05.070847] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T17:38:05.071818] [INFO ] [REMOTE ] BIPH: Full fetch complete (4261 records). [2025-10-07T17:38:05.071892] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-07T17:38:05.448629] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-07T17:38:05.469378] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-07T17:38:05.470433] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-07T17:38:05.470814] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-07T17:38:05.470947] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-07T17:38:05.471761] [DEBUG] [LOCAL ] BIPH: Trimmed 4261 records to 2558 (keeping 200 days of data) [2025-10-07T17:38:05.513463] [DEBUG] [LOCAL ] BIPH: Primary data saved (2558 records). [2025-10-07T17:38:05.514781] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T17:38:05.524017] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-07T17:38:05.524464] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPH took 15.6s. Estimated remaining: 4h 46m 15s. Rate: 7.3 symbols/min [2025-10-07T17:38:06.216298] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T17:38:06.247603] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-07T17:38:07.047698] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-07T17:38:07.380660] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T17:38:07.382340] [INFO ] [REMOTE ] BIO: Full fetch complete (34131 records). [2025-10-07T17:38:07.382418] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-07T17:38:07.741940] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-07T17:38:07.742024] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-07T17:38:07.742601] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-07T17:38:07.742710] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-07T17:38:07.743603] [DEBUG] [LOCAL ] BIO: Trimmed 34131 records to 24515 (keeping 200 days of data) [2025-10-07T17:38:07.897836] [DEBUG] [LOCAL ] BIO: Primary data saved (24515 records). [2025-10-07T17:38:07.897995] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-07T17:38:07.898117] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIO took 45.4s. Estimated remaining: 4h 45m 23s. Rate: 7.3 symbols/min [2025-10-07T17:38:08.475764] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T17:38:08.484520] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-07T17:38:09.945095] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T17:38:09.958582] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-07T17:38:11.499386] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T17:38:11.503495] [INFO ] [REMOTE ] BIPC: Full fetch complete (59983 records). [2025-10-07T17:38:11.503707] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-07T17:38:11.890773] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-07T17:38:11.890855] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-07T17:38:11.891538] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-07T17:38:11.891581] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-07T17:38:11.892836] [DEBUG] [LOCAL ] BIPC: Trimmed 59983 records to 41252 (keeping 200 days of data) [2025-10-07T17:38:12.145389] [DEBUG] [LOCAL ] BIPC: Primary data saved (41252 records). [2025-10-07T17:38:12.145520] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-07T17:38:12.146300] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPC took 33.9s. Estimated remaining: 4h 44m 45s. Rate: 7.3 symbols/min [2025-10-07T17:38:12.766636] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:38:12.834291] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:38:12.863812] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:38:12.918191] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:38:12.921492] [DEBUG] [LOCAL ] BIPJ: Loaded 3135 existing records from primary storage. [2025-10-07T17:38:12.922056] [INFO ] [MAIN ] BIPJ: Loaded 3135 existing records. [2025-10-07T17:38:13.006216] [DEBUG] [LOCAL ] BIPI: Loaded 3194 existing records from primary storage. [2025-10-07T17:38:13.017686] [INFO ] [MAIN ] BIPI: Loaded 3194 existing records. [2025-10-07T17:38:13.078330] [DEBUG] [LOCAL ] BIT: Loaded 23078 existing records from primary storage. [2025-10-07T17:38:13.142177] [INFO ] [MAIN ] BIT: Loaded 23078 existing records. [2025-10-07T17:38:13.332454] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:38:13.368293] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-07T17:38:13.394870] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-07T17:38:13.460899] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-07T17:38:13.486305] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-07T17:38:13.500344] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:38:13.494605] [DEBUG] [LOCAL ] BIRK: Loaded 50930 existing records from primary storage. [2025-10-07T17:38:13.505958] [INFO ] [MAIN ] BIRK: Loaded 50930 existing records. [2025-10-07T17:38:13.506069] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-07T17:38:13.541749] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-07T17:38:13.596350] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-07T17:38:13.621560] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-07T17:38:13.824712] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:38:13.868243] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-07T17:38:13.894357] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-07T17:38:13.973048] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-07T17:38:13.992379] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-07T17:38:14.191084] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:38:14.308925] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-07T17:38:14.380510] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-07T17:38:14.421121] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-07T17:38:14.473380] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-07T17:38:14.806707] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:38:14.854222] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-07T17:38:14.932792] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:38:14.974334] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-07T17:38:15.220061] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:38:15.222823] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-07T17:38:15.302909] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:38:15.303271] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-07T17:38:15.705503] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T17:38:15.707094] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-07T17:38:15.981615] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T17:38:15.983673] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-07T17:38:16.179762] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-07T17:38:16.181071] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-07T17:38:16.345076] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-07T17:38:16.346494] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-07T17:38:16.474168] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T17:38:16.479971] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-07T17:38:16.532390] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-07T17:38:16.647628] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-07T17:38:16.846387] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-07T17:38:16.875701] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T17:38:17.088019] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-07T17:38:17.166534] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-07T17:38:17.447682] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-07T17:38:18.157282] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T17:38:18.247708] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-07T17:38:19.047708] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-07T17:38:19.661970] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-07T17:38:19.847639] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-07T17:38:19.905160] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T17:38:20.647727] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-07T17:38:20.944868] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T17:38:20.997677] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-07T17:38:21.447745] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-07T17:38:22.247699] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-07T17:38:22.696613] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-07T17:38:23.043211] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T17:38:23.052298] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-07T17:38:23.439450] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-07T17:38:23.847709] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-07T17:38:24.647702] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-07T17:38:25.306521] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T17:38:25.447613] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-07T17:38:25.632309] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T17:38:25.888008] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-07T17:38:26.247706] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-07T17:38:26.745216] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-07T17:38:27.047722] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-07T17:38:27.652683] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T17:38:27.847723] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-07T17:38:28.647735] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-07T17:38:28.979993] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T17:38:29.021775] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-07T17:38:29.447672] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-07T17:38:29.961249] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-07T17:38:30.247669] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-07T17:38:30.793957] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T17:38:31.047741] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-07T17:38:31.557636] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-07T17:38:31.847749] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-07T17:38:32.647689] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-07T17:38:33.219968] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T17:38:33.223339] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T17:38:33.447695] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-07T17:38:33.948005] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T17:38:33.948852] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4365 records). [2025-10-07T17:38:33.948923] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-07T17:38:34.252726] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-07T17:38:34.316071] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-07T17:38:34.316194] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-07T17:38:34.316360] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-07T17:38:34.316422] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-07T17:38:34.316872] [DEBUG] [LOCAL ] BIPJ: Trimmed 4365 records to 3146 (keeping 200 days of data) [2025-10-07T17:38:34.337170] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3146 records). [2025-10-07T17:38:34.337277] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-07T17:38:34.337359] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 22.2s. Estimated remaining: 4h 46m 22s. Rate: 7.3 symbols/min [2025-10-07T17:38:34.505877] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:38:34.567266] [DEBUG] [LOCAL ] BJ: Loaded 51429 existing records from primary storage. [2025-10-07T17:38:34.568125] [INFO ] [MAIN ] BJ: Loaded 51429 existing records. [2025-10-07T17:38:34.747176] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:38:34.747482] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-07T17:38:34.747540] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-07T17:38:34.748174] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-07T17:38:34.748234] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-07T17:38:34.910503] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T17:38:34.999822] [INFO ] [REMOTE ] BIPI: Full fetch complete (5044 records). [2025-10-07T17:38:35.036168] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-07T17:38:35.059049] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-07T17:38:35.243477] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:38:35.493319] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-07T17:38:35.493408] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-07T17:38:35.493609] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-07T17:38:35.493667] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-07T17:38:35.494047] [DEBUG] [LOCAL ] BIPI: Trimmed 5044 records to 3159 (keeping 200 days of data) [2025-10-07T17:38:35.513976] [DEBUG] [LOCAL ] BIPI: Primary data saved (3159 records). [2025-10-07T17:38:35.514070] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-07T17:38:35.514168] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 23.4s. Estimated remaining: 4h 45m 21s. Rate: 7.3 symbols/min [2025-10-07T17:38:35.678357] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:38:35.734155] [DEBUG] [LOCAL ] BK: Loaded 53537 existing records from primary storage. [2025-10-07T17:38:35.734494] [INFO ] [MAIN ] BK: Loaded 53537 existing records. [2025-10-07T17:38:35.852841] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-07T17:38:35.911689] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:38:35.911934] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-07T17:38:35.911990] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-07T17:38:35.912345] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-07T17:38:35.912416] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-07T17:38:36.265762] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:38:36.647732] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-07T17:38:36.867183] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T17:38:37.351846] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T17:38:37.447668] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-07T17:38:38.247637] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-07T17:38:38.363197] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T17:38:39.047679] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-07T17:38:39.050580] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T17:38:39.847710] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-07T17:38:39.961355] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T17:38:40.399676] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T17:38:40.647681] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-07T17:38:41.447741] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-07T17:38:41.479155] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T17:38:41.539588] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T17:38:42.247724] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-07T17:38:43.047623] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-07T17:38:43.229995] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T17:38:43.678837] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T17:38:43.847615] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-07T17:38:43.957089] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T17:38:44.647696] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-07T17:38:45.447692] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-07T17:38:45.516347] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T17:38:46.242924] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T17:38:46.254006] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-07T17:38:47.047710] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-07T17:38:47.229270] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T17:38:47.253361] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T17:38:47.847685] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-07T17:38:48.647715] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-07T17:38:48.978694] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T17:38:49.447711] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-07T17:38:49.568808] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T17:38:49.979219] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T17:38:50.247711] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-07T17:38:51.047686] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-07T17:38:51.137877] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T17:38:51.847716] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-07T17:38:52.060472] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T17:38:52.534127] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T17:38:52.647705] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-07T17:38:53.338808] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T17:38:53.343667] [INFO ] [REMOTE ] BIRK: Full fetch complete (73067 records). [2025-10-07T17:38:53.343841] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-07T17:38:53.456038] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-07T17:38:53.764317] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-07T17:38:53.764443] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-07T17:38:53.765250] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-07T17:38:53.765326] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-07T17:38:53.767065] [DEBUG] [LOCAL ] BIRK: Trimmed 73067 records to 50954 (keeping 200 days of data) [2025-10-07T17:38:53.995105] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T17:38:54.005418] [INFO ] [REMOTE ] BIT: Full fetch complete (31934 records). [2025-10-07T17:38:54.015378] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-07T17:38:54.212515] [DEBUG] [LOCAL ] BIRK: Primary data saved (50954 records). [2025-10-07T17:38:54.236756] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-07T17:38:54.247208] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIRK took 42.1s. Estimated remaining: 4h 46m 31s. Rate: 7.3 symbols/min [2025-10-07T17:38:54.247721] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-07T17:38:54.609901] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:38:54.650473] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-07T17:38:54.650562] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-07T17:38:54.651050] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-07T17:38:54.651114] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-07T17:38:54.652138] [DEBUG] [LOCAL ] BIT: Trimmed 31934 records to 23137 (keeping 200 days of data) [2025-10-07T17:38:54.793953] [DEBUG] [LOCAL ] BKD: Loaded 50317 existing records from primary storage. [2025-10-07T17:38:54.795609] [INFO ] [MAIN ] BKD: Loaded 50317 existing records. [2025-10-07T17:38:54.987881] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:38:54.996212] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-07T17:38:54.997350] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-07T17:38:54.998396] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-07T17:38:54.998465] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-07T17:38:55.392051] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:38:55.393205] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-07T17:38:55.397129] [DEBUG] [LOCAL ] BIT: Primary data saved (23137 records). [2025-10-07T17:38:55.397772] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-07T17:38:55.397991] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIT took 43.2s. Estimated remaining: 4h 45m 30s. Rate: 7.3 symbols/min [2025-10-07T17:38:55.533871] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-07T17:38:55.617557] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:38:55.655234] [DEBUG] [LOCAL ] BKE: Loaded 34159 existing records from primary storage. [2025-10-07T17:38:55.655554] [INFO ] [MAIN ] BKE: Loaded 34159 existing records. [2025-10-07T17:38:55.837565] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:38:55.838046] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-07T17:38:55.838131] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-07T17:38:55.842020] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-07T17:38:55.842314] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-07T17:38:55.855131] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-07T17:38:56.237245] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:38:56.239298] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T17:38:56.647712] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-07T17:38:56.854340] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T17:38:57.447708] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-07T17:38:57.540152] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T17:38:58.119611] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T17:38:58.247704] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-07T17:38:59.022492] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T17:38:59.047699] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-07T17:38:59.847793] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-07T17:38:59.993169] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T17:39:00.554864] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:39:00.647754] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-07T17:39:01.447761] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-07T17:39:01.920966] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-07T17:39:02.213429] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T17:39:02.247767] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-07T17:39:02.755556] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T17:39:03.047685] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-07T17:39:03.847686] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-07T17:39:04.061188] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T17:39:04.647633] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-07T17:39:04.922390] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T17:39:05.428510] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T17:39:05.447609] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-07T17:39:05.715052] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T17:39:06.247693] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-07T17:39:07.036581] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T17:39:07.047617] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-07T17:39:07.847719] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-07T17:39:07.953848] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T17:39:07.957411] [INFO ] [REMOTE ] BK: Full fetch complete (77482 records). [2025-10-07T17:39:07.957540] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-07T17:39:08.376432] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-07T17:39:08.398587] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-07T17:39:08.400174] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-07T17:39:08.401131] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T17:39:08.401270] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-07T17:39:08.410481] [DEBUG] [LOCAL ] BK: Trimmed 77482 records to 53536 (keeping 200 days of data) [2025-10-07T17:39:08.647765] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-07T17:39:08.793529] [DEBUG] [LOCAL ] BK: Primary data saved (53536 records). [2025-10-07T17:39:08.793747] [INFO ] [MAIN ] BK: Full history saved. [2025-10-07T17:39:08.793880] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BK took 33.3s. Estimated remaining: 4h 46m 0s. Rate: 7.3 symbols/min [2025-10-07T17:39:09.020710] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:39:09.068058] [DEBUG] [LOCAL ] BKH: Loaded 36789 existing records from primary storage. [2025-10-07T17:39:09.068589] [INFO ] [MAIN ] BKH: Loaded 36789 existing records. [2025-10-07T17:39:09.302603] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:39:09.303039] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-07T17:39:09.303109] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-07T17:39:09.327436] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-07T17:39:09.327533] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-07T17:39:09.412838] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T17:39:09.451883] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-07T17:39:09.710475] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:39:10.247713] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-07T17:39:10.354054] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T17:39:10.817432] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T17:39:11.047730] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-07T17:39:11.860594] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-07T17:39:11.863615] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T17:39:12.090594] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T17:39:12.647689] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-07T17:39:13.353673] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T17:39:13.357285] [INFO ] [REMOTE ] BJ: Full fetch complete (74003 records). [2025-10-07T17:39:13.357605] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-07T17:39:13.453670] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-07T17:39:13.756260] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-07T17:39:13.756369] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-07T17:39:13.757344] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-07T17:39:13.757411] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-07T17:39:13.759331] [DEBUG] [LOCAL ] BJ: Trimmed 74003 records to 51495 (keeping 200 days of data) [2025-10-07T17:39:14.066215] [DEBUG] [LOCAL ] BJ: Primary data saved (51495 records). [2025-10-07T17:39:14.066353] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-07T17:39:14.066849] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BJ took 39.7s. Estimated remaining: 4h 45m 30s. Rate: 7.3 symbols/min [2025-10-07T17:39:14.236521] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:39:14.247688] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-07T17:39:14.274737] [DEBUG] [LOCAL ] BKKT: Loaded 35590 existing records from primary storage. [2025-10-07T17:39:14.275060] [INFO ] [MAIN ] BKKT: Loaded 35590 existing records. [2025-10-07T17:39:14.461245] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:39:14.461490] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-07T17:39:14.461728] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-07T17:39:14.461960] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-07T17:39:14.462017] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-07T17:39:14.842453] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-07T17:39:14.882130] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:39:15.047883] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-07T17:39:15.112819] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T17:39:15.847725] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-07T17:39:15.883696] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T17:39:16.515555] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:39:16.647694] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-07T17:39:16.925481] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T17:39:17.447740] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-07T17:39:17.653270] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T17:39:18.247708] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-07T17:39:18.948354] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T17:39:19.047739] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-07T17:39:19.847705] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-07T17:39:20.086474] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T17:39:20.335945] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T17:39:20.647757] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-07T17:39:21.447726] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-07T17:39:21.624945] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T17:39:22.256732] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-07T17:39:22.258896] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T17:39:23.047685] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-07T17:39:23.079901] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T17:39:23.180836] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T17:39:23.183192] [INFO ] [REMOTE ] BKE: Full fetch complete (50145 records). [2025-10-07T17:39:23.183280] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-07T17:39:23.564552] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-07T17:39:23.564665] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-07T17:39:23.565233] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-07T17:39:23.565274] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-07T17:39:23.566283] [DEBUG] [LOCAL ] BKE: Trimmed 50145 records to 34102 (keeping 200 days of data) [2025-10-07T17:39:23.769741] [DEBUG] [LOCAL ] BKE: Primary data saved (34102 records). [2025-10-07T17:39:23.769904] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-07T17:39:23.770003] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKE took 28.4s. Estimated remaining: 4h 45m 33s. Rate: 7.3 symbols/min [2025-10-07T17:39:23.852801] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-07T17:39:23.946378] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:39:23.955925] [DEBUG] [LOCAL ] BKN: Loaded 7717 existing records from primary storage. [2025-10-07T17:39:23.956108] [INFO ] [MAIN ] BKN: Loaded 7717 existing records. [2025-10-07T17:39:24.132819] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:39:24.133074] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-07T17:39:24.133137] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-07T17:39:24.133335] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-07T17:39:24.133414] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-07T17:39:24.503232] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:39:24.583625] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T17:39:24.647677] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-07T17:39:25.389322] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T17:39:25.447758] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-07T17:39:26.030607] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T17:39:26.247612] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-07T17:39:26.816505] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T17:39:27.047694] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-07T17:39:27.643698] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T17:39:27.847703] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-07T17:39:27.969942] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T17:39:28.647720] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-07T17:39:28.964275] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T17:39:29.284104] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T17:39:29.447621] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-07T17:39:30.247679] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-07T17:39:30.809160] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T17:39:30.838397] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T17:39:31.047612] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-07T17:39:31.847718] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-07T17:39:32.647708] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-07T17:39:32.675519] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T17:39:33.318317] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T17:39:33.351832] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T17:39:33.447676] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-07T17:39:34.247703] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-07T17:39:34.270671] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-07T17:39:35.047686] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-07T17:39:35.658155] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T17:39:35.847690] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-07T17:39:36.237481] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T17:39:36.647684] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-07T17:39:37.253233] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T17:39:37.447673] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-07T17:39:37.742890] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T17:39:37.745509] [INFO ] [REMOTE ] BKH: Full fetch complete (52500 records). [2025-10-07T17:39:37.745590] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-07T17:39:38.162110] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-07T17:39:38.162215] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-07T17:39:38.163338] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-07T17:39:38.163406] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-07T17:39:38.164758] [DEBUG] [LOCAL ] BKH: Trimmed 52500 records to 36861 (keeping 200 days of data) [2025-10-07T17:39:38.274271] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-07T17:39:38.413144] [DEBUG] [LOCAL ] BKH: Primary data saved (36861 records). [2025-10-07T17:39:38.413305] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-07T17:39:38.413433] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKH took 29.6s. Estimated remaining: 4h 46m 11s. Rate: 7.3 symbols/min [2025-10-07T17:39:38.579609] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:39:38.629067] [DEBUG] [LOCAL ] BKSY: Loaded 48342 existing records from primary storage. [2025-10-07T17:39:38.629380] [INFO ] [MAIN ] BKSY: Loaded 48342 existing records. [2025-10-07T17:39:38.802598] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:39:38.802846] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-07T17:39:38.802894] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-07T17:39:38.803137] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-07T17:39:38.803195] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-07T17:39:38.921720] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T17:39:38.941279] [INFO ] [REMOTE ] BKD: Full fetch complete (71761 records). [2025-10-07T17:39:38.964179] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-07T17:39:39.070503] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-07T17:39:39.387950] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:39:39.584458] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-07T17:39:39.584551] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-07T17:39:39.585276] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-07T17:39:39.585341] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-07T17:39:39.586832] [DEBUG] [LOCAL ] BKD: Trimmed 71761 records to 50321 (keeping 200 days of data) [2025-10-07T17:39:39.852268] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-07T17:39:39.888327] [DEBUG] [LOCAL ] BKD: Primary data saved (50321 records). [2025-10-07T17:39:39.888465] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-07T17:39:39.888616] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKD took 45.6s. Estimated remaining: 4h 45m 14s. Rate: 7.3 symbols/min [2025-10-07T17:39:40.060816] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:39:40.079331] [DEBUG] [LOCAL ] BKT: Loaded 11729 existing records from primary storage. [2025-10-07T17:39:40.080360] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T17:39:40.080499] [INFO ] [MAIN ] BKT: Loaded 11729 existing records. [2025-10-07T17:39:40.262055] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:39:40.262354] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-07T17:39:40.262427] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-07T17:39:40.262817] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-07T17:39:40.262924] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-07T17:39:40.431622] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-07T17:39:40.656024] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:39:40.656135] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-07T17:39:41.268461] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T17:39:41.366921] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T17:39:41.447614] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-07T17:39:42.247686] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-07T17:39:43.047638] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-07T17:39:43.086677] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T17:39:43.156552] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T17:39:43.504002] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T17:39:43.847692] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-07T17:39:44.647726] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-07T17:39:45.105471] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-07T17:39:45.447627] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-07T17:39:45.509732] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T17:39:46.145854] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T17:39:46.247674] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-07T17:39:46.930317] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-07T17:39:47.047722] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-07T17:39:47.847707] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-07T17:39:48.647727] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-07T17:39:48.917705] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T17:39:49.371962] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T17:39:49.447694] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-07T17:39:49.853180] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-07T17:39:50.216726] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T17:39:50.217735] [INFO ] [REMOTE ] BKN: Full fetch complete (11773 records). [2025-10-07T17:39:50.217842] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-07T17:39:50.252910] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-07T17:39:50.582066] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-07T17:39:50.582171] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-07T17:39:50.582469] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-07T17:39:50.582511] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-07T17:39:50.582981] [DEBUG] [LOCAL ] BKN: Trimmed 11773 records to 7685 (keeping 200 days of data) [2025-10-07T17:39:50.629842] [DEBUG] [LOCAL ] BKN: Primary data saved (7685 records). [2025-10-07T17:39:50.629963] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-07T17:39:50.630043] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 26.9s. Estimated remaining: 4h 45m 24s. Rate: 7.3 symbols/min [2025-10-07T17:39:50.798314] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:39:50.838231] [DEBUG] [LOCAL ] BKU: Loaded 41507 existing records from primary storage. [2025-10-07T17:39:50.838612] [INFO ] [MAIN ] BKU: Loaded 41507 existing records. [2025-10-07T17:39:51.055010] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-07T17:39:51.054877] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:39:51.056617] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-07T17:39:51.056723] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-07T17:39:51.057139] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-07T17:39:51.057201] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-07T17:39:51.447996] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:39:51.847821] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-07T17:39:52.124232] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T17:39:52.653299] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-07T17:39:52.654899] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T17:39:53.040862] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-07T17:39:53.045995] [INFO ] [REMOTE ] BKKT: Full fetch complete (50560 records). [2025-10-07T17:39:53.046205] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-07T17:39:53.452983] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-07T17:39:53.594140] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-07T17:39:53.594252] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-07T17:39:53.595080] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-07T17:39:53.595188] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-07T17:39:53.596697] [DEBUG] [LOCAL ] BKKT: Trimmed 50560 records to 35633 (keeping 200 days of data) [2025-10-07T17:39:53.893201] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T17:39:53.919712] [DEBUG] [LOCAL ] BKKT: Primary data saved (35633 records). [2025-10-07T17:39:53.919941] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-07T17:39:53.922248] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 39.9s. Estimated remaining: 4h 44m 41s. Rate: 7.3 symbols/min [2025-10-07T17:39:54.153370] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:39:54.207636] [DEBUG] [LOCAL ] BKV: Loaded 29817 existing records from primary storage. [2025-10-07T17:39:54.208055] [INFO ] [MAIN ] BKV: Loaded 29817 existing records. [2025-10-07T17:39:54.251538] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-07T17:39:54.463787] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:39:54.464087] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-07T17:39:54.464145] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-07T17:39:54.464404] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-07T17:39:54.464464] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-07T17:39:54.631955] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T17:39:54.852293] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:39:55.047717] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-07T17:39:55.726422] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T17:39:55.794929] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T17:39:55.847629] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-07T17:39:56.647738] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-07T17:39:56.995117] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T17:39:57.384722] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T17:39:57.447730] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-07T17:39:58.247803] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-07T17:39:58.664160] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T17:39:59.047632] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-07T17:39:59.121631] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T17:39:59.847683] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-07T17:39:59.890344] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T17:40:00.647718] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-07T17:40:01.002871] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T17:40:01.447732] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-07T17:40:01.510820] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T17:40:02.247705] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-07T17:40:02.862902] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-07T17:40:03.047692] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-07T17:40:03.485953] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T17:40:03.847706] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-07T17:40:04.647751] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-07T17:40:05.393711] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-07T17:40:05.447702] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-07T17:40:05.471804] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T17:40:05.880683] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T17:40:06.247698] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-07T17:40:07.047608] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-07T17:40:07.098318] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T17:40:07.218053] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T17:40:07.219627] [INFO ] [REMOTE ] BKT: Full fetch complete (15612 records). [2025-10-07T17:40:07.219723] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-07T17:40:07.220170] [FATAL] [VALIDATOR ] BKT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:40:07.220251] [FATAL] [MAIN ] BKT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:40:07.220293] [WARN ] [MAIN ] BKT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:40:07.220358] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-07T17:40:07.220422] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-10-07T17:40:07.220458] [INFO ] [LOCAL ] BKT: Starting deletion of derivative data. [2025-10-07T17:40:07.220702] [DEBUG] [LOCAL ] BKT: Deleted derivative data file. [2025-10-07T17:40:07.220788] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKT took 27.3s. Estimated remaining: 4h 45m 9s. Rate: 7.3 symbols/min [2025-10-07T17:40:07.396809] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:40:07.432610] [DEBUG] [LOCAL ] BLCO: Loaded 35566 existing records from primary storage. [2025-10-07T17:40:07.432949] [INFO ] [MAIN ] BLCO: Loaded 35566 existing records. [2025-10-07T17:40:07.613891] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:40:07.614092] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-07T17:40:07.614142] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-07T17:40:07.614421] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-07T17:40:07.614480] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-07T17:40:07.856751] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-07T17:40:08.018435] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:40:08.445550] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T17:40:08.647719] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-07T17:40:09.447639] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-07T17:40:09.726431] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T17:40:10.247630] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-07T17:40:10.335275] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T17:40:10.432310] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T17:40:11.047675] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-07T17:40:11.594222] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T17:40:11.847705] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-07T17:40:12.647695] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-07T17:40:12.840440] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T17:40:13.327688] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-07T17:40:13.447697] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-07T17:40:14.247700] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-07T17:40:14.455502] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T17:40:14.782209] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T17:40:15.047719] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-07T17:40:15.124567] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T17:40:15.847684] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-07T17:40:16.647739] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-07T17:40:16.686744] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T17:40:17.063727] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T17:40:17.447694] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-07T17:40:17.843369] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T17:40:18.247705] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-07T17:40:18.560147] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T17:40:18.562550] [INFO ] [REMOTE ] BKV: Full fetch complete (44807 records). [2025-10-07T17:40:18.562671] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-07T17:40:18.927349] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-07T17:40:18.927427] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-07T17:40:18.927927] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-07T17:40:18.927990] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-07T17:40:18.928989] [DEBUG] [LOCAL ] BKV: Trimmed 44807 records to 29802 (keeping 200 days of data) [2025-10-07T17:40:19.068710] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-07T17:40:19.104830] [DEBUG] [LOCAL ] BKV: Primary data saved (29802 records). [2025-10-07T17:40:19.104995] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-07T17:40:19.105087] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKV took 25.2s. Estimated remaining: 4h 45m 26s. Rate: 7.3 symbols/min [2025-10-07T17:40:19.273491] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:40:19.300151] [DEBUG] [LOCAL ] BLD: Loaded 27586 existing records from primary storage. [2025-10-07T17:40:19.300405] [INFO ] [MAIN ] BLD: Loaded 27586 existing records. [2025-10-07T17:40:19.472234] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:40:19.472504] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-07T17:40:19.472551] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-07T17:40:19.473023] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-07T17:40:19.473081] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-07T17:40:19.816259] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:40:19.847601] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-07T17:40:20.501859] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-07T17:40:20.605061] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T17:40:20.647722] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-07T17:40:20.738856] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T17:40:21.447693] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-07T17:40:22.247739] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-07T17:40:22.472827] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T17:40:22.553930] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T17:40:23.047627] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-07T17:40:23.211193] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T17:40:23.847745] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-07T17:40:24.637864] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T17:40:24.641462] [INFO ] [REMOTE ] BKSY: Full fetch complete (69900 records). [2025-10-07T17:40:24.641569] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-07T17:40:24.653355] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-07T17:40:25.024780] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-07T17:40:25.024866] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-07T17:40:25.025602] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-07T17:40:25.025666] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-07T17:40:25.027040] [DEBUG] [LOCAL ] BKSY: Trimmed 69900 records to 48400 (keeping 200 days of data) [2025-10-07T17:40:25.219187] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T17:40:25.343132] [DEBUG] [LOCAL ] BKSY: Primary data saved (48400 records). [2025-10-07T17:40:25.343337] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-07T17:40:25.344592] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKSY took 46.9s. Estimated remaining: 4h 45m 4s. Rate: 7.3 symbols/min [2025-10-07T17:40:25.452723] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-07T17:40:25.514872] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:40:25.567463] [DEBUG] [LOCAL ] BLDR: Loaded 51674 existing records from primary storage. [2025-10-07T17:40:25.567844] [INFO ] [MAIN ] BLDR: Loaded 51674 existing records. [2025-10-07T17:40:25.740423] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:40:25.740694] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-07T17:40:25.740774] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-07T17:40:25.741015] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-07T17:40:25.741072] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-07T17:40:26.094310] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:40:26.223349] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T17:40:26.247680] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-07T17:40:27.049022] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-07T17:40:27.055356] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T17:40:27.847695] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-07T17:40:28.042348] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T17:40:28.135404] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T17:40:28.647744] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-07T17:40:28.828253] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T17:40:29.447678] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-07T17:40:30.098489] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T17:40:30.247604] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-07T17:40:30.720364] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T17:40:31.047679] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-07T17:40:31.847682] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-07T17:40:32.015526] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T17:40:32.535108] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T17:40:32.647674] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-07T17:40:32.916280] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-07T17:40:32.919433] [INFO ] [REMOTE ] BKU: Full fetch complete (60073 records). [2025-10-07T17:40:32.919538] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-07T17:40:33.306671] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-07T17:40:33.306765] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-07T17:40:33.307498] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-07T17:40:33.307565] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-07T17:40:33.308972] [DEBUG] [LOCAL ] BKU: Trimmed 60073 records to 41591 (keeping 200 days of data) [2025-10-07T17:40:33.489193] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-07T17:40:33.571219] [DEBUG] [LOCAL ] BKU: Primary data saved (41591 records). [2025-10-07T17:40:33.571353] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-07T17:40:33.572305] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKU took 42.9s. Estimated remaining: 4h 44m 56s. Rate: 7.3 symbols/min [2025-10-07T17:40:33.745470] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:40:33.763014] [DEBUG] [LOCAL ] BLE: Loaded 14135 existing records from primary storage. [2025-10-07T17:40:33.763261] [INFO ] [MAIN ] BLE: Loaded 14135 existing records. [2025-10-07T17:40:33.944260] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:40:33.944491] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-07T17:40:33.944540] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-07T17:40:33.945094] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-07T17:40:33.945177] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-07T17:40:34.252397] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-07T17:40:34.322151] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:40:34.366409] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T17:40:34.916957] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T17:40:35.047622] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-07T17:40:35.367246] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T17:40:35.847678] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-07T17:40:36.174540] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T17:40:36.647742] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-07T17:40:36.866341] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T17:40:37.447685] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-07T17:40:37.927256] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-07T17:40:38.247667] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-07T17:40:39.047716] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-07T17:40:39.236328] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T17:40:39.400120] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T17:40:39.735287] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-07T17:40:39.847696] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-07T17:40:40.647755] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-07T17:40:41.447630] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-07T17:40:41.523974] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T17:40:41.616510] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T17:40:42.247694] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-07T17:40:42.473314] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T17:40:42.838521] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T17:40:43.047677] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-07T17:40:43.847723] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-07T17:40:44.225204] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T17:40:44.227982] [INFO ] [REMOTE ] BLCO: Full fetch complete (52334 records). [2025-10-07T17:40:44.228089] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-07T17:40:44.606567] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-07T17:40:44.606681] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-07T17:40:44.607272] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-07T17:40:44.607316] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-07T17:40:44.608554] [DEBUG] [LOCAL ] BLCO: Trimmed 52334 records to 35528 (keeping 200 days of data) [2025-10-07T17:40:44.660503] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-07T17:40:44.821692] [DEBUG] [LOCAL ] BLCO: Primary data saved (35528 records). [2025-10-07T17:40:44.821853] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-07T17:40:44.821954] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 37.6s. Estimated remaining: 4h 45m 8s. Rate: 7.3 symbols/min [2025-10-07T17:40:45.016164] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:40:45.059457] [DEBUG] [LOCAL ] BLK: Loaded 34166 existing records from primary storage. [2025-10-07T17:40:45.059774] [INFO ] [MAIN ] BLK: Loaded 34166 existing records. [2025-10-07T17:40:45.239916] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:40:45.240166] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-07T17:40:45.240213] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-07T17:40:45.240435] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-07T17:40:45.240491] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-07T17:40:45.454740] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-07T17:40:45.771489] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T17:40:45.814693] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:40:45.841195] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T17:40:46.247748] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-07T17:40:46.775195] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T17:40:47.047700] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-07T17:40:47.657386] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T17:40:47.847629] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-07T17:40:48.042443] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T17:40:48.647683] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-07T17:40:49.447614] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-07T17:40:49.638894] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T17:40:50.247630] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-07T17:40:50.385596] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T17:40:50.498478] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T17:40:50.500451] [INFO ] [REMOTE ] BLD: Full fetch complete (40102 records). [2025-10-07T17:40:50.500539] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-07T17:40:50.877127] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-07T17:40:50.877218] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-07T17:40:50.877824] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-07T17:40:50.877891] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-07T17:40:50.879018] [DEBUG] [LOCAL ] BLD: Trimmed 40102 records to 27585 (keeping 200 days of data) [2025-10-07T17:40:51.048165] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-07T17:40:51.063340] [DEBUG] [LOCAL ] BLD: Primary data saved (27585 records). [2025-10-07T17:40:51.063479] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-07T17:40:51.063569] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLD took 32.0s. Estimated remaining: 4h 44m 46s. Rate: 7.3 symbols/min [2025-10-07T17:40:51.230336] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:40:51.283534] [DEBUG] [LOCAL ] BLND: Loaded 49213 existing records from primary storage. [2025-10-07T17:40:51.284047] [INFO ] [MAIN ] BLND: Loaded 49213 existing records. [2025-10-07T17:40:51.476081] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:40:51.477425] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-07T17:40:51.478972] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T17:40:51.479283] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-07T17:40:51.485093] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-07T17:40:51.485384] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-07T17:40:51.833993] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:40:51.847620] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-07T17:40:52.647742] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-07T17:40:52.841703] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T17:40:53.447669] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-07T17:40:53.594790] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T17:40:53.967346] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T17:40:54.054548] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T17:40:54.247675] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-07T17:40:55.047684] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-07T17:40:55.129363] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T17:40:55.847769] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-07T17:40:56.606465] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T17:40:56.647590] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-07T17:40:56.880068] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T17:40:57.447734] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-07T17:40:58.247739] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-07T17:40:58.379191] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T17:40:58.843092] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T17:40:59.047682] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-07T17:40:59.847619] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-07T17:41:00.325829] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-07T17:41:00.463217] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-07T17:41:00.632231] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T17:41:00.647597] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-07T17:41:01.447801] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-07T17:41:02.247743] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-07T17:41:02.346853] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T17:41:03.047682] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-07T17:41:03.451180] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T17:41:03.681184] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T17:41:03.683616] [INFO ] [REMOTE ] BLE: Full fetch complete (20193 records). [2025-10-07T17:41:03.683745] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-07T17:41:03.851428] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-07T17:41:04.053674] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-07T17:41:04.094972] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-07T17:41:04.095067] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-07T17:41:04.095708] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-07T17:41:04.095802] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-07T17:41:04.095899] [INFO ] [REMOTE ] BLDR: Full fetch complete (74484 records). [2025-10-07T17:41:04.096046] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-07T17:41:04.097045] [DEBUG] [LOCAL ] BLE: Trimmed 20193 records to 14063 (keeping 200 days of data) [2025-10-07T17:41:04.579396] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-07T17:41:04.579837] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-07T17:41:04.580942] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-07T17:41:04.581343] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-07T17:41:04.586299] [DEBUG] [LOCAL ] BLDR: Trimmed 74484 records to 51691 (keeping 200 days of data) [2025-10-07T17:41:04.648756] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-07T17:41:04.688592] [DEBUG] [LOCAL ] BLE: Primary data saved (14063 records). [2025-10-07T17:41:04.692275] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-07T17:41:04.695248] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 31.1s. Estimated remaining: 4h 45m 16s. Rate: 7.3 symbols/min [2025-10-07T17:41:04.950826] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:04.951825] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-07T17:41:04.955579] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-07T17:41:04.959083] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-07T17:41:04.961727] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-07T17:41:04.963312] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-07T17:41:04.963681] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-07T17:41:05.476711] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:41:05.479834] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-07T17:41:05.564592] [DEBUG] [LOCAL ] BLDR: Primary data saved (51691 records). [2025-10-07T17:41:05.564745] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-07T17:41:05.565539] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLDR took 40.2s. Estimated remaining: 4h 44m 16s. Rate: 7.3 symbols/min [2025-10-07T17:41:05.690232] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:41:05.733407] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-07T17:41:05.743580] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:41:05.745473] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T17:41:05.745598] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-07T17:41:05.779178] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:05.779390] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:41:05.779630] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-07T17:41:05.779816] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-07T17:41:05.780203] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-07T17:41:05.780342] [DEBUG] [LOCAL ] BLW: No existing data file found in primary storage. [2025-10-07T17:41:05.780451] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-07T17:41:05.780568] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLSH took 1.1s. Estimated remaining: 4h 43m 13s. Rate: 7.3 symbols/min [2025-10-07T17:41:05.780680] [WARN ] [MAIN ] BLW: No existing data found, performing full refresh instead. [2025-10-07T17:41:05.822955] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-07T17:41:05.854287] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-07T17:41:05.870345] [DEBUG] [LOCAL ] BLW: No primary data file found to delete. [2025-10-07T17:41:05.880861] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-07T17:41:06.046229] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:06.264251] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-07T17:41:06.276629] [DEBUG] [LOCAL ] BLX: Loaded 15594 existing records from primary storage. [2025-10-07T17:41:06.315004] [INFO ] [MAIN ] BLX: Loaded 15594 existing records. [2025-10-07T17:41:06.354268] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:41:06.549120] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:41:06.568489] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-07T17:41:06.569387] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-07T17:41:06.570530] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T17:41:06.581866] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-07T17:41:06.582603] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-07T17:41:06.957740] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:41:07.047721] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-07T17:41:07.839451] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T17:41:07.847710] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-07T17:41:08.652177] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-07T17:41:08.674755] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T17:41:08.870561] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T17:41:09.447747] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-07T17:41:10.247681] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-07T17:41:10.556677] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T17:41:10.588505] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T17:41:11.047698] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-07T17:41:11.194437] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T17:41:11.847707] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-07T17:41:12.583156] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:41:12.647702] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-07T17:41:12.883335] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T17:41:13.447693] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-07T17:41:13.718201] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T17:41:14.247698] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-07T17:41:15.004194] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T17:41:15.047613] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-07T17:41:15.240046] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T17:41:15.847711] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-07T17:41:16.274328] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T17:41:16.647752] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-07T17:41:17.435962] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T17:41:17.447586] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-07T17:41:17.664165] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T17:41:18.247634] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-07T17:41:18.340806] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-07T17:41:19.047692] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-07T17:41:19.849528] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-07T17:41:19.852492] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T17:41:20.011011] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T17:41:20.647709] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-07T17:41:21.314844] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T17:41:21.317549] [INFO ] [REMOTE ] BLK: Full fetch complete (52572 records). [2025-10-07T17:41:21.317709] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-07T17:41:21.452922] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-07T17:41:21.744875] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-07T17:41:21.744971] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-07T17:41:21.745572] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-07T17:41:21.745617] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-07T17:41:21.747394] [DEBUG] [LOCAL ] BLK: Trimmed 52572 records to 34141 (keeping 200 days of data) [2025-10-07T17:41:21.986314] [DEBUG] [LOCAL ] BLK: Primary data saved (34141 records). [2025-10-07T17:41:21.986503] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-07T17:41:21.986676] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLK took 37.2s. Estimated remaining: 4h 43m 59s. Rate: 7.3 symbols/min [2025-10-07T17:41:22.186593] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:22.221364] [DEBUG] [LOCAL ] BMA: Loaded 35563 existing records from primary storage. [2025-10-07T17:41:22.221757] [INFO ] [MAIN ] BMA: Loaded 35563 existing records. [2025-10-07T17:41:22.258058] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-07T17:41:22.402885] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T17:41:22.426677] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:41:22.428480] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-07T17:41:22.428773] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-07T17:41:22.441947] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-07T17:41:22.460292] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-07T17:41:22.513479] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T17:41:22.944476] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:41:23.047694] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-07T17:41:23.492960] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T17:41:23.847700] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-07T17:41:24.530744] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T17:41:24.534465] [INFO ] [REMOTE ] BLND: Full fetch complete (72244 records). [2025-10-07T17:41:24.534692] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-07T17:41:24.652748] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-07T17:41:24.943902] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-07T17:41:24.944148] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-07T17:41:24.945097] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-07T17:41:24.945200] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-07T17:41:24.947119] [DEBUG] [LOCAL ] BLND: Trimmed 72244 records to 49214 (keeping 200 days of data) [2025-10-07T17:41:25.076138] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T17:41:25.274220] [DEBUG] [LOCAL ] BLND: Primary data saved (49214 records). [2025-10-07T17:41:25.274399] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-07T17:41:25.274945] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLND took 34.2s. Estimated remaining: 4h 43m 17s. Rate: 7.3 symbols/min [2025-10-07T17:41:25.445286] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:25.447618] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-07T17:41:25.460992] [DEBUG] [LOCAL ] BME: Loaded 11023 existing records from primary storage. [2025-10-07T17:41:25.461418] [INFO ] [MAIN ] BME: Loaded 11023 existing records. [2025-10-07T17:41:25.599074] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T17:41:25.659818] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:41:25.660070] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-07T17:41:25.660125] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-07T17:41:25.660294] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-07T17:41:25.660356] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-07T17:41:26.019938] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:41:26.247679] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-07T17:41:26.486818] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T17:41:26.749418] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-07T17:41:27.047696] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-07T17:41:27.847697] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-07T17:41:28.191384] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T17:41:28.647638] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-07T17:41:28.872614] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T17:41:29.310594] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-07T17:41:29.447883] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-07T17:41:30.247731] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-07T17:41:30.372177] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T17:41:31.047632] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-07T17:41:31.118671] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T17:41:31.847677] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-07T17:41:32.162776] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T17:41:32.445302] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T17:41:32.647675] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-07T17:41:33.447614] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-07T17:41:33.746341] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T17:41:34.247635] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-07T17:41:34.420159] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T17:41:34.422319] [INFO ] [REMOTE ] BLW: Full fetch complete (19394 records). [2025-10-07T17:41:34.422402] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-07T17:41:34.797996] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-07T17:41:34.798076] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-07T17:41:34.798474] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-07T17:41:34.798537] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-07T17:41:34.799127] [DEBUG] [LOCAL ] BLW: Trimmed 19394 records to 13323 (keeping 200 days of data) [2025-10-07T17:41:34.887752] [DEBUG] [LOCAL ] BLW: Primary data saved (13323 records). [2025-10-07T17:41:34.887922] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-07T17:41:34.888015] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLW took 29.3s. Estimated remaining: 4h 43m 19s. Rate: 7.3 symbols/min [2025-10-07T17:41:35.058188] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:35.058255] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-07T17:41:35.073105] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T17:41:35.100860] [DEBUG] [LOCAL ] BMEZ: Loaded 26581 existing records from primary storage. [2025-10-07T17:41:35.101186] [INFO ] [MAIN ] BMEZ: Loaded 26581 existing records. [2025-10-07T17:41:35.273441] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:41:35.273719] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-07T17:41:35.273774] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-07T17:41:35.274782] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-07T17:41:35.274841] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-07T17:41:35.635190] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:41:35.847692] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-07T17:41:36.355284] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T17:41:36.647698] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-07T17:41:37.236524] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T17:41:37.447713] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-07T17:41:37.825161] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T17:41:38.247702] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-07T17:41:38.396336] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-07T17:41:38.984044] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-07T17:41:39.047716] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-07T17:41:39.847738] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-07T17:41:40.336981] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T17:41:40.647767] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-07T17:41:41.159924] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T17:41:41.447739] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-07T17:41:41.634198] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T17:41:42.097538] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T17:41:42.247666] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-07T17:41:43.047766] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-07T17:41:43.171617] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T17:41:43.173979] [INFO ] [REMOTE ] BLX: Full fetch complete (22699 records). [2025-10-07T17:41:43.174086] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-07T17:41:43.561209] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-07T17:41:43.561416] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-07T17:41:43.561904] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-07T17:41:43.561969] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-07T17:41:43.562807] [DEBUG] [LOCAL ] BLX: Trimmed 22699 records to 15607 (keeping 200 days of data) [2025-10-07T17:41:43.657843] [DEBUG] [LOCAL ] BLX: Primary data saved (15607 records). [2025-10-07T17:41:43.658001] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-07T17:41:43.658127] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 37.9s. Estimated remaining: 4h 43m 14s. Rate: 7.3 symbols/min [2025-10-07T17:41:43.821944] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:43.846249] [DEBUG] [LOCAL ] BMI: Loaded 24309 existing records from primary storage. [2025-10-07T17:41:43.846513] [INFO ] [MAIN ] BMI: Loaded 24309 existing records. [2025-10-07T17:41:43.857553] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-07T17:41:44.023116] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:41:44.023325] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-07T17:41:44.023372] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-07T17:41:44.024280] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-07T17:41:44.024341] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-07T17:41:44.376261] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:41:44.478342] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T17:41:44.647671] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-07T17:41:44.729249] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-07T17:41:45.447693] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-07T17:41:45.793744] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T17:41:46.247727] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-07T17:41:46.337237] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-07T17:41:46.761746] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-07T17:41:47.047717] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-07T17:41:47.847703] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-07T17:41:48.354895] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T17:41:48.647716] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-07T17:41:48.881771] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T17:41:49.447732] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-07T17:41:49.956298] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T17:41:50.247689] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-07T17:41:50.505185] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T17:41:51.047719] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-07T17:41:51.191216] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-07T17:41:51.847737] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-07T17:41:52.055254] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T17:41:52.585837] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T17:41:52.647736] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-07T17:41:53.431189] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-07T17:41:53.447670] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-07T17:41:54.104667] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-07T17:41:54.247747] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-07T17:41:55.047619] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-07T17:41:55.068769] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T17:41:55.847693] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-07T17:41:56.543896] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T17:41:56.647696] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-07T17:41:56.825962] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T17:41:57.447685] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-07T17:41:57.795219] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T17:41:57.798210] [INFO ] [REMOTE ] BMA: Full fetch complete (51484 records). [2025-10-07T17:41:57.798322] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-07T17:41:58.181853] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-07T17:41:58.181936] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-07T17:41:58.182570] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-07T17:41:58.182635] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-07T17:41:58.183806] [DEBUG] [LOCAL ] BMA: Trimmed 51484 records to 35599 (keeping 200 days of data) [2025-10-07T17:41:58.252711] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T17:41:58.252473] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-07T17:41:58.280163] [INFO ] [REMOTE ] BME: Full fetch complete (16077 records). [2025-10-07T17:41:58.280764] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-07T17:41:58.688994] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-07T17:41:58.689146] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-07T17:41:58.689541] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-07T17:41:58.689586] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-07T17:41:58.737245] [DEBUG] [LOCAL ] BME: Trimmed 16077 records to 11037 (keeping 200 days of data) [2025-10-07T17:41:58.844694] [DEBUG] [LOCAL ] BMA: Primary data saved (35599 records). [2025-10-07T17:41:58.845351] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-07T17:41:58.845764] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 36.9s. Estimated remaining: 4h 43m 53s. Rate: 7.3 symbols/min [2025-10-07T17:41:59.031242] [DEBUG] [LOCAL ] BME: Primary data saved (11037 records). [2025-10-07T17:41:59.031152] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:59.031426] [DEBUG] [LOCAL ] BMN: No existing data file found in primary storage. [2025-10-07T17:41:59.031528] [WARN ] [MAIN ] BMN: No existing data found, performing full refresh instead. [2025-10-07T17:41:59.031784] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-07T17:41:59.031855] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-07T17:41:59.031595] [INFO ] [MAIN ] BME: Full history saved. [2025-10-07T17:41:59.032101] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BME took 33.8s. Estimated remaining: 4h 42m 50s. Rate: 7.3 symbols/min [2025-10-07T17:41:59.032008] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-10-07T17:41:59.032206] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-07T17:41:59.058420] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-07T17:41:59.423249] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:41:59.665836] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T17:41:59.664306] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:41:59.701388] [DEBUG] [LOCAL ] BMO: Loaded 41165 existing records from primary storage. [2025-10-07T17:41:59.701748] [INFO ] [MAIN ] BMO: Loaded 41165 existing records. [2025-10-07T17:41:59.872442] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-07T17:41:59.878717] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:41:59.879027] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-07T17:41:59.879116] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-07T17:41:59.880460] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-07T17:41:59.880520] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-07T17:42:00.237630] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:42:00.647636] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-07T17:42:00.710687] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T17:42:01.039755] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-07T17:42:01.079950] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-07T17:42:01.447743] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-07T17:42:02.247697] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-07T17:42:02.558911] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T17:42:03.047687] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-07T17:42:03.847752] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-07T17:42:03.968805] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T17:42:04.120007] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T17:42:04.618888] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T17:42:04.647632] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-07T17:42:05.447716] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-07T17:42:05.837470] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-07T17:42:05.992171] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T17:42:06.247689] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-07T17:42:06.694007] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-07T17:42:07.047716] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-07T17:42:07.547350] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-07T17:42:07.847699] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-07T17:42:08.647730] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-07T17:42:09.119618] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T17:42:09.447703] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-07T17:42:09.691941] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T17:42:10.247718] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-07T17:42:10.527008] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-07T17:42:11.047714] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-07T17:42:11.700672] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T17:42:11.847629] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-07T17:42:12.521448] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T17:42:12.647716] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-07T17:42:12.953423] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T17:42:12.955323] [INFO ] [REMOTE ] BMI: Full fetch complete (33021 records). [2025-10-07T17:42:12.955399] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-07T17:42:13.377714] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-07T17:42:13.377807] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-07T17:42:13.378433] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-07T17:42:13.378498] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-07T17:42:13.379371] [DEBUG] [LOCAL ] BMI: Trimmed 33021 records to 24368 (keeping 200 days of data) [2025-10-07T17:42:13.472706] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-07T17:42:13.537214] [DEBUG] [LOCAL ] BMI: Primary data saved (24368 records). [2025-10-07T17:42:13.537355] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-07T17:42:13.537441] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMI took 29.9s. Estimated remaining: 4h 43m 24s. Rate: 7.3 symbols/min [2025-10-07T17:42:13.741044] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:42:13.741247] [DEBUG] [LOCAL ] BMY: No existing data file found in primary storage. [2025-10-07T17:42:13.741306] [WARN ] [MAIN ] BMY: No existing data found, performing full refresh instead. [2025-10-07T17:42:13.741422] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-07T17:42:13.741466] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-07T17:42:13.741510] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-10-07T17:42:13.741543] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-07T17:42:14.046088] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T17:42:14.048941] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40823 records). [2025-10-07T17:42:14.059602] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-07T17:42:14.242341] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:42:14.252716] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-07T17:42:14.531952] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-07T17:42:14.532051] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-07T17:42:14.532746] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-07T17:42:14.532816] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-07T17:42:14.533815] [DEBUG] [LOCAL ] BMEZ: Trimmed 40823 records to 26653 (keeping 200 days of data) [2025-10-07T17:42:14.706390] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26653 records). [2025-10-07T17:42:14.706539] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-07T17:42:14.706625] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMEZ took 39.8s. Estimated remaining: 4h 42m 29s. Rate: 7.3 symbols/min [2025-10-07T17:42:14.885235] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:42:14.939063] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-07T17:42:14.939392] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-10-07T17:42:15.032206] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T17:42:15.048017] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-07T17:42:15.145534] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:42:15.160304] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-07T17:42:15.160900] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-07T17:42:15.161686] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T17:42:15.171681] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-07T17:42:15.171756] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-07T17:42:15.530359] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:42:15.847711] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-07T17:42:16.647639] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-07T17:42:17.061205] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-07T17:42:17.447624] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-07T17:42:17.646199] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T17:42:17.919125] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T17:42:18.247620] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-07T17:42:18.503209] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T17:42:19.047676] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-07T17:42:19.847671] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-07T17:42:19.901155] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T17:42:20.294229] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T17:42:20.575157] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T17:42:20.647636] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-07T17:42:21.447677] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-07T17:42:21.823384] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-07T17:42:22.156353] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:42:22.247674] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-07T17:42:22.615350] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-07T17:42:23.047699] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-07T17:42:23.847685] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-07T17:42:24.171973] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-07T17:42:24.647614] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-07T17:42:25.139261] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-07T17:42:25.447703] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-07T17:42:26.247615] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-07T17:42:26.428572] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T17:42:26.894934] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T17:42:27.047635] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-07T17:42:27.847742] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-07T17:42:28.510759] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-07T17:42:28.549309] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T17:42:28.647601] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-07T17:42:29.447689] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-07T17:42:29.811682] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T17:42:30.052709] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T17:42:30.053696] [INFO ] [REMOTE ] BMN: Full fetch complete (3720 records). [2025-10-07T17:42:30.053776] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-07T17:42:30.261695] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-07T17:42:30.455726] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-07T17:42:30.455848] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-07T17:42:30.456028] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-07T17:42:30.456175] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-07T17:42:30.456940] [DEBUG] [LOCAL ] BMN: Trimmed 3720 records to 2582 (keeping 200 days of data) [2025-10-07T17:42:30.474153] [DEBUG] [LOCAL ] BMN: Primary data saved (2582 records). [2025-10-07T17:42:30.474340] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-07T17:42:30.474480] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMN took 31.6s. Estimated remaining: 4h 43m 11s. Rate: 7.3 symbols/min [2025-10-07T17:42:30.659812] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T17:42:30.693504] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:42:30.722427] [DEBUG] [LOCAL ] BNED: Loaded 29447 existing records from primary storage. [2025-10-07T17:42:30.722784] [INFO ] [MAIN ] BNED: Loaded 29447 existing records. [2025-10-07T17:42:30.899698] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:42:30.899944] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-07T17:42:30.899993] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-07T17:42:30.900827] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-07T17:42:30.900887] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-07T17:42:31.052704] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-07T17:42:31.251710] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:42:31.847627] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-07T17:42:32.261876] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T17:42:32.647689] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-07T17:42:33.107565] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-07T17:42:33.379181] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T17:42:33.447629] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-07T17:42:34.247694] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-07T17:42:34.411502] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T17:42:35.047698] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-07T17:42:35.485114] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-07T17:42:35.564395] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T17:42:35.847697] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-07T17:42:36.104556] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T17:42:36.647699] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-07T17:42:37.338546] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T17:42:37.341342] [INFO ] [REMOTE ] BMO: Full fetch complete (59715 records). [2025-10-07T17:42:37.341435] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-07T17:42:37.452813] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-07T17:42:37.725469] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-07T17:42:37.725621] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-07T17:42:37.726771] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-07T17:42:37.726838] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-07T17:42:37.728203] [DEBUG] [LOCAL ] BMO: Trimmed 59715 records to 41146 (keeping 200 days of data) [2025-10-07T17:42:38.015138] [DEBUG] [LOCAL ] BMO: Primary data saved (41146 records). [2025-10-07T17:42:38.015321] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-07T17:42:38.016004] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 39.0s. Estimated remaining: 4h 42m 58s. Rate: 7.3 symbols/min [2025-10-07T17:42:38.188107] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:42:38.197444] [DEBUG] [LOCAL ] BNH: Loaded 5218 existing records from primary storage. [2025-10-07T17:42:38.197712] [INFO ] [MAIN ] BNH: Loaded 5218 existing records. [2025-10-07T17:42:38.258546] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-07T17:42:38.379933] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:42:38.380235] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-07T17:42:38.380284] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-07T17:42:38.380540] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-07T17:42:38.380600] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-07T17:42:38.830497] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:42:38.853722] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T17:42:38.900004] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-07T17:42:39.047679] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-07T17:42:39.847616] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-07T17:42:40.117894] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T17:42:40.647631] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-07T17:42:40.868194] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T17:42:41.143281] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T17:42:41.251437] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T17:42:41.447677] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-07T17:42:42.247680] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-07T17:42:42.773660] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-07T17:42:43.047726] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-07T17:42:43.616408] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-07T17:42:43.847710] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-07T17:42:44.169861] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T17:42:44.647716] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-07T17:42:45.209284] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T17:42:45.447632] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-07T17:42:45.540405] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T17:42:46.247751] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-07T17:42:46.846112] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T17:42:47.021820] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T17:42:47.047797] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-07T17:42:47.847724] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-07T17:42:48.393609] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T17:42:48.647729] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-07T17:42:49.447750] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-07T17:42:49.675820] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T17:42:49.939133] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T17:42:50.011444] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T17:42:50.016016] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-07T17:42:50.016200] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-07T17:42:50.252892] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-07T17:42:50.419390] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-07T17:42:50.419486] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-07T17:42:50.420336] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-07T17:42:50.420406] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-07T17:42:50.422004] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-10-07T17:42:50.769510] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-07T17:42:50.769719] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-07T17:42:50.769827] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 37.2s. Estimated remaining: 4h 43m 20s. Rate: 7.3 symbols/min [2025-10-07T17:42:50.944168] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:42:50.948740] [DEBUG] [LOCAL ] BNJ: Loaded 2655 existing records from primary storage. [2025-10-07T17:42:50.948900] [INFO ] [MAIN ] BNJ: Loaded 2655 existing records. [2025-10-07T17:42:51.052854] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-07T17:42:51.127845] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:42:51.128279] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-07T17:42:51.128335] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-07T17:42:51.128905] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-07T17:42:51.128965] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-07T17:42:51.480879] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:42:51.798183] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T17:42:51.847694] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-07T17:42:52.570767] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-07T17:42:52.647634] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-07T17:42:53.127299] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-07T17:42:53.447685] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-07T17:42:53.921398] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-07T17:42:53.982221] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-07T17:42:54.247751] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-07T17:42:55.047738] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-07T17:42:55.713027] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T17:42:55.787194] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T17:42:55.791702] [INFO ] [REMOTE ] BN: Full fetch complete (76712 records). [2025-10-07T17:42:55.791969] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-07T17:42:55.852881] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-07T17:42:56.268574] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-07T17:42:56.268741] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-07T17:42:56.269603] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-07T17:42:56.269676] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-07T17:42:56.271289] [DEBUG] [LOCAL ] BN: Trimmed 76712 records to 52993 (keeping 200 days of data) [2025-10-07T17:42:56.501089] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T17:42:56.625210] [DEBUG] [LOCAL ] BN: Primary data saved (52993 records). [2025-10-07T17:42:56.625370] [INFO ] [MAIN ] BN: Full history saved. [2025-10-07T17:42:56.626330] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BN took 41.9s. Estimated remaining: 4h 42m 56s. Rate: 7.3 symbols/min [2025-10-07T17:42:56.655446] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-07T17:42:56.801401] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:42:56.850789] [DEBUG] [LOCAL ] BNL: Loaded 47097 existing records from primary storage. [2025-10-07T17:42:56.851127] [INFO ] [MAIN ] BNL: Loaded 47097 existing records. [2025-10-07T17:42:57.032546] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:42:57.032804] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-07T17:42:57.032856] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-07T17:42:57.034391] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-07T17:42:57.034461] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-07T17:42:57.349104] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T17:42:57.413664] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:42:57.447596] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-07T17:42:58.247692] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-07T17:42:58.987413] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T17:42:59.047727] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-07T17:42:59.558047] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T17:42:59.823124] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T17:42:59.847602] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-07T17:43:00.431742] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T17:43:00.647882] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-07T17:43:01.447700] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-07T17:43:01.770573] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T17:43:01.772789] [INFO ] [REMOTE ] BNED: Full fetch complete (43478 records). [2025-10-07T17:43:01.772890] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-07T17:43:02.084206] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T17:43:02.192758] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-07T17:43:02.192894] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-07T17:43:02.193726] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-07T17:43:02.193805] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-07T17:43:02.195400] [DEBUG] [LOCAL ] BNED: Trimmed 43478 records to 29337 (keeping 200 days of data) [2025-10-07T17:43:02.248149] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-07T17:43:02.371999] [DEBUG] [LOCAL ] BNED: Primary data saved (29337 records). [2025-10-07T17:43:02.372157] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-07T17:43:02.372280] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BNED took 31.9s. Estimated remaining: 4h 42m 31s. Rate: 7.3 symbols/min [2025-10-07T17:43:02.538782] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:43:02.589923] [DEBUG] [LOCAL ] BNS: Loaded 51491 existing records from primary storage. [2025-10-07T17:43:02.590268] [INFO ] [MAIN ] BNS: Loaded 51491 existing records. [2025-10-07T17:43:02.768620] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:43:02.768908] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-07T17:43:02.768956] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-07T17:43:02.769174] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-07T17:43:02.769231] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-07T17:43:03.052742] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-07T17:43:03.144494] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:43:03.767625] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-07T17:43:03.794315] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T17:43:03.847625] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-07T17:43:04.647711] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-07T17:43:05.352530] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T17:43:05.447678] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-07T17:43:06.023340] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T17:43:06.247713] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-07T17:43:06.611750] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T17:43:06.903564] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-07T17:43:07.047727] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-07T17:43:07.847682] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-07T17:43:08.134491] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-07T17:43:08.410865] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T17:43:08.647686] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-07T17:43:09.155758] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-07T17:43:09.447706] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-07T17:43:10.247747] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-07T17:43:11.047742] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-07T17:43:11.113150] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T17:43:11.144496] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-07T17:43:11.847681] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-07T17:43:12.294462] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-07T17:43:12.636525] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T17:43:12.647603] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-07T17:43:13.447733] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-07T17:43:14.247720] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-07T17:43:14.436297] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T17:43:14.765380] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T17:43:14.766800] [INFO ] [REMOTE ] BNH: Full fetch complete (7030 records). [2025-10-07T17:43:14.766891] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-07T17:43:15.051413] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-07T17:43:15.168738] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-07T17:43:15.177869] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-07T17:43:15.190239] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-07T17:43:15.192911] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-07T17:43:15.194704] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T17:43:15.204037] [DEBUG] [LOCAL ] BNH: Trimmed 7030 records to 5256 (keeping 200 days of data) [2025-10-07T17:43:15.237914] [DEBUG] [LOCAL ] BNH: Primary data saved (5256 records). [2025-10-07T17:43:15.238021] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-07T17:43:15.238115] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNH took 37.2s. Estimated remaining: 4h 42m 53s. Rate: 7.3 symbols/min [2025-10-07T17:43:15.404741] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:43:15.410974] [DEBUG] [LOCAL ] BNT: Loaded 3349 existing records from primary storage. [2025-10-07T17:43:15.411206] [INFO ] [MAIN ] BNT: Loaded 3349 existing records. [2025-10-07T17:43:15.590706] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:43:15.590900] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-07T17:43:15.590946] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-07T17:43:15.591201] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-07T17:43:15.591259] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-07T17:43:15.852746] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-07T17:43:15.952909] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:43:16.647759] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-07T17:43:16.661604] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T17:43:16.689566] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T17:43:17.272283] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-07T17:43:17.447672] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-07T17:43:18.247702] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-07T17:43:19.047690] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-07T17:43:19.117715] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T17:43:19.508214] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-07T17:43:19.847706] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-07T17:43:20.078142] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T17:43:20.318974] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-07T17:43:20.647723] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-07T17:43:21.101666] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-07T17:43:21.102453] [INFO ] [REMOTE ] BNJ: Full fetch complete (4253 records). [2025-10-07T17:43:21.102523] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-07T17:43:21.459473] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-07T17:43:21.467168] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-07T17:43:21.467278] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-07T17:43:21.467473] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-07T17:43:21.468361] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-07T17:43:21.468836] [DEBUG] [LOCAL ] BNJ: Trimmed 4253 records to 2661 (keeping 200 days of data) [2025-10-07T17:43:21.487236] [DEBUG] [LOCAL ] BNJ: Primary data saved (2661 records). [2025-10-07T17:43:21.487330] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-07T17:43:21.487421] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 30.7s. Estimated remaining: 4h 42m 32s. Rate: 7.3 symbols/min [2025-10-07T17:43:21.658872] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:43:21.667743] [DEBUG] [LOCAL ] BNY: Loaded 7004 existing records from primary storage. [2025-10-07T17:43:21.667933] [INFO ] [MAIN ] BNY: Loaded 7004 existing records. [2025-10-07T17:43:21.840311] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:43:21.840544] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-07T17:43:21.840614] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-07T17:43:21.841025] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-07T17:43:21.841083] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-07T17:43:22.126763] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T17:43:22.202704] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:43:22.247605] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-07T17:43:23.047749] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-07T17:43:23.136455] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T17:43:23.847687] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-07T17:43:24.475968] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T17:43:24.524964] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T17:43:24.647601] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-07T17:43:25.447687] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-07T17:43:26.034404] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T17:43:26.247620] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-07T17:43:26.352575] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T17:43:27.047720] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-07T17:43:27.630723] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-07T17:43:27.847731] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-07T17:43:27.924937] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T17:43:28.647726] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-07T17:43:29.173749] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T17:43:29.452739] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-07T17:43:29.468139] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T17:43:30.085744] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-07T17:43:30.247722] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-07T17:43:30.829851] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T17:43:31.047738] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-07T17:43:31.659199] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T17:43:31.847712] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-07T17:43:32.647776] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-07T17:43:33.447742] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-07T17:43:33.535059] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T17:43:33.981432] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-07T17:43:34.247690] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-07T17:43:34.598241] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T17:43:35.047738] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-07T17:43:35.570912] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-07T17:43:35.640024] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T17:43:35.643395] [INFO ] [REMOTE ] BNL: Full fetch complete (67162 records). [2025-10-07T17:43:35.643509] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-07T17:43:35.852855] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-07T17:43:36.025851] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-07T17:43:36.025941] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-07T17:43:36.026636] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-07T17:43:36.026719] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-07T17:43:36.028032] [DEBUG] [LOCAL ] BNL: Trimmed 67162 records to 47159 (keeping 200 days of data) [2025-10-07T17:43:36.329132] [DEBUG] [LOCAL ] BNL: Primary data saved (47159 records). [2025-10-07T17:43:36.329287] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-07T17:43:36.330141] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNL took 39.7s. Estimated remaining: 4h 43m 7s. Rate: 7.3 symbols/min [2025-10-07T17:43:36.444620] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T17:43:36.505701] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:43:36.524053] [DEBUG] [LOCAL ] BOC: Loaded 18309 existing records from primary storage. [2025-10-07T17:43:36.524328] [INFO ] [MAIN ] BOC: Loaded 18309 existing records. [2025-10-07T17:43:36.657717] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-07T17:43:36.699449] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:43:36.699725] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-07T17:43:36.699791] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-07T17:43:36.699984] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-07T17:43:36.700041] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-07T17:43:37.114318] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:43:37.197880] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-07T17:43:37.447699] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-07T17:43:38.247674] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-07T17:43:38.310444] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T17:43:38.999062] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T17:43:39.047737] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-07T17:43:39.572744] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T17:43:39.573589] [INFO ] [REMOTE ] BNT: Full fetch complete (4537 records). [2025-10-07T17:43:39.573683] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-07T17:43:39.852838] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-07T17:43:39.925327] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-07T17:43:39.925398] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-07T17:43:39.925567] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-07T17:43:39.925675] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-07T17:43:39.926052] [DEBUG] [LOCAL ] BNT: Trimmed 4537 records to 3349 (keeping 200 days of data) [2025-10-07T17:43:39.947827] [DEBUG] [LOCAL ] BNT: Primary data saved (3349 records). [2025-10-07T17:43:39.947909] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-07T17:43:39.947987] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 24.7s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-07T17:43:40.647759] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-07T17:43:40.973622] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T17:43:41.447673] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-07T17:43:42.132522] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T17:43:42.247626] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-07T17:43:42.295044] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T17:43:42.968375] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T17:43:43.047704] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-07T17:43:43.812799] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T17:43:43.847631] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-07T17:43:44.404671] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T17:43:44.406017] [INFO ] [REMOTE ] BNY: Full fetch complete (10563 records). [2025-10-07T17:43:44.406088] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-07T17:43:44.653716] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-07T17:43:44.762630] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-07T17:43:44.762738] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-07T17:43:44.762987] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-07T17:43:44.763027] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-07T17:43:44.763448] [DEBUG] [LOCAL ] BNY: Trimmed 10563 records to 7242 (keeping 200 days of data) [2025-10-07T17:43:44.808937] [DEBUG] [LOCAL ] BNY: Primary data saved (7242 records). [2025-10-07T17:43:44.809030] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-07T17:43:44.809106] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNY took 23.3s. Estimated remaining: 4h 41m 58s. Rate: 7.3 symbols/min [2025-10-07T17:43:45.431321] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T17:43:45.447597] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-07T17:43:46.203305] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-07T17:43:46.247709] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-07T17:43:47.047747] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-07T17:43:47.379142] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T17:43:47.847689] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-07T17:43:48.631884] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T17:43:48.647598] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-07T17:43:48.701726] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T17:43:49.447734] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-07T17:43:49.568039] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T17:43:50.247764] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-07T17:43:50.853564] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T17:43:50.857042] [INFO ] [REMOTE ] BNS: Full fetch complete (74332 records). [2025-10-07T17:43:50.857155] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-07T17:43:51.242325] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-07T17:43:51.242558] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-07T17:43:51.243348] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-07T17:43:51.243414] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-07T17:43:51.244997] [DEBUG] [LOCAL ] BNS: Trimmed 74332 records to 51478 (keeping 200 days of data) [2025-10-07T17:43:51.478606] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T17:43:51.487218] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-07T17:43:51.583736] [DEBUG] [LOCAL ] BNS: Primary data saved (51478 records). [2025-10-07T17:43:51.583868] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-07T17:43:51.583976] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNS took 49.2s. Estimated remaining: 4h 41m 40s. Rate: 7.3 symbols/min [2025-10-07T17:43:52.541252] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T17:43:52.547388] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-07T17:43:53.339265] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T17:43:53.345940] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-07T17:43:54.189130] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T17:43:54.190574] [INFO ] [REMOTE ] BOC: Full fetch complete (25702 records). [2025-10-07T17:43:54.190670] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-07T17:43:54.549407] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-07T17:43:54.549510] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-07T17:43:54.549917] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-07T17:43:54.549979] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-07T17:43:54.550913] [DEBUG] [LOCAL ] BOC: Trimmed 25702 records to 18321 (keeping 200 days of data) [2025-10-07T17:43:54.662532] [DEBUG] [LOCAL ] BOC: Primary data saved (18321 records). [2025-10-07T17:43:54.662660] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-07T17:43:54.662759] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 18.3s. Estimated remaining: 4h 40m 59s. Rate: 7.3 symbols/min [2025-10-07T17:43:55.305553] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:43:55.259491] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:43:55.304760] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:43:55.350803] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:43:55.393591] [DEBUG] [LOCAL ] BOE: Loaded 18006 existing records from primary storage. [2025-10-07T17:43:55.394082] [INFO ] [MAIN ] BOE: Loaded 18006 existing records. [2025-10-07T17:43:55.524410] [DEBUG] [LOCAL ] BOH: Loaded 30588 existing records from primary storage. [2025-10-07T17:43:55.525447] [DEBUG] [LOCAL ] BOND: Loaded 32214 existing records from primary storage. [2025-10-07T17:43:55.525954] [INFO ] [MAIN ] BOH: Loaded 30588 existing records. [2025-10-07T17:43:55.526430] [INFO ] [MAIN ] BOND: Loaded 32214 existing records. [2025-10-07T17:43:55.736144] [DEBUG] [LOCAL ] BOOT: Loaded 40336 existing records from primary storage. [2025-10-07T17:43:55.742345] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:43:55.782948] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-07T17:43:55.777575] [INFO ] [MAIN ] BOOT: Loaded 40336 existing records. [2025-10-07T17:43:55.788306] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-07T17:43:55.856338] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-07T17:43:55.880000] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-07T17:43:56.166981] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:43:56.150993] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:43:56.172758] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-07T17:43:56.172706] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-07T17:43:56.204183] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-07T17:43:56.271908] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-07T17:43:56.275010] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-07T17:43:56.319910] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-07T17:43:56.292118] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-07T17:43:56.339160] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-07T17:43:56.328420] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:43:56.447611] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-07T17:43:56.480406] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-07T17:43:56.598984] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-07T17:43:56.622824] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-07T17:43:57.185065] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:43:57.256683] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-07T17:43:57.530083] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:43:57.511073] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:43:57.550975] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-07T17:43:57.550689] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-07T17:43:57.656700] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:43:57.656984] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-07T17:43:58.604376] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T17:43:58.609251] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-07T17:43:58.939726] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T17:43:58.946211] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-07T17:43:59.063928] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T17:43:59.072920] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-07T17:43:59.157364] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T17:43:59.164702] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-07T17:43:59.676837] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T17:43:59.847685] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-07T17:44:00.198360] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T17:44:00.341993] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T17:44:00.451735] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T17:44:00.512330] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T17:44:00.647672] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-07T17:44:01.447638] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-07T17:44:01.520184] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T17:44:02.247746] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-07T17:44:03.047621] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-07T17:44:03.093169] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T17:44:03.373951] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T17:44:03.847617] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-07T17:44:04.181202] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T17:44:04.647748] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-07T17:44:05.447707] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-07T17:44:05.509963] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T17:44:06.247672] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-07T17:44:06.249498] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T17:44:06.474903] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T17:44:07.047706] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-07T17:44:07.847763] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-07T17:44:07.925342] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T17:44:08.032855] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T17:44:08.647684] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-07T17:44:09.447701] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-07T17:44:09.494898] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T17:44:10.199267] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T17:44:10.247616] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-07T17:44:10.719180] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T17:44:11.047723] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-07T17:44:11.794082] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T17:44:11.847709] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-07T17:44:12.066870] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T17:44:12.647676] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-07T17:44:13.099217] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T17:44:13.447761] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-07T17:44:14.256269] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-07T17:44:14.262197] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T17:44:14.416090] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T17:44:15.047701] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-07T17:44:15.410265] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T17:44:15.847613] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-07T17:44:16.047881] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T17:44:16.619810] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T17:44:16.647740] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-07T17:44:17.447681] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-07T17:44:18.121632] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T17:44:18.247719] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-07T17:44:18.772992] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T17:44:19.047709] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-07T17:44:19.448122] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T17:44:19.847732] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-07T17:44:20.338202] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T17:44:20.647674] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-07T17:44:21.447693] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-07T17:44:21.606513] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T17:44:21.647291] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T17:44:21.650168] [INFO ] [REMOTE ] BOOT: Full fetch complete (60101 records). [2025-10-07T17:44:21.650346] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-07T17:44:22.044631] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-07T17:44:22.044752] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-07T17:44:22.045445] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-07T17:44:22.045489] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-07T17:44:22.046716] [DEBUG] [LOCAL ] BOOT: Trimmed 60101 records to 40234 (keeping 200 days of data) [2025-10-07T17:44:22.266422] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-07T17:44:22.308822] [DEBUG] [LOCAL ] BOOT: Primary data saved (40234 records). [2025-10-07T17:44:22.308955] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-07T17:44:22.310864] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOOT took 27.6s. Estimated remaining: 4h 42m 55s. Rate: 7.2 symbols/min [2025-10-07T17:44:22.480561] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:44:22.480873] [DEBUG] [LOCAL ] BORR: No existing data file found in primary storage. [2025-10-07T17:44:22.480931] [WARN ] [MAIN ] BORR: No existing data found, performing full refresh instead. [2025-10-07T17:44:22.481058] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-07T17:44:22.481129] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-07T17:44:22.481191] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-07T17:44:22.481226] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-07T17:44:22.841768] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:44:22.914817] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T17:44:23.047683] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-07T17:44:23.112149] [DEBUG] [REMOTE ] BOE: Error fetching primary data for 2025-09: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-07T17:44:23.112300] [WARN ] [REMOTE ] BOE: No data returned for month 2025-09 [2025-10-07T17:44:23.112371] [FATAL] [REMOTE ] BOE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:44:23.112424] [FATAL] [MAIN ] BOE: Failed to fetch primary data. [2025-10-07T17:44:23.112518] [WARN ] [MAIN ] BOE: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:44:23.112590] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-07T17:44:23.112738] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-07T17:44:23.112815] [INFO ] [LOCAL ] BOE: Starting deletion of derivative data. [2025-10-07T17:44:23.113160] [DEBUG] [LOCAL ] BOE: Deleted derivative data file. [2025-10-07T17:44:23.113235] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOE took 28.4s. Estimated remaining: 4h 41m 59s. Rate: 7.3 symbols/min [2025-10-07T17:44:23.284035] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:44:23.308339] [DEBUG] [LOCAL ] BOW: Loaded 23794 existing records from primary storage. [2025-10-07T17:44:23.308665] [INFO ] [MAIN ] BOW: Loaded 23794 existing records. [2025-10-07T17:44:23.480924] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:44:23.481137] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-07T17:44:23.481186] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-07T17:44:23.482060] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-07T17:44:23.482120] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-07T17:44:23.822733] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:44:23.847607] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-07T17:44:24.647712] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-07T17:44:24.824063] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T17:44:24.864401] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T17:44:25.447735] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-07T17:44:25.920006] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T17:44:26.247745] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-07T17:44:27.047663] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-07T17:44:27.160760] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T17:44:27.610543] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T17:44:27.847624] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-07T17:44:27.944174] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-07T17:44:28.647734] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-07T17:44:29.447691] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-07T17:44:29.570971] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T17:44:29.705091] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T17:44:30.247944] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-07T17:44:30.895991] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T17:44:31.047753] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-07T17:44:31.638862] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T17:44:31.847711] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-07T17:44:32.326066] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T17:44:32.328601] [INFO ] [REMOTE ] BOND: Full fetch complete (46479 records). [2025-10-07T17:44:32.328727] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-07T17:44:32.657890] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-07T17:44:32.713225] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-07T17:44:32.713307] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-07T17:44:32.713928] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-07T17:44:32.713996] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-07T17:44:32.715148] [DEBUG] [LOCAL ] BOND: Trimmed 46479 records to 32226 (keeping 200 days of data) [2025-10-07T17:44:32.915693] [DEBUG] [LOCAL ] BOND: Primary data saved (32226 records). [2025-10-07T17:44:32.915838] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-07T17:44:32.915923] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 38.3s. Estimated remaining: 4h 42m 1s. Rate: 7.3 symbols/min [2025-10-07T17:44:33.081850] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:44:33.126039] [DEBUG] [LOCAL ] BOX: Loaded 50221 existing records from primary storage. [2025-10-07T17:44:33.126356] [INFO ] [MAIN ] BOX: Loaded 50221 existing records. [2025-10-07T17:44:33.332525] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:44:33.332909] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-07T17:44:33.333224] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-07T17:44:33.333621] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-07T17:44:33.333712] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-07T17:44:33.448876] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-07T17:44:33.695589] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T17:44:33.750050] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:44:33.898349] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T17:44:33.900628] [INFO ] [REMOTE ] BOH: Full fetch complete (44832 records). [2025-10-07T17:44:33.900973] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-07T17:44:34.252729] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-07T17:44:34.306812] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T17:44:34.326892] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-07T17:44:34.326990] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-07T17:44:34.327595] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-07T17:44:34.327700] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-07T17:44:34.329108] [DEBUG] [LOCAL ] BOH: Trimmed 44832 records to 30506 (keeping 200 days of data) [2025-10-07T17:44:34.527291] [DEBUG] [LOCAL ] BOH: Primary data saved (30506 records). [2025-10-07T17:44:34.527446] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-07T17:44:34.527532] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOH took 39.9s. Estimated remaining: 4h 41m 10s. Rate: 7.3 symbols/min [2025-10-07T17:44:34.694363] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:44:34.694596] [DEBUG] [LOCAL ] BP: No existing data file found in primary storage. [2025-10-07T17:44:34.694677] [WARN ] [MAIN ] BP: No existing data found, performing full refresh instead. [2025-10-07T17:44:34.694822] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-07T17:44:34.694872] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-07T17:44:34.694916] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-07T17:44:34.694948] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-07T17:44:35.052297] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:44:35.049989] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-07T17:44:35.847744] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-07T17:44:35.881896] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T17:44:36.647745] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-07T17:44:37.233237] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-07T17:44:37.447612] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-07T17:44:37.848435] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T17:44:38.215061] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T17:44:38.247626] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-07T17:44:39.035749] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T17:44:39.047603] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-07T17:44:39.758613] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T17:44:39.847708] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-07T17:44:40.650802] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-07T17:44:40.657197] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T17:44:41.285336] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T17:44:41.447637] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-07T17:44:42.247630] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-07T17:44:42.672887] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-07T17:44:42.728929] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T17:44:43.047695] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-07T17:44:43.516023] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T17:44:43.847626] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-07T17:44:44.647638] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-07T17:44:44.692051] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T17:44:44.860487] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T17:44:45.447676] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-07T17:44:46.231612] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T17:44:46.247596] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-07T17:44:47.047613] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-07T17:44:47.531627] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T17:44:47.847619] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-07T17:44:47.955178] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T17:44:48.050110] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T17:44:48.647740] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-07T17:44:49.358496] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T17:44:49.408983] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T17:44:49.447601] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-07T17:44:50.247631] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-07T17:44:50.540206] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T17:44:51.047751] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-07T17:44:51.847726] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-07T17:44:52.158240] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T17:44:52.611253] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-07T17:44:52.647604] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-07T17:44:53.391433] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:44:53.447725] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-07T17:44:54.247704] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-07T17:44:55.048858] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-07T17:44:55.066684] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T17:44:55.083617] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-07T17:44:55.760222] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T17:44:55.847613] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-07T17:44:56.178948] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T17:44:56.181361] [INFO ] [REMOTE ] BOW: Full fetch complete (31942 records). [2025-10-07T17:44:56.181446] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-07T17:44:56.561839] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-07T17:44:56.561923] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-07T17:44:56.562364] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-07T17:44:56.562417] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-07T17:44:56.563221] [DEBUG] [LOCAL ] BOW: Trimmed 31942 records to 23806 (keeping 200 days of data) [2025-10-07T17:44:56.648680] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-07T17:44:56.702967] [DEBUG] [LOCAL ] BOW: Primary data saved (23806 records). [2025-10-07T17:44:56.703113] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-07T17:44:56.703198] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 33.6s. Estimated remaining: 4h 42m 30s. Rate: 7.2 symbols/min [2025-10-07T17:44:56.866245] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:44:56.902469] [DEBUG] [LOCAL ] BR: Loaded 34837 existing records from primary storage. [2025-10-07T17:44:56.902787] [INFO ] [MAIN ] BR: Loaded 34837 existing records. [2025-10-07T17:44:57.085928] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:44:57.086233] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-07T17:44:57.086311] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-07T17:44:57.086820] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-07T17:44:57.086903] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-07T17:44:57.200210] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T17:44:57.264705] [INFO ] [REMOTE ] BORR: Full fetch complete (74586 records). [2025-10-07T17:44:57.282266] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-07T17:44:57.457809] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-07T17:44:57.618846] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:44:57.909167] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-07T17:44:57.909303] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-07T17:44:57.910577] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-07T17:44:57.910678] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-07T17:44:57.913042] [DEBUG] [LOCAL ] BORR: Trimmed 74586 records to 51100 (keeping 200 days of data) [2025-10-07T17:44:58.239337] [DEBUG] [LOCAL ] BORR: Primary data saved (51100 records). [2025-10-07T17:44:58.239578] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-07T17:44:58.239712] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 35.9s. Estimated remaining: 4h 41m 39s. Rate: 7.3 symbols/min [2025-10-07T17:44:58.275896] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-07T17:44:58.429766] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:44:58.484364] [DEBUG] [LOCAL ] BRBR: Loaded 51408 existing records from primary storage. [2025-10-07T17:44:58.484857] [INFO ] [MAIN ] BRBR: Loaded 51408 existing records. [2025-10-07T17:44:58.725896] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-07T17:44:58.722675] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:44:58.737315] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-07T17:44:58.737434] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-07T17:44:58.740347] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-07T17:44:58.740440] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-07T17:44:59.061968] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-07T17:44:59.106483] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:44:59.268219] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T17:44:59.721827] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T17:44:59.847710] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-07T17:45:00.647726] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-07T17:45:01.177822] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-07T17:45:01.447637] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-07T17:45:01.551028] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T17:45:02.247676] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-07T17:45:02.594537] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-07T17:45:03.047735] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-07T17:45:03.439347] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T17:45:03.848241] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-07T17:45:04.324511] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-07T17:45:04.647737] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-07T17:45:04.867631] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T17:45:05.343115] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T17:45:05.346107] [INFO ] [REMOTE ] BOX: Full fetch complete (71739 records). [2025-10-07T17:45:05.346204] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-07T17:45:05.346969] [FATAL] [VALIDATOR ] BOX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:45:05.347055] [FATAL] [MAIN ] BOX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:45:05.347098] [WARN ] [MAIN ] BOX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:45:05.347136] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-07T17:45:05.347196] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-07T17:45:05.347231] [INFO ] [LOCAL ] BOX: Starting deletion of derivative data. [2025-10-07T17:45:05.347466] [DEBUG] [LOCAL ] BOX: Deleted derivative data file. [2025-10-07T17:45:05.347572] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 32.4s. Estimated remaining: 4h 41m 24s. Rate: 7.3 symbols/min [2025-10-07T17:45:05.452864] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-07T17:45:05.519307] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:45:05.538284] [DEBUG] [LOCAL ] BRC: Loaded 18933 existing records from primary storage. [2025-10-07T17:45:05.538589] [INFO ] [MAIN ] BRC: Loaded 18933 existing records. [2025-10-07T17:45:05.712959] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:45:05.713151] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-07T17:45:05.713199] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-07T17:45:05.713469] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-07T17:45:05.713524] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-07T17:45:06.081152] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:45:06.167868] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T17:45:06.247683] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-07T17:45:07.047689] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-07T17:45:07.152991] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T17:45:07.603215] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T17:45:07.847725] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-07T17:45:08.647702] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-07T17:45:09.232768] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-07T17:45:09.406243] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T17:45:09.447625] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-07T17:45:09.900292] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T17:45:10.247678] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-07T17:45:11.047628] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-07T17:45:11.154166] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T17:45:11.669728] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T17:45:11.690088] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T17:45:11.847698] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-07T17:45:12.611676] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T17:45:12.647682] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-07T17:45:13.447665] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-07T17:45:14.247623] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-07T17:45:14.332300] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T17:45:14.649470] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T17:45:15.047759] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-07T17:45:15.421093] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T17:45:15.847752] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-07T17:45:16.122515] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T17:45:16.647717] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-07T17:45:17.278570] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T17:45:17.447670] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-07T17:45:18.247689] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-07T17:45:18.978624] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-07T17:45:18.982587] [INFO ] [REMOTE ] BP: Full fetch complete (77761 records). [2025-10-07T17:45:18.982824] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-07T17:45:19.052014] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-07T17:45:19.415298] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-07T17:45:19.415514] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-07T17:45:19.416405] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-07T17:45:19.416930] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-07T17:45:19.440744] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T17:45:19.441062] [DEBUG] [LOCAL ] BP: Trimmed 77761 records to 53709 (keeping 200 days of data) [2025-10-07T17:45:19.571118] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-07T17:45:19.848323] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-07T17:45:19.866028] [DEBUG] [LOCAL ] BP: Primary data saved (53709 records). [2025-10-07T17:45:19.866215] [INFO ] [MAIN ] BP: Full history saved. [2025-10-07T17:45:19.866299] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BP took 45.3s. Estimated remaining: 4h 41m 54s. Rate: 7.2 symbols/min [2025-10-07T17:45:20.085253] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:45:20.129162] [DEBUG] [LOCAL ] BRCC: Loaded 40170 existing records from primary storage. [2025-10-07T17:45:20.129574] [INFO ] [MAIN ] BRCC: Loaded 40170 existing records. [2025-10-07T17:45:20.362489] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:45:20.362840] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-07T17:45:20.362924] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-07T17:45:20.363418] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-07T17:45:20.363497] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-07T17:45:20.649501] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-07T17:45:20.847338] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:45:20.879573] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T17:45:21.091150] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T17:45:21.447707] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-07T17:45:21.791782] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T17:45:22.247633] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-07T17:45:22.943129] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T17:45:23.047609] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-07T17:45:23.398950] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T17:45:23.401957] [INFO ] [REMOTE ] BR: Full fetch complete (49509 records). [2025-10-07T17:45:23.402136] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-07T17:45:23.793663] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-07T17:45:23.793755] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-07T17:45:23.794372] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-07T17:45:23.794416] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-07T17:45:23.795542] [DEBUG] [LOCAL ] BR: Trimmed 49509 records to 34891 (keeping 200 days of data) [2025-10-07T17:45:23.855440] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-07T17:45:24.025800] [DEBUG] [LOCAL ] BR: Primary data saved (34891 records). [2025-10-07T17:45:24.025948] [INFO ] [MAIN ] BR: Full history saved. [2025-10-07T17:45:24.026634] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 27.3s. Estimated remaining: 4h 41m 21s. Rate: 7.3 symbols/min [2025-10-07T17:45:24.204312] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:45:24.204635] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-07T17:45:24.204716] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-07T17:45:24.204855] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-07T17:45:24.204901] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-07T17:45:24.204945] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-07T17:45:24.204978] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-07T17:45:24.565226] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T17:45:24.603511] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:45:24.647602] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-07T17:45:24.691866] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T17:45:25.447696] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-07T17:45:25.990819] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T17:45:26.247691] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-07T17:45:27.047690] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-07T17:45:27.118549] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T17:45:27.581947] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-07T17:45:27.847753] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-07T17:45:27.953812] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T17:45:28.647711] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-07T17:45:28.684472] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-07T17:45:29.447734] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-07T17:45:30.247614] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-07T17:45:30.578635] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T17:45:30.884225] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T17:45:31.038719] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T17:45:31.041198] [INFO ] [REMOTE ] BRC: Full fetch complete (28950 records). [2025-10-07T17:45:31.041282] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-07T17:45:31.052832] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-07T17:45:31.415036] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-07T17:45:31.415116] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-07T17:45:31.415544] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-07T17:45:31.415585] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-07T17:45:31.416370] [DEBUG] [LOCAL ] BRC: Trimmed 28950 records to 18876 (keeping 200 days of data) [2025-10-07T17:45:31.539900] [DEBUG] [LOCAL ] BRC: Primary data saved (18876 records). [2025-10-07T17:45:31.540067] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-07T17:45:31.540245] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRC took 26.2s. Estimated remaining: 4h 41m 8s. Rate: 7.3 symbols/min [2025-10-07T17:45:31.710144] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:45:31.766558] [DEBUG] [LOCAL ] BROS: Loaded 53294 existing records from primary storage. [2025-10-07T17:45:31.767004] [INFO ] [MAIN ] BROS: Loaded 53294 existing records. [2025-10-07T17:45:31.852972] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-07T17:45:31.949627] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:45:31.949944] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-07T17:45:31.950006] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-07T17:45:31.951688] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-07T17:45:31.951752] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-07T17:45:32.342273] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:45:32.647633] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-07T17:45:32.811529] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T17:45:33.354278] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T17:45:33.447621] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-07T17:45:34.243284] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T17:45:34.253431] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-07T17:45:35.047612] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-07T17:45:35.142433] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T17:45:35.726162] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T17:45:35.847700] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-07T17:45:36.451947] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T17:45:36.647705] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-07T17:45:37.240820] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T17:45:37.447719] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-07T17:45:38.171037] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T17:45:38.174483] [INFO ] [REMOTE ] BRBR: Full fetch complete (72205 records). [2025-10-07T17:45:38.174592] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-07T17:45:38.252733] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-07T17:45:38.597824] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-07T17:45:38.597939] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-07T17:45:38.598829] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-07T17:45:38.598925] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-07T17:45:38.600701] [DEBUG] [LOCAL ] BRBR: Trimmed 72205 records to 51420 (keeping 200 days of data) [2025-10-07T17:45:38.983909] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T17:45:39.063943] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-07T17:45:39.139867] [DEBUG] [LOCAL ] BRBR: Primary data saved (51420 records). [2025-10-07T17:45:39.140097] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-07T17:45:39.141555] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 40.9s. Estimated remaining: 4h 40m 55s. Rate: 7.3 symbols/min [2025-10-07T17:45:39.412467] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:45:39.412747] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-07T17:45:39.412812] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-07T17:45:39.412956] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-07T17:45:39.413022] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-07T17:45:39.413098] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-07T17:45:39.413134] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-07T17:45:39.811055] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:45:39.847780] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-07T17:45:40.047724] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:45:40.048054] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-07T17:45:40.048145] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:45:40.048193] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-07T17:45:40.048254] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:45:40.048356] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-07T17:45:40.048426] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-07T17:45:40.048462] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-07T17:45:40.048501] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-07T17:45:40.048564] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRSL took 0.9s. Estimated remaining: 4h 40m 2s. Rate: 7.3 symbols/min [2025-10-07T17:45:40.222460] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:45:40.256931] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T17:45:40.306924] [DEBUG] [LOCAL ] BRSP: Loaded 36695 existing records from primary storage. [2025-10-07T17:45:40.307251] [INFO ] [MAIN ] BRSP: Loaded 36695 existing records. [2025-10-07T17:45:40.494145] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:45:40.494403] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-07T17:45:40.494458] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-07T17:45:40.495515] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-07T17:45:40.495577] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-07T17:45:40.649131] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-07T17:45:40.870949] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:45:40.959283] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T17:45:41.447748] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-07T17:45:42.211030] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T17:45:42.247682] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-07T17:45:43.047737] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-07T17:45:43.165194] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T17:45:43.699807] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T17:45:43.847607] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-07T17:45:44.647620] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-07T17:45:44.841762] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T17:45:45.447627] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-07T17:45:45.485808] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T17:45:45.846283] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T17:45:46.247675] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-07T17:45:47.047838] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-07T17:45:47.317034] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T17:45:47.726863] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T17:45:47.847672] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-07T17:45:48.647629] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-07T17:45:48.896912] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T17:45:49.447614] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-07T17:45:49.853812] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-07T17:45:49.922353] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T17:45:50.247717] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-07T17:45:51.047636] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-07T17:45:51.370905] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T17:45:51.490580] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T17:45:51.847713] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-07T17:45:52.511573] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T17:45:52.647749] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-07T17:45:52.886524] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T17:45:53.447681] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-07T17:45:54.142758] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T17:45:54.247672] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-07T17:45:54.761826] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T17:45:55.047709] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-07T17:45:55.617228] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T17:45:55.620720] [INFO ] [REMOTE ] BRCC: Full fetch complete (57544 records). [2025-10-07T17:45:55.620829] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-07T17:45:55.852948] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-07T17:45:56.057371] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-07T17:45:56.057467] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-07T17:45:56.058137] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-07T17:45:56.058204] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-07T17:45:56.059504] [DEBUG] [LOCAL ] BRCC: Trimmed 57544 records to 40149 (keeping 200 days of data) [2025-10-07T17:45:56.304885] [DEBUG] [LOCAL ] BRCC: Primary data saved (40149 records). [2025-10-07T17:45:56.305030] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-07T17:45:56.305975] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRCC took 36.4s. Estimated remaining: 4h 40m 43s. Rate: 7.3 symbols/min [2025-10-07T17:45:56.485740] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:45:56.493998] [DEBUG] [LOCAL ] BRT: Loaded 4946 existing records from primary storage. [2025-10-07T17:45:56.494267] [INFO ] [MAIN ] BRT: Loaded 4946 existing records. [2025-10-07T17:45:56.657814] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-07T17:45:56.692846] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:45:56.694299] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-07T17:45:56.694382] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-07T17:45:56.694752] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-07T17:45:56.695026] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-07T17:45:57.057399] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T17:45:57.141124] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:45:57.177353] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T17:45:57.181065] [INFO ] [REMOTE ] BRO: Full fetch complete (74359 records). [2025-10-07T17:45:57.181216] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-07T17:45:57.452833] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-07T17:45:57.575906] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-07T17:45:57.576021] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-07T17:45:57.576867] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-07T17:45:57.576947] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-07T17:45:57.579074] [DEBUG] [LOCAL ] BRO: Trimmed 74359 records to 51940 (keeping 200 days of data) [2025-10-07T17:45:57.841023] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T17:45:57.940995] [DEBUG] [LOCAL ] BRO: Primary data saved (51940 records). [2025-10-07T17:45:57.941171] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-07T17:45:57.941256] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 33.9s. Estimated remaining: 4h 39m 54s. Rate: 7.3 symbols/min [2025-10-07T17:45:58.113984] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:45:58.134726] [DEBUG] [LOCAL ] BRW: Loaded 20615 existing records from primary storage. [2025-10-07T17:45:58.135156] [INFO ] [MAIN ] BRW: Loaded 20615 existing records. [2025-10-07T17:45:58.252807] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-07T17:45:58.247400] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T17:45:58.336828] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:45:58.337061] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-07T17:45:58.337111] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-07T17:45:58.337887] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-07T17:45:58.337947] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-07T17:45:58.705920] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:45:59.047693] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-07T17:45:59.599397] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T17:45:59.847684] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-07T17:46:00.246810] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T17:46:00.647732] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-07T17:46:01.073215] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T17:46:01.279173] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T17:46:01.447750] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-07T17:46:02.247698] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-07T17:46:03.052756] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-07T17:46:03.067611] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T17:46:03.412078] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-07T17:46:03.467101] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T17:46:03.847698] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-07T17:46:04.647688] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-07T17:46:05.063412] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T17:46:05.447681] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-07T17:46:06.048272] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T17:46:06.247632] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-07T17:46:06.622222] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T17:46:07.047689] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-07T17:46:07.655055] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T17:46:07.657727] [INFO ] [REMOTE ] BRSP: Full fetch complete (54269 records). [2025-10-07T17:46:07.657820] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-07T17:46:07.853190] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-07T17:46:08.036403] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-07T17:46:08.036566] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-07T17:46:08.037237] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-07T17:46:08.037305] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-07T17:46:08.038561] [DEBUG] [LOCAL ] BRSP: Trimmed 54269 records to 36656 (keeping 200 days of data) [2025-10-07T17:46:08.256482] [DEBUG] [LOCAL ] BRSP: Primary data saved (36656 records). [2025-10-07T17:46:08.256633] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-07T17:46:08.257514] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 28.2s. Estimated remaining: 4h 39m 58s. Rate: 7.3 symbols/min [2025-10-07T17:46:08.420839] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:46:08.472448] [DEBUG] [LOCAL ] BRX: Loaded 51731 existing records from primary storage. [2025-10-07T17:46:08.472835] [INFO ] [MAIN ] BRX: Loaded 51731 existing records. [2025-10-07T17:46:08.647080] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:46:08.647303] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-07T17:46:08.647350] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-07T17:46:08.647634] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-07T17:46:08.652378] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-07T17:46:08.652449] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-07T17:46:09.019988] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T17:46:09.019393] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:46:09.103089] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-07T17:46:09.447624] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-07T17:46:09.455818] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T17:46:10.247621] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-07T17:46:10.624846] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T17:46:11.047768] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-07T17:46:11.847723] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-07T17:46:11.918348] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T17:46:11.978422] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T17:46:12.343793] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-07T17:46:12.647737] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-07T17:46:13.144134] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-07T17:46:13.447740] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-07T17:46:14.247694] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-07T17:46:15.047679] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-07T17:46:15.135538] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T17:46:15.323963] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T17:46:15.847673] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-07T17:46:16.647724] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-07T17:46:16.772035] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T17:46:16.817340] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T17:46:17.447636] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-07T17:46:18.247738] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-07T17:46:18.647475] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T17:46:18.739696] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-07T17:46:18.870257] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T17:46:19.047731] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-07T17:46:19.847726] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-07T17:46:20.645718] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T17:46:20.655180] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-07T17:46:21.447735] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-07T17:46:21.582009] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-07T17:46:21.672899] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-07T17:46:21.676371] [INFO ] [REMOTE ] BROS: Full fetch complete (77066 records). [2025-10-07T17:46:21.676487] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-07T17:46:22.072811] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-07T17:46:22.072906] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-07T17:46:22.073748] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-07T17:46:22.073820] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-07T17:46:22.075769] [DEBUG] [LOCAL ] BROS: Trimmed 77066 records to 53293 (keeping 200 days of data) [2025-10-07T17:46:22.181953] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-07T17:46:22.272634] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-07T17:46:22.433583] [DEBUG] [LOCAL ] BROS: Primary data saved (53293 records). [2025-10-07T17:46:22.433762] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-07T17:46:22.433852] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BROS took 50.9s. Estimated remaining: 4h 40m 26s. Rate: 7.3 symbols/min [2025-10-07T17:46:22.604948] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:46:22.636106] [DEBUG] [LOCAL ] BSAC: Loaded 32912 existing records from primary storage. [2025-10-07T17:46:22.636577] [INFO ] [MAIN ] BSAC: Loaded 32912 existing records. [2025-10-07T17:46:22.814397] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:46:22.814630] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-07T17:46:22.814710] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-07T17:46:22.815494] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-07T17:46:22.815552] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-07T17:46:23.058521] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-07T17:46:23.203094] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:46:23.717555] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-07T17:46:23.811696] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T17:46:23.847690] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-07T17:46:24.647716] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-07T17:46:25.241638] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T17:46:25.242598] [INFO ] [REMOTE ] BRT: Full fetch complete (6789 records). [2025-10-07T17:46:25.242696] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-07T17:46:25.243124] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:46:25.243202] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:46:25.243269] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:46:25.243346] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-07T17:46:25.243440] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-07T17:46:25.243495] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-07T17:46:25.243753] [DEBUG] [LOCAL ] BRT: Deleted derivative data file. [2025-10-07T17:46:25.243865] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRT took 28.9s. Estimated remaining: 4h 39m 45s. Rate: 7.3 symbols/min [2025-10-07T17:46:25.431345] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:46:25.452281] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-07T17:46:25.470273] [DEBUG] [LOCAL ] BSBR: Loaded 35401 existing records from primary storage. [2025-10-07T17:46:25.470607] [INFO ] [MAIN ] BSBR: Loaded 35401 existing records. [2025-10-07T17:46:25.660327] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:46:25.660692] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-07T17:46:25.660885] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-07T17:46:25.673692] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-07T17:46:25.678953] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-07T17:46:25.783943] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T17:46:26.092954] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:46:26.247691] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-07T17:46:26.344546] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T17:46:26.356837] [DEBUG] [REMOTE ] BSBR: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-07T17:46:26.357175] [WARN ] [REMOTE ] BSBR: No data returned for month 2024-12 [2025-10-07T17:46:26.357266] [FATAL] [REMOTE ] BSBR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:46:26.357317] [FATAL] [MAIN ] BSBR: Failed to fetch primary data. [2025-10-07T17:46:26.357351] [WARN ] [MAIN ] BSBR: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:46:26.357398] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-07T17:46:26.357457] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-07T17:46:26.357727] [INFO ] [LOCAL ] BSBR: Starting deletion of derivative data. [2025-10-07T17:46:26.357939] [DEBUG] [LOCAL ] BSBR: Deleted derivative data file. [2025-10-07T17:46:26.358042] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BSBR took 1.1s. Estimated remaining: 4h 38m 54s. Rate: 7.3 symbols/min [2025-10-07T17:46:26.528846] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:46:26.529060] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-10-07T17:46:26.529116] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-10-07T17:46:26.529233] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-07T17:46:26.529275] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-07T17:46:26.529317] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-07T17:46:26.529349] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-07T17:46:26.964982] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:46:27.047681] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-07T17:46:27.847732] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-07T17:46:27.877932] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-07T17:46:28.647757] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-07T17:46:28.978417] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T17:46:29.059871] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-07T17:46:29.447680] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-07T17:46:30.247758] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-07T17:46:31.047744] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-07T17:46:31.126606] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T17:46:31.262258] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T17:46:31.267926] [INFO ] [REMOTE ] BRW: Full fetch complete (30391 records). [2025-10-07T17:46:31.268329] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-07T17:46:31.269624] [FATAL] [VALIDATOR ] BRW: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:46:31.269810] [FATAL] [MAIN ] BRW: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:46:31.269952] [WARN ] [MAIN ] BRW: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:46:31.270059] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-07T17:46:31.270174] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-07T17:46:31.270241] [INFO ] [LOCAL ] BRW: Starting deletion of derivative data. [2025-10-07T17:46:31.270857] [DEBUG] [LOCAL ] BRW: Deleted derivative data file. [2025-10-07T17:46:31.271219] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BRW took 33.3s. Estimated remaining: 4h 38m 25s. Rate: 7.3 symbols/min [2025-10-07T17:46:31.516952] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:46:31.517192] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-07T17:46:31.517253] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-07T17:46:31.517415] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-07T17:46:31.517477] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-07T17:46:31.517553] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-07T17:46:31.517607] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-07T17:46:31.852918] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-07T17:46:32.008990] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:46:32.021691] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T17:46:32.647712] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-07T17:46:33.212481] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T17:46:33.447623] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-07T17:46:33.458057] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T17:46:34.247631] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-07T17:46:34.389939] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-07T17:46:35.047699] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-07T17:46:35.818025] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T17:46:35.847601] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-07T17:46:36.521973] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T17:46:36.647674] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-07T17:46:37.447723] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-07T17:46:37.599446] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T17:46:37.979471] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T17:46:38.168878] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-07T17:46:38.247679] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-07T17:46:39.047712] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-07T17:46:39.787712] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T17:46:39.847615] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-07T17:46:40.456376] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T17:46:40.647733] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-07T17:46:41.095349] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-07T17:46:41.449104] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-07T17:46:41.451711] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T17:46:42.247678] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-07T17:46:42.682751] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T17:46:43.047748] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-07T17:46:43.686798] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T17:46:43.690330] [INFO ] [REMOTE ] BRX: Full fetch complete (74971 records). [2025-10-07T17:46:43.690556] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-07T17:46:43.849169] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-07T17:46:43.918175] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T17:46:44.095238] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-07T17:46:44.095338] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-07T17:46:44.096139] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-07T17:46:44.096206] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-07T17:46:44.097661] [DEBUG] [LOCAL ] BRX: Trimmed 74971 records to 51770 (keeping 200 days of data) [2025-10-07T17:46:44.420909] [DEBUG] [LOCAL ] BRX: Primary data saved (51770 records). [2025-10-07T17:46:44.421045] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-07T17:46:44.422277] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BRX took 36.2s. Estimated remaining: 4h 38m 47s. Rate: 7.3 symbols/min [2025-10-07T17:46:44.589959] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:46:44.609501] [DEBUG] [LOCAL ] BST: Loaded 19005 existing records from primary storage. [2025-10-07T17:46:44.609780] [INFO ] [MAIN ] BST: Loaded 19005 existing records. [2025-10-07T17:46:44.652899] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-07T17:46:44.782738] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:46:44.782965] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-07T17:46:44.783013] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-07T17:46:44.783685] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-07T17:46:44.783746] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-07T17:46:45.125118] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:46:45.380919] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T17:46:45.380603] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T17:46:45.447724] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-07T17:46:46.247618] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-07T17:46:46.728707] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T17:46:47.047700] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-07T17:46:47.819701] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T17:46:47.847739] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-07T17:46:48.188899] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T17:46:48.354080] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-07T17:46:48.647754] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-07T17:46:49.447706] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-07T17:46:50.011547] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T17:46:50.193165] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T17:46:50.247736] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-07T17:46:51.047756] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-07T17:46:51.363531] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T17:46:51.478175] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T17:46:51.847675] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-07T17:46:52.647692] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-07T17:46:53.215558] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T17:46:53.279372] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T17:46:53.447681] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-07T17:46:54.247727] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-07T17:46:54.626300] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T17:46:55.047627] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-07T17:46:55.268179] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T17:46:55.847725] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-07T17:46:55.912906] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T17:46:55.915574] [INFO ] [REMOTE ] BSAC: Full fetch complete (44087 records). [2025-10-07T17:46:55.915727] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-07T17:46:56.277463] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-07T17:46:56.277545] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-07T17:46:56.278062] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-07T17:46:56.278127] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-07T17:46:56.279139] [DEBUG] [LOCAL ] BSAC: Trimmed 44087 records to 32827 (keeping 200 days of data) [2025-10-07T17:46:56.479828] [DEBUG] [LOCAL ] BSAC: Primary data saved (32827 records). [2025-10-07T17:46:56.479988] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-07T17:46:56.480087] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSAC took 34.0s. Estimated remaining: 4h 39m 1s. Rate: 7.3 symbols/min [2025-10-07T17:46:56.655201] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-07T17:46:56.659571] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T17:46:56.658332] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:46:56.688755] [DEBUG] [LOCAL ] BSTZ: Loaded 24876 existing records from primary storage. [2025-10-07T17:46:56.689019] [INFO ] [MAIN ] BSTZ: Loaded 24876 existing records. [2025-10-07T17:46:56.859482] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:46:56.859683] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-07T17:46:56.859743] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-07T17:46:56.860638] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-07T17:46:56.860738] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-07T17:46:57.204959] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:46:57.447757] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-07T17:46:58.088572] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T17:46:58.247724] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-07T17:46:58.682905] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T17:46:59.047723] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-07T17:46:59.519434] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T17:46:59.847730] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-07T17:47:00.129949] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T17:47:00.647619] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-07T17:47:01.056163] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T17:47:01.447690] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-07T17:47:01.994049] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T17:47:02.208876] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T17:47:02.247597] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-07T17:47:03.047755] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-07T17:47:03.472077] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T17:47:03.847743] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-07T17:47:04.247210] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T17:47:04.647758] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-07T17:47:05.374348] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T17:47:05.398367] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T17:47:05.399394] [INFO ] [REMOTE ] BSL: Full fetch complete (12687 records). [2025-10-07T17:47:05.399465] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-07T17:47:05.399879] [FATAL] [VALIDATOR ] BSL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:47:05.399978] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:47:05.400061] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:47:05.400154] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-07T17:47:05.400242] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-07T17:47:05.400281] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-10-07T17:47:05.400323] [DEBUG] [LOCAL ] BSL: No derivative data file found to delete. [2025-10-07T17:47:05.400399] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSL took 39.0s. Estimated remaining: 4h 38m 57s. Rate: 7.3 symbols/min [2025-10-07T17:47:05.452874] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-07T17:47:05.579669] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:47:05.636617] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-07T17:47:05.636956] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-07T17:47:05.816490] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:47:05.816711] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-07T17:47:05.816768] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-07T17:47:05.817856] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-07T17:47:05.817917] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-07T17:47:06.172897] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:47:06.247603] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-07T17:47:06.299548] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T17:47:07.047744] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-07T17:47:07.847632] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-07T17:47:08.126844] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T17:47:08.382492] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T17:47:08.647739] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-07T17:47:08.949296] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T17:47:09.447619] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-07T17:47:09.726017] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T17:47:09.728810] [INFO ] [REMOTE ] BSM: Full fetch complete (47185 records). [2025-10-07T17:47:09.728931] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-07T17:47:10.124448] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-07T17:47:10.124532] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-07T17:47:10.125102] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-07T17:47:10.125169] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-07T17:47:10.126226] [DEBUG] [LOCAL ] BSM: Trimmed 47185 records to 32094 (keeping 200 days of data) [2025-10-07T17:47:10.247910] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-07T17:47:10.327198] [DEBUG] [LOCAL ] BSM: Primary data saved (32094 records). [2025-10-07T17:47:10.327393] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-07T17:47:10.327477] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSM took 39.1s. Estimated remaining: 4h 38m 29s. Rate: 7.3 symbols/min [2025-10-07T17:47:10.520539] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:47:10.520765] [DEBUG] [LOCAL ] BTA: No existing data file found in primary storage. [2025-10-07T17:47:10.520811] [WARN ] [MAIN ] BTA: No existing data found, performing full refresh instead. [2025-10-07T17:47:10.520938] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-07T17:47:10.520980] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-07T17:47:10.521022] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-10-07T17:47:10.521055] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-07T17:47:10.865744] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:47:11.047691] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-07T17:47:11.195351] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T17:47:11.525892] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-07T17:47:11.652358] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-07T17:47:11.847685] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-07T17:47:12.647679] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-07T17:47:13.447634] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-07T17:47:13.497691] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T17:47:13.528795] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T17:47:14.135484] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T17:47:14.247702] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-07T17:47:15.047725] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-07T17:47:15.407175] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T17:47:15.847759] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-07T17:47:16.493521] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-07T17:47:16.647730] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-07T17:47:16.843176] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T17:47:17.447637] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-07T17:47:17.761274] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T17:47:18.247723] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-07T17:47:18.538061] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T17:47:19.047726] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-07T17:47:19.705604] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-07T17:47:19.847613] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-07T17:47:19.956668] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T17:47:20.245790] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-07T17:47:20.647694] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-07T17:47:21.263440] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T17:47:21.447782] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-07T17:47:21.963040] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-07T17:47:22.247749] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-07T17:47:23.047664] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-07T17:47:23.320300] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T17:47:23.490912] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-07T17:47:23.847763] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-07T17:47:24.485257] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T17:47:24.487459] [INFO ] [REMOTE ] BST: Full fetch complete (28790 records). [2025-10-07T17:47:24.487551] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-07T17:47:24.669834] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-07T17:47:24.868735] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-07T17:47:24.868853] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-07T17:47:24.869364] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-07T17:47:24.869434] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-07T17:47:24.870915] [DEBUG] [LOCAL ] BST: Trimmed 28790 records to 19001 (keeping 200 days of data) [2025-10-07T17:47:24.994681] [DEBUG] [LOCAL ] BST: Primary data saved (19001 records). [2025-10-07T17:47:24.994855] [INFO ] [MAIN ] BST: Full history saved. [2025-10-07T17:47:24.994947] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BST took 40.6s. Estimated remaining: 4h 38m 59s. Rate: 7.3 symbols/min [2025-10-07T17:47:25.163703] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:47:25.180557] [DEBUG] [LOCAL ] BTCM: Loaded 15847 existing records from primary storage. [2025-10-07T17:47:25.180811] [INFO ] [MAIN ] BTCM: Loaded 15847 existing records. [2025-10-07T17:47:25.356154] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:47:25.356385] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-07T17:47:25.356432] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-07T17:47:25.356710] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-07T17:47:25.356768] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-07T17:47:25.452872] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-07T17:47:25.722002] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:47:26.247712] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-07T17:47:26.498001] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T17:47:26.505303] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36650 records). [2025-10-07T17:47:26.505508] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-07T17:47:26.506398] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:47:26.506487] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:47:26.506531] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:47:26.506572] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-07T17:47:26.506683] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-07T17:47:26.506747] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-10-07T17:47:26.507263] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-10-07T17:47:26.507411] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSTZ took 30.0s. Estimated remaining: 4h 38m 11s. Rate: 7.3 symbols/min [2025-10-07T17:47:26.700780] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:47:26.721904] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-07T17:47:26.787611] [DEBUG] [LOCAL ] BTE: Loaded 52711 existing records from primary storage. [2025-10-07T17:47:26.788070] [INFO ] [MAIN ] BTE: Loaded 52711 existing records. [2025-10-07T17:47:26.916575] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-07T17:47:27.012916] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:47:27.013182] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-07T17:47:27.013240] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-07T17:47:27.013603] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-07T17:47:27.013708] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-07T17:47:27.052803] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-07T17:47:27.373903] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:47:27.847684] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-07T17:47:28.240809] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T17:47:28.647709] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-07T17:47:29.447746] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-07T17:47:29.691992] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T17:47:29.956107] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T17:47:30.031765] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-07T17:47:30.247720] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-07T17:47:31.038667] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T17:47:31.047586] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-07T17:47:31.619442] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-07T17:47:31.847734] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-07T17:47:32.527323] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-07T17:47:32.647677] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-07T17:47:33.308488] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-07T17:47:33.447638] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-07T17:47:33.868321] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-07T17:47:34.247708] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-07T17:47:34.817939] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T17:47:35.047682] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-07T17:47:35.701861] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T17:47:35.847693] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-07T17:47:36.367931] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T17:47:36.369073] [INFO ] [REMOTE ] BTA: Full fetch complete (9465 records). [2025-10-07T17:47:36.369165] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-07T17:47:36.652797] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-07T17:47:36.721905] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-07T17:47:36.721991] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-07T17:47:36.722241] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-07T17:47:36.722282] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-07T17:47:36.722773] [DEBUG] [LOCAL ] BTA: Trimmed 9465 records to 5458 (keeping 200 days of data) [2025-10-07T17:47:36.758416] [DEBUG] [LOCAL ] BTA: Primary data saved (5458 records). [2025-10-07T17:47:36.758563] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-07T17:47:36.758662] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BTA took 26.4s. Estimated remaining: 4h 38m 14s. Rate: 7.3 symbols/min [2025-10-07T17:47:36.937758] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:47:36.937951] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-10-07T17:47:36.938001] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-10-07T17:47:36.938146] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-07T17:47:36.938195] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-07T17:47:36.938238] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-07T17:47:36.938292] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-07T17:47:37.293910] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:47:37.447680] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-07T17:47:38.198307] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T17:47:38.247632] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-07T17:47:39.047619] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-07T17:47:39.237286] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T17:47:39.692046] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T17:47:39.722385] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T17:47:39.847634] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-07T17:47:40.647746] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-07T17:47:41.447729] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-07T17:47:41.561473] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T17:47:42.247733] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-07T17:47:42.371193] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T17:47:43.047720] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-07T17:47:43.102565] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T17:47:43.847715] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-07T17:47:44.108174] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T17:47:44.647630] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-07T17:47:44.819271] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T17:47:45.447616] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-07T17:47:45.671861] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T17:47:46.247734] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-07T17:47:46.366405] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T17:47:46.851446] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T17:47:47.047721] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-07T17:47:47.787706] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T17:47:47.847710] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-07T17:47:48.647633] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-07T17:47:48.685406] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T17:47:49.447681] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-07T17:47:49.657458] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T17:47:50.247621] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-07T17:47:50.599018] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-07T17:47:50.827207] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T17:47:51.047681] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-07T17:47:51.490235] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T17:47:51.847687] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-07T17:47:52.234365] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T17:47:52.237606] [INFO ] [REMOTE ] BSX: Full fetch complete (77309 records). [2025-10-07T17:47:52.237760] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-07T17:47:52.238828] [FATAL] [VALIDATOR ] BSX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:47:52.238939] [FATAL] [MAIN ] BSX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:47:52.238987] [WARN ] [MAIN ] BSX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:47:52.239085] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-07T17:47:52.239183] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-07T17:47:52.239252] [INFO ] [LOCAL ] BSX: Starting deletion of derivative data. [2025-10-07T17:47:52.239500] [DEBUG] [LOCAL ] BSX: Deleted derivative data file. [2025-10-07T17:47:52.240571] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSX took 46.8s. Estimated remaining: 4h 38m 48s. Rate: 7.3 symbols/min [2025-10-07T17:47:52.410534] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:47:52.421838] [DEBUG] [LOCAL ] BTO: Loaded 8690 existing records from primary storage. [2025-10-07T17:47:52.422071] [INFO ] [MAIN ] BTO: Loaded 8690 existing records. [2025-10-07T17:47:52.602706] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:47:52.603046] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-07T17:47:52.603213] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-07T17:47:52.603504] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-07T17:47:52.603722] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-07T17:47:52.656207] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-07T17:47:52.879428] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T17:47:53.020973] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:47:53.447782] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-07T17:47:54.247702] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-07T17:47:54.865701] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-07T17:47:55.047630] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-07T17:47:55.074133] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-07T17:47:55.459857] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T17:47:55.847700] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-07T17:47:56.647635] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-07T17:47:56.729298] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T17:47:56.887699] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T17:47:57.447682] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-07T17:47:57.865397] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T17:47:57.867152] [INFO ] [REMOTE ] BTCM: Full fetch complete (19449 records). [2025-10-07T17:47:57.867229] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-07T17:47:57.867810] [FATAL] [VALIDATOR ] BTCM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:47:57.867913] [FATAL] [MAIN ] BTCM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:47:57.867977] [WARN ] [MAIN ] BTCM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:47:57.868046] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-07T17:47:57.868110] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-07T17:47:57.868145] [INFO ] [LOCAL ] BTCM: Starting deletion of derivative data. [2025-10-07T17:47:57.868330] [DEBUG] [LOCAL ] BTCM: Deleted derivative data file. [2025-10-07T17:47:57.868434] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 32.9s. Estimated remaining: 4h 38m 25s. Rate: 7.3 symbols/min [2025-10-07T17:47:58.036408] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:47:58.053525] [DEBUG] [LOCAL ] BTT: Loaded 15829 existing records from primary storage. [2025-10-07T17:47:58.053823] [INFO ] [MAIN ] BTT: Loaded 15829 existing records. [2025-10-07T17:47:58.248833] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:47:58.248998] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-07T17:47:58.250793] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-07T17:47:58.250987] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-07T17:47:58.251804] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T17:47:58.251973] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-07T17:47:58.255302] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-07T17:47:58.640348] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:47:59.047756] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-07T17:47:59.748665] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T17:47:59.752637] [INFO ] [REMOTE ] BTE: Full fetch complete (76108 records). [2025-10-07T17:47:59.752795] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-07T17:47:59.853467] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-07T17:48:00.161351] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-07T17:48:00.161504] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-07T17:48:00.162344] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-07T17:48:00.162492] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-07T17:48:00.164289] [DEBUG] [LOCAL ] BTE: Trimmed 76108 records to 52715 (keeping 200 days of data) [2025-10-07T17:48:00.394096] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T17:48:00.512377] [DEBUG] [LOCAL ] BTE: Primary data saved (52715 records). [2025-10-07T17:48:00.512530] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-07T17:48:00.512613] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTE took 34.0s. Estimated remaining: 4h 37m 44s. Rate: 7.3 symbols/min [2025-10-07T17:48:00.649518] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-07T17:48:00.684690] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:48:00.738843] [DEBUG] [LOCAL ] BTU: Loaded 53310 existing records from primary storage. [2025-10-07T17:48:00.739220] [INFO ] [MAIN ] BTU: Loaded 53310 existing records. [2025-10-07T17:48:00.918594] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:48:00.918837] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-07T17:48:00.918919] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-07T17:48:00.919216] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-07T17:48:00.919275] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-07T17:48:01.320857] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:48:01.447679] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-07T17:48:01.675606] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T17:48:01.896150] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-07T17:48:02.247681] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-07T17:48:03.047742] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-07T17:48:03.229438] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T17:48:03.251352] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T17:48:03.847723] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-07T17:48:04.647697] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-07T17:48:04.974987] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T17:48:05.349035] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T17:48:05.382210] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T17:48:05.447627] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-07T17:48:06.155398] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T17:48:06.247676] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-07T17:48:07.047702] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-07T17:48:07.847698] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-07T17:48:07.969631] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T17:48:08.394782] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-07T17:48:08.428388] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T17:48:08.647691] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-07T17:48:09.447689] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-07T17:48:10.247632] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-07T17:48:10.361546] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T17:48:11.026127] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-07T17:48:11.047691] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-07T17:48:11.106951] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T17:48:11.847730] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-07T17:48:11.974999] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T17:48:12.647742] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-07T17:48:13.355000] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-07T17:48:13.447591] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-07T17:48:13.517602] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T17:48:13.521291] [INFO ] [REMOTE ] BTI: Full fetch complete (77461 records). [2025-10-07T17:48:13.521407] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-07T17:48:13.917977] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-07T17:48:13.918111] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-07T17:48:13.918995] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-07T17:48:13.919060] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-07T17:48:13.920552] [DEBUG] [LOCAL ] BTI: Trimmed 77461 records to 53572 (keeping 200 days of data) [2025-10-07T17:48:14.241773] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T17:48:14.247724] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-07T17:48:14.276964] [DEBUG] [LOCAL ] BTI: Primary data saved (53572 records). [2025-10-07T17:48:14.277139] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-07T17:48:14.277222] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTI took 37.5s. Estimated remaining: 4h 38m 8s. Rate: 7.3 symbols/min [2025-10-07T17:48:14.451825] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:48:14.452003] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-07T17:48:14.452039] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-07T17:48:14.452150] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-07T17:48:14.452191] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-07T17:48:14.452232] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-07T17:48:14.452264] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-07T17:48:14.816919] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:48:15.047716] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-07T17:48:15.314875] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T17:48:15.847752] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-07T17:48:16.064019] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:48:16.064508] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-07T17:48:16.064714] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:48:16.064822] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-07T17:48:16.064918] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:48:16.065085] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-07T17:48:16.065173] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-07T17:48:16.065218] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-07T17:48:16.065282] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-07T17:48:16.065427] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 1.8s. Estimated remaining: 4h 37m 22s. Rate: 7.3 symbols/min [2025-10-07T17:48:16.335911] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:48:16.366821] [DEBUG] [LOCAL ] BTZ: Loaded 22737 existing records from primary storage. [2025-10-07T17:48:16.367242] [INFO ] [MAIN ] BTZ: Loaded 22737 existing records. [2025-10-07T17:48:16.650332] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-07T17:48:16.650146] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:48:16.652019] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-07T17:48:16.652096] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-07T17:48:16.652366] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-07T17:48:16.652462] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-07T17:48:17.104774] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:48:17.137114] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-07T17:48:17.447685] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-07T17:48:17.667711] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T17:48:18.247736] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-07T17:48:18.703387] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T17:48:19.047634] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-07T17:48:19.343694] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T17:48:19.847636] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-07T17:48:19.930561] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T17:48:20.647637] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-07T17:48:20.749897] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T17:48:21.447681] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-07T17:48:22.247629] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-07T17:48:22.417451] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T17:48:22.775731] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-07T17:48:23.047609] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-07T17:48:23.135097] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T17:48:23.767137] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T17:48:23.847728] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-07T17:48:24.461163] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T17:48:24.462365] [INFO ] [REMOTE ] BTO: Full fetch complete (13134 records). [2025-10-07T17:48:24.462444] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-07T17:48:24.462961] [FATAL] [VALIDATOR ] BTO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:48:24.463050] [FATAL] [MAIN ] BTO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:48:24.463097] [WARN ] [MAIN ] BTO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:48:24.463140] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-07T17:48:24.463206] [DEBUG] [LOCAL ] BTO: No primary data file found to delete. [2025-10-07T17:48:24.463282] [INFO ] [LOCAL ] BTO: Starting deletion of derivative data. [2025-10-07T17:48:24.463609] [DEBUG] [LOCAL ] BTO: Deleted derivative data file. [2025-10-07T17:48:24.463841] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTO took 32.2s. Estimated remaining: 4h 37m 15s. Rate: 7.3 symbols/min [2025-10-07T17:48:24.652401] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-07T17:48:24.652311] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:48:24.707547] [DEBUG] [LOCAL ] BUD: Loaded 52705 existing records from primary storage. [2025-10-07T17:48:24.707989] [INFO ] [MAIN ] BUD: Loaded 52705 existing records. [2025-10-07T17:48:24.898170] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:48:24.898401] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-07T17:48:24.898552] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-07T17:48:24.898865] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-07T17:48:24.898923] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-07T17:48:25.271426] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:48:25.447633] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-07T17:48:25.470216] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T17:48:25.471749] [INFO ] [REMOTE ] BTT: Full fetch complete (23739 records). [2025-10-07T17:48:25.471823] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-07T17:48:25.837979] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-07T17:48:25.838087] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-07T17:48:25.838514] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-07T17:48:25.838579] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-07T17:48:25.839373] [DEBUG] [LOCAL ] BTT: Trimmed 23739 records to 15845 (keeping 200 days of data) [2025-10-07T17:48:25.936381] [DEBUG] [LOCAL ] BTT: Primary data saved (15845 records). [2025-10-07T17:48:25.936526] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-07T17:48:25.936610] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTT took 28.1s. Estimated remaining: 4h 36m 28s. Rate: 7.3 symbols/min [2025-10-07T17:48:26.104252] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:48:26.104416] [DEBUG] [LOCAL ] BUI: No existing data file found in primary storage. [2025-10-07T17:48:26.104472] [WARN ] [MAIN ] BUI: No existing data found, performing full refresh instead. [2025-10-07T17:48:26.104595] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-07T17:48:26.104638] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-07T17:48:26.104730] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-07T17:48:26.104769] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-07T17:48:26.252795] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-07T17:48:26.457754] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:48:27.047626] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-07T17:48:27.231456] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T17:48:27.809634] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T17:48:27.847672] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-07T17:48:28.392692] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-07T17:48:28.647713] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-07T17:48:28.724063] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T17:48:29.447639] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-07T17:48:30.148401] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T17:48:30.247619] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-07T17:48:30.523982] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T17:48:31.047677] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-07T17:48:31.847689] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-07T17:48:32.308581] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-07T17:48:32.647624] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-07T17:48:32.813632] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T17:48:32.909355] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T17:48:33.447739] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-07T17:48:34.247688] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-07T17:48:34.280989] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-07T17:48:34.497054] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T17:48:35.047682] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-07T17:48:35.721795] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-07T17:48:35.852789] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-07T17:48:35.866396] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T17:48:36.586586] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T17:48:36.647615] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-07T17:48:37.447729] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-07T17:48:38.247660] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-07T17:48:38.266306] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T17:48:38.535167] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T17:48:39.047684] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-07T17:48:39.826288] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T17:48:39.847605] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-07T17:48:40.507535] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T17:48:40.647618] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-07T17:48:40.925431] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T17:48:41.447694] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-07T17:48:42.247677] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-07T17:48:42.280466] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T17:48:43.047703] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-07T17:48:43.084177] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-07T17:48:43.458552] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T17:48:43.847691] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-07T17:48:44.604567] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T17:48:44.639464] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T17:48:44.649449] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-07T17:48:45.393318] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T17:48:45.447728] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-07T17:48:46.247752] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-07T17:48:46.980221] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T17:48:46.998200] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T17:48:47.000469] [INFO ] [REMOTE ] BTZ: Full fetch complete (33756 records). [2025-10-07T17:48:47.000571] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-07T17:48:47.052756] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-07T17:48:47.385763] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-07T17:48:47.385853] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-07T17:48:47.386358] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-07T17:48:47.386417] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-07T17:48:47.387240] [DEBUG] [LOCAL ] BTZ: Trimmed 33756 records to 22735 (keeping 200 days of data) [2025-10-07T17:48:47.529811] [DEBUG] [LOCAL ] BTZ: Primary data saved (22735 records). [2025-10-07T17:48:47.529988] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-07T17:48:47.530096] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTZ took 31.5s. Estimated remaining: 4h 37m 36s. Rate: 7.3 symbols/min [2025-10-07T17:48:47.701832] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:48:47.702066] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-10-07T17:48:47.702120] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-10-07T17:48:47.702234] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-07T17:48:47.702276] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-07T17:48:47.702317] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-10-07T17:48:47.702349] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-07T17:48:47.851665] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-07T17:48:48.056733] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:48:48.647116] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T17:48:48.657211] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-07T17:48:48.812341] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T17:48:49.447700] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-07T17:48:50.247756] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-07T17:48:50.343807] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T17:48:50.435415] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-07T17:48:50.440202] [INFO ] [REMOTE ] BTU: Full fetch complete (77027 records). [2025-10-07T17:48:50.440381] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-07T17:48:50.887237] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-07T17:48:50.887319] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-07T17:48:50.888105] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-07T17:48:50.888170] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-07T17:48:50.889691] [DEBUG] [LOCAL ] BTU: Trimmed 77027 records to 53316 (keeping 200 days of data) [2025-10-07T17:48:51.067021] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-07T17:48:51.214413] [DEBUG] [LOCAL ] BTU: Primary data saved (53316 records). [2025-10-07T17:48:51.214566] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-07T17:48:51.214672] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTU took 50.7s. Estimated remaining: 4h 37m 2s. Rate: 7.3 symbols/min [2025-10-07T17:48:51.379280] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:48:51.421401] [DEBUG] [LOCAL ] BURL: Loaded 45861 existing records from primary storage. [2025-10-07T17:48:51.421767] [INFO ] [MAIN ] BURL: Loaded 45861 existing records. [2025-10-07T17:48:51.603923] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:48:51.604756] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-07T17:48:51.604931] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-07T17:48:51.605188] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-07T17:48:51.605260] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-07T17:48:51.853423] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-07T17:48:51.963979] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T17:48:51.993235] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-07T17:48:52.039510] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:48:52.647708] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-07T17:48:53.292688] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T17:48:53.447639] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-07T17:48:53.527996] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T17:48:54.247701] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-07T17:48:54.809463] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T17:48:55.047688] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-07T17:48:55.732941] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T17:48:55.736569] [INFO ] [REMOTE ] BUD: Full fetch complete (76481 records). [2025-10-07T17:48:55.736716] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-07T17:48:55.852749] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-07T17:48:56.138202] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-07T17:48:56.138334] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-07T17:48:56.139249] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-07T17:48:56.139317] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-07T17:48:56.140950] [DEBUG] [LOCAL ] BUD: Trimmed 76481 records to 52706 (keeping 200 days of data) [2025-10-07T17:48:56.471423] [DEBUG] [LOCAL ] BUD: Primary data saved (52706 records). [2025-10-07T17:48:56.471601] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-07T17:48:56.472840] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BUD took 32.0s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-07T17:48:56.657418] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-07T17:48:56.661707] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:48:56.666951] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T17:48:56.669368] [INFO ] [REMOTE ] BUI: Full fetch complete (16484 records). [2025-10-07T17:48:56.669546] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-07T17:48:56.794385] [DEBUG] [LOCAL ] BUXX: Loaded 15257 existing records from primary storage. [2025-10-07T17:48:56.805007] [INFO ] [MAIN ] BUXX: Loaded 15257 existing records. [2025-10-07T17:48:57.187365] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:48:57.202973] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-07T17:48:57.208175] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-07T17:48:57.243351] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-07T17:48:57.245325] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-07T17:48:57.374166] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-07T17:48:57.374281] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-07T17:48:57.374745] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-07T17:48:57.382858] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-07T17:48:57.402161] [DEBUG] [LOCAL ] BUI: Trimmed 16484 records to 11784 (keeping 200 days of data) [2025-10-07T17:48:57.724444] [DEBUG] [LOCAL ] BUI: Primary data saved (11784 records). [2025-10-07T17:48:57.725322] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-07T17:48:57.741519] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUI took 31.8s. Estimated remaining: 4h 35m 49s. Rate: 7.3 symbols/min [2025-10-07T17:48:57.745216] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:48:57.746443] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-07T17:48:58.026746] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T17:48:58.182954] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-07T17:48:58.247599] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-07T17:48:58.637053] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T17:48:59.047702] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-07T17:48:59.498931] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T17:48:59.514519] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-07T17:48:59.847639] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-07T17:49:00.647671] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-07T17:49:01.392265] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-07T17:49:01.457828] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-07T17:49:01.462846] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T17:49:02.247709] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-07T17:49:02.303494] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T17:49:03.047754] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-07T17:49:03.847732] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-07T17:49:04.033719] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T17:49:04.647632] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-07T17:49:04.835871] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-07T17:49:04.870229] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T17:49:05.447736] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-07T17:49:06.247716] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-07T17:49:06.461000] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T17:49:06.494901] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T17:49:07.047700] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-07T17:49:07.483032] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T17:49:07.648702] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T17:49:07.847744] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-07T17:49:08.647770] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-07T17:49:08.855778] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-07T17:49:09.447681] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-07T17:49:10.251438] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-07T17:49:10.263415] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T17:49:10.281320] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T17:49:11.047674] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-07T17:49:11.847745] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-07T17:49:12.044713] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T17:49:12.638515] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T17:49:12.647677] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-07T17:49:12.659513] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T17:49:13.447742] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-07T17:49:14.256000] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-07T17:49:14.273737] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T17:49:15.047776] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-07T17:49:15.212346] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T17:49:15.214206] [INFO ] [REMOTE ] BUXX: Full fetch complete (20390 records). [2025-10-07T17:49:15.214286] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-07T17:49:15.582561] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-07T17:49:15.582787] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-07T17:49:15.583208] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-07T17:49:15.583316] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-07T17:49:15.584256] [DEBUG] [LOCAL ] BUXX: Trimmed 20390 records to 15298 (keeping 200 days of data) [2025-10-07T17:49:15.682524] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-07T17:49:15.718318] [DEBUG] [LOCAL ] BUXX: Primary data saved (15298 records). [2025-10-07T17:49:15.718437] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-07T17:49:15.718520] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUXX took 19.2s. Estimated remaining: 4h 36m 36s. Rate: 7.3 symbols/min [2025-10-07T17:49:15.847768] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-07T17:49:16.546792] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T17:49:16.647613] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-07T17:49:17.586288] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T17:49:17.596514] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-07T17:49:18.206844] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T17:49:18.247618] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-07T17:49:18.906255] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T17:49:19.047625] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-07T17:49:19.806224] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T17:49:19.847617] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-07T17:49:20.494513] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-07T17:49:20.497097] [INFO ] [REMOTE ] BUR: Full fetch complete (63240 records). [2025-10-07T17:49:20.497213] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-07T17:49:20.498147] [FATAL] [VALIDATOR ] BUR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:49:20.498271] [FATAL] [MAIN ] BUR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:49:20.498333] [WARN ] [MAIN ] BUR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:49:20.498421] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-07T17:49:20.498574] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-10-07T17:49:20.498668] [INFO ] [LOCAL ] BUR: Starting deletion of derivative data. [2025-10-07T17:49:20.498755] [DEBUG] [LOCAL ] BUR: No derivative data file found to delete. [2025-10-07T17:49:20.498840] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUR took 33.0s. Estimated remaining: 4h 36m 8s. Rate: 7.3 symbols/min [2025-10-07T17:49:21.255226] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T17:49:21.258332] [INFO ] [REMOTE ] BURL: Full fetch complete (65693 records). [2025-10-07T17:49:21.258480] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-07T17:49:21.715549] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-07T17:49:21.715637] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-07T17:49:21.716522] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-07T17:49:21.716602] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-07T17:49:21.718219] [DEBUG] [LOCAL ] BURL: Trimmed 65693 records to 45815 (keeping 200 days of data) [2025-10-07T17:49:22.009300] [DEBUG] [LOCAL ] BURL: Primary data saved (45815 records). [2025-10-07T17:49:22.009446] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-07T17:49:22.009548] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 30.8s. Estimated remaining: 4h 35m 22s. Rate: 7.3 symbols/min [2025-10-07T17:49:22.610802] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:49:22.671339] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:49:22.747634] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:49:22.766374] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:49:22.767097] [DEBUG] [LOCAL ] BW: No existing data file found in primary storage. [2025-10-07T17:49:22.767147] [WARN ] [MAIN ] BW: No existing data found, performing full refresh instead. [2025-10-07T17:49:22.767242] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-07T17:49:22.767281] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-07T17:49:22.767324] [DEBUG] [LOCAL ] BW: No primary data file found to delete. [2025-10-07T17:49:22.767393] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-07T17:49:23.074078] [DEBUG] [LOCAL ] BV: Loaded 38381 existing records from primary storage. [2025-10-07T17:49:23.106481] [INFO ] [MAIN ] BV: Loaded 38381 existing records. [2025-10-07T17:49:23.133219] [DEBUG] [LOCAL ] BVN: Loaded 43948 existing records from primary storage. [2025-10-07T17:49:23.139912] [DEBUG] [LOCAL ] BWA: Loaded 52170 existing records from primary storage. [2025-10-07T17:49:23.174888] [INFO ] [MAIN ] BVN: Loaded 43948 existing records. [2025-10-07T17:49:23.186797] [INFO ] [MAIN ] BWA: Loaded 52170 existing records. [2025-10-07T17:49:23.526817] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:49:23.589590] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-07T17:49:23.756066] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:49:23.824749] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:49:23.834712] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-07T17:49:23.834805] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-07T17:49:23.834370] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-07T17:49:23.850432] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-07T17:49:23.850267] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:49:23.851490] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-07T17:49:23.851588] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-07T17:49:23.851130] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-07T17:49:23.851718] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-07T17:49:23.852209] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-07T17:49:23.871105] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-07T17:49:23.857408] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-07T17:49:23.900970] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-07T17:49:25.342918] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:49:25.326925] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:49:25.372621] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-07T17:49:25.377501] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:49:25.378170] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-07T17:49:25.380410] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-07T17:49:25.424380] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T17:49:25.439047] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-07T17:49:26.771723] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T17:49:26.778817] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-07T17:49:26.876300] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T17:49:26.885691] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-07T17:49:26.971609] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T17:49:26.980488] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-07T17:49:27.258810] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T17:49:27.269215] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-07T17:49:27.718245] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T17:49:27.847787] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-07T17:49:27.930789] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T17:49:27.953235] [DEBUG] [REMOTE ] BV: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-07T17:49:27.953760] [WARN ] [REMOTE ] BV: No data returned for month 2025-02 [2025-10-07T17:49:27.953868] [FATAL] [REMOTE ] BV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:49:27.953977] [FATAL] [MAIN ] BV: Failed to fetch primary data. [2025-10-07T17:49:27.954046] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:49:27.954132] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-07T17:49:27.954214] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-07T17:49:27.954261] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-10-07T17:49:27.954844] [DEBUG] [LOCAL ] BV: Deleted derivative data file. [2025-10-07T17:49:27.955140] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 5.9s. Estimated remaining: 4h 35m 1s. Rate: 7.3 symbols/min [2025-10-07T17:49:28.187807] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:49:28.205156] [DEBUG] [LOCAL ] BWG: Loaded 12605 existing records from primary storage. [2025-10-07T17:49:28.205553] [INFO ] [MAIN ] BWG: Loaded 12605 existing records. [2025-10-07T17:49:28.436189] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:49:28.457094] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-07T17:49:28.457817] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-07T17:49:28.458543] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T17:49:28.465998] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-07T17:49:28.466735] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-07T17:49:28.649493] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-07T17:49:28.823474] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:49:29.043179] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T17:49:29.447701] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-07T17:49:30.237485] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T17:49:30.247595] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-07T17:49:30.301558] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T17:49:31.047694] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-07T17:49:31.847640] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-07T17:49:31.897132] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T17:49:32.601873] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T17:49:32.647622] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-07T17:49:33.308051] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T17:49:33.447612] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-07T17:49:33.963237] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T17:49:34.247671] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-07T17:49:35.010599] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T17:49:35.047681] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-07T17:49:35.193266] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T17:49:35.783716] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-07T17:49:35.847628] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-07T17:49:36.579550] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T17:49:36.647742] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-07T17:49:37.447686] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-07T17:49:38.247731] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-07T17:49:38.432140] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T17:49:38.438094] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T17:49:39.047674] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-07T17:49:39.642898] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T17:49:39.847739] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-07T17:49:40.260189] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T17:49:40.502031] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T17:49:40.647757] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-07T17:49:41.447735] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-07T17:49:42.079960] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T17:49:42.213457] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T17:49:42.247677] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-07T17:49:43.047775] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-07T17:49:43.366224] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T17:49:43.699983] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-07T17:49:43.847697] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-07T17:49:44.647683] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-07T17:49:45.442523] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T17:49:45.452766] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-07T17:49:46.145727] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T17:49:46.193376] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T17:49:46.247618] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-07T17:49:47.047734] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-07T17:49:47.790954] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:49:47.847629] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-07T17:49:48.276335] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T17:49:48.647707] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-07T17:49:49.386330] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T17:49:49.447617] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-07T17:49:49.741678] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T17:49:49.979387] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T17:49:49.980607] [INFO ] [REMOTE ] BWG: Full fetch complete (17890 records). [2025-10-07T17:49:49.980732] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-07T17:49:50.250518] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-07T17:49:50.335077] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-07T17:49:50.335175] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-07T17:49:50.335505] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-07T17:49:50.335547] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-07T17:49:50.336110] [DEBUG] [LOCAL ] BWG: Trimmed 17890 records to 12612 (keeping 200 days of data) [2025-10-07T17:49:50.413674] [DEBUG] [LOCAL ] BWG: Primary data saved (12612 records). [2025-10-07T17:49:50.413828] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-07T17:49:50.413916] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BWG took 22.5s. Estimated remaining: 4h 36m 12s. Rate: 7.3 symbols/min [2025-10-07T17:49:50.576281] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:49:50.614520] [DEBUG] [LOCAL ] BWLP: Loaded 32271 existing records from primary storage. [2025-10-07T17:49:50.614843] [INFO ] [MAIN ] BWLP: Loaded 32271 existing records. [2025-10-07T17:49:50.786239] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:49:50.786445] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-07T17:49:50.786491] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-07T17:49:50.786784] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-07T17:49:50.786841] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-07T17:49:51.053749] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-07T17:49:51.138092] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:49:51.713273] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T17:49:51.847606] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-07T17:49:52.603395] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T17:49:52.647609] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-07T17:49:52.877406] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T17:49:53.447672] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-07T17:49:54.247626] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-07T17:49:54.435983] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T17:49:54.913385] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T17:49:55.047619] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-07T17:49:55.843147] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T17:49:55.851832] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-07T17:49:56.560938] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T17:49:56.647616] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-07T17:49:57.330073] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T17:49:57.333722] [INFO ] [REMOTE ] BWA: Full fetch complete (75718 records). [2025-10-07T17:49:57.333858] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-07T17:49:57.452846] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-07T17:49:57.723827] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-07T17:49:57.723923] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-07T17:49:57.724708] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-07T17:49:57.724772] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-07T17:49:57.726861] [DEBUG] [LOCAL ] BWA: Trimmed 75718 records to 52171 (keeping 200 days of data) [2025-10-07T17:49:58.044858] [DEBUG] [LOCAL ] BWA: Primary data saved (52171 records). [2025-10-07T17:49:58.044999] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-07T17:49:58.045768] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BWA took 36.0s. Estimated remaining: 4h 36m 1s. Rate: 7.3 symbols/min [2025-10-07T17:49:58.209768] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:49:58.218922] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T17:49:58.222926] [INFO ] [REMOTE ] BW: Full fetch complete (58869 records). [2025-10-07T17:49:58.223063] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-07T17:49:58.259768] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-07T17:49:58.338605] [DEBUG] [LOCAL ] BWMX: Loaded 7693 existing records from primary storage. [2025-10-07T17:49:58.351078] [INFO ] [MAIN ] BWMX: Loaded 7693 existing records. [2025-10-07T17:49:58.706616] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:49:58.742832] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-07T17:49:58.758304] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-07T17:49:58.779062] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-07T17:49:58.779466] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-07T17:49:58.988759] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-07T17:49:59.027624] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-07T17:49:59.028547] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-07T17:49:59.039312] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-07T17:49:59.156973] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T17:49:59.201491] [DEBUG] [LOCAL ] BW: Trimmed 58869 records to 40087 (keeping 200 days of data) [2025-10-07T17:49:59.202225] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-07T17:49:59.373318] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:49:59.511445] [DEBUG] [LOCAL ] BW: Primary data saved (40087 records). [2025-10-07T17:49:59.511571] [INFO ] [MAIN ] BW: Full history saved. [2025-10-07T17:49:59.511662] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BW took 37.5s. Estimated remaining: 4h 35m 15s. Rate: 7.3 symbols/min [2025-10-07T17:49:59.677932] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:49:59.685172] [DEBUG] [LOCAL ] BWNB: Loaded 4392 existing records from primary storage. [2025-10-07T17:49:59.685375] [INFO ] [MAIN ] BWNB: Loaded 4392 existing records. [2025-10-07T17:49:59.851940] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-07T17:49:59.865950] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:49:59.866137] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-07T17:49:59.866183] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-07T17:49:59.866370] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-07T17:49:59.866427] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-07T17:50:00.281294] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:50:00.285001] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T17:50:00.548964] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T17:50:00.647971] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-07T17:50:00.651611] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T17:50:01.265059] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-07T17:50:01.447679] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-07T17:50:02.247702] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-07T17:50:02.899783] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T17:50:03.047718] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-07T17:50:03.156410] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T17:50:03.530249] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T17:50:03.847670] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-07T17:50:04.647689] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-07T17:50:05.226041] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T17:50:05.298326] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-07T17:50:05.302994] [INFO ] [REMOTE ] BVN: Full fetch complete (62852 records). [2025-10-07T17:50:05.303092] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-07T17:50:05.448822] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-07T17:50:05.688376] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-07T17:50:05.688457] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-07T17:50:05.689135] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-07T17:50:05.689200] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-07T17:50:05.690521] [DEBUG] [LOCAL ] BVN: Trimmed 62852 records to 44028 (keeping 200 days of data) [2025-10-07T17:50:05.965879] [DEBUG] [LOCAL ] BVN: Primary data saved (44028 records). [2025-10-07T17:50:05.966028] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-07T17:50:05.966142] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BVN took 44.0s. Estimated remaining: 4h 34m 57s. Rate: 7.3 symbols/min [2025-10-07T17:50:06.077117] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-07T17:50:06.141204] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:50:06.151046] [DEBUG] [LOCAL ] BWSN: Loaded 5204 existing records from primary storage. [2025-10-07T17:50:06.151236] [INFO ] [MAIN ] BWSN: Loaded 5204 existing records. [2025-10-07T17:50:06.252841] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-07T17:50:06.332989] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:50:06.333240] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-07T17:50:06.333288] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-07T17:50:06.333463] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-07T17:50:06.333518] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-07T17:50:06.682441] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:50:06.928497] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T17:50:07.047709] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-07T17:50:07.512546] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T17:50:07.847716] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-07T17:50:08.647706] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-07T17:50:08.719816] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T17:50:09.447674] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-07T17:50:09.924807] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T17:50:10.187095] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T17:50:10.247669] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-07T17:50:10.639879] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-07T17:50:11.047710] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-07T17:50:11.847750] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-07T17:50:12.610231] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T17:50:12.652748] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-07T17:50:12.669122] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T17:50:13.447619] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-07T17:50:13.642265] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T17:50:14.194710] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T17:50:14.247631] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-07T17:50:15.047718] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-07T17:50:15.695714] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T17:50:15.847708] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-07T17:50:15.882160] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T17:50:16.451675] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T17:50:16.647684] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-07T17:50:17.447751] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-07T17:50:17.893843] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T17:50:18.115482] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T17:50:18.247715] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-07T17:50:18.857686] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-07T17:50:19.047691] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-07T17:50:19.847719] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-07T17:50:20.130152] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T17:50:20.291699] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-07T17:50:20.647730] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-07T17:50:21.421371] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T17:50:21.447667] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-07T17:50:22.057348] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T17:50:22.247738] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-07T17:50:22.774502] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T17:50:23.047710] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-07T17:50:23.639551] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T17:50:23.847684] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-07T17:50:24.519447] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-07T17:50:24.647711] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-07T17:50:25.212991] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T17:50:25.447663] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-07T17:50:26.246314] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-07T17:50:26.247278] [INFO ] [REMOTE ] BWMX: Full fetch complete (10069 records). [2025-10-07T17:50:26.247348] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-07T17:50:26.252955] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-07T17:50:26.620046] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-07T17:50:26.620226] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-07T17:50:26.620501] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-07T17:50:26.620555] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-07T17:50:26.621379] [DEBUG] [LOCAL ] BWMX: Trimmed 10069 records to 7672 (keeping 200 days of data) [2025-10-07T17:50:26.671980] [DEBUG] [LOCAL ] BWMX: Primary data saved (7672 records). [2025-10-07T17:50:26.672143] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-07T17:50:26.672258] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWMX took 28.6s. Estimated remaining: 4h 35m 57s. Rate: 7.3 symbols/min [2025-10-07T17:50:26.840364] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:50:26.889478] [DEBUG] [LOCAL ] BWXT: Loaded 46898 existing records from primary storage. [2025-10-07T17:50:26.889817] [INFO ] [MAIN ] BWXT: Loaded 46898 existing records. [2025-10-07T17:50:27.060964] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-07T17:50:27.067562] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:50:27.068722] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-07T17:50:27.068813] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-07T17:50:27.069210] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-07T17:50:27.069267] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-07T17:50:27.437079] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:50:27.612490] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T17:50:27.821080] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T17:50:27.847600] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-07T17:50:28.527744] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T17:50:28.647684] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-07T17:50:29.032844] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T17:50:29.033801] [INFO ] [REMOTE ] BWNB: Full fetch complete (5723 records). [2025-10-07T17:50:29.033897] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-07T17:50:29.416129] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-07T17:50:29.416222] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-07T17:50:29.416387] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-07T17:50:29.416428] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-07T17:50:29.416826] [DEBUG] [LOCAL ] BWNB: Trimmed 5723 records to 4363 (keeping 200 days of data) [2025-10-07T17:50:29.446460] [DEBUG] [LOCAL ] BWNB: Primary data saved (4363 records). [2025-10-07T17:50:29.446543] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-07T17:50:29.446617] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWNB took 29.9s. Estimated remaining: 4h 35m 19s. Rate: 7.3 symbols/min [2025-10-07T17:50:29.457749] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-07T17:50:29.617108] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:50:29.672213] [DEBUG] [LOCAL ] BX: Loaded 53479 existing records from primary storage. [2025-10-07T17:50:29.672529] [INFO ] [MAIN ] BX: Loaded 53479 existing records. [2025-10-07T17:50:29.850263] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:50:29.850498] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-07T17:50:29.850548] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-07T17:50:29.850796] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-07T17:50:29.850853] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-07T17:50:30.083153] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T17:50:30.220572] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:50:30.247613] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-07T17:50:31.047745] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-07T17:50:31.847727] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-07T17:50:32.198004] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T17:50:32.200502] [INFO ] [REMOTE ] BWLP: Full fetch complete (48035 records). [2025-10-07T17:50:32.200593] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-07T17:50:32.614548] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-07T17:50:32.614745] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-07T17:50:32.615431] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-07T17:50:32.615509] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-07T17:50:32.646364] [DEBUG] [LOCAL ] BWLP: Trimmed 48035 records to 32303 (keeping 200 days of data) [2025-10-07T17:50:32.648861] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-07T17:50:32.649236] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-07T17:50:32.888386] [DEBUG] [LOCAL ] BWLP: Primary data saved (32303 records). [2025-10-07T17:50:32.888555] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-07T17:50:32.888667] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 42.5s. Estimated remaining: 4h 34m 44s. Rate: 7.3 symbols/min [2025-10-07T17:50:33.074292] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:50:33.089699] [DEBUG] [LOCAL ] BXC: Loaded 13641 existing records from primary storage. [2025-10-07T17:50:33.089925] [INFO ] [MAIN ] BXC: Loaded 13641 existing records. [2025-10-07T17:50:33.270492] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:50:33.270802] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-07T17:50:33.270861] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-07T17:50:33.271049] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-07T17:50:33.271106] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-07T17:50:33.454337] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-07T17:50:33.525997] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T17:50:33.645360] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:50:33.670967] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T17:50:34.247756] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-07T17:50:35.047756] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-07T17:50:35.479145] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-07T17:50:35.524880] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T17:50:35.559237] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-07T17:50:35.847677] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-07T17:50:36.468453] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-07T17:50:36.647674] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-07T17:50:37.447672] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-07T17:50:38.213046] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T17:50:38.214087] [INFO ] [REMOTE ] BWSN: Full fetch complete (6277 records). [2025-10-07T17:50:38.214161] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-07T17:50:38.252744] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-07T17:50:38.440708] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-07T17:50:38.681818] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-07T17:50:38.681931] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-07T17:50:38.682161] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-07T17:50:38.682245] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-07T17:50:38.682848] [DEBUG] [LOCAL ] BWSN: Trimmed 6277 records to 5170 (keeping 200 days of data) [2025-10-07T17:50:38.723704] [DEBUG] [LOCAL ] BWSN: Primary data saved (5170 records). [2025-10-07T17:50:38.723885] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-07T17:50:38.724014] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 32.8s. Estimated remaining: 4h 34m 23s. Rate: 7.3 symbols/min [2025-10-07T17:50:38.898002] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:50:38.949369] [DEBUG] [LOCAL ] BXMT: Loaded 47183 existing records from primary storage. [2025-10-07T17:50:38.949793] [INFO ] [MAIN ] BXMT: Loaded 47183 existing records. [2025-10-07T17:50:39.049132] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-07T17:50:39.142757] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:50:39.143136] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-07T17:50:39.150707] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-07T17:50:39.151948] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-07T17:50:39.151868] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T17:50:39.152078] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-07T17:50:39.512828] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:50:39.847688] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-07T17:50:40.560381] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-07T17:50:40.596387] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T17:50:40.647698] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-07T17:50:41.447620] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-07T17:50:41.532785] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T17:50:42.247788] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-07T17:50:43.047704] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-07T17:50:43.149107] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T17:50:43.847777] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-07T17:50:43.887617] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T17:50:44.647736] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-07T17:50:44.811617] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T17:50:45.128473] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T17:50:45.403386] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T17:50:45.447675] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-07T17:50:46.247729] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-07T17:50:46.373901] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T17:50:47.047797] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-07T17:50:47.847773] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-07T17:50:47.977779] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T17:50:48.384601] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-07T17:50:48.647698] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-07T17:50:49.077805] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T17:50:49.146808] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-07T17:50:49.447638] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-07T17:50:50.226974] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T17:50:50.247588] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-07T17:50:50.842024] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T17:50:50.843334] [INFO ] [REMOTE ] BXC: Full fetch complete (18103 records). [2025-10-07T17:50:50.843407] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-07T17:50:51.052857] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-07T17:50:51.204306] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-07T17:50:51.204387] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-07T17:50:51.204726] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-07T17:50:51.204789] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-07T17:50:51.205350] [DEBUG] [LOCAL ] BXC: Trimmed 18103 records to 13701 (keeping 200 days of data) [2025-10-07T17:50:51.286938] [DEBUG] [LOCAL ] BXC: Primary data saved (13701 records). [2025-10-07T17:50:51.287087] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-07T17:50:51.287171] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BXC took 18.4s. Estimated remaining: 4h 34m 39s. Rate: 7.3 symbols/min [2025-10-07T17:50:51.462849] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:50:51.484531] [DEBUG] [LOCAL ] BXMX: Loaded 19522 existing records from primary storage. [2025-10-07T17:50:51.484846] [INFO ] [MAIN ] BXMX: Loaded 19522 existing records. [2025-10-07T17:50:51.658378] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:50:51.658603] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-07T17:50:51.658674] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-07T17:50:51.658898] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-07T17:50:51.658956] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-07T17:50:51.853102] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-07T17:50:52.008876] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:50:52.647677] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-07T17:50:53.041223] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T17:50:53.447708] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-07T17:50:53.748154] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T17:50:53.984405] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-07T17:50:54.247932] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-07T17:50:54.937516] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T17:50:55.047746] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-07T17:50:55.847688] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-07T17:50:56.199224] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T17:50:56.647743] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-07T17:50:57.029814] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T17:50:57.110187] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T17:50:57.447669] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-07T17:50:58.247697] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-07T17:50:58.333690] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T17:50:59.054982] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-07T17:50:59.072793] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T17:50:59.847629] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-07T17:51:00.136968] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T17:51:00.647620] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-07T17:51:00.913343] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T17:51:01.107157] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-07T17:51:01.447673] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-07T17:51:02.247719] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-07T17:51:02.377456] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-07T17:51:02.447365] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T17:51:02.451811] [INFO ] [REMOTE ] BWXT: Full fetch complete (67266 records). [2025-10-07T17:51:02.452001] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-07T17:51:02.453305] [FATAL] [VALIDATOR ] BWXT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T17:51:02.453432] [FATAL] [MAIN ] BWXT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:51:02.453484] [WARN ] [MAIN ] BWXT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:51:02.453564] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-07T17:51:02.453682] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-10-07T17:51:02.453761] [INFO ] [LOCAL ] BWXT: Starting deletion of derivative data. [2025-10-07T17:51:02.454059] [DEBUG] [LOCAL ] BWXT: Deleted derivative data file. [2025-10-07T17:51:02.454177] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 35.8s. Estimated remaining: 4h 34m 46s. Rate: 7.3 symbols/min [2025-10-07T17:51:02.640636] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:51:02.640846] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-10-07T17:51:02.640886] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-10-07T17:51:02.641003] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-07T17:51:02.641045] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-07T17:51:02.641087] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-07T17:51:02.641119] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-07T17:51:03.007622] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:51:03.047704] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-07T17:51:03.825509] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T17:51:03.847605] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-07T17:51:04.647725] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-07T17:51:04.811897] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T17:51:05.054003] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T17:51:05.447709] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-07T17:51:05.484918] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-07T17:51:06.247686] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-07T17:51:07.047636] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-07T17:51:07.374481] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T17:51:07.857814] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-07T17:51:07.863949] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T17:51:08.112804] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T17:51:08.647693] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-07T17:51:09.447734] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-07T17:51:09.637536] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T17:51:10.262583] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-07T17:51:10.273313] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T17:51:10.884129] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T17:51:11.029910] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T17:51:11.047595] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-07T17:51:11.847727] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-07T17:51:12.647685] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-07T17:51:12.685776] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T17:51:13.433421] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T17:51:13.447585] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-07T17:51:14.149507] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T17:51:14.153153] [INFO ] [REMOTE ] BX: Full fetch complete (77402 records). [2025-10-07T17:51:14.153324] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-07T17:51:14.253915] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-07T17:51:14.544583] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-07T17:51:14.544714] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-07T17:51:14.545508] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-07T17:51:14.545553] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-07T17:51:14.547108] [DEBUG] [LOCAL ] BX: Trimmed 77402 records to 53479 (keeping 200 days of data) [2025-10-07T17:51:14.908959] [DEBUG] [LOCAL ] BX: Primary data saved (53479 records). [2025-10-07T17:51:14.909123] [INFO ] [MAIN ] BX: Full history saved. [2025-10-07T17:51:14.910197] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BX took 45.5s. Estimated remaining: 4h 35m 0s. Rate: 7.3 symbols/min [2025-10-07T17:51:15.060695] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-07T17:51:15.095329] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:51:15.129136] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T17:51:15.177510] [DEBUG] [LOCAL ] BXSL: Loaded 47707 existing records from primary storage. [2025-10-07T17:51:15.177889] [INFO ] [MAIN ] BXSL: Loaded 47707 existing records. [2025-10-07T17:51:15.349873] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T17:51:15.369735] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:51:15.374969] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-07T17:51:15.375175] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-07T17:51:15.375839] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-07T17:51:15.375900] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-07T17:51:15.721717] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:51:15.847695] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-07T17:51:16.647678] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-07T17:51:16.923603] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T17:51:16.927495] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T17:51:17.447712] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-07T17:51:18.247739] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-07T17:51:18.451801] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T17:51:19.047633] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-07T17:51:19.095810] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T17:51:19.189528] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T17:51:19.847719] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-07T17:51:20.647766] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-07T17:51:20.856940] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T17:51:21.275780] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T17:51:21.447670] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-07T17:51:22.247727] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-07T17:51:22.291567] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T17:51:22.496287] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T17:51:23.047717] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-07T17:51:23.847614] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-07T17:51:23.950531] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T17:51:24.647625] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-07T17:51:24.892955] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T17:51:25.447638] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-07T17:51:25.595047] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T17:51:26.195431] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T17:51:26.198055] [INFO ] [REMOTE ] BXMX: Full fetch complete (28897 records). [2025-10-07T17:51:26.198271] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-07T17:51:26.253687] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-07T17:51:26.352109] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T17:51:26.636793] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-07T17:51:26.636878] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-07T17:51:26.637279] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-07T17:51:26.637339] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-07T17:51:26.638227] [DEBUG] [LOCAL ] BXMX: Trimmed 28897 records to 19513 (keeping 200 days of data) [2025-10-07T17:51:26.762744] [DEBUG] [LOCAL ] BXMX: Primary data saved (19513 records). [2025-10-07T17:51:26.762904] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-07T17:51:26.762988] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXMX took 35.5s. Estimated remaining: 4h 35m 12s. Rate: 7.3 symbols/min [2025-10-07T17:51:26.930982] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:51:26.952185] [DEBUG] [LOCAL ] BY: Loaded 21672 existing records from primary storage. [2025-10-07T17:51:26.952475] [INFO ] [MAIN ] BY: Loaded 21672 existing records. [2025-10-07T17:51:27.052342] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-07T17:51:27.136053] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:51:27.136323] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-07T17:51:27.136375] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-07T17:51:27.136671] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-07T17:51:27.136730] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-07T17:51:27.488379] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:51:27.847697] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-07T17:51:28.036195] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T17:51:28.585753] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T17:51:28.589302] [INFO ] [REMOTE ] BXMT: Full fetch complete (69676 records). [2025-10-07T17:51:28.589472] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-07T17:51:28.652856] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-07T17:51:28.969173] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T17:51:29.000831] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-07T17:51:29.000919] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-07T17:51:29.001683] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-07T17:51:29.001752] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-07T17:51:29.003169] [DEBUG] [LOCAL ] BXMT: Trimmed 69676 records to 47180 (keeping 200 days of data) [2025-10-07T17:51:29.298069] [DEBUG] [LOCAL ] BXMT: Primary data saved (47180 records). [2025-10-07T17:51:29.298225] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-07T17:51:29.299269] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMT took 50.6s. Estimated remaining: 4h 34m 33s. Rate: 7.3 symbols/min [2025-10-07T17:51:29.461754] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-07T17:51:29.464402] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:51:29.507518] [DEBUG] [LOCAL ] BYD: Loaded 44852 existing records from primary storage. [2025-10-07T17:51:29.507840] [INFO ] [MAIN ] BYD: Loaded 44852 existing records. [2025-10-07T17:51:29.681512] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:51:29.681794] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-07T17:51:29.681845] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-07T17:51:29.682131] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-07T17:51:29.682188] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-07T17:51:30.039203] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:51:30.247691] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-07T17:51:30.463582] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T17:51:30.464706] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T17:51:31.047761] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-07T17:51:31.850244] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-07T17:51:31.852060] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T17:51:31.917024] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T17:51:32.647702] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-07T17:51:33.277849] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T17:51:33.447688] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-07T17:51:34.247729] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-07T17:51:34.371120] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T17:51:34.996452] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T17:51:35.047612] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-07T17:51:35.109812] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T17:51:35.847714] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-07T17:51:36.545610] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T17:51:36.647771] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-07T17:51:37.316287] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T17:51:37.447604] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-07T17:51:38.247697] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-07T17:51:38.499864] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T17:51:38.764081] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T17:51:38.767352] [INFO ] [REMOTE ] BXP: Full fetch complete (71728 records). [2025-10-07T17:51:38.767487] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-07T17:51:39.054555] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-07T17:51:39.192224] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-07T17:51:39.192418] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-07T17:51:39.193276] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-07T17:51:39.193362] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-07T17:51:39.194881] [DEBUG] [LOCAL ] BXP: Trimmed 71728 records to 49822 (keeping 200 days of data) [2025-10-07T17:51:39.303160] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T17:51:39.518474] [DEBUG] [LOCAL ] BXP: Primary data saved (49822 records). [2025-10-07T17:51:39.518616] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-07T17:51:39.518726] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXP took 37.1s. Estimated remaining: 4h 34m 35s. Rate: 7.3 symbols/min [2025-10-07T17:51:39.682441] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:51:39.682602] [DEBUG] [LOCAL ] BYM: No existing data file found in primary storage. [2025-10-07T17:51:39.682639] [WARN ] [MAIN ] BYM: No existing data found, performing full refresh instead. [2025-10-07T17:51:39.682780] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-07T17:51:39.682840] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-07T17:51:39.682882] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-07T17:51:39.682914] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-07T17:51:39.853593] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-07T17:51:40.035287] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:51:40.647633] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-07T17:51:40.753371] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T17:51:40.856517] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T17:51:41.447674] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-07T17:51:42.247615] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-07T17:51:42.431297] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T17:51:43.047635] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-07T17:51:43.163011] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T17:51:43.552711] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-07T17:51:43.847726] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-07T17:51:43.890667] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-07T17:51:44.647688] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-07T17:51:44.986055] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T17:51:45.447688] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-07T17:51:46.207966] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T17:51:46.247620] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-07T17:51:47.047713] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-07T17:51:47.611865] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-07T17:51:47.847625] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-07T17:51:48.020609] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T17:51:48.159736] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T17:51:48.647698] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-07T17:51:49.019563] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T17:51:49.447617] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-07T17:51:49.684880] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T17:51:50.247685] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-07T17:51:51.038172] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T17:51:51.047593] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-07T17:51:51.139826] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-07T17:51:51.143313] [INFO ] [REMOTE ] BXSL: Full fetch complete (69520 records). [2025-10-07T17:51:51.143435] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-07T17:51:51.541011] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-07T17:51:51.541131] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-07T17:51:51.541913] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-07T17:51:51.541992] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-07T17:51:51.543371] [DEBUG] [LOCAL ] BXSL: Trimmed 69520 records to 47768 (keeping 200 days of data) [2025-10-07T17:51:51.646760] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T17:51:51.847885] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-07T17:51:51.851394] [DEBUG] [LOCAL ] BXSL: Primary data saved (47768 records). [2025-10-07T17:51:51.851540] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-07T17:51:51.852287] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXSL took 36.9s. Estimated remaining: 4h 34m 48s. Rate: 7.3 symbols/min [2025-10-07T17:51:52.019755] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:51:52.054906] [DEBUG] [LOCAL ] BZH: Loaded 32355 existing records from primary storage. [2025-10-07T17:51:52.055213] [INFO ] [MAIN ] BZH: Loaded 32355 existing records. [2025-10-07T17:51:52.227737] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:51:52.227978] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-07T17:51:52.228025] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-07T17:51:52.228291] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-07T17:51:52.228347] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-07T17:51:52.580809] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:51:52.591677] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T17:51:52.647602] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-07T17:51:53.447712] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-07T17:51:53.675845] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T17:51:54.247702] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-07T17:51:54.497342] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T17:51:55.047605] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-07T17:51:55.510633] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T17:51:55.847720] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-07T17:51:56.525884] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T17:51:56.647604] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-07T17:51:56.918300] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T17:51:57.447760] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-07T17:51:57.899947] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T17:51:57.902997] [INFO ] [REMOTE ] BYD: Full fetch complete (65120 records). [2025-10-07T17:51:57.903098] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-07T17:51:58.250732] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-07T17:51:58.333982] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-07T17:51:58.334284] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-07T17:51:58.335079] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-07T17:51:58.335218] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-07T17:51:58.346705] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T17:51:58.350619] [DEBUG] [LOCAL ] BYD: Trimmed 65120 records to 44885 (keeping 200 days of data) [2025-10-07T17:51:58.640424] [DEBUG] [LOCAL ] BYD: Primary data saved (44885 records). [2025-10-07T17:51:58.640570] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-07T17:51:58.641239] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BYD took 29.3s. Estimated remaining: 4h 34m 32s. Rate: 7.3 symbols/min [2025-10-07T17:51:58.813592] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:51:58.872967] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-07T17:51:58.873306] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-07T17:51:59.048729] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-07T17:51:59.052984] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:51:59.054029] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-07T17:51:59.054081] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-07T17:51:59.054438] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-07T17:51:59.054495] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-07T17:51:59.411536] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:51:59.494263] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T17:51:59.847676] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-07T17:52:00.453085] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T17:52:00.647615] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-07T17:52:01.447690] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-07T17:52:01.752299] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T17:52:01.755734] [INFO ] [REMOTE ] BY: Full fetch complete (29651 records). [2025-10-07T17:52:01.755920] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-07T17:52:01.993923] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-07T17:52:02.252968] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-07T17:52:02.433058] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-07T17:52:02.433188] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-07T17:52:02.434061] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-07T17:52:02.434154] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-07T17:52:02.436157] [DEBUG] [LOCAL ] BY: Trimmed 29651 records to 21734 (keeping 200 days of data) [2025-10-07T17:52:02.646022] [DEBUG] [LOCAL ] BY: Primary data saved (21734 records). [2025-10-07T17:52:02.646405] [INFO ] [MAIN ] BY: Full history saved. [2025-10-07T17:52:02.646557] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BY took 35.9s. Estimated remaining: 4h 34m 2s. Rate: 7.3 symbols/min [2025-10-07T17:52:02.879940] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:52:02.901742] [DEBUG] [LOCAL ] CAAP: Loaded 19865 existing records from primary storage. [2025-10-07T17:52:02.902058] [INFO ] [MAIN ] CAAP: Loaded 19865 existing records. [2025-10-07T17:52:03.050400] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-07T17:52:03.080770] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:52:03.081409] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-07T17:52:03.082355] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-07T17:52:03.082551] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-07T17:52:03.082608] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-07T17:52:03.250691] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T17:52:03.482191] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:52:03.847712] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-07T17:52:03.930559] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-07T17:52:04.434975] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-07T17:52:04.647738] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-07T17:52:05.317815] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T17:52:05.447677] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-07T17:52:06.252778] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-07T17:52:06.267537] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T17:52:06.525837] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T17:52:07.047750] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-07T17:52:07.847727] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-07T17:52:08.018224] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T17:52:08.238532] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T17:52:08.647624] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-07T17:52:08.701475] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-07T17:52:09.251924] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T17:52:09.447693] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-07T17:52:10.099948] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T17:52:10.247806] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-07T17:52:11.047689] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-07T17:52:11.585863] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T17:52:11.847697] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-07T17:52:12.647754] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-07T17:52:13.294316] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T17:52:13.311592] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T17:52:13.313821] [INFO ] [REMOTE ] BYM: Full fetch complete (17975 records). [2025-10-07T17:52:13.313972] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-07T17:52:13.449020] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-07T17:52:13.745546] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-07T17:52:13.745922] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-07T17:52:13.757243] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-07T17:52:13.758071] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-07T17:52:13.758141] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-07T17:52:13.759768] [DEBUG] [LOCAL ] BYM: Trimmed 17975 records to 11929 (keeping 200 days of data) [2025-10-07T17:52:13.835321] [DEBUG] [LOCAL ] BYM: Primary data saved (11929 records). [2025-10-07T17:52:13.835494] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-07T17:52:13.835580] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 34.3s. Estimated remaining: 4h 34m 9s. Rate: 7.3 symbols/min [2025-10-07T17:52:14.002830] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:52:14.021057] [DEBUG] [LOCAL ] CABO: Loaded 16885 existing records from primary storage. [2025-10-07T17:52:14.021300] [INFO ] [MAIN ] CABO: Loaded 16885 existing records. [2025-10-07T17:52:14.199743] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:52:14.200002] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-07T17:52:14.200058] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-07T17:52:14.200237] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-07T17:52:14.200294] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-07T17:52:14.252925] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-07T17:52:14.554027] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:52:14.568129] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T17:52:15.047690] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-07T17:52:15.847636] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-07T17:52:15.930554] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T17:52:16.568945] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-07T17:52:16.647694] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-07T17:52:16.735718] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T17:52:17.447677] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-07T17:52:18.247626] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-07T17:52:18.270047] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T17:52:18.476809] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-07T17:52:19.047688] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-07T17:52:19.847703] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-07T17:52:19.969292] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T17:52:20.547373] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-07T17:52:20.647671] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-07T17:52:20.690928] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-07T17:52:21.447677] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-07T17:52:22.004852] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T17:52:22.247624] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-07T17:52:23.047619] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-07T17:52:23.506534] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-07T17:52:23.525207] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T17:52:23.529594] [INFO ] [REMOTE ] BZH: Full fetch complete (47020 records). [2025-10-07T17:52:23.529738] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-07T17:52:23.857363] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-07T17:52:23.984302] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-07T17:52:23.984547] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-07T17:52:23.988667] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-07T17:52:23.989510] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-07T17:52:23.990095] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-07T17:52:23.991540] [DEBUG] [LOCAL ] BZH: Trimmed 47020 records to 32402 (keeping 200 days of data) [2025-10-07T17:52:24.186621] [DEBUG] [LOCAL ] BZH: Primary data saved (32402 records). [2025-10-07T17:52:24.186809] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-07T17:52:24.187562] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 32.3s. Estimated remaining: 4h 34m 11s. Rate: 7.3 symbols/min [2025-10-07T17:52:24.353201] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:52:24.381431] [DEBUG] [LOCAL ] CACI: Loaded 24209 existing records from primary storage. [2025-10-07T17:52:24.381743] [INFO ] [MAIN ] CACI: Loaded 24209 existing records. [2025-10-07T17:52:24.554710] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:52:24.554990] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-07T17:52:24.555063] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-07T17:52:24.555423] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-07T17:52:24.555481] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-07T17:52:24.652767] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-07T17:52:25.006284] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:52:25.447793] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-07T17:52:25.554518] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T17:52:26.074239] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-07T17:52:26.247639] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-07T17:52:26.724945] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T17:52:27.047685] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-07T17:52:27.612849] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T17:52:27.847698] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-07T17:52:27.880861] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T17:52:28.647709] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-07T17:52:29.447726] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-07T17:52:29.830697] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T17:52:29.880205] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T17:52:30.247742] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-07T17:52:30.477412] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T17:52:30.479368] [INFO ] [REMOTE ] CAAP: Full fetch complete (27746 records). [2025-10-07T17:52:30.479446] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-07T17:52:30.834199] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-07T17:52:30.834286] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-07T17:52:30.834707] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-07T17:52:30.834770] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-07T17:52:30.835477] [DEBUG] [LOCAL ] CAAP: Trimmed 27746 records to 19823 (keeping 200 days of data) [2025-10-07T17:52:30.950823] [DEBUG] [LOCAL ] CAAP: Primary data saved (19823 records). [2025-10-07T17:52:30.950959] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-07T17:52:30.951040] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 28.3s. Estimated remaining: 4h 33m 55s. Rate: 7.3 symbols/min [2025-10-07T17:52:31.049473] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-07T17:52:31.127993] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:52:31.140884] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-07T17:52:31.190406] [DEBUG] [LOCAL ] CADE: Loaded 49070 existing records from primary storage. [2025-10-07T17:52:31.190831] [INFO ] [MAIN ] CADE: Loaded 49070 existing records. [2025-10-07T17:52:31.365893] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:52:31.366121] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-07T17:52:31.366188] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-07T17:52:31.366477] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-07T17:52:31.366553] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-07T17:52:31.707748] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:52:31.847624] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-07T17:52:32.336196] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T17:52:32.542583] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T17:52:32.647619] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-07T17:52:33.447679] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-07T17:52:33.714608] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T17:52:34.247677] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-07T17:52:35.019318] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T17:52:35.047603] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-07T17:52:35.209396] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T17:52:35.847677] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-07T17:52:36.648023] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-07T17:52:36.654191] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T17:52:37.403245] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T17:52:37.447628] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-07T17:52:37.723034] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T17:52:38.247712] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-07T17:52:38.872109] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T17:52:39.047684] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-07T17:52:39.847631] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-07T17:52:40.097350] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T17:52:40.285701] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T17:52:40.647683] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-07T17:52:41.451684] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-07T17:52:41.460574] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T17:52:42.247614] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-07T17:52:42.275676] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T17:52:42.421321] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-07T17:52:42.424831] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-07T17:52:42.424948] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-07T17:52:42.813453] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-07T17:52:42.813542] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-07T17:52:42.814356] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-07T17:52:42.814442] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-07T17:52:42.815941] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53740 (keeping 200 days of data) [2025-10-07T17:52:43.048245] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-07T17:52:43.155374] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-07T17:52:43.155522] [INFO ] [MAIN ] C: Full history saved. [2025-10-07T17:52:43.156211] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. C took 44.5s. Estimated remaining: 4h 34m 8s. Rate: 7.3 symbols/min [2025-10-07T17:52:43.325580] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:52:43.366590] [DEBUG] [LOCAL ] CAE: Loaded 39221 existing records from primary storage. [2025-10-07T17:52:43.366933] [INFO ] [MAIN ] CAE: Loaded 39221 existing records. [2025-10-07T17:52:43.546571] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:52:43.546802] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-07T17:52:43.546851] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-07T17:52:43.547057] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-07T17:52:43.547116] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-07T17:52:43.847845] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-07T17:52:43.918906] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:52:43.940906] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T17:52:44.615937] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T17:52:44.617279] [INFO ] [REMOTE ] CABO: Full fetch complete (23112 records). [2025-10-07T17:52:44.617370] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-07T17:52:44.652846] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-07T17:52:45.078691] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-07T17:52:45.078820] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-07T17:52:45.079479] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-07T17:52:45.080249] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-07T17:52:45.081913] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T17:52:45.097051] [DEBUG] [LOCAL ] CABO: Trimmed 23112 records to 16889 (keeping 200 days of data) [2025-10-07T17:52:45.199234] [DEBUG] [LOCAL ] CABO: Primary data saved (16889 records). [2025-10-07T17:52:45.199386] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-07T17:52:45.199473] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. CABO took 31.4s. Estimated remaining: 4h 33m 27s. Rate: 7.3 symbols/min [2025-10-07T17:52:45.363726] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:52:45.369581] [DEBUG] [LOCAL ] CAF: Loaded 3419 existing records from primary storage. [2025-10-07T17:52:45.369777] [INFO ] [MAIN ] CAF: Loaded 3419 existing records. [2025-10-07T17:52:45.452966] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-07T17:52:45.553723] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:52:45.553988] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-07T17:52:45.554036] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-07T17:52:45.554252] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-07T17:52:45.554308] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-07T17:52:45.904143] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:52:46.247629] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-07T17:52:46.289355] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T17:52:46.676075] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-07T17:52:47.047695] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-07T17:52:47.741406] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T17:52:47.847671] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-07T17:52:48.214937] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T17:52:48.647720] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-07T17:52:49.146868] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T17:52:49.375589] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-07T17:52:49.447672] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-07T17:52:50.035079] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T17:52:50.247698] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-07T17:52:51.047694] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-07T17:52:51.847627] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-07T17:52:51.964922] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T17:52:52.071392] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-07T17:52:52.431071] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T17:52:52.647684] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-07T17:52:53.447744] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-07T17:52:54.247666] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-07T17:52:54.709296] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-07T17:52:54.792692] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T17:52:55.047629] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-07T17:52:55.292962] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T17:52:55.847694] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-07T17:52:56.647624] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-07T17:52:56.687431] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T17:52:56.883293] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T17:52:57.447702] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-07T17:52:58.247681] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-07T17:52:58.390022] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T17:52:58.545181] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T17:52:59.043919] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T17:52:59.047596] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-07T17:52:59.687682] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T17:52:59.847739] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-07T17:53:00.647674] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-07T17:53:01.355734] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T17:53:01.361121] [INFO ] [REMOTE ] CADE: Full fetch complete (70109 records). [2025-10-07T17:53:01.361528] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-07T17:53:01.452856] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-07T17:53:01.800972] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-07T17:53:01.801081] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-07T17:53:01.801899] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-07T17:53:01.801984] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-07T17:53:01.803600] [DEBUG] [LOCAL ] CADE: Trimmed 70109 records to 49123 (keeping 200 days of data) [2025-10-07T17:53:02.121189] [DEBUG] [LOCAL ] CADE: Primary data saved (49123 records). [2025-10-07T17:53:02.121350] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-07T17:53:02.122239] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CADE took 31.2s. Estimated remaining: 4h 34m 4s. Rate: 7.3 symbols/min [2025-10-07T17:53:02.250887] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-07T17:53:02.306254] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:53:02.364326] [DEBUG] [LOCAL ] CAG: Loaded 53664 existing records from primary storage. [2025-10-07T17:53:02.364712] [INFO ] [MAIN ] CAG: Loaded 53664 existing records. [2025-10-07T17:53:02.610368] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T17:53:02.621602] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:53:02.614338] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T17:53:02.623829] [INFO ] [REMOTE ] CACI: Full fetch complete (38711 records). [2025-10-07T17:53:02.624175] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-07T17:53:02.624079] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-07T17:53:02.633208] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-07T17:53:02.665509] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-07T17:53:02.670896] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-07T17:53:02.714146] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-07T17:53:03.052904] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-07T17:53:03.410535] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-07T17:53:03.416278] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-07T17:53:03.422564] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-07T17:53:03.432586] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-07T17:53:03.454817] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:53:03.455793] [DEBUG] [LOCAL ] CACI: Trimmed 38711 records to 24024 (keeping 200 days of data) [2025-10-07T17:53:03.598333] [DEBUG] [LOCAL ] CACI: Primary data saved (24024 records). [2025-10-07T17:53:03.598485] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-07T17:53:03.598576] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CACI took 39.4s. Estimated remaining: 4h 33m 20s. Rate: 7.3 symbols/min [2025-10-07T17:53:03.771309] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:53:03.822961] [DEBUG] [LOCAL ] CAH: Loaded 51470 existing records from primary storage. [2025-10-07T17:53:03.823276] [INFO ] [MAIN ] CAH: Loaded 51470 existing records. [2025-10-07T17:53:03.853135] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-07T17:53:04.000218] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:53:04.000438] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-07T17:53:04.000486] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-07T17:53:04.000729] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-07T17:53:04.000786] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-07T17:53:04.362830] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:53:04.641446] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T17:53:04.651041] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-07T17:53:05.117332] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T17:53:05.447711] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-07T17:53:05.775349] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T17:53:05.844942] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-07T17:53:06.247725] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-07T17:53:07.047724] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-07T17:53:07.603802] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T17:53:07.787892] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T17:53:07.847618] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-07T17:53:08.360031] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T17:53:08.360940] [INFO ] [REMOTE ] CAF: Full fetch complete (5560 records). [2025-10-07T17:53:08.361012] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-07T17:53:08.652797] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-07T17:53:08.713020] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-07T17:53:08.713230] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-07T17:53:08.713469] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-07T17:53:08.713548] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-07T17:53:08.713977] [DEBUG] [LOCAL ] CAF: Trimmed 5560 records to 3410 (keeping 200 days of data) [2025-10-07T17:53:08.734250] [DEBUG] [LOCAL ] CAF: Primary data saved (3410 records). [2025-10-07T17:53:08.734332] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-07T17:53:08.734406] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAF took 23.5s. Estimated remaining: 4h 32m 56s. Rate: 7.3 symbols/min [2025-10-07T17:53:08.905540] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:53:08.954027] [DEBUG] [LOCAL ] CAL: Loaded 43096 existing records from primary storage. [2025-10-07T17:53:08.954383] [INFO ] [MAIN ] CAL: Loaded 43096 existing records. [2025-10-07T17:53:09.128611] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:53:09.128851] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-07T17:53:09.128901] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-07T17:53:09.129181] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-07T17:53:09.129239] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-07T17:53:09.458533] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-07T17:53:09.481600] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:53:10.247677] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-07T17:53:10.538855] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T17:53:10.943969] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T17:53:11.047695] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-07T17:53:11.847695] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-07T17:53:12.065706] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T17:53:12.647622] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-07T17:53:12.818704] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T17:53:13.447733] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-07T17:53:13.586531] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T17:53:14.001682] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T17:53:14.247629] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-07T17:53:14.737015] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T17:53:15.047678] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-07T17:53:15.756219] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T17:53:15.847640] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-07T17:53:16.583855] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T17:53:16.647677] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-07T17:53:17.407819] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T17:53:17.447725] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-07T17:53:18.108340] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T17:53:18.247743] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-07T17:53:18.864601] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T17:53:19.047723] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-07T17:53:19.847671] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-07T17:53:20.101738] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T17:53:20.278703] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T17:53:20.281680] [INFO ] [REMOTE ] CAE: Full fetch complete (56212 records). [2025-10-07T17:53:20.281780] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-07T17:53:20.649484] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-07T17:53:20.667887] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-07T17:53:20.667980] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-07T17:53:20.668668] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-07T17:53:20.668848] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-07T17:53:20.670058] [DEBUG] [LOCAL ] CAE: Trimmed 56212 records to 39206 (keeping 200 days of data) [2025-10-07T17:53:20.901192] [DEBUG] [LOCAL ] CAE: Primary data saved (39206 records). [2025-10-07T17:53:20.901337] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-07T17:53:20.901885] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAE took 37.7s. Estimated remaining: 4h 33m 8s. Rate: 7.3 symbols/min [2025-10-07T17:53:21.071442] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:53:21.109206] [DEBUG] [LOCAL ] CALX: Loaded 37817 existing records from primary storage. [2025-10-07T17:53:21.109579] [INFO ] [MAIN ] CALX: Loaded 37817 existing records. [2025-10-07T17:53:21.290961] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:53:21.291287] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-07T17:53:21.291344] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-07T17:53:21.291821] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-07T17:53:21.291880] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-07T17:53:21.447922] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-07T17:53:21.647920] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:53:21.735702] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T17:53:22.247741] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-07T17:53:22.623339] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T17:53:22.662373] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T17:53:23.047621] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-07T17:53:23.103917] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T17:53:23.847702] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-07T17:53:24.443266] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T17:53:24.647736] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-07T17:53:25.447710] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-07T17:53:25.668541] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T17:53:26.255018] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-07T17:53:26.260139] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T17:53:27.047626] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-07T17:53:27.092790] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T17:53:27.847702] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-07T17:53:28.007555] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T17:53:28.647694] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-07T17:53:28.705312] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T17:53:29.447722] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-07T17:53:29.736102] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T17:53:29.956056] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T17:53:30.247733] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-07T17:53:30.909738] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T17:53:31.047716] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-07T17:53:31.718833] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T17:53:31.847637] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-07T17:53:32.526878] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T17:53:32.647600] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-07T17:53:33.447618] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-07T17:53:33.668297] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-07T17:53:34.142870] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T17:53:34.247636] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-07T17:53:35.047700] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-07T17:53:35.386441] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T17:53:35.834968] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T17:53:35.847607] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-07T17:53:36.621281] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T17:53:36.625006] [INFO ] [REMOTE ] CAH: Full fetch complete (74615 records). [2025-10-07T17:53:36.625151] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-07T17:53:36.659041] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-07T17:53:37.021976] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-07T17:53:37.022084] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-07T17:53:37.023543] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-07T17:53:37.023629] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-07T17:53:37.025268] [DEBUG] [LOCAL ] CAH: Trimmed 74615 records to 51479 (keeping 200 days of data) [2025-10-07T17:53:37.363161] [DEBUG] [LOCAL ] CAH: Primary data saved (51479 records). [2025-10-07T17:53:37.363905] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-07T17:53:37.364013] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAH took 33.8s. Estimated remaining: 4h 33m 41s. Rate: 7.2 symbols/min [2025-10-07T17:53:37.453187] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-07T17:53:37.536199] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:53:37.562835] [DEBUG] [LOCAL ] CANG: Loaded 26918 existing records from primary storage. [2025-10-07T17:53:37.563111] [INFO ] [MAIN ] CANG: Loaded 26918 existing records. [2025-10-07T17:53:37.742940] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:53:37.743162] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-07T17:53:37.743210] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-07T17:53:37.743467] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-07T17:53:37.743525] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-07T17:53:38.138837] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:53:38.141232] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-07T17:53:38.174004] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T17:53:38.247610] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-07T17:53:39.048147] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-07T17:53:39.054094] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T17:53:39.250723] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T17:53:39.847680] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-07T17:53:40.569159] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T17:53:40.647610] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-07T17:53:41.176905] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T17:53:41.180054] [INFO ] [REMOTE ] CAL: Full fetch complete (61836 records). [2025-10-07T17:53:41.180172] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-07T17:53:41.452751] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-07T17:53:41.661927] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-07T17:53:41.662008] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-07T17:53:41.662730] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-07T17:53:41.662833] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-07T17:53:41.664124] [DEBUG] [LOCAL ] CAL: Trimmed 61836 records to 43072 (keeping 200 days of data) [2025-10-07T17:53:41.952613] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T17:53:41.965306] [DEBUG] [LOCAL ] CAL: Primary data saved (43072 records). [2025-10-07T17:53:41.965443] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-07T17:53:41.965575] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 33.2s. Estimated remaining: 4h 33m 14s. Rate: 7.3 symbols/min [2025-10-07T17:53:42.182441] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:53:42.193693] [DEBUG] [LOCAL ] CAPL: Loaded 5725 existing records from primary storage. [2025-10-07T17:53:42.194000] [INFO ] [MAIN ] CAPL: Loaded 5725 existing records. [2025-10-07T17:53:42.259577] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-07T17:53:42.407955] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:53:42.408244] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-07T17:53:42.408304] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-07T17:53:42.408551] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-07T17:53:42.408609] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-07T17:53:42.786081] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:53:43.048699] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-07T17:53:43.050325] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T17:53:43.224084] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T17:53:43.847678] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-07T17:53:44.647712] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-07T17:53:44.844374] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T17:53:44.849997] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-07T17:53:44.850244] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-07T17:53:45.198843] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T17:53:45.278842] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-07T17:53:45.278921] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-07T17:53:45.279966] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-07T17:53:45.280033] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-07T17:53:45.281534] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 53664 (keeping 200 days of data) [2025-10-07T17:53:45.465984] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-07T17:53:45.625306] [DEBUG] [LOCAL ] CAG: Primary data saved (53664 records). [2025-10-07T17:53:45.625462] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-07T17:53:45.626885] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAG took 43.5s. Estimated remaining: 4h 32m 43s. Rate: 7.3 symbols/min [2025-10-07T17:53:45.794139] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:53:45.849774] [DEBUG] [LOCAL ] CARR: Loaded 53595 existing records from primary storage. [2025-10-07T17:53:45.850099] [INFO ] [MAIN ] CARR: Loaded 53595 existing records. [2025-10-07T17:53:46.027241] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:53:46.027491] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-07T17:53:46.027590] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-07T17:53:46.027844] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-07T17:53:46.027901] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-07T17:53:46.255759] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-07T17:53:46.392369] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T17:53:46.436960] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:53:46.439844] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T17:53:47.047742] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-07T17:53:47.110277] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T17:53:47.847710] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-07T17:53:48.186278] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T17:53:48.647736] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-07T17:53:49.414162] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T17:53:49.447615] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-07T17:53:50.247745] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-07T17:53:50.484946] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T17:53:50.525973] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T17:53:51.032567] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T17:53:51.047605] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-07T17:53:51.648888] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T17:53:51.847707] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-07T17:53:52.647624] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-07T17:53:53.029844] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T17:53:53.447695] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-07T17:53:54.247683] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-07T17:53:54.332360] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T17:53:54.469209] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-07T17:53:54.975235] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T17:53:55.047616] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-07T17:53:55.847624] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-07T17:53:56.465814] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T17:53:56.557049] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T17:53:56.647626] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-07T17:53:57.326749] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-07T17:53:57.447639] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-07T17:53:58.025923] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T17:53:58.247697] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-07T17:53:59.047682] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-07T17:53:59.744890] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T17:53:59.847634] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-07T17:54:00.647618] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-07T17:54:00.916378] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T17:54:01.199158] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-07T17:54:01.238540] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T17:54:01.447733] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-07T17:54:02.247704] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-07T17:54:02.574701] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T17:54:03.047748] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-07T17:54:03.593244] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T17:54:03.847739] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-07T17:54:04.536338] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T17:54:04.647709] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-07T17:54:04.979409] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T17:54:05.447719] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-07T17:54:06.105381] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T17:54:06.108869] [INFO ] [REMOTE ] CALX: Full fetch complete (54051 records). [2025-10-07T17:54:06.108994] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-07T17:54:06.256969] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-07T17:54:06.505805] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-07T17:54:06.505901] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-07T17:54:06.506570] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-07T17:54:06.506637] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-07T17:54:06.507946] [DEBUG] [LOCAL ] CALX: Trimmed 54051 records to 37780 (keeping 200 days of data) [2025-10-07T17:54:06.736009] [DEBUG] [LOCAL ] CALX: Primary data saved (37780 records). [2025-10-07T17:54:06.736172] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-07T17:54:06.737139] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 45.8s. Estimated remaining: 4h 33m 40s. Rate: 7.2 symbols/min [2025-10-07T17:54:06.955997] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:54:07.017540] [DEBUG] [LOCAL ] CARS: Loaded 39750 existing records from primary storage. [2025-10-07T17:54:07.018005] [INFO ] [MAIN ] CARS: Loaded 39750 existing records. [2025-10-07T17:54:07.052898] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-07T17:54:07.238311] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:54:07.238916] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-07T17:54:07.239134] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-07T17:54:07.239463] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-07T17:54:07.239522] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-07T17:54:07.648409] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:54:07.651253] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-07T17:54:07.663290] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T17:54:07.790662] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T17:54:07.847602] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-07T17:54:08.647680] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-07T17:54:09.344025] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T17:54:09.447753] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-07T17:54:10.189148] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:54:10.247622] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-07T17:54:10.645111] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T17:54:10.647871] [INFO ] [REMOTE ] CANG: Full fetch complete (40308 records). [2025-10-07T17:54:10.647963] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-07T17:54:11.045792] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-07T17:54:11.045916] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-07T17:54:11.046474] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-07T17:54:11.046517] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-07T17:54:11.047688] [DEBUG] [LOCAL ] CANG: Trimmed 40308 records to 26957 (keeping 200 days of data) [2025-10-07T17:54:11.047847] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-07T17:54:11.219709] [DEBUG] [LOCAL ] CANG: Primary data saved (26957 records). [2025-10-07T17:54:11.219854] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-07T17:54:11.219937] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CANG took 33.9s. Estimated remaining: 4h 33m 12s. Rate: 7.2 symbols/min [2025-10-07T17:54:11.387315] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:54:11.436770] [DEBUG] [LOCAL ] CAT: Loaded 52917 existing records from primary storage. [2025-10-07T17:54:11.437104] [INFO ] [MAIN ] CAT: Loaded 52917 existing records. [2025-10-07T17:54:11.598102] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T17:54:11.616470] [INFO ] [REMOTE ] CAPL: Full fetch complete (8734 records). [2025-10-07T17:54:11.620430] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-07T17:54:11.620313] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:54:11.663580] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-07T17:54:11.689126] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-07T17:54:11.717712] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-07T17:54:11.717802] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-07T17:54:11.852459] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-07T17:54:12.379068] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:54:12.379584] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-07T17:54:12.379691] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-07T17:54:12.379966] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-07T17:54:12.380123] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-07T17:54:12.380757] [DEBUG] [LOCAL ] CAPL: Trimmed 8734 records to 5715 (keeping 200 days of data) [2025-10-07T17:54:12.417161] [DEBUG] [LOCAL ] CAPL: Primary data saved (5715 records). [2025-10-07T17:54:12.417311] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-07T17:54:12.417723] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 30.5s. Estimated remaining: 4h 32m 28s. Rate: 7.3 symbols/min [2025-10-07T17:54:12.594228] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-07T17:54:12.619449] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:54:12.640705] [DEBUG] [LOCAL ] CATO: Loaded 7011 existing records from primary storage. [2025-10-07T17:54:12.640927] [INFO ] [MAIN ] CATO: Loaded 7011 existing records. [2025-10-07T17:54:12.653246] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-07T17:54:12.834547] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:54:12.834798] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-07T17:54:12.834853] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-07T17:54:12.835032] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-07T17:54:12.835097] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-07T17:54:13.188323] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:54:13.226536] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T17:54:13.447748] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-07T17:54:14.247681] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-07T17:54:14.473383] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T17:54:14.541285] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T17:54:15.047668] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-07T17:54:15.616180] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T17:54:15.847616] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-07T17:54:16.164306] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T17:54:16.647637] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-07T17:54:17.365683] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T17:54:17.447598] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-07T17:54:17.610663] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T17:54:18.233511] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T17:54:18.247601] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-07T17:54:18.974010] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T17:54:19.047714] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-07T17:54:19.847705] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-07T17:54:20.255275] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T17:54:20.325472] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-07T17:54:20.647691] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-07T17:54:21.447704] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-07T17:54:22.049604] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T17:54:22.247619] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-07T17:54:22.408457] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-07T17:54:22.412090] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-07T17:54:22.412227] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-07T17:54:22.792518] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-07T17:54:22.792603] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-07T17:54:22.793438] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-07T17:54:22.793511] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-07T17:54:22.795112] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53597 (keeping 200 days of data) [2025-10-07T17:54:23.057545] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-07T17:54:23.193830] [DEBUG] [LOCAL ] CARR: Primary data saved (53597 records). [2025-10-07T17:54:23.194067] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-07T17:54:23.195369] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARR took 37.6s. Estimated remaining: 4h 32m 32s. Rate: 7.3 symbols/min [2025-10-07T17:54:23.371596] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:54:23.426891] [DEBUG] [LOCAL ] CAVA: Loaded 53556 existing records from primary storage. [2025-10-07T17:54:23.427247] [INFO ] [MAIN ] CAVA: Loaded 53556 existing records. [2025-10-07T17:54:23.646774] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T17:54:23.644119] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:54:23.647166] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-07T17:54:23.656419] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-07T17:54:23.657095] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-07T17:54:23.657153] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-07T17:54:23.761389] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T17:54:23.852769] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-07T17:54:24.017831] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:54:24.647673] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-07T17:54:25.447615] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-07T17:54:25.484575] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T17:54:25.948581] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T17:54:26.247712] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-07T17:54:26.842809] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-07T17:54:27.053594] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-07T17:54:27.060606] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T17:54:27.847705] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-07T17:54:28.617364] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T17:54:28.647669] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-07T17:54:29.447688] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-07T17:54:30.020353] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-07T17:54:30.115461] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T17:54:30.247683] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-07T17:54:31.020847] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T17:54:31.047600] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-07T17:54:31.153770] [DEBUG] [REMOTE ] CAVA: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-07T17:54:31.154074] [WARN ] [REMOTE ] CAVA: No data returned for month 2025-02 [2025-10-07T17:54:31.154199] [FATAL] [REMOTE ] CAVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:54:31.154305] [FATAL] [MAIN ] CAVA: Failed to fetch primary data. [2025-10-07T17:54:31.154375] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:54:31.154479] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-07T17:54:31.154560] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-07T17:54:31.154602] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-10-07T17:54:31.154884] [DEBUG] [LOCAL ] CAVA: Deleted derivative data file. [2025-10-07T17:54:31.155731] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CAVA took 8.0s. Estimated remaining: 4h 32m 23s. Rate: 7.3 symbols/min [2025-10-07T17:54:31.327802] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:54:31.378459] [DEBUG] [LOCAL ] CB: Loaded 49941 existing records from primary storage. [2025-10-07T17:54:31.379004] [INFO ] [MAIN ] CB: Loaded 49941 existing records. [2025-10-07T17:54:31.560588] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:54:31.560905] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-07T17:54:31.560979] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-07T17:54:31.561348] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-07T17:54:31.561409] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-07T17:54:31.859267] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-07T17:54:31.931018] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T17:54:31.954304] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:54:32.440311] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T17:54:32.441377] [INFO ] [REMOTE ] CATO: Full fetch complete (11221 records). [2025-10-07T17:54:32.441446] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-07T17:54:32.656919] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-07T17:54:32.811259] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-07T17:54:32.811336] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-07T17:54:32.811598] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-07T17:54:32.811637] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-07T17:54:32.812116] [DEBUG] [LOCAL ] CATO: Trimmed 11221 records to 6981 (keeping 200 days of data) [2025-10-07T17:54:32.851954] [DEBUG] [LOCAL ] CATO: Primary data saved (6981 records). [2025-10-07T17:54:32.852057] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-07T17:54:32.852149] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CATO took 20.4s. Estimated remaining: 4h 31m 42s. Rate: 7.3 symbols/min [2025-10-07T17:54:33.017990] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:54:33.030732] [DEBUG] [LOCAL ] CBAN: Loaded 10712 existing records from primary storage. [2025-10-07T17:54:33.030939] [INFO ] [MAIN ] CBAN: Loaded 10712 existing records. [2025-10-07T17:54:33.205106] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:54:33.205304] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-07T17:54:33.205352] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-07T17:54:33.205531] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-07T17:54:33.205595] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-07T17:54:33.452846] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-07T17:54:33.567578] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:54:34.247689] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-07T17:54:34.848604] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-07T17:54:34.950443] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T17:54:35.047602] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-07T17:54:35.808630] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T17:54:35.847604] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-07T17:54:36.491263] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T17:54:36.647716] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-07T17:54:37.398304] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T17:54:37.447605] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-07T17:54:38.005849] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T17:54:38.247743] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-07T17:54:39.047706] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-07T17:54:39.163419] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T17:54:39.847708] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-07T17:54:40.228476] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T17:54:40.231235] [INFO ] [REMOTE ] CARS: Full fetch complete (55664 records). [2025-10-07T17:54:40.231337] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-07T17:54:40.490782] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-07T17:54:40.651550] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-07T17:54:40.666245] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-07T17:54:40.666342] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-07T17:54:40.667066] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-07T17:54:40.667276] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-07T17:54:40.668697] [DEBUG] [LOCAL ] CARS: Trimmed 55664 records to 39739 (keeping 200 days of data) [2025-10-07T17:54:40.898496] [DEBUG] [LOCAL ] CARS: Primary data saved (39739 records). [2025-10-07T17:54:40.898701] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-07T17:54:40.899528] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CARS took 34.2s. Estimated remaining: 4h 31m 32s. Rate: 7.3 symbols/min [2025-10-07T17:54:41.426083] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T17:54:41.436941] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T17:54:41.447594] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-07T17:54:42.243802] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T17:54:42.247586] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-07T17:54:43.047612] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-07T17:54:43.048262] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T17:54:43.847769] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-07T17:54:44.647779] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-07T17:54:44.909332] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T17:54:45.447625] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-07T17:54:45.558629] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T17:54:45.712119] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T17:54:46.247703] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-07T17:54:46.893755] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T17:54:47.047711] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-07T17:54:47.847708] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-07T17:54:48.219487] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T17:54:48.479802] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T17:54:48.647600] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-07T17:54:48.686136] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-07T17:54:49.447703] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-07T17:54:50.247701] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-07T17:54:50.430610] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T17:54:51.014322] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T17:54:51.047624] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-07T17:54:51.339572] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T17:54:51.847727] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-07T17:54:51.906239] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-07T17:54:52.647685] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-07T17:54:53.410015] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T17:54:53.447628] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-07T17:54:53.917383] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-07T17:54:54.160752] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-07T17:54:54.247716] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-07T17:54:55.047722] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-07T17:54:55.847738] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-07T17:54:56.022413] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T17:54:56.556558] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T17:54:56.647613] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-07T17:54:56.796973] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T17:54:57.174449] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T17:54:57.175552] [INFO ] [REMOTE ] CBAN: Full fetch complete (16130 records). [2025-10-07T17:54:57.175626] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-07T17:54:57.453004] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-07T17:54:57.570392] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-07T17:54:57.570489] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-07T17:54:57.570837] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-07T17:54:57.570900] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-07T17:54:57.571447] [DEBUG] [LOCAL ] CBAN: Trimmed 16130 records to 10701 (keeping 200 days of data) [2025-10-07T17:54:57.636700] [DEBUG] [LOCAL ] CBAN: Primary data saved (10701 records). [2025-10-07T17:54:57.636860] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-07T17:54:57.636945] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CBAN took 24.8s. Estimated remaining: 4h 32m 6s. Rate: 7.3 symbols/min [2025-10-07T17:54:58.247762] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-07T17:54:59.312907] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T17:54:59.323690] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-07T17:55:00.063071] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-07T17:55:00.066621] [INFO ] [REMOTE ] CAT: Full fetch complete (76691 records). [2025-10-07T17:55:00.066759] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-07T17:55:00.454857] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-07T17:55:00.454936] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-07T17:55:00.455756] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-07T17:55:00.455819] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-07T17:55:00.457226] [DEBUG] [LOCAL ] CAT: Trimmed 76691 records to 52913 (keeping 200 days of data) [2025-10-07T17:55:00.785539] [DEBUG] [LOCAL ] CAT: Primary data saved (52913 records). [2025-10-07T17:55:00.785715] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-07T17:55:00.785846] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAT took 49.6s. Estimated remaining: 4h 31m 32s. Rate: 7.3 symbols/min [2025-10-07T17:55:00.928894] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T17:55:00.932671] [INFO ] [REMOTE ] CB: Full fetch complete (72617 records). [2025-10-07T17:55:00.932817] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-07T17:55:01.330503] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-07T17:55:01.330585] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-07T17:55:01.331432] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-07T17:55:01.331499] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-07T17:55:01.332931] [DEBUG] [LOCAL ] CB: Trimmed 72617 records to 49930 (keeping 200 days of data) [2025-10-07T17:55:01.664231] [DEBUG] [LOCAL ] CB: Primary data saved (49930 records). [2025-10-07T17:55:01.664397] [INFO ] [MAIN ] CB: Full history saved. [2025-10-07T17:55:01.665351] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 30.5s. Estimated remaining: 4h 30m 48s. Rate: 7.3 symbols/min [2025-10-07T17:55:02.267836] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:02.299737] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:02.360132] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:02.384850] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:02.391788] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-07T17:55:02.391908] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-07T17:55:02.392146] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-07T17:55:02.392213] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-07T17:55:02.392291] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-07T17:55:02.392329] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-07T17:55:02.417515] [DEBUG] [LOCAL ] CBNA: Loaded 2906 existing records from primary storage. [2025-10-07T17:55:02.445045] [INFO ] [MAIN ] CBNA: Loaded 2906 existing records. [2025-10-07T17:55:02.552240] [DEBUG] [LOCAL ] CBL: Loaded 16311 existing records from primary storage. [2025-10-07T17:55:02.580913] [INFO ] [MAIN ] CBL: Loaded 16311 existing records. [2025-10-07T17:55:03.007908] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:55:03.028497] [DEBUG] [LOCAL ] CBRE: Loaded 50483 existing records from primary storage. [2025-10-07T17:55:03.127526] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:55:03.111048] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-07T17:55:03.150978] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-07T17:55:03.151069] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-07T17:55:03.155389] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-07T17:55:03.143636] [INFO ] [MAIN ] CBRE: Loaded 50483 existing records. [2025-10-07T17:55:03.160888] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-07T17:55:03.160965] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-07T17:55:03.182584] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-07T17:55:03.182662] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-07T17:55:03.389069] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:03.421623] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-07T17:55:03.866683] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:55:03.928768] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-07T17:55:03.936146] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:55:03.953303] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:55:04.010218] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-07T17:55:04.010449] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-07T17:55:04.068331] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:55:04.099435] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-07T17:55:04.099564] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-07T17:55:04.115195] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-07T17:55:04.115264] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-07T17:55:04.120992] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-07T17:55:04.126709] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-07T17:55:04.142550] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-07T17:55:04.198002] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 2.5s. Estimated remaining: 4h 30m 12s. Rate: 7.3 symbols/min [2025-10-07T17:55:04.310155] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:04.371769] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-07T17:55:04.346188] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:04.420945] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-07T17:55:04.661995] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:04.906777] [DEBUG] [LOCAL ] CBT: Loaded 30746 existing records from primary storage. [2025-10-07T17:55:04.908634] [INFO ] [MAIN ] CBT: Loaded 30746 existing records. [2025-10-07T17:55:04.944375] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:04.954061] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-07T17:55:05.112197] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:55:05.112426] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-07T17:55:05.112474] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-07T17:55:05.113405] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-07T17:55:05.113464] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-07T17:55:05.220474] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T17:55:05.225027] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-07T17:55:05.494261] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:05.491100] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T17:55:05.499781] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-07T17:55:05.501448] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-07T17:55:05.749201] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-07T17:55:05.751248] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-07T17:55:06.213723] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T17:55:06.247699] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-07T17:55:06.454063] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T17:55:06.598489] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-07T17:55:06.618818] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T17:55:06.942759] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T17:55:07.047694] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-07T17:55:07.847719] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-07T17:55:08.459788] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T17:55:08.647686] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-07T17:55:09.447716] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-07T17:55:09.518090] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T17:55:09.614745] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T17:55:10.208338] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T17:55:10.247614] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-07T17:55:11.047630] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-07T17:55:11.267605] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-07T17:55:11.847609] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-07T17:55:12.031406] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T17:55:12.490912] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T17:55:12.647679] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-07T17:55:13.447694] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-07T17:55:14.130238] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T17:55:14.247630] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-07T17:55:14.365548] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T17:55:15.023856] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T17:55:15.047602] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-07T17:55:15.847725] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-07T17:55:16.086929] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T17:55:16.390135] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-07T17:55:16.647693] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-07T17:55:17.447757] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-07T17:55:18.247616] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-07T17:55:18.276570] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T17:55:18.434634] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T17:55:18.623604] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-07T17:55:19.047710] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-07T17:55:19.847708] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-07T17:55:20.346866] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T17:55:20.451920] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T17:55:20.647674] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-07T17:55:21.447711] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-07T17:55:22.247670] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-07T17:55:22.425548] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T17:55:22.552189] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T17:55:23.047695] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-07T17:55:23.659506] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T17:55:23.847672] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-07T17:55:24.029610] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T17:55:24.647719] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-07T17:55:25.447734] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-07T17:55:25.488403] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T17:55:25.490035] [INFO ] [REMOTE ] CBL: Full fetch complete (25460 records). [2025-10-07T17:55:25.490184] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-07T17:55:25.892903] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T17:55:25.929676] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-07T17:55:25.929790] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-07T17:55:25.930523] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-07T17:55:25.930579] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-07T17:55:25.931280] [DEBUG] [LOCAL ] CBL: Trimmed 25460 records to 16300 (keeping 200 days of data) [2025-10-07T17:55:26.039776] [DEBUG] [LOCAL ] CBL: Primary data saved (16300 records). [2025-10-07T17:55:26.039946] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-07T17:55:26.040056] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBL took 24.4s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-07T17:55:26.209901] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:26.232488] [DEBUG] [LOCAL ] CBU: Loaded 22556 existing records from primary storage. [2025-10-07T17:55:26.232858] [INFO ] [MAIN ] CBU: Loaded 22556 existing records. [2025-10-07T17:55:26.253256] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-07T17:55:26.419673] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:55:26.420035] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-07T17:55:26.420118] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-07T17:55:26.421286] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-07T17:55:26.421371] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-07T17:55:26.782736] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-07T17:55:26.846354] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T17:55:26.852569] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:27.047747] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-07T17:55:27.847693] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-07T17:55:28.183419] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T17:55:28.489059] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T17:55:28.489897] [INFO ] [REMOTE ] CBNA: Full fetch complete (4542 records). [2025-10-07T17:55:28.489983] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-07T17:55:28.652713] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-07T17:55:28.896309] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-07T17:55:28.896393] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-07T17:55:28.896537] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-07T17:55:28.896578] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-07T17:55:28.897035] [DEBUG] [LOCAL ] CBNA: Trimmed 4542 records to 2906 (keeping 200 days of data) [2025-10-07T17:55:28.915554] [DEBUG] [LOCAL ] CBNA: Primary data saved (2906 records). [2025-10-07T17:55:28.915721] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-07T17:55:28.915826] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBNA took 27.2s. Estimated remaining: 4h 30m 35s. Rate: 7.3 symbols/min [2025-10-07T17:55:29.096692] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:29.096943] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-07T17:55:29.097001] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-07T17:55:29.097115] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-07T17:55:29.097159] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-07T17:55:29.097202] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-07T17:55:29.097235] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-07T17:55:29.463245] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:29.458597] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-07T17:55:30.247705] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-07T17:55:30.507349] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T17:55:30.574443] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T17:55:31.047694] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-07T17:55:31.441232] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T17:55:31.704108] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T17:55:31.847733] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-07T17:55:32.647682] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-07T17:55:32.977977] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T17:55:33.447615] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-07T17:55:33.651306] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:55:33.651627] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-07T17:55:33.651754] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:55:33.651803] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-07T17:55:33.651864] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:55:33.651938] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-07T17:55:33.652006] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-07T17:55:33.652048] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-07T17:55:33.652089] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-07T17:55:33.652144] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBX took 4.7s. Estimated remaining: 4h 30m 10s. Rate: 7.3 symbols/min [2025-10-07T17:55:33.830487] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:33.854279] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T17:55:33.889809] [DEBUG] [LOCAL ] CBZ: Loaded 33903 existing records from primary storage. [2025-10-07T17:55:33.890111] [INFO ] [MAIN ] CBZ: Loaded 33903 existing records. [2025-10-07T17:55:34.062341] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:55:34.062598] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-07T17:55:34.062667] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-07T17:55:34.062967] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-07T17:55:34.063026] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-07T17:55:34.256990] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-07T17:55:34.417970] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:35.047743] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-07T17:55:35.611225] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T17:55:35.847701] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-07T17:55:36.647684] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-07T17:55:36.744240] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T17:55:36.838334] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T17:55:36.840662] [INFO ] [REMOTE ] CBT: Full fetch complete (45710 records). [2025-10-07T17:55:36.840748] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-07T17:55:37.227979] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-07T17:55:37.228079] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-07T17:55:37.228838] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-07T17:55:37.228905] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-07T17:55:37.229896] [DEBUG] [LOCAL ] CBT: Trimmed 45710 records to 30815 (keeping 200 days of data) [2025-10-07T17:55:37.422515] [DEBUG] [LOCAL ] CBT: Primary data saved (30815 records). [2025-10-07T17:55:37.422688] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-07T17:55:37.422789] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBT took 33.2s. Estimated remaining: 4h 29m 40s. Rate: 7.3 symbols/min [2025-10-07T17:55:37.452977] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-07T17:55:37.591219] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:37.640087] [DEBUG] [LOCAL ] CC: Loaded 52991 existing records from primary storage. [2025-10-07T17:55:37.640448] [INFO ] [MAIN ] CC: Loaded 52991 existing records. [2025-10-07T17:55:37.814879] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:55:37.815247] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-07T17:55:37.815437] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-07T17:55:37.815706] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-07T17:55:37.815763] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-07T17:55:38.183880] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T17:55:38.187469] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:38.247597] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-07T17:55:38.705575] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T17:55:39.047677] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-07T17:55:39.818386] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T17:55:39.847607] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-07T17:55:40.641239] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T17:55:40.651073] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-07T17:55:41.285755] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T17:55:41.447624] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-07T17:55:41.685340] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T17:55:42.247760] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-07T17:55:42.737066] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T17:55:43.047695] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-07T17:55:43.556452] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T17:55:43.847638] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-07T17:55:44.480465] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T17:55:44.647598] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-07T17:55:45.307485] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T17:55:45.310877] [INFO ] [REMOTE ] CBRE: Full fetch complete (73838 records). [2025-10-07T17:55:45.310973] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-07T17:55:45.452844] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-07T17:55:45.701467] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-07T17:55:45.701548] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-07T17:55:45.702322] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-07T17:55:45.702386] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-07T17:55:45.703784] [DEBUG] [LOCAL ] CBRE: Trimmed 73838 records to 50455 (keeping 200 days of data) [2025-10-07T17:55:46.015748] [DEBUG] [LOCAL ] CBRE: Primary data saved (50455 records). [2025-10-07T17:55:46.015875] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-07T17:55:46.015971] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBRE took 44.3s. Estimated remaining: 4h 29m 34s. Rate: 7.3 symbols/min [2025-10-07T17:55:46.184331] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:55:46.240339] [DEBUG] [LOCAL ] CCI: Loaded 53139 existing records from primary storage. [2025-10-07T17:55:46.240692] [INFO ] [MAIN ] CCI: Loaded 53139 existing records. [2025-10-07T17:55:46.254384] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-07T17:55:46.425609] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:55:46.425930] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-07T17:55:46.426106] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-07T17:55:46.437257] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-07T17:55:46.454255] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-07T17:55:46.487268] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T17:55:46.581212] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T17:55:46.832020] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:55:47.047637] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-07T17:55:47.373213] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T17:55:47.847731] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-07T17:55:48.554916] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T17:55:48.647610] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-07T17:55:48.772416] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T17:55:49.447677] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-07T17:55:50.247753] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-07T17:55:50.512776] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T17:55:50.733876] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T17:55:51.047624] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-07T17:55:51.524154] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T17:55:51.847716] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-07T17:55:52.307935] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T17:55:52.647698] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-07T17:55:53.447687] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-07T17:55:53.650551] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T17:55:53.767124] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T17:55:54.247623] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-07T17:55:54.296279] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T17:55:55.047712] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-07T17:55:55.847630] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-07T17:55:56.043135] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T17:55:56.275764] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T17:55:56.647698] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-07T17:55:57.415600] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T17:55:57.447602] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-07T17:55:58.080716] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T17:55:58.247708] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-07T17:55:59.047766] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-07T17:55:59.278805] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T17:55:59.459302] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T17:55:59.847698] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-07T17:56:00.147015] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T17:56:00.647725] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-07T17:56:01.402993] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T17:56:01.447628] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-07T17:56:02.247713] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-07T17:56:02.649019] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-07T17:56:03.047723] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-07T17:56:03.221826] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T17:56:03.681850] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T17:56:03.847710] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-07T17:56:04.195773] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T17:56:04.197668] [INFO ] [REMOTE ] CBU: Full fetch complete (32425 records). [2025-10-07T17:56:04.197749] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-07T17:56:04.558293] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-07T17:56:04.558372] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-07T17:56:04.558873] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-07T17:56:04.558937] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-07T17:56:04.559689] [DEBUG] [LOCAL ] CBU: Trimmed 32425 records to 22579 (keeping 200 days of data) [2025-10-07T17:56:04.647725] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-07T17:56:04.701525] [DEBUG] [LOCAL ] CBU: Primary data saved (22579 records). [2025-10-07T17:56:04.701699] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-07T17:56:04.701796] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 38.7s. Estimated remaining: 4h 30m 16s. Rate: 7.3 symbols/min [2025-10-07T17:56:04.868096] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:56:04.868287] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-07T17:56:04.868328] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-07T17:56:04.868441] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-07T17:56:04.868482] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-07T17:56:04.868522] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-07T17:56:04.868554] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-07T17:56:05.225435] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:56:05.317054] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T17:56:05.447694] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-07T17:56:05.895687] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-07T17:56:06.223415] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T17:56:06.226901] [INFO ] [REMOTE ] CC: Full fetch complete (75690 records). [2025-10-07T17:56:06.227055] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-07T17:56:06.252755] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-07T17:56:06.628974] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-07T17:56:06.629066] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-07T17:56:06.629925] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-07T17:56:06.630001] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-07T17:56:06.631592] [DEBUG] [LOCAL ] CC: Trimmed 75690 records to 52991 (keeping 200 days of data) [2025-10-07T17:56:06.970373] [DEBUG] [LOCAL ] CC: Primary data saved (52991 records). [2025-10-07T17:56:06.970612] [INFO ] [MAIN ] CC: Full history saved. [2025-10-07T17:56:06.970765] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CC took 29.5s. Estimated remaining: 4h 29m 39s. Rate: 7.3 symbols/min [2025-10-07T17:56:07.052874] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-07T17:56:07.147399] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:56:07.163572] [DEBUG] [LOCAL ] CCIF: Loaded 15589 existing records from primary storage. [2025-10-07T17:56:07.163837] [INFO ] [MAIN ] CCIF: Loaded 15589 existing records. [2025-10-07T17:56:07.342515] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:56:07.342810] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-07T17:56:07.342869] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-07T17:56:07.343203] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-07T17:56:07.343265] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-07T17:56:07.657999] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T17:56:07.713690] [INFO ] [REMOTE ] CBZ: Full fetch complete (45739 records). [2025-10-07T17:56:07.732274] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-07T17:56:07.736310] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:56:07.852831] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-07T17:56:08.172023] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-07T17:56:08.172104] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-07T17:56:08.172746] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-07T17:56:08.172810] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-07T17:56:08.173762] [DEBUG] [LOCAL ] CBZ: Trimmed 45739 records to 33989 (keeping 200 days of data) [2025-10-07T17:56:08.374857] [DEBUG] [LOCAL ] CBZ: Primary data saved (33989 records). [2025-10-07T17:56:08.375001] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-07T17:56:08.375086] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBZ took 34.7s. Estimated remaining: 4h 28m 58s. Rate: 7.3 symbols/min [2025-10-07T17:56:08.560237] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:56:08.623094] [DEBUG] [LOCAL ] CCJ: Loaded 53677 existing records from primary storage. [2025-10-07T17:56:08.623578] [INFO ] [MAIN ] CCJ: Loaded 53677 existing records. [2025-10-07T17:56:08.648265] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-07T17:56:08.845986] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T17:56:08.845466] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:56:08.850333] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-07T17:56:08.850602] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-07T17:56:08.852309] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-07T17:56:08.852373] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-07T17:56:09.078603] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T17:56:09.173346] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-07T17:56:09.265741] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:56:09.447676] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-07T17:56:10.247713] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-07T17:56:11.047745] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-07T17:56:11.139165] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T17:56:11.333748] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-07T17:56:11.336109] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T17:56:11.847674] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-07T17:56:12.647745] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-07T17:56:12.669752] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T17:56:13.447716] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-07T17:56:14.252023] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-07T17:56:14.258029] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T17:56:14.957340] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-07T17:56:15.047676] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-07T17:56:15.376244] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T17:56:15.391356] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-07T17:56:15.847748] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-07T17:56:16.647694] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-07T17:56:17.180578] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T17:56:17.447634] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-07T17:56:17.529496] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T17:56:17.886279] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-07T17:56:18.247693] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-07T17:56:19.047740] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-07T17:56:19.343160] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T17:56:19.379345] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-07T17:56:19.847700] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-07T17:56:20.647741] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-07T17:56:20.998473] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-07T17:56:21.388440] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:56:21.447635] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-07T17:56:22.247693] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-07T17:56:23.047711] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-07T17:56:23.275557] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T17:56:23.327257] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-07T17:56:23.847715] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-07T17:56:24.335103] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-07T17:56:24.367741] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-07T17:56:24.647677] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-07T17:56:25.318607] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T17:56:25.447685] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-07T17:56:25.954738] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T17:56:25.955710] [INFO ] [REMOTE ] CCIA: Full fetch complete (2103 records). [2025-10-07T17:56:25.955787] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-07T17:56:26.147147] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T17:56:26.147370] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T17:56:26.147425] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T17:56:26.147489] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-07T17:56:26.147553] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-07T17:56:26.147595] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-07T17:56:26.147665] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-07T17:56:26.147747] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CCIA took 21.4s. Estimated remaining: 4h 29m 35s. Rate: 7.3 symbols/min [2025-10-07T17:56:26.252719] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-07T17:56:26.315352] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:56:26.372625] [DEBUG] [LOCAL ] CCK: Loaded 46259 existing records from primary storage. [2025-10-07T17:56:26.372974] [INFO ] [MAIN ] CCK: Loaded 46259 existing records. [2025-10-07T17:56:26.546680] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:56:26.546910] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-07T17:56:26.546966] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-07T17:56:26.548155] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-07T17:56:26.548221] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-07T17:56:26.899019] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:56:27.047623] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-07T17:56:27.847619] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-07T17:56:28.017082] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T17:56:28.647725] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-07T17:56:28.786704] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T17:56:29.447635] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-07T17:56:29.605502] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-07T17:56:30.247607] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-07T17:56:30.376850] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T17:56:30.745564] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T17:56:31.047674] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-07T17:56:31.847631] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-07T17:56:32.230395] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T17:56:32.486852] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T17:56:32.647633] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-07T17:56:32.683717] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-07T17:56:33.447678] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-07T17:56:34.247718] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-07T17:56:34.558502] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T17:56:35.005047] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-07T17:56:35.047615] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-07T17:56:35.832417] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T17:56:35.836126] [INFO ] [REMOTE ] CCI: Full fetch complete (76992 records). [2025-10-07T17:56:35.836274] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-07T17:56:35.857749] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-07T17:56:36.249756] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-07T17:56:36.249899] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-07T17:56:36.250945] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-07T17:56:36.251043] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-07T17:56:36.255798] [DEBUG] [LOCAL ] CCI: Trimmed 76992 records to 53138 (keeping 200 days of data) [2025-10-07T17:56:36.620774] [DEBUG] [LOCAL ] CCI: Primary data saved (53138 records). [2025-10-07T17:56:36.620925] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-07T17:56:36.622178] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCI took 50.6s. Estimated remaining: 4h 29m 38s. Rate: 7.3 symbols/min [2025-10-07T17:56:36.653363] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-07T17:56:36.802265] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:56:36.861028] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-07T17:56:36.861380] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-07T17:56:37.045129] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:56:37.056402] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-07T17:56:37.057107] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-07T17:56:37.057502] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T17:56:37.062434] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-07T17:56:37.062508] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-07T17:56:37.439503] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:56:37.452735] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-07T17:56:37.474657] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-07T17:56:38.255118] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-07T17:56:38.260778] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T17:56:39.042479] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T17:56:39.047595] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-07T17:56:39.544782] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T17:56:39.655570] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T17:56:39.656935] [INFO ] [REMOTE ] CCIF: Full fetch complete (21923 records). [2025-10-07T17:56:39.657025] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-07T17:56:39.852755] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-07T17:56:40.058045] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-07T17:56:40.058171] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-07T17:56:40.058673] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-07T17:56:40.058737] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-07T17:56:40.062056] [DEBUG] [LOCAL ] CCIF: Trimmed 21923 records to 15588 (keeping 200 days of data) [2025-10-07T17:56:40.153856] [DEBUG] [LOCAL ] CCIF: Primary data saved (15588 records). [2025-10-07T17:56:40.154010] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-07T17:56:40.154098] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIF took 33.2s. Estimated remaining: 4h 29m 7s. Rate: 7.3 symbols/min [2025-10-07T17:56:40.320111] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:56:40.362847] [DEBUG] [LOCAL ] CCO: Loaded 47991 existing records from primary storage. [2025-10-07T17:56:40.363174] [INFO ] [MAIN ] CCO: Loaded 47991 existing records. [2025-10-07T17:56:40.537431] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:56:40.537668] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-07T17:56:40.537730] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-07T17:56:40.537965] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-07T17:56:40.538023] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-07T17:56:40.652803] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-07T17:56:40.895433] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:56:41.447729] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-07T17:56:41.672791] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T17:56:42.247708] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-07T17:56:42.967098] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-07T17:56:43.047672] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-07T17:56:43.620620] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-07T17:56:43.654777] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T17:56:43.847732] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-07T17:56:44.647633] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-07T17:56:45.080502] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-07T17:56:45.441611] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T17:56:45.451055] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-07T17:56:46.247686] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-07T17:56:46.552047] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T17:56:46.849613] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-07T17:56:47.047671] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-07T17:56:47.847765] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-07T17:56:48.531497] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-07T17:56:48.592248] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:56:48.647612] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-07T17:56:48.781702] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-07T17:56:49.447678] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-07T17:56:50.027841] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T17:56:50.247687] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-07T17:56:50.947945] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T17:56:51.047691] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-07T17:56:51.847743] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-07T17:56:52.647624] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-07T17:56:52.714110] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-07T17:56:52.753210] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T17:56:53.285102] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T17:56:53.447665] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-07T17:56:54.247691] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-07T17:56:54.694124] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-07T17:56:54.697737] [INFO ] [REMOTE ] CCJ: Full fetch complete (77685 records). [2025-10-07T17:56:54.697857] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-07T17:56:55.059901] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-07T17:56:55.084367] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-07T17:56:55.085361] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-07T17:56:55.086297] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-07T17:56:55.086454] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-07T17:56:55.088137] [DEBUG] [LOCAL ] CCJ: Trimmed 77685 records to 53676 (keeping 200 days of data) [2025-10-07T17:56:55.414179] [DEBUG] [LOCAL ] CCJ: Primary data saved (53676 records). [2025-10-07T17:56:55.414383] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-07T17:56:55.414579] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCJ took 47.0s. Estimated remaining: 4h 29m 32s. Rate: 7.3 symbols/min [2025-10-07T17:56:55.584187] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:56:55.596466] [DEBUG] [LOCAL ] CCRD: Loaded 9159 existing records from primary storage. [2025-10-07T17:56:55.596710] [INFO ] [MAIN ] CCRD: Loaded 9159 existing records. [2025-10-07T17:56:55.780407] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:56:55.780808] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-07T17:56:55.780887] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-07T17:56:55.781308] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-07T17:56:55.781370] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-07T17:56:56.182620] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:56:56.183502] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-07T17:56:56.186993] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T17:56:56.231238] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-07T17:56:56.336992] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T17:56:56.647715] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-07T17:56:56.881503] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T17:56:57.447735] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-07T17:56:57.803552] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T17:56:57.806796] [INFO ] [REMOTE ] CCK: Full fetch complete (67612 records). [2025-10-07T17:56:57.806921] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-07T17:56:57.995418] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-07T17:56:58.211687] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-07T17:56:58.211802] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-07T17:56:58.212535] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-07T17:56:58.212589] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-07T17:56:58.216299] [DEBUG] [LOCAL ] CCK: Trimmed 67612 records to 46302 (keeping 200 days of data) [2025-10-07T17:56:58.284623] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-07T17:56:58.517008] [DEBUG] [LOCAL ] CCK: Primary data saved (46302 records). [2025-10-07T17:56:58.517144] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-07T17:56:58.517860] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCK took 32.4s. Estimated remaining: 4h 28m 59s. Rate: 7.3 symbols/min [2025-10-07T17:56:58.683478] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:56:58.683598] [DEBUG] [LOCAL ] CCS: No existing data file found in primary storage. [2025-10-07T17:56:58.683635] [WARN ] [MAIN ] CCS: No existing data found, performing full refresh instead. [2025-10-07T17:56:58.683763] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-07T17:56:58.683817] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-07T17:56:58.683884] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-10-07T17:56:58.683921] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-07T17:56:59.033055] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:56:59.047596] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-07T17:56:59.826809] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T17:56:59.847615] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-07T17:57:00.191489] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T17:57:00.647757] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-07T17:57:01.447733] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-07T17:57:01.510401] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T17:57:01.962136] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-07T17:57:02.065721] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T17:57:02.247721] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-07T17:57:03.047695] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-07T17:57:03.534485] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-07T17:57:03.847719] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-07T17:57:04.292955] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-07T17:57:04.313429] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-07T17:57:04.647683] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-07T17:57:05.447685] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-07T17:57:06.247719] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-07T17:57:07.052821] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-07T17:57:07.056367] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-07T17:57:07.097220] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T17:57:07.626962] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T17:57:07.700913] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T17:57:07.847714] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-07T17:57:08.647732] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-07T17:57:09.447728] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-07T17:57:10.172916] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-07T17:57:10.247619] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-07T17:57:10.356251] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T17:57:10.853086] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T17:57:11.047702] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-07T17:57:11.847704] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-07T17:57:12.164034] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T17:57:12.295665] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T17:57:12.299159] [INFO ] [REMOTE ] CCO: Full fetch complete (66846 records). [2025-10-07T17:57:12.299278] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-07T17:57:12.656002] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-07T17:57:12.696839] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-07T17:57:12.696923] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-07T17:57:12.697639] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-07T17:57:12.697733] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-07T17:57:12.699072] [DEBUG] [LOCAL ] CCO: Trimmed 66846 records to 48007 (keeping 200 days of data) [2025-10-07T17:57:12.988299] [DEBUG] [LOCAL ] CCO: Primary data saved (48007 records). [2025-10-07T17:57:12.988490] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-07T17:57:12.988626] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCO took 32.8s. Estimated remaining: 4h 29m 20s. Rate: 7.3 symbols/min [2025-10-07T17:57:13.169822] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:57:13.170243] [DEBUG] [LOCAL ] CCU: No existing data file found in primary storage. [2025-10-07T17:57:13.170385] [WARN ] [MAIN ] CCU: No existing data found, performing full refresh instead. [2025-10-07T17:57:13.170561] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-07T17:57:13.170633] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-07T17:57:13.170741] [DEBUG] [LOCAL ] CCU: No primary data file found to delete. [2025-10-07T17:57:13.170888] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-07T17:57:13.461012] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-07T17:57:13.516826] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T17:57:13.578731] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:57:13.633819] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T17:57:14.247740] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-07T17:57:15.047702] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-07T17:57:15.412146] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T17:57:15.848428] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-07T17:57:15.850833] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-07T17:57:15.861692] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-07T17:57:15.863895] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-07T17:57:15.877501] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T17:57:16.272944] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-07T17:57:16.273037] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-07T17:57:16.273884] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-07T17:57:16.273949] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-07T17:57:16.275434] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-10-07T17:57:16.605063] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-07T17:57:16.605203] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-07T17:57:16.606169] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCL took 40.0s. Estimated remaining: 4h 28m 50s. Rate: 7.3 symbols/min [2025-10-07T17:57:16.659563] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-07T17:57:16.781253] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:57:16.781455] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-07T17:57:16.781495] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-07T17:57:16.781602] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-07T17:57:16.781665] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-07T17:57:16.781733] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-07T17:57:16.781767] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-07T17:57:17.133311] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:57:17.327168] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T17:57:17.447601] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-07T17:57:17.717742] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T17:57:18.247715] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-07T17:57:18.665726] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T17:57:19.047677] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-07T17:57:19.325408] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T17:57:19.847708] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-07T17:57:20.007560] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T17:57:20.647635] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-07T17:57:21.096442] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T17:57:21.385594] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T17:57:21.447731] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-07T17:57:22.247703] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-07T17:57:22.300613] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-07T17:57:23.047695] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-07T17:57:23.711000] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T17:57:23.847702] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-07T17:57:23.941024] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T17:57:24.183384] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-07T17:57:24.647639] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-07T17:57:24.920895] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-07T17:57:25.447692] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-07T17:57:26.247670] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-07T17:57:26.627608] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T17:57:27.047637] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-07T17:57:27.195828] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T17:57:27.662351] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T17:57:27.664335] [INFO ] [REMOTE ] CCRD: Full fetch complete (11865 records). [2025-10-07T17:57:27.664573] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-07T17:57:27.852164] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-07T17:57:28.070469] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-07T17:57:28.070585] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-07T17:57:28.071066] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-07T17:57:28.071140] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-07T17:57:28.071704] [DEBUG] [LOCAL ] CCRD: Trimmed 11865 records to 9204 (keeping 200 days of data) [2025-10-07T17:57:28.133813] [DEBUG] [LOCAL ] CCRD: Primary data saved (9204 records). [2025-10-07T17:57:28.133965] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-07T17:57:28.134051] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCRD took 32.7s. Estimated remaining: 4h 28m 57s. Rate: 7.3 symbols/min [2025-10-07T17:57:28.332990] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:57:28.392415] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-07T17:57:28.392865] [INFO ] [MAIN ] CDE: Loaded 53642 existing records. [2025-10-07T17:57:28.619353] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:57:28.619669] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-07T17:57:28.619744] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-07T17:57:28.621381] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-07T17:57:28.621455] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-07T17:57:28.658142] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-07T17:57:28.938762] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-07T17:57:29.105361] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:57:29.399623] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T17:57:29.447686] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-07T17:57:30.247689] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-07T17:57:30.553358] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-07T17:57:30.572952] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T17:57:31.047685] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-07T17:57:31.847700] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-07T17:57:32.167004] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-07T17:57:32.647678] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-07T17:57:32.819132] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T17:57:33.447684] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-07T17:57:33.852633] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T17:57:33.854757] [INFO ] [REMOTE ] CCS: Full fetch complete (45042 records). [2025-10-07T17:57:33.854848] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-07T17:57:34.228810] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-07T17:57:34.228896] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-07T17:57:34.229498] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-07T17:57:34.229540] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-07T17:57:34.230537] [DEBUG] [LOCAL ] CCS: Trimmed 45042 records to 30314 (keeping 200 days of data) [2025-10-07T17:57:34.284095] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-07T17:57:34.420905] [DEBUG] [LOCAL ] CCS: Primary data saved (30314 records). [2025-10-07T17:57:34.421056] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-07T17:57:34.421156] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCS took 35.9s. Estimated remaining: 4h 28m 40s. Rate: 7.3 symbols/min [2025-10-07T17:57:34.588888] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:57:34.599583] [DEBUG] [LOCAL ] CDLR: Loaded 9885 existing records from primary storage. [2025-10-07T17:57:34.599856] [INFO ] [MAIN ] CDLR: Loaded 9885 existing records. [2025-10-07T17:57:34.688299] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-07T17:57:34.790259] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:57:34.790557] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-07T17:57:34.790610] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-07T17:57:34.791027] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-07T17:57:34.791089] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-07T17:57:35.058057] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-07T17:57:35.191964] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:57:35.220736] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T17:57:35.847745] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-07T17:57:36.183622] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T17:57:36.628715] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T17:57:36.647604] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-07T17:57:37.148944] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-07T17:57:37.447675] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-07T17:57:37.667761] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:57:37.668058] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-07T17:57:37.668171] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:57:37.668258] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-07T17:57:37.668317] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:57:37.668384] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-07T17:57:37.668468] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-07T17:57:37.668528] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-07T17:57:37.668590] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-07T17:57:37.668685] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCZ took 21.1s. Estimated remaining: 4h 28m 8s. Rate: 7.3 symbols/min [2025-10-07T17:57:37.850074] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:57:37.905033] [DEBUG] [LOCAL ] CDP: Loaded 42655 existing records from primary storage. [2025-10-07T17:57:37.905443] [INFO ] [MAIN ] CDP: Loaded 42655 existing records. [2025-10-07T17:57:38.115300] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:57:38.115533] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-07T17:57:38.115599] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-07T17:57:38.117583] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-07T17:57:38.117687] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-07T17:57:38.252759] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-07T17:57:38.501003] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:57:39.047691] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-07T17:57:39.847638] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-07T17:57:40.086306] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T17:57:40.242003] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T17:57:40.492288] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T17:57:40.647693] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-07T17:57:41.447697] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-07T17:57:42.082503] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T17:57:42.247617] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-07T17:57:42.325871] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T17:57:42.327750] [INFO ] [REMOTE ] CCU: Full fetch complete (32611 records). [2025-10-07T17:57:42.327840] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-07T17:57:42.722326] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-07T17:57:42.722465] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-07T17:57:42.723229] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-07T17:57:42.723299] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-07T17:57:42.724365] [DEBUG] [LOCAL ] CCU: Trimmed 32611 records to 22981 (keeping 200 days of data) [2025-10-07T17:57:42.872927] [DEBUG] [LOCAL ] CCU: Primary data saved (22981 records). [2025-10-07T17:57:42.873118] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-07T17:57:42.873252] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCU took 29.9s. Estimated remaining: 4h 27m 46s. Rate: 7.3 symbols/min [2025-10-07T17:57:43.049800] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:57:43.049950] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-07T17:57:43.078395] [DEBUG] [LOCAL ] CDRE: Loaded 24654 existing records from primary storage. [2025-10-07T17:57:43.078792] [INFO ] [MAIN ] CDRE: Loaded 24654 existing records. [2025-10-07T17:57:43.267958] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:57:43.268614] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-07T17:57:43.268842] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-07T17:57:43.269808] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-07T17:57:43.269877] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-07T17:57:43.691103] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:57:43.740069] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T17:57:43.847615] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-07T17:57:44.647717] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-07T17:57:45.116464] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-07T17:57:45.384696] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T17:57:45.447703] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-07T17:57:45.622484] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T17:57:46.247745] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-07T17:57:46.920429] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T17:57:47.047688] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-07T17:57:47.563839] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T17:57:47.847679] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-07T17:57:48.647626] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-07T17:57:48.797627] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T17:57:48.897985] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T17:57:49.447616] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-07T17:57:50.238286] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T17:57:50.247596] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-07T17:57:50.431829] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T17:57:50.779336] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-07T17:57:51.047712] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-07T17:57:51.847686] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-07T17:57:52.547755] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-07T17:57:52.647683] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-07T17:57:52.932767] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T17:57:53.319030] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-07T17:57:53.447742] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-07T17:57:54.247610] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-07T17:57:54.393870] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T17:57:55.047691] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-07T17:57:55.739279] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T17:57:55.803426] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T17:57:55.847617] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-07T17:57:56.295444] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T17:57:56.647709] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-07T17:57:57.447692] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-07T17:57:57.792777] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T17:57:58.247744] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-07T17:57:58.680364] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T17:57:59.047678] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-07T17:57:59.069317] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T17:57:59.070992] [INFO ] [REMOTE ] CDLR: Full fetch complete (13530 records). [2025-10-07T17:57:59.071070] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-07T17:57:59.476240] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-07T17:57:59.476321] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-07T17:57:59.476638] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-07T17:57:59.476720] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-07T17:57:59.477189] [DEBUG] [LOCAL ] CDLR: Trimmed 13530 records to 9880 (keeping 200 days of data) [2025-10-07T17:57:59.535380] [DEBUG] [LOCAL ] CDLR: Primary data saved (9880 records). [2025-10-07T17:57:59.535531] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-07T17:57:59.535613] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDLR took 25.1s. Estimated remaining: 4h 28m 17s. Rate: 7.3 symbols/min [2025-10-07T17:57:59.707597] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:57:59.764604] [DEBUG] [LOCAL ] CE: Loaded 51474 existing records from primary storage. [2025-10-07T17:57:59.764957] [INFO ] [MAIN ] CE: Loaded 51474 existing records. [2025-10-07T17:57:59.852944] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-07T17:57:59.949216] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:57:59.955421] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-07T17:57:59.964164] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-07T17:57:59.965310] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T17:57:59.971914] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-07T17:57:59.972030] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-07T17:58:00.325714] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:58:00.647621] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-07T17:58:01.447734] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-07T17:58:01.837596] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T17:58:02.247741] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-07T17:58:02.606801] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T17:58:02.762467] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T17:58:03.047752] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-07T17:58:03.847731] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-07T17:58:04.059946] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T17:58:04.061109] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T17:58:04.647703] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-07T17:58:05.447743] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-07T17:58:05.517189] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T17:58:06.247613] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-07T17:58:06.558505] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T17:58:06.724810] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-07T17:58:07.047674] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-07T17:58:07.830039] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T17:58:07.847592] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-07T17:58:08.647688] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-07T17:58:08.793577] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T17:58:09.348056] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T17:58:09.447623] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-07T17:58:09.678718] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T17:58:10.247736] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-07T17:58:10.982968] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T17:58:10.986070] [INFO ] [REMOTE ] CDP: Full fetch complete (61839 records). [2025-10-07T17:58:10.986190] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-07T17:58:11.050683] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-07T17:58:11.390814] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-07T17:58:11.396108] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-07T17:58:11.405096] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-07T17:58:11.406202] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T17:58:11.405708] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-07T17:58:11.412623] [DEBUG] [LOCAL ] CDP: Trimmed 61839 records to 42619 (keeping 200 days of data) [2025-10-07T17:58:11.679967] [DEBUG] [LOCAL ] CDP: Primary data saved (42619 records). [2025-10-07T17:58:11.680136] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-07T17:58:11.681196] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDP took 34.0s. Estimated remaining: 4h 28m 26s. Rate: 7.3 symbols/min [2025-10-07T17:58:11.848034] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:58:11.848168] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-07T17:58:11.857639] [DEBUG] [LOCAL ] CEE: Loaded 5673 existing records from primary storage. [2025-10-07T17:58:11.857880] [INFO ] [MAIN ] CEE: Loaded 5673 existing records. [2025-10-07T17:58:12.034764] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:58:12.034965] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-07T17:58:12.035012] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-07T17:58:12.035357] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-07T17:58:12.035415] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-07T17:58:12.384507] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:58:12.647624] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-07T17:58:12.742084] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T17:58:13.447627] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-07T17:58:13.596884] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T17:58:13.602292] [INFO ] [REMOTE ] CDRE: Full fetch complete (35127 records). [2025-10-07T17:58:13.602406] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-07T17:58:13.996857] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-07T17:58:13.997040] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-07T17:58:13.997874] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-07T17:58:13.997977] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-07T17:58:13.999508] [DEBUG] [LOCAL ] CDRE: Trimmed 35127 records to 24694 (keeping 200 days of data) [2025-10-07T17:58:14.131057] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-07T17:58:14.206323] [DEBUG] [LOCAL ] CDRE: Primary data saved (24694 records). [2025-10-07T17:58:14.206536] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-07T17:58:14.206685] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDRE took 31.3s. Estimated remaining: 4h 27m 52s. Rate: 7.3 symbols/min [2025-10-07T17:58:14.252956] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-07T17:58:14.390192] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:58:14.419635] [DEBUG] [LOCAL ] CEPU: Loaded 26006 existing records from primary storage. [2025-10-07T17:58:14.419980] [INFO ] [MAIN ] CEPU: Loaded 26006 existing records. [2025-10-07T17:58:14.593617] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:58:14.593879] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-07T17:58:14.593926] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-07T17:58:14.594639] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-07T17:58:14.594735] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-07T17:58:14.956999] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:58:15.019535] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T17:58:15.047670] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-07T17:58:15.383595] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T17:58:15.681321] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T17:58:15.847705] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-07T17:58:16.647692] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-07T17:58:17.447630] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-07T17:58:17.647610] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T17:58:17.939245] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-07T17:58:17.943781] [INFO ] [REMOTE ] CDE: Full fetch complete (77591 records). [2025-10-07T17:58:17.943951] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-07T17:58:18.254216] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-07T17:58:18.363455] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-07T17:58:18.363554] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-07T17:58:18.364437] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-07T17:58:18.364511] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-07T17:58:18.366133] [DEBUG] [LOCAL ] CDE: Trimmed 77591 records to 53642 (keeping 200 days of data) [2025-10-07T17:58:18.690883] [DEBUG] [LOCAL ] CDE: Primary data saved (53642 records). [2025-10-07T17:58:18.691044] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-07T17:58:18.691204] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDE took 50.6s. Estimated remaining: 4h 27m 26s. Rate: 7.3 symbols/min [2025-10-07T17:58:18.864113] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:58:18.923870] [DEBUG] [LOCAL ] CF: Loaded 52167 existing records from primary storage. [2025-10-07T17:58:18.941851] [INFO ] [MAIN ] CF: Loaded 52167 existing records. [2025-10-07T17:58:18.943475] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T17:58:19.052753] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-07T17:58:19.075363] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T17:58:19.161192] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:58:19.161426] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-07T17:58:19.161475] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-07T17:58:19.163115] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-07T17:58:19.163179] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-07T17:58:19.519442] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:58:19.847717] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-07T17:58:20.380246] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T17:58:20.647732] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-07T17:58:21.447710] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-07T17:58:21.678619] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T17:58:21.727499] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T17:58:22.247694] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-07T17:58:23.047672] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-07T17:58:23.383819] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T17:58:23.751338] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T17:58:23.847635] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-07T17:58:24.000369] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T17:58:24.647681] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-07T17:58:25.399838] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T17:58:25.447608] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-07T17:58:25.885530] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T17:58:26.247706] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-07T17:58:27.047672] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-07T17:58:27.082308] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T17:58:27.452886] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T17:58:27.847632] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-07T17:58:28.487678] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T17:58:28.647625] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-07T17:58:28.685501] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T17:58:29.447678] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-07T17:58:29.962332] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T17:58:30.247709] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-07T17:58:31.007010] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T17:58:31.047639] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-07T17:58:31.297509] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T17:58:31.637428] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T17:58:31.847684] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-07T17:58:32.647636] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-07T17:58:32.890869] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T17:58:33.404211] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T17:58:33.447632] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-07T17:58:34.247630] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-07T17:58:34.618244] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T17:58:35.047678] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-07T17:58:35.847635] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-07T17:58:36.092925] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T17:58:36.349490] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-07T17:58:36.647638] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-07T17:58:36.899250] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T17:58:37.447629] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-07T17:58:37.502673] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T17:58:37.948276] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T17:58:37.949156] [INFO ] [REMOTE ] CEE: Full fetch complete (10159 records). [2025-10-07T17:58:37.949233] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-07T17:58:38.252749] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-07T17:58:38.351032] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-07T17:58:38.351116] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-07T17:58:38.351375] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-07T17:58:38.351417] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-07T17:58:38.351931] [DEBUG] [LOCAL ] CEE: Trimmed 10159 records to 5637 (keeping 200 days of data) [2025-10-07T17:58:38.388031] [DEBUG] [LOCAL ] CEE: Primary data saved (5637 records). [2025-10-07T17:58:38.388203] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-07T17:58:38.388300] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CEE took 26.7s. Estimated remaining: 4h 28m 10s. Rate: 7.3 symbols/min [2025-10-07T17:58:38.555173] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:58:38.607189] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-07T17:58:38.607560] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-10-07T17:58:38.786270] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:58:38.787788] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-07T17:58:38.787849] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-07T17:58:38.788554] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-07T17:58:38.788613] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-07T17:58:39.052793] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-07T17:58:39.143086] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:58:39.600590] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T17:58:39.847665] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-07T17:58:40.647618] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-07T17:58:40.767830] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T17:58:41.252347] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T17:58:41.447739] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-07T17:58:41.946880] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T17:58:41.950320] [INFO ] [REMOTE ] CEPU: Full fetch complete (39387 records). [2025-10-07T17:58:41.950497] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-07T17:58:42.257816] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-07T17:58:42.413623] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-07T17:58:42.413732] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-07T17:58:42.414287] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-07T17:58:42.414332] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-07T17:58:42.415210] [DEBUG] [LOCAL ] CEPU: Trimmed 39387 records to 25974 (keeping 200 days of data) [2025-10-07T17:58:42.565494] [DEBUG] [LOCAL ] CEPU: Primary data saved (25974 records). [2025-10-07T17:58:42.565629] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-07T17:58:42.565749] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CEPU took 28.4s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-07T17:58:42.741585] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:58:42.741792] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-07T17:58:42.741843] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-07T17:58:42.741953] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-07T17:58:42.741994] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-07T17:58:42.742035] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-07T17:58:42.742067] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-07T17:58:43.061701] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-07T17:58:43.105012] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:58:43.275925] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T17:58:43.847696] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-07T17:58:44.036994] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T17:58:44.037345] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-07T17:58:44.037479] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T17:58:44.037577] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-07T17:58:44.037694] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T17:58:44.037794] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-07T17:58:44.037879] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-07T17:58:44.037919] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-07T17:58:44.038018] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-07T17:58:44.038154] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CFND took 1.5s. Estimated remaining: 4h 27m 4s. Rate: 7.3 symbols/min [2025-10-07T17:58:44.209463] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:58:44.209770] [DEBUG] [LOCAL ] CFR: No existing data file found in primary storage. [2025-10-07T17:58:44.227027] [WARN ] [MAIN ] CFR: No existing data found, performing full refresh instead. [2025-10-07T17:58:44.243709] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-07T17:58:44.244002] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-07T17:58:44.244547] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-07T17:58:44.246378] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-07T17:58:44.246284] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T17:58:44.618852] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:58:44.647606] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-07T17:58:44.835434] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T17:58:45.447762] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-07T17:58:45.983612] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T17:58:46.247715] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-07T17:58:47.026625] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T17:58:47.030177] [INFO ] [REMOTE ] CE: Full fetch complete (74808 records). [2025-10-07T17:58:47.030317] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-07T17:58:47.052822] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-07T17:58:47.436366] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-07T17:58:47.436454] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-07T17:58:47.437354] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-07T17:58:47.437422] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-07T17:58:47.439055] [DEBUG] [LOCAL ] CE: Trimmed 74808 records to 51475 (keeping 200 days of data) [2025-10-07T17:58:47.765415] [DEBUG] [LOCAL ] CE: Primary data saved (51475 records). [2025-10-07T17:58:47.765558] [INFO ] [MAIN ] CE: Full history saved. [2025-10-07T17:58:47.766367] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CE took 48.2s. Estimated remaining: 4h 26m 36s. Rate: 7.3 symbols/min [2025-10-07T17:58:47.863385] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-07T17:58:47.940034] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:58:47.972446] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T17:58:48.017583] [DEBUG] [LOCAL ] CGAU: Loaded 42926 existing records from primary storage. [2025-10-07T17:58:48.017915] [INFO ] [MAIN ] CGAU: Loaded 42926 existing records. [2025-10-07T17:58:48.196117] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:58:48.196479] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-07T17:58:48.196548] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-07T17:58:48.197756] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-07T17:58:48.197816] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-07T17:58:48.544319] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:58:48.647675] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-07T17:58:49.066198] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T17:58:49.328454] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T17:58:49.447638] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-07T17:58:50.247751] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-07T17:58:50.300766] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T17:58:50.854964] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T17:58:51.047714] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-07T17:58:51.847691] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-07T17:58:51.885413] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T17:58:52.345748] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T17:58:52.647794] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-07T17:58:53.248969] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T17:58:53.447712] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-07T17:58:53.956687] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T17:58:54.247701] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-07T17:58:55.047630] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-07T17:58:55.418537] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T17:58:55.847775] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-07T17:58:55.973883] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T17:58:56.509243] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T17:58:56.647751] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-07T17:58:57.447665] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-07T17:58:57.670760] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T17:58:58.191159] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T17:58:58.247751] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-07T17:58:59.047673] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-07T17:58:59.181490] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T17:58:59.185483] [INFO ] [REMOTE ] CF: Full fetch complete (75297 records). [2025-10-07T17:58:59.185619] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-07T17:58:59.584700] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-07T17:58:59.584941] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-07T17:58:59.585896] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-07T17:58:59.585999] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-07T17:58:59.587741] [DEBUG] [LOCAL ] CF: Trimmed 75297 records to 52174 (keeping 200 days of data) [2025-10-07T17:58:59.832011] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T17:58:59.848693] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-07T17:58:59.947705] [DEBUG] [LOCAL ] CF: Primary data saved (52174 records). [2025-10-07T17:58:59.947859] [INFO ] [MAIN ] CF: Full history saved. [2025-10-07T17:58:59.947970] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CF took 41.3s. Estimated remaining: 4h 26m 45s. Rate: 7.3 symbols/min [2025-10-07T17:59:00.118703] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:59:00.122059] [DEBUG] [LOCAL ] CGV: Loaded 1391 existing records from primary storage. [2025-10-07T17:59:00.122267] [INFO ] [MAIN ] CGV: Loaded 1391 existing records. [2025-10-07T17:59:00.292704] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:59:00.292935] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-07T17:59:00.293006] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-07T17:59:00.293247] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-07T17:59:00.293304] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-07T17:59:00.636601] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:59:00.647598] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-07T17:59:00.996586] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T17:59:01.265848] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T17:59:01.344321] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T17:59:01.447603] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-07T17:59:02.247753] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-07T17:59:02.725059] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T17:59:03.047682] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-07T17:59:03.529576] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-07T17:59:03.847690] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-07T17:59:04.194858] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T17:59:04.266465] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T17:59:04.647677] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-07T17:59:05.447722] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-07T17:59:06.090518] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T17:59:06.247736] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-07T17:59:07.047731] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-07T17:59:07.467880] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-07T17:59:07.477804] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T17:59:07.683686] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T17:59:07.847663] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-07T17:59:08.647720] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-07T17:59:09.071558] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-07T17:59:09.453992] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-07T17:59:09.473503] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T17:59:10.247699] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-07T17:59:11.018632] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T17:59:11.047604] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-07T17:59:11.847622] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-07T17:59:12.030154] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T17:59:12.423307] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-07T17:59:12.602763] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T17:59:12.647620] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-07T17:59:13.447753] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-07T17:59:14.131719] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T17:59:14.247728] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-07T17:59:14.815570] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T17:59:15.047692] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-07T17:59:15.383571] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-07T17:59:15.847631] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-07T17:59:15.994863] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T17:59:16.150685] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-07T17:59:16.647749] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-07T17:59:17.094755] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T17:59:17.447690] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-07T17:59:17.852310] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-07T17:59:18.247691] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-07T17:59:18.556202] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-07T17:59:19.047717] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-07T17:59:19.433477] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T17:59:19.434230] [INFO ] [REMOTE ] CGV: Full fetch complete (2280 records). [2025-10-07T17:59:19.434300] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-07T17:59:19.789278] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-07T17:59:19.789367] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-07T17:59:19.789482] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-07T17:59:19.789520] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-07T17:59:19.789887] [DEBUG] [LOCAL ] CGV: Trimmed 2280 records to 1394 (keeping 200 days of data) [2025-10-07T17:59:19.799026] [DEBUG] [LOCAL ] CGV: Primary data saved (1394 records). [2025-10-07T17:59:19.799095] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-07T17:59:19.799164] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CGV took 19.9s. Estimated remaining: 4h 27m 29s. Rate: 7.3 symbols/min [2025-10-07T17:59:19.852796] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-07T17:59:19.974159] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:59:19.997998] [DEBUG] [LOCAL ] CHCT: Loaded 23818 existing records from primary storage. [2025-10-07T17:59:19.998293] [INFO ] [MAIN ] CHCT: Loaded 23818 existing records. [2025-10-07T17:59:20.171090] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:59:20.171331] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-07T17:59:20.171379] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-07T17:59:20.171621] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-07T17:59:20.171713] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-07T17:59:20.515213] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:59:20.647628] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-07T17:59:21.106547] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T17:59:21.109123] [INFO ] [REMOTE ] CFR: Full fetch complete (48382 records). [2025-10-07T17:59:21.109253] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-07T17:59:21.452751] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-07T17:59:21.570030] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-07T17:59:21.570125] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-07T17:59:21.570797] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-07T17:59:21.570862] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-07T17:59:21.572039] [DEBUG] [LOCAL ] CFR: Trimmed 48382 records to 33008 (keeping 200 days of data) [2025-10-07T17:59:21.818119] [DEBUG] [LOCAL ] CFR: Primary data saved (33008 records). [2025-10-07T17:59:21.818294] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-07T17:59:21.818379] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFR took 37.8s. Estimated remaining: 4h 26m 53s. Rate: 7.3 symbols/min [2025-10-07T17:59:22.015301] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:59:22.022714] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T17:59:22.082295] [DEBUG] [LOCAL ] CHD: Loaded 52192 existing records from primary storage. [2025-10-07T17:59:22.082675] [INFO ] [MAIN ] CHD: Loaded 52192 existing records. [2025-10-07T17:59:22.257142] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-07T17:59:22.265292] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:59:22.265596] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-07T17:59:22.265671] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-07T17:59:22.266097] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-07T17:59:22.266156] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-07T17:59:22.625753] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:59:23.047633] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-07T17:59:23.391409] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T17:59:23.848294] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-07T17:59:23.854508] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T17:59:23.858563] [INFO ] [REMOTE ] CGAU: Full fetch complete (61029 records). [2025-10-07T17:59:23.858691] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-07T17:59:24.245466] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-07T17:59:24.250829] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-07T17:59:24.259752] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-07T17:59:24.259833] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-07T17:59:24.261191] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T17:59:24.267851] [DEBUG] [LOCAL ] CGAU: Trimmed 61029 records to 43023 (keeping 200 days of data) [2025-10-07T17:59:24.526728] [DEBUG] [LOCAL ] CGAU: Primary data saved (43023 records). [2025-10-07T17:59:24.526863] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-07T17:59:24.527435] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CGAU took 36.8s. Estimated remaining: 4h 26m 20s. Rate: 7.3 symbols/min [2025-10-07T17:59:24.652945] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-07T17:59:24.701629] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:59:24.719040] [DEBUG] [LOCAL ] CHE: Loaded 15216 existing records from primary storage. [2025-10-07T17:59:24.719327] [INFO ] [MAIN ] CHE: Loaded 15216 existing records. [2025-10-07T17:59:24.892011] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:59:24.892224] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-07T17:59:24.892269] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-07T17:59:24.892533] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-07T17:59:24.892592] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-07T17:59:25.245031] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:59:25.352530] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T17:59:25.356388] [INFO ] [REMOTE ] CFG: Full fetch complete (77576 records). [2025-10-07T17:59:25.356510] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-07T17:59:25.453154] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-07T17:59:25.744576] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T17:59:25.773943] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-07T17:59:25.774018] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-07T17:59:25.774895] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-07T17:59:25.774968] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-07T17:59:25.776402] [DEBUG] [LOCAL ] CFG: Trimmed 77576 records to 53624 (keeping 200 days of data) [2025-10-07T17:59:26.116756] [DEBUG] [LOCAL ] CFG: Primary data saved (53624 records). [2025-10-07T17:59:26.116941] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-07T17:59:26.117727] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CFG took 47.7s. Estimated remaining: 4h 25m 42s. Rate: 7.3 symbols/min [2025-10-07T17:59:26.254396] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-07T17:59:26.289158] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:59:26.340001] [DEBUG] [LOCAL ] CHGG: Loaded 47811 existing records from primary storage. [2025-10-07T17:59:26.340386] [INFO ] [MAIN ] CHGG: Loaded 47811 existing records. [2025-10-07T17:59:26.470423] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T17:59:26.531831] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:59:26.532046] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-07T17:59:26.532096] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-07T17:59:26.532305] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-07T17:59:26.532363] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-07T17:59:26.887917] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:59:27.047746] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-07T17:59:27.847694] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-07T17:59:27.941247] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-07T17:59:27.999435] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T17:59:28.647710] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-07T17:59:29.447731] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-07T17:59:29.784380] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T17:59:30.192806] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T17:59:30.251993] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-07T17:59:30.259032] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T17:59:31.047635] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-07T17:59:31.176166] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T17:59:31.847684] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-07T17:59:32.647623] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-07T17:59:32.758989] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T17:59:32.806893] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T17:59:33.447738] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-07T17:59:33.906225] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T17:59:34.247743] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-07T17:59:34.883342] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T17:59:35.047698] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-07T17:59:35.434176] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T17:59:35.847690] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-07T17:59:36.064417] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T17:59:36.647614] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-07T17:59:36.923589] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T17:59:37.447622] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-07T17:59:37.753797] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T17:59:38.247695] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-07T17:59:39.047685] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-07T17:59:39.124751] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T17:59:39.170317] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T17:59:39.847747] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-07T17:59:40.647688] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-07T17:59:40.719966] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T17:59:40.837475] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T17:59:41.447680] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-07T17:59:42.247746] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-07T17:59:42.387394] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T17:59:42.399545] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T17:59:43.047778] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-07T17:59:43.331025] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T17:59:43.847675] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-07T17:59:43.966634] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T17:59:44.647696] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-07T17:59:45.447695] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-07T17:59:45.545574] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T17:59:45.591191] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T17:59:45.593171] [INFO ] [REMOTE ] CHE: Full fetch complete (20200 records). [2025-10-07T17:59:45.593308] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-07T17:59:45.982077] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-07T17:59:45.982157] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-07T17:59:45.982570] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-07T17:59:45.982616] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-07T17:59:45.983237] [DEBUG] [LOCAL ] CHE: Trimmed 20200 records to 15233 (keeping 200 days of data) [2025-10-07T17:59:46.079898] [DEBUG] [LOCAL ] CHE: Primary data saved (15233 records). [2025-10-07T17:59:46.080042] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-07T17:59:46.080126] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHE took 21.6s. Estimated remaining: 4h 26m 26s. Rate: 7.3 symbols/min [2025-10-07T17:59:46.256203] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-07T17:59:46.260574] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:59:46.261499] [DEBUG] [LOCAL ] CHH: No existing data file found in primary storage. [2025-10-07T17:59:46.261548] [WARN ] [MAIN ] CHH: No existing data found, performing full refresh instead. [2025-10-07T17:59:46.261719] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-07T17:59:46.261789] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-07T17:59:46.261833] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-10-07T17:59:46.261865] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-07T17:59:46.626723] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T17:59:47.047704] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-07T17:59:47.278675] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T17:59:47.645050] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T17:59:47.847724] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-07T17:59:48.647715] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-07T17:59:48.771910] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T17:59:49.447610] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-07T17:59:49.641278] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T17:59:49.895802] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T17:59:50.247732] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-07T17:59:50.542770] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T17:59:51.047706] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-07T17:59:51.847715] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-07T17:59:52.176089] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T17:59:52.492053] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T17:59:52.647686] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-07T17:59:53.447756] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-07T17:59:53.500224] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T17:59:54.247678] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-07T17:59:54.412981] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T17:59:54.571877] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T17:59:55.047684] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-07T17:59:55.329381] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T17:59:55.847734] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-07T17:59:56.583160] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T17:59:56.647614] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-07T17:59:57.274368] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T17:59:57.447717] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-07T17:59:57.969193] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T17:59:57.972561] [INFO ] [REMOTE ] CHGG: Full fetch complete (70458 records). [2025-10-07T17:59:57.972687] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-07T17:59:58.252835] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-07T17:59:58.358710] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-07T17:59:58.358801] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-07T17:59:58.359562] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-07T17:59:58.359605] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-07T17:59:58.360960] [DEBUG] [LOCAL ] CHGG: Trimmed 70458 records to 47825 (keeping 200 days of data) [2025-10-07T17:59:58.562598] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T17:59:58.566029] [INFO ] [REMOTE ] CHCT: Full fetch complete (34829 records). [2025-10-07T17:59:58.566720] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-07T17:59:58.955681] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-07T17:59:58.956070] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-07T17:59:58.956913] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-07T17:59:58.957276] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-07T17:59:58.960299] [DEBUG] [LOCAL ] CHCT: Trimmed 34829 records to 23845 (keeping 200 days of data) [2025-10-07T17:59:59.055199] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-07T17:59:59.130460] [DEBUG] [LOCAL ] CHGG: Primary data saved (47825 records). [2025-10-07T17:59:59.131109] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-07T17:59:59.132355] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHGG took 33.0s. Estimated remaining: 4h 26m 39s. Rate: 7.3 symbols/min [2025-10-07T17:59:59.309750] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:59:59.341452] [DEBUG] [LOCAL ] CHCT: Primary data saved (23845 records). [2025-10-07T17:59:59.341663] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-07T17:59:59.341774] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHCT took 39.5s. Estimated remaining: 4h 25m 55s. Rate: 7.3 symbols/min [2025-10-07T17:59:59.458307] [DEBUG] [LOCAL ] CHMI: Loaded 21649 existing records from primary storage. [2025-10-07T17:59:59.479467] [INFO ] [MAIN ] CHMI: Loaded 21649 existing records. [2025-10-07T17:59:59.585949] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T17:59:59.654550] [DEBUG] [LOCAL ] CHN: Loaded 4779 existing records from primary storage. [2025-10-07T17:59:59.677147] [INFO ] [MAIN ] CHN: Loaded 4779 existing records. [2025-10-07T17:59:59.727347] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T17:59:59.783699] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-07T17:59:59.783922] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-07T17:59:59.811029] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-07T17:59:59.811220] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-07T18:00:00.007979] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:00:00.019596] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-07T18:00:00.069129] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-07T18:00:00.124578] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-07T18:00:00.158596] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-07T18:00:00.396958] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:00:00.419562] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-07T18:00:00.593848] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-07T18:00:00.658895] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-07T18:00:00.787596] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:00:00.801785] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T18:00:01.447695] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-07T18:00:01.824376] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T18:00:02.220930] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T18:00:02.247600] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-07T18:00:02.522977] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T18:00:02.679662] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T18:00:03.047725] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-07T18:00:03.847704] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-07T18:00:04.234079] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T18:00:04.647711] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-07T18:00:05.315314] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T18:00:05.447623] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-07T18:00:05.773585] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T18:00:06.247743] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-07T18:00:06.727608] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T18:00:07.047723] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-07T18:00:07.847742] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-07T18:00:07.946144] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T18:00:08.207536] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T18:00:08.313101] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-07T18:00:08.647728] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-07T18:00:09.447705] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-07T18:00:09.934808] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T18:00:10.048573] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T18:00:10.247686] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-07T18:00:11.047709] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-07T18:00:11.622136] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-07T18:00:11.847716] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-07T18:00:12.254253] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T18:00:12.257413] [INFO ] [REMOTE ] CHD: Full fetch complete (74066 records). [2025-10-07T18:00:12.257558] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-07T18:00:12.258461] [FATAL] [VALIDATOR ] CHD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:00:12.258570] [FATAL] [MAIN ] CHD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:00:12.258668] [WARN ] [MAIN ] CHD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:00:12.258770] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-07T18:00:12.258867] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-10-07T18:00:12.258924] [INFO ] [LOCAL ] CHD: Starting deletion of derivative data. [2025-10-07T18:00:12.259240] [DEBUG] [LOCAL ] CHD: Deleted derivative data file. [2025-10-07T18:00:12.259337] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHD took 50.4s. Estimated remaining: 4h 26m 8s. Rate: 7.3 symbols/min [2025-10-07T18:00:12.647703] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-07T18:00:13.447748] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-07T18:00:13.466931] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-07T18:00:14.247736] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-07T18:00:14.799707] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T18:00:14.857865] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T18:00:15.047621] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-07T18:00:15.133893] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-10-07T18:00:15.643214] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T18:00:15.847721] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-07T18:00:16.647696] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-07T18:00:17.211014] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T18:00:17.259765] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T18:00:17.447670] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-07T18:00:18.247755] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-07T18:00:19.047768] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-07T18:00:19.301614] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:00:19.365746] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T18:00:19.786051] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T18:00:19.847688] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-07T18:00:20.647754] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-07T18:00:21.007589] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T18:00:21.011027] [INFO ] [REMOTE ] CHH: Full fetch complete (46940 records). [2025-10-07T18:00:21.011218] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-07T18:00:21.404233] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-07T18:00:21.404321] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-07T18:00:21.404967] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-07T18:00:21.405032] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-07T18:00:21.406122] [DEBUG] [LOCAL ] CHH: Trimmed 46940 records to 32270 (keeping 200 days of data) [2025-10-07T18:00:21.461422] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-07T18:00:21.614001] [DEBUG] [LOCAL ] CHH: Primary data saved (32270 records). [2025-10-07T18:00:21.614150] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-07T18:00:21.614229] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHH took 35.5s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-07T18:00:21.725928] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T18:00:22.099943] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-07T18:00:22.247711] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-07T18:00:23.047734] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-07T18:00:23.347101] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T18:00:23.555978] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T18:00:23.556888] [INFO ] [REMOTE ] CHN: Full fetch complete (7420 records). [2025-10-07T18:00:23.556958] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-07T18:00:23.860793] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-07T18:00:23.951194] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-07T18:00:23.951275] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-07T18:00:23.951485] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-07T18:00:23.951522] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-07T18:00:23.951942] [DEBUG] [LOCAL ] CHN: Trimmed 7420 records to 4770 (keeping 200 days of data) [2025-10-07T18:00:23.979969] [DEBUG] [LOCAL ] CHN: Primary data saved (4770 records). [2025-10-07T18:00:23.980074] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-07T18:00:23.980156] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 24.6s. Estimated remaining: 4h 25m 30s. Rate: 7.3 symbols/min [2025-10-07T18:00:24.843691] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T18:00:24.845495] [INFO ] [REMOTE ] CHMI: Full fetch complete (31853 records). [2025-10-07T18:00:24.845578] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-07T18:00:25.208682] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-07T18:00:25.208769] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-07T18:00:25.209313] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-07T18:00:25.209374] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-07T18:00:25.210547] [DEBUG] [LOCAL ] CHMI: Trimmed 31853 records to 21639 (keeping 200 days of data) [2025-10-07T18:00:25.336324] [DEBUG] [LOCAL ] CHMI: Primary data saved (21639 records). [2025-10-07T18:00:25.336458] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-07T18:00:25.336540] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 26.2s. Estimated remaining: 4h 24m 51s. Rate: 7.3 symbols/min [2025-10-07T18:00:25.916772] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:00:25.997823] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:00:26.001262] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:00:26.022547] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:00:26.038504] [DEBUG] [LOCAL ] CHT: Loaded 19553 existing records from primary storage. [2025-10-07T18:00:26.038843] [INFO ] [MAIN ] CHT: Loaded 19553 existing records. [2025-10-07T18:00:26.262013] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:00:26.275277] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-07T18:00:26.276555] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-07T18:00:26.277777] [DEBUG] [LOCAL ] CHPT: Loaded 48378 existing records from primary storage. [2025-10-07T18:00:26.278248] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-07T18:00:26.278469] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-07T18:00:26.278419] [INFO ] [MAIN ] CHPT: Loaded 48378 existing records. [2025-10-07T18:00:26.496275] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-07T18:00:26.484344] [DEBUG] [LOCAL ] CI: Loaded 49801 existing records from primary storage. [2025-10-07T18:00:26.516210] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-07T18:00:26.550696] [INFO ] [MAIN ] CI: Loaded 49801 existing records. [2025-10-07T18:00:26.786217] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:00:26.853420] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-07T18:00:26.964402] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-07T18:00:27.001229] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:00:27.010163] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-07T18:00:27.021420] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-07T18:00:27.010391] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-07T18:00:27.030892] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-07T18:00:27.072417] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-07T18:00:27.135542] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-07T18:00:27.224403] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:00:27.411721] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-07T18:00:27.426281] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-07T18:00:27.475687] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-07T18:00:27.475926] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-07T18:00:27.475581] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:00:27.500934] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-07T18:00:28.198156] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:00:28.225956] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-07T18:00:28.338249] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:00:28.341674] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-07T18:00:28.364613] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:00:28.365169] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-07T18:00:28.728230] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T18:00:28.732297] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-07T18:00:29.628254] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T18:00:29.632132] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-07T18:00:30.283897] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T18:00:30.295087] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-07T18:00:30.469022] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-07T18:00:30.480108] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-07T18:00:30.554530] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-07T18:00:30.687109] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T18:00:31.047688] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-07T18:00:31.772718] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T18:00:31.847626] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-07T18:00:32.431191] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T18:00:32.647681] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-07T18:00:33.283530] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-07T18:00:33.447635] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-07T18:00:33.591018] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T18:00:34.073812] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T18:00:34.247627] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-07T18:00:35.047620] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-07T18:00:35.431508] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-07T18:00:35.847672] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-07T18:00:35.953356] [DEBUG] [REMOTE ] CHPT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-07T18:00:35.953712] [WARN ] [REMOTE ] CHPT: No data returned for month 2025-03 [2025-10-07T18:00:35.953801] [FATAL] [REMOTE ] CHPT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:00:35.953880] [FATAL] [MAIN ] CHPT: Failed to fetch primary data. [2025-10-07T18:00:35.953940] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:00:35.954033] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-07T18:00:35.954145] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-07T18:00:35.954221] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-10-07T18:00:35.954576] [DEBUG] [LOCAL ] CHPT: Deleted derivative data file. [2025-10-07T18:00:35.954718] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHPT took 10.6s. Estimated remaining: 4h 24m 54s. Rate: 7.3 symbols/min [2025-10-07T18:00:36.131189] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:00:36.148089] [DEBUG] [LOCAL ] CIA: Loaded 16872 existing records from primary storage. [2025-10-07T18:00:36.148398] [INFO ] [MAIN ] CIA: Loaded 16872 existing records. [2025-10-07T18:00:36.346663] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:00:36.365791] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-07T18:00:36.365887] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-07T18:00:36.366501] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-07T18:00:36.367718] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-07T18:00:36.366564] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-07T18:00:36.648022] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-07T18:00:36.741961] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:00:36.946399] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T18:00:37.447615] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-07T18:00:37.741854] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T18:00:38.247688] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-07T18:00:38.414636] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T18:00:39.047674] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-07T18:00:39.369697] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T18:00:39.847629] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-07T18:00:39.981551] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T18:00:40.647669] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-07T18:00:41.447620] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-07T18:00:41.701247] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T18:00:41.725358] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T18:00:42.247744] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-07T18:00:43.047725] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-07T18:00:43.084488] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T18:00:43.245001] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T18:00:43.822703] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T18:00:43.847613] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-07T18:00:44.647632] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-07T18:00:45.447707] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-07T18:00:46.029487] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-07T18:00:46.247772] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-07T18:00:46.506452] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T18:00:46.583996] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T18:00:46.835862] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T18:00:47.047698] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-07T18:00:47.847704] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-07T18:00:48.647702] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-07T18:00:48.923201] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T18:00:49.113544] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-07T18:00:49.342855] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T18:00:49.447629] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-07T18:00:50.247617] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-07T18:00:50.596991] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T18:00:51.047711] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-07T18:00:51.847605] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-07T18:00:51.891975] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T18:00:52.187715] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T18:00:52.647718] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-07T18:00:53.447633] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-07T18:00:53.725518] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T18:00:53.815391] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T18:00:54.149398] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T18:00:54.152347] [INFO ] [REMOTE ] CHT: Full fetch complete (27594 records). [2025-10-07T18:00:54.152537] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-07T18:00:54.253011] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-07T18:00:54.617460] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-07T18:00:54.617562] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-07T18:00:54.618226] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-07T18:00:54.618289] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-07T18:00:54.619055] [DEBUG] [LOCAL ] CHT: Trimmed 27594 records to 19602 (keeping 200 days of data) [2025-10-07T18:00:54.737105] [DEBUG] [LOCAL ] CHT: Primary data saved (19602 records). [2025-10-07T18:00:54.737306] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-07T18:00:54.737398] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHT took 29.4s. Estimated remaining: 4h 25m 31s. Rate: 7.3 symbols/min [2025-10-07T18:00:54.901546] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:00:54.934336] [DEBUG] [LOCAL ] CIB: Loaded 30791 existing records from primary storage. [2025-10-07T18:00:54.934609] [INFO ] [MAIN ] CIB: Loaded 30791 existing records. [2025-10-07T18:00:55.052765] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-07T18:00:55.109266] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:00:55.109445] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-07T18:00:55.109490] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-07T18:00:55.109789] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-07T18:00:55.109848] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-07T18:00:55.460457] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:00:55.847606] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-07T18:00:55.955497] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T18:00:56.647624] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-07T18:00:56.886927] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T18:00:57.085775] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-07T18:00:57.447763] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-07T18:00:58.247706] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-07T18:00:58.548754] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T18:00:58.586898] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T18:00:59.047629] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-07T18:00:59.847734] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-07T18:01:00.357758] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T18:01:00.464050] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-07T18:01:00.599268] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T18:01:00.647626] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-07T18:01:01.447735] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-07T18:01:02.247748] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-07T18:01:02.717226] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-07T18:01:02.721464] [INFO ] [REMOTE ] CHWY: Full fetch complete (77632 records). [2025-10-07T18:01:02.721722] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-07T18:01:02.851083] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T18:01:03.052842] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-07T18:01:03.181624] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-07T18:01:03.181759] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-07T18:01:03.182618] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-07T18:01:03.182723] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-07T18:01:03.184802] [DEBUG] [LOCAL ] CHWY: Trimmed 77632 records to 53654 (keeping 200 days of data) [2025-10-07T18:01:03.526442] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-07T18:01:03.526782] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-07T18:01:03.527966] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHWY took 38.2s. Estimated remaining: 4h 25m 26s. Rate: 7.3 symbols/min [2025-10-07T18:01:03.730359] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:01:03.730690] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-07T18:01:03.730798] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-07T18:01:03.730999] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-07T18:01:03.731105] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-07T18:01:03.731300] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-07T18:01:03.731355] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-07T18:01:03.858753] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-07T18:01:03.937838] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T18:01:04.033937] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T18:01:04.059508] [INFO ] [REMOTE ] CIA: Full fetch complete (23521 records). [2025-10-07T18:01:04.062003] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-07T18:01:04.259520] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:01:04.544167] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-07T18:01:04.544257] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-07T18:01:04.544739] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-07T18:01:04.544818] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-07T18:01:04.545776] [DEBUG] [LOCAL ] CIA: Trimmed 23521 records to 16849 (keeping 200 days of data) [2025-10-07T18:01:04.641174] [DEBUG] [LOCAL ] CIA: Primary data saved (16849 records). [2025-10-07T18:01:04.641319] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-07T18:01:04.641404] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CIA took 28.7s. Estimated remaining: 4h 24m 46s. Rate: 7.3 symbols/min [2025-10-07T18:01:04.652978] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-07T18:01:04.815438] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:01:04.815681] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-07T18:01:04.815739] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-07T18:01:04.815855] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-07T18:01:04.815898] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-07T18:01:04.815964] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-07T18:01:04.815998] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-07T18:01:05.167591] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:01:05.310793] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T18:01:05.437779] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T18:01:05.447590] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-07T18:01:05.896701] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T18:01:06.247718] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-07T18:01:07.047694] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-07T18:01:07.847631] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-07T18:01:07.878195] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T18:01:08.647705] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-07T18:01:08.981301] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-07T18:01:09.447794] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-07T18:01:09.785226] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T18:01:09.816821] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T18:01:10.247747] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-07T18:01:10.507878] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-07T18:01:11.047694] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-07T18:01:11.384484] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-07T18:01:11.465257] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-07T18:01:11.847697] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-07T18:01:12.647684] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-07T18:01:13.096784] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-07T18:01:13.447699] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-07T18:01:13.531062] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T18:01:13.788402] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-07T18:01:14.247685] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-07T18:01:15.047730] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-07T18:01:15.847622] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-07T18:01:16.086717] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T18:01:16.145374] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T18:01:16.170558] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-07T18:01:16.173894] [INFO ] [REMOTE ] CI: Full fetch complete (72306 records). [2025-10-07T18:01:16.173993] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-07T18:01:16.558612] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-07T18:01:16.558716] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-07T18:01:16.559461] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-07T18:01:16.559503] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-07T18:01:16.561039] [DEBUG] [LOCAL ] CI: Trimmed 72306 records to 49809 (keeping 200 days of data) [2025-10-07T18:01:16.656987] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-07T18:01:16.880820] [DEBUG] [LOCAL ] CI: Primary data saved (49809 records). [2025-10-07T18:01:16.880957] [INFO ] [MAIN ] CI: Full history saved. [2025-10-07T18:01:16.882093] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CI took 51.5s. Estimated remaining: 4h 24m 55s. Rate: 7.3 symbols/min [2025-10-07T18:01:17.052206] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:01:17.061915] [DEBUG] [LOCAL ] CIF: Loaded 4156 existing records from primary storage. [2025-10-07T18:01:17.062143] [INFO ] [MAIN ] CIF: Loaded 4156 existing records. [2025-10-07T18:01:17.240825] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:01:17.241067] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-07T18:01:17.241151] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-07T18:01:17.241397] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-07T18:01:17.241467] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-07T18:01:17.456715] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-07T18:01:17.592245] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:01:18.247745] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-07T18:01:18.695457] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T18:01:18.796451] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T18:01:18.817743] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-07T18:01:19.047703] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-07T18:01:19.520418] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T18:01:19.847684] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-07T18:01:20.410591] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-07T18:01:20.647677] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-07T18:01:21.447697] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-07T18:01:22.096727] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T18:01:22.247676] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-07T18:01:22.825526] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T18:01:23.047626] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-07T18:01:23.201141] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T18:01:23.314839] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-07T18:01:23.847627] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-07T18:01:24.647699] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-07T18:01:25.447638] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-07T18:01:25.536073] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T18:01:25.824485] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T18:01:25.825308] [INFO ] [REMOTE ] CICB: Full fetch complete (2016 records). [2025-10-07T18:01:25.825381] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-07T18:01:26.016849] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-07T18:01:26.017104] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:01:26.017253] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:01:26.017474] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-07T18:01:26.017775] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-07T18:01:26.017868] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-07T18:01:26.018003] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-07T18:01:26.018127] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CICB took 22.5s. Estimated remaining: 4h 24m 51s. Rate: 7.3 symbols/min [2025-10-07T18:01:26.150564] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T18:01:26.221309] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:01:26.251921] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-07T18:01:26.274815] [DEBUG] [LOCAL ] CIG: Loaded 43776 existing records from primary storage. [2025-10-07T18:01:26.275437] [INFO ] [MAIN ] CIG: Loaded 43776 existing records. [2025-10-07T18:01:26.492052] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:01:26.492333] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-07T18:01:26.492428] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-07T18:01:26.492855] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-07T18:01:26.492926] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-07T18:01:26.782847] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-07T18:01:26.935794] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:01:27.047693] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-07T18:01:27.614685] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-07T18:01:27.847670] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-07T18:01:28.515070] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T18:01:28.647671] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-07T18:01:29.447702] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-07T18:01:30.247633] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-07T18:01:30.541211] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T18:01:30.610593] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T18:01:30.613464] [INFO ] [REMOTE ] CIB: Full fetch complete (44597 records). [2025-10-07T18:01:30.613559] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-07T18:01:31.013609] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-07T18:01:31.013756] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-07T18:01:31.014288] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-07T18:01:31.014347] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-07T18:01:31.015360] [DEBUG] [LOCAL ] CIB: Trimmed 44597 records to 30737 (keeping 200 days of data) [2025-10-07T18:01:31.065707] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-07T18:01:31.195456] [DEBUG] [LOCAL ] CIB: Primary data saved (30737 records). [2025-10-07T18:01:31.195603] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-07T18:01:31.195707] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 36.5s. Estimated remaining: 4h 24m 29s. Rate: 7.3 symbols/min [2025-10-07T18:01:31.365791] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:01:31.383429] [DEBUG] [LOCAL ] CII: Loaded 15166 existing records from primary storage. [2025-10-07T18:01:31.383694] [INFO ] [MAIN ] CII: Loaded 15166 existing records. [2025-10-07T18:01:31.526026] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T18:01:31.594757] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:01:31.594984] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-07T18:01:31.595043] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-07T18:01:31.595374] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-07T18:01:31.595439] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-07T18:01:31.853363] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-07T18:01:31.939831] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:01:32.473626] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T18:01:32.647687] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-07T18:01:33.447684] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-07T18:01:33.474599] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T18:01:33.706252] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T18:01:33.962624] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-07T18:01:34.247697] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-07T18:01:35.047738] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-07T18:01:35.710109] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-07T18:01:35.847680] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-07T18:01:36.344264] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-07T18:01:36.348425] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-07T18:01:36.647701] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-07T18:01:37.447707] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-07T18:01:38.091503] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T18:01:38.247702] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-07T18:01:38.360024] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T18:01:39.047729] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-07T18:01:39.847711] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-07T18:01:39.915987] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T18:01:40.034145] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T18:01:40.516376] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-07T18:01:40.647672] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-07T18:01:41.447619] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-07T18:01:41.502378] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T18:01:41.790236] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-07T18:01:42.247731] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-07T18:01:43.047694] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-07T18:01:43.847629] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-07T18:01:44.043941] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T18:01:44.047916] [INFO ] [REMOTE ] CIEN: Full fetch complete (75561 records). [2025-10-07T18:01:44.048118] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-07T18:01:44.365242] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-07T18:01:44.462150] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-07T18:01:44.462242] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-07T18:01:44.463174] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-07T18:01:44.463243] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-07T18:01:44.464842] [DEBUG] [LOCAL ] CIEN: Trimmed 75561 records to 52111 (keeping 200 days of data) [2025-10-07T18:01:44.673151] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-07T18:01:44.795180] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T18:01:44.815217] [DEBUG] [LOCAL ] CIEN: Primary data saved (52111 records). [2025-10-07T18:01:44.815327] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-07T18:01:44.815392] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIEN took 40.2s. Estimated remaining: 4h 24m 44s. Rate: 7.3 symbols/min [2025-10-07T18:01:44.982592] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:01:45.017901] [DEBUG] [LOCAL ] CIM: Loaded 37664 existing records from primary storage. [2025-10-07T18:01:45.018210] [INFO ] [MAIN ] CIM: Loaded 37664 existing records. [2025-10-07T18:01:45.142985] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T18:01:45.174696] [INFO ] [REMOTE ] CIF: Full fetch complete (6583 records). [2025-10-07T18:01:45.183346] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-07T18:01:45.192866] [FATAL] [VALIDATOR ] CIF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:01:45.196549] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:01:45.196605] [FATAL] [MAIN ] CIF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:01:45.196752] [WARN ] [MAIN ] CIF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:01:45.196982] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-07T18:01:45.197057] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-07T18:01:45.196870] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-07T18:01:45.197200] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-10-07T18:01:45.197254] [INFO ] [LOCAL ] CIF: Starting deletion of derivative data. [2025-10-07T18:01:45.197331] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-07T18:01:45.197387] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-07T18:01:45.228212] [DEBUG] [LOCAL ] CIF: Deleted derivative data file. [2025-10-07T18:01:45.239613] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIF took 28.4s. Estimated remaining: 4h 24m 2s. Rate: 7.3 symbols/min [2025-10-07T18:01:45.455309] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-07T18:01:45.567157] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:01:45.663729] [DEBUG] [LOCAL ] CIMN: Loaded 2736 existing records from primary storage. [2025-10-07T18:01:45.674418] [INFO ] [MAIN ] CIMN: Loaded 2736 existing records. [2025-10-07T18:01:45.852470] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:01:45.931231] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:01:45.931563] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-07T18:01:45.931670] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-07T18:01:45.931895] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-07T18:01:45.931968] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-07T18:01:46.255337] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-07T18:01:46.286808] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:01:46.855991] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T18:01:47.047619] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-07T18:01:47.847769] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-07T18:01:47.885984] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T18:01:48.094803] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T18:01:48.647745] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-07T18:01:48.913932] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T18:01:49.447708] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-07T18:01:49.914639] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-07T18:01:50.152381] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T18:01:50.247700] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-07T18:01:51.047682] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-07T18:01:51.845493] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T18:01:51.855990] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-07T18:01:51.877269] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-07T18:01:52.647679] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-07T18:01:53.412047] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T18:01:53.447634] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-07T18:01:53.709825] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T18:01:54.247787] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-07T18:01:54.725136] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-07T18:01:55.047617] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-07T18:01:55.157800] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T18:01:55.573770] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-07T18:01:55.847706] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-07T18:01:56.647632] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-07T18:01:56.877831] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T18:01:57.447722] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-07T18:01:58.159533] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T18:01:58.161138] [INFO ] [REMOTE ] CII: Full fetch complete (22990 records). [2025-10-07T18:01:58.161209] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-07T18:01:58.250254] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-07T18:01:58.361392] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T18:01:58.567153] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-07T18:01:58.567044] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-07T18:01:58.568560] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-07T18:01:58.569046] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-07T18:01:58.569108] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-07T18:01:58.569723] [DEBUG] [LOCAL ] CII: Trimmed 22990 records to 15178 (keeping 200 days of data) [2025-10-07T18:01:58.661204] [DEBUG] [LOCAL ] CII: Primary data saved (15178 records). [2025-10-07T18:01:58.661343] [INFO ] [MAIN ] CII: Full history saved. [2025-10-07T18:01:58.661423] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 27.5s. Estimated remaining: 4h 24m 16s. Rate: 7.3 symbols/min [2025-10-07T18:01:58.831515] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:01:58.831805] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-07T18:01:58.831862] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-07T18:01:58.831943] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-07T18:01:58.831980] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-07T18:01:58.832021] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-07T18:01:58.832052] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-07T18:01:59.055447] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-07T18:01:59.179639] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:01:59.847666] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-07T18:02:00.335016] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T18:02:00.338313] [INFO ] [REMOTE ] CIG: Full fetch complete (61328 records). [2025-10-07T18:02:00.338410] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-07T18:02:00.652834] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-07T18:02:00.737712] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-07T18:02:00.737815] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-07T18:02:00.738578] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-07T18:02:00.738672] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-07T18:02:00.739946] [DEBUG] [LOCAL ] CIG: Trimmed 61328 records to 43835 (keeping 200 days of data) [2025-10-07T18:02:00.838355] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T18:02:01.009555] [DEBUG] [LOCAL ] CIG: Primary data saved (43835 records). [2025-10-07T18:02:01.009740] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-07T18:02:01.009837] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIG took 35.0s. Estimated remaining: 4h 23m 43s. Rate: 7.3 symbols/min [2025-10-07T18:02:01.176090] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:02:01.176339] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-07T18:02:01.176397] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-07T18:02:01.176525] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-07T18:02:01.176568] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-07T18:02:01.176609] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-07T18:02:01.176662] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-07T18:02:01.448522] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-07T18:02:01.535855] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-07T18:02:01.539184] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:02:01.992313] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-07T18:02:02.247748] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-07T18:02:03.047708] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-07T18:02:03.277875] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:02:03.278265] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-07T18:02:03.278357] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:02:03.278409] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-07T18:02:03.278445] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:02:03.278517] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-07T18:02:03.278585] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-07T18:02:03.278621] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-07T18:02:03.278724] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-07T18:02:03.278802] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMP took 2.3s. Estimated remaining: 4h 23m 9s. Rate: 7.3 symbols/min [2025-10-07T18:02:03.453190] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:02:03.453385] [DEBUG] [LOCAL ] CINT: No existing data file found in primary storage. [2025-10-07T18:02:03.453441] [WARN ] [MAIN ] CINT: No existing data found, performing full refresh instead. [2025-10-07T18:02:03.453560] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-07T18:02:03.453602] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-07T18:02:03.453667] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-07T18:02:03.453723] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-07T18:02:03.858070] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-07T18:02:03.862899] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:02:03.880120] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T18:02:04.470827] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T18:02:04.647704] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-07T18:02:05.447706] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-07T18:02:05.674348] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T18:02:05.724993] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-07T18:02:06.247687] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-07T18:02:06.781746] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-07T18:02:07.047620] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-07T18:02:07.847703] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-07T18:02:08.053446] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T18:02:08.647735] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-07T18:02:09.250388] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T18:02:09.273593] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T18:02:09.447623] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-07T18:02:09.939988] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-07T18:02:10.247707] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-07T18:02:11.047624] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-07T18:02:11.252521] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T18:02:11.596117] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T18:02:11.847667] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-07T18:02:12.277604] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-07T18:02:12.647670] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-07T18:02:13.117756] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T18:02:13.118722] [INFO ] [REMOTE ] CIMN: Full fetch complete (3914 records). [2025-10-07T18:02:13.118802] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-07T18:02:13.119277] [FATAL] [VALIDATOR ] CIMN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:02:13.119345] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:02:13.119415] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:02:13.119495] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-07T18:02:13.119568] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-07T18:02:13.119609] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-10-07T18:02:13.119905] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-10-07T18:02:13.120009] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMN took 27.9s. Estimated remaining: 4h 23m 8s. Rate: 7.3 symbols/min [2025-10-07T18:02:13.298054] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:02:13.318912] [DEBUG] [LOCAL ] CIO: Loaded 20433 existing records from primary storage. [2025-10-07T18:02:13.319193] [INFO ] [MAIN ] CIO: Loaded 20433 existing records. [2025-10-07T18:02:13.456102] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-07T18:02:13.501970] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:02:13.502226] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-07T18:02:13.502273] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-07T18:02:13.502455] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-07T18:02:13.502512] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-07T18:02:13.862961] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:02:14.247613] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-07T18:02:14.552550] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-07T18:02:15.047700] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-07T18:02:15.715431] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T18:02:15.850856] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-07T18:02:15.855782] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T18:02:16.414604] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-07T18:02:16.647727] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-07T18:02:16.946859] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-07T18:02:17.447685] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-07T18:02:17.841125] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-07T18:02:18.247677] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-07T18:02:18.676933] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-07T18:02:19.047700] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-07T18:02:19.847691] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-07T18:02:20.176694] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T18:02:20.647677] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-07T18:02:21.221975] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T18:02:21.430680] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T18:02:21.447607] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-07T18:02:22.247738] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-07T18:02:22.553766] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T18:02:22.690064] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-07T18:02:23.047692] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-07T18:02:23.847708] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-07T18:02:23.989088] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-07T18:02:24.647706] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-07T18:02:25.447675] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-07T18:02:25.595830] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T18:02:25.657547] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T18:02:25.977500] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T18:02:25.978410] [INFO ] [REMOTE ] CIMO: Full fetch complete (5241 records). [2025-10-07T18:02:25.978483] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-07T18:02:25.979072] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:02:25.979171] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:02:25.979246] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:02:25.979341] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-07T18:02:25.979435] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-07T18:02:25.979489] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-07T18:02:25.979550] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-07T18:02:25.979665] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIMO took 27.3s. Estimated remaining: 4h 23m 19s. Rate: 7.3 symbols/min [2025-10-07T18:02:26.147345] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:02:26.175894] [DEBUG] [LOCAL ] CION: Loaded 28474 existing records from primary storage. [2025-10-07T18:02:26.176161] [INFO ] [MAIN ] CION: Loaded 28474 existing records. [2025-10-07T18:02:26.252745] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-07T18:02:26.354627] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:02:26.354886] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-07T18:02:26.354943] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-07T18:02:26.355222] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-07T18:02:26.355278] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-07T18:02:26.709914] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:02:27.047754] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-07T18:02:27.843420] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T18:02:27.854831] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-07T18:02:28.192883] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T18:02:28.647746] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-07T18:02:29.094016] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T18:02:29.447731] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-07T18:02:29.783916] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T18:02:30.247670] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-07T18:02:30.700932] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T18:02:31.047683] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-07T18:02:31.570702] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T18:02:31.847612] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-07T18:02:31.992972] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T18:02:32.647674] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-07T18:02:32.929809] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T18:02:33.447621] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-07T18:02:33.584219] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T18:02:34.247613] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-07T18:02:34.501467] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T18:02:35.047630] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-07T18:02:35.441682] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T18:02:35.847682] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-07T18:02:36.572793] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T18:02:36.647714] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-07T18:02:36.751686] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T18:02:37.447715] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-07T18:02:37.614397] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T18:02:38.247695] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-07T18:02:38.821306] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T18:02:39.047747] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-07T18:02:39.806343] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T18:02:39.847670] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-07T18:02:40.452633] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T18:02:40.647706] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-07T18:02:41.173308] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T18:02:41.176524] [INFO ] [REMOTE ] CIM: Full fetch complete (55057 records). [2025-10-07T18:02:41.176637] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-07T18:02:41.453285] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-07T18:02:41.562426] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-07T18:02:41.562541] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-07T18:02:41.563293] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-07T18:02:41.563359] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-07T18:02:41.564617] [DEBUG] [LOCAL ] CIM: Trimmed 55057 records to 37719 (keeping 200 days of data) [2025-10-07T18:02:41.795811] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T18:02:41.828337] [DEBUG] [LOCAL ] CIM: Primary data saved (37719 records). [2025-10-07T18:02:41.828467] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-07T18:02:41.828545] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIM took 57.0s. Estimated remaining: 4h 23m 43s. Rate: 7.3 symbols/min [2025-10-07T18:02:41.993859] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:02:42.043479] [DEBUG] [LOCAL ] CIVI: Loaded 52609 existing records from primary storage. [2025-10-07T18:02:42.043837] [INFO ] [MAIN ] CIVI: Loaded 52609 existing records. [2025-10-07T18:02:42.233409] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:02:42.233632] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-07T18:02:42.233714] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-07T18:02:42.234073] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-07T18:02:42.234130] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-07T18:02:42.255118] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-07T18:02:42.546837] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T18:02:42.635860] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:02:43.047695] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-07T18:02:43.607876] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T18:02:43.610136] [INFO ] [REMOTE ] CIO: Full fetch complete (29199 records). [2025-10-07T18:02:43.610235] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-07T18:02:43.856285] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-07T18:02:43.982126] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-07T18:02:43.982206] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-07T18:02:43.982745] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-07T18:02:43.982810] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-07T18:02:43.983786] [DEBUG] [LOCAL ] CIO: Trimmed 29199 records to 20458 (keeping 200 days of data) [2025-10-07T18:02:44.104227] [DEBUG] [LOCAL ] CIO: Primary data saved (20458 records). [2025-10-07T18:02:44.104362] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-07T18:02:44.104460] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CIO took 31.0s. Estimated remaining: 4h 23m 10s. Rate: 7.3 symbols/min [2025-10-07T18:02:44.273478] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:02:44.329073] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-07T18:02:44.329481] [INFO ] [MAIN ] CL: Loaded 53648 existing records. [2025-10-07T18:02:44.514345] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:02:44.514704] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-07T18:02:44.514817] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-07T18:02:44.515055] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-07T18:02:44.515114] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-07T18:02:44.656474] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-07T18:02:44.887548] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:02:44.906906] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T18:02:44.952833] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T18:02:45.447746] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-07T18:02:45.484830] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T18:02:46.247744] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-07T18:02:46.637283] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T18:02:47.047722] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-07T18:02:47.847717] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-07T18:02:47.920690] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T18:02:48.375861] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T18:02:48.647703] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-07T18:02:48.951930] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T18:02:49.447702] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-07T18:02:50.215789] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T18:02:50.247597] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-07T18:02:50.633487] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-07T18:02:51.047691] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-07T18:02:51.847713] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-07T18:02:51.944174] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T18:02:52.503860] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T18:02:52.647623] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-07T18:02:52.947176] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T18:02:53.447763] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-07T18:02:54.172369] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T18:02:54.247620] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-07T18:02:54.726837] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T18:02:54.729189] [INFO ] [REMOTE ] CINT: Full fetch complete (27197 records). [2025-10-07T18:02:54.729272] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-07T18:02:55.052767] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-07T18:02:55.150923] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-07T18:02:55.151007] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-07T18:02:55.151471] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-07T18:02:55.151547] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-07T18:02:55.152368] [DEBUG] [LOCAL ] CINT: Trimmed 27197 records to 19213 (keeping 200 days of data) [2025-10-07T18:02:55.277328] [DEBUG] [LOCAL ] CINT: Primary data saved (19213 records). [2025-10-07T18:02:55.277520] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-07T18:02:55.277678] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CINT took 52.0s. Estimated remaining: 4h 23m 14s. Rate: 7.3 symbols/min [2025-10-07T18:02:55.476901] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:02:55.515858] [DEBUG] [LOCAL ] CLB: Loaded 33026 existing records from primary storage. [2025-10-07T18:02:55.516179] [INFO ] [MAIN ] CLB: Loaded 33026 existing records. [2025-10-07T18:02:55.692235] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:02:55.692488] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-07T18:02:55.692538] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-07T18:02:55.692828] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-07T18:02:55.692885] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-07T18:02:55.852686] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-07T18:02:56.058058] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:02:56.166326] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T18:02:56.652742] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-07T18:02:56.674958] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T18:02:56.895853] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T18:02:56.897781] [INFO ] [REMOTE ] CION: Full fetch complete (40679 records). [2025-10-07T18:02:56.897861] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-07T18:02:57.269693] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-07T18:02:57.269779] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-07T18:02:57.270304] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-07T18:02:57.270347] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-07T18:02:57.271242] [DEBUG] [LOCAL ] CION: Trimmed 40679 records to 28464 (keeping 200 days of data) [2025-10-07T18:02:57.441664] [DEBUG] [LOCAL ] CION: Primary data saved (28464 records). [2025-10-07T18:02:57.441806] [INFO ] [MAIN ] CION: Full history saved. [2025-10-07T18:02:57.441892] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CION took 31.5s. Estimated remaining: 4h 22m 40s. Rate: 7.3 symbols/min [2025-10-07T18:02:57.453286] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-07T18:02:57.610251] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:02:57.624345] [DEBUG] [LOCAL ] CLCO: Loaded 12635 existing records from primary storage. [2025-10-07T18:02:57.624566] [INFO ] [MAIN ] CLCO: Loaded 12635 existing records. [2025-10-07T18:02:57.798956] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:02:57.799187] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-07T18:02:57.799240] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-07T18:02:57.799383] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-07T18:02:57.799421] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-07T18:02:58.147522] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:02:58.247603] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-07T18:02:58.532754] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T18:02:58.865305] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T18:02:59.047671] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-07T18:02:59.139458] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T18:02:59.847711] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-07T18:03:00.647637] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-07T18:03:01.232891] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-07T18:03:01.312365] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T18:03:01.447616] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-07T18:03:01.909118] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T18:03:02.247712] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-07T18:03:03.047720] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-07T18:03:03.203283] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T18:03:03.334713] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T18:03:03.847732] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-07T18:03:04.647672] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-07T18:03:04.861740] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T18:03:04.906326] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T18:03:05.447692] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-07T18:03:06.137742] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T18:03:06.247602] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-07T18:03:07.047625] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-07T18:03:07.436702] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-07T18:03:07.437554] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T18:03:07.847753] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-07T18:03:08.647727] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-07T18:03:08.786249] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T18:03:09.311482] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T18:03:09.447695] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-07T18:03:10.247711] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-07T18:03:10.492789] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T18:03:10.997554] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T18:03:11.047607] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-07T18:03:11.365031] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T18:03:11.847679] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-07T18:03:12.364466] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-07T18:03:12.647638] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-07T18:03:12.675451] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T18:03:13.447736] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-07T18:03:14.247764] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-07T18:03:14.596212] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T18:03:14.881491] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T18:03:15.047667] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-07T18:03:15.854007] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-07T18:03:15.855755] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T18:03:16.132255] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T18:03:16.647744] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-07T18:03:17.198877] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T18:03:17.447684] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-07T18:03:18.215934] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T18:03:18.225249] [INFO ] [REMOTE ] CL: Full fetch complete (77619 records). [2025-10-07T18:03:18.226048] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-07T18:03:18.225839] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-07T18:03:18.257378] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-07T18:03:18.620127] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-07T18:03:18.620203] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-07T18:03:18.621038] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-07T18:03:18.621101] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-07T18:03:18.622578] [DEBUG] [LOCAL ] CL: Trimmed 77619 records to 53648 (keeping 200 days of data) [2025-10-07T18:03:18.958444] [DEBUG] [LOCAL ] CL: Primary data saved (53648 records). [2025-10-07T18:03:18.958725] [INFO ] [MAIN ] CL: Full history saved. [2025-10-07T18:03:18.958825] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CL took 34.9s. Estimated remaining: 4h 23m 27s. Rate: 7.3 symbols/min [2025-10-07T18:03:19.054097] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-07T18:03:19.128396] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:03:19.155128] [DEBUG] [LOCAL ] CLDT: Loaded 25327 existing records from primary storage. [2025-10-07T18:03:19.155403] [INFO ] [MAIN ] CLDT: Loaded 25327 existing records. [2025-10-07T18:03:19.334984] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:03:19.335268] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-07T18:03:19.335321] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-07T18:03:19.335583] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-07T18:03:19.335677] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-07T18:03:19.844304] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:03:19.857760] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-07T18:03:19.883109] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T18:03:20.647692] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-07T18:03:21.044600] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T18:03:21.074967] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-07T18:03:21.447628] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-07T18:03:21.911915] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T18:03:22.161281] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-07T18:03:22.247673] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-07T18:03:23.047715] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-07T18:03:23.744022] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T18:03:23.748427] [INFO ] [REMOTE ] CIVI: Full fetch complete (75721 records). [2025-10-07T18:03:23.748599] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-07T18:03:23.852945] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-07T18:03:24.263502] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-07T18:03:24.264190] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-07T18:03:24.265292] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-07T18:03:24.265797] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-07T18:03:24.265678] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T18:03:24.269233] [INFO ] [REMOTE ] CLB: Full fetch complete (46657 records). [2025-10-07T18:03:24.269421] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-07T18:03:24.301226] [DEBUG] [LOCAL ] CIVI: Trimmed 75721 records to 52615 (keeping 200 days of data) [2025-10-07T18:03:24.654546] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-07T18:03:24.801400] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-07T18:03:24.802154] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-07T18:03:24.803869] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-07T18:03:24.803960] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-07T18:03:24.808190] [DEBUG] [LOCAL ] CLB: Trimmed 46657 records to 33057 (keeping 200 days of data) [2025-10-07T18:03:25.139132] [DEBUG] [LOCAL ] CLB: Primary data saved (33057 records). [2025-10-07T18:03:25.141458] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-07T18:03:25.142454] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLB took 29.9s. Estimated remaining: 4h 23m 10s. Rate: 7.3 symbols/min [2025-10-07T18:03:25.141355] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T18:03:25.332193] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:03:25.447736] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-07T18:03:25.451056] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-07T18:03:25.454159] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-07T18:03:25.586840] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-07T18:03:25.660252] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:03:25.662387] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-07T18:03:25.662793] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-07T18:03:25.663816] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-07T18:03:25.663890] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-07T18:03:25.757932] [DEBUG] [LOCAL ] CIVI: Primary data saved (52615 records). [2025-10-07T18:03:25.767815] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-07T18:03:25.768044] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CIVI took 43.9s. Estimated remaining: 4h 22m 30s. Rate: 7.3 symbols/min [2025-10-07T18:03:26.209132] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:03:26.229066] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:03:26.248014] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-07T18:03:26.261085] [DEBUG] [LOCAL ] CLH: Loaded 27690 existing records from primary storage. [2025-10-07T18:03:26.261391] [INFO ] [MAIN ] CLH: Loaded 27690 existing records. [2025-10-07T18:03:26.441895] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:03:26.442171] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-07T18:03:26.442227] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-07T18:03:26.442514] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-07T18:03:26.442571] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-07T18:03:26.800235] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:03:26.936947] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T18:03:27.047733] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-07T18:03:27.153284] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T18:03:27.847704] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-07T18:03:28.647627] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-07T18:03:28.789388] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T18:03:29.165487] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-07T18:03:29.447747] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-07T18:03:29.982129] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T18:03:30.247631] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-07T18:03:30.329496] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T18:03:30.331510] [INFO ] [REMOTE ] CLCO: Full fetch complete (22599 records). [2025-10-07T18:03:30.331596] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-07T18:03:30.717721] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-07T18:03:30.717818] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-07T18:03:30.718274] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-07T18:03:30.718337] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-07T18:03:30.719063] [DEBUG] [LOCAL ] CLCO: Trimmed 22599 records to 12716 (keeping 200 days of data) [2025-10-07T18:03:30.791729] [DEBUG] [LOCAL ] CLCO: Primary data saved (12716 records). [2025-10-07T18:03:30.791881] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-07T18:03:30.791965] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLCO took 33.3s. Estimated remaining: 4h 22m 9s. Rate: 7.3 symbols/min [2025-10-07T18:03:30.958112] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:03:30.971817] [DEBUG] [LOCAL ] CLPR: Loaded 10866 existing records from primary storage. [2025-10-07T18:03:30.972112] [INFO ] [MAIN ] CLPR: Loaded 10866 existing records. [2025-10-07T18:03:31.053585] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-07T18:03:31.169268] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:03:31.169501] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-07T18:03:31.169549] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-07T18:03:31.169776] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-07T18:03:31.169835] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-07T18:03:31.512293] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:03:31.847621] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-07T18:03:32.303507] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-07T18:03:32.344228] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T18:03:32.647679] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-07T18:03:33.021708] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-07T18:03:33.447693] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-07T18:03:34.010512] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T18:03:34.216236] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T18:03:34.247678] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-07T18:03:35.047708] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-07T18:03:35.089808] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T18:03:35.847690] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-07T18:03:36.171465] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T18:03:36.647711] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-07T18:03:37.447731] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-07T18:03:37.874701] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-07T18:03:37.923687] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T18:03:38.247722] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-07T18:03:38.887870] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T18:03:39.047718] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-07T18:03:39.440114] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T18:03:39.847699] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-07T18:03:40.647754] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-07T18:03:40.772276] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T18:03:40.986729] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T18:03:41.447708] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-07T18:03:42.247637] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-07T18:03:42.458218] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T18:03:42.916529] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-07T18:03:43.047604] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-07T18:03:43.482744] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T18:03:43.847734] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-07T18:03:44.647672] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-07T18:03:45.014512] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T18:03:45.184994] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-07T18:03:45.447688] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-07T18:03:45.905615] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T18:03:46.247711] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-07T18:03:46.331391] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T18:03:47.047711] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-07T18:03:47.847758] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-07T18:03:48.279140] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T18:03:48.306327] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T18:03:48.647758] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-07T18:03:49.013999] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T18:03:49.212962] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-07T18:03:49.447764] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-07T18:03:50.247630] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-07T18:03:50.299256] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T18:03:51.047717] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-07T18:03:51.847615] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-07T18:03:52.180496] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T18:03:52.265383] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T18:03:52.647690] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-07T18:03:52.802498] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T18:03:52.806758] [INFO ] [REMOTE ] CLDT: Full fetch complete (36985 records). [2025-10-07T18:03:52.806891] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-07T18:03:52.807727] [FATAL] [VALIDATOR ] CLDT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:03:52.807831] [FATAL] [MAIN ] CLDT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:03:52.807885] [WARN ] [MAIN ] CLDT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:03:52.807976] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-07T18:03:52.808112] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-10-07T18:03:52.808176] [INFO ] [LOCAL ] CLDT: Starting deletion of derivative data. [2025-10-07T18:03:52.808442] [DEBUG] [LOCAL ] CLDT: Deleted derivative data file. [2025-10-07T18:03:52.808556] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLDT took 33.8s. Estimated remaining: 4h 22m 57s. Rate: 7.3 symbols/min [2025-10-07T18:03:52.986936] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:03:53.045428] [DEBUG] [LOCAL ] CLS: Loaded 53612 existing records from primary storage. [2025-10-07T18:03:53.045816] [INFO ] [MAIN ] CLS: Loaded 53612 existing records. [2025-10-07T18:03:53.220032] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:03:53.220246] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-07T18:03:53.220295] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-07T18:03:53.220543] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-07T18:03:53.220606] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-07T18:03:53.455121] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-07T18:03:53.588215] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:03:54.247740] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-07T18:03:54.277979] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T18:03:54.948822] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-07T18:03:55.047738] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-07T18:03:55.847706] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-07T18:03:56.084143] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T18:03:56.647717] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-07T18:03:56.685061] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-07T18:03:56.907769] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T18:03:57.447748] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-07T18:03:58.247702] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-07T18:03:58.830122] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-07T18:03:58.938802] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-07T18:03:59.047639] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-07T18:03:59.481260] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T18:03:59.847766] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-07T18:04:00.647754] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-07T18:04:01.157721] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T18:04:01.159313] [INFO ] [REMOTE ] CLPR: Full fetch complete (16929 records). [2025-10-07T18:04:01.159398] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-07T18:04:01.159956] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:04:01.160054] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:04:01.160098] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:04:01.160140] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-07T18:04:01.160212] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-07T18:04:01.160260] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-07T18:04:01.160501] [DEBUG] [LOCAL ] CLPR: Deleted derivative data file. [2025-10-07T18:04:01.160612] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLPR took 30.4s. Estimated remaining: 4h 22m 49s. Rate: 7.3 symbols/min [2025-10-07T18:04:01.336982] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:04:01.387097] [DEBUG] [LOCAL ] CLVT: Loaded 51951 existing records from primary storage. [2025-10-07T18:04:01.387425] [INFO ] [MAIN ] CLVT: Loaded 51951 existing records. [2025-10-07T18:04:01.452589] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-07T18:04:01.575089] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:04:01.575563] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-07T18:04:01.602681] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-07T18:04:01.606476] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-07T18:04:01.607013] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-07T18:04:01.608389] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-07T18:04:01.923868] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-07T18:04:01.978884] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-07T18:04:02.015214] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-07T18:04:02.056793] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:04:02.254071] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-07T18:04:02.531182] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-07T18:04:02.531320] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-07T18:04:02.532547] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-07T18:04:02.532719] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-07T18:04:02.535226] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 53741 (keeping 200 days of data) [2025-10-07T18:04:02.865544] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T18:04:02.895084] [INFO ] [REMOTE ] CLH: Full fetch complete (41899 records). [2025-10-07T18:04:02.895686] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-07T18:04:03.054139] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-07T18:04:03.295750] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-07T18:04:03.296825] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-07T18:04:03.298448] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-07T18:04:03.298529] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-07T18:04:03.301888] [DEBUG] [LOCAL ] CLH: Trimmed 41899 records to 27665 (keeping 200 days of data) [2025-10-07T18:04:03.359366] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-07T18:04:03.367335] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-07T18:04:03.394456] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLF took 38.3s. Estimated remaining: 4h 22m 16s. Rate: 7.3 symbols/min [2025-10-07T18:04:03.570375] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:04:03.656082] [DEBUG] [LOCAL ] CLW: Loaded 21690 existing records from primary storage. [2025-10-07T18:04:03.660173] [INFO ] [MAIN ] CLW: Loaded 21690 existing records. [2025-10-07T18:04:03.773895] [DEBUG] [LOCAL ] CLH: Primary data saved (27665 records). [2025-10-07T18:04:03.784611] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-07T18:04:03.795017] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLH took 38.0s. Estimated remaining: 4h 21m 36s. Rate: 7.3 symbols/min [2025-10-07T18:04:03.940530] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:04:03.963693] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-07T18:04:03.963999] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-07T18:04:03.969924] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-07T18:04:03.985638] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-07T18:04:04.109005] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:04:04.380003] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-07T18:04:04.426153] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-07T18:04:04.468606] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:04:04.485551] [DEBUG] [LOCAL ] CLX: Loaded 51548 existing records from primary storage. [2025-10-07T18:04:04.486482] [INFO ] [MAIN ] CLX: Loaded 51548 existing records. [2025-10-07T18:04:04.654154] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-07T18:04:04.677097] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:04:04.678291] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-07T18:04:04.678347] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-07T18:04:04.678599] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-07T18:04:04.678706] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-07T18:04:05.032056] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:04:05.447751] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-07T18:04:05.581855] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-07T18:04:05.770737] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T18:04:06.126007] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T18:04:06.247674] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-07T18:04:06.850846] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T18:04:07.047607] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-07T18:04:07.516519] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T18:04:07.847708] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-07T18:04:08.647671] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-07T18:04:09.244080] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-07T18:04:09.291488] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T18:04:09.447631] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-07T18:04:10.253223] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-07T18:04:10.259101] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T18:04:11.047723] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-07T18:04:11.208228] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T18:04:11.847766] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-07T18:04:12.576767] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-07T18:04:12.647604] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-07T18:04:12.770443] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T18:04:13.079998] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-07T18:04:13.447758] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-07T18:04:14.247690] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-07T18:04:14.842208] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-07T18:04:15.047675] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-07T18:04:15.542352] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-07T18:04:15.847626] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-07T18:04:16.212447] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T18:04:16.647675] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-07T18:04:17.392208] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-07T18:04:17.447601] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-07T18:04:17.625770] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:04:17.677724] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-07T18:04:18.247685] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-07T18:04:19.047638] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-07T18:04:19.835397] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-07T18:04:19.847726] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-07T18:04:20.189021] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T18:04:20.335022] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-07T18:04:20.647632] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-07T18:04:21.447735] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-07T18:04:22.213507] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-07T18:04:22.247588] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-07T18:04:22.434353] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T18:04:23.047743] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-07T18:04:23.233731] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T18:04:23.847681] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-07T18:04:24.101891] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T18:04:24.369790] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-07T18:04:24.374268] [INFO ] [REMOTE ] CLS: Full fetch complete (77090 records). [2025-10-07T18:04:24.374391] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-07T18:04:24.375331] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:04:24.375426] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:04:24.375468] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:04:24.375517] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-07T18:04:24.375626] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-07T18:04:24.375723] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-10-07T18:04:24.375922] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-10-07T18:04:24.376827] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLS took 31.6s. Estimated remaining: 4h 22m 18s. Rate: 7.3 symbols/min [2025-10-07T18:04:24.544153] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:04:24.599396] [DEBUG] [LOCAL ] CM: Loaded 48664 existing records from primary storage. [2025-10-07T18:04:24.599835] [INFO ] [MAIN ] CM: Loaded 48664 existing records. [2025-10-07T18:04:24.657401] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-07T18:04:24.781249] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:04:24.781470] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-07T18:04:24.781522] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-07T18:04:24.781936] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-07T18:04:24.781995] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-07T18:04:25.128837] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:04:25.387010] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T18:04:25.447615] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-07T18:04:26.247670] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-07T18:04:26.538482] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-07T18:04:27.047635] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-07T18:04:27.120962] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T18:04:27.162614] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-07T18:04:27.847686] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-07T18:04:28.337627] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T18:04:28.647687] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-07T18:04:28.946193] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T18:04:29.447686] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-07T18:04:30.254977] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-07T18:04:30.261138] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T18:04:30.504344] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T18:04:31.047682] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-07T18:04:31.847722] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-07T18:04:31.984734] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T18:04:32.014611] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T18:04:32.647741] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-07T18:04:33.447738] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-07T18:04:33.694861] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T18:04:34.254340] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-07T18:04:34.257076] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T18:04:34.315254] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T18:04:34.319039] [INFO ] [REMOTE ] CLW: Full fetch complete (34681 records). [2025-10-07T18:04:34.319326] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-07T18:04:34.707463] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-07T18:04:34.707558] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-07T18:04:34.708119] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-07T18:04:34.708183] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-07T18:04:34.709010] [DEBUG] [LOCAL ] CLW: Trimmed 34681 records to 21707 (keeping 200 days of data) [2025-10-07T18:04:34.834256] [DEBUG] [LOCAL ] CLW: Primary data saved (21707 records). [2025-10-07T18:04:34.834391] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-07T18:04:34.834470] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLW took 31.4s. Estimated remaining: 4h 22m 19s. Rate: 7.3 symbols/min [2025-10-07T18:04:35.000079] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:04:35.047252] [DEBUG] [LOCAL ] CMA: Loaded 49881 existing records from primary storage. [2025-10-07T18:04:35.047589] [INFO ] [MAIN ] CMA: Loaded 49881 existing records. [2025-10-07T18:04:35.047735] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-07T18:04:35.230963] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:04:35.231193] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-07T18:04:35.231242] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-07T18:04:35.231500] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-07T18:04:35.231559] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-07T18:04:35.579232] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:04:35.847745] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-07T18:04:36.134512] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-07T18:04:36.138043] [INFO ] [REMOTE ] CLX: Full fetch complete (73183 records). [2025-10-07T18:04:36.138158] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-07T18:04:36.560252] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-07T18:04:36.560371] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-07T18:04:36.561212] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-07T18:04:36.561276] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-07T18:04:36.562752] [DEBUG] [LOCAL ] CLX: Trimmed 73183 records to 51546 (keeping 200 days of data) [2025-10-07T18:04:36.654145] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-07T18:04:36.900432] [DEBUG] [LOCAL ] CLX: Primary data saved (51546 records). [2025-10-07T18:04:36.900606] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-07T18:04:36.900743] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLX took 33.1s. Estimated remaining: 4h 21m 45s. Rate: 7.3 symbols/min [2025-10-07T18:04:37.119904] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:04:37.137676] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-07T18:04:37.168186] [DEBUG] [LOCAL ] CMBT: Loaded 24195 existing records from primary storage. [2025-10-07T18:04:37.168517] [INFO ] [MAIN ] CMBT: Loaded 24195 existing records. [2025-10-07T18:04:37.347414] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:04:37.347814] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-07T18:04:37.347946] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-07T18:04:37.348317] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-07T18:04:37.348384] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-07T18:04:37.447794] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-07T18:04:37.696167] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T18:04:37.747215] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:04:38.247677] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-07T18:04:38.434240] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T18:04:38.946446] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T18:04:38.949599] [INFO ] [REMOTE ] CLVT: Full fetch complete (74846 records). [2025-10-07T18:04:38.949770] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-07T18:04:38.950474] [FATAL] [VALIDATOR ] CLVT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:04:38.950565] [FATAL] [MAIN ] CLVT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:04:38.950611] [WARN ] [MAIN ] CLVT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:04:38.950712] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-07T18:04:38.950791] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-07T18:04:38.950831] [INFO ] [LOCAL ] CLVT: Starting deletion of derivative data. [2025-10-07T18:04:38.950998] [DEBUG] [LOCAL ] CLVT: Deleted derivative data file. [2025-10-07T18:04:38.951093] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLVT took 37.8s. Estimated remaining: 4h 21m 12s. Rate: 7.3 symbols/min [2025-10-07T18:04:39.054728] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-07T18:04:39.130866] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:04:39.173285] [DEBUG] [LOCAL ] CMC: Loaded 45453 existing records from primary storage. [2025-10-07T18:04:39.173612] [INFO ] [MAIN ] CMC: Loaded 45453 existing records. [2025-10-07T18:04:39.354754] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:04:39.355015] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-07T18:04:39.355078] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-07T18:04:39.355318] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-07T18:04:39.355377] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-07T18:04:39.720778] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:04:39.847622] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-07T18:04:39.968272] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T18:04:40.284624] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T18:04:40.647690] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-07T18:04:41.453974] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-07T18:04:41.474121] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T18:04:42.253209] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-07T18:04:42.259740] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T18:04:42.463078] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T18:04:43.047709] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-07T18:04:43.764610] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T18:04:43.847632] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-07T18:04:43.919748] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T18:04:44.647727] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-07T18:04:44.787509] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T18:04:45.447698] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-07T18:04:46.241229] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T18:04:46.250533] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-07T18:04:47.047630] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-07T18:04:47.294789] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T18:04:47.585632] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-07T18:04:47.847696] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-07T18:04:48.579414] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T18:04:48.647610] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-07T18:04:48.922539] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T18:04:49.447727] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-07T18:04:49.917093] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T18:04:50.247635] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-07T18:04:50.600515] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T18:04:51.047732] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-07T18:04:51.847706] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-07T18:04:52.081005] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T18:04:52.409786] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-07T18:04:52.647722] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-07T18:04:53.363599] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T18:04:53.447608] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-07T18:04:54.247627] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-07T18:04:54.348230] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T18:04:54.720794] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T18:04:55.047702] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-07T18:04:55.755064] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T18:04:55.847722] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-07T18:04:56.396358] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T18:04:56.647722] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-07T18:04:57.234630] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T18:04:57.447682] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-07T18:04:58.247677] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-07T18:04:58.634318] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T18:04:58.894318] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T18:04:59.047758] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-07T18:04:59.652029] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T18:04:59.847683] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-07T18:05:00.655674] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-07T18:05:00.682524] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T18:05:01.447740] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-07T18:05:01.484343] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T18:05:01.487782] [INFO ] [REMOTE ] CMBT: Full fetch complete (31163 records). [2025-10-07T18:05:01.487890] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-07T18:05:01.872150] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-07T18:05:01.872338] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-07T18:05:01.872869] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-07T18:05:01.872931] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-07T18:05:01.873736] [DEBUG] [LOCAL ] CMBT: Trimmed 31163 records to 24479 (keeping 200 days of data) [2025-10-07T18:05:02.021553] [DEBUG] [LOCAL ] CMBT: Primary data saved (24479 records). [2025-10-07T18:05:02.021754] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-07T18:05:02.021905] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMBT took 25.1s. Estimated remaining: 4h 22m 3s. Rate: 7.3 symbols/min [2025-10-07T18:05:02.190193] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:02.197600] [DEBUG] [LOCAL ] CMCM: Loaded 4714 existing records from primary storage. [2025-10-07T18:05:02.197843] [INFO ] [MAIN ] CMCM: Loaded 4714 existing records. [2025-10-07T18:05:02.261044] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-07T18:05:02.389754] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:05:02.390104] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-07T18:05:02.390179] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-07T18:05:02.390381] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-07T18:05:02.390442] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-07T18:05:02.698165] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T18:05:02.757765] [INFO ] [REMOTE ] CM: Full fetch complete (69177 records). [2025-10-07T18:05:02.778794] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-07T18:05:02.778507] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:05:02.780139] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:05:02.780340] [FATAL] [MAIN ] CM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:05:02.780442] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:05:02.780608] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-07T18:05:02.780802] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-10-07T18:05:02.780922] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-10-07T18:05:02.781304] [DEBUG] [LOCAL ] CM: Deleted derivative data file. [2025-10-07T18:05:02.784551] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CM took 38.4s. Estimated remaining: 4h 21m 25s. Rate: 7.3 symbols/min [2025-10-07T18:05:02.857701] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-07T18:05:03.018340] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:03.018579] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-07T18:05:03.018623] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-07T18:05:03.018756] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-07T18:05:03.018798] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-07T18:05:03.018838] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-07T18:05:03.018869] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-07T18:05:03.052740] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-07T18:05:03.384632] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:05:03.847609] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-07T18:05:04.104779] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T18:05:04.443875] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T18:05:04.647617] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-07T18:05:04.757637] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T18:05:05.134838] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-07T18:05:05.447677] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-07T18:05:06.247687] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-07T18:05:07.047761] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-07T18:05:07.262432] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T18:05:07.799999] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T18:05:07.838889] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T18:05:07.848924] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-07T18:05:08.040203] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:05:08.040687] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-07T18:05:08.040796] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:05:08.040877] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-07T18:05:08.040940] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:05:08.041025] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-07T18:05:08.041107] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-07T18:05:08.041148] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-07T18:05:08.041188] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-07T18:05:08.041240] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMDB took 5.2s. Estimated remaining: 4h 21m 5s. Rate: 7.3 symbols/min [2025-10-07T18:05:08.219477] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:08.287070] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-07T18:05:08.287521] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-07T18:05:08.482326] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:05:08.482728] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-07T18:05:08.482816] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-07T18:05:08.483260] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-07T18:05:08.483343] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-07T18:05:08.652871] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-07T18:05:08.890604] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:05:09.447708] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-07T18:05:10.247634] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-07T18:05:10.588607] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T18:05:10.845020] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T18:05:11.047738] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-07T18:05:11.370247] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T18:05:11.585561] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-07T18:05:11.847741] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-07T18:05:12.216147] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-07T18:05:12.647685] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-07T18:05:13.447691] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-07T18:05:14.009233] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-07T18:05:14.220503] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T18:05:14.247600] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-07T18:05:15.047692] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-07T18:05:15.483022] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T18:05:15.487016] [INFO ] [REMOTE ] CMA: Full fetch complete (73100 records). [2025-10-07T18:05:15.487222] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-07T18:05:15.857387] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-07T18:05:15.881796] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-07T18:05:15.881881] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-07T18:05:15.882750] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-07T18:05:15.882868] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-07T18:05:15.884516] [DEBUG] [LOCAL ] CMA: Trimmed 73100 records to 49900 (keeping 200 days of data) [2025-10-07T18:05:16.195584] [DEBUG] [LOCAL ] CMA: Primary data saved (49900 records). [2025-10-07T18:05:16.195762] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-07T18:05:16.195866] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMA took 41.4s. Estimated remaining: 4h 20m 56s. Rate: 7.3 symbols/min [2025-10-07T18:05:16.363899] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:16.404118] [DEBUG] [LOCAL ] CMI: Loaded 41714 existing records from primary storage. [2025-10-07T18:05:16.404437] [INFO ] [MAIN ] CMI: Loaded 41714 existing records. [2025-10-07T18:05:16.589757] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:05:16.592614] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T18:05:16.592325] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-07T18:05:16.595374] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-07T18:05:16.595945] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-07T18:05:16.596016] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-07T18:05:16.652731] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-07T18:05:16.758106] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T18:05:17.009003] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:05:17.310712] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-07T18:05:17.447695] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-07T18:05:18.247761] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-07T18:05:19.047629] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-07T18:05:19.090218] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T18:05:19.848729] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-07T18:05:19.854323] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T18:05:20.648491] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-07T18:05:20.655699] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T18:05:21.120419] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-07T18:05:21.447714] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-07T18:05:21.927597] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T18:05:21.930846] [INFO ] [REMOTE ] CMC: Full fetch complete (66923 records). [2025-10-07T18:05:21.930958] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-07T18:05:22.208336] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T18:05:22.238139] [INFO ] [REMOTE ] CMCM: Full fetch complete (6878 records). [2025-10-07T18:05:22.248920] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-07T18:05:22.249157] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-07T18:05:22.438776] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-07T18:05:22.444060] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-07T18:05:22.463255] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-07T18:05:22.465627] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-07T18:05:22.524866] [DEBUG] [LOCAL ] CMC: Trimmed 66923 records to 45441 (keeping 200 days of data) [2025-10-07T18:05:22.819449] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-07T18:05:22.819876] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-07T18:05:22.820101] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-07T18:05:22.820181] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-07T18:05:22.821557] [DEBUG] [LOCAL ] CMCM: Trimmed 6878 records to 4731 (keeping 200 days of data) [2025-10-07T18:05:22.853183] [DEBUG] [LOCAL ] CMCM: Primary data saved (4731 records). [2025-10-07T18:05:22.853923] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-07T18:05:22.854578] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMCM took 20.8s. Estimated remaining: 4h 20m 41s. Rate: 7.3 symbols/min [2025-10-07T18:05:23.030714] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:23.055489] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-07T18:05:23.160040] [DEBUG] [LOCAL ] CMP: Loaded 36092 existing records from primary storage. [2025-10-07T18:05:23.161465] [INFO ] [MAIN ] CMP: Loaded 36092 existing records. [2025-10-07T18:05:23.387503] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:05:23.391521] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-07T18:05:23.391981] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-07T18:05:23.392732] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-07T18:05:23.393596] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-07T18:05:23.769500] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:05:23.817305] [DEBUG] [LOCAL ] CMC: Primary data saved (45441 records). [2025-10-07T18:05:23.817474] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-07T18:05:23.817569] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMC took 44.9s. Estimated remaining: 4h 20m 4s. Rate: 7.3 symbols/min [2025-10-07T18:05:23.849295] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-07T18:05:24.015263] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:24.012947] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T18:05:24.059455] [DEBUG] [LOCAL ] CMPO: Loaded 39064 existing records from primary storage. [2025-10-07T18:05:24.059781] [INFO ] [MAIN ] CMPO: Loaded 39064 existing records. [2025-10-07T18:05:24.231461] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:05:24.231743] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-07T18:05:24.231797] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-07T18:05:24.232013] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-07T18:05:24.232077] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-07T18:05:24.577118] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:05:24.647608] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-07T18:05:25.352281] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-07T18:05:25.426997] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T18:05:25.447598] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-07T18:05:26.168181] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T18:05:26.247605] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-07T18:05:26.854295] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T18:05:27.047709] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-07T18:05:27.775157] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T18:05:27.847733] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-07T18:05:28.016436] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T18:05:28.647700] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-07T18:05:29.207842] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T18:05:29.447698] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-07T18:05:30.196966] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T18:05:30.247612] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-07T18:05:30.892007] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T18:05:31.047741] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-07T18:05:31.663583] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-07T18:05:31.847691] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-07T18:05:32.392613] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T18:05:32.647729] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-07T18:05:33.447686] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-07T18:05:33.925950] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T18:05:34.194334] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T18:05:34.247694] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-07T18:05:34.959275] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T18:05:35.047681] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-07T18:05:35.847699] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-07T18:05:36.377187] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-07T18:05:36.653207] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-07T18:05:36.664967] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T18:05:37.458062] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-07T18:05:37.480943] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T18:05:38.076777] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T18:05:38.247724] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-07T18:05:38.693872] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T18:05:39.047759] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-07T18:05:39.626521] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T18:05:39.847757] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-07T18:05:40.072819] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T18:05:40.647735] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-07T18:05:41.202056] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T18:05:41.447738] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-07T18:05:42.247739] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-07T18:05:42.286842] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T18:05:43.013727] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T18:05:43.047600] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-07T18:05:43.693938] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T18:05:43.847668] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-07T18:05:44.647626] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-07T18:05:45.065312] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-07T18:05:45.312728] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T18:05:45.447610] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-07T18:05:46.252798] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-07T18:05:46.267575] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:05:46.463732] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T18:05:47.047740] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-07T18:05:47.852798] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-07T18:05:47.865874] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T18:05:48.584292] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T18:05:48.587912] [INFO ] [REMOTE ] CMPO: Full fetch complete (58813 records). [2025-10-07T18:05:48.588055] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-07T18:05:48.657226] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-07T18:05:48.984896] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-07T18:05:48.984990] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-07T18:05:48.985720] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-07T18:05:48.985792] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-07T18:05:48.987165] [DEBUG] [LOCAL ] CMPO: Trimmed 58813 records to 39033 (keeping 200 days of data) [2025-10-07T18:05:49.215441] [DEBUG] [LOCAL ] CMPO: Primary data saved (39033 records). [2025-10-07T18:05:49.215584] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-07T18:05:49.215688] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMPO took 25.4s. Estimated remaining: 4h 21m 4s. Rate: 7.3 symbols/min [2025-10-07T18:05:49.447731] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-07T18:05:49.987465] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-07T18:05:50.235086] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T18:05:50.247592] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-07T18:05:50.721044] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-07T18:05:51.047706] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-07T18:05:51.802809] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T18:05:51.806911] [INFO ] [REMOTE ] CMI: Full fetch complete (60174 records). [2025-10-07T18:05:51.807051] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-07T18:05:51.852848] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-07T18:05:52.276920] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-07T18:05:52.277067] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-07T18:05:52.277812] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-07T18:05:52.277880] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-07T18:05:52.279218] [DEBUG] [LOCAL ] CMI: Trimmed 60174 records to 41708 (keeping 200 days of data) [2025-10-07T18:05:52.556842] [DEBUG] [LOCAL ] CMI: Primary data saved (41708 records). [2025-10-07T18:05:52.556977] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-07T18:05:52.557057] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMI took 36.4s. Estimated remaining: 4h 20m 36s. Rate: 7.3 symbols/min [2025-10-07T18:05:53.238389] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T18:05:53.245925] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-07T18:05:53.356591] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-07T18:05:53.447735] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-07T18:05:54.346912] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T18:05:54.349301] [INFO ] [REMOTE ] CMP: Full fetch complete (52141 records). [2025-10-07T18:05:54.349432] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-07T18:05:54.723193] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-07T18:05:54.723274] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-07T18:05:54.724091] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-07T18:05:54.724155] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-07T18:05:54.725253] [DEBUG] [LOCAL ] CMP: Trimmed 52141 records to 36085 (keeping 200 days of data) [2025-10-07T18:05:54.935015] [DEBUG] [LOCAL ] CMP: Primary data saved (36085 records). [2025-10-07T18:05:54.935164] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-07T18:05:54.935246] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMP took 32.1s. Estimated remaining: 4h 20m 5s. Rate: 7.3 symbols/min [2025-10-07T18:05:56.185238] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-07T18:05:56.196946] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-07T18:05:58.425324] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-07T18:05:58.429347] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-07T18:05:58.429515] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-07T18:05:58.842830] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-07T18:05:58.842913] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-07T18:05:58.843775] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-07T18:05:58.843845] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-07T18:05:58.845408] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-10-07T18:05:59.168905] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-10-07T18:05:59.169047] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-07T18:05:59.170509] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMG took 51.1s. Estimated remaining: 4h 19m 41s. Rate: 7.3 symbols/min [2025-10-07T18:05:59.721915] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:59.855554] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:59.885282] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:59.911439] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:05:59.914997] [DEBUG] [LOCAL ] CMSC: Loaded 5062 existing records from primary storage. [2025-10-07T18:05:59.915785] [INFO ] [MAIN ] CMSC: Loaded 5062 existing records. [2025-10-07T18:05:59.996173] [DEBUG] [LOCAL ] CMSA: Loaded 3513 existing records from primary storage. [2025-10-07T18:06:00.007238] [INFO ] [MAIN ] CMSA: Loaded 3513 existing records. [2025-10-07T18:06:00.214554] [DEBUG] [LOCAL ] CMRE: Loaded 35445 existing records from primary storage. [2025-10-07T18:06:00.238892] [INFO ] [MAIN ] CMRE: Loaded 35445 existing records. [2025-10-07T18:06:00.221129] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:00.295342] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-07T18:06:00.300582] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-07T18:06:00.327511] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-07T18:06:00.364900] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-07T18:06:00.498424] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:00.558859] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-07T18:06:00.543225] [DEBUG] [LOCAL ] CMS: Loaded 52610 existing records from primary storage. [2025-10-07T18:06:00.574454] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-07T18:06:00.612280] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-07T18:06:00.618525] [INFO ] [MAIN ] CMS: Loaded 52610 existing records. [2025-10-07T18:06:00.680043] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-07T18:06:00.714104] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:00.821096] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-07T18:06:00.849678] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-07T18:06:00.892802] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-07T18:06:00.898104] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-07T18:06:01.255372] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:01.286427] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-07T18:06:01.286729] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-07T18:06:01.341682] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-07T18:06:01.403736] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-07T18:06:01.527158] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:01.571168] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-07T18:06:01.901404] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:01.992704] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-07T18:06:02.136014] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:02.155767] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-07T18:06:02.242155] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:02.242486] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-07T18:06:02.499808] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T18:06:02.501785] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-07T18:06:02.851312] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T18:06:02.852977] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-07T18:06:03.259490] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T18:06:03.261206] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-07T18:06:03.492412] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T18:06:03.501010] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-07T18:06:03.501567] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-07T18:06:03.503919] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-07T18:06:03.722499] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T18:06:03.723970] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-07T18:06:03.906286] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-07T18:06:03.907535] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-07T18:06:03.973322] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T18:06:03.985796] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-07T18:06:04.196723] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T18:06:04.389776] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T18:06:04.539873] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T18:06:04.647640] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-07T18:06:05.404232] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T18:06:05.447595] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-07T18:06:05.635062] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T18:06:06.026768] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T18:06:06.247636] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-07T18:06:06.655461] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-07T18:06:07.047688] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-07T18:06:07.847676] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-07T18:06:08.444859] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-07T18:06:08.647675] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-07T18:06:08.733201] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T18:06:09.447684] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-07T18:06:09.646466] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T18:06:10.247679] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-07T18:06:10.847489] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T18:06:11.047602] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-07T18:06:11.181462] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T18:06:11.528760] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-07T18:06:11.847624] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-07T18:06:12.647667] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-07T18:06:13.303452] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-07T18:06:13.447760] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-07T18:06:13.549278] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T18:06:14.047157] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T18:06:14.048419] [INFO ] [REMOTE ] CMSC: Full fetch complete (7169 records). [2025-10-07T18:06:14.048526] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-07T18:06:14.257718] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-07T18:06:14.447149] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-07T18:06:14.447236] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-07T18:06:14.447492] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-07T18:06:14.447556] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-07T18:06:14.448034] [DEBUG] [LOCAL ] CMSC: Trimmed 7169 records to 5021 (keeping 200 days of data) [2025-10-07T18:06:14.481435] [DEBUG] [LOCAL ] CMSC: Primary data saved (5021 records). [2025-10-07T18:06:14.481594] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-07T18:06:14.481726] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSC took 15.3s. Estimated remaining: 4h 20m 0s. Rate: 7.3 symbols/min [2025-10-07T18:06:14.663863] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:06:14.675809] [DEBUG] [LOCAL ] CMSD: Loaded 8028 existing records from primary storage. [2025-10-07T18:06:14.676086] [INFO ] [MAIN ] CMSD: Loaded 8028 existing records. [2025-10-07T18:06:14.863573] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:14.863871] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-07T18:06:14.863932] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-07T18:06:14.864167] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-07T18:06:14.864227] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-07T18:06:14.960188] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T18:06:15.052273] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-07T18:06:15.241176] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:15.847695] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-07T18:06:16.211342] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-07T18:06:16.345989] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T18:06:16.647694] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-07T18:06:17.447687] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-07T18:06:18.247705] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-07T18:06:18.436285] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T18:06:18.476325] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T18:06:18.815689] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-07T18:06:19.047737] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-07T18:06:19.847713] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-07T18:06:20.492809] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T18:06:20.647691] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-07T18:06:21.181195] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-07T18:06:21.457576] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-07T18:06:21.477486] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T18:06:22.247678] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-07T18:06:22.742888] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T18:06:22.822825] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T18:06:23.047626] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-07T18:06:23.752418] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T18:06:23.753270] [INFO ] [REMOTE ] CMSA: Full fetch complete (5102 records). [2025-10-07T18:06:23.753339] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-07T18:06:23.851465] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-07T18:06:24.142560] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-07T18:06:24.142668] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-07T18:06:24.142890] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-07T18:06:24.142937] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-07T18:06:24.143348] [DEBUG] [LOCAL ] CMSA: Trimmed 5102 records to 3514 (keeping 200 days of data) [2025-10-07T18:06:24.167869] [DEBUG] [LOCAL ] CMSA: Primary data saved (3514 records). [2025-10-07T18:06:24.168049] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-07T18:06:24.168150] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSA took 25.0s. Estimated remaining: 4h 19m 58s. Rate: 7.3 symbols/min [2025-10-07T18:06:24.340206] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:06:24.374618] [DEBUG] [LOCAL ] CMTG: Loaded 36405 existing records from primary storage. [2025-10-07T18:06:24.374941] [INFO ] [MAIN ] CMTG: Loaded 36405 existing records. [2025-10-07T18:06:24.548370] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:24.548622] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-07T18:06:24.548699] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-07T18:06:24.549011] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-07T18:06:24.549068] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-07T18:06:24.652885] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-07T18:06:24.901589] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:25.447681] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-07T18:06:25.705291] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T18:06:26.247701] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-07T18:06:26.269684] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T18:06:26.291927] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T18:06:27.047693] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-07T18:06:27.548251] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-07T18:06:27.847695] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-07T18:06:28.647612] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-07T18:06:28.979300] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T18:06:29.307281] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T18:06:29.397335] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T18:06:29.447625] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-07T18:06:30.247683] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-07T18:06:30.820849] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T18:06:31.047724] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-07T18:06:31.597333] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T18:06:31.847727] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-07T18:06:32.647713] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-07T18:06:32.749044] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T18:06:32.948548] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T18:06:33.447714] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-07T18:06:33.673777] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T18:06:34.247751] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-07T18:06:34.832956] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T18:06:34.836603] [INFO ] [REMOTE ] CMS: Full fetch complete (76008 records). [2025-10-07T18:06:34.836747] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-07T18:06:35.055122] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-07T18:06:35.234039] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-07T18:06:35.234139] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-07T18:06:35.235092] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-07T18:06:35.235167] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-07T18:06:35.236799] [DEBUG] [LOCAL ] CMS: Trimmed 76008 records to 52626 (keeping 200 days of data) [2025-10-07T18:06:35.485116] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T18:06:35.493977] [INFO ] [REMOTE ] CMRE: Full fetch complete (50288 records). [2025-10-07T18:06:35.497746] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-07T18:06:35.863687] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-07T18:06:35.878500] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T18:06:35.946144] [DEBUG] [LOCAL ] CMS: Primary data saved (52626 records). [2025-10-07T18:06:35.962580] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-07T18:06:35.963096] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMS took 36.8s. Estimated remaining: 4h 20m 3s. Rate: 7.3 symbols/min [2025-10-07T18:06:36.062290] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-07T18:06:36.073694] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-07T18:06:36.090197] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-07T18:06:36.101053] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-07T18:06:36.185691] [DEBUG] [LOCAL ] CMRE: Trimmed 50288 records to 35498 (keeping 200 days of data) [2025-10-07T18:06:36.212467] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:06:36.306258] [DEBUG] [LOCAL ] CMU: Loaded 6438 existing records from primary storage. [2025-10-07T18:06:36.307155] [INFO ] [MAIN ] CMU: Loaded 6438 existing records. [2025-10-07T18:06:36.502930] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:36.503584] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-07T18:06:36.504098] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-07T18:06:36.505225] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-07T18:06:36.505519] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-07T18:06:36.649065] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-07T18:06:36.889356] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:36.988778] [DEBUG] [LOCAL ] CMRE: Primary data saved (35498 records). [2025-10-07T18:06:36.988914] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-07T18:06:36.988993] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMRE took 37.8s. Estimated remaining: 4h 19m 27s. Rate: 7.3 symbols/min [2025-10-07T18:06:37.156834] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T18:06:37.181329] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:06:37.222076] [DEBUG] [LOCAL ] CNA: Loaded 32857 existing records from primary storage. [2025-10-07T18:06:37.222348] [INFO ] [MAIN ] CNA: Loaded 32857 existing records. [2025-10-07T18:06:37.401042] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:37.401395] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-07T18:06:37.401563] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-07T18:06:37.408597] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-07T18:06:37.409453] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T18:06:37.409225] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-07T18:06:37.447778] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-07T18:06:37.771228] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:38.237240] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T18:06:38.247596] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-07T18:06:38.348679] [DEBUG] [REMOTE ] CMU: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-07T18:06:38.348861] [WARN ] [REMOTE ] CMU: No data returned for month 2024-12 [2025-10-07T18:06:38.348960] [FATAL] [REMOTE ] CMU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:06:38.349011] [FATAL] [MAIN ] CMU: Failed to fetch primary data. [2025-10-07T18:06:38.349044] [WARN ] [MAIN ] CMU: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:06:38.349081] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-07T18:06:38.349130] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-07T18:06:38.349172] [INFO ] [LOCAL ] CMU: Starting deletion of derivative data. [2025-10-07T18:06:38.349416] [DEBUG] [LOCAL ] CMU: Deleted derivative data file. [2025-10-07T18:06:38.349498] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMU took 2.4s. Estimated remaining: 4h 18m 52s. Rate: 7.3 symbols/min [2025-10-07T18:06:38.512720] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:06:38.565622] [DEBUG] [LOCAL ] CNC: Loaded 53745 existing records from primary storage. [2025-10-07T18:06:38.565963] [INFO ] [MAIN ] CNC: Loaded 53745 existing records. [2025-10-07T18:06:38.736061] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:38.736257] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-07T18:06:38.736303] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-07T18:06:38.736759] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-07T18:06:38.736824] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-07T18:06:39.052852] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-07T18:06:39.082047] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:39.847680] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-07T18:06:40.647789] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-07T18:06:40.830238] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:06:41.125716] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T18:06:41.212854] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-07T18:06:41.447735] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-07T18:06:42.247697] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-07T18:06:43.047677] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-07T18:06:43.376354] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-07T18:06:43.660889] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T18:06:43.847683] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-07T18:06:43.974624] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T18:06:44.647714] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-07T18:06:45.396812] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T18:06:45.447628] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-07T18:06:45.515482] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T18:06:46.247756] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-07T18:06:46.726763] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T18:06:47.047713] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-07T18:06:47.736551] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T18:06:47.847637] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-07T18:06:47.978810] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T18:06:48.647698] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-07T18:06:49.159870] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T18:06:49.447733] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-07T18:06:50.141211] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-07T18:06:50.247628] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-07T18:06:50.395989] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T18:06:51.020037] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T18:06:51.021116] [INFO ] [REMOTE ] CMSD: Full fetch complete (12235 records). [2025-10-07T18:06:51.021214] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-07T18:06:51.056363] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-07T18:06:51.468308] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-07T18:06:51.468410] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-07T18:06:51.468800] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-07T18:06:51.468873] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-07T18:06:51.469371] [DEBUG] [LOCAL ] CMSD: Trimmed 12235 records to 8015 (keeping 200 days of data) [2025-10-07T18:06:51.531218] [DEBUG] [LOCAL ] CMSD: Primary data saved (8015 records). [2025-10-07T18:06:51.531360] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-07T18:06:51.531443] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMSD took 37.0s. Estimated remaining: 4h 19m 3s. Rate: 7.3 symbols/min [2025-10-07T18:06:51.696971] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:06:51.709437] [DEBUG] [LOCAL ] CNF: Loaded 10495 existing records from primary storage. [2025-10-07T18:06:51.709695] [INFO ] [MAIN ] CNF: Loaded 10495 existing records. [2025-10-07T18:06:51.855087] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-07T18:06:51.885879] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:06:51.886118] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-07T18:06:51.886172] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-07T18:06:51.886397] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-07T18:06:51.886456] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-07T18:06:52.235548] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:06:52.647627] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-07T18:06:53.024965] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T18:06:53.303036] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T18:06:53.447637] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-07T18:06:54.109255] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T18:06:54.257513] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-07T18:06:54.259899] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T18:06:55.047700] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-07T18:06:55.847760] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-07T18:06:56.151293] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T18:06:56.563040] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-07T18:06:56.590031] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T18:06:56.647611] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-07T18:06:57.447731] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-07T18:06:57.766085] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-07T18:06:58.083792] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T18:06:58.247639] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-07T18:06:59.047687] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-07T18:06:59.847629] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-07T18:07:00.065424] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T18:07:00.220018] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-07T18:07:00.250740] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T18:07:00.647679] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-07T18:07:01.447753] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-07T18:07:02.166161] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T18:07:02.186990] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T18:07:02.247606] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-07T18:07:02.818750] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T18:07:03.047709] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-07T18:07:03.847691] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-07T18:07:04.647665] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-07T18:07:04.661804] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T18:07:05.447805] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-07T18:07:05.575015] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-07T18:07:05.981977] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T18:07:06.247633] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-07T18:07:06.392694] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T18:07:07.047741] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-07T18:07:07.553053] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T18:07:07.847697] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-07T18:07:08.234910] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T18:07:08.647638] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-07T18:07:08.972744] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T18:07:08.975763] [INFO ] [REMOTE ] CMTG: Full fetch complete (53619 records). [2025-10-07T18:07:08.975916] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-07T18:07:09.356611] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-07T18:07:09.356732] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-07T18:07:09.357471] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-07T18:07:09.357521] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-07T18:07:09.358737] [DEBUG] [LOCAL ] CMTG: Trimmed 53619 records to 36360 (keeping 200 days of data) [2025-10-07T18:07:09.447899] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-07T18:07:09.573937] [DEBUG] [LOCAL ] CMTG: Primary data saved (36360 records). [2025-10-07T18:07:09.574110] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-07T18:07:09.574212] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMTG took 45.4s. Estimated remaining: 4h 19m 32s. Rate: 7.3 symbols/min [2025-10-07T18:07:09.686682] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T18:07:09.766004] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:07:09.766293] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-07T18:07:09.766352] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-07T18:07:09.766482] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-07T18:07:09.766525] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-07T18:07:09.766596] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-07T18:07:09.766691] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-07T18:07:10.117129] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:07:10.247611] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-07T18:07:10.665560] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T18:07:11.047637] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-07T18:07:11.847708] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-07T18:07:11.926212] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T18:07:11.928875] [INFO ] [REMOTE ] CNA: Full fetch complete (45454 records). [2025-10-07T18:07:11.929058] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-07T18:07:11.929992] [FATAL] [VALIDATOR ] CNA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:07:11.930231] [FATAL] [MAIN ] CNA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:07:11.930335] [WARN ] [MAIN ] CNA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:07:11.930413] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-07T18:07:11.930680] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-07T18:07:11.930740] [INFO ] [LOCAL ] CNA: Starting deletion of derivative data. [2025-10-07T18:07:11.969593] [DEBUG] [LOCAL ] CNA: Deleted derivative data file. [2025-10-07T18:07:11.973845] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNA took 35.0s. Estimated remaining: 4h 19m 1s. Rate: 7.3 symbols/min [2025-10-07T18:07:12.032189] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T18:07:12.167929] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:07:12.216245] [DEBUG] [LOCAL ] CNI: Loaded 51661 existing records from primary storage. [2025-10-07T18:07:12.216592] [INFO ] [MAIN ] CNI: Loaded 51661 existing records. [2025-10-07T18:07:12.401977] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:07:12.402227] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-07T18:07:12.402308] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-07T18:07:12.402593] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-07T18:07:12.402687] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-07T18:07:12.599385] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T18:07:12.655198] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-07T18:07:12.801260] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:07:13.447750] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-07T18:07:14.232472] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T18:07:14.247595] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-07T18:07:15.047633] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-07T18:07:15.404607] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T18:07:15.838741] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T18:07:15.840257] [INFO ] [REMOTE ] CNF: Full fetch complete (13133 records). [2025-10-07T18:07:15.840351] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-07T18:07:15.854858] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-07T18:07:16.236181] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T18:07:16.265292] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-07T18:07:16.274921] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-07T18:07:16.275805] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-07T18:07:16.276199] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-07T18:07:16.276769] [DEBUG] [LOCAL ] CNF: Trimmed 13133 records to 10538 (keeping 200 days of data) [2025-10-07T18:07:16.336724] [DEBUG] [LOCAL ] CNF: Primary data saved (10538 records). [2025-10-07T18:07:16.336886] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-07T18:07:16.336970] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNF took 24.8s. Estimated remaining: 4h 18m 38s. Rate: 7.3 symbols/min [2025-10-07T18:07:16.502066] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:07:16.560191] [DEBUG] [LOCAL ] CNK: Loaded 52882 existing records from primary storage. [2025-10-07T18:07:16.560806] [INFO ] [MAIN ] CNK: Loaded 52882 existing records. [2025-10-07T18:07:16.652724] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-07T18:07:16.747443] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:07:16.747700] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-07T18:07:16.747786] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-07T18:07:16.749389] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-07T18:07:16.749451] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-07T18:07:17.115088] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:07:17.410413] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T18:07:17.447629] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-07T18:07:18.247723] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-07T18:07:18.449781] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T18:07:19.047694] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-07T18:07:19.134287] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T18:07:19.847732] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-07T18:07:20.528487] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-07T18:07:20.647633] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-07T18:07:20.899267] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T18:07:21.401763] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T18:07:21.447603] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-07T18:07:22.247885] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-07T18:07:22.600194] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T18:07:23.047722] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-07T18:07:23.197746] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T18:07:23.847623] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-07T18:07:24.034908] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T18:07:24.647687] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-07T18:07:24.947234] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-07T18:07:25.447709] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-07T18:07:25.488763] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T18:07:26.050552] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T18:07:26.247745] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-07T18:07:27.047736] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-07T18:07:27.700783] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-07T18:07:27.751821] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T18:07:27.847722] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-07T18:07:28.322990] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T18:07:28.647727] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-07T18:07:29.447695] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-07T18:07:29.520457] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T18:07:29.971529] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T18:07:30.247724] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-07T18:07:31.047702] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-07T18:07:31.282193] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-07T18:07:31.285872] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-10-07T18:07:31.286021] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-07T18:07:31.710063] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-07T18:07:31.710292] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-07T18:07:31.711181] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-07T18:07:31.711265] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-07T18:07:31.712841] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 53752 (keeping 200 days of data) [2025-10-07T18:07:31.880310] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-07T18:07:32.045735] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T18:07:32.079673] [DEBUG] [LOCAL ] CNC: Primary data saved (53752 records). [2025-10-07T18:07:32.079830] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-07T18:07:32.079934] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNC took 53.7s. Estimated remaining: 4h 18m 59s. Rate: 7.3 symbols/min [2025-10-07T18:07:32.245272] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:07:32.291761] [DEBUG] [LOCAL ] CNM: Loaded 51030 existing records from primary storage. [2025-10-07T18:07:32.292133] [INFO ] [MAIN ] CNM: Loaded 51030 existing records. [2025-10-07T18:07:32.469763] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:07:32.470136] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-07T18:07:32.470327] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-07T18:07:32.471833] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-07T18:07:32.471896] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-07T18:07:32.649461] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-07T18:07:32.803976] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T18:07:32.880435] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:07:33.447717] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-07T18:07:33.860177] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T18:07:34.247681] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-07T18:07:34.563190] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T18:07:35.047700] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-07T18:07:35.424673] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T18:07:35.847676] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-07T18:07:36.084584] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T18:07:36.647695] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-07T18:07:36.656818] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T18:07:37.270731] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T18:07:37.447711] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-07T18:07:38.247679] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-07T18:07:38.309162] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T18:07:38.798414] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T18:07:39.047692] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-07T18:07:39.697423] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T18:07:39.847675] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-07T18:07:40.647716] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-07T18:07:40.837456] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T18:07:41.059103] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T18:07:41.447694] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-07T18:07:42.253769] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-07T18:07:42.270827] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:07:42.771422] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T18:07:43.047713] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-07T18:07:43.847626] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-07T18:07:43.864346] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T18:07:43.867838] [INFO ] [REMOTE ] CNI: Full fetch complete (74577 records). [2025-10-07T18:07:43.867996] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-07T18:07:44.252990] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-07T18:07:44.253080] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-07T18:07:44.253911] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-07T18:07:44.253980] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-07T18:07:44.255381] [DEBUG] [LOCAL ] CNI: Trimmed 74577 records to 51675 (keeping 200 days of data) [2025-10-07T18:07:44.581669] [DEBUG] [LOCAL ] CNI: Primary data saved (51675 records). [2025-10-07T18:07:44.581807] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-07T18:07:44.581890] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNI took 32.6s. Estimated remaining: 4h 19m 7s. Rate: 7.3 symbols/min [2025-10-07T18:07:44.649236] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-07T18:07:44.708453] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T18:07:44.771462] [INFO ] [REMOTE ] CNH: Full fetch complete (77539 records). [2025-10-07T18:07:44.779300] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-07T18:07:44.779211] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:07:45.102685] [DEBUG] [LOCAL ] CNMD: Loaded 32267 existing records from primary storage. [2025-10-07T18:07:45.113268] [INFO ] [MAIN ] CNMD: Loaded 32267 existing records. [2025-10-07T18:07:45.312397] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-07T18:07:45.312932] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-07T18:07:45.314011] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-07T18:07:45.319588] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-07T18:07:45.391502] [DEBUG] [LOCAL ] CNH: Trimmed 77539 records to 53551 (keeping 200 days of data) [2025-10-07T18:07:45.395212] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:07:45.396342] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-07T18:07:45.396721] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-07T18:07:45.396976] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-07T18:07:45.397034] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-07T18:07:45.882179] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:07:45.901285] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-07T18:07:45.904915] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-07T18:07:46.137066] [DEBUG] [LOCAL ] CNH: Primary data saved (53551 records). [2025-10-07T18:07:46.137310] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-07T18:07:46.137466] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNH took 36.6s. Estimated remaining: 4h 18m 33s. Rate: 7.3 symbols/min [2025-10-07T18:07:46.251722] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-07T18:07:46.313686] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:07:46.345969] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T18:07:46.385444] [DEBUG] [LOCAL ] CNNE: Loaded 36348 existing records from primary storage. [2025-10-07T18:07:46.385761] [INFO ] [MAIN ] CNNE: Loaded 36348 existing records. [2025-10-07T18:07:46.559077] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:07:46.559287] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-07T18:07:46.559335] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-07T18:07:46.559561] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-07T18:07:46.559617] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-07T18:07:46.906615] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:07:47.003443] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T18:07:47.047612] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-07T18:07:47.565328] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T18:07:47.568915] [INFO ] [REMOTE ] CNK: Full fetch complete (75834 records). [2025-10-07T18:07:47.569029] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-07T18:07:47.856040] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-07T18:07:47.975120] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-07T18:07:47.975208] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-07T18:07:47.976132] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-07T18:07:47.976200] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-07T18:07:47.978041] [DEBUG] [LOCAL ] CNK: Trimmed 75834 records to 52883 (keeping 200 days of data) [2025-10-07T18:07:48.248446] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T18:07:48.356608] [DEBUG] [LOCAL ] CNK: Primary data saved (52883 records). [2025-10-07T18:07:48.356785] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-07T18:07:48.358267] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNK took 32.0s. Estimated remaining: 4h 18m 1s. Rate: 7.3 symbols/min [2025-10-07T18:07:48.524469] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:07:48.564849] [DEBUG] [LOCAL ] CNO: Loaded 40924 existing records from primary storage. [2025-10-07T18:07:48.565158] [INFO ] [MAIN ] CNO: Loaded 40924 existing records. [2025-10-07T18:07:48.654869] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-07T18:07:48.745946] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:07:48.746146] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-07T18:07:48.746195] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-07T18:07:48.746424] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-07T18:07:48.746482] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-07T18:07:49.111945] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:07:49.320718] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T18:07:49.447600] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-07T18:07:49.937842] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T18:07:50.247615] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-07T18:07:51.047740] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-07T18:07:51.136240] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T18:07:51.847717] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-07T18:07:51.877798] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T18:07:52.157392] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T18:07:52.647688] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-07T18:07:53.447735] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-07T18:07:53.607854] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T18:07:53.775108] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T18:07:54.247694] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-07T18:07:54.777163] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T18:07:55.047695] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-07T18:07:55.581948] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T18:07:55.847685] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-07T18:07:56.425762] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T18:07:56.647695] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-07T18:07:56.895090] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T18:07:57.447752] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-07T18:07:58.209814] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T18:07:58.247616] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-07T18:07:59.047614] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-07T18:07:59.200535] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T18:07:59.761891] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T18:07:59.847609] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-07T18:08:00.537274] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T18:08:00.647732] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-07T18:08:01.025943] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T18:08:01.447765] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-07T18:08:02.238758] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T18:08:02.247993] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-07T18:08:02.650748] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T18:08:02.654245] [INFO ] [REMOTE ] CNM: Full fetch complete (73641 records). [2025-10-07T18:08:02.654386] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-07T18:08:03.046767] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-07T18:08:03.046947] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-07T18:08:03.048098] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-07T18:08:03.048173] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-07T18:08:03.048454] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-07T18:08:03.051004] [DEBUG] [LOCAL ] CNM: Trimmed 73641 records to 51054 (keeping 200 days of data) [2025-10-07T18:08:03.365802] [DEBUG] [LOCAL ] CNM: Primary data saved (51054 records). [2025-10-07T18:08:03.365955] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-07T18:08:03.366047] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNM took 31.3s. Estimated remaining: 4h 18m 19s. Rate: 7.3 symbols/min [2025-10-07T18:08:03.533328] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:08:03.584030] [DEBUG] [LOCAL ] CNP: Loaded 53471 existing records from primary storage. [2025-10-07T18:08:03.584357] [INFO ] [MAIN ] CNP: Loaded 53471 existing records. [2025-10-07T18:08:03.780543] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:08:03.800129] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-07T18:08:03.800203] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-07T18:08:03.800940] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-07T18:08:03.800867] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T18:08:03.801115] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-07T18:08:03.850688] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-07T18:08:04.177721] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:08:04.436969] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T18:08:04.647699] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-07T18:08:05.447683] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-07T18:08:05.549440] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T18:08:06.081464] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T18:08:06.247702] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-07T18:08:07.047695] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-07T18:08:07.190882] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T18:08:07.847727] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-07T18:08:07.994018] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T18:08:08.182704] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-07T18:08:08.647683] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-07T18:08:09.447699] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-07T18:08:09.741601] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T18:08:10.090937] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T18:08:10.247667] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-07T18:08:10.981395] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T18:08:11.047637] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-07T18:08:11.248133] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T18:08:11.847704] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-07T18:08:12.572853] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T18:08:12.647696] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-07T18:08:13.135916] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T18:08:13.138796] [INFO ] [REMOTE ] CNNE: Full fetch complete (50257 records). [2025-10-07T18:08:13.139116] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-07T18:08:13.454730] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-07T18:08:13.703166] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-07T18:08:13.703303] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-07T18:08:13.704748] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-07T18:08:13.704872] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-07T18:08:13.706742] [DEBUG] [LOCAL ] CNNE: Trimmed 50257 records to 36320 (keeping 200 days of data) [2025-10-07T18:08:14.029398] [DEBUG] [LOCAL ] CNNE: Primary data saved (36320 records). [2025-10-07T18:08:14.029594] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-07T18:08:14.029771] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNNE took 27.9s. Estimated remaining: 4h 18m 20s. Rate: 7.3 symbols/min [2025-10-07T18:08:14.235564] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:08:14.247749] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-07T18:08:14.305538] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T18:08:14.347060] [DEBUG] [LOCAL ] CNQ: Loaded 53577 existing records from primary storage. [2025-10-07T18:08:14.347524] [INFO ] [MAIN ] CNQ: Loaded 53577 existing records. [2025-10-07T18:08:14.538901] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:08:14.539160] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-07T18:08:14.539209] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-07T18:08:14.539521] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-07T18:08:14.539580] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-07T18:08:14.904914] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:08:14.917968] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T18:08:15.047604] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-07T18:08:15.847715] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-07T18:08:15.916235] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T18:08:16.647701] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-07T18:08:16.770318] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T18:08:17.116319] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T18:08:17.447635] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-07T18:08:18.247684] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-07T18:08:18.308909] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T18:08:18.991179] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T18:08:19.047670] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-07T18:08:19.847708] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-07T18:08:20.029729] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T18:08:20.647596] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-07T18:08:20.728301] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T18:08:21.077962] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T18:08:21.447677] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-07T18:08:21.684502] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T18:08:21.686680] [INFO ] [REMOTE ] CNMD: Full fetch complete (47124 records). [2025-10-07T18:08:21.686762] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-07T18:08:21.687684] [FATAL] [VALIDATOR ] CNMD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:08:21.687784] [FATAL] [MAIN ] CNMD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:08:21.687856] [WARN ] [MAIN ] CNMD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:08:21.687975] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-07T18:08:21.688074] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-07T18:08:21.688136] [INFO ] [LOCAL ] CNMD: Starting deletion of derivative data. [2025-10-07T18:08:21.688421] [DEBUG] [LOCAL ] CNMD: Deleted derivative data file. [2025-10-07T18:08:21.688562] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNMD took 37.1s. Estimated remaining: 4h 18m 9s. Rate: 7.3 symbols/min [2025-10-07T18:08:21.856411] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:08:21.856603] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-07T18:08:21.856676] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-07T18:08:21.856810] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-07T18:08:21.856873] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-07T18:08:21.856945] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-07T18:08:21.857008] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-07T18:08:22.234469] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:08:22.247614] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-07T18:08:23.047621] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-07T18:08:23.255996] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:08:23.256330] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-07T18:08:23.256434] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:08:23.256490] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-07T18:08:23.256554] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:08:23.256638] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-07T18:08:23.256757] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-07T18:08:23.256802] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-07T18:08:23.256844] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-07T18:08:23.256894] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNR took 1.6s. Estimated remaining: 4h 17m 36s. Rate: 7.3 symbols/min [2025-10-07T18:08:23.476518] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T18:08:23.482419] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:08:23.514239] [DEBUG] [LOCAL ] CNS: Loaded 20806 existing records from primary storage. [2025-10-07T18:08:23.514509] [INFO ] [MAIN ] CNS: Loaded 20806 existing records. [2025-10-07T18:08:23.698283] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:08:23.698607] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-07T18:08:23.698811] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-07T18:08:23.699053] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-07T18:08:23.699109] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-07T18:08:23.850918] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-07T18:08:24.084248] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:08:24.120761] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T18:08:24.647708] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-07T18:08:25.447618] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-07T18:08:25.778375] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T18:08:25.798707] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T18:08:26.247740] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-07T18:08:26.692408] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T18:08:26.696169] [INFO ] [REMOTE ] CNO: Full fetch complete (60666 records). [2025-10-07T18:08:26.696345] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-07T18:08:27.052923] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-07T18:08:27.129522] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-07T18:08:27.129628] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-07T18:08:27.130399] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-07T18:08:27.130455] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-07T18:08:27.131875] [DEBUG] [LOCAL ] CNO: Trimmed 60666 records to 40903 (keeping 200 days of data) [2025-10-07T18:08:27.367975] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T18:08:27.408421] [DEBUG] [LOCAL ] CNO: Primary data saved (40903 records). [2025-10-07T18:08:27.408566] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-07T18:08:27.409392] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNO took 39.1s. Estimated remaining: 4h 17m 12s. Rate: 7.3 symbols/min [2025-10-07T18:08:27.581584] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:08:27.632843] [DEBUG] [LOCAL ] CNX: Loaded 51353 existing records from primary storage. [2025-10-07T18:08:27.633167] [INFO ] [MAIN ] CNX: Loaded 51353 existing records. [2025-10-07T18:08:27.809845] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:08:27.810112] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-07T18:08:27.810184] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-07T18:08:27.810398] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-07T18:08:27.810439] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-07T18:08:27.852992] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-07T18:08:28.163190] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:08:28.647615] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-07T18:08:28.840553] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T18:08:29.457256] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T18:08:29.454346] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-07T18:08:29.571172] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T18:08:30.247697] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-07T18:08:31.047615] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-07T18:08:31.198913] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T18:08:31.847622] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-07T18:08:32.033213] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T18:08:32.647615] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-07T18:08:32.681695] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T18:08:33.447614] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-07T18:08:33.691350] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T18:08:34.151679] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T18:08:34.247594] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-07T18:08:34.305494] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T18:08:35.047715] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-07T18:08:35.847618] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-07T18:08:35.981293] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T18:08:36.620512] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T18:08:36.647627] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-07T18:08:37.198674] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T18:08:37.447737] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-07T18:08:38.249602] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-07T18:08:38.258185] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T18:08:39.047712] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-07T18:08:39.333678] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T18:08:39.450417] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T18:08:39.847718] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-07T18:08:39.950158] [DEBUG] [REMOTE ] CNS: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-07T18:08:39.950443] [WARN ] [REMOTE ] CNS: No data returned for month 2025-06 [2025-10-07T18:08:39.950531] [FATAL] [REMOTE ] CNS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:08:39.950611] [FATAL] [MAIN ] CNS: Failed to fetch primary data. [2025-10-07T18:08:39.950695] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:08:39.950771] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-07T18:08:39.950837] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-07T18:08:39.950872] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-07T18:08:39.951030] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-10-07T18:08:39.951114] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNS took 16.7s. Estimated remaining: 4h 17m 20s. Rate: 7.3 symbols/min [2025-10-07T18:08:40.120532] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:08:40.161724] [DEBUG] [LOCAL ] CODI: Loaded 40433 existing records from primary storage. [2025-10-07T18:08:40.162069] [INFO ] [MAIN ] CODI: Loaded 40433 existing records. [2025-10-07T18:08:40.333631] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:08:40.333895] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-07T18:08:40.333958] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-07T18:08:40.334312] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-07T18:08:40.334368] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-07T18:08:40.651482] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-07T18:08:40.686425] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:08:40.719999] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T18:08:41.447707] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-07T18:08:42.247697] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-07T18:08:42.453616] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T18:08:42.457238] [INFO ] [REMOTE ] CNQ: Full fetch complete (77552 records). [2025-10-07T18:08:42.457354] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-07T18:08:42.845741] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-07T18:08:42.845842] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-07T18:08:42.846704] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-07T18:08:42.846768] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-07T18:08:42.848259] [DEBUG] [LOCAL ] CNQ: Trimmed 77552 records to 53577 (keeping 200 days of data) [2025-10-07T18:08:43.063326] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-07T18:08:43.183025] [DEBUG] [LOCAL ] CNQ: Primary data saved (53577 records). [2025-10-07T18:08:43.183176] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-07T18:08:43.183264] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNQ took 29.2s. Estimated remaining: 4h 16m 53s. Rate: 7.3 symbols/min [2025-10-07T18:08:43.387803] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:08:43.390169] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T18:08:43.448018] [DEBUG] [LOCAL ] COF: Loaded 53609 existing records from primary storage. [2025-10-07T18:08:43.448353] [INFO ] [MAIN ] COF: Loaded 53609 existing records. [2025-10-07T18:08:43.621880] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:08:43.622086] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-07T18:08:43.622133] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-07T18:08:43.622480] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-07T18:08:43.622544] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-07T18:08:43.859275] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-07T18:08:43.979281] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:08:44.087273] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T18:08:44.215753] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T18:08:44.647630] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-07T18:08:45.405043] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T18:08:45.447601] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-07T18:08:46.247620] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-07T18:08:46.302814] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T18:08:46.963699] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T18:08:46.967515] [INFO ] [REMOTE ] CNP: Full fetch complete (77370 records). [2025-10-07T18:08:46.967721] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-07T18:08:47.053006] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-07T18:08:47.371449] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-07T18:08:47.371600] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-07T18:08:47.372509] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-07T18:08:47.372580] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-07T18:08:47.374263] [DEBUG] [LOCAL ] CNP: Trimmed 77370 records to 53475 (keeping 200 days of data) [2025-10-07T18:08:47.703432] [DEBUG] [LOCAL ] CNP: Primary data saved (53475 records). [2025-10-07T18:08:47.703573] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-07T18:08:47.703679] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNP took 44.3s. Estimated remaining: 4h 16m 31s. Rate: 7.3 symbols/min [2025-10-07T18:08:47.848881] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-07T18:08:47.874510] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:08:47.876099] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-07T18:08:47.876188] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-07T18:08:47.876454] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-07T18:08:47.876669] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-07T18:08:47.876760] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-07T18:08:47.876960] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-07T18:08:48.277831] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-07T18:08:48.372705] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:08:48.421373] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T18:08:48.647735] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-07T18:08:48.944794] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T18:08:49.447686] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-07T18:08:50.247625] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-07T18:08:50.306682] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T18:08:50.391681] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T18:08:51.047694] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-07T18:08:51.847624] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-07T18:08:52.277577] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-07T18:08:52.647618] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-07T18:08:52.826314] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T18:08:53.105717] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T18:08:53.447757] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-07T18:08:54.247639] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-07T18:08:54.583182] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-07T18:08:54.802280] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T18:08:55.047726] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-07T18:08:55.556428] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T18:08:55.847680] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-07T18:08:56.563320] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T18:08:56.647696] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-07T18:08:57.447625] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-07T18:08:57.864512] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-07T18:08:57.976988] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T18:08:58.247690] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-07T18:08:59.047634] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-07T18:08:59.499121] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-07T18:08:59.847626] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-07T18:08:59.902679] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T18:09:00.647626] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-07T18:09:01.000354] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-07T18:09:01.447784] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-07T18:09:01.884400] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T18:09:01.888327] [INFO ] [REMOTE ] CNX: Full fetch complete (74745 records). [2025-10-07T18:09:01.888533] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-07T18:09:02.254068] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-07T18:09:02.315717] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-07T18:09:02.315958] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-07T18:09:02.316886] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-07T18:09:02.317031] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-07T18:09:02.318989] [DEBUG] [LOCAL ] CNX: Trimmed 74745 records to 51355 (keeping 200 days of data) [2025-10-07T18:09:02.436258] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-07T18:09:02.661239] [DEBUG] [LOCAL ] CNX: Primary data saved (51355 records). [2025-10-07T18:09:02.661386] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-07T18:09:02.662321] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNX took 35.3s. Estimated remaining: 4h 16m 48s. Rate: 7.3 symbols/min [2025-10-07T18:09:02.826977] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:09:02.885823] [DEBUG] [LOCAL ] COLD: Loaded 52161 existing records from primary storage. [2025-10-07T18:09:02.886160] [INFO ] [MAIN ] COLD: Loaded 52161 existing records. [2025-10-07T18:09:03.056742] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-07T18:09:03.061494] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:09:03.062679] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-07T18:09:03.062743] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-07T18:09:03.062950] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-07T18:09:03.063008] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-07T18:09:03.444898] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:09:03.485949] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T18:09:03.565453] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T18:09:03.847615] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-07T18:09:04.647753] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-07T18:09:05.191172] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-07T18:09:05.371764] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T18:09:05.447720] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-07T18:09:06.247749] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-07T18:09:06.525334] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T18:09:07.047685] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-07T18:09:07.375967] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T18:09:07.847665] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-07T18:09:07.882113] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T18:09:08.647611] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-07T18:09:08.809997] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T18:09:09.447637] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-07T18:09:09.752893] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T18:09:09.755373] [INFO ] [REMOTE ] CODI: Full fetch complete (51158 records). [2025-10-07T18:09:09.755481] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-07T18:09:09.756186] [FATAL] [VALIDATOR ] CODI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:09:09.756274] [FATAL] [MAIN ] CODI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:09:09.756317] [WARN ] [MAIN ] CODI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:09:09.756384] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-07T18:09:09.756450] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-07T18:09:09.756486] [INFO ] [LOCAL ] CODI: Starting deletion of derivative data. [2025-10-07T18:09:09.756699] [DEBUG] [LOCAL ] CODI: Deleted derivative data file. [2025-10-07T18:09:09.756792] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CODI took 29.8s. Estimated remaining: 4h 16m 35s. Rate: 7.3 symbols/min [2025-10-07T18:09:09.933091] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:09:09.933317] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-07T18:09:09.933372] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-07T18:09:09.933483] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-07T18:09:09.933525] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-07T18:09:09.933566] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-07T18:09:09.933598] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-07T18:09:10.137722] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-07T18:09:10.250186] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-07T18:09:10.330481] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:09:11.047700] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-07T18:09:11.556004] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-07T18:09:11.822865] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T18:09:11.847606] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-07T18:09:12.647688] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-07T18:09:13.013204] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T18:09:13.360259] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T18:09:13.447595] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-07T18:09:14.247686] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-07T18:09:14.520719] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T18:09:14.923430] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T18:09:15.047622] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-07T18:09:15.693319] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T18:09:15.847631] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-07T18:09:16.647719] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-07T18:09:16.738562] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T18:09:17.447634] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-07T18:09:17.607469] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T18:09:18.247659] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-07T18:09:18.512701] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T18:09:19.047627] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-07T18:09:19.414749] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T18:09:19.847678] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-07T18:09:20.192335] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T18:09:20.547218] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T18:09:20.552974] [INFO ] [REMOTE ] COF: Full fetch complete (77441 records). [2025-10-07T18:09:20.553222] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-07T18:09:20.652914] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-07T18:09:20.999052] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-07T18:09:20.999185] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-07T18:09:21.000233] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-07T18:09:21.000304] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-07T18:09:21.002378] [DEBUG] [LOCAL ] COF: Trimmed 77441 records to 53609 (keeping 200 days of data) [2025-10-07T18:09:21.358582] [DEBUG] [LOCAL ] COF: Primary data saved (53609 records). [2025-10-07T18:09:21.358780] [INFO ] [MAIN ] COF: Full history saved. [2025-10-07T18:09:21.358896] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 38.2s. Estimated remaining: 4h 16m 39s. Rate: 7.3 symbols/min [2025-10-07T18:09:21.449575] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-07T18:09:21.534078] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:09:21.565477] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T18:09:21.606867] [DEBUG] [LOCAL ] CON: Loaded 38814 existing records from primary storage. [2025-10-07T18:09:21.607172] [INFO ] [MAIN ] CON: Loaded 38814 existing records. [2025-10-07T18:09:21.782072] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:09:21.782282] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-07T18:09:21.782329] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-07T18:09:21.782593] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-07T18:09:21.782702] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-07T18:09:22.142173] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:09:22.176877] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T18:09:22.247610] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-07T18:09:23.047633] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-07T18:09:23.517927] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-07T18:09:23.847674] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-07T18:09:24.064676] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T18:09:24.647629] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-07T18:09:24.745711] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T18:09:25.447755] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-07T18:09:25.667110] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:09:26.247635] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-07T18:09:26.369796] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T18:09:26.966698] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T18:09:27.047699] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-07T18:09:27.847620] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-07T18:09:28.378506] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-07T18:09:28.421126] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T18:09:28.647716] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-07T18:09:29.447716] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-07T18:09:29.866886] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-07T18:09:30.247682] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-07T18:09:30.852966] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-07T18:09:30.856456] [INFO ] [REMOTE ] COHR: Full fetch complete (77155 records). [2025-10-07T18:09:30.856577] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-07T18:09:31.050772] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-07T18:09:31.263188] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-07T18:09:31.263408] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-07T18:09:31.264511] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-07T18:09:31.264632] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-07T18:09:31.294310] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T18:09:31.292858] [DEBUG] [LOCAL ] COHR: Trimmed 77155 records to 53365 (keeping 200 days of data) [2025-10-07T18:09:31.629501] [DEBUG] [LOCAL ] COHR: Primary data saved (53365 records). [2025-10-07T18:09:31.629690] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-07T18:09:31.629801] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COHR took 43.9s. Estimated remaining: 4h 16m 39s. Rate: 7.3 symbols/min [2025-10-07T18:09:31.741794] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T18:09:31.766263] [INFO ] [REMOTE ] COLD: Full fetch complete (74011 records). [2025-10-07T18:09:31.790564] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-07T18:09:31.833606] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:09:31.834720] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:09:31.834865] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:09:31.834936] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:09:31.835009] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-07T18:09:31.835091] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-07T18:09:31.835148] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-07T18:09:31.835363] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-07T18:09:31.836582] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COLD took 29.2s. Estimated remaining: 4h 16m 1s. Rate: 7.3 symbols/min [2025-10-07T18:09:31.852755] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-07T18:09:32.015566] [DEBUG] [LOCAL ] COOK: Loaded 24317 existing records from primary storage. [2025-10-07T18:09:32.032736] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:09:32.033121] [INFO ] [MAIN ] COOK: Loaded 24317 existing records. [2025-10-07T18:09:32.033239] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-10-07T18:09:32.033324] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-10-07T18:09:32.077476] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-07T18:09:32.099250] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-07T18:09:32.111170] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-07T18:09:32.136072] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-07T18:09:32.370008] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:09:32.379755] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-07T18:09:32.380146] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-07T18:09:32.395755] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-07T18:09:32.404827] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-07T18:09:32.825497] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:09:32.833814] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-07T18:09:33.006039] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:09:33.039909] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-07T18:09:33.190344] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T18:09:33.447757] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-07T18:09:34.247740] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-07T18:09:34.679586] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T18:09:35.047625] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-07T18:09:35.473286] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-07T18:09:35.537926] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T18:09:35.847699] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-07T18:09:35.918752] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T18:09:36.647761] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-07T18:09:37.006498] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T18:09:37.447718] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-07T18:09:38.247705] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-07T18:09:38.574973] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T18:09:39.047678] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-07T18:09:39.504251] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-10-07T18:09:39.847704] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-07T18:09:40.082167] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T18:09:40.271984] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-07T18:09:40.647762] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-07T18:09:41.447619] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-07T18:09:41.803018] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-07T18:09:42.093403] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T18:09:42.120321] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T18:09:42.247717] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-07T18:09:43.047688] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-07T18:09:43.847629] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-07T18:09:43.881942] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T18:09:43.885948] [INFO ] [REMOTE ] COMP: Full fetch complete (77192 records). [2025-10-07T18:09:43.886087] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-07T18:09:44.270280] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-07T18:09:44.270376] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-07T18:09:44.271258] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-07T18:09:44.271336] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-07T18:09:44.272889] [DEBUG] [LOCAL ] COMP: Trimmed 77192 records to 53401 (keeping 200 days of data) [2025-10-07T18:09:44.594463] [DEBUG] [LOCAL ] COMP: Primary data saved (53401 records). [2025-10-07T18:09:44.594609] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-07T18:09:44.594724] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COMP took 34.8s. Estimated remaining: 4h 16m 9s. Rate: 7.3 symbols/min [2025-10-07T18:09:44.656910] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-07T18:09:44.764294] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:09:44.806563] [DEBUG] [LOCAL ] COR: Loaded 46949 existing records from primary storage. [2025-10-07T18:09:44.806914] [INFO ] [MAIN ] COR: Loaded 46949 existing records. [2025-10-07T18:09:44.983493] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:09:44.983767] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-07T18:09:44.983844] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-07T18:09:44.984287] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-07T18:09:44.984413] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-07T18:09:45.242064] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-07T18:09:45.460185] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-07T18:09:45.466751] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:09:45.487397] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T18:09:45.640421] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T18:09:46.247697] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-07T18:09:47.047741] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-07T18:09:47.418273] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T18:09:47.494723] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T18:09:47.847748] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-07T18:09:48.587512] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T18:09:48.647616] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-07T18:09:49.128176] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T18:09:49.447688] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-07T18:09:50.095739] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T18:09:50.247715] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-07T18:09:50.819933] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T18:09:51.047633] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-07T18:09:51.644808] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T18:09:51.847721] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-07T18:09:52.387629] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T18:09:52.647726] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-07T18:09:53.245593] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T18:09:53.447699] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-07T18:09:54.247634] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-07T18:09:54.349688] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T18:09:54.827613] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-07T18:09:55.047712] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-07T18:09:55.636461] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T18:09:55.847700] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-07T18:09:56.647638] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-07T18:09:56.740803] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T18:09:57.104612] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T18:09:57.107503] [INFO ] [REMOTE ] CON: Full fetch complete (56877 records). [2025-10-07T18:09:57.107611] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-07T18:09:57.457282] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-07T18:09:57.503796] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-07T18:09:57.503876] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-07T18:09:57.504533] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-07T18:09:57.504575] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-07T18:09:57.505831] [DEBUG] [LOCAL ] CON: Trimmed 56877 records to 38863 (keeping 200 days of data) [2025-10-07T18:09:57.752143] [DEBUG] [LOCAL ] CON: Primary data saved (38863 records). [2025-10-07T18:09:57.752302] [INFO ] [MAIN ] CON: Full history saved. [2025-10-07T18:09:57.752423] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 36.4s. Estimated remaining: 4h 16m 19s. Rate: 7.3 symbols/min [2025-10-07T18:09:57.950812] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:09:58.023378] [DEBUG] [LOCAL ] COTY: Loaded 53238 existing records from primary storage. [2025-10-07T18:09:58.024139] [INFO ] [MAIN ] COTY: Loaded 53238 existing records. [2025-10-07T18:09:58.256592] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-07T18:09:58.330163] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:09:58.371281] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-07T18:09:58.371603] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-07T18:09:58.374618] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T18:09:58.374787] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-07T18:09:58.375129] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-07T18:09:58.909843] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:09:59.047688] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-07T18:09:59.094091] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T18:09:59.847752] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-07T18:10:00.218698] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T18:10:00.647796] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-07T18:10:01.065252] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-07T18:10:01.187808] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T18:10:01.447742] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-07T18:10:02.247720] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-07T18:10:02.538785] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T18:10:03.046910] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T18:10:03.056624] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-07T18:10:03.847714] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-07T18:10:04.211092] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T18:10:04.213539] [INFO ] [REMOTE ] COOK: Full fetch complete (32686 records). [2025-10-07T18:10:04.213621] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-07T18:10:04.585801] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-07T18:10:04.661522] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-07T18:10:04.713609] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-07T18:10:04.713743] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-07T18:10:04.714429] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-07T18:10:04.714704] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-07T18:10:04.715599] [DEBUG] [LOCAL ] COOK: Trimmed 32686 records to 24428 (keeping 200 days of data) [2025-10-07T18:10:04.859584] [DEBUG] [LOCAL ] COOK: Primary data saved (24428 records). [2025-10-07T18:10:04.859746] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-07T18:10:04.859837] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COOK took 33.2s. Estimated remaining: 4h 16m 6s. Rate: 7.3 symbols/min [2025-10-07T18:10:05.035012] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:10:05.035210] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-10-07T18:10:05.035250] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-10-07T18:10:05.035376] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-07T18:10:05.035463] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-07T18:10:05.035528] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-07T18:10:05.035564] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-07T18:10:05.393120] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:10:05.447610] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-07T18:10:05.519172] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T18:10:06.247675] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-07T18:10:06.592406] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T18:10:07.047751] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-07T18:10:07.403734] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T18:10:07.847668] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-07T18:10:08.093944] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:10:08.330408] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T18:10:08.647617] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-07T18:10:09.447595] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T18:10:09.447708] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-07T18:10:09.848044] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-07T18:10:09.851665] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-07T18:10:09.851780] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-07T18:10:10.249094] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-07T18:10:10.249613] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-07T18:10:10.250946] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-07T18:10:10.251936] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-07T18:10:10.252019] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-07T18:10:10.253979] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 53727 (keeping 200 days of data) [2025-10-07T18:10:10.284451] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T18:10:10.633445] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-07T18:10:10.633596] [INFO ] [MAIN ] COP: Full history saved. [2025-10-07T18:10:10.633695] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 38.8s. Estimated remaining: 4h 15m 49s. Rate: 7.3 symbols/min [2025-10-07T18:10:10.804006] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:10:10.855073] [DEBUG] [LOCAL ] CP: Loaded 53262 existing records from primary storage. [2025-10-07T18:10:10.855434] [INFO ] [MAIN ] CP: Loaded 53262 existing records. [2025-10-07T18:10:11.036500] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:10:11.038016] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-07T18:10:11.038081] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-07T18:10:11.039205] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-07T18:10:11.039266] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-07T18:10:11.052793] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-07T18:10:11.402594] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:10:11.847630] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-07T18:10:12.064997] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:10:12.647612] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-07T18:10:13.007839] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T18:10:13.447634] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-07T18:10:13.803805] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T18:10:14.116056] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T18:10:14.247686] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-07T18:10:14.926063] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T18:10:15.047679] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-07T18:10:15.742488] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T18:10:15.745233] [INFO ] [REMOTE ] COR: Full fetch complete (68398 records). [2025-10-07T18:10:15.745395] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-07T18:10:15.746678] [FATAL] [VALIDATOR ] COR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:10:15.746808] [FATAL] [MAIN ] COR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:10:15.746867] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:10:15.746951] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-07T18:10:15.747036] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-07T18:10:15.747084] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-10-07T18:10:15.747343] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-10-07T18:10:15.747463] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COR took 31.2s. Estimated remaining: 4h 15m 29s. Rate: 7.3 symbols/min [2025-10-07T18:10:15.854747] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-07T18:10:15.936925] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:10:15.967316] [DEBUG] [LOCAL ] CPA: Loaded 28283 existing records from primary storage. [2025-10-07T18:10:15.967622] [INFO ] [MAIN ] CPA: Loaded 28283 existing records. [2025-10-07T18:10:16.142467] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:10:16.142721] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-07T18:10:16.142779] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-07T18:10:16.143011] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-07T18:10:16.143069] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-07T18:10:16.516049] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:10:16.545687] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T18:10:16.647713] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-07T18:10:17.410379] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T18:10:17.447637] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-07T18:10:18.247702] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-07T18:10:18.417099] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T18:10:19.048957] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-07T18:10:19.052032] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T18:10:19.640702] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T18:10:19.847697] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-07T18:10:20.647729] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-07T18:10:20.962411] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T18:10:21.147247] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T18:10:21.447724] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-07T18:10:22.188085] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T18:10:22.247740] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-07T18:10:22.679682] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T18:10:23.047685] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-07T18:10:23.847736] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-07T18:10:24.067432] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T18:10:24.647725] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-07T18:10:25.033235] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T18:10:25.060470] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T18:10:25.447719] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-07T18:10:25.999552] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T18:10:26.247681] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-07T18:10:26.873018] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T18:10:27.047710] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-07T18:10:27.847633] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-07T18:10:28.020773] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T18:10:28.647679] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-07T18:10:28.706796] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T18:10:29.447770] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-07T18:10:29.654215] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T18:10:30.247621] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-07T18:10:30.511387] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T18:10:30.641989] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T18:10:31.047694] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-07T18:10:31.850415] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-07T18:10:31.854036] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T18:10:32.647672] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-07T18:10:33.019522] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-07T18:10:33.447635] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-07T18:10:33.582590] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T18:10:33.969420] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T18:10:34.247775] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-07T18:10:34.932302] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T18:10:34.935903] [INFO ] [REMOTE ] COTY: Full fetch complete (77103 records). [2025-10-07T18:10:34.936054] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-07T18:10:35.052830] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-07T18:10:35.374873] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-07T18:10:35.374961] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-07T18:10:35.375945] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-07T18:10:35.376014] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-07T18:10:35.377512] [DEBUG] [LOCAL ] COTY: Trimmed 77103 records to 53239 (keeping 200 days of data) [2025-10-07T18:10:35.680671] [DEBUG] [LOCAL ] COTY: Primary data saved (53239 records). [2025-10-07T18:10:35.680930] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-07T18:10:35.681047] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COTY took 37.9s. Estimated remaining: 4h 16m 4s. Rate: 7.3 symbols/min [2025-10-07T18:10:35.851180] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:10:35.851381] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-07T18:10:35.848337] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-07T18:10:35.852631] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-07T18:10:35.852822] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-07T18:10:35.852898] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-07T18:10:35.852988] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-07T18:10:35.853041] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-07T18:10:36.313071] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-07T18:10:36.315709] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:10:36.435297] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T18:10:36.647729] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-07T18:10:37.240686] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-07T18:10:37.447676] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-07T18:10:37.486078] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T18:10:38.247736] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-07T18:10:38.996543] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T18:10:39.047609] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-07T18:10:39.851811] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-07T18:10:39.853902] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T18:10:39.859088] [INFO ] [REMOTE ] COUR: Full fetch complete (70892 records). [2025-10-07T18:10:39.859248] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-07T18:10:40.293718] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-07T18:10:40.293825] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-07T18:10:40.294614] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-07T18:10:40.294692] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-07T18:10:40.296351] [DEBUG] [LOCAL ] COUR: Trimmed 70892 records to 49046 (keeping 200 days of data) [2025-10-07T18:10:40.381523] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-07T18:10:40.583953] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T18:10:40.590031] [INFO ] [REMOTE ] CP: Full fetch complete (77126 records). [2025-10-07T18:10:40.590774] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-07T18:10:40.654745] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-07T18:10:40.766993] [DEBUG] [LOCAL ] COUR: Primary data saved (49046 records). [2025-10-07T18:10:40.782440] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-07T18:10:40.783070] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. COUR took 35.9s. Estimated remaining: 4h 15m 44s. Rate: 7.3 symbols/min [2025-10-07T18:10:41.173580] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-07T18:10:41.173390] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:10:41.174404] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-07T18:10:41.175266] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-07T18:10:41.175329] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-07T18:10:41.177246] [DEBUG] [LOCAL ] CP: Trimmed 77126 records to 53265 (keeping 200 days of data) [2025-10-07T18:10:41.292007] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T18:10:41.317237] [DEBUG] [LOCAL ] CPAY: Loaded 30485 existing records from primary storage. [2025-10-07T18:10:41.320212] [INFO ] [MAIN ] CPAY: Loaded 30485 existing records. [2025-10-07T18:10:41.449527] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-07T18:10:41.525127] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:10:41.526162] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-07T18:10:41.526690] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-07T18:10:41.527437] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-07T18:10:41.528280] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-07T18:10:41.996442] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:10:42.132922] [DEBUG] [LOCAL ] CP: Primary data saved (53265 records). [2025-10-07T18:10:42.133083] [INFO ] [MAIN ] CP: Full history saved. [2025-10-07T18:10:42.134170] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CP took 31.5s. Estimated remaining: 4h 15m 11s. Rate: 7.3 symbols/min [2025-10-07T18:10:42.252830] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-07T18:10:42.302016] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:10:42.319758] [DEBUG] [LOCAL ] CPF: Loaded 15213 existing records from primary storage. [2025-10-07T18:10:42.320010] [INFO ] [MAIN ] CPF: Loaded 15213 existing records. [2025-10-07T18:10:42.492052] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:10:42.492282] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-07T18:10:42.492329] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-07T18:10:42.492568] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-07T18:10:42.492625] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-07T18:10:42.649845] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-07T18:10:42.853833] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:10:43.047615] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-07T18:10:43.071977] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T18:10:43.847747] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-07T18:10:44.153632] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T18:10:44.221310] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-07T18:10:44.647739] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-07T18:10:45.447683] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-07T18:10:46.117333] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T18:10:46.136063] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T18:10:46.247616] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-07T18:10:46.515742] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-07T18:10:47.047701] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-07T18:10:47.847684] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-07T18:10:48.307318] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T18:10:48.364824] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T18:10:48.647675] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-07T18:10:49.447632] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-07T18:10:49.699847] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T18:10:50.247754] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-07T18:10:50.582785] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-07T18:10:50.866289] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T18:10:51.047911] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-07T18:10:51.847768] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-07T18:10:52.029563] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T18:10:52.647711] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-07T18:10:53.047140] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T18:10:53.447723] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-07T18:10:53.608421] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T18:10:54.247693] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-07T18:10:54.622244] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-07T18:10:54.812183] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T18:10:55.047728] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-07T18:10:55.847752] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-07T18:10:56.371345] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T18:10:56.372227] [INFO ] [REMOTE ] CPAC: Full fetch complete (1871 records). [2025-10-07T18:10:56.372299] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-07T18:10:56.568421] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T18:10:56.568873] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:10:56.568965] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:10:56.569239] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-07T18:10:56.569384] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-07T18:10:56.569490] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-07T18:10:56.569614] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-07T18:10:56.570034] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPAC took 20.9s. Estimated remaining: 4h 15m 25s. Rate: 7.3 symbols/min [2025-10-07T18:10:56.652789] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-07T18:10:56.630959] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T18:10:56.780551] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:10:56.797717] [DEBUG] [LOCAL ] CPK: Loaded 13554 existing records from primary storage. [2025-10-07T18:10:56.798024] [INFO ] [MAIN ] CPK: Loaded 13554 existing records. [2025-10-07T18:10:56.976959] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:10:56.977215] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-07T18:10:56.977261] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-07T18:10:56.977477] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-07T18:10:56.977535] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-07T18:10:57.342507] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:10:57.447709] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-07T18:10:57.800110] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T18:10:58.247675] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-07T18:10:58.824584] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T18:10:59.047720] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-07T18:10:59.599060] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T18:10:59.791935] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-07T18:10:59.847726] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-07T18:11:00.647667] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-07T18:11:01.060208] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T18:11:01.447737] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-07T18:11:02.002461] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T18:11:02.247614] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-07T18:11:02.356774] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T18:11:03.047722] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-07T18:11:03.241827] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T18:11:03.847626] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-07T18:11:03.912723] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T18:11:04.647692] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-07T18:11:05.198578] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T18:11:05.315446] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-07T18:11:05.447679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-07T18:11:06.247718] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-07T18:11:06.685381] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T18:11:07.047682] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-07T18:11:07.284525] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T18:11:07.847624] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-07T18:11:07.931106] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T18:11:08.647707] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-07T18:11:09.258351] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T18:11:09.447710] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-07T18:11:09.547134] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T18:11:10.247683] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-07T18:11:10.494168] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T18:11:11.047665] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-07T18:11:11.322295] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T18:11:11.730067] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T18:11:11.731426] [INFO ] [REMOTE ] CPF: Full fetch complete (23942 records). [2025-10-07T18:11:11.731496] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-07T18:11:11.732063] [FATAL] [VALIDATOR ] CPF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:11:11.732145] [FATAL] [MAIN ] CPF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:11:11.732191] [WARN ] [MAIN ] CPF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:11:11.732277] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-07T18:11:11.732356] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-07T18:11:11.732405] [INFO ] [LOCAL ] CPF: Starting deletion of derivative data. [2025-10-07T18:11:11.732681] [DEBUG] [LOCAL ] CPF: Deleted derivative data file. [2025-10-07T18:11:11.732793] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CPF took 29.6s. Estimated remaining: 4h 15m 41s. Rate: 7.3 symbols/min [2025-10-07T18:11:11.852764] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-07T18:11:11.906109] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:11:11.906320] [DEBUG] [LOCAL ] CPNG: No existing data file found in primary storage. [2025-10-07T18:11:11.906424] [WARN ] [MAIN ] CPNG: No existing data found, performing full refresh instead. [2025-10-07T18:11:11.906543] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-07T18:11:11.906585] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-07T18:11:11.906628] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-07T18:11:11.906699] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-07T18:11:12.313265] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:11:12.647685] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-07T18:11:13.193882] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T18:11:13.447666] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-07T18:11:13.555845] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T18:11:14.247713] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-07T18:11:14.826255] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T18:11:14.862572] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T18:11:15.047709] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-07T18:11:15.847730] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-07T18:11:16.647758] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-07T18:11:17.093993] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T18:11:17.242461] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-07T18:11:17.447732] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-07T18:11:17.561871] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T18:11:18.247712] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-07T18:11:19.047666] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-07T18:11:19.110613] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T18:11:19.112265] [INFO ] [REMOTE ] CPK: Full fetch complete (18056 records). [2025-10-07T18:11:19.112336] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-07T18:11:19.474167] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-07T18:11:19.474379] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-07T18:11:19.474786] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-07T18:11:19.474848] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-07T18:11:19.475400] [DEBUG] [LOCAL ] CPK: Trimmed 18056 records to 13627 (keeping 200 days of data) [2025-10-07T18:11:19.576766] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-07T18:11:19.599478] [DEBUG] [LOCAL ] CPK: Primary data saved (13627 records). [2025-10-07T18:11:19.599593] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-07T18:11:19.599691] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPK took 23.0s. Estimated remaining: 4h 15m 32s. Rate: 7.3 symbols/min [2025-10-07T18:11:19.847705] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-07T18:11:20.300776] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T18:11:20.302806] [INFO ] [REMOTE ] CPA: Full fetch complete (41454 records). [2025-10-07T18:11:20.303009] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-07T18:11:20.649587] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-07T18:11:20.682447] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-07T18:11:20.682529] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-07T18:11:20.683100] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-07T18:11:20.683164] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-07T18:11:20.684072] [DEBUG] [LOCAL ] CPA: Trimmed 41454 records to 28274 (keeping 200 days of data) [2025-10-07T18:11:20.872442] [DEBUG] [LOCAL ] CPA: Primary data saved (28274 records). [2025-10-07T18:11:20.872628] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-07T18:11:20.872760] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPA took 1m 5s. Estimated remaining: 4h 14m 58s. Rate: 7.3 symbols/min [2025-10-07T18:11:21.202571] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T18:11:21.205799] [INFO ] [REMOTE ] CPAY: Full fetch complete (44971 records). [2025-10-07T18:11:21.205988] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-07T18:11:21.583522] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-07T18:11:21.583620] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-07T18:11:21.584371] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-07T18:11:21.584440] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-07T18:11:21.585930] [DEBUG] [LOCAL ] CPAY: Trimmed 44971 records to 30449 (keeping 200 days of data) [2025-10-07T18:11:21.786128] [DEBUG] [LOCAL ] CPAY: Primary data saved (30449 records). [2025-10-07T18:11:21.786333] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-07T18:11:21.786457] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPAY took 41.0s. Estimated remaining: 4h 14m 24s. Rate: 7.3 symbols/min [2025-10-07T18:11:22.733946] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-07T18:11:22.744332] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-07T18:11:24.835307] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-07T18:11:24.848388] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-07T18:11:26.955754] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T18:11:26.967245] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-07T18:11:29.034371] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-07T18:11:29.045521] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-07T18:11:31.269014] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-07T18:11:31.280059] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-07T18:11:33.775937] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-07T18:11:33.788540] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-07T18:11:35.692209] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T18:11:35.703542] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-07T18:11:38.043477] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-07T18:11:38.055477] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-07T18:11:40.338817] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-07T18:11:40.342335] [INFO ] [REMOTE ] CPNG: Full fetch complete (77676 records). [2025-10-07T18:11:40.342463] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-07T18:11:40.720414] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-07T18:11:40.720500] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-07T18:11:40.721472] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-07T18:11:40.721541] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-07T18:11:40.723093] [DEBUG] [LOCAL ] CPNG: Trimmed 77676 records to 53672 (keeping 200 days of data) [2025-10-07T18:11:41.058032] [DEBUG] [LOCAL ] CPNG: Primary data saved (53672 records). [2025-10-07T18:11:41.058181] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-07T18:11:41.058278] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 29.3s. Estimated remaining: 4h 14m 55s. Rate: 7.3 symbols/min [2025-10-07T18:11:41.823952] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:11:41.870121] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:11:41.900787] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:11:41.902078] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:11:41.932028] [DEBUG] [LOCAL ] CQP: Loaded 19102 existing records from primary storage. [2025-10-07T18:11:41.932800] [INFO ] [MAIN ] CQP: Loaded 19102 existing records. [2025-10-07T18:11:42.036109] [DEBUG] [LOCAL ] CPS: Loaded 25745 existing records from primary storage. [2025-10-07T18:11:42.055437] [INFO ] [MAIN ] CPS: Loaded 25745 existing records. [2025-10-07T18:11:42.170195] [DEBUG] [LOCAL ] CPT: Loaded 44378 existing records from primary storage. [2025-10-07T18:11:42.207754] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:11:42.207946] [INFO ] [MAIN ] CPT: Loaded 44378 existing records. [2025-10-07T18:11:42.241332] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-07T18:11:42.246744] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-07T18:11:42.300843] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-07T18:11:42.337782] [DEBUG] [LOCAL ] CPRI: Loaded 52511 existing records from primary storage. [2025-10-07T18:11:42.365297] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-07T18:11:42.410361] [INFO ] [MAIN ] CPRI: Loaded 52511 existing records. [2025-10-07T18:11:42.579076] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:11:42.671879] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-07T18:11:42.731789] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-07T18:11:42.822955] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:11:42.828743] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-07T18:11:42.833155] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-07T18:11:42.833238] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-07T18:11:42.845926] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-07T18:11:42.887417] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-07T18:11:42.967597] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-07T18:11:43.248181] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:11:43.303900] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-07T18:11:43.348009] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-07T18:11:43.398584] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-07T18:11:43.465974] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:11:43.533404] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-07T18:11:43.533486] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-07T18:11:44.067128] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:11:44.146519] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-07T18:11:44.170367] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:11:44.192342] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-07T18:11:44.345895] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:11:44.346263] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-07T18:11:44.647018] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T18:11:44.651586] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-07T18:11:44.936500] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-07T18:11:44.940920] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-07T18:11:46.002592] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T18:11:46.007914] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-07T18:11:46.045920] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T18:11:46.051914] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-07T18:11:46.103379] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T18:11:46.114557] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-07T18:11:46.334172] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-07T18:11:46.343426] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-07T18:11:46.790508] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T18:11:46.796182] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-07T18:11:46.871066] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T18:11:46.876457] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-07T18:11:47.666914] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T18:11:47.678015] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-07T18:11:47.738727] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T18:11:47.745028] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-07T18:11:47.852158] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T18:11:47.857010] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-07T18:11:48.028488] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T18:11:48.037916] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-07T18:11:48.860071] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-07T18:11:48.864791] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-07T18:11:48.889963] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T18:11:48.897441] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-07T18:11:49.033724] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T18:11:49.043899] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-07T18:11:49.308010] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T18:11:49.316907] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-07T18:11:49.931171] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T18:11:49.936229] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-07T18:11:50.249455] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T18:11:50.256348] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-07T18:11:50.775981] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T18:11:50.787522] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-07T18:11:50.994157] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T18:11:51.003484] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-07T18:11:51.220204] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T18:11:51.226305] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-07T18:11:51.262023] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T18:11:51.267258] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-07T18:11:52.070732] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-07T18:11:52.075955] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-07T18:11:52.477452] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T18:11:52.483008] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-07T18:11:52.628986] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T18:11:52.640788] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-07T18:11:52.726141] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T18:11:52.736428] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-07T18:11:52.888710] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T18:11:52.894508] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-07T18:11:53.032958] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T18:11:53.036475] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-07T18:11:53.549724] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-07T18:11:53.553192] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-07T18:11:53.624182] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T18:11:54.161973] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T18:11:54.247621] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-07T18:11:54.440974] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T18:11:54.442170] [INFO ] [REMOTE ] CQP: Full fetch complete (30377 records). [2025-10-07T18:11:54.442244] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-07T18:11:54.442885] [FATAL] [VALIDATOR ] CQP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:11:54.442988] [FATAL] [MAIN ] CQP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:11:54.443060] [WARN ] [MAIN ] CQP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:11:54.443162] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-07T18:11:54.443268] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-07T18:11:54.443325] [INFO ] [LOCAL ] CQP: Starting deletion of derivative data. [2025-10-07T18:11:54.443576] [DEBUG] [LOCAL ] CQP: Deleted derivative data file. [2025-10-07T18:11:54.443717] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 13.4s. Estimated remaining: 4h 15m 5s. Rate: 7.3 symbols/min [2025-10-07T18:11:54.648200] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:11:54.653490] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T18:11:54.687245] [DEBUG] [LOCAL ] CR: Loaded 24251 existing records from primary storage. [2025-10-07T18:11:54.687548] [INFO ] [MAIN ] CR: Loaded 24251 existing records. [2025-10-07T18:11:54.859063] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:11:54.859316] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-07T18:11:54.859366] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-07T18:11:54.859669] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-07T18:11:54.859729] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-07T18:11:55.053712] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-07T18:11:55.212361] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:11:55.847602] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-07T18:11:55.887891] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T18:11:55.924693] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T18:11:55.926604] [INFO ] [REMOTE ] CPS: Full fetch complete (36398 records). [2025-10-07T18:11:55.926722] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-07T18:11:56.286354] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-07T18:11:56.286447] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-07T18:11:56.287007] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-07T18:11:56.287070] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-07T18:11:56.287983] [DEBUG] [LOCAL ] CPS: Trimmed 36398 records to 25707 (keeping 200 days of data) [2025-10-07T18:11:56.437572] [DEBUG] [LOCAL ] CPS: Primary data saved (25707 records). [2025-10-07T18:11:56.437740] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-07T18:11:56.437835] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 15.4s. Estimated remaining: 4h 14m 34s. Rate: 7.3 symbols/min [2025-10-07T18:11:56.601171] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:11:56.611813] [DEBUG] [LOCAL ] CRBD: Loaded 8957 existing records from primary storage. [2025-10-07T18:11:56.612043] [INFO ] [MAIN ] CRBD: Loaded 8957 existing records. [2025-10-07T18:11:56.652857] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-07T18:11:56.785838] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:11:56.786047] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-07T18:11:56.786093] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-07T18:11:56.786270] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-07T18:11:56.786327] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-07T18:11:57.133398] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:11:57.229541] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:11:57.447691] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-07T18:11:57.748462] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T18:11:58.247685] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-07T18:11:59.047671] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-07T18:11:59.111963] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T18:11:59.339845] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T18:11:59.847740] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-07T18:12:00.625187] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T18:12:00.647691] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-07T18:12:00.951594] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T18:12:01.447736] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-07T18:12:01.903277] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T18:12:02.247705] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-07T18:12:03.038123] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T18:12:03.047613] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-07T18:12:03.384145] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T18:12:03.767506] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T18:12:03.847695] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-07T18:12:04.647738] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-07T18:12:05.442830] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T18:12:05.451828] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-07T18:12:05.843130] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T18:12:06.247682] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-07T18:12:07.047619] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-07T18:12:07.099172] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T18:12:07.778491] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T18:12:07.780162] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T18:12:07.784812] [INFO ] [REMOTE ] CPT: Full fetch complete (63973 records). [2025-10-07T18:12:07.784919] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-07T18:12:07.852710] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-07T18:12:08.183541] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-07T18:12:08.183627] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-07T18:12:08.184435] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-07T18:12:08.184501] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-07T18:12:08.185904] [DEBUG] [LOCAL ] CPT: Trimmed 63973 records to 44398 (keeping 200 days of data) [2025-10-07T18:12:08.482368] [DEBUG] [LOCAL ] CPT: Primary data saved (44398 records). [2025-10-07T18:12:08.482530] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-07T18:12:08.482623] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 27.4s. Estimated remaining: 4h 14m 39s. Rate: 7.3 symbols/min [2025-10-07T18:12:08.661036] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-07T18:12:08.664821] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:12:08.720595] [DEBUG] [LOCAL ] CRBG: Loaded 52399 existing records from primary storage. [2025-10-07T18:12:08.720996] [INFO ] [MAIN ] CRBG: Loaded 52399 existing records. [2025-10-07T18:12:08.899825] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:12:08.900061] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-07T18:12:08.900109] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-07T18:12:08.900331] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-07T18:12:08.900387] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-07T18:12:09.267434] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:12:09.357490] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T18:12:09.447612] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-07T18:12:10.091304] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T18:12:10.247633] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-07T18:12:10.586114] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T18:12:10.895447] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-07T18:12:11.047716] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-07T18:12:11.847740] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-07T18:12:12.596597] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T18:12:12.600258] [INFO ] [REMOTE ] CPRI: Full fetch complete (76099 records). [2025-10-07T18:12:12.600427] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-07T18:12:12.666675] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-07T18:12:13.024052] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T18:12:13.055905] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-07T18:12:13.056465] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-07T18:12:13.057421] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-07T18:12:13.057518] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-07T18:12:13.059745] [DEBUG] [LOCAL ] CPRI: Trimmed 76099 records to 52513 (keeping 200 days of data) [2025-10-07T18:12:13.380966] [DEBUG] [LOCAL ] CPRI: Primary data saved (52513 records). [2025-10-07T18:12:13.381133] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-07T18:12:13.381223] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 32.3s. Estimated remaining: 4h 14m 19s. Rate: 7.3 symbols/min [2025-10-07T18:12:13.452613] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-07T18:12:13.566352] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:12:13.567224] [DEBUG] [LOCAL ] CRC: No existing data file found in primary storage. [2025-10-07T18:12:13.567594] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T18:12:13.567677] [WARN ] [MAIN ] CRC: No existing data found, performing full refresh instead. [2025-10-07T18:12:13.570394] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-07T18:12:13.570879] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-07T18:12:13.570950] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-10-07T18:12:13.570987] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-07T18:12:13.919893] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:12:14.247748] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-07T18:12:14.672847] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T18:12:15.047707] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-07T18:12:15.847678] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-07T18:12:16.244702] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T18:12:16.305576] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T18:12:16.373140] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-07T18:12:16.647779] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-07T18:12:17.447769] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-07T18:12:17.811859] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T18:12:18.247759] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-07T18:12:19.047632] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-07T18:12:19.088271] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T18:12:19.242021] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T18:12:19.243841] [INFO ] [REMOTE ] CR: Full fetch complete (34763 records). [2025-10-07T18:12:19.243920] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-07T18:12:19.621774] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-07T18:12:19.621855] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-07T18:12:19.622419] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-07T18:12:19.622459] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-07T18:12:19.623354] [DEBUG] [LOCAL ] CR: Trimmed 34763 records to 24194 (keeping 200 days of data) [2025-10-07T18:12:19.798907] [DEBUG] [LOCAL ] CR: Primary data saved (24194 records). [2025-10-07T18:12:19.799045] [INFO ] [MAIN ] CR: Full history saved. [2025-10-07T18:12:19.799130] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CR took 25.4s. Estimated remaining: 4h 14m 4s. Rate: 7.3 symbols/min [2025-10-07T18:12:19.862863] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-07T18:12:19.987961] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:12:19.988204] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-07T18:12:19.988258] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-07T18:12:19.988380] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-07T18:12:19.988424] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-07T18:12:19.988467] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-07T18:12:19.988502] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-07T18:12:20.338818] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:12:20.647703] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-07T18:12:20.710703] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T18:12:20.852780] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:12:20.853112] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-07T18:12:20.853209] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:12:20.853287] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-07T18:12:20.853355] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:12:20.853426] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-07T18:12:20.853494] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-07T18:12:20.853537] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-07T18:12:20.853605] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-07T18:12:20.853678] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRCL took 1.1s. Estimated remaining: 4h 13m 31s. Rate: 7.3 symbols/min [2025-10-07T18:12:21.017398] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:12:21.074719] [DEBUG] [LOCAL ] CRGY: Loaded 52502 existing records from primary storage. [2025-10-07T18:12:21.075071] [INFO ] [MAIN ] CRGY: Loaded 52502 existing records. [2025-10-07T18:12:21.249290] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:12:21.249695] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-07T18:12:21.249753] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-07T18:12:21.250033] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-07T18:12:21.250091] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-07T18:12:21.453705] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-07T18:12:21.618000] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:12:21.646365] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T18:12:22.081420] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T18:12:22.247618] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-07T18:12:22.990225] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T18:12:23.047681] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-07T18:12:23.786696] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T18:12:23.847742] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-07T18:12:24.647683] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-07T18:12:25.447762] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-07T18:12:25.503247] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T18:12:26.247632] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-07T18:12:26.485758] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T18:12:26.567133] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T18:12:26.750580] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T18:12:26.751808] [INFO ] [REMOTE ] CRBD: Full fetch complete (14061 records). [2025-10-07T18:12:26.751903] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-07T18:12:27.052788] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-07T18:12:27.116103] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-07T18:12:27.116188] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-07T18:12:27.116536] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-07T18:12:27.116576] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-07T18:12:27.117100] [DEBUG] [LOCAL ] CRBD: Trimmed 14061 records to 8964 (keeping 200 days of data) [2025-10-07T18:12:27.171956] [DEBUG] [LOCAL ] CRBD: Primary data saved (8964 records). [2025-10-07T18:12:27.172091] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-07T18:12:27.172175] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBD took 30.7s. Estimated remaining: 4h 13m 16s. Rate: 7.3 symbols/min [2025-10-07T18:12:27.337445] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:12:27.388371] [DEBUG] [LOCAL ] CRH: Loaded 53462 existing records from primary storage. [2025-10-07T18:12:27.388756] [INFO ] [MAIN ] CRH: Loaded 53462 existing records. [2025-10-07T18:12:27.564585] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:12:27.564848] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-07T18:12:27.564897] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-07T18:12:27.565155] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-07T18:12:27.565212] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-07T18:12:27.852867] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-07T18:12:27.923721] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:12:28.446796] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-07T18:12:28.647741] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-07T18:12:29.447778] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-07T18:12:29.896785] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T18:12:30.246151] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T18:12:30.255361] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-07T18:12:31.047759] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-07T18:12:31.144147] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T18:12:31.847723] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-07T18:12:32.091430] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T18:12:32.647706] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-07T18:12:32.964498] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T18:12:33.415776] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T18:12:33.447610] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-07T18:12:34.133879] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T18:12:34.247609] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-07T18:12:35.047746] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-07T18:12:35.240344] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T18:12:35.847634] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-07T18:12:36.046534] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T18:12:36.625041] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T18:12:36.647595] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-07T18:12:37.447734] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-07T18:12:37.619888] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T18:12:38.032405] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T18:12:38.247752] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-07T18:12:39.047738] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-07T18:12:39.090822] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T18:12:39.847639] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-07T18:12:40.025923] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T18:12:40.524912] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T18:12:40.647614] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-07T18:12:41.262820] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T18:12:41.447695] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-07T18:12:42.090367] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T18:12:42.247625] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-07T18:12:42.995023] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T18:12:42.999167] [INFO ] [REMOTE ] CRBG: Full fetch complete (75757 records). [2025-10-07T18:12:42.999311] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-07T18:12:43.052936] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-07T18:12:43.496865] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-07T18:12:43.496979] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-07T18:12:43.497920] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-07T18:12:43.497990] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-07T18:12:43.499802] [DEBUG] [LOCAL ] CRBG: Trimmed 75757 records to 52422 (keeping 200 days of data) [2025-10-07T18:12:43.847729] [DEBUG] [LOCAL ] CRBG: Primary data saved (52422 records). [2025-10-07T18:12:43.848040] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-07T18:12:43.848210] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRBG took 35.4s. Estimated remaining: 4h 13m 37s. Rate: 7.3 symbols/min [2025-10-07T18:12:43.847884] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-07T18:12:44.026714] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:12:44.026993] [DEBUG] [LOCAL ] CRI: No existing data file found in primary storage. [2025-10-07T18:12:44.027048] [WARN ] [MAIN ] CRI: No existing data found, performing full refresh instead. [2025-10-07T18:12:44.038922] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-07T18:12:44.052747] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-07T18:12:44.055761] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-10-07T18:12:44.055832] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-07T18:12:44.090332] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T18:12:44.420230] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:12:44.647611] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-07T18:12:45.269626] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-07T18:12:45.448185] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-07T18:12:45.453187] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T18:12:45.961731] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T18:12:46.247733] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-07T18:12:47.047748] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-07T18:12:47.477709] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T18:12:47.847726] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-07T18:12:48.237243] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T18:12:48.514343] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T18:12:48.647741] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-07T18:12:49.441133] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T18:12:49.451961] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-07T18:12:50.247695] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-07T18:12:50.432348] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T18:12:51.051927] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-07T18:12:51.053576] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T18:12:51.056921] [INFO ] [REMOTE ] CRC: Full fetch complete (62489 records). [2025-10-07T18:12:51.057047] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-07T18:12:51.456270] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-07T18:12:51.456444] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-07T18:12:51.457366] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-07T18:12:51.457490] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-07T18:12:51.459251] [DEBUG] [LOCAL ] CRC: Trimmed 62489 records to 43850 (keeping 200 days of data) [2025-10-07T18:12:51.596431] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T18:12:51.797190] [DEBUG] [LOCAL ] CRC: Primary data saved (43850 records). [2025-10-07T18:12:51.797339] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-07T18:12:51.797418] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRC took 38.4s. Estimated remaining: 4h 13m 28s. Rate: 7.3 symbols/min [2025-10-07T18:12:51.855447] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-07T18:12:52.036709] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:12:52.104001] [DEBUG] [LOCAL ] CRK: Loaded 52172 existing records from primary storage. [2025-10-07T18:12:52.104544] [INFO ] [MAIN ] CRK: Loaded 52172 existing records. [2025-10-07T18:12:52.374200] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:12:52.374555] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-07T18:12:52.374694] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-07T18:12:52.375032] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-07T18:12:52.375108] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-07T18:12:52.652102] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-07T18:12:52.856013] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:12:52.892438] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T18:12:53.443940] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T18:12:53.452482] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-07T18:12:54.247613] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-07T18:12:54.634467] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T18:12:55.047637] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-07T18:12:55.109074] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T18:12:55.847633] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-07T18:12:56.058949] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T18:12:56.647734] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-07T18:12:56.736289] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T18:12:57.447634] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-07T18:12:57.795124] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-07T18:12:58.213739] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T18:12:58.221274] [INFO ] [REMOTE ] CRGY: Full fetch complete (75971 records). [2025-10-07T18:12:58.221456] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-07T18:12:58.252758] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-07T18:12:58.622438] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-07T18:12:58.622531] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-07T18:12:58.623576] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-07T18:12:58.623629] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-07T18:12:58.625400] [DEBUG] [LOCAL ] CRGY: Trimmed 75971 records to 52498 (keeping 200 days of data) [2025-10-07T18:12:58.960260] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T18:12:58.990342] [DEBUG] [LOCAL ] CRGY: Primary data saved (52498 records). [2025-10-07T18:12:58.990510] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-07T18:12:58.991505] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRGY took 38.1s. Estimated remaining: 4h 13m 16s. Rate: 7.3 symbols/min [2025-10-07T18:12:59.055029] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-07T18:12:59.169773] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:12:59.225612] [DEBUG] [LOCAL ] CRL: Loaded 42885 existing records from primary storage. [2025-10-07T18:12:59.225978] [INFO ] [MAIN ] CRL: Loaded 42885 existing records. [2025-10-07T18:12:59.404338] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:12:59.404549] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-07T18:12:59.404598] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-07T18:12:59.404892] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-07T18:12:59.404949] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-07T18:12:59.768907] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:12:59.847712] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-07T18:12:59.996194] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T18:13:00.392146] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T18:13:00.647676] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-07T18:13:01.447683] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-07T18:13:02.247710] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-07T18:13:02.247616] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-07T18:13:02.479232] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T18:13:03.047705] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-07T18:13:03.097103] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T18:13:03.847686] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-07T18:13:03.973398] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T18:13:04.647698] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-07T18:13:04.686665] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T18:13:05.447731] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-07T18:13:05.516054] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T18:13:06.158676] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T18:13:06.247696] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-07T18:13:07.047739] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-07T18:13:07.143613] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T18:13:07.704912] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T18:13:07.847735] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-07T18:13:08.647739] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-07T18:13:08.691063] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T18:13:09.447704] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-07T18:13:09.503816] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T18:13:10.252810] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-07T18:13:10.268101] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T18:13:11.047740] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-07T18:13:11.619806] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-07T18:13:11.712509] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T18:13:11.847701] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-07T18:13:12.647636] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-07T18:13:12.858859] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T18:13:13.447622] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-07T18:13:13.653388] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T18:13:13.997268] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T18:13:14.000534] [INFO ] [REMOTE ] CRI: Full fetch complete (70841 records). [2025-10-07T18:13:14.000984] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-07T18:13:14.252753] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-07T18:13:14.386557] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-07T18:13:14.386663] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-07T18:13:14.387457] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-07T18:13:14.387502] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-07T18:13:14.388996] [DEBUG] [LOCAL ] CRI: Trimmed 70841 records to 49806 (keeping 200 days of data) [2025-10-07T18:13:14.695721] [DEBUG] [LOCAL ] CRI: Primary data saved (49806 records). [2025-10-07T18:13:14.695862] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-07T18:13:14.695935] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRI took 30.8s. Estimated remaining: 4h 13m 33s. Rate: 7.3 symbols/min [2025-10-07T18:13:14.872000] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:13:14.924027] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-07T18:13:14.924350] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-07T18:13:15.055335] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-07T18:13:15.112104] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:13:15.112542] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-07T18:13:15.112734] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-07T18:13:15.113096] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-07T18:13:15.113246] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-07T18:13:15.434860] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T18:13:15.517424] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:13:15.847758] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-07T18:13:16.075606] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:13:16.647639] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-07T18:13:17.048148] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T18:13:17.447758] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-07T18:13:17.842885] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T18:13:18.247716] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-07T18:13:18.516971] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T18:13:19.047821] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-07T18:13:19.149738] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T18:13:19.847752] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-07T18:13:20.614091] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T18:13:20.618022] [INFO ] [REMOTE ] CRK: Full fetch complete (75607 records). [2025-10-07T18:13:20.618204] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-07T18:13:20.649446] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-07T18:13:21.038727] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-07T18:13:21.046485] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-07T18:13:21.050279] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-07T18:13:21.050374] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-07T18:13:21.052862] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-07T18:13:21.064305] [DEBUG] [LOCAL ] CRK: Trimmed 75607 records to 52197 (keeping 200 days of data) [2025-10-07T18:13:21.381826] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T18:13:21.405305] [DEBUG] [LOCAL ] CRK: Primary data saved (52197 records). [2025-10-07T18:13:21.405447] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-07T18:13:21.405538] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRK took 29.6s. Estimated remaining: 4h 13m 20s. Rate: 7.3 symbols/min [2025-10-07T18:13:21.452888] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-07T18:13:21.582185] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:13:21.624354] [DEBUG] [LOCAL ] CRS: Loaded 43201 existing records from primary storage. [2025-10-07T18:13:21.624794] [INFO ] [MAIN ] CRS: Loaded 43201 existing records. [2025-10-07T18:13:21.830919] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:13:21.831178] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-07T18:13:21.831237] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-07T18:13:21.831744] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-07T18:13:21.831807] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-07T18:13:22.185838] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:13:22.247601] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-07T18:13:22.646117] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-07T18:13:22.651244] [INFO ] [REMOTE ] CRH: Full fetch complete (77304 records). [2025-10-07T18:13:22.651408] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-07T18:13:23.063125] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-07T18:13:23.067500] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-07T18:13:23.068559] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-07T18:13:23.069534] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-07T18:13:23.069763] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-07T18:13:23.096248] [DEBUG] [LOCAL ] CRH: Trimmed 77304 records to 53462 (keeping 200 days of data) [2025-10-07T18:13:23.097274] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T18:13:23.461347] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T18:13:23.490112] [DEBUG] [LOCAL ] CRH: Primary data saved (53462 records). [2025-10-07T18:13:23.490262] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-07T18:13:23.490347] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRH took 56.3s. Estimated remaining: 4h 12m 50s. Rate: 7.3 symbols/min [2025-10-07T18:13:23.657975] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:13:23.665816] [DEBUG] [LOCAL ] CRT: Loaded 5015 existing records from primary storage. [2025-10-07T18:13:23.666059] [INFO ] [MAIN ] CRT: Loaded 5015 existing records. [2025-10-07T18:13:23.852015] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:13:23.852178] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-07T18:13:23.854118] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-07T18:13:23.854192] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-07T18:13:23.854421] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-07T18:13:23.854480] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-07T18:13:24.243217] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:13:24.647704] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-07T18:13:25.447704] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-07T18:13:25.539455] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T18:13:25.582168] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-07T18:13:26.062675] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-07T18:13:26.247727] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-07T18:13:26.479859] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T18:13:27.047692] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-07T18:13:27.740619] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T18:13:27.847611] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-07T18:13:28.647766] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-07T18:13:28.734043] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T18:13:29.254465] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T18:13:29.257662] [INFO ] [REMOTE ] CRL: Full fetch complete (63169 records). [2025-10-07T18:13:29.257768] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-07T18:13:29.452823] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-07T18:13:29.663851] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-07T18:13:29.663933] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-07T18:13:29.664677] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-07T18:13:29.664740] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-07T18:13:29.665933] [DEBUG] [LOCAL ] CRL: Trimmed 63169 records to 42802 (keeping 200 days of data) [2025-10-07T18:13:29.937301] [DEBUG] [LOCAL ] CRL: Primary data saved (42802 records). [2025-10-07T18:13:29.937463] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-07T18:13:29.938292] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRL took 30.9s. Estimated remaining: 4h 12m 36s. Rate: 7.3 symbols/min [2025-10-07T18:13:30.112175] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:13:30.156563] [DEBUG] [LOCAL ] CSAN: Loaded 42213 existing records from primary storage. [2025-10-07T18:13:30.156894] [INFO ] [MAIN ] CSAN: Loaded 42213 existing records. [2025-10-07T18:13:30.257171] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-07T18:13:30.285987] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T18:13:30.348107] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:13:30.348328] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-07T18:13:30.348376] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-07T18:13:30.348613] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-07T18:13:30.348702] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-07T18:13:30.704809] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:13:30.849480] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-07T18:13:31.047680] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-07T18:13:31.755587] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T18:13:31.847748] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-07T18:13:32.647733] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-07T18:13:33.255891] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T18:13:33.270281] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T18:13:33.447734] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-07T18:13:33.496753] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-07T18:13:33.989278] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-07T18:13:34.247753] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-07T18:13:35.047715] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-07T18:13:35.852962] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-07T18:13:35.866784] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T18:13:36.647763] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-07T18:13:36.676118] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-07T18:13:36.724032] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T18:13:37.447753] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-07T18:13:38.247692] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-07T18:13:38.411241] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T18:13:38.846897] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-07T18:13:38.980915] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T18:13:39.047691] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-07T18:13:39.847753] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-07T18:13:40.469536] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T18:13:40.647738] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-07T18:13:41.447710] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-07T18:13:41.536686] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T18:13:42.247769] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-07T18:13:42.761787] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-07T18:13:42.881929] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T18:13:42.994113] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-07T18:13:43.047690] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-07T18:13:43.847676] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-07T18:13:44.327704] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T18:13:44.647737] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-07T18:13:45.254943] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T18:13:45.447699] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-07T18:13:45.989499] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-07T18:13:46.247713] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-07T18:13:46.939112] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T18:13:47.047716] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-07T18:13:47.129112] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T18:13:47.692476] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-07T18:13:47.847710] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-07T18:13:48.647719] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-07T18:13:49.184541] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T18:13:49.185818] [INFO ] [REMOTE ] CRT: Full fetch complete (7542 records). [2025-10-07T18:13:49.185894] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-07T18:13:49.452936] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-07T18:13:49.578230] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-07T18:13:49.578350] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-07T18:13:49.578683] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-07T18:13:49.578750] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-07T18:13:49.579212] [DEBUG] [LOCAL ] CRT: Trimmed 7542 records to 5025 (keeping 200 days of data) [2025-10-07T18:13:49.612992] [DEBUG] [LOCAL ] CRT: Primary data saved (5025 records). [2025-10-07T18:13:49.613151] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-07T18:13:49.613285] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRT took 26.1s. Estimated remaining: 4h 13m 7s. Rate: 7.3 symbols/min [2025-10-07T18:13:49.783025] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:13:49.821535] [DEBUG] [LOCAL ] CSL: Loaded 31516 existing records from primary storage. [2025-10-07T18:13:49.821986] [INFO ] [MAIN ] CSL: Loaded 31516 existing records. [2025-10-07T18:13:50.028311] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:13:50.028684] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-07T18:13:50.028754] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-07T18:13:50.029276] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-07T18:13:50.029399] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-07T18:13:50.265067] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-07T18:13:50.392912] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:13:50.427416] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-07T18:13:50.941783] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T18:13:51.047777] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-07T18:13:51.847683] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-07T18:13:52.024196] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T18:13:52.603547] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T18:13:52.647698] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-07T18:13:53.447697] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-07T18:13:54.120142] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T18:13:54.247630] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-07T18:13:54.434544] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-07T18:13:54.483097] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T18:13:55.047697] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-07T18:13:55.847769] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-07T18:13:55.884836] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T18:13:56.647759] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-07T18:13:57.177593] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T18:13:57.447711] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-07T18:13:57.653951] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-07T18:13:58.060037] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T18:13:58.062854] [INFO ] [REMOTE ] CRS: Full fetch complete (62664 records). [2025-10-07T18:13:58.062944] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-07T18:13:58.252860] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-07T18:13:58.444521] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-07T18:13:58.444606] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-07T18:13:58.445379] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-07T18:13:58.445446] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-07T18:13:58.446762] [DEBUG] [LOCAL ] CRS: Trimmed 62664 records to 43173 (keeping 200 days of data) [2025-10-07T18:13:58.704005] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T18:13:58.775451] [DEBUG] [LOCAL ] CRS: Primary data saved (43173 records). [2025-10-07T18:13:58.775683] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-07T18:13:58.775851] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRS took 37.4s. Estimated remaining: 4h 13m 2s. Rate: 7.3 symbols/min [2025-10-07T18:13:58.967256] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:13:58.983726] [DEBUG] [LOCAL ] CSR: Loaded 12915 existing records from primary storage. [2025-10-07T18:13:58.984085] [INFO ] [MAIN ] CSR: Loaded 12915 existing records. [2025-10-07T18:13:59.055114] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-07T18:13:59.108194] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T18:13:59.161072] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-07T18:13:59.171322] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-07T18:13:59.243543] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:13:59.298959] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-07T18:13:59.311899] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-07T18:13:59.331064] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-07T18:13:59.331182] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-07T18:13:59.863429] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-07T18:14:00.078430] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-07T18:14:00.084821] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-07T18:14:00.085972] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-07T18:14:00.086070] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-07T18:14:00.131492] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-10-07T18:14:00.131191] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:00.503250] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-07T18:14:00.503400] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-07T18:14:00.503484] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRM took 45.8s. Estimated remaining: 4h 12m 31s. Rate: 7.3 symbols/min [2025-10-07T18:14:00.647810] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T18:14:00.653125] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-07T18:14:00.710075] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:00.754480] [DEBUG] [LOCAL ] CSTM: Loaded 47430 existing records from primary storage. [2025-10-07T18:14:00.754909] [INFO ] [MAIN ] CSTM: Loaded 47430 existing records. [2025-10-07T18:14:00.929117] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:14:00.929363] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-07T18:14:00.929413] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-07T18:14:00.929716] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-07T18:14:00.929778] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-07T18:14:01.283413] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:01.447936] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-07T18:14:01.578548] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T18:14:01.898915] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T18:14:02.247744] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-07T18:14:03.047615] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-07T18:14:03.083425] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T18:14:03.602997] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T18:14:03.606994] [INFO ] [REMOTE ] CSAN: Full fetch complete (60548 records). [2025-10-07T18:14:03.607158] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-07T18:14:03.860024] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-07T18:14:04.002532] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-07T18:14:04.002632] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-07T18:14:04.003437] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-07T18:14:04.003491] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-07T18:14:04.004980] [DEBUG] [LOCAL ] CSAN: Trimmed 60548 records to 42225 (keeping 200 days of data) [2025-10-07T18:14:04.264182] [DEBUG] [LOCAL ] CSAN: Primary data saved (42225 records). [2025-10-07T18:14:04.264319] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-07T18:14:04.265894] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 34.3s. Estimated remaining: 4h 12m 7s. Rate: 7.3 symbols/min [2025-10-07T18:14:04.458954] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:04.475274] [DEBUG] [LOCAL ] CSV: Loaded 12801 existing records from primary storage. [2025-10-07T18:14:04.475522] [INFO ] [MAIN ] CSV: Loaded 12801 existing records. [2025-10-07T18:14:04.677750] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:14:04.673878] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-07T18:14:04.678337] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-07T18:14:04.679697] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-07T18:14:04.681825] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T18:14:04.690175] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-07T18:14:04.690951] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-07T18:14:05.047547] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T18:14:05.083204] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:05.447724] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-07T18:14:06.247722] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-07T18:14:06.247636] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T18:14:06.297904] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T18:14:07.047720] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-07T18:14:07.269486] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T18:14:07.847745] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-07T18:14:07.865753] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T18:14:08.519394] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-07T18:14:08.647681] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-07T18:14:09.447749] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-07T18:14:09.631256] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T18:14:10.247685] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-07T18:14:10.947355] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T18:14:11.047699] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-07T18:14:11.595897] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T18:14:11.614705] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-07T18:14:11.847712] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-07T18:14:12.647639] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-07T18:14:12.836602] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T18:14:13.447757] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-07T18:14:14.247675] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-07T18:14:14.411438] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T18:14:14.497415] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T18:14:15.047700] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-07T18:14:15.311289] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T18:14:15.847721] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-07T18:14:16.647699] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-07T18:14:16.753865] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T18:14:16.930388] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T18:14:17.447710] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-07T18:14:18.013882] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-07T18:14:18.029408] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T18:14:18.247628] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-07T18:14:19.047742] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-07T18:14:19.407306] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T18:14:19.847665] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-07T18:14:20.479074] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T18:14:20.647620] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-07T18:14:20.820372] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T18:14:21.447751] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-07T18:14:22.247787] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-07T18:14:22.284547] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T18:14:22.303970] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T18:14:23.047710] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-07T18:14:23.208732] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T18:14:23.847730] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-07T18:14:24.647741] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-07T18:14:24.792507] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T18:14:24.831411] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T18:14:25.447755] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-07T18:14:26.247627] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-07T18:14:26.278350] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T18:14:26.518509] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-07T18:14:26.520029] [INFO ] [REMOTE ] CSR: Full fetch complete (17754 records). [2025-10-07T18:14:26.520138] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-07T18:14:26.888853] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-07T18:14:26.888949] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-07T18:14:26.889378] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-07T18:14:26.889421] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-07T18:14:26.890038] [DEBUG] [LOCAL ] CSR: Trimmed 17754 records to 12957 (keeping 200 days of data) [2025-10-07T18:14:26.973458] [DEBUG] [LOCAL ] CSR: Primary data saved (12957 records). [2025-10-07T18:14:26.973668] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-07T18:14:26.973801] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSR took 28.2s. Estimated remaining: 4h 12m 48s. Rate: 7.2 symbols/min [2025-10-07T18:14:27.052769] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-07T18:14:27.146513] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:27.146709] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-07T18:14:27.146759] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-07T18:14:27.146868] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-07T18:14:27.146910] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-07T18:14:27.146952] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-07T18:14:27.146984] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-07T18:14:27.503384] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:27.811761] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T18:14:27.847599] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-07T18:14:27.917679] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T18:14:28.647734] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-07T18:14:28.865998] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:14:28.866411] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-07T18:14:28.866526] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:14:28.866665] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-07T18:14:28.866751] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:14:28.866884] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-07T18:14:28.866984] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-07T18:14:28.867043] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-07T18:14:28.867127] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-07T18:14:28.867215] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSW took 1.9s. Estimated remaining: 4h 12m 18s. Rate: 7.3 symbols/min [2025-10-07T18:14:29.012421] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T18:14:29.039847] [INFO ] [REMOTE ] CSL: Full fetch complete (45361 records). [2025-10-07T18:14:29.064138] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-07T18:14:29.065794] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:29.066183] [DEBUG] [LOCAL ] CTBB: No existing data file found in primary storage. [2025-10-07T18:14:29.066241] [WARN ] [MAIN ] CTBB: No existing data found, performing full refresh instead. [2025-10-07T18:14:29.110440] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-07T18:14:29.125088] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-07T18:14:29.125195] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-07T18:14:29.125264] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-07T18:14:29.465215] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-07T18:14:29.818214] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:29.849747] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-07T18:14:29.849831] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-07T18:14:29.850436] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-07T18:14:29.850478] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-07T18:14:29.851461] [DEBUG] [LOCAL ] CSL: Trimmed 45361 records to 31514 (keeping 200 days of data) [2025-10-07T18:14:30.047010] [DEBUG] [LOCAL ] CSL: Primary data saved (31514 records). [2025-10-07T18:14:30.047152] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-07T18:14:30.048278] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSL took 40.4s. Estimated remaining: 4h 11m 46s. Rate: 7.3 symbols/min [2025-10-07T18:14:30.246773] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:30.247699] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-07T18:14:30.256608] [DEBUG] [LOCAL ] CTDD: Loaded 5859 existing records from primary storage. [2025-10-07T18:14:30.256881] [INFO ] [MAIN ] CTDD: Loaded 5859 existing records. [2025-10-07T18:14:30.430605] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:14:30.430817] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-07T18:14:30.430864] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-07T18:14:30.431085] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-07T18:14:30.431141] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-07T18:14:30.699137] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T18:14:30.798682] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:30.936858] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-07T18:14:31.047612] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-07T18:14:31.847728] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-07T18:14:31.957498] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T18:14:32.647745] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-07T18:14:32.704479] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T18:14:33.447681] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-07T18:14:33.955851] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-07T18:14:34.247720] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-07T18:14:34.325530] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T18:14:35.031180] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T18:14:35.047632] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-07T18:14:35.705351] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T18:14:35.847632] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-07T18:14:36.651666] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-07T18:14:36.653869] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T18:14:37.442375] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T18:14:37.444744] [INFO ] [REMOTE ] CSV: Full fetch complete (19431 records). [2025-10-07T18:14:37.444879] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-07T18:14:37.458125] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-07T18:14:37.846577] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-07T18:14:37.846714] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-07T18:14:37.847168] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-07T18:14:37.847212] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-07T18:14:37.847801] [DEBUG] [LOCAL ] CSV: Trimmed 19431 records to 12795 (keeping 200 days of data) [2025-10-07T18:14:37.926057] [DEBUG] [LOCAL ] CSV: Primary data saved (12795 records). [2025-10-07T18:14:37.926202] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-07T18:14:37.926284] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSV took 33.7s. Estimated remaining: 4h 11m 36s. Rate: 7.3 symbols/min [2025-10-07T18:14:38.092917] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:38.093171] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-07T18:14:38.093227] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-07T18:14:38.093354] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-07T18:14:38.093397] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-07T18:14:38.093438] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-07T18:14:38.093475] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-07T18:14:38.255218] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-07T18:14:38.461195] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:39.047626] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-07T18:14:39.151836] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T18:14:39.213598] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T18:14:39.628216] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T18:14:39.847706] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-07T18:14:40.165913] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:14:40.166359] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-07T18:14:40.166475] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:14:40.166551] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-07T18:14:40.166639] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:14:40.166766] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-07T18:14:40.166854] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-07T18:14:40.166915] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-07T18:14:40.166979] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-07T18:14:40.167049] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 2.2s. Estimated remaining: 4h 11m 8s. Rate: 7.3 symbols/min [2025-10-07T18:14:40.351669] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:40.351883] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-07T18:14:40.351921] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-07T18:14:40.352043] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-07T18:14:40.352084] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-07T18:14:40.352124] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-07T18:14:40.352155] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-07T18:14:40.652926] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-07T18:14:40.715852] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:41.447703] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-07T18:14:42.165844] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T18:14:42.169107] [INFO ] [REMOTE ] CSTM: Full fetch complete (69263 records). [2025-10-07T18:14:42.169212] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-07T18:14:42.253416] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-07T18:14:42.292057] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-07T18:14:42.573843] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-07T18:14:42.573948] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-07T18:14:42.574806] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-07T18:14:42.574878] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-07T18:14:42.576394] [DEBUG] [LOCAL ] CSTM: Trimmed 69263 records to 47537 (keeping 200 days of data) [2025-10-07T18:14:42.861778] [DEBUG] [LOCAL ] CSTM: Primary data saved (47537 records). [2025-10-07T18:14:42.861972] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-07T18:14:42.862082] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CSTM took 42.4s. Estimated remaining: 4h 10m 41s. Rate: 7.3 symbols/min [2025-10-07T18:14:43.064010] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-07T18:14:43.067054] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:43.074749] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T18:14:43.102950] [DEBUG] [LOCAL ] CTO: Loaded 27723 existing records from primary storage. [2025-10-07T18:14:43.103275] [INFO ] [MAIN ] CTO: Loaded 27723 existing records. [2025-10-07T18:14:43.287893] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:14:43.288220] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-07T18:14:43.288277] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-07T18:14:43.288497] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-07T18:14:43.288555] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-07T18:14:43.645538] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:43.847669] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-07T18:14:43.964826] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T18:14:44.647678] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-07T18:14:45.298719] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T18:14:45.447673] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-07T18:14:45.529027] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-07T18:14:46.090787] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T18:14:46.247700] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-07T18:14:47.047628] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-07T18:14:47.446841] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T18:14:47.648550] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T18:14:47.847710] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-07T18:14:48.647737] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-07T18:14:49.055761] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T18:14:49.253664] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T18:14:49.447703] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-07T18:14:49.662380] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:14:49.662846] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-07T18:14:49.662941] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:14:49.663006] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-07T18:14:49.663051] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:14:49.663105] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-07T18:14:49.663233] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-07T18:14:49.663302] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-07T18:14:49.663365] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-07T18:14:49.663426] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTEV took 9.5s. Estimated remaining: 4h 10m 28s. Rate: 7.3 symbols/min [2025-10-07T18:14:49.854326] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:49.854517] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-07T18:14:49.854557] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-07T18:14:49.854704] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-07T18:14:49.854758] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-07T18:14:49.854816] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-07T18:14:49.854851] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-07T18:14:50.229747] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:50.247687] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-07T18:14:50.876389] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T18:14:51.047678] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-07T18:14:51.847685] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-07T18:14:52.424343] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T18:14:52.480382] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T18:14:52.647610] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-07T18:14:53.447625] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-07T18:14:53.544988] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T18:14:54.173565] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T18:14:54.247614] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-07T18:14:55.047702] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-07T18:14:55.650773] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T18:14:55.651704] [INFO ] [REMOTE ] CTDD: Full fetch complete (8365 records). [2025-10-07T18:14:55.651775] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-07T18:14:55.791894] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T18:14:55.851831] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-07T18:14:56.036589] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-07T18:14:56.036691] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-07T18:14:56.036941] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-07T18:14:56.036984] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-07T18:14:56.037419] [DEBUG] [LOCAL ] CTDD: Trimmed 8365 records to 5824 (keeping 200 days of data) [2025-10-07T18:14:56.072561] [DEBUG] [LOCAL ] CTDD: Primary data saved (5824 records). [2025-10-07T18:14:56.072725] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-07T18:14:56.072824] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTDD took 26.0s. Estimated remaining: 4h 10m 14s. Rate: 7.3 symbols/min [2025-10-07T18:14:56.238323] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:14:56.238515] [DEBUG] [LOCAL ] CTRA: No existing data file found in primary storage. [2025-10-07T18:14:56.238554] [WARN ] [MAIN ] CTRA: No existing data found, performing full refresh instead. [2025-10-07T18:14:56.238690] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-07T18:14:56.238745] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-07T18:14:56.238790] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-10-07T18:14:56.238823] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-07T18:14:56.591626] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:14:56.647608] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-07T18:14:57.388970] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T18:14:57.447703] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-07T18:14:58.120828] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T18:14:58.247749] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-07T18:14:58.696151] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-07T18:14:59.047631] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-07T18:14:59.475055] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T18:14:59.847716] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-07T18:15:00.439296] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T18:15:00.440267] [INFO ] [REMOTE ] CTBB: Full fetch complete (10656 records). [2025-10-07T18:15:00.440391] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-07T18:15:00.655776] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-07T18:15:00.809413] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-07T18:15:00.809572] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-07T18:15:00.809880] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-07T18:15:00.809943] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-07T18:15:00.810401] [DEBUG] [LOCAL ] CTBB: Trimmed 10656 records to 7035 (keeping 200 days of data) [2025-10-07T18:15:00.857545] [DEBUG] [LOCAL ] CTBB: Primary data saved (7035 records). [2025-10-07T18:15:00.857702] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-07T18:15:00.857794] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTBB took 32.0s. Estimated remaining: 4h 9m 54s. Rate: 7.3 symbols/min [2025-10-07T18:15:01.028999] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:15:01.060928] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-07T18:15:01.108307] [DEBUG] [LOCAL ] CTRE: Loaded 49286 existing records from primary storage. [2025-10-07T18:15:01.108621] [INFO ] [MAIN ] CTRE: Loaded 49286 existing records. [2025-10-07T18:15:01.280670] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:15:01.280891] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-07T18:15:01.280938] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-07T18:15:01.281308] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-07T18:15:01.281367] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-07T18:15:01.456939] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-07T18:15:01.635381] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:15:02.247716] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-07T18:15:02.314542] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T18:15:03.009310] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T18:15:03.047709] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-07T18:15:03.813842] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T18:15:03.847722] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-07T18:15:04.652818] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-07T18:15:04.670697] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T18:15:05.447639] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-07T18:15:05.872970] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-07T18:15:06.247784] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-07T18:15:06.593176] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T18:15:06.619884] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T18:15:07.047732] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-07T18:15:07.777424] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T18:15:07.847631] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-07T18:15:08.294628] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T18:15:08.647747] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-07T18:15:09.447624] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-07T18:15:09.552564] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T18:15:10.212271] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T18:15:10.247613] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-07T18:15:10.328609] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T18:15:11.047755] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-07T18:15:11.660795] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T18:15:11.847715] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-07T18:15:12.647766] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-07T18:15:12.808562] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T18:15:13.002786] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T18:15:13.447711] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-07T18:15:14.247774] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-07T18:15:14.486953] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T18:15:14.646172] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T18:15:15.047673] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-07T18:15:15.550513] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T18:15:15.847675] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-07T18:15:16.647707] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-07T18:15:16.793794] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T18:15:17.452725] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-07T18:15:17.463861] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:15:18.184690] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T18:15:18.247615] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-07T18:15:19.047690] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-07T18:15:19.081288] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T18:15:19.847677] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-07T18:15:20.172214] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-07T18:15:20.647630] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-07T18:15:20.668777] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T18:15:21.250282] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T18:15:21.447710] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-07T18:15:22.247732] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-07T18:15:22.709310] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-07T18:15:23.047720] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-07T18:15:23.202759] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T18:15:23.487909] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T18:15:23.490687] [INFO ] [REMOTE ] CTO: Full fetch complete (41720 records). [2025-10-07T18:15:23.490801] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-07T18:15:23.855296] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-07T18:15:23.867432] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-07T18:15:23.867517] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-07T18:15:23.868149] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-07T18:15:23.868225] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-07T18:15:23.869217] [DEBUG] [LOCAL ] CTO: Trimmed 41720 records to 27731 (keeping 200 days of data) [2025-10-07T18:15:24.047793] [DEBUG] [LOCAL ] CTO: Primary data saved (27731 records). [2025-10-07T18:15:24.047991] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-07T18:15:24.048109] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTO took 41.2s. Estimated remaining: 4h 10m 36s. Rate: 7.3 symbols/min [2025-10-07T18:15:24.165801] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T18:15:24.203559] [INFO ] [REMOTE ] CTOS: Full fetch complete (53663 records). [2025-10-07T18:15:24.215924] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-07T18:15:24.242930] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:15:24.308102] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-07T18:15:24.330409] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-07T18:15:24.341174] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-07T18:15:24.341613] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-07T18:15:24.352269] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-07T18:15:24.362624] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-07T18:15:24.652111] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-07T18:15:24.959313] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-07T18:15:24.970231] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-07T18:15:24.986552] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-07T18:15:25.012426] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-07T18:15:25.040629] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:15:25.041394] [DEBUG] [LOCAL ] CTOS: Trimmed 53663 records to 36691 (keeping 200 days of data) [2025-10-07T18:15:25.295258] [DEBUG] [LOCAL ] CTOS: Primary data saved (36691 records). [2025-10-07T18:15:25.295406] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-07T18:15:25.295501] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTOS took 35.6s. Estimated remaining: 4h 10m 4s. Rate: 7.3 symbols/min [2025-10-07T18:15:25.452736] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-07T18:15:25.502310] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:15:25.524096] [DEBUG] [LOCAL ] CTS: Loaded 19411 existing records from primary storage. [2025-10-07T18:15:25.524352] [INFO ] [MAIN ] CTS: Loaded 19411 existing records. [2025-10-07T18:15:25.706293] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:15:25.706694] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-07T18:15:25.706772] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-07T18:15:25.707182] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-07T18:15:25.707294] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-07T18:15:26.015713] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-07T18:15:26.109852] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:15:26.185343] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T18:15:26.247606] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-07T18:15:26.887544] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T18:15:27.047615] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-07T18:15:27.129370] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T18:15:27.847670] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-07T18:15:28.647368] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T18:15:28.651117] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-07T18:15:28.839548] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T18:15:29.447630] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-07T18:15:29.885342] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T18:15:30.247706] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-07T18:15:31.047698] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-07T18:15:31.293669] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:15:31.294372] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T18:15:31.847732] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-07T18:15:32.516724] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T18:15:32.520294] [INFO ] [REMOTE ] CTRE: Full fetch complete (71192 records). [2025-10-07T18:15:32.520428] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-07T18:15:32.648799] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-07T18:15:32.906564] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T18:15:32.970791] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-07T18:15:32.970894] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-07T18:15:32.971736] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-07T18:15:32.971802] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-07T18:15:32.973307] [DEBUG] [LOCAL ] CTRE: Trimmed 71192 records to 49274 (keeping 200 days of data) [2025-10-07T18:15:33.286993] [DEBUG] [LOCAL ] CTRE: Primary data saved (49274 records). [2025-10-07T18:15:33.287151] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-07T18:15:33.287252] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRE took 32.4s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-07T18:15:33.458097] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-07T18:15:33.486853] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:15:33.539551] [DEBUG] [LOCAL ] CTVA: Loaded 53246 existing records from primary storage. [2025-10-07T18:15:33.539925] [INFO ] [MAIN ] CTVA: Loaded 53246 existing records. [2025-10-07T18:15:33.725307] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:15:33.725700] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-07T18:15:33.725762] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-07T18:15:33.726214] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-07T18:15:33.726273] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-07T18:15:34.098795] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T18:15:34.134595] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:15:34.247610] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-07T18:15:35.047677] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-07T18:15:35.082280] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T18:15:35.087155] [INFO ] [REMOTE ] CTRA: Full fetch complete (77661 records). [2025-10-07T18:15:35.087323] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-07T18:15:35.500589] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-07T18:15:35.519609] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-07T18:15:35.520754] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-07T18:15:35.521819] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-07T18:15:35.523326] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T18:15:35.533093] [DEBUG] [LOCAL ] CTRA: Trimmed 77661 records to 53646 (keeping 200 days of data) [2025-10-07T18:15:35.853798] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-07T18:15:35.880152] [DEBUG] [LOCAL ] CTRA: Primary data saved (53646 records). [2025-10-07T18:15:35.880276] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-07T18:15:35.880348] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRA took 39.8s. Estimated remaining: 4h 9m 28s. Rate: 7.3 symbols/min [2025-10-07T18:15:36.045438] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:15:36.045637] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-07T18:15:36.045715] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-07T18:15:36.045831] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-07T18:15:36.045873] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-07T18:15:36.045913] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-07T18:15:36.045945] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-07T18:15:36.457121] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:15:36.490524] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T18:15:36.647687] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-07T18:15:37.064076] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T18:15:37.447706] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-07T18:15:38.247639] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-07T18:15:38.350457] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T18:15:38.620916] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T18:15:39.047748] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-07T18:15:39.282621] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T18:15:39.847681] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-07T18:15:40.647736] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-07T18:15:40.792561] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T18:15:41.145325] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-07T18:15:41.348995] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T18:15:41.447630] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-07T18:15:42.247688] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-07T18:15:42.845681] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T18:15:43.047732] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-07T18:15:43.216807] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T18:15:43.847689] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-07T18:15:44.647638] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-07T18:15:44.865222] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T18:15:44.931729] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T18:15:45.447676] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-07T18:15:45.714041] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T18:15:45.754622] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-07T18:15:46.247678] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-07T18:15:46.755333] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-07T18:15:47.047754] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-07T18:15:47.847695] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-07T18:15:48.647731] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-07T18:15:48.649591] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T18:15:49.008460] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T18:15:49.447634] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-07T18:15:49.806835] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T18:15:50.247719] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-07T18:15:50.522686] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-07T18:15:51.047629] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-07T18:15:51.312833] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T18:15:51.847638] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-07T18:15:52.647626] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-07T18:15:52.940929] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T18:15:52.995510] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T18:15:53.447679] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-07T18:15:54.177515] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T18:15:54.247619] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-07T18:15:54.339558] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T18:15:54.341228] [INFO ] [REMOTE ] CTS: Full fetch complete (26832 records). [2025-10-07T18:15:54.341322] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-07T18:15:54.705176] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-07T18:15:54.706944] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-07T18:15:54.708057] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-07T18:15:54.708526] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-07T18:15:54.708570] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-07T18:15:54.709225] [DEBUG] [LOCAL ] CTS: Trimmed 26832 records to 19410 (keeping 200 days of data) [2025-10-07T18:15:54.830062] [DEBUG] [LOCAL ] CTS: Primary data saved (19410 records). [2025-10-07T18:15:54.830209] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-07T18:15:54.830293] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTS took 29.5s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-07T18:15:54.994869] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:15:55.044165] [DEBUG] [LOCAL ] CUBE: Loaded 50758 existing records from primary storage. [2025-10-07T18:15:55.044541] [INFO ] [MAIN ] CUBE: Loaded 50758 existing records. [2025-10-07T18:15:55.055490] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-07T18:15:55.222595] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:15:55.222862] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-07T18:15:55.222908] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-07T18:15:55.223225] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-07T18:15:55.223289] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-07T18:15:55.500011] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-07T18:15:55.578784] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:15:55.847721] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-07T18:15:56.647720] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-07T18:15:57.447687] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-07T18:15:57.809822] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T18:15:58.247613] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-07T18:15:58.509525] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T18:15:58.548377] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-07T18:15:58.952492] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T18:15:58.956007] [INFO ] [REMOTE ] CTRI: Full fetch complete (52359 records). [2025-10-07T18:15:58.956126] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-07T18:15:59.052740] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-07T18:15:59.343425] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-07T18:15:59.343520] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-07T18:15:59.344244] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-07T18:15:59.344312] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-07T18:15:59.345699] [DEBUG] [LOCAL ] CTRI: Trimmed 52359 records to 39307 (keeping 200 days of data) [2025-10-07T18:15:59.579623] [DEBUG] [LOCAL ] CTRI: Primary data saved (39307 records). [2025-10-07T18:15:59.580012] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-07T18:15:59.580096] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTRI took 35.5s. Estimated remaining: 4h 9m 36s. Rate: 7.3 symbols/min [2025-10-07T18:15:59.681567] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T18:15:59.753867] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:15:59.782519] [DEBUG] [LOCAL ] CUBI: Loaded 27064 existing records from primary storage. [2025-10-07T18:15:59.782855] [INFO ] [MAIN ] CUBI: Loaded 27064 existing records. [2025-10-07T18:15:59.852939] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-07T18:15:59.962039] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:15:59.962282] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-07T18:15:59.962329] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-07T18:15:59.962546] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-07T18:15:59.962603] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-07T18:16:00.309242] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:16:00.647680] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-07T18:16:01.447720] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-07T18:16:01.712893] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T18:16:01.800801] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-07T18:16:02.131559] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T18:16:02.247741] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-07T18:16:02.608209] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-07T18:16:03.047692] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-07T18:16:03.395338] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-07T18:16:03.396050] [INFO ] [REMOTE ] CUBB: Full fetch complete (926 records). [2025-10-07T18:16:03.396123] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-07T18:16:03.396478] [FATAL] [VALIDATOR ] CUBB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:16:03.396563] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:16:03.396627] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:16:03.396718] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-07T18:16:03.396782] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-07T18:16:03.396817] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-07T18:16:03.396872] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-07T18:16:03.396947] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CUBB took 27.5s. Estimated remaining: 4h 9m 13s. Rate: 7.3 symbols/min [2025-10-07T18:16:03.567424] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:16:03.622667] [DEBUG] [LOCAL ] CUK: Loaded 50984 existing records from primary storage. [2025-10-07T18:16:03.623202] [INFO ] [MAIN ] CUK: Loaded 50984 existing records. [2025-10-07T18:16:03.800070] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:16:03.800314] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-07T18:16:03.800362] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-07T18:16:03.800603] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-07T18:16:03.800702] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-07T18:16:03.852748] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-07T18:16:04.148858] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:16:04.647739] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-07T18:16:05.080840] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T18:16:05.447741] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-07T18:16:06.247671] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-07T18:16:06.422041] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T18:16:07.047714] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-07T18:16:07.290323] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T18:16:07.339836] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T18:16:07.847706] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-07T18:16:08.655731] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-07T18:16:08.658490] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T18:16:09.041451] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T18:16:09.447750] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-07T18:16:10.247672] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-07T18:16:10.350382] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T18:16:11.047618] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-07T18:16:11.312401] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T18:16:11.847618] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-07T18:16:11.888498] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T18:16:12.647715] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-07T18:16:12.872816] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T18:16:13.208030] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T18:16:13.447750] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-07T18:16:14.131478] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T18:16:14.134694] [INFO ] [REMOTE ] CTVA: Full fetch complete (76604 records). [2025-10-07T18:16:14.134819] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-07T18:16:14.135801] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:16:14.135900] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:16:14.135952] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:16:14.135996] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-07T18:16:14.136063] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-07T18:16:14.136115] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-07T18:16:14.136425] [DEBUG] [LOCAL ] CTVA: Deleted derivative data file. [2025-10-07T18:16:14.136535] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTVA took 40.8s. Estimated remaining: 4h 9m 13s. Rate: 7.3 symbols/min [2025-10-07T18:16:14.250903] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-07T18:16:14.336566] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:16:14.336834] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-07T18:16:14.336890] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-07T18:16:14.337004] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-07T18:16:14.337047] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-07T18:16:14.337089] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-07T18:16:14.337119] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-07T18:16:14.708858] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:16:15.047694] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-07T18:16:15.175344] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T18:16:15.199994] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T18:16:15.751456] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T18:16:15.847635] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-07T18:16:16.423526] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-07T18:16:16.647689] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-07T18:16:16.985021] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-07T18:16:17.447716] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-07T18:16:18.247752] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-07T18:16:19.047681] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-07T18:16:19.105506] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T18:16:19.847670] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-07T18:16:20.147965] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T18:16:20.206901] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T18:16:20.217939] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-07T18:16:20.647698] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-07T18:16:21.447744] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-07T18:16:22.247747] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-07T18:16:22.774837] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-07T18:16:22.841342] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T18:16:23.047687] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-07T18:16:23.680720] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T18:16:23.847637] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-07T18:16:24.647730] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-07T18:16:24.952612] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T18:16:25.030280] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T18:16:25.447699] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-07T18:16:26.247744] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-07T18:16:26.463017] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T18:16:26.767243] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-07T18:16:26.767093] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T18:16:27.047699] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-07T18:16:27.509551] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-07T18:16:27.847725] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-07T18:16:28.647701] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-07T18:16:29.447740] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-07T18:16:29.674715] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T18:16:29.680772] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T18:16:29.681223] [INFO ] [REMOTE ] CUBI: Full fetch complete (39259 records). [2025-10-07T18:16:29.692095] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-07T18:16:29.809491] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-07T18:16:30.098605] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-07T18:16:30.098731] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-07T18:16:30.099357] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-07T18:16:30.099404] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-07T18:16:30.100518] [DEBUG] [LOCAL ] CUBI: Trimmed 39259 records to 27078 (keeping 200 days of data) [2025-10-07T18:16:30.252090] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-07T18:16:30.268982] [DEBUG] [LOCAL ] CUBI: Primary data saved (27078 records). [2025-10-07T18:16:30.269172] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-07T18:16:30.269275] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBI took 30.7s. Estimated remaining: 4h 9m 30s. Rate: 7.3 symbols/min [2025-10-07T18:16:30.434920] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:16:30.435127] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-07T18:16:30.435164] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-07T18:16:30.435277] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-07T18:16:30.435317] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-07T18:16:30.435358] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-07T18:16:30.435391] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-07T18:16:30.688964] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-07T18:16:30.799027] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:16:31.047703] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-07T18:16:31.847716] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-07T18:16:32.430821] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T18:16:32.647724] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-07T18:16:33.397120] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T18:16:33.447603] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-07T18:16:34.247630] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-07T18:16:34.658563] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T18:16:34.823901] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T18:16:35.047628] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-07T18:16:35.510287] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T18:16:35.847729] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-07T18:16:36.647727] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-07T18:16:36.872273] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:16:37.022374] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T18:16:37.177688] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-07T18:16:37.447707] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-07T18:16:38.247694] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-07T18:16:38.717969] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T18:16:39.047727] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-07T18:16:39.847742] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-07T18:16:40.157523] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-07T18:16:40.208142] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-07T18:16:40.461154] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T18:16:40.647664] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-07T18:16:41.447632] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-07T18:16:41.779391] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T18:16:42.247678] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-07T18:16:43.047670] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-07T18:16:43.167602] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-07T18:16:43.171253] [INFO ] [REMOTE ] CUK: Full fetch complete (74049 records). [2025-10-07T18:16:43.171371] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-07T18:16:43.563200] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-07T18:16:43.563308] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-07T18:16:43.564301] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-07T18:16:43.564384] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-07T18:16:43.566030] [DEBUG] [LOCAL ] CUK: Trimmed 74049 records to 50976 (keeping 200 days of data) [2025-10-07T18:16:43.743290] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T18:16:43.785688] [INFO ] [REMOTE ] CULP: Full fetch complete (4631 records). [2025-10-07T18:16:43.796909] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-07T18:16:43.809838] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T18:16:43.862062] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-07T18:16:44.192846] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-07T18:16:44.193265] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-07T18:16:44.193466] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-07T18:16:44.193546] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-07T18:16:44.195194] [DEBUG] [LOCAL ] CULP: Trimmed 4631 records to 2898 (keeping 200 days of data) [2025-10-07T18:16:44.220464] [DEBUG] [LOCAL ] CULP: Primary data saved (2898 records). [2025-10-07T18:16:44.221445] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-07T18:16:44.221555] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CULP took 30.1s. Estimated remaining: 4h 9m 41s. Rate: 7.3 symbols/min [2025-10-07T18:16:44.292154] [DEBUG] [LOCAL ] CUK: Primary data saved (50976 records). [2025-10-07T18:16:44.292304] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-07T18:16:44.292389] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CUK took 40.9s. Estimated remaining: 4h 9m 6s. Rate: 7.3 symbols/min [2025-10-07T18:16:44.647706] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-07T18:16:45.539943] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T18:16:45.544208] [INFO ] [REMOTE ] CUBE: Full fetch complete (73100 records). [2025-10-07T18:16:45.544466] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-07T18:16:45.957103] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-07T18:16:45.957342] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-07T18:16:45.958439] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-07T18:16:45.958704] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-07T18:16:45.983240] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T18:16:45.991075] [DEBUG] [LOCAL ] CUBE: Trimmed 73100 records to 50776 (keeping 200 days of data) [2025-10-07T18:16:45.992044] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-07T18:16:46.318053] [DEBUG] [LOCAL ] CUBE: Primary data saved (50776 records). [2025-10-07T18:16:46.318256] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-07T18:16:46.320289] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CUBE took 51.5s. Estimated remaining: 4h 8m 38s. Rate: 7.3 symbols/min [2025-10-07T18:16:47.391366] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T18:16:47.399013] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-07T18:16:48.731549] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T18:16:48.738972] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-07T18:16:49.879703] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T18:16:49.882380] [INFO ] [REMOTE ] CURB: Full fetch complete (47382 records). [2025-10-07T18:16:49.882508] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-07T18:16:50.274958] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-07T18:16:50.275037] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-07T18:16:50.275659] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-07T18:16:50.275722] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-07T18:16:50.276674] [DEBUG] [LOCAL ] CURB: Trimmed 47382 records to 32683 (keeping 200 days of data) [2025-10-07T18:16:50.471583] [DEBUG] [LOCAL ] CURB: Primary data saved (32683 records). [2025-10-07T18:16:50.471756] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-07T18:16:50.471840] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CURB took 20.2s. Estimated remaining: 4h 8m 16s. Rate: 7.3 symbols/min [2025-10-07T18:16:51.089569] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:16:51.156323] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:16:51.199056] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:16:51.197417] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:16:51.199909] [DEBUG] [LOCAL ] CVE: No existing data file found in primary storage. [2025-10-07T18:16:51.200064] [WARN ] [MAIN ] CVE: No existing data found, performing full refresh instead. [2025-10-07T18:16:51.200173] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-07T18:16:51.200214] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-07T18:16:51.200257] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-07T18:16:51.200290] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-07T18:16:51.355950] [DEBUG] [LOCAL ] CVEO: Loaded 15179 existing records from primary storage. [2025-10-07T18:16:51.377048] [INFO ] [MAIN ] CVEO: Loaded 15179 existing records. [2025-10-07T18:16:51.448999] [DEBUG] [LOCAL ] CURV: Loaded 26819 existing records from primary storage. [2025-10-07T18:16:51.482591] [INFO ] [MAIN ] CURV: Loaded 26819 existing records. [2025-10-07T18:16:51.731227] [DEBUG] [LOCAL ] CUZ: Loaded 49398 existing records from primary storage. [2025-10-07T18:16:51.793060] [INFO ] [MAIN ] CUZ: Loaded 49398 existing records. [2025-10-07T18:16:52.021126] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:16:52.061723] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:16:52.072869] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-07T18:16:52.122639] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-07T18:16:52.122404] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:16:52.124179] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-07T18:16:52.140044] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-07T18:16:52.150532] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-07T18:16:52.122830] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-07T18:16:52.164144] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-07T18:16:52.179862] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-07T18:16:52.224468] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-07T18:16:52.237055] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:16:52.311867] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-07T18:16:52.330061] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-07T18:16:52.400581] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-07T18:16:52.414284] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-07T18:16:53.259242] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:16:53.280628] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-07T18:16:53.349799] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:16:53.367144] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-07T18:16:53.371036] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:16:53.372130] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-07T18:16:54.174506] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-07T18:16:54.186162] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-07T18:16:54.269206] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T18:16:54.272053] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-07T18:16:54.882076] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T18:16:54.890103] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-07T18:16:55.029795] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T18:16:55.039718] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-07T18:16:55.060755] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T18:16:55.063023] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-07T18:16:55.617276] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T18:16:55.640300] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T18:16:55.639882] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-07T18:16:55.847609] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-07T18:16:56.088482] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T18:16:56.432019] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T18:16:56.589486] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T18:16:56.647739] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-07T18:16:57.343688] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T18:16:57.447754] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-07T18:16:58.203332] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T18:16:58.247739] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-07T18:16:58.371960] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T18:16:59.005588] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T18:16:59.047606] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-07T18:16:59.847738] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-07T18:16:59.949365] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T18:17:00.647703] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-07T18:17:01.190241] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T18:17:01.447715] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-07T18:17:02.219934] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T18:17:02.247629] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-07T18:17:02.988891] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T18:17:03.047599] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-07T18:17:03.847693] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-07T18:17:03.990103] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T18:17:04.647682] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-07T18:17:05.086239] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T18:17:05.149072] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T18:17:05.447685] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-07T18:17:06.247706] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-07T18:17:06.505308] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T18:17:06.788827] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-07T18:17:07.047746] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-07T18:17:07.342594] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T18:17:07.847726] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-07T18:17:08.647662] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-07T18:17:08.926955] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T18:17:09.447632] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-07T18:17:09.544054] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T18:17:09.621145] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T18:17:10.247616] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-07T18:17:10.649602] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-07T18:17:11.047722] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-07T18:17:11.152948] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T18:17:11.847635] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-07T18:17:12.647622] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-07T18:17:12.780344] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-07T18:17:12.894604] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T18:17:13.447753] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-07T18:17:14.247727] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-07T18:17:14.409492] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T18:17:14.773827] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T18:17:15.047732] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-07T18:17:15.705034] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T18:17:15.847700] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-07T18:17:15.948621] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-07T18:17:15.950112] [INFO ] [REMOTE ] CVEO: Full fetch complete (20472 records). [2025-10-07T18:17:15.950187] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-07T18:17:16.313900] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-07T18:17:16.314002] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-07T18:17:16.314423] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-07T18:17:16.314484] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-07T18:17:16.315070] [DEBUG] [LOCAL ] CVEO: Trimmed 20472 records to 15232 (keeping 200 days of data) [2025-10-07T18:17:16.402315] [DEBUG] [LOCAL ] CVEO: Primary data saved (15232 records). [2025-10-07T18:17:16.402457] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-07T18:17:16.402555] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 25.9s. Estimated remaining: 4h 9m 5s. Rate: 7.3 symbols/min [2025-10-07T18:17:16.568679] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:17:16.614156] [DEBUG] [LOCAL ] CVI: Loaded 46494 existing records from primary storage. [2025-10-07T18:17:16.614474] [INFO ] [MAIN ] CVI: Loaded 46494 existing records. [2025-10-07T18:17:16.656123] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-07T18:17:16.795197] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:17:16.795457] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-07T18:17:16.795516] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-07T18:17:16.795809] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-07T18:17:16.795869] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-07T18:17:17.173706] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:17:17.447716] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-07T18:17:17.619081] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T18:17:18.101814] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T18:17:18.247669] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-07T18:17:19.047629] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-07T18:17:19.287116] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T18:17:19.384194] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T18:17:19.847683] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-07T18:17:20.516183] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T18:17:20.647689] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-07T18:17:21.447619] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-07T18:17:21.800019] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-07T18:17:21.845252] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T18:17:21.847379] [INFO ] [REMOTE ] CURV: Full fetch complete (38656 records). [2025-10-07T18:17:21.847461] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-07T18:17:21.848175] [FATAL] [VALIDATOR ] CURV: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:17:21.848263] [FATAL] [MAIN ] CURV: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:17:21.848305] [WARN ] [MAIN ] CURV: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:17:21.848373] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-07T18:17:21.848463] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-07T18:17:21.848518] [INFO ] [LOCAL ] CURV: Starting deletion of derivative data. [2025-10-07T18:17:21.848909] [DEBUG] [LOCAL ] CURV: Deleted derivative data file. [2025-10-07T18:17:21.849000] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 31.4s. Estimated remaining: 4h 8m 48s. Rate: 7.3 symbols/min [2025-10-07T18:17:22.013359] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:17:22.013551] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-07T18:17:22.013588] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-07T18:17:22.013722] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-07T18:17:22.013770] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-07T18:17:22.013811] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-07T18:17:22.013842] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-07T18:17:22.252963] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-07T18:17:22.368421] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:17:22.919245] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T18:17:22.923529] [INFO ] [REMOTE ] CUZ: Full fetch complete (70755 records). [2025-10-07T18:17:22.923701] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-07T18:17:23.062910] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-07T18:17:23.313588] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-07T18:17:23.313719] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-07T18:17:23.314602] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-07T18:17:23.314675] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-07T18:17:23.316199] [DEBUG] [LOCAL ] CUZ: Trimmed 70755 records to 49405 (keeping 200 days of data) [2025-10-07T18:17:23.641858] [DEBUG] [LOCAL ] CUZ: Primary data saved (49405 records). [2025-10-07T18:17:23.642019] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-07T18:17:23.642119] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 33.1s. Estimated remaining: 4h 8m 19s. Rate: 7.3 symbols/min [2025-10-07T18:17:23.822995] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:17:23.853295] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-07T18:17:23.876799] [DEBUG] [LOCAL ] CVNA: Loaded 52929 existing records from primary storage. [2025-10-07T18:17:23.877202] [INFO ] [MAIN ] CVNA: Loaded 52929 existing records. [2025-10-07T18:17:24.005473] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T18:17:24.097126] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:17:24.097373] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-07T18:17:24.097430] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-07T18:17:24.097704] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-07T18:17:24.097763] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-07T18:17:24.278548] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-07T18:17:24.466706] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:17:24.647621] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-07T18:17:25.428286] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T18:17:25.447606] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-07T18:17:26.247699] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-07T18:17:26.929809] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-07T18:17:27.025559] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T18:17:27.029424] [INFO ] [REMOTE ] CVE: Full fetch complete (77561 records). [2025-10-07T18:17:27.029583] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-07T18:17:27.052768] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-07T18:17:27.168539] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T18:17:27.455098] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-07T18:17:27.455195] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-07T18:17:27.456084] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-07T18:17:27.456150] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-07T18:17:27.457972] [DEBUG] [LOCAL ] CVE: Trimmed 77561 records to 53559 (keeping 200 days of data) [2025-10-07T18:17:27.801230] [DEBUG] [LOCAL ] CVE: Primary data saved (53559 records). [2025-10-07T18:17:27.801369] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-07T18:17:27.801443] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 37.3s. Estimated remaining: 4h 7m 57s. Rate: 7.3 symbols/min [2025-10-07T18:17:27.857274] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-07T18:17:27.972935] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:17:28.021693] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-07T18:17:28.022015] [INFO ] [MAIN ] CVS: Loaded 53696 existing records. [2025-10-07T18:17:28.201709] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:17:28.201961] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-07T18:17:28.202009] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-07T18:17:28.202220] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-07T18:17:28.202277] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-07T18:17:28.497127] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T18:17:28.562964] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:17:28.647610] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-07T18:17:29.277057] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-07T18:17:29.447688] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-07T18:17:30.247717] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-07T18:17:30.806686] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T18:17:30.879885] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-07T18:17:30.972215] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-07T18:17:31.047604] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-07T18:17:31.847679] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-07T18:17:32.185300] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T18:17:32.647745] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-07T18:17:33.447669] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-07T18:17:33.567617] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T18:17:33.644596] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T18:17:34.247734] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-07T18:17:35.047701] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-07T18:17:35.127181] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T18:17:35.847728] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-07T18:17:36.148470] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T18:17:36.484989] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-07T18:17:36.647601] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-07T18:17:37.447623] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-07T18:17:37.811510] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-07T18:17:38.247720] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-07T18:17:39.048328] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-07T18:17:39.048416] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-07T18:17:39.227464] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T18:17:39.249330] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T18:17:39.847714] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-07T18:17:40.608516] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T18:17:40.647615] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-07T18:17:40.894590] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T18:17:41.447697] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-07T18:17:42.156554] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T18:17:42.250142] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-07T18:17:42.256033] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T18:17:43.047613] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-07T18:17:43.108949] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T18:17:43.110332] [INFO ] [REMOTE ] CVLG: Full fetch complete (21092 records). [2025-10-07T18:17:43.110485] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-07T18:17:43.469149] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-07T18:17:43.469226] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-07T18:17:43.469621] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-07T18:17:43.469695] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-07T18:17:43.471541] [DEBUG] [LOCAL ] CVLG: Trimmed 21092 records to 15491 (keeping 200 days of data) [2025-10-07T18:17:43.573095] [DEBUG] [LOCAL ] CVLG: Primary data saved (15491 records). [2025-10-07T18:17:43.573249] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-07T18:17:43.573345] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 21.7s. Estimated remaining: 4h 8m 13s. Rate: 7.3 symbols/min [2025-10-07T18:17:43.753865] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:17:43.812415] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-07T18:17:43.813018] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-07T18:17:43.855510] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-07T18:17:43.995775] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:17:43.996006] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-07T18:17:43.996053] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-07T18:17:43.997287] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-07T18:17:43.997347] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-07T18:17:44.370073] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:17:44.647681] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-07T18:17:45.272742] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-07T18:17:45.447617] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-07T18:17:45.598842] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T18:17:46.247689] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-07T18:17:46.974339] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-07T18:17:47.047725] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-07T18:17:47.403580] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T18:17:47.847677] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-07T18:17:47.908171] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T18:17:48.633622] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T18:17:48.647594] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-07T18:17:49.447710] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-07T18:17:50.229024] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T18:17:50.247601] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-07T18:17:50.452663] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-07T18:17:51.047769] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-07T18:17:51.426771] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T18:17:51.726000] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-07T18:17:51.847723] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-07T18:17:52.338317] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T18:17:52.647742] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-07T18:17:53.447712] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-07T18:17:54.020708] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-07T18:17:54.238442] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T18:17:54.249502] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-07T18:17:55.047680] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-07T18:17:55.639379] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-07T18:17:55.847611] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-07T18:17:56.063984] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T18:17:56.642686] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T18:17:56.652543] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-07T18:17:57.447708] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-07T18:17:57.826524] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T18:17:58.247704] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-07T18:17:58.675018] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-07T18:17:59.047675] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-07T18:17:59.598964] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-07T18:17:59.847743] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-07T18:18:00.311596] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-07T18:18:00.647634] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-07T18:18:00.933835] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-07T18:18:00.937412] [INFO ] [REMOTE ] CVNA: Full fetch complete (76286 records). [2025-10-07T18:18:00.937537] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-07T18:18:00.938540] [FATAL] [VALIDATOR ] CVNA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:18:00.938637] [FATAL] [MAIN ] CVNA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:18:00.938727] [WARN ] [MAIN ] CVNA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:18:00.938807] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-07T18:18:00.938922] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-07T18:18:00.938981] [INFO ] [LOCAL ] CVNA: Starting deletion of derivative data. [2025-10-07T18:18:00.939236] [DEBUG] [LOCAL ] CVNA: Deleted derivative data file. [2025-10-07T18:18:00.939349] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVNA took 37.3s. Estimated remaining: 4h 8m 34s. Rate: 7.3 symbols/min [2025-10-07T18:18:01.125673] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:18:01.125886] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-10-07T18:18:01.125924] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-10-07T18:18:01.126037] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-07T18:18:01.126079] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-07T18:18:01.126121] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-07T18:18:01.126154] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-07T18:18:01.452921] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-07T18:18:01.487989] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:18:02.252318] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-07T18:18:02.275602] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T18:18:02.324316] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-07T18:18:03.047626] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-07T18:18:03.235159] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-07T18:18:03.238814] [INFO ] [REMOTE ] CVI: Full fetch complete (67319 records). [2025-10-07T18:18:03.238970] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-07T18:18:03.663386] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-07T18:18:03.663814] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-07T18:18:03.677916] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-07T18:18:03.678111] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-07T18:18:03.679539] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T18:18:03.685868] [DEBUG] [LOCAL ] CVI: Trimmed 67319 records to 46516 (keeping 200 days of data) [2025-10-07T18:18:03.786328] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T18:18:03.792459] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-10-07T18:18:03.793147] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-07T18:18:03.858714] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-07T18:18:04.320071] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-07T18:18:04.320475] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-07T18:18:04.325428] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-07T18:18:04.325609] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-07T18:18:04.427188] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 53696 (keeping 200 days of data) [2025-10-07T18:18:04.612270] [DEBUG] [LOCAL ] CVI: Primary data saved (46516 records). [2025-10-07T18:18:04.613163] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-07T18:18:04.613320] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVI took 48.2s. Estimated remaining: 4h 8m 11s. Rate: 7.3 symbols/min [2025-10-07T18:18:04.649726] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-07T18:18:04.809900] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:18:04.989638] [DEBUG] [LOCAL ] CWAN: Loaded 52437 existing records from primary storage. [2025-10-07T18:18:04.992263] [INFO ] [MAIN ] CWAN: Loaded 52437 existing records. [2025-10-07T18:18:05.248561] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:18:05.252993] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-07T18:18:05.254987] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-07T18:18:05.256799] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-07T18:18:05.257515] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-07T18:18:05.438428] [DEBUG] [LOCAL ] CVS: Primary data saved (53696 records). [2025-10-07T18:18:05.520703] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-07T18:18:05.526856] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVS took 37.7s. Estimated remaining: 4h 7m 40s. Rate: 7.3 symbols/min [2025-10-07T18:18:05.825723] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:18:05.857256] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-07T18:18:05.858791] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:18:05.877603] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T18:18:05.922231] [DEBUG] [LOCAL ] CWEN: Loaded 45176 existing records from primary storage. [2025-10-07T18:18:05.922594] [INFO ] [MAIN ] CWEN: Loaded 45176 existing records. [2025-10-07T18:18:06.097343] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:18:06.098090] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-07T18:18:06.098256] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-07T18:18:06.099036] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-07T18:18:06.099100] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-07T18:18:06.249154] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-07T18:18:06.562385] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:18:06.581621] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-07T18:18:07.047607] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-07T18:18:07.603950] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T18:18:07.718308] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T18:18:07.847626] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-07T18:18:08.647687] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-07T18:18:09.447712] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-07T18:18:09.529204] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-07T18:18:09.577800] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T18:18:10.239123] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T18:18:10.248397] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-07T18:18:10.579913] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-07T18:18:11.047747] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-07T18:18:11.860841] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-07T18:18:11.863862] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T18:18:12.527318] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T18:18:12.647632] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-07T18:18:13.447752] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-07T18:18:14.093635] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-07T18:18:14.171128] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T18:18:14.247634] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-07T18:18:14.370419] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T18:18:15.047729] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-07T18:18:15.500021] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T18:18:15.847719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-07T18:18:16.403279] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T18:18:16.647684] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-07T18:18:17.430335] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T18:18:17.447598] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-07T18:18:17.592706] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T18:18:18.247720] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-07T18:18:18.985158] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T18:18:19.047624] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-07T18:18:19.847714] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-07T18:18:20.652566] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-07T18:18:20.659062] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-07T18:18:20.684891] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T18:18:20.834899] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T18:18:21.447711] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-07T18:18:22.247617] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-07T18:18:22.277299] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T18:18:23.047700] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-07T18:18:23.143055] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-07T18:18:23.146796] [INFO ] [REMOTE ] CVX: Full fetch complete (77455 records). [2025-10-07T18:18:23.146970] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-07T18:18:23.148177] [FATAL] [VALIDATOR ] CVX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:18:23.148365] [FATAL] [MAIN ] CVX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:18:23.148413] [WARN ] [MAIN ] CVX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:18:23.148490] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-07T18:18:23.148583] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-07T18:18:23.148666] [INFO ] [LOCAL ] CVX: Starting deletion of derivative data. [2025-10-07T18:18:23.149032] [DEBUG] [LOCAL ] CVX: Deleted derivative data file. [2025-10-07T18:18:23.149146] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVX took 39.6s. Estimated remaining: 4h 8m 1s. Rate: 7.3 symbols/min [2025-10-07T18:18:23.331071] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:18:23.389259] [DEBUG] [LOCAL ] CWH: Loaded 51312 existing records from primary storage. [2025-10-07T18:18:23.389739] [INFO ] [MAIN ] CWH: Loaded 51312 existing records. [2025-10-07T18:18:23.607542] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:18:23.607962] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-07T18:18:23.608028] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-07T18:18:23.609893] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-07T18:18:23.609958] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-07T18:18:23.855707] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-07T18:18:24.047466] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:18:24.106246] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T18:18:24.651897] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-07T18:18:24.664487] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T18:18:25.103878] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T18:18:25.447728] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-07T18:18:26.051138] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T18:18:26.247717] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-07T18:18:27.043577] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T18:18:27.053137] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-07T18:18:27.370891] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T18:18:27.847629] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-07T18:18:28.429164] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:18:28.647746] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-07T18:18:28.878957] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T18:18:28.880612] [INFO ] [REMOTE ] CW: Full fetch complete (33191 records). [2025-10-07T18:18:28.880722] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-07T18:18:29.251800] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-07T18:18:29.251894] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-07T18:18:29.252396] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-07T18:18:29.252457] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-07T18:18:29.253726] [DEBUG] [LOCAL ] CW: Trimmed 33191 records to 22229 (keeping 200 days of data) [2025-10-07T18:18:29.398539] [DEBUG] [LOCAL ] CW: Primary data saved (22229 records). [2025-10-07T18:18:29.398700] [INFO ] [MAIN ] CW: Full history saved. [2025-10-07T18:18:29.398787] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CW took 28.5s. Estimated remaining: 4h 7m 47s. Rate: 7.3 symbols/min [2025-10-07T18:18:29.460156] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-07T18:18:29.568107] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:18:29.613074] [DEBUG] [LOCAL ] CWK: Loaded 49481 existing records from primary storage. [2025-10-07T18:18:29.613409] [INFO ] [MAIN ] CWK: Loaded 49481 existing records. [2025-10-07T18:18:29.825292] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:18:29.825571] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-07T18:18:29.825629] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-07T18:18:29.827321] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-07T18:18:29.827389] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-07T18:18:30.262537] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-07T18:18:30.271035] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:18:30.324815] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T18:18:31.047632] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-07T18:18:31.142467] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T18:18:31.517601] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T18:18:31.847685] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-07T18:18:32.647741] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-07T18:18:33.028554] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T18:18:33.370012] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T18:18:33.447630] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-07T18:18:34.247699] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-07T18:18:34.500389] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:18:35.047613] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-07T18:18:35.229161] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T18:18:35.673487] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T18:18:35.847685] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-07T18:18:36.647638] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-07T18:18:36.657443] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T18:18:36.661141] [INFO ] [REMOTE ] CWEN: Full fetch complete (64986 records). [2025-10-07T18:18:36.661258] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-07T18:18:37.041702] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-07T18:18:37.041797] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-07T18:18:37.042751] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-07T18:18:37.042814] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-07T18:18:37.044103] [DEBUG] [LOCAL ] CWEN: Trimmed 64986 records to 45224 (keeping 200 days of data) [2025-10-07T18:18:37.319594] [DEBUG] [LOCAL ] CWEN: Primary data saved (45224 records). [2025-10-07T18:18:37.319753] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-07T18:18:37.319854] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 31.8s. Estimated remaining: 4h 7m 37s. Rate: 7.3 symbols/min [2025-10-07T18:18:37.461107] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-07T18:18:37.492971] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:18:37.519631] [DEBUG] [LOCAL ] CWT: Loaded 27928 existing records from primary storage. [2025-10-07T18:18:37.519926] [INFO ] [MAIN ] CWT: Loaded 27928 existing records. [2025-10-07T18:18:37.712711] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:18:37.713002] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-07T18:18:37.713052] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-07T18:18:37.713868] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-07T18:18:37.713931] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-07T18:18:38.068733] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:18:38.247601] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-07T18:18:38.305774] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-07T18:18:38.481908] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T18:18:39.047610] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-07T18:18:39.273604] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-07T18:18:39.278266] [INFO ] [REMOTE ] CWAN: Full fetch complete (75191 records). [2025-10-07T18:18:39.278560] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-07T18:18:39.693976] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-07T18:18:39.694611] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T18:18:39.700035] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-07T18:18:39.701125] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-07T18:18:39.701198] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-07T18:18:39.702585] [DEBUG] [LOCAL ] CWAN: Trimmed 75191 records to 52446 (keeping 200 days of data) [2025-10-07T18:18:39.866617] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-07T18:18:40.028297] [DEBUG] [LOCAL ] CWAN: Primary data saved (52446 records). [2025-10-07T18:18:40.028477] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-07T18:18:40.028631] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWAN took 35.4s. Estimated remaining: 4h 7m 12s. Rate: 7.3 symbols/min [2025-10-07T18:18:40.235681] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:18:40.288277] [DEBUG] [LOCAL ] CX: Loaded 52807 existing records from primary storage. [2025-10-07T18:18:40.288632] [INFO ] [MAIN ] CX: Loaded 52807 existing records. [2025-10-07T18:18:40.505896] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:18:40.506121] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-07T18:18:40.506179] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-07T18:18:40.507554] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-07T18:18:40.507618] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-07T18:18:40.648886] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-07T18:18:41.002079] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:18:41.004277] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T18:18:41.447686] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-07T18:18:41.524976] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T18:18:41.714218] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T18:18:42.247718] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-07T18:18:43.047623] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-07T18:18:43.100272] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T18:18:43.847740] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-07T18:18:44.370246] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T18:18:44.404125] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-07T18:18:44.647729] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-07T18:18:44.956864] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T18:18:45.447749] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-07T18:18:45.975000] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T18:18:46.247755] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-07T18:18:47.047753] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-07T18:18:47.114178] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T18:18:47.847623] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-07T18:18:48.008278] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T18:18:48.517244] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T18:18:48.647706] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-07T18:18:49.452760] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-07T18:18:49.470236] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T18:18:50.173360] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T18:18:50.247634] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-07T18:18:51.047714] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-07T18:18:51.132852] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T18:18:51.188686] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T18:18:51.847732] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-07T18:18:52.647703] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-07T18:18:52.923848] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T18:18:53.447694] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-07T18:18:53.535368] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T18:18:54.202240] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T18:18:54.247676] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-07T18:18:54.716731] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T18:18:55.047632] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-07T18:18:55.485545] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T18:18:55.847754] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-07T18:18:56.135382] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T18:18:56.647809] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-07T18:18:57.212131] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T18:18:57.447610] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-07T18:18:58.247706] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-07T18:18:58.429332] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T18:18:59.022761] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T18:18:59.026029] [INFO ] [REMOTE ] CWH: Full fetch complete (73077 records). [2025-10-07T18:18:59.026144] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-07T18:18:59.056686] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-07T18:18:59.420063] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-07T18:18:59.420172] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-07T18:18:59.421292] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-07T18:18:59.421359] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-07T18:18:59.422827] [DEBUG] [LOCAL ] CWH: Trimmed 73077 records to 51310 (keeping 200 days of data) [2025-10-07T18:18:59.656372] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T18:18:59.764619] [DEBUG] [LOCAL ] CWH: Primary data saved (51310 records). [2025-10-07T18:18:59.764791] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-07T18:18:59.764877] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 36.6s. Estimated remaining: 4h 7m 39s. Rate: 7.3 symbols/min [2025-10-07T18:18:59.852850] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-07T18:18:59.933301] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:18:59.940107] [DEBUG] [LOCAL ] CXE: Loaded 6286 existing records from primary storage. [2025-10-07T18:18:59.940272] [INFO ] [MAIN ] CXE: Loaded 6286 existing records. [2025-10-07T18:19:00.111469] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:19:00.111748] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-07T18:19:00.111808] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-07T18:19:00.112131] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-07T18:19:00.112229] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-07T18:19:00.477309] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:19:00.647608] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-07T18:19:00.856515] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T18:19:01.278717] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T18:19:01.280603] [INFO ] [REMOTE ] CWT: Full fetch complete (40434 records). [2025-10-07T18:19:01.280742] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-07T18:19:01.282049] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:19:01.282135] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:19:01.282189] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:19:01.282278] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-07T18:19:01.282361] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-07T18:19:01.282410] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-10-07T18:19:01.282665] [DEBUG] [LOCAL ] CWT: Deleted derivative data file. [2025-10-07T18:19:01.282787] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWT took 24.0s. Estimated remaining: 4h 7m 10s. Rate: 7.3 symbols/min [2025-10-07T18:19:01.452270] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:19:01.452445] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-07T18:19:01.460232] [DEBUG] [LOCAL ] CXH: Loaded 4449 existing records from primary storage. [2025-10-07T18:19:01.460453] [INFO ] [MAIN ] CXH: Loaded 4449 existing records. [2025-10-07T18:19:01.636821] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:19:01.637070] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-07T18:19:01.637119] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-07T18:19:01.637293] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-07T18:19:01.637350] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-07T18:19:01.986757] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:19:02.247692] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-07T18:19:02.396996] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T18:19:02.552367] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T18:19:02.876486] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-07T18:19:03.047703] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-07T18:19:03.531529] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T18:19:03.847721] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-07T18:19:04.444804] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T18:19:04.647695] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-07T18:19:05.447701] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-07T18:19:05.530697] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T18:19:06.247692] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-07T18:19:06.591898] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-07T18:19:06.985559] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T18:19:07.047623] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-07T18:19:07.847674] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-07T18:19:08.647635] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-07T18:19:08.730720] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T18:19:09.164541] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-07T18:19:09.447634] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-07T18:19:09.693977] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T18:19:10.247702] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-07T18:19:10.812957] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T18:19:11.047696] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-07T18:19:11.201710] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-07T18:19:11.205397] [INFO ] [REMOTE ] CWK: Full fetch complete (71068 records). [2025-10-07T18:19:11.205555] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-07T18:19:11.595749] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-07T18:19:11.595902] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-07T18:19:11.596757] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-07T18:19:11.596823] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-07T18:19:11.598332] [DEBUG] [LOCAL ] CWK: Trimmed 71068 records to 49503 (keeping 200 days of data) [2025-10-07T18:19:11.688002] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T18:19:11.869139] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-07T18:19:11.903918] [DEBUG] [LOCAL ] CWK: Primary data saved (49503 records). [2025-10-07T18:19:11.904343] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-07T18:19:11.904442] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWK took 42.5s. Estimated remaining: 4h 7m 9s. Rate: 7.3 symbols/min [2025-10-07T18:19:12.070780] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:19:12.113284] [DEBUG] [LOCAL ] CXM: Loaded 47544 existing records from primary storage. [2025-10-07T18:19:12.113598] [INFO ] [MAIN ] CXM: Loaded 47544 existing records. [2025-10-07T18:19:12.286200] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:19:12.286435] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-07T18:19:12.286483] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-07T18:19:12.286823] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-07T18:19:12.286882] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-07T18:19:12.631703] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:19:12.647604] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-07T18:19:13.252636] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:19:13.447718] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-07T18:19:14.146860] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T18:19:14.247721] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-07T18:19:14.875145] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T18:19:15.047758] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-07T18:19:15.496014] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T18:19:15.847713] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-07T18:19:16.068179] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T18:19:16.647677] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-07T18:19:17.447729] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-07T18:19:17.572782] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T18:19:17.610847] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T18:19:18.247741] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-07T18:19:18.573674] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T18:19:19.047687] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-07T18:19:19.769487] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T18:19:19.847616] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-07T18:19:20.606511] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T18:19:20.647637] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-07T18:19:21.275253] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T18:19:21.278890] [INFO ] [REMOTE ] CX: Full fetch complete (76391 records). [2025-10-07T18:19:21.279023] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-07T18:19:21.455318] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-07T18:19:21.670697] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-07T18:19:21.670787] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-07T18:19:21.671746] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-07T18:19:21.671811] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-07T18:19:21.673486] [DEBUG] [LOCAL ] CX: Trimmed 76391 records to 52822 (keeping 200 days of data) [2025-10-07T18:19:21.989445] [DEBUG] [LOCAL ] CX: Primary data saved (52822 records). [2025-10-07T18:19:21.989585] [INFO ] [MAIN ] CX: Full history saved. [2025-10-07T18:19:21.989692] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CX took 42.0s. Estimated remaining: 4h 7m 7s. Rate: 7.3 symbols/min [2025-10-07T18:19:22.169875] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:19:22.202364] [DEBUG] [LOCAL ] CXT: Loaded 30991 existing records from primary storage. [2025-10-07T18:19:22.202805] [INFO ] [MAIN ] CXT: Loaded 30991 existing records. [2025-10-07T18:19:22.247819] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-07T18:19:22.311377] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-07T18:19:22.410019] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:19:22.426517] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-07T18:19:22.427293] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-07T18:19:22.428414] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:19:22.438182] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-07T18:19:22.438276] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-07T18:19:22.819910] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:19:23.047700] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-07T18:19:23.056916] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T18:19:23.668365] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T18:19:23.847682] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-07T18:19:24.289252] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T18:19:24.647737] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-07T18:19:25.080840] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-07T18:19:25.447705] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-07T18:19:26.030259] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T18:19:26.247701] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-07T18:19:27.047624] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-07T18:19:27.125411] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T18:19:27.847707] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-07T18:19:28.436420] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-07T18:19:28.609434] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T18:19:28.647613] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-07T18:19:29.447711] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-07T18:19:30.125294] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T18:19:30.126160] [INFO ] [REMOTE ] CXH: Full fetch complete (5394 records). [2025-10-07T18:19:30.126231] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-07T18:19:30.126626] [FATAL] [VALIDATOR ] CXH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:19:30.126743] [FATAL] [MAIN ] CXH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:19:30.126880] [WARN ] [MAIN ] CXH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:19:30.126923] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-07T18:19:30.126980] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-10-07T18:19:30.127016] [INFO ] [LOCAL ] CXH: Starting deletion of derivative data. [2025-10-07T18:19:30.127205] [DEBUG] [LOCAL ] CXH: Deleted derivative data file. [2025-10-07T18:19:30.127292] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXH took 28.8s. Estimated remaining: 4h 6m 58s. Rate: 7.3 symbols/min [2025-10-07T18:19:30.250237] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-07T18:19:30.344889] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:19:30.347215] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T18:19:30.399171] [DEBUG] [LOCAL ] CXW: Loaded 43955 existing records from primary storage. [2025-10-07T18:19:30.399492] [INFO ] [MAIN ] CXW: Loaded 43955 existing records. [2025-10-07T18:19:30.572501] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:19:30.572767] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-07T18:19:30.572819] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-07T18:19:30.573027] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-07T18:19:30.573082] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-07T18:19:30.928384] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:19:31.047612] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-07T18:19:31.062252] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T18:19:31.847791] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-07T18:19:32.647688] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-07T18:19:32.989277] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T18:19:33.453308] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-07T18:19:33.492211] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T18:19:33.798534] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T18:19:34.247630] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-07T18:19:34.301455] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T18:19:34.302844] [INFO ] [REMOTE ] CXE: Full fetch complete (11724 records). [2025-10-07T18:19:34.302987] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-07T18:19:34.664781] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-07T18:19:34.664860] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-07T18:19:34.665172] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-07T18:19:34.665211] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-07T18:19:34.665672] [DEBUG] [LOCAL ] CXE: Trimmed 11724 records to 6168 (keeping 200 days of data) [2025-10-07T18:19:34.705507] [DEBUG] [LOCAL ] CXE: Primary data saved (6168 records). [2025-10-07T18:19:34.705715] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-07T18:19:34.705824] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXE took 34.9s. Estimated remaining: 4h 6m 38s. Rate: 7.3 symbols/min [2025-10-07T18:19:34.878751] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:19:34.907362] [DEBUG] [LOCAL ] CYD: Loaded 26399 existing records from primary storage. [2025-10-07T18:19:34.907680] [INFO ] [MAIN ] CYD: Loaded 26399 existing records. [2025-10-07T18:19:35.054861] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-07T18:19:35.088838] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:19:35.089041] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-07T18:19:35.089122] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-07T18:19:35.089366] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-07T18:19:35.089436] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-07T18:19:35.444004] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:19:35.824557] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T18:19:35.847601] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-07T18:19:36.647690] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-07T18:19:36.772965] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T18:19:37.449311] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T18:19:37.449481] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-07T18:19:37.610862] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T18:19:38.159546] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-07T18:19:38.247692] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-07T18:19:39.047704] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-07T18:19:39.717184] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T18:19:39.723010] [INFO ] [REMOTE ] CXM: Full fetch complete (68714 records). [2025-10-07T18:19:39.723299] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-07T18:19:39.849818] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-07T18:19:40.151585] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-07T18:19:40.151696] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-07T18:19:40.152927] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-07T18:19:40.152998] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-07T18:19:40.154598] [DEBUG] [LOCAL ] CXM: Trimmed 68714 records to 47611 (keeping 200 days of data) [2025-10-07T18:19:40.450977] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T18:19:40.486694] [DEBUG] [LOCAL ] CXM: Primary data saved (47611 records). [2025-10-07T18:19:40.486811] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-07T18:19:40.486888] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXM took 28.6s. Estimated remaining: 4h 6m 22s. Rate: 7.3 symbols/min [2025-10-07T18:19:40.651935] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:19:40.650406] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-07T18:19:40.702147] [DEBUG] [LOCAL ] CYH: Loaded 47591 existing records from primary storage. [2025-10-07T18:19:40.702560] [INFO ] [MAIN ] CYH: Loaded 47591 existing records. [2025-10-07T18:19:40.882463] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:19:40.882838] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-07T18:19:40.883084] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-07T18:19:40.883550] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-07T18:19:40.883629] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-07T18:19:41.014425] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T18:19:41.283715] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:19:41.284933] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T18:19:41.447693] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-07T18:19:42.247689] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-07T18:19:42.407183] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T18:19:43.047637] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-07T18:19:43.847814] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-07T18:19:44.118626] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T18:19:44.188962] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T18:19:44.647723] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-07T18:19:45.447681] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-07T18:19:45.743332] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T18:19:46.247709] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-07T18:19:46.291066] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T18:19:47.047630] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-07T18:19:47.214102] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T18:19:47.799726] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T18:19:47.847606] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-07T18:19:48.647629] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-07T18:19:49.269013] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T18:19:49.328919] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-07T18:19:49.447633] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-07T18:19:49.718993] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T18:19:50.247712] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-07T18:19:51.047749] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-07T18:19:51.336457] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T18:19:51.699207] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T18:19:51.847741] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-07T18:19:52.647675] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-07T18:19:52.687744] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T18:19:52.978758] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T18:19:53.447695] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-07T18:19:53.828067] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T18:19:54.247629] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-07T18:19:54.755871] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T18:19:55.047692] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-07T18:19:55.350133] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T18:19:55.847680] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-07T18:19:56.647669] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-07T18:19:56.978630] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-07T18:19:57.310104] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T18:19:57.447693] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-07T18:19:58.252846] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-07T18:19:58.264974] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T18:19:58.489092] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T18:19:58.491451] [INFO ] [REMOTE ] CYD: Full fetch complete (33844 records). [2025-10-07T18:19:58.491541] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-07T18:19:58.898871] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-07T18:19:58.898953] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-07T18:19:58.899470] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-07T18:19:58.899511] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-07T18:19:58.900361] [DEBUG] [LOCAL ] CYD: Trimmed 33844 records to 26352 (keeping 200 days of data) [2025-10-07T18:19:59.047936] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-07T18:19:59.058514] [DEBUG] [LOCAL ] CYD: Primary data saved (26352 records). [2025-10-07T18:19:59.058691] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-07T18:19:59.058807] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CYD took 24.4s. Estimated remaining: 4h 6m 46s. Rate: 7.3 symbols/min [2025-10-07T18:19:59.228471] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:19:59.277790] [DEBUG] [LOCAL ] D: Loaded 53645 existing records from primary storage. [2025-10-07T18:19:59.278127] [INFO ] [MAIN ] D: Loaded 53645 existing records. [2025-10-07T18:19:59.457959] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:19:59.458230] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-07T18:19:59.458293] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-07T18:19:59.458691] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-07T18:19:59.458750] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-07T18:19:59.814017] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:19:59.847612] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-07T18:19:59.980269] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T18:20:00.647674] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-07T18:20:01.014944] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T18:20:01.447694] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-07T18:20:02.177683] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T18:20:02.247673] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-07T18:20:02.625289] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-07T18:20:03.047703] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-07T18:20:03.134069] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T18:20:03.628453] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T18:20:03.847672] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-07T18:20:04.647672] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-07T18:20:04.743286] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T18:20:05.093936] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T18:20:05.447689] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-07T18:20:06.257457] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-07T18:20:06.276280] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T18:20:07.047742] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-07T18:20:07.139882] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T18:20:07.207374] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-07T18:20:07.847739] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-07T18:20:08.637459] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T18:20:08.640490] [INFO ] [REMOTE ] CXW: Full fetch complete (64938 records). [2025-10-07T18:20:08.640593] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-07T18:20:08.653658] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-07T18:20:09.027823] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-07T18:20:09.027928] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-07T18:20:09.028755] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-07T18:20:09.028823] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-07T18:20:09.030243] [DEBUG] [LOCAL ] CXW: Trimmed 64938 records to 43951 (keeping 200 days of data) [2025-10-07T18:20:09.298148] [DEBUG] [LOCAL ] CXW: Primary data saved (43951 records). [2025-10-07T18:20:09.298323] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-07T18:20:09.298497] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXW took 39.2s. Estimated remaining: 4h 6m 44s. Rate: 7.3 symbols/min [2025-10-07T18:20:09.468828] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:20:09.450948] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-07T18:20:09.480400] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T18:20:09.483501] [INFO ] [REMOTE ] CXT: Full fetch complete (45525 records). [2025-10-07T18:20:09.483603] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-07T18:20:09.614256] [DEBUG] [LOCAL ] DAC: Loaded 12528 existing records from primary storage. [2025-10-07T18:20:09.629934] [INFO ] [MAIN ] DAC: Loaded 12528 existing records. [2025-10-07T18:20:09.997722] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:20:10.027210] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-07T18:20:10.040449] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-07T18:20:10.059568] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-07T18:20:10.062539] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-07T18:20:10.167794] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-07T18:20:10.175603] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-07T18:20:10.178704] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-07T18:20:10.179130] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-07T18:20:10.238448] [DEBUG] [LOCAL ] CXT: Trimmed 45525 records to 30988 (keeping 200 days of data) [2025-10-07T18:20:10.562002] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:20:10.571224] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-07T18:20:10.656452] [DEBUG] [LOCAL ] CXT: Primary data saved (30988 records). [2025-10-07T18:20:10.656605] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-07T18:20:10.656731] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CXT took 48.7s. Estimated remaining: 4h 6m 14s. Rate: 7.3 symbols/min [2025-10-07T18:20:10.829951] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:20:10.888833] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-07T18:20:10.889296] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-07T18:20:11.092924] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-07T18:20:11.107138] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:20:11.107546] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-07T18:20:11.107606] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-07T18:20:11.107882] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-07T18:20:11.107941] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-07T18:20:11.181475] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-07T18:20:11.496771] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:20:11.510862] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-07T18:20:11.827208] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T18:20:11.847670] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-07T18:20:12.647678] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-07T18:20:12.800371] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T18:20:13.447705] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-07T18:20:13.571401] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-07T18:20:14.225636] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T18:20:14.247620] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-07T18:20:14.400316] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T18:20:15.047717] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-07T18:20:15.847727] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-07T18:20:16.301173] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-07T18:20:16.647746] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-07T18:20:17.344749] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-07T18:20:17.447689] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-07T18:20:17.524024] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T18:20:17.554430] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T18:20:18.247693] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-07T18:20:19.047699] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-07T18:20:19.200971] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T18:20:19.631592] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:20:19.847636] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-07T18:20:20.572152] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T18:20:20.647681] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-07T18:20:21.447718] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-07T18:20:21.859221] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T18:20:22.240755] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T18:20:22.244082] [INFO ] [REMOTE ] CYH: Full fetch complete (69816 records). [2025-10-07T18:20:22.244283] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-07T18:20:22.257257] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-07T18:20:22.665106] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-07T18:20:22.665213] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-07T18:20:22.666224] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-07T18:20:22.671511] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-07T18:20:22.678074] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T18:20:22.681887] [DEBUG] [LOCAL ] CYH: Trimmed 69816 records to 47623 (keeping 200 days of data) [2025-10-07T18:20:22.965541] [DEBUG] [LOCAL ] CYH: Primary data saved (47623 records). [2025-10-07T18:20:22.965713] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-07T18:20:22.965810] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CYH took 42.5s. Estimated remaining: 4h 6m 18s. Rate: 7.3 symbols/min [2025-10-07T18:20:23.054289] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-07T18:20:23.135892] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:20:23.185351] [DEBUG] [LOCAL ] DAN: Loaded 49053 existing records from primary storage. [2025-10-07T18:20:23.185770] [INFO ] [MAIN ] DAN: Loaded 49053 existing records. [2025-10-07T18:20:23.363832] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:20:23.364105] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-07T18:20:23.364155] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-07T18:20:23.364402] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-07T18:20:23.364458] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-07T18:20:23.747723] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:20:23.847612] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-07T18:20:24.651070] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-07T18:20:24.672115] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-07T18:20:25.081602] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-07T18:20:25.447632] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-07T18:20:25.472603] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T18:20:25.847794] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T18:20:26.247693] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-07T18:20:27.047736] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-07T18:20:27.329367] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T18:20:27.847677] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-07T18:20:28.647734] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-07T18:20:28.836696] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-07T18:20:28.878455] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T18:20:29.340063] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T18:20:29.447613] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-07T18:20:29.547845] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-07T18:20:29.550862] [INFO ] [REMOTE ] D: Full fetch complete (77267 records). [2025-10-07T18:20:29.550962] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-07T18:20:29.551848] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:20:29.551943] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:20:29.551986] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:20:29.552026] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-07T18:20:29.552084] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-07T18:20:29.552118] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-07T18:20:29.552332] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-10-07T18:20:29.552423] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. D took 30.5s. Estimated remaining: 4h 6m 5s. Rate: 7.3 symbols/min [2025-10-07T18:20:29.754148] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:20:29.754459] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-07T18:20:29.754519] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-07T18:20:29.754636] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-07T18:20:29.754723] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-07T18:20:29.754773] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-07T18:20:29.754805] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-07T18:20:30.144298] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:20:30.247673] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-07T18:20:30.978567] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-07T18:20:31.047620] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-07T18:20:31.439723] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T18:20:31.646987] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T18:20:31.847662] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-07T18:20:32.647710] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-07T18:20:32.947583] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T18:20:33.447684] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-07T18:20:33.995528] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T18:20:34.247674] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-07T18:20:35.047613] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-07T18:20:35.272406] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T18:20:35.273768] [INFO ] [REMOTE ] DAC: Full fetch complete (19370 records). [2025-10-07T18:20:35.273841] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-07T18:20:35.639586] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-07T18:20:35.639789] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-07T18:20:35.640277] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-07T18:20:35.640357] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-07T18:20:35.641178] [DEBUG] [LOCAL ] DAC: Trimmed 19370 records to 12546 (keeping 200 days of data) [2025-10-07T18:20:35.718373] [DEBUG] [LOCAL ] DAC: Primary data saved (12546 records). [2025-10-07T18:20:35.718502] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-07T18:20:35.718584] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. DAC took 26.4s. Estimated remaining: 4h 5m 50s. Rate: 7.3 symbols/min [2025-10-07T18:20:35.863726] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-07T18:20:35.923968] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:20:35.928067] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-07T18:20:35.989930] [DEBUG] [LOCAL ] DAR: Loaded 51849 existing records from primary storage. [2025-10-07T18:20:35.990264] [INFO ] [MAIN ] DAR: Loaded 51849 existing records. [2025-10-07T18:20:36.164683] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:20:36.164882] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-07T18:20:36.164930] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-07T18:20:36.165141] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-07T18:20:36.165199] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-07T18:20:36.516125] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:20:36.647608] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-07T18:20:36.698059] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T18:20:36.830107] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T18:20:37.447781] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-07T18:20:38.247706] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-07T18:20:39.047632] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-07T18:20:39.095891] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-07T18:20:39.288520] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T18:20:39.557413] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-07T18:20:39.847636] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-07T18:20:40.508079] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T18:20:40.647725] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-07T18:20:41.181630] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T18:20:41.447721] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-07T18:20:42.247701] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-07T18:20:42.376816] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T18:20:43.047699] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-07T18:20:43.462725] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-07T18:20:43.555888] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T18:20:43.847616] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-07T18:20:44.647622] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-07T18:20:44.735911] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T18:20:45.345700] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T18:20:45.447626] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-07T18:20:45.915596] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T18:20:46.247707] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-07T18:20:46.523861] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T18:20:47.047686] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-07T18:20:47.847695] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-07T18:20:48.338941] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-07T18:20:48.402336] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T18:20:48.647705] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-07T18:20:48.733056] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-07T18:20:49.447676] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-07T18:20:50.247780] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-07T18:20:50.419478] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T18:20:50.640728] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T18:20:51.047687] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-07T18:20:51.857378] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-07T18:20:51.874965] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T18:20:52.399879] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T18:20:52.647734] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-07T18:20:53.447796] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-07T18:20:54.056113] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-07T18:20:54.129153] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T18:20:54.247730] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-07T18:20:55.047627] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-07T18:20:55.092355] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T18:20:55.847619] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-07T18:20:55.882622] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T18:20:56.171330] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T18:20:56.647768] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-07T18:20:57.361147] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T18:20:57.447612] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-07T18:20:58.247724] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-07T18:20:58.713188] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-07T18:20:58.717861] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-07T18:20:58.718170] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-07T18:20:59.049203] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-07T18:20:59.134127] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-07T18:20:59.134412] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-07T18:20:59.135399] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-07T18:20:59.135584] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-07T18:20:59.137333] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-10-07T18:20:59.263988] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:20:59.519055] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-07T18:20:59.519203] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-07T18:20:59.519298] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAL took 48.9s. Estimated remaining: 4h 6m 29s. Rate: 7.2 symbols/min [2025-10-07T18:20:59.690558] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:20:59.733214] [DEBUG] [LOCAL ] DAVA: Loaded 41193 existing records from primary storage. [2025-10-07T18:20:59.733511] [INFO ] [MAIN ] DAVA: Loaded 41193 existing records. [2025-10-07T18:20:59.848577] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-07T18:20:59.914983] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:20:59.915490] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-07T18:20:59.915559] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-07T18:20:59.915871] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-07T18:20:59.915977] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-07T18:21:00.098107] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:21:00.330516] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:21:00.533155] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T18:21:00.647618] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-07T18:21:01.447693] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-07T18:21:01.699208] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T18:21:01.700533] [INFO ] [REMOTE ] DAO: Full fetch complete (32562 records). [2025-10-07T18:21:01.700620] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-07T18:21:02.126466] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-07T18:21:02.126680] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-07T18:21:02.127449] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-07T18:21:02.127583] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-07T18:21:02.129227] [DEBUG] [LOCAL ] DAO: Trimmed 32562 records to 20194 (keeping 200 days of data) [2025-10-07T18:21:02.166919] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-07T18:21:02.262311] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-07T18:21:02.305245] [DEBUG] [LOCAL ] DAO: Primary data saved (20194 records). [2025-10-07T18:21:02.305393] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-07T18:21:02.305471] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAO took 32.8s. Estimated remaining: 4h 6m 4s. Rate: 7.2 symbols/min [2025-10-07T18:21:02.474873] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:21:02.518334] [DEBUG] [LOCAL ] DAY: Loaded 49247 existing records from primary storage. [2025-10-07T18:21:02.518737] [INFO ] [MAIN ] DAY: Loaded 49247 existing records. [2025-10-07T18:21:02.692006] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:21:02.692258] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-07T18:21:02.692306] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-07T18:21:02.692517] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-07T18:21:02.692573] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-07T18:21:03.045151] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:21:03.047609] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-07T18:21:03.434612] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-07T18:21:03.438097] [INFO ] [REMOTE ] DAN: Full fetch complete (70861 records). [2025-10-07T18:21:03.438209] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-07T18:21:03.837839] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-07T18:21:03.837956] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-07T18:21:03.838872] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-07T18:21:03.839022] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-07T18:21:03.858799] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-07T18:21:03.860939] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T18:21:03.868079] [DEBUG] [LOCAL ] DAN: Trimmed 70861 records to 49104 (keeping 200 days of data) [2025-10-07T18:21:04.190544] [DEBUG] [LOCAL ] DAN: Primary data saved (49104 records). [2025-10-07T18:21:04.190730] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-07T18:21:04.190832] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 41.2s. Estimated remaining: 4h 5m 37s. Rate: 7.3 symbols/min [2025-10-07T18:21:04.359206] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:21:04.410056] [DEBUG] [LOCAL ] DB: Loaded 52532 existing records from primary storage. [2025-10-07T18:21:04.410421] [INFO ] [MAIN ] DB: Loaded 52532 existing records. [2025-10-07T18:21:04.589813] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:21:04.590121] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-07T18:21:04.590250] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-07T18:21:04.590565] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-07T18:21:04.590733] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-07T18:21:04.652759] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-07T18:21:04.885303] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T18:21:05.005849] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:21:05.447679] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-07T18:21:05.696464] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-07T18:21:05.700432] [INFO ] [REMOTE ] DAR: Full fetch complete (74640 records). [2025-10-07T18:21:05.700567] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-07T18:21:06.043206] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T18:21:06.127955] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-07T18:21:06.128065] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-07T18:21:06.129020] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-07T18:21:06.129098] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-07T18:21:06.130752] [DEBUG] [LOCAL ] DAR: Trimmed 74640 records to 51864 (keeping 200 days of data) [2025-10-07T18:21:06.250347] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-07T18:21:06.436406] [DEBUG] [LOCAL ] DAR: Primary data saved (51864 records). [2025-10-07T18:21:06.436560] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-07T18:21:06.436672] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 30.7s. Estimated remaining: 4h 5m 10s. Rate: 7.3 symbols/min [2025-10-07T18:21:06.606831] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:21:06.607049] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-07T18:21:06.607105] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-07T18:21:06.607217] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-07T18:21:06.607280] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-07T18:21:06.607340] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-07T18:21:06.607373] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-07T18:21:06.972886] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:21:07.047639] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-07T18:21:07.301484] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T18:21:07.632213] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T18:21:07.813495] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T18:21:07.847613] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-07T18:21:08.647712] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-07T18:21:09.282318] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T18:21:09.447690] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-07T18:21:09.498082] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T18:21:10.247697] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-07T18:21:10.757472] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T18:21:11.047665] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-07T18:21:11.852323] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-07T18:21:11.858166] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T18:21:12.272036] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T18:21:12.647681] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-07T18:21:13.325273] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T18:21:13.447665] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-07T18:21:14.247792] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-07T18:21:14.479528] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T18:21:14.871948] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T18:21:15.047695] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-07T18:21:15.718599] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T18:21:15.847682] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-07T18:21:16.458885] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-07T18:21:16.647677] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-07T18:21:17.447686] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-07T18:21:17.909158] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T18:21:18.167973] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-07T18:21:18.247602] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-07T18:21:18.459312] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T18:21:19.047769] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-07T18:21:19.847679] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-07T18:21:20.089677] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T18:21:20.224153] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T18:21:20.647775] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-07T18:21:21.272080] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T18:21:21.447713] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-07T18:21:21.699092] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T18:21:22.247771] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-07T18:21:23.054415] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-07T18:21:23.059961] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T18:21:23.847632] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-07T18:21:23.994432] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T18:21:24.164708] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T18:21:24.647785] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-07T18:21:25.447636] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-07T18:21:25.758217] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T18:21:26.247712] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-07T18:21:26.361972] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T18:21:27.047711] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-07T18:21:27.299918] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T18:21:27.463163] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T18:21:27.847631] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-07T18:21:28.589622] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T18:21:28.647602] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-07T18:21:29.447692] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-07T18:21:29.714636] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T18:21:30.085373] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-07T18:21:30.247701] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-07T18:21:31.047622] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-07T18:21:31.304486] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T18:21:31.602492] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T18:21:31.847685] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-07T18:21:32.499352] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T18:21:32.647610] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-07T18:21:33.324213] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T18:21:33.326637] [INFO ] [REMOTE ] DAY: Full fetch complete (71165 records). [2025-10-07T18:21:33.326804] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-07T18:21:33.327600] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:21:33.327713] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:21:33.327800] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:21:33.327850] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-07T18:21:33.327910] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-07T18:21:33.327989] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-07T18:21:33.328261] [DEBUG] [LOCAL ] DAY: Deleted derivative data file. [2025-10-07T18:21:33.328375] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAY took 31.0s. Estimated remaining: 4h 5m 58s. Rate: 7.2 symbols/min [2025-10-07T18:21:33.452884] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-07T18:21:33.498884] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:21:33.538881] [DEBUG] [LOCAL ] DBI: Loaded 44435 existing records from primary storage. [2025-10-07T18:21:33.539191] [INFO ] [MAIN ] DBI: Loaded 44435 existing records. [2025-10-07T18:21:33.717486] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:21:33.717775] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-07T18:21:33.717835] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-07T18:21:33.718050] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-07T18:21:33.718107] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-07T18:21:34.073709] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:21:34.203519] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T18:21:34.247637] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-07T18:21:34.613837] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T18:21:35.047684] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-07T18:21:35.717867] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T18:21:35.847625] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-07T18:21:35.897217] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T18:21:35.899890] [INFO ] [REMOTE ] DBD: Full fetch complete (30961 records). [2025-10-07T18:21:35.900038] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-07T18:21:35.900876] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:21:35.900971] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:21:35.901018] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:21:35.901097] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-07T18:21:35.901174] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-07T18:21:35.901541] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-07T18:21:35.901921] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-07T18:21:35.902126] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DBD took 29.5s. Estimated remaining: 4h 5m 33s. Rate: 7.2 symbols/min [2025-10-07T18:21:36.069493] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:21:36.082476] [DEBUG] [LOCAL ] DBL: Loaded 9270 existing records from primary storage. [2025-10-07T18:21:36.082782] [INFO ] [MAIN ] DBL: Loaded 9270 existing records. [2025-10-07T18:21:36.287371] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:21:36.287594] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-07T18:21:36.287664] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-07T18:21:36.287881] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-07T18:21:36.287936] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-07T18:21:36.647632] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-07T18:21:36.652606] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:21:37.447758] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-07T18:21:37.699745] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-07T18:21:37.703303] [INFO ] [REMOTE ] DB: Full fetch complete (74738 records). [2025-10-07T18:21:37.703432] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-07T18:21:38.105301] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-07T18:21:38.105402] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-07T18:21:38.106286] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-07T18:21:38.106354] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-07T18:21:38.107972] [DEBUG] [LOCAL ] DB: Trimmed 74738 records to 52522 (keeping 200 days of data) [2025-10-07T18:21:38.292797] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-07T18:21:38.446392] [DEBUG] [LOCAL ] DB: Primary data saved (52522 records). [2025-10-07T18:21:38.446548] [INFO ] [MAIN ] DB: Full history saved. [2025-10-07T18:21:38.446634] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 34.3s. Estimated remaining: 4h 5m 7s. Rate: 7.3 symbols/min [2025-10-07T18:21:38.618799] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:21:38.665427] [DEBUG] [LOCAL ] DBRG: Loaded 49774 existing records from primary storage. [2025-10-07T18:21:38.665800] [INFO ] [MAIN ] DBRG: Loaded 49774 existing records. [2025-10-07T18:21:38.848558] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:21:38.849083] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-07T18:21:38.849223] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-07T18:21:38.882555] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-07T18:21:38.885702] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-07T18:21:38.885866] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-07T18:21:38.944250] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-07T18:21:39.052688] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-07T18:21:39.260963] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:21:39.348667] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T18:21:39.847769] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-07T18:21:40.647767] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-07T18:21:40.979797] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-07T18:21:40.983107] [INFO ] [REMOTE ] DAVA: Full fetch complete (56306 records). [2025-10-07T18:21:40.983204] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-07T18:21:41.406204] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-07T18:21:41.406334] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-07T18:21:41.407248] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-07T18:21:41.407311] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-07T18:21:41.408451] [DEBUG] [LOCAL ] DAVA: Trimmed 56306 records to 41291 (keeping 200 days of data) [2025-10-07T18:21:41.460857] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-07T18:21:41.679733] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T18:21:41.704968] [DEBUG] [LOCAL ] DAVA: Primary data saved (41291 records). [2025-10-07T18:21:41.705084] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-07T18:21:41.705160] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DAVA took 42.2s. Estimated remaining: 4h 4m 44s. Rate: 7.3 symbols/min [2025-10-07T18:21:41.888735] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:21:41.888925] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-07T18:21:41.888964] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-07T18:21:41.889098] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-07T18:21:41.889141] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-07T18:21:41.889183] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-07T18:21:41.889217] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-07T18:21:42.244735] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:21:42.247598] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-07T18:21:42.415421] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T18:21:42.453331] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T18:21:43.047715] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-07T18:21:43.847727] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-07T18:21:44.097326] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T18:21:44.540951] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T18:21:44.647603] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-07T18:21:45.286618] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T18:21:45.447690] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-07T18:21:46.247766] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-07T18:21:46.330806] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T18:21:46.479610] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T18:21:47.047613] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-07T18:21:47.647714] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T18:21:47.847624] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-07T18:21:47.995878] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T18:21:48.647770] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-07T18:21:49.459978] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-07T18:21:49.487449] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T18:21:49.772612] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T18:21:50.247673] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-07T18:21:51.047667] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-07T18:21:51.505894] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T18:21:51.598012] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T18:21:51.820371] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-07T18:21:51.847703] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-07T18:21:52.647691] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-07T18:21:53.343262] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T18:21:53.447707] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-07T18:21:53.782374] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T18:21:54.125824] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T18:21:54.247786] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-07T18:21:55.047696] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-07T18:21:55.847769] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-07T18:21:55.934140] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T18:21:56.647958] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-07T18:21:56.841475] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T18:21:57.035351] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T18:21:57.447692] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-07T18:21:58.092300] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T18:21:58.244290] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T18:21:58.251461] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-07T18:21:59.046954] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T18:21:59.049899] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-07T18:21:59.847682] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-07T18:22:00.647725] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-07T18:22:01.447789] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-07T18:22:01.662686] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-07T18:22:01.963571] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-07T18:22:02.247801] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-07T18:22:02.459188] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-07T18:22:02.460147] [INFO ] [REMOTE ] DBL: Full fetch complete (12536 records). [2025-10-07T18:22:02.460217] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-07T18:22:02.820116] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-07T18:22:02.820193] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-07T18:22:02.820430] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-07T18:22:02.820468] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-07T18:22:02.820940] [DEBUG] [LOCAL ] DBL: Trimmed 12536 records to 9263 (keeping 200 days of data) [2025-10-07T18:22:02.882499] [DEBUG] [LOCAL ] DBL: Primary data saved (9263 records). [2025-10-07T18:22:02.882610] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-07T18:22:02.882713] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 27.0s. Estimated remaining: 4h 5m 14s. Rate: 7.2 symbols/min [2025-10-07T18:22:03.046532] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:22:03.047622] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-07T18:22:03.063360] [DEBUG] [LOCAL ] DCO: Loaded 13883 existing records from primary storage. [2025-10-07T18:22:03.063584] [INFO ] [MAIN ] DCO: Loaded 13883 existing records. [2025-10-07T18:22:03.242867] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:22:03.243043] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-07T18:22:03.243090] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-07T18:22:03.243596] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-07T18:22:03.243688] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-07T18:22:03.602350] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:22:03.675798] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T18:22:03.847702] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-07T18:22:04.647811] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-07T18:22:04.720204] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-10-07T18:22:05.141305] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-07T18:22:05.452190] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-07T18:22:05.463840] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T18:22:05.558431] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-07T18:22:06.247765] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-07T18:22:07.047763] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-07T18:22:07.223723] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T18:22:07.715491] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T18:22:07.847665] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-07T18:22:08.647622] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-07T18:22:08.732721] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T18:22:09.447793] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-07T18:22:09.984633] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T18:22:10.233299] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-07T18:22:10.247612] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-07T18:22:11.047785] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-07T18:22:11.333817] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T18:22:11.706083] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T18:22:11.782016] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T18:22:11.847939] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-07T18:22:12.441710] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T18:22:12.647722] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-07T18:22:13.426210] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T18:22:13.447672] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-07T18:22:14.247689] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-07T18:22:14.259455] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T18:22:15.047885] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-07T18:22:15.488978] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T18:22:15.847711] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-07T18:22:16.647756] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-07T18:22:17.281139] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T18:22:17.283334] [INFO ] [REMOTE ] DCI: Full fetch complete (53437 records). [2025-10-07T18:22:17.283467] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-07T18:22:17.284329] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:22:17.284434] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:22:17.284479] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:22:17.284553] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-07T18:22:17.284621] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-07T18:22:17.284699] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-10-07T18:22:17.284759] [DEBUG] [LOCAL ] DCI: No derivative data file found to delete. [2025-10-07T18:22:17.284829] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DCI took 35.6s. Estimated remaining: 4h 5m 24s. Rate: 7.2 symbols/min [2025-10-07T18:22:17.461635] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-07T18:22:17.465771] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:22:17.519206] [DEBUG] [LOCAL ] DD: Loaded 52847 existing records from primary storage. [2025-10-07T18:22:17.519611] [INFO ] [MAIN ] DD: Loaded 52847 existing records. [2025-10-07T18:22:17.715100] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:22:17.715501] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-07T18:22:17.715580] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-07T18:22:17.715886] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-07T18:22:17.715947] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-07T18:22:18.029504] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (2.98 seconds). [2025-10-07T18:22:18.072320] [INFO ] [REMOTE ] DBRG: Full fetch complete (71999 records). [2025-10-07T18:22:18.088204] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-07T18:22:18.094917] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:22:18.096966] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:22:18.097120] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:22:18.097165] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:22:18.097207] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-07T18:22:18.097289] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-07T18:22:18.097356] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-10-07T18:22:18.097628] [DEBUG] [LOCAL ] DBRG: Deleted derivative data file. [2025-10-07T18:22:18.097837] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 39.7s. Estimated remaining: 4h 4m 54s. Rate: 7.2 symbols/min [2025-10-07T18:22:18.258097] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-07T18:22:18.278411] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:22:18.334511] [DEBUG] [LOCAL ] DDD: Loaded 50902 existing records from primary storage. [2025-10-07T18:22:18.334933] [INFO ] [MAIN ] DDD: Loaded 50902 existing records. [2025-10-07T18:22:18.516590] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:22:18.516852] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-07T18:22:18.516922] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-07T18:22:18.517256] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-07T18:22:18.517326] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-07T18:22:18.901182] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-07T18:22:18.932259] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:22:19.047982] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-07T18:22:19.852852] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-07T18:22:19.875944] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T18:22:20.107499] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-07T18:22:20.647758] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-07T18:22:21.005859] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T18:22:21.068345] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T18:22:21.447678] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-07T18:22:22.247707] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-07T18:22:22.863092] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-07T18:22:23.047768] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-07T18:22:23.174893] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T18:22:23.178343] [INFO ] [REMOTE ] DBI: Full fetch complete (65604 records). [2025-10-07T18:22:23.178560] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-07T18:22:23.370288] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T18:22:23.594939] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-07T18:22:23.595041] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-07T18:22:23.595914] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-07T18:22:23.595994] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-07T18:22:23.597680] [DEBUG] [LOCAL ] DBI: Trimmed 65604 records to 44391 (keeping 200 days of data) [2025-10-07T18:22:23.855220] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-07T18:22:23.872866] [DEBUG] [LOCAL ] DBI: Primary data saved (44391 records). [2025-10-07T18:22:23.873013] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-07T18:22:23.873114] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DBI took 50.5s. Estimated remaining: 4h 4m 38s. Rate: 7.3 symbols/min [2025-10-07T18:22:24.647714] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-07T18:22:24.794967] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T18:22:24.850975] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T18:22:25.447685] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-07T18:22:26.183248] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T18:22:26.247689] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-07T18:22:27.047716] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-07T18:22:27.839920] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-07T18:22:27.851567] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-07T18:22:28.099868] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T18:22:28.266619] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T18:22:28.268311] [INFO ] [REMOTE ] DCO: Full fetch complete (19053 records). [2025-10-07T18:22:28.268411] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-07T18:22:28.638793] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-07T18:22:28.638885] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-07T18:22:28.639316] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-07T18:22:28.639356] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-07T18:22:28.640216] [DEBUG] [LOCAL ] DCO: Trimmed 19053 records to 13934 (keeping 200 days of data) [2025-10-07T18:22:28.677415] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-07T18:22:28.731064] [DEBUG] [LOCAL ] DCO: Primary data saved (13934 records). [2025-10-07T18:22:28.731222] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-07T18:22:28.731307] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 25.8s. Estimated remaining: 4h 4m 20s. Rate: 7.3 symbols/min [2025-10-07T18:22:29.583853] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T18:22:29.595274] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-07T18:22:30.164176] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T18:22:30.247755] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-07T18:22:31.250029] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T18:22:31.260773] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-07T18:22:32.295603] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-07T18:22:32.307156] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-07T18:22:33.229469] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T18:22:33.241009] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-07T18:22:34.079372] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T18:22:34.090435] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-07T18:22:35.082256] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T18:22:35.093530] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-07T18:22:36.066900] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T18:22:36.078836] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-07T18:22:36.743903] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T18:22:36.755906] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-07T18:22:38.218525] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-07T18:22:38.229685] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-07T18:22:38.516927] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T18:22:38.528437] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-07T18:22:40.456692] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T18:22:40.468706] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-07T18:22:40.480978] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-07T18:22:40.480693] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-07T18:22:42.164719] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T18:22:42.168734] [INFO ] [REMOTE ] DD: Full fetch complete (76365 records). [2025-10-07T18:22:42.168892] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-07T18:22:42.583396] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-07T18:22:42.583616] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-07T18:22:42.584613] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-07T18:22:42.584783] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-07T18:22:42.586532] [DEBUG] [LOCAL ] DD: Trimmed 76365 records to 52861 (keeping 200 days of data) [2025-10-07T18:22:42.698229] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-07T18:22:42.704431] [INFO ] [REMOTE ] DDD: Full fetch complete (73713 records). [2025-10-07T18:22:42.705470] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-07T18:22:43.161902] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-07T18:22:43.162525] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-07T18:22:43.165019] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-07T18:22:43.165633] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-07T18:22:43.174606] [DEBUG] [LOCAL ] DDD: Trimmed 73713 records to 50919 (keeping 200 days of data) [2025-10-07T18:22:43.668698] [DEBUG] [LOCAL ] DDD: Primary data saved (50919 records). [2025-10-07T18:22:43.670215] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-07T18:22:43.670672] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DDD took 25.6s. Estimated remaining: 4h 4m 31s. Rate: 7.2 symbols/min [2025-10-07T18:22:43.681372] [DEBUG] [LOCAL ] DD: Primary data saved (52861 records). [2025-10-07T18:22:43.681491] [INFO ] [MAIN ] DD: Full history saved. [2025-10-07T18:22:43.681580] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DD took 26.4s. Estimated remaining: 4h 3m 58s. Rate: 7.3 symbols/min [2025-10-07T18:22:44.353339] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:22:44.426422] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:22:44.431036] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:22:44.449325] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:22:44.455491] [DEBUG] [LOCAL ] DDT: Loaded 2087 existing records from primary storage. [2025-10-07T18:22:44.455927] [INFO ] [MAIN ] DDT: Loaded 2087 existing records. [2025-10-07T18:22:44.619825] [DEBUG] [LOCAL ] DDS: Loaded 12900 existing records from primary storage. [2025-10-07T18:22:44.640385] [INFO ] [MAIN ] DDS: Loaded 12900 existing records. [2025-10-07T18:22:44.676152] [DEBUG] [LOCAL ] DDL: Loaded 36671 existing records from primary storage. [2025-10-07T18:22:44.709906] [INFO ] [MAIN ] DDL: Loaded 36671 existing records. [2025-10-07T18:22:44.738743] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:22:44.739624] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-07T18:22:44.739727] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-07T18:22:44.739985] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-07T18:22:44.740273] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-07T18:22:44.978632] [DEBUG] [LOCAL ] DE: Loaded 47559 existing records from primary storage. [2025-10-07T18:22:45.091684] [INFO ] [MAIN ] DE: Loaded 47559 existing records. [2025-10-07T18:22:45.185552] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:22:45.249366] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-07T18:22:45.302582] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-07T18:22:45.385670] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-07T18:22:45.385816] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-07T18:22:45.605392] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:22:45.621265] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-07T18:22:45.621958] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-07T18:22:45.692400] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-07T18:22:45.765382] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-07T18:22:45.861684] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:22:45.894430] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:22:45.901630] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-07T18:22:45.928989] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-07T18:22:45.946837] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-07T18:22:45.983942] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-07T18:22:46.011447] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-07T18:22:46.727951] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:22:46.737751] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T18:22:46.762004] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-07T18:22:46.769373] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-07T18:22:46.801831] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:22:46.814389] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-07T18:22:46.929963] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:22:46.930302] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-07T18:22:47.284282] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-07T18:22:47.285423] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-07T18:22:47.805841] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-07T18:22:47.807365] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-07T18:22:48.055889] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T18:22:48.059750] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-07T18:22:48.294949] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-07T18:22:48.296154] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-07T18:22:48.433576] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T18:22:48.442490] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-07T18:22:48.903357] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T18:22:48.913599] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-07T18:22:48.919292] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T18:22:48.921277] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-07T18:22:48.931616] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T18:22:49.370780] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-07T18:22:49.452806] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-07T18:22:49.464745] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T18:22:49.918310] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-07T18:22:50.247771] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-07T18:22:50.604966] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-07T18:22:50.697607] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T18:22:51.047781] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-07T18:22:51.847671] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-07T18:22:52.647779] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-07T18:22:53.447826] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-07T18:23:05.854989] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (13.21 seconds). [2025-10-07T18:23:05.865546] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-07T18:23:05.889408] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (14.04 seconds). [2025-10-07T18:23:05.898120] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-07T18:23:06.682673] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (15.63 seconds). [2025-10-07T18:23:06.684050] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-07T18:23:07.624963] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T18:23:07.637340] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-07T18:23:08.029971] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (14.58 seconds). [2025-10-07T18:23:08.033195] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-07T18:23:08.724240] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-07T18:23:08.728346] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-07T18:23:09.105585] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-07T18:23:09.107059] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-07T18:23:09.159501] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (3.26 seconds). [2025-10-07T18:23:09.170327] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-07T18:23:09.365914] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T18:23:09.378356] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-07T18:23:09.795254] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T18:23:09.800424] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-07T18:23:09.810113] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T18:23:09.810785] [INFO ] [REMOTE ] DDT: Full fetch complete (2851 records). [2025-10-07T18:23:09.810855] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-07T18:23:09.811482] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:23:09.811637] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:23:09.811727] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:23:09.811800] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-07T18:23:09.811864] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-07T18:23:09.811899] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-07T18:23:09.812276] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-10-07T18:23:09.812458] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 26.1s. Estimated remaining: 4h 4m 43s. Rate: 7.2 symbols/min [2025-10-07T18:23:09.980839] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:23:09.981056] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-07T18:23:09.981111] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-07T18:23:09.981222] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-07T18:23:09.981263] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-07T18:23:09.981303] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-07T18:23:09.981334] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-07T18:23:10.337771] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:23:10.338121] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-07T18:23:10.622205] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T18:23:10.632605] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-07T18:23:10.752029] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T18:23:10.756188] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-07T18:23:11.252851] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T18:23:11.263086] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-07T18:23:11.692367] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T18:23:11.696128] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-07T18:23:12.012439] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T18:23:12.022032] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-07T18:23:12.310162] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T18:23:12.320305] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-07T18:23:12.353624] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T18:23:12.357335] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-07T18:23:13.099819] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T18:23:13.110118] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-07T18:23:13.304330] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T18:23:13.313968] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-07T18:23:13.325528] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T18:23:13.329922] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-07T18:23:13.879386] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T18:23:13.888497] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-07T18:23:14.161333] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T18:23:14.165096] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-07T18:23:14.198344] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T18:23:14.205051] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-07T18:23:14.569752] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T18:23:14.582074] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-07T18:23:14.951280] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T18:23:14.952437] [INFO ] [REMOTE ] DDS: Full fetch complete (18904 records). [2025-10-07T18:23:14.952513] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-07T18:23:15.335527] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-07T18:23:15.335893] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-07T18:23:15.336529] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-07T18:23:15.336712] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-07T18:23:15.338198] [DEBUG] [LOCAL ] DDS: Trimmed 18904 records to 12873 (keeping 200 days of data) [2025-10-07T18:23:15.444581] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T18:23:15.461401] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-07T18:23:15.468755] [DEBUG] [LOCAL ] DDS: Primary data saved (12873 records). [2025-10-07T18:23:15.468851] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-07T18:23:15.468934] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 31.8s. Estimated remaining: 4h 4m 27s. Rate: 7.2 symbols/min [2025-10-07T18:23:15.567854] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T18:23:15.606455] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-07T18:23:15.673818] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:23:15.674054] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-07T18:23:15.674101] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-07T18:23:15.674213] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-07T18:23:15.674257] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-07T18:23:15.674344] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-07T18:23:15.674384] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-07T18:23:16.042069] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:23:16.042406] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-07T18:23:16.681783] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-07T18:23:16.693092] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-07T18:23:17.126048] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T18:23:17.187504] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T18:23:17.458687] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-07T18:23:17.461317] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T18:23:18.247781] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-07T18:23:18.567393] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T18:23:19.047634] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-07T18:23:19.236794] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:23:19.377322] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T18:23:19.847747] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-07T18:23:20.647683] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-07T18:23:20.810251] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-07T18:23:20.816528] [INFO ] [REMOTE ] DE: Full fetch complete (69537 records). [2025-10-07T18:23:20.816870] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-07T18:23:21.236952] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-07T18:23:21.237240] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-07T18:23:21.238199] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-07T18:23:21.238293] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-07T18:23:21.248380] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T18:23:21.251861] [DEBUG] [LOCAL ] DE: Trimmed 69537 records to 47575 (keeping 200 days of data) [2025-10-07T18:23:21.252562] [INFO ] [REMOTE ] DDL: Full fetch complete (53192 records). [2025-10-07T18:23:21.253087] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-07T18:23:21.448721] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-07T18:23:21.775836] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-07T18:23:21.776539] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-07T18:23:21.778138] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-07T18:23:21.778758] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-07T18:23:21.789078] [DEBUG] [LOCAL ] DDL: Trimmed 53192 records to 36762 (keeping 200 days of data) [2025-10-07T18:23:22.032929] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T18:23:22.248060] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-07T18:23:22.256123] [DEBUG] [LOCAL ] DDL: Primary data saved (36762 records). [2025-10-07T18:23:22.257841] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-07T18:23:22.260602] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 38.6s. Estimated remaining: 4h 4m 14s. Rate: 7.2 symbols/min [2025-10-07T18:23:22.260486] [DEBUG] [LOCAL ] DE: Primary data saved (47575 records). [2025-10-07T18:23:22.266274] [INFO ] [MAIN ] DE: Full history saved. [2025-10-07T18:23:22.316935] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 38.6s. Estimated remaining: 4h 3m 42s. Rate: 7.3 symbols/min [2025-10-07T18:23:22.572873] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:23:22.647063] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:23:22.695685] [DEBUG] [LOCAL ] DECK: Loaded 53291 existing records from primary storage. [2025-10-07T18:23:22.696095] [INFO ] [MAIN ] DECK: Loaded 53291 existing records. [2025-10-07T18:23:22.891538] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:23:22.917431] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-07T18:23:22.928065] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-07T18:23:22.929706] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T18:23:22.928004] [DEBUG] [LOCAL ] DEI: Loaded 48286 existing records from primary storage. [2025-10-07T18:23:22.935827] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-07T18:23:22.936000] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-07T18:23:22.969792] [INFO ] [MAIN ] DEI: Loaded 48286 existing records. [2025-10-07T18:23:23.068737] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-07T18:23:23.406734] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:23:23.409305] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-07T18:23:23.414701] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-07T18:23:23.436089] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-07T18:23:23.458775] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-07T18:23:23.489697] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:23:23.863186] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:23:23.859757] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-07T18:23:23.886149] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T18:23:24.627180] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T18:23:24.647619] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-07T18:23:25.447611] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-07T18:23:25.931194] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-07T18:23:26.172581] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T18:23:26.247741] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-07T18:23:26.872730] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T18:23:27.047684] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-07T18:23:27.847700] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-07T18:23:28.064051] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T18:23:28.453030] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T18:23:28.647689] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-07T18:23:29.447618] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-07T18:23:29.493157] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T18:23:30.247761] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-07T18:23:30.770076] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-07T18:23:30.845887] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T18:23:31.047679] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-07T18:23:31.847754] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-07T18:23:32.143278] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T18:23:32.647756] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-07T18:23:32.849100] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T18:23:33.160613] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T18:23:33.447627] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-07T18:23:34.247720] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-07T18:23:34.444180] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T18:23:34.446988] [INFO ] [REMOTE ] DEA: Full fetch complete (62282 records). [2025-10-07T18:23:34.447087] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-07T18:23:34.830694] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-07T18:23:34.830802] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-07T18:23:34.831574] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-07T18:23:34.831638] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-07T18:23:34.832889] [DEBUG] [LOCAL ] DEA: Trimmed 62282 records to 40570 (keeping 200 days of data) [2025-10-07T18:23:35.049989] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-07T18:23:35.090452] [DEBUG] [LOCAL ] DEA: Primary data saved (40570 records). [2025-10-07T18:23:35.090580] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-07T18:23:35.090683] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 25.3s. Estimated remaining: 4h 3m 47s. Rate: 7.2 symbols/min [2025-10-07T18:23:35.273618] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:23:35.273874] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-10-07T18:23:35.274093] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-10-07T18:23:35.274220] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-07T18:23:35.274264] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-07T18:23:35.274307] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-07T18:23:35.274339] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-07T18:23:35.639544] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:23:35.671836] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-07T18:23:35.796349] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T18:23:35.847619] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-07T18:23:36.451472] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T18:23:36.647683] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-07T18:23:37.411075] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T18:23:37.447611] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-07T18:23:38.247694] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-07T18:23:38.869809] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-07T18:23:39.047763] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-07T18:23:39.104876] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T18:23:39.192711] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T18:23:39.847797] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-07T18:23:40.647701] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-07T18:23:41.458815] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-07T18:23:41.465352] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-07T18:23:41.704950] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T18:23:42.247748] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-07T18:23:42.462510] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T18:23:43.047612] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-07T18:23:43.418808] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-07T18:23:43.847788] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-07T18:23:44.515358] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T18:23:44.518909] [INFO ] [REMOTE ] DEC: Full fetch complete (43765 records). [2025-10-07T18:23:44.519026] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-07T18:23:44.651021] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-07T18:23:45.012360] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-07T18:23:45.022949] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-07T18:23:45.023369] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-07T18:23:45.024475] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-07T18:23:45.024567] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-07T18:23:45.025761] [DEBUG] [LOCAL ] DEC: Trimmed 43765 records to 30438 (keeping 200 days of data) [2025-10-07T18:23:45.251105] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T18:23:45.273429] [DEBUG] [LOCAL ] DEC: Primary data saved (30438 records). [2025-10-07T18:23:45.273559] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-07T18:23:45.273628] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 29.8s. Estimated remaining: 4h 3m 44s. Rate: 7.2 symbols/min [2025-10-07T18:23:45.436751] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:23:45.436920] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-07T18:23:45.436957] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-07T18:23:45.437070] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-07T18:23:45.437121] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-07T18:23:45.437202] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-07T18:23:45.437263] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-07T18:23:45.458186] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-07T18:23:45.813092] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:23:46.247766] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-07T18:23:46.604897] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T18:23:47.047791] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-07T18:23:47.689295] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-07T18:23:47.847604] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-07T18:23:47.937267] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T18:23:48.647765] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-07T18:23:49.279136] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-07T18:23:49.447605] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-07T18:23:50.081315] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-07T18:23:50.154277] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T18:23:50.247626] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-07T18:23:51.052884] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-07T18:23:51.075937] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T18:23:51.856386] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-07T18:23:51.873739] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T18:23:52.537362] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T18:23:52.647620] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-07T18:23:53.377464] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T18:23:53.381185] [INFO ] [REMOTE ] DECK: Full fetch complete (76749 records). [2025-10-07T18:23:53.381348] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-07T18:23:53.454799] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-07T18:23:53.838200] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-07T18:23:53.838419] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-07T18:23:53.839374] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-07T18:23:53.839498] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-07T18:23:53.841379] [DEBUG] [LOCAL ] DECK: Trimmed 76749 records to 53299 (keeping 200 days of data) [2025-10-07T18:23:53.956728] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T18:23:54.211025] [DEBUG] [LOCAL ] DECK: Primary data saved (53299 records). [2025-10-07T18:23:54.211186] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-07T18:23:54.211314] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 32.0s. Estimated remaining: 4h 3m 37s. Rate: 7.2 symbols/min [2025-10-07T18:23:54.253559] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-07T18:23:54.381592] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:23:54.412115] [DEBUG] [LOCAL ] DFH: Loaded 32142 existing records from primary storage. [2025-10-07T18:23:54.412424] [INFO ] [MAIN ] DFH: Loaded 32142 existing records. [2025-10-07T18:23:54.585490] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:23:54.585739] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-07T18:23:54.585794] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-07T18:23:54.586064] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-07T18:23:54.586121] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-07T18:23:54.949681] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:23:55.047740] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-07T18:23:55.090693] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T18:23:55.847793] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-07T18:23:56.375564] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-07T18:23:56.647770] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-07T18:23:56.777594] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T18:23:57.447788] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-07T18:23:58.247820] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-07T18:23:58.554747] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-07T18:23:58.799008] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-07T18:23:59.047685] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-07T18:23:59.153699] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T18:23:59.268749] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T18:23:59.847686] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-07T18:24:00.647627] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-07T18:24:00.843368] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T18:24:01.430067] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T18:24:01.433285] [INFO ] [REMOTE ] DEI: Full fetch complete (69385 records). [2025-10-07T18:24:01.433416] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-07T18:24:01.434309] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:24:01.434400] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:24:01.434465] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:24:01.434535] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-07T18:24:01.434604] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-07T18:24:01.434639] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-10-07T18:24:01.434914] [DEBUG] [LOCAL ] DEI: Deleted derivative data file. [2025-10-07T18:24:01.436140] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DEI took 39.1s. Estimated remaining: 4h 3m 26s. Rate: 7.2 symbols/min [2025-10-07T18:24:01.452767] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-07T18:24:01.648411] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:24:01.674483] [DEBUG] [LOCAL ] DFIN: Loaded 22914 existing records from primary storage. [2025-10-07T18:24:01.674791] [INFO ] [MAIN ] DFIN: Loaded 22914 existing records. [2025-10-07T18:24:01.875482] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:24:01.875837] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-07T18:24:01.875917] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-07T18:24:01.876246] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-07T18:24:01.876315] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-07T18:24:02.221392] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:24:02.243031] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T18:24:02.249952] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-07T18:24:03.047697] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-07T18:24:03.741663] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-07T18:24:03.847628] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-07T18:24:04.033043] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T18:24:04.504572] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T18:24:04.647746] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-07T18:24:04.985971] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T18:24:05.447776] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-07T18:24:05.770389] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T18:24:06.247625] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-07T18:24:06.429011] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T18:24:07.047694] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-07T18:24:07.847757] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-07T18:24:08.215207] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T18:24:08.643857] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T18:24:08.650726] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-07T18:24:09.447786] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-07T18:24:10.087633] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-07T18:24:10.247615] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-07T18:24:10.328320] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T18:24:11.047740] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-07T18:24:11.558987] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-07T18:24:11.847736] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-07T18:24:12.137367] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T18:24:12.647739] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-07T18:24:12.695129] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T18:24:13.447684] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-07T18:24:13.926438] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T18:24:14.251433] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-07T18:24:14.254604] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-07T18:24:15.047674] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-07T18:24:15.298818] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:24:15.611389] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T18:24:15.847691] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-07T18:24:16.055802] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-07T18:24:16.647735] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-07T18:24:17.447781] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-07T18:24:18.037467] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T18:24:18.154361] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-07T18:24:18.157307] [INFO ] [REMOTE ] DEO: Full fetch complete (71134 records). [2025-10-07T18:24:18.157422] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-07T18:24:18.158273] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:24:18.158391] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:24:18.158434] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:24:18.158473] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-07T18:24:18.158532] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-07T18:24:18.158567] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-07T18:24:18.158606] [DEBUG] [LOCAL ] DEO: No derivative data file found to delete. [2025-10-07T18:24:18.158687] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DEO took 32.9s. Estimated remaining: 4h 3m 42s. Rate: 7.2 symbols/min [2025-10-07T18:24:18.249582] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-07T18:24:18.334558] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:24:18.347902] [DEBUG] [LOCAL ] DFP: Loaded 11297 existing records from primary storage. [2025-10-07T18:24:18.348138] [INFO ] [MAIN ] DFP: Loaded 11297 existing records. [2025-10-07T18:24:18.539285] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:24:18.539638] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-07T18:24:18.553791] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-07T18:24:18.555232] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T18:24:18.555287] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-07T18:24:18.555459] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-07T18:24:18.957803] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:24:19.047679] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-07T18:24:19.762366] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T18:24:19.847627] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-07T18:24:20.086874] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T18:24:20.647675] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-07T18:24:21.277545] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T18:24:21.280852] [INFO ] [REMOTE ] DFH: Full fetch complete (48351 records). [2025-10-07T18:24:21.280990] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-07T18:24:21.461125] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-07T18:24:21.699017] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-07T18:24:21.699103] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-07T18:24:21.699787] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-07T18:24:21.699851] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-07T18:24:21.700885] [DEBUG] [LOCAL ] DFH: Trimmed 48351 records to 32149 (keeping 200 days of data) [2025-10-07T18:24:21.800350] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T18:24:21.907927] [DEBUG] [LOCAL ] DFH: Primary data saved (32149 records). [2025-10-07T18:24:21.908064] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-07T18:24:21.908145] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DFH took 27.7s. Estimated remaining: 4h 3m 21s. Rate: 7.2 symbols/min [2025-10-07T18:24:22.081978] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:24:22.135356] [DEBUG] [LOCAL ] DG: Loaded 53279 existing records from primary storage. [2025-10-07T18:24:22.135749] [INFO ] [MAIN ] DG: Loaded 53279 existing records. [2025-10-07T18:24:22.251569] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-07T18:24:22.316361] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:24:22.317240] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-07T18:24:22.317314] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-07T18:24:22.330767] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-07T18:24:22.331168] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T18:24:22.331356] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-07T18:24:22.680179] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:24:23.043686] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T18:24:23.047584] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-07T18:24:23.815005] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T18:24:23.847606] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-07T18:24:24.643083] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T18:24:24.647594] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-07T18:24:25.447668] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-07T18:24:25.576476] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T18:24:26.247690] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-07T18:24:27.047635] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-07T18:24:27.243830] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T18:24:27.660348] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T18:24:27.847618] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-07T18:24:27.866450] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T18:24:28.559191] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T18:24:28.647625] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-07T18:24:29.076299] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-07T18:24:29.447716] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-07T18:24:30.228877] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-07T18:24:30.247588] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-07T18:24:31.047628] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-07T18:24:31.138822] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T18:24:31.847784] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-07T18:24:32.647734] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-07T18:24:33.347471] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-07T18:24:33.447729] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-07T18:24:33.775986] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T18:24:34.252802] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-07T18:24:34.270133] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-07T18:24:35.051564] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-07T18:24:35.097306] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T18:24:35.363937] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T18:24:35.365102] [INFO ] [REMOTE ] DFP: Full fetch complete (16016 records). [2025-10-07T18:24:35.365206] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-07T18:24:35.722400] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-07T18:24:35.722478] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-07T18:24:35.722850] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-07T18:24:35.722912] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-07T18:24:35.723418] [DEBUG] [LOCAL ] DFP: Trimmed 16016 records to 11307 (keeping 200 days of data) [2025-10-07T18:24:35.795068] [DEBUG] [LOCAL ] DFP: Primary data saved (11307 records). [2025-10-07T18:24:35.795209] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-07T18:24:35.795291] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFP took 17.6s. Estimated remaining: 4h 3m 29s. Rate: 7.2 symbols/min [2025-10-07T18:24:35.857234] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-07T18:24:35.968382] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:24:36.021161] [DEBUG] [LOCAL ] DGX: Loaded 44815 existing records from primary storage. [2025-10-07T18:24:36.021477] [INFO ] [MAIN ] DGX: Loaded 44815 existing records. [2025-10-07T18:24:36.205346] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:24:36.205737] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-07T18:24:36.205828] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-07T18:24:36.210425] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-07T18:24:36.210599] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T18:24:36.210669] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-07T18:24:36.277735] [INFO ] [REMOTE ] DFIN: Full fetch complete (33584 records). [2025-10-07T18:24:36.304227] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-07T18:24:36.651328] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-07T18:24:36.895737] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:24:36.979443] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-07T18:24:36.979526] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-07T18:24:36.980102] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-07T18:24:36.980168] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-07T18:24:36.981184] [DEBUG] [LOCAL ] DFIN: Trimmed 33584 records to 22891 (keeping 200 days of data) [2025-10-07T18:24:37.121553] [DEBUG] [LOCAL ] DFIN: Primary data saved (22891 records). [2025-10-07T18:24:37.121717] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-07T18:24:37.121811] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFIN took 35.7s. Estimated remaining: 4h 3m 0s. Rate: 7.2 symbols/min [2025-10-07T18:24:37.286415] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:24:37.307594] [DEBUG] [LOCAL ] DHF: Loaded 21258 existing records from primary storage. [2025-10-07T18:24:37.307883] [INFO ] [MAIN ] DHF: Loaded 21258 existing records. [2025-10-07T18:24:37.452779] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-07T18:24:37.483136] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:24:37.483830] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-07T18:24:37.483886] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-07T18:24:37.484135] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-07T18:24:37.484192] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-07T18:24:37.828499] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:24:38.172188] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-07T18:24:38.178288] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-07T18:24:38.178596] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-07T18:24:38.261708] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-07T18:24:38.590103] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-07T18:24:38.590223] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-07T18:24:38.591258] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-07T18:24:38.591428] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-07T18:24:38.623915] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T18:24:38.622350] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53736 (keeping 200 days of data) [2025-10-07T18:24:38.988426] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-07T18:24:38.988592] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-07T18:24:38.988711] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DELL took 1m 4s. Estimated remaining: 4h 2m 34s. Rate: 7.2 symbols/min [2025-10-07T18:24:39.056271] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-07T18:24:39.161838] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:24:39.216756] [DEBUG] [LOCAL ] DHI: Loaded 53341 existing records from primary storage. [2025-10-07T18:24:39.217098] [INFO ] [MAIN ] DHI: Loaded 53341 existing records. [2025-10-07T18:24:39.400194] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:24:39.400819] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-07T18:24:39.406150] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-07T18:24:39.412220] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-07T18:24:39.412812] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-07T18:24:39.412723] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T18:24:39.534193] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-07T18:24:39.808168] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:24:39.847601] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-07T18:24:40.647715] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-07T18:24:41.215492] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-07T18:24:41.447627] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-07T18:24:41.658749] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T18:24:41.838226] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T18:24:42.247777] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-07T18:24:43.047780] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-07T18:24:43.578362] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-07T18:24:43.664562] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T18:24:43.847675] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-07T18:24:44.637979] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T18:24:44.647604] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-07T18:24:45.409769] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T18:24:45.447601] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-07T18:24:46.247624] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-07T18:24:46.578837] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T18:24:47.047622] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-07T18:24:47.294880] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T18:24:47.638567] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T18:24:47.847753] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-07T18:24:48.000707] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T18:24:48.647781] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-07T18:24:49.426368] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T18:24:49.447612] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-07T18:24:50.247684] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-07T18:24:50.656396] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T18:24:51.047623] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-07T18:24:51.135798] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T18:24:51.847758] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-07T18:24:52.048164] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T18:24:52.647637] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-07T18:24:53.018601] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T18:24:53.447785] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-07T18:24:53.590737] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T18:24:54.247783] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-07T18:24:54.869611] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-07T18:24:55.058775] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-07T18:24:55.064033] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T18:24:55.339852] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-07T18:24:55.847721] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-07T18:24:56.647638] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-07T18:24:56.744782] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T18:24:57.255023] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T18:24:57.447766] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-07T18:24:57.711777] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-07T18:24:58.247748] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-07T18:24:58.436051] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T18:24:59.047807] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-07T18:24:59.847757] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-07T18:25:00.380927] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-07T18:25:00.647623] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-07T18:25:00.926778] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-07T18:25:00.929924] [INFO ] [REMOTE ] DG: Full fetch complete (76820 records). [2025-10-07T18:25:00.930055] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-07T18:25:00.930917] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:25:00.931018] [FATAL] [MAIN ] DG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:25:00.931063] [WARN ] [MAIN ] DG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:25:00.931103] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-07T18:25:00.931162] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-07T18:25:00.931197] [INFO ] [LOCAL ] DG: Starting deletion of derivative data. [2025-10-07T18:25:00.931627] [DEBUG] [LOCAL ] DG: Deleted derivative data file. [2025-10-07T18:25:00.931747] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 39.0s. Estimated remaining: 4h 3m 4s. Rate: 7.2 symbols/min [2025-10-07T18:25:01.106596] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:25:01.166416] [DEBUG] [LOCAL ] DHR: Loaded 53376 existing records from primary storage. [2025-10-07T18:25:01.166799] [INFO ] [MAIN ] DHR: Loaded 53376 existing records. [2025-10-07T18:25:01.384688] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:25:01.384937] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-07T18:25:01.385018] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-07T18:25:01.385427] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-07T18:25:01.385497] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-07T18:25:01.455527] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-07T18:25:01.762702] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:25:01.929908] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-07T18:25:02.247686] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-07T18:25:03.047635] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-07T18:25:03.176907] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-07T18:25:03.203623] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T18:25:03.847752] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-07T18:25:04.312773] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-07T18:25:04.460688] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T18:25:04.647632] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-07T18:25:05.032707] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T18:25:05.447779] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-07T18:25:06.236042] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T18:25:06.247598] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-07T18:25:06.492345] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T18:25:07.047771] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-07T18:25:07.596613] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T18:25:07.598617] [INFO ] [REMOTE ] DHF: Full fetch complete (30038 records). [2025-10-07T18:25:07.598722] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-07T18:25:07.599314] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:25:07.599399] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:25:07.599441] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:25:07.599490] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-07T18:25:07.599573] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-07T18:25:07.599609] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-10-07T18:25:07.599795] [DEBUG] [LOCAL ] DHF: Deleted derivative data file. [2025-10-07T18:25:07.599883] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHF took 30.5s. Estimated remaining: 4h 2m 51s. Rate: 7.2 symbols/min [2025-10-07T18:25:07.766373] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:25:07.828702] [DEBUG] [LOCAL ] DHT: Loaded 47877 existing records from primary storage. [2025-10-07T18:25:07.829042] [INFO ] [MAIN ] DHT: Loaded 47877 existing records. [2025-10-07T18:25:07.852766] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-07T18:25:08.013537] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:25:08.013757] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-07T18:25:08.013808] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-07T18:25:08.014032] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-07T18:25:08.014087] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-07T18:25:08.361268] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:25:08.647726] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-07T18:25:09.101158] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-07T18:25:09.105504] [INFO ] [REMOTE ] DHI: Full fetch complete (77203 records). [2025-10-07T18:25:09.105698] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-07T18:25:09.457230] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-07T18:25:09.515829] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-07T18:25:09.516135] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-07T18:25:09.517099] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-07T18:25:09.517221] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-07T18:25:09.519110] [DEBUG] [LOCAL ] DHI: Trimmed 77203 records to 53341 (keeping 200 days of data) [2025-10-07T18:25:09.781518] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T18:25:09.901543] [DEBUG] [LOCAL ] DHI: Primary data saved (53341 records). [2025-10-07T18:25:09.901707] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-07T18:25:09.901801] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHI took 30.9s. Estimated remaining: 4h 2m 26s. Rate: 7.2 symbols/min [2025-10-07T18:25:10.066975] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:25:10.084851] [DEBUG] [LOCAL ] DHX: Loaded 12976 existing records from primary storage. [2025-10-07T18:25:10.085159] [INFO ] [MAIN ] DHX: Loaded 12976 existing records. [2025-10-07T18:25:10.259487] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:25:10.254731] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-07T18:25:10.260493] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-07T18:25:10.260553] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-07T18:25:10.260811] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-07T18:25:10.260870] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-07T18:25:10.614119] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:25:10.771258] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-07T18:25:11.047718] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-07T18:25:11.343102] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-07T18:25:11.847734] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-07T18:25:11.975271] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T18:25:12.236481] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T18:25:12.647705] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-07T18:25:13.447669] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-07T18:25:13.682559] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T18:25:14.247719] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-07T18:25:14.420390] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T18:25:14.918457] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T18:25:15.047683] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-07T18:25:15.246493] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T18:25:15.847708] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-07T18:25:16.647630] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-07T18:25:16.682127] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T18:25:16.685473] [INFO ] [REMOTE ] DGX: Full fetch complete (65175 records). [2025-10-07T18:25:16.685586] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-07T18:25:17.065026] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-07T18:25:17.065116] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-07T18:25:17.065878] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-07T18:25:17.065944] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-07T18:25:17.067470] [DEBUG] [LOCAL ] DGX: Trimmed 65175 records to 44803 (keeping 200 days of data) [2025-10-07T18:25:17.359534] [DEBUG] [LOCAL ] DGX: Primary data saved (44803 records). [2025-10-07T18:25:17.359694] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-07T18:25:17.360704] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DGX took 41.6s. Estimated remaining: 4h 2m 15s. Rate: 7.2 symbols/min [2025-10-07T18:25:17.456509] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-07T18:25:17.529838] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:25:17.553245] [DEBUG] [LOCAL ] DIAX: Loaded 13131 existing records from primary storage. [2025-10-07T18:25:17.553601] [INFO ] [MAIN ] DIAX: Loaded 13131 existing records. [2025-10-07T18:25:17.731267] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:25:17.731682] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-07T18:25:17.731824] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-07T18:25:17.732098] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-07T18:25:17.732271] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-07T18:25:17.859023] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-07T18:25:18.115190] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:25:18.247623] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-07T18:25:18.630338] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T18:25:19.047620] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-07T18:25:19.142059] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T18:25:19.144072] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-07T18:25:19.847635] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-07T18:25:19.969687] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T18:25:20.647607] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-07T18:25:21.447789] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-07T18:25:21.788687] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T18:25:22.247803] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-07T18:25:22.674433] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T18:25:22.766467] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T18:25:23.047680] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-07T18:25:23.690310] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T18:25:23.847605] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-07T18:25:24.000224] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T18:25:24.647724] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-07T18:25:25.443591] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T18:25:25.447594] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-07T18:25:25.916371] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-07T18:25:26.247636] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-07T18:25:26.358156] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T18:25:27.047732] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-07T18:25:27.847711] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-07T18:25:27.902480] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T18:25:28.046212] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T18:25:28.647628] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-07T18:25:29.447637] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-07T18:25:29.586808] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T18:25:29.677395] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T18:25:30.247714] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-07T18:25:30.523093] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T18:25:31.047792] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-07T18:25:31.607547] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T18:25:31.847731] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-07T18:25:32.499770] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-07T18:25:32.647618] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-07T18:25:33.426786] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T18:25:33.432572] [INFO ] [REMOTE ] DHR: Full fetch complete (77277 records). [2025-10-07T18:25:33.432922] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-07T18:25:33.456591] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-07T18:25:33.853413] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-07T18:25:33.853545] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-07T18:25:33.854493] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-07T18:25:33.854791] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-07T18:25:33.888877] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-07T18:25:33.899695] [DEBUG] [LOCAL ] DHR: Trimmed 77277 records to 53382 (keeping 200 days of data) [2025-10-07T18:25:34.007616] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T18:25:34.252862] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-07T18:25:34.265666] [DEBUG] [LOCAL ] DHR: Primary data saved (53382 records). [2025-10-07T18:25:34.265796] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-07T18:25:34.265890] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHR took 33.3s. Estimated remaining: 4h 2m 32s. Rate: 7.2 symbols/min [2025-10-07T18:25:34.454860] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:25:34.491603] [DEBUG] [LOCAL ] DIN: Loaded 37218 existing records from primary storage. [2025-10-07T18:25:34.491945] [INFO ] [MAIN ] DIN: Loaded 37218 existing records. [2025-10-07T18:25:34.666255] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:25:34.666425] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-07T18:25:34.666523] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-07T18:25:34.666770] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-07T18:25:34.666833] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-07T18:25:35.026516] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:25:35.047612] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-07T18:25:35.847638] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-07T18:25:35.937831] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T18:25:36.538302] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T18:25:36.647703] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-07T18:25:37.272538] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T18:25:37.273814] [INFO ] [REMOTE ] DHX: Full fetch complete (20650 records). [2025-10-07T18:25:37.273883] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-07T18:25:37.453039] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-07T18:25:37.644271] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-07T18:25:37.644351] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-07T18:25:37.644813] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-07T18:25:37.644885] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-07T18:25:37.645705] [DEBUG] [LOCAL ] DHX: Trimmed 20650 records to 12971 (keeping 200 days of data) [2025-10-07T18:25:37.719169] [DEBUG] [LOCAL ] DHX: Primary data saved (12971 records). [2025-10-07T18:25:37.719294] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-07T18:25:37.719383] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHX took 27.8s. Estimated remaining: 4h 2m 10s. Rate: 7.2 symbols/min [2025-10-07T18:25:37.889098] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:25:37.889280] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-07T18:25:37.889417] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-07T18:25:37.889630] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-07T18:25:37.889719] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-07T18:25:37.889776] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-07T18:25:37.889811] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-07T18:25:38.251027] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-07T18:25:38.250960] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T18:25:38.292973] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:25:38.477986] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T18:25:39.047716] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-07T18:25:39.847767] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-07T18:25:39.917898] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T18:25:40.410456] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T18:25:40.647721] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-07T18:25:41.447627] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-07T18:25:41.893083] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-07T18:25:42.247742] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-07T18:25:42.324575] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T18:25:42.514248] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T18:25:43.047760] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-07T18:25:43.847752] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-07T18:25:43.915547] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T18:25:44.647737] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-07T18:25:45.045180] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T18:25:45.080263] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T18:25:45.417289] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T18:25:45.447604] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-07T18:25:46.247740] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-07T18:25:46.342538] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T18:25:47.047729] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-07T18:25:47.847748] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-07T18:25:47.987758] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T18:25:48.650400] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-07T18:25:48.655804] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T18:25:49.380631] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T18:25:49.383965] [INFO ] [REMOTE ] DHT: Full fetch complete (69961 records). [2025-10-07T18:25:49.384064] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-07T18:25:49.457704] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-07T18:25:49.774814] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-07T18:25:49.774892] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-07T18:25:49.775690] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-07T18:25:49.775754] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-07T18:25:49.777247] [DEBUG] [LOCAL ] DHT: Trimmed 69961 records to 47896 (keeping 200 days of data) [2025-10-07T18:25:50.063535] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T18:25:50.098520] [DEBUG] [LOCAL ] DHT: Primary data saved (47896 records). [2025-10-07T18:25:50.098632] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-07T18:25:50.098743] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHT took 42.5s. Estimated remaining: 4h 2m 13s. Rate: 7.2 symbols/min [2025-10-07T18:25:50.261155] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-07T18:25:50.263726] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:25:50.315325] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-07T18:25:50.315689] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-07T18:25:50.488709] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:25:50.488910] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-07T18:25:50.488956] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-07T18:25:50.489240] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-07T18:25:50.489297] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-07T18:25:50.839180] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:25:51.047604] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-07T18:25:51.276346] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T18:25:51.656612] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T18:25:51.847734] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-07T18:25:52.647736] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-07T18:25:53.447632] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-07T18:25:53.558077] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-07T18:25:53.878867] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T18:25:54.030455] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T18:25:54.247612] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-07T18:25:54.531294] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T18:25:55.047759] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-07T18:25:55.852876] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-07T18:25:55.865561] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:25:56.484737] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T18:25:56.647608] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-07T18:25:57.447793] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-07T18:25:58.247670] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-07T18:25:58.404020] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T18:25:58.440363] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T18:25:58.533572] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-07T18:25:59.047672] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-07T18:25:59.847700] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-07T18:25:59.897157] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T18:26:00.222588] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T18:26:00.224235] [INFO ] [REMOTE ] DIAX: Full fetch complete (17869 records). [2025-10-07T18:26:00.224305] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-07T18:26:00.620209] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-07T18:26:00.620287] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-07T18:26:00.620668] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-07T18:26:00.620729] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-07T18:26:00.621279] [DEBUG] [LOCAL ] DIAX: Trimmed 17869 records to 13133 (keeping 200 days of data) [2025-10-07T18:26:00.657092] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-07T18:26:00.708494] [DEBUG] [LOCAL ] DIAX: Primary data saved (13133 records). [2025-10-07T18:26:00.708619] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-07T18:26:00.708733] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 43.3s. Estimated remaining: 4h 2m 11s. Rate: 7.2 symbols/min [2025-10-07T18:26:00.880801] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:26:00.880972] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-07T18:26:00.881013] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-07T18:26:00.881126] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-07T18:26:00.881172] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-07T18:26:00.881306] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-07T18:26:00.881357] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-07T18:26:01.241999] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:26:01.447624] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-07T18:26:02.147774] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T18:26:02.150619] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-07T18:26:02.247738] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-07T18:26:02.337903] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T18:26:02.340373] [INFO ] [REMOTE ] DIN: Full fetch complete (55024 records). [2025-10-07T18:26:02.340458] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-07T18:26:02.341218] [FATAL] [VALIDATOR ] DIN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:26:02.341300] [FATAL] [MAIN ] DIN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:26:02.341367] [WARN ] [MAIN ] DIN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:26:02.341442] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-07T18:26:02.341508] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-07T18:26:02.341544] [INFO ] [LOCAL ] DIN: Starting deletion of derivative data. [2025-10-07T18:26:02.341756] [DEBUG] [LOCAL ] DIN: Deleted derivative data file. [2025-10-07T18:26:02.341848] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 28.1s. Estimated remaining: 4h 1m 44s. Rate: 7.2 symbols/min [2025-10-07T18:26:02.532393] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:26:02.581111] [DEBUG] [LOCAL ] DK: Loaded 49324 existing records from primary storage. [2025-10-07T18:26:02.581469] [INFO ] [MAIN ] DK: Loaded 49324 existing records. [2025-10-07T18:26:02.766329] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-07T18:26:02.771768] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:26:02.772036] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-07T18:26:02.773249] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-07T18:26:02.774758] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-07T18:26:02.774822] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-07T18:26:03.052816] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-07T18:26:03.145809] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:26:03.847770] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-07T18:26:04.647736] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-07T18:26:05.384597] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-07T18:26:05.447734] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-07T18:26:05.942563] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-07T18:26:06.243245] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T18:26:06.253044] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-07T18:26:07.047705] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-07T18:26:07.814348] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T18:26:07.847620] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-07T18:26:08.037822] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-07T18:26:08.309188] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T18:26:08.650951] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-07T18:26:09.057860] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-07T18:26:09.447723] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-07T18:26:09.552949] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T18:26:09.897724] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-07T18:26:10.247725] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-07T18:26:11.047699] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-07T18:26:11.847702] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-07T18:26:11.934026] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T18:26:12.647635] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-07T18:26:12.800099] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T18:26:13.447751] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-07T18:26:14.247692] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-07T18:26:14.323579] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T18:26:14.487919] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-07T18:26:14.834317] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T18:26:15.047703] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-07T18:26:15.072147] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T18:26:15.075534] [INFO ] [REMOTE ] DINO: Full fetch complete (76651 records). [2025-10-07T18:26:15.075676] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-07T18:26:15.476702] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-07T18:26:15.476796] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-07T18:26:15.477964] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-07T18:26:15.478033] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-07T18:26:15.479516] [DEBUG] [LOCAL ] DINO: Trimmed 76651 records to 52913 (keeping 200 days of data) [2025-10-07T18:26:15.804599] [DEBUG] [LOCAL ] DINO: Primary data saved (52913 records). [2025-10-07T18:26:15.804767] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-07T18:26:15.804852] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DINO took 38.1s. Estimated remaining: 4h 1m 50s. Rate: 7.2 symbols/min [2025-10-07T18:26:15.858137] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-07T18:26:15.974638] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:26:15.993626] [DEBUG] [LOCAL ] DKL: Loaded 18266 existing records from primary storage. [2025-10-07T18:26:15.993921] [INFO ] [MAIN ] DKL: Loaded 18266 existing records. [2025-10-07T18:26:16.193488] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:26:16.193786] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-07T18:26:16.193879] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-07T18:26:16.194170] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-07T18:26:16.194255] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-07T18:26:16.646329] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:26:16.647621] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-07T18:26:17.007592] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-07T18:26:17.128990] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-07T18:26:17.447690] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-07T18:26:18.255856] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-07T18:26:18.261596] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-07T18:26:19.047621] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-07T18:26:19.149546] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T18:26:19.405066] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-07T18:26:19.836947] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T18:26:19.847593] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-07T18:26:20.647754] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-07T18:26:21.447735] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-07T18:26:21.592257] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T18:26:22.247758] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-07T18:26:22.589235] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T18:26:22.800313] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-07T18:26:23.047751] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-07T18:26:23.852737] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-07T18:26:23.871077] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:26:24.647633] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-07T18:26:24.686723] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T18:26:25.272314] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T18:26:25.447597] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-07T18:26:25.702742] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-07T18:26:26.247716] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-07T18:26:26.587832] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-07T18:26:27.047774] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-07T18:26:27.389892] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-07T18:26:27.570176] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T18:26:27.847712] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-07T18:26:28.647628] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-07T18:26:29.000704] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T18:26:29.447736] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-07T18:26:30.247782] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-07T18:26:30.927439] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-07T18:26:31.047752] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-07T18:26:31.122535] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T18:26:31.126185] [INFO ] [REMOTE ] DK: Full fetch complete (70872 records). [2025-10-07T18:26:31.126351] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-07T18:26:31.308629] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T18:26:31.338036] [INFO ] [REMOTE ] DIVY: Full fetch complete (1736 records). [2025-10-07T18:26:31.370874] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-07T18:26:31.745928] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T18:26:31.765915] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-07T18:26:31.765711] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:26:31.766077] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-07T18:26:31.767072] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-07T18:26:31.767231] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-07T18:26:31.767163] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:26:31.767565] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-07T18:26:31.767709] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-07T18:26:31.767772] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-07T18:26:31.767818] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-07T18:26:31.767901] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIVY took 31.1s. Estimated remaining: 4h 2m 3s. Rate: 7.2 symbols/min [2025-10-07T18:26:31.852305] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-07T18:26:31.870437] [DEBUG] [LOCAL ] DK: Trimmed 70872 records to 49328 (keeping 200 days of data) [2025-10-07T18:26:32.037951] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:26:32.039286] [DEBUG] [LOCAL ] DKS: No existing data file found in primary storage. [2025-10-07T18:26:32.039862] [WARN ] [MAIN ] DKS: No existing data found, performing full refresh instead. [2025-10-07T18:26:32.040927] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-07T18:26:32.041261] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-07T18:26:32.041339] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-10-07T18:26:32.041383] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-07T18:26:32.406913] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:26:32.610242] [DEBUG] [LOCAL ] DK: Primary data saved (49328 records). [2025-10-07T18:26:32.610749] [INFO ] [MAIN ] DK: Full history saved. [2025-10-07T18:26:32.610875] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DK took 30.3s. Estimated remaining: 4h 1m 34s. Rate: 7.2 symbols/min [2025-10-07T18:26:32.653979] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-07T18:26:32.779686] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:26:32.779869] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-10-07T18:26:32.779906] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-10-07T18:26:32.780048] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-07T18:26:32.780089] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-07T18:26:32.780130] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-07T18:26:32.780165] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-07T18:26:33.123722] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:26:33.382250] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-07T18:26:33.386335] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-07T18:26:33.386534] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-07T18:26:33.457333] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-07T18:26:33.729803] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T18:26:33.843295] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-07T18:26:33.843379] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-07T18:26:33.844255] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-07T18:26:33.844322] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-07T18:26:33.846368] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 53788 (keeping 200 days of data) [2025-10-07T18:26:34.186545] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-07T18:26:34.186715] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-07T18:26:34.186806] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DIS took 44.1s. Estimated remaining: 4h 1m 7s. Rate: 7.2 symbols/min [2025-10-07T18:26:34.260108] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-07T18:26:34.358146] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:26:34.366182] [DEBUG] [LOCAL ] DLNG: Loaded 6088 existing records from primary storage. [2025-10-07T18:26:34.366353] [INFO ] [MAIN ] DLNG: Loaded 6088 existing records. [2025-10-07T18:26:34.543824] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:26:34.544080] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-07T18:26:34.544156] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-07T18:26:34.544902] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-07T18:26:34.544965] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-07T18:26:34.917122] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-07T18:26:34.958519] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:26:35.047625] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-07T18:26:35.103368] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T18:26:35.500137] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T18:26:35.847747] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-07T18:26:36.440093] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T18:26:36.647629] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-07T18:26:36.921437] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T18:26:37.447758] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-07T18:26:38.234520] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T18:26:38.247604] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-07T18:26:38.491381] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T18:26:39.047729] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-07T18:26:39.847630] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-07T18:26:39.878796] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T18:26:39.905951] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T18:26:40.647706] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-07T18:26:41.149518] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T18:26:41.447724] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-07T18:26:42.247622] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-07T18:26:42.379998] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T18:26:42.786031] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T18:26:43.047692] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-07T18:26:43.234148] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T18:26:43.847740] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-07T18:26:44.277437] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-07T18:26:44.647745] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-07T18:26:45.259392] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-07T18:26:45.447709] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-07T18:26:45.767682] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T18:26:46.247723] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-07T18:26:46.681364] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T18:26:47.047731] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-07T18:26:47.742690] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T18:26:47.847683] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-07T18:26:48.272363] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-07T18:26:48.647720] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-07T18:26:49.423853] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T18:26:49.447700] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-07T18:26:49.515109] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T18:26:50.247702] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-07T18:26:51.047637] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-07T18:26:51.193410] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T18:26:51.635860] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T18:26:51.661490] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T18:26:51.847741] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-07T18:26:52.443575] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T18:26:52.647744] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-07T18:26:53.087092] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-07T18:26:53.447679] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-07T18:26:54.029566] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T18:26:54.247624] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-07T18:26:55.047733] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-07T18:26:55.072570] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T18:26:55.640277] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T18:26:55.847735] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-07T18:26:56.647703] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-07T18:26:57.206409] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T18:26:57.207705] [INFO ] [REMOTE ] DKL: Full fetch complete (28251 records). [2025-10-07T18:26:57.207863] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-07T18:26:57.453687] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-07T18:26:57.596780] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-07T18:26:57.596897] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-07T18:26:57.597369] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-07T18:26:57.597412] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-07T18:26:57.598411] [DEBUG] [LOCAL ] DKL: Trimmed 28251 records to 18057 (keeping 200 days of data) [2025-10-07T18:26:57.709280] [DEBUG] [LOCAL ] DKL: Primary data saved (18057 records). [2025-10-07T18:26:57.709424] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-07T18:26:57.709558] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKL took 41.9s. Estimated remaining: 4h 1m 41s. Rate: 7.2 symbols/min [2025-10-07T18:26:57.887794] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:26:57.958983] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T18:26:57.960193] [DEBUG] [LOCAL ] DLR: Loaded 50908 existing records from primary storage. [2025-10-07T18:26:57.960546] [INFO ] [MAIN ] DLR: Loaded 50908 existing records. [2025-10-07T18:26:58.150393] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:26:58.150671] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-07T18:26:58.150759] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-07T18:26:58.152508] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-07T18:26:58.152594] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-07T18:26:58.253027] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-07T18:26:58.260381] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T18:26:58.272364] [INFO ] [REMOTE ] DLNG: Full fetch complete (11877 records). [2025-10-07T18:26:58.293120] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-07T18:26:58.757874] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:26:58.910426] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-07T18:26:58.910508] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-07T18:26:58.910841] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-07T18:26:58.910910] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-07T18:26:58.911352] [DEBUG] [LOCAL ] DLNG: Trimmed 11877 records to 6093 (keeping 200 days of data) [2025-10-07T18:26:58.948424] [DEBUG] [LOCAL ] DLNG: Primary data saved (6093 records). [2025-10-07T18:26:58.948525] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-07T18:26:58.948618] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLNG took 24.8s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-07T18:26:59.049164] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-07T18:26:59.122908] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:26:59.159141] [DEBUG] [LOCAL ] DLX: Loaded 28542 existing records from primary storage. [2025-10-07T18:26:59.159407] [INFO ] [MAIN ] DLX: Loaded 28542 existing records. [2025-10-07T18:26:59.337170] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:26:59.337373] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-07T18:26:59.337421] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-07T18:26:59.337696] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-07T18:26:59.337789] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-07T18:26:59.696588] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:26:59.847623] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-07T18:26:59.893497] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T18:27:00.647706] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-07T18:27:01.275594] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-07T18:27:01.447604] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-07T18:27:01.527231] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T18:27:02.001297] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T18:27:02.247692] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-07T18:27:03.026499] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T18:27:03.047617] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-07T18:27:03.803173] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T18:27:03.847719] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-07T18:27:04.647634] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-07T18:27:04.867187] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T18:27:04.875790] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-07T18:27:04.881258] [INFO ] [REMOTE ] DKS: Full fetch complete (71611 records). [2025-10-07T18:27:04.881417] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-07T18:27:05.280961] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-07T18:27:05.281087] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-07T18:27:05.281963] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-07T18:27:05.282040] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-07T18:27:05.283955] [DEBUG] [LOCAL ] DKS: Trimmed 71611 records to 49700 (keeping 200 days of data) [2025-10-07T18:27:05.507639] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-07T18:27:05.706270] [DEBUG] [LOCAL ] DKS: Primary data saved (49700 records). [2025-10-07T18:27:05.706487] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-07T18:27:05.706608] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DKS took 33.9s. Estimated remaining: 4h 1m 1s. Rate: 7.2 symbols/min [2025-10-07T18:27:05.993420] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:27:06.024451] [DEBUG] [LOCAL ] DLY: Loaded 20190 existing records from primary storage. [2025-10-07T18:27:06.025021] [INFO ] [MAIN ] DLY: Loaded 20190 existing records. [2025-10-07T18:27:06.126525] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T18:27:06.252897] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-07T18:27:06.328728] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:27:06.329204] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-07T18:27:06.329306] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-07T18:27:06.329578] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-07T18:27:06.329638] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-07T18:27:06.709958] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:27:06.952395] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T18:27:07.047615] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-07T18:27:07.644767] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T18:27:07.647245] [INFO ] [REMOTE ] DLB: Full fetch complete (47048 records). [2025-10-07T18:27:07.647446] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-07T18:27:07.852962] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-07T18:27:08.022620] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-07T18:27:08.022749] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-07T18:27:08.023608] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-07T18:27:08.023710] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-07T18:27:08.024859] [DEBUG] [LOCAL ] DLB: Trimmed 47048 records to 32090 (keeping 200 days of data) [2025-10-07T18:27:08.233115] [DEBUG] [LOCAL ] DLB: Primary data saved (32090 records). [2025-10-07T18:27:08.233265] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-07T18:27:08.233405] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLB took 35.6s. Estimated remaining: 4h 0m 36s. Rate: 7.2 symbols/min [2025-10-07T18:27:08.411800] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:27:08.430857] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T18:27:08.440278] [DEBUG] [LOCAL ] DMA: Loaded 4554 existing records from primary storage. [2025-10-07T18:27:08.440471] [INFO ] [MAIN ] DMA: Loaded 4554 existing records. [2025-10-07T18:27:08.618869] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:27:08.619111] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-07T18:27:08.619167] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-07T18:27:08.619350] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-07T18:27:08.619411] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-07T18:27:08.652897] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-07T18:27:09.018698] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:27:09.447621] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-07T18:27:09.585746] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T18:27:09.843085] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-07T18:27:10.208475] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T18:27:10.247611] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-07T18:27:11.047717] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-07T18:27:11.847733] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-07T18:27:11.963396] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T18:27:12.151821] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T18:27:12.647629] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-07T18:27:12.832514] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-07T18:27:13.447623] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-07T18:27:13.655621] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T18:27:14.017971] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T18:27:14.247685] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-07T18:27:15.047768] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-07T18:27:15.847617] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-07T18:27:16.069756] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T18:27:16.647722] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-07T18:27:16.878000] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T18:27:17.148034] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-07T18:27:17.447717] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-07T18:27:18.141239] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T18:27:18.247764] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-07T18:27:18.927836] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T18:27:19.047734] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-07T18:27:19.847703] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-07T18:27:19.999117] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T18:27:20.027170] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T18:27:20.345611] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-07T18:27:20.647708] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-07T18:27:21.447721] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-07T18:27:21.786970] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-07T18:27:22.247729] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-07T18:27:23.047733] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-07T18:27:23.222308] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T18:27:23.324166] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T18:27:23.846119] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T18:27:23.850462] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-07T18:27:24.647733] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-07T18:27:25.447756] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-07T18:27:25.508403] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T18:27:25.698103] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:27:26.247759] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-07T18:27:26.570738] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T18:27:27.047770] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-07T18:27:27.847721] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-07T18:27:27.928682] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T18:27:27.932729] [INFO ] [REMOTE ] DLR: Full fetch complete (74039 records). [2025-10-07T18:27:27.932913] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-07T18:27:28.351626] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T18:27:28.372940] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-07T18:27:28.373230] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-07T18:27:28.374682] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-07T18:27:28.374835] [INFO ] [REMOTE ] DLY: Full fetch complete (28425 records). [2025-10-07T18:27:28.374930] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-07T18:27:28.375348] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-07T18:27:28.477357] [DEBUG] [LOCAL ] DLR: Trimmed 74039 records to 50862 (keeping 200 days of data) [2025-10-07T18:27:28.667212] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-07T18:27:28.861462] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-07T18:27:28.863147] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-07T18:27:28.864316] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-07T18:27:28.864730] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-07T18:27:28.872045] [DEBUG] [LOCAL ] DLY: Trimmed 28425 records to 20249 (keeping 200 days of data) [2025-10-07T18:27:29.135059] [DEBUG] [LOCAL ] DLY: Primary data saved (20249 records). [2025-10-07T18:27:29.136076] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-07T18:27:29.136454] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLY took 23.4s. Estimated remaining: 4h 1m 3s. Rate: 7.2 symbols/min [2025-10-07T18:27:29.331035] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-07T18:27:29.335318] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:27:29.339704] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-07T18:27:29.340599] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-07T18:27:29.341036] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-07T18:27:29.341671] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-07T18:27:29.342021] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-07T18:27:29.342394] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-07T18:27:29.452450] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-07T18:27:29.763905] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:27:29.789009] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T18:27:29.881669] [DEBUG] [LOCAL ] DLR: Primary data saved (50862 records). [2025-10-07T18:27:29.881872] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-07T18:27:29.881966] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLR took 32.2s. Estimated remaining: 4h 0m 34s. Rate: 7.2 symbols/min [2025-10-07T18:27:30.081604] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:27:30.081915] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-10-07T18:27:30.081988] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-10-07T18:27:30.082162] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-07T18:27:30.088619] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-07T18:27:30.088841] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T18:27:30.091336] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-07T18:27:30.091818] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-07T18:27:30.255958] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-07T18:27:30.437757] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:27:30.816356] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-07T18:27:31.047745] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-07T18:27:31.566121] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T18:27:31.847760] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-07T18:27:32.647633] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-07T18:27:32.729838] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T18:27:33.447705] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-07T18:27:33.952100] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-07T18:27:34.034185] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-07T18:27:34.247685] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-07T18:27:34.857365] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T18:27:35.047686] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-07T18:27:35.847628] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-07T18:27:35.934030] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T18:27:36.647733] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-07T18:27:36.852426] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T18:27:36.853302] [INFO ] [REMOTE ] DMA: Full fetch complete (6660 records). [2025-10-07T18:27:36.853372] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-07T18:27:37.237069] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-07T18:27:37.237187] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-07T18:27:37.237395] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-07T18:27:37.237439] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-07T18:27:37.237902] [DEBUG] [LOCAL ] DMA: Trimmed 6660 records to 4585 (keeping 200 days of data) [2025-10-07T18:27:37.265375] [DEBUG] [LOCAL ] DMA: Primary data saved (4585 records). [2025-10-07T18:27:37.265463] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-07T18:27:37.265536] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DMA took 29.0s. Estimated remaining: 4h 0m 23s. Rate: 7.2 symbols/min [2025-10-07T18:27:37.427464] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:27:37.453854] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-07T18:27:37.475264] [DEBUG] [LOCAL ] DNA: Loaded 48384 existing records from primary storage. [2025-10-07T18:27:37.475598] [INFO ] [MAIN ] DNA: Loaded 48384 existing records. [2025-10-07T18:27:37.651225] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:27:37.651443] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-07T18:27:37.651492] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-07T18:27:37.651902] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-07T18:27:37.651962] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-07T18:27:38.026119] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:27:38.044000] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T18:27:38.247781] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-07T18:27:38.571177] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T18:27:39.024160] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T18:27:39.047609] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-07T18:27:39.837989] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T18:27:39.847618] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-07T18:27:40.647625] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-07T18:27:40.647569] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T18:27:41.447704] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-07T18:27:42.243455] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T18:27:42.251914] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-07T18:27:42.266709] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T18:27:43.047693] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-07T18:27:43.847777] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-07T18:27:44.135329] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T18:27:44.503711] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-07T18:27:44.647621] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-07T18:27:45.148732] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T18:27:45.447733] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-07T18:27:46.247632] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-07T18:27:46.256620] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T18:27:46.406779] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T18:27:47.047732] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-07T18:27:47.395579] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T18:27:47.847757] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-07T18:27:48.595343] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T18:27:48.647724] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-07T18:27:48.956878] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-07T18:27:49.442958] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T18:27:49.447587] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-07T18:27:50.240290] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T18:27:50.247590] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-07T18:27:51.047754] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-07T18:27:51.263732] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T18:27:51.264797] [INFO ] [REMOTE ] DMB: Full fetch complete (14913 records). [2025-10-07T18:27:51.264869] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-07T18:27:51.620989] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-07T18:27:51.621070] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-07T18:27:51.621408] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-07T18:27:51.621448] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-07T18:27:51.621961] [DEBUG] [LOCAL ] DMB: Trimmed 14913 records to 10289 (keeping 200 days of data) [2025-10-07T18:27:51.682995] [DEBUG] [LOCAL ] DMB: Primary data saved (10289 records). [2025-10-07T18:27:51.683141] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-07T18:27:51.683217] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DMB took 22.5s. Estimated remaining: 4h 0m 31s. Rate: 7.2 symbols/min [2025-10-07T18:27:51.852295] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:27:51.852374] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-07T18:27:51.904635] [DEBUG] [LOCAL ] DNOW: Loaded 43717 existing records from primary storage. [2025-10-07T18:27:51.905023] [INFO ] [MAIN ] DNOW: Loaded 43717 existing records. [2025-10-07T18:27:52.076117] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:27:52.076396] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-07T18:27:52.076461] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-07T18:27:52.076811] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-07T18:27:52.076870] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-07T18:27:52.422873] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:27:52.647619] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-07T18:27:52.834284] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T18:27:53.097744] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T18:27:53.099874] [INFO ] [REMOTE ] DLX: Full fetch complete (41399 records). [2025-10-07T18:27:53.099960] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-07T18:27:53.453163] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-07T18:27:53.464734] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-07T18:27:53.464833] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-07T18:27:53.465412] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-07T18:27:53.465453] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-07T18:27:53.466432] [DEBUG] [LOCAL ] DLX: Trimmed 41399 records to 28517 (keeping 200 days of data) [2025-10-07T18:27:53.647561] [DEBUG] [LOCAL ] DLX: Primary data saved (28517 records). [2025-10-07T18:27:53.647780] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-07T18:27:53.647912] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DLX took 54.7s. Estimated remaining: 4h 0m 6s. Rate: 7.2 symbols/min [2025-10-07T18:27:53.813664] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:27:53.845785] [DEBUG] [LOCAL ] DNP: Loaded 33242 existing records from primary storage. [2025-10-07T18:27:53.846101] [INFO ] [MAIN ] DNP: Loaded 33242 existing records. [2025-10-07T18:27:54.018591] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:27:54.018825] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-07T18:27:54.018875] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-07T18:27:54.019160] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-07T18:27:54.019220] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-07T18:27:54.252916] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-07T18:27:54.381557] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:27:54.405143] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T18:27:54.524585] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T18:27:55.047750] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-07T18:27:55.847716] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-07T18:27:56.443399] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T18:27:56.615318] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-07T18:27:56.633931] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T18:27:56.647594] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-07T18:27:57.447635] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-07T18:27:57.506712] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-07T18:27:58.247778] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-07T18:27:59.047636] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-07T18:27:59.195185] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T18:27:59.631054] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T18:27:59.847789] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-07T18:28:00.251731] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T18:28:00.647694] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-07T18:28:01.357699] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T18:28:01.387223] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T18:28:01.447703] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-07T18:28:02.247748] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-07T18:28:02.318077] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T18:28:03.047736] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-07T18:28:03.639000] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T18:28:03.847693] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-07T18:28:04.647688] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-07T18:28:04.956009] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T18:28:05.447633] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-07T18:28:05.719474] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-07T18:28:05.737529] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T18:28:06.247713] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-07T18:28:06.708366] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T18:28:07.047616] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-07T18:28:07.485323] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T18:28:07.847737] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-07T18:28:08.559395] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T18:28:08.647632] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-07T18:28:09.233427] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T18:28:09.447700] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-07T18:28:10.110170] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T18:28:10.247719] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-07T18:28:11.047627] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-07T18:28:11.239693] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T18:28:11.808097] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T18:28:11.826017] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T18:28:11.847597] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-07T18:28:12.647619] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-07T18:28:12.702409] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T18:28:12.703630] [INFO ] [REMOTE ] DMO: Full fetch complete (14483 records). [2025-10-07T18:28:12.703731] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-07T18:28:13.059222] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-07T18:28:13.059313] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-07T18:28:13.059699] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-07T18:28:13.059762] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-07T18:28:13.060227] [DEBUG] [LOCAL ] DMO: Trimmed 14483 records to 9932 (keeping 200 days of data) [2025-10-07T18:28:13.121619] [DEBUG] [LOCAL ] DMO: Primary data saved (9932 records). [2025-10-07T18:28:13.121811] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-07T18:28:13.121906] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMO took 43.2s. Estimated remaining: 4h 0m 28s. Rate: 7.2 symbols/min [2025-10-07T18:28:13.287979] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:28:13.343463] [DEBUG] [LOCAL ] DOC: Loaded 53551 existing records from primary storage. [2025-10-07T18:28:13.343826] [INFO ] [MAIN ] DOC: Loaded 53551 existing records. [2025-10-07T18:28:13.452899] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-07T18:28:13.525035] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:28:13.525243] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-07T18:28:13.525292] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-07T18:28:13.526814] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-07T18:28:13.526877] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-07T18:28:13.877128] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:28:14.153357] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T18:28:14.247614] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-07T18:28:15.047724] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-07T18:28:15.762240] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T18:28:15.847715] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-07T18:28:16.647762] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-07T18:28:16.726557] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (3.27 seconds). [2025-10-07T18:28:17.447627] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-07T18:28:17.715530] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-07T18:28:17.833966] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-07T18:28:17.837895] [INFO ] [REMOTE ] DNOW: Full fetch complete (62971 records). [2025-10-07T18:28:17.838129] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-07T18:28:18.232031] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-07T18:28:18.232129] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-07T18:28:18.232953] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-07T18:28:18.233022] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-07T18:28:18.234433] [DEBUG] [LOCAL ] DNOW: Trimmed 62971 records to 43697 (keeping 200 days of data) [2025-10-07T18:28:18.283835] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-07T18:28:18.475084] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T18:28:18.525277] [DEBUG] [LOCAL ] DNOW: Primary data saved (43697 records). [2025-10-07T18:28:18.525419] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-07T18:28:18.526837] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNOW took 26.8s. Estimated remaining: 4h 0m 12s. Rate: 7.2 symbols/min [2025-10-07T18:28:19.047624] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-07T18:28:19.365972] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T18:28:19.847719] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-07T18:28:20.049181] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T18:28:20.653024] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-07T18:28:20.672185] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T18:28:21.447800] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-07T18:28:22.114966] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-07T18:28:22.247766] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-07T18:28:22.361553] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T18:28:22.734436] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T18:28:23.047783] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-07T18:28:23.847764] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-07T18:28:24.179917] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-07T18:28:24.183325] [INFO ] [REMOTE ] DNA: Full fetch complete (70993 records). [2025-10-07T18:28:24.183446] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-07T18:28:24.521958] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T18:28:24.597457] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-07T18:28:24.597534] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-07T18:28:24.598373] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-07T18:28:24.598438] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-07T18:28:24.599761] [DEBUG] [LOCAL ] DNA: Trimmed 70993 records to 48427 (keeping 200 days of data) [2025-10-07T18:28:24.648476] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-07T18:28:24.883045] [DEBUG] [LOCAL ] DNA: Primary data saved (48427 records). [2025-10-07T18:28:24.883203] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-07T18:28:24.883337] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNA took 47.6s. Estimated remaining: 3h 59m 58s. Rate: 7.2 symbols/min [2025-10-07T18:28:25.795689] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-07T18:28:25.807030] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-07T18:28:26.085124] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T18:28:26.247624] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-07T18:28:27.703409] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T18:28:27.705811] [INFO ] [REMOTE ] DNP: Full fetch complete (49129 records). [2025-10-07T18:28:27.705900] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-07T18:28:28.092472] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-07T18:28:28.092587] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-07T18:28:28.093346] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-07T18:28:28.093456] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-07T18:28:28.094862] [DEBUG] [LOCAL ] DNP: Trimmed 49129 records to 33279 (keeping 200 days of data) [2025-10-07T18:28:28.210161] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-07T18:28:28.225798] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-07T18:28:28.337507] [DEBUG] [LOCAL ] DNP: Primary data saved (33279 records). [2025-10-07T18:28:28.340896] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-07T18:28:28.341048] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNP took 34.7s. Estimated remaining: 3h 59m 37s. Rate: 7.2 symbols/min [2025-10-07T18:28:29.727111] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T18:28:29.738383] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-07T18:28:31.525861] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T18:28:31.537492] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-07T18:28:33.476636] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T18:28:33.488191] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-07T18:28:35.307486] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:28:35.319544] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-07T18:28:37.667466] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-07T18:28:37.678870] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-07T18:28:39.789348] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-07T18:28:39.792897] [INFO ] [REMOTE ] DOC: Full fetch complete (77389 records). [2025-10-07T18:28:39.793039] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-07T18:28:40.208424] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-07T18:28:40.208517] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-07T18:28:40.209447] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-07T18:28:40.209521] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-07T18:28:40.211201] [DEBUG] [LOCAL ] DOC: Trimmed 77389 records to 53552 (keeping 200 days of data) [2025-10-07T18:28:40.550506] [DEBUG] [LOCAL ] DOC: Primary data saved (53552 records). [2025-10-07T18:28:40.550666] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-07T18:28:40.550771] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 27.4s. Estimated remaining: 3h 59m 39s. Rate: 7.2 symbols/min [2025-10-07T18:28:41.270565] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:28:41.277492] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:28:41.274015] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:28:41.296149] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:28:41.375274] [DEBUG] [LOCAL ] DOUG: Loaded 34381 existing records from primary storage. [2025-10-07T18:28:41.376271] [DEBUG] [LOCAL ] DOLE: Loaded 38603 existing records from primary storage. [2025-10-07T18:28:41.376621] [INFO ] [MAIN ] DOLE: Loaded 38603 existing records. [2025-10-07T18:28:41.406133] [INFO ] [MAIN ] DOUG: Loaded 34381 existing records. [2025-10-07T18:28:41.528989] [DEBUG] [LOCAL ] DOCS: Loaded 51060 existing records from primary storage. [2025-10-07T18:28:41.578160] [INFO ] [MAIN ] DOCS: Loaded 51060 existing records. [2025-10-07T18:28:41.685883] [DEBUG] [LOCAL ] DOCN: Loaded 50703 existing records from primary storage. [2025-10-07T18:28:41.764730] [INFO ] [MAIN ] DOCN: Loaded 50703 existing records. [2025-10-07T18:28:41.839688] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:28:42.030739] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-07T18:28:42.093218] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:28:42.104550] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:28:42.104712] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-07T18:28:42.115871] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-07T18:28:42.127485] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-07T18:28:42.127591] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-07T18:28:42.121146] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-07T18:28:42.143745] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-07T18:28:42.160271] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-07T18:28:42.216903] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-07T18:28:42.252627] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-07T18:28:42.252573] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-07T18:28:42.252855] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-07T18:28:42.268803] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:28:42.389077] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-07T18:28:42.446427] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-07T18:28:42.472303] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-07T18:28:42.493529] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-07T18:28:43.470981] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:28:43.497992] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-07T18:28:43.574822] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:28:43.624383] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-07T18:28:43.707707] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:28:43.704863] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:28:43.708785] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-07T18:28:43.709704] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-07T18:28:45.302480] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T18:28:45.309636] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-07T18:28:45.429082] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T18:28:45.438060] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-07T18:28:45.527803] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T18:28:45.536381] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-07T18:28:45.907358] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-07T18:28:45.918559] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-07T18:28:46.758064] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T18:28:46.766593] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-07T18:28:47.204030] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T18:28:47.211484] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-07T18:28:47.277350] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T18:28:47.286835] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-07T18:28:47.577581] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T18:28:47.587554] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-07T18:28:48.002605] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T18:28:48.009254] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-07T18:28:48.127350] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T18:28:48.134639] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-07T18:28:48.944082] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T18:28:48.954048] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-07T18:28:49.178672] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T18:28:49.186192] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-07T18:28:49.442430] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T18:28:49.452351] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-07T18:28:49.560772] [DEBUG] [REMOTE ] DOCS: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-07T18:28:49.561440] [WARN ] [REMOTE ] DOCS: No data returned for month 2025-03 [2025-10-07T18:28:49.561859] [FATAL] [REMOTE ] DOCS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:28:49.562051] [FATAL] [MAIN ] DOCS: Failed to fetch primary data. [2025-10-07T18:28:49.562177] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:28:49.562313] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-07T18:28:49.562417] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-07T18:28:49.562454] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-10-07T18:28:49.562795] [DEBUG] [LOCAL ] DOCS: Deleted derivative data file. [2025-10-07T18:28:49.562892] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOCS took 9.0s. Estimated remaining: 3h 59m 32s. Rate: 7.2 symbols/min [2025-10-07T18:28:49.730704] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:28:49.753120] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T18:28:49.761148] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-07T18:28:49.803731] [DEBUG] [LOCAL ] DOV: Loaded 45461 existing records from primary storage. [2025-10-07T18:28:49.804077] [INFO ] [MAIN ] DOV: Loaded 45461 existing records. [2025-10-07T18:28:49.984320] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:28:49.984561] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-07T18:28:49.984609] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-07T18:28:49.986069] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-07T18:28:49.986134] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-07T18:28:50.422165] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:28:50.422758] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-07T18:28:50.698090] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T18:28:50.712546] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-07T18:28:50.763463] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T18:28:50.778460] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-07T18:28:51.151344] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T18:28:51.159257] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-07T18:28:52.261518] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T18:28:52.270310] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-07T18:28:52.527931] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-07T18:28:52.536400] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-07T18:28:52.563300] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T18:28:52.575101] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-07T18:28:52.732719] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T18:28:52.743362] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-07T18:28:53.588473] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T18:28:53.595934] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-07T18:28:53.769161] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T18:28:53.776819] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-07T18:28:54.354828] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T18:28:54.363753] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-07T18:28:54.630155] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T18:28:55.035011] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T18:28:55.047587] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-07T18:28:55.127765] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T18:28:55.847697] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-07T18:28:55.888604] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T18:28:56.647634] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-07T18:28:56.812546] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T18:28:57.447638] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-07T18:28:57.962134] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-07T18:28:58.247687] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-07T18:28:58.349112] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T18:28:58.575114] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T18:28:59.047760] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-07T18:28:59.713786] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T18:28:59.847708] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-07T18:29:00.647637] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-07T18:29:00.740698] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-07T18:29:00.744474] [INFO ] [REMOTE ] DOLE: Full fetch complete (54179 records). [2025-10-07T18:29:00.744601] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-07T18:29:01.170094] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-07T18:29:01.181028] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-07T18:29:01.181764] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-07T18:29:01.182016] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-07T18:29:01.183631] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T18:29:01.191590] [DEBUG] [LOCAL ] DOLE: Trimmed 54179 records to 38734 (keeping 200 days of data) [2025-10-07T18:29:01.434239] [DEBUG] [LOCAL ] DOLE: Primary data saved (38734 records). [2025-10-07T18:29:01.434441] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-07T18:29:01.434573] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOLE took 20.9s. Estimated remaining: 3h 59m 34s. Rate: 7.2 symbols/min [2025-10-07T18:29:01.456058] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-07T18:29:01.613322] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:29:01.613511] [DEBUG] [LOCAL ] DOW: No existing data file found in primary storage. [2025-10-07T18:29:01.613549] [WARN ] [MAIN ] DOW: No existing data found, performing full refresh instead. [2025-10-07T18:29:01.613691] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-07T18:29:01.613746] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-07T18:29:01.613790] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-07T18:29:01.613824] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-07T18:29:01.966401] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:29:02.247627] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-07T18:29:02.518866] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T18:29:03.047682] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-07T18:29:03.356983] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T18:29:03.802431] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T18:29:03.804637] [INFO ] [REMOTE ] DOUG: Full fetch complete (50690 records). [2025-10-07T18:29:03.804814] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-07T18:29:03.807996] [FATAL] [VALIDATOR ] DOUG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:29:03.808101] [FATAL] [MAIN ] DOUG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:29:03.808182] [WARN ] [MAIN ] DOUG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:29:03.808271] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-07T18:29:03.808360] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-10-07T18:29:03.808399] [INFO ] [LOCAL ] DOUG: Starting deletion of derivative data. [2025-10-07T18:29:03.808801] [DEBUG] [LOCAL ] DOUG: Deleted derivative data file. [2025-10-07T18:29:03.808905] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOUG took 23.3s. Estimated remaining: 3h 59m 9s. Rate: 7.2 symbols/min [2025-10-07T18:29:03.853403] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-07T18:29:03.978754] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:29:03.996010] [DEBUG] [LOCAL ] DPG: Loaded 13375 existing records from primary storage. [2025-10-07T18:29:03.996261] [INFO ] [MAIN ] DPG: Loaded 13375 existing records. [2025-10-07T18:29:04.169990] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:29:04.170228] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-07T18:29:04.170275] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-07T18:29:04.170791] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-07T18:29:04.170878] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-07T18:29:04.528824] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:29:04.647612] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-07T18:29:05.254578] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-07T18:29:05.447630] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-07T18:29:05.874902] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-07T18:29:05.914508] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T18:29:06.247685] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-07T18:29:07.047619] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-07T18:29:07.152938] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T18:29:07.847606] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-07T18:29:07.905042] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T18:29:07.927412] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T18:29:08.647711] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-07T18:29:09.438840] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T18:29:09.447590] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-07T18:29:09.638593] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T18:29:10.247619] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-07T18:29:10.316837] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T18:29:11.047701] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-07T18:29:11.847707] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-07T18:29:12.454444] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-07T18:29:12.647747] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-07T18:29:12.771194] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T18:29:12.790867] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T18:29:13.447760] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-07T18:29:14.247777] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-07T18:29:14.316419] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T18:29:14.837493] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-07T18:29:15.047746] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-07T18:29:15.847629] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-07T18:29:16.128634] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-07T18:29:16.132809] [INFO ] [REMOTE ] DOCN: Full fetch complete (71993 records). [2025-10-07T18:29:16.132958] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-07T18:29:16.566023] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-07T18:29:16.566146] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-07T18:29:16.567173] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-07T18:29:16.567265] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-07T18:29:16.579168] [DEBUG] [LOCAL ] DOCN: Trimmed 71993 records to 50780 (keeping 200 days of data) [2025-10-07T18:29:16.597134] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T18:29:16.655668] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-07T18:29:16.911060] [DEBUG] [LOCAL ] DOCN: Primary data saved (50780 records). [2025-10-07T18:29:16.911210] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-07T18:29:16.911317] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCN took 36.4s. Estimated remaining: 3h 59m 14s. Rate: 7.2 symbols/min [2025-10-07T18:29:17.076926] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:29:17.121634] [DEBUG] [LOCAL ] DQ: Loaded 43466 existing records from primary storage. [2025-10-07T18:29:17.122016] [INFO ] [MAIN ] DQ: Loaded 43466 existing records. [2025-10-07T18:29:17.302058] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:29:17.302304] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-07T18:29:17.302351] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-07T18:29:17.303559] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-07T18:29:17.303618] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-07T18:29:17.453603] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-07T18:29:17.664174] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:29:18.065636] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T18:29:18.247624] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-07T18:29:18.317111] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-07T18:29:19.047730] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-07T18:29:19.198067] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T18:29:19.375174] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T18:29:19.847744] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-07T18:29:20.647619] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-07T18:29:20.746819] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T18:29:21.447762] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-07T18:29:21.536893] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T18:29:21.710609] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T18:29:22.247698] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-07T18:29:23.047631] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-07T18:29:23.125682] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T18:29:23.705801] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T18:29:23.847683] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-07T18:29:23.964242] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T18:29:24.647710] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-07T18:29:25.447774] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-07T18:29:25.558115] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T18:29:25.561053] [INFO ] [REMOTE ] DOV: Full fetch complete (65270 records). [2025-10-07T18:29:25.561193] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-07T18:29:25.971439] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-07T18:29:25.971565] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-07T18:29:25.972378] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-07T18:29:25.972456] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-07T18:29:25.973821] [DEBUG] [LOCAL ] DOV: Trimmed 65270 records to 45506 (keeping 200 days of data) [2025-10-07T18:29:26.225872] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T18:29:26.247764] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-07T18:29:26.302274] [DEBUG] [LOCAL ] DOV: Primary data saved (45506 records). [2025-10-07T18:29:26.302411] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-07T18:29:26.302515] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DOV took 36.7s. Estimated remaining: 3h 59m 9s. Rate: 7.2 symbols/min [2025-10-07T18:29:26.470217] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:29:26.476104] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T18:29:26.477562] [INFO ] [REMOTE ] DPG: Full fetch complete (18940 records). [2025-10-07T18:29:26.477686] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-07T18:29:26.731578] [DEBUG] [LOCAL ] DRD: Loaded 37053 existing records from primary storage. [2025-10-07T18:29:26.780038] [INFO ] [MAIN ] DRD: Loaded 37053 existing records. [2025-10-07T18:29:27.050753] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-07T18:29:27.072227] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:29:27.072321] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-07T18:29:27.073537] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-07T18:29:27.073626] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-07T18:29:27.073481] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-07T18:29:27.074171] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-07T18:29:27.074336] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-07T18:29:27.074975] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-07T18:29:27.075152] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-07T18:29:27.095769] [DEBUG] [LOCAL ] DPG: Trimmed 18940 records to 13428 (keeping 200 days of data) [2025-10-07T18:29:27.499694] [DEBUG] [LOCAL ] DPG: Primary data saved (13428 records). [2025-10-07T18:29:27.520178] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-07T18:29:27.520093] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:29:27.520554] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DPG took 23.7s. Estimated remaining: 3h 58m 41s. Rate: 7.2 symbols/min [2025-10-07T18:29:27.703676] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:29:27.756109] [DEBUG] [LOCAL ] DRH: Loaded 50446 existing records from primary storage. [2025-10-07T18:29:27.756450] [INFO ] [MAIN ] DRH: Loaded 50446 existing records. [2025-10-07T18:29:27.851062] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-07T18:29:27.945504] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:29:27.945766] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-07T18:29:27.945821] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-07T18:29:27.947304] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-07T18:29:27.947365] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-07T18:29:28.328733] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:29:28.359726] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-07T18:29:28.439062] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T18:29:28.647707] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-07T18:29:29.352578] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T18:29:29.447733] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-07T18:29:30.195055] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T18:29:30.247610] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-07T18:29:30.427973] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T18:29:31.047757] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-07T18:29:31.847724] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-07T18:29:31.967308] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T18:29:32.647766] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-07T18:29:33.447749] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-07T18:29:33.548758] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-07T18:29:33.632552] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T18:29:33.815779] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T18:29:34.247697] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-07T18:29:34.861868] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T18:29:35.051375] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-07T18:29:35.847730] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-07T18:29:36.510892] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-07T18:29:36.544519] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T18:29:36.647695] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-07T18:29:37.447761] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-07T18:29:37.586032] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T18:29:38.034263] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T18:29:38.247752] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-07T18:29:39.047739] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-07T18:29:39.575299] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-07T18:29:39.847720] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-07T18:29:39.997702] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T18:29:40.490870] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T18:29:40.647753] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-07T18:29:41.447772] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-07T18:29:41.940934] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-07T18:29:41.944463] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-07T18:29:41.944598] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-07T18:29:42.253377] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-07T18:29:42.363970] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-07T18:29:42.364150] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-07T18:29:42.365121] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-07T18:29:42.365202] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-07T18:29:42.396028] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T18:29:42.394558] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-10-07T18:29:42.756357] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-07T18:29:42.756526] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-07T18:29:42.756609] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOW took 41.3s. Estimated remaining: 3h 58m 52s. Rate: 7.2 symbols/min [2025-10-07T18:29:42.939424] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:29:42.998999] [DEBUG] [LOCAL ] DRI: Loaded 47748 existing records from primary storage. [2025-10-07T18:29:42.999730] [INFO ] [MAIN ] DRI: Loaded 47748 existing records. [2025-10-07T18:29:43.055401] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-07T18:29:43.240363] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T18:29:43.355982] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:29:43.356695] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-07T18:29:43.356776] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-07T18:29:43.358597] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-07T18:29:43.358709] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-07T18:29:43.782276] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:29:43.847723] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-07T18:29:44.018127] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T18:29:44.647617] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-07T18:29:45.067869] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T18:29:45.133795] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-07T18:29:45.447707] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-07T18:29:46.247749] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-07T18:29:46.424147] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T18:29:47.047741] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-07T18:29:47.199792] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T18:29:47.847815] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-07T18:29:47.976032] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T18:29:48.556419] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T18:29:48.647753] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-07T18:29:49.447732] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-07T18:29:49.533584] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-07T18:29:49.536764] [INFO ] [REMOTE ] DQ: Full fetch complete (63162 records). [2025-10-07T18:29:49.536863] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-07T18:29:49.925603] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-07T18:29:49.925716] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-07T18:29:49.926462] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-07T18:29:49.926506] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-07T18:29:49.927849] [DEBUG] [LOCAL ] DQ: Trimmed 63162 records to 43484 (keeping 200 days of data) [2025-10-07T18:29:50.193111] [DEBUG] [LOCAL ] DQ: Primary data saved (43484 records). [2025-10-07T18:29:50.193422] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-07T18:29:50.194367] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DQ took 33.3s. Estimated remaining: 3h 58m 41s. Rate: 7.2 symbols/min [2025-10-07T18:29:50.257121] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-07T18:29:50.373479] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T18:29:50.420784] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:29:50.420986] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-10-07T18:29:50.421077] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-10-07T18:29:50.421208] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-07T18:29:50.421251] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-07T18:29:50.421292] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-07T18:29:50.421325] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-07T18:29:50.778998] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:29:50.944096] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T18:29:51.047736] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-07T18:29:51.759831] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T18:29:51.847705] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-07T18:29:52.058821] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T18:29:52.647736] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-07T18:29:53.390037] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T18:29:53.447626] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-07T18:29:54.247736] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-07T18:29:54.629947] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-07T18:29:55.047720] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-07T18:29:55.486343] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T18:29:55.847719] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-07T18:29:56.300696] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-07T18:29:56.459005] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T18:29:56.463696] [INFO ] [REMOTE ] DRD: Full fetch complete (50291 records). [2025-10-07T18:29:56.463837] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-07T18:29:56.659942] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-07T18:29:56.851681] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-07T18:29:56.851768] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-07T18:29:56.852441] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-07T18:29:56.852492] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-07T18:29:56.853582] [DEBUG] [LOCAL ] DRD: Trimmed 50291 records to 37150 (keeping 200 days of data) [2025-10-07T18:29:57.082116] [DEBUG] [LOCAL ] DRD: Primary data saved (37150 records). [2025-10-07T18:29:57.082286] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-07T18:29:57.082375] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 30.8s. Estimated remaining: 3h 58m 29s. Rate: 7.2 symbols/min [2025-10-07T18:29:57.256622] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:29:57.256865] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-10-07T18:29:57.256937] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-10-07T18:29:57.257156] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-07T18:29:57.257213] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-07T18:29:57.257340] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-07T18:29:57.257468] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-07T18:29:57.463874] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-07T18:29:57.613809] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:29:57.642924] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T18:29:58.144203] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T18:29:58.247611] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-07T18:29:58.320949] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-07T18:29:59.047721] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-07T18:29:59.847619] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-07T18:29:59.848687] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T18:29:59.870950] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T18:30:00.647710] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-07T18:30:01.447754] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-07T18:30:01.701881] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T18:30:02.114685] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-07T18:30:02.247737] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-07T18:30:03.047733] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-07T18:30:03.596549] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T18:30:03.598432] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-07T18:30:03.847722] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-07T18:30:04.647668] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-07T18:30:04.739078] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T18:30:05.195003] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T18:30:05.447698] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-07T18:30:06.247698] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-07T18:30:06.287135] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T18:30:06.291225] [INFO ] [REMOTE ] DRH: Full fetch complete (71938 records). [2025-10-07T18:30:06.291454] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-07T18:30:06.694114] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-07T18:30:06.694225] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-07T18:30:06.695076] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-07T18:30:06.695150] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-07T18:30:06.696718] [DEBUG] [LOCAL ] DRH: Trimmed 71938 records to 50480 (keeping 200 days of data) [2025-10-07T18:30:07.050726] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-07T18:30:07.050885] [DEBUG] [LOCAL ] DRH: Primary data saved (50480 records). [2025-10-07T18:30:07.052331] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-07T18:30:07.052460] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 39.5s. Estimated remaining: 3h 58m 25s. Rate: 7.2 symbols/min [2025-10-07T18:30:07.226317] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:30:07.260588] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T18:30:07.276338] [DEBUG] [LOCAL ] DSM: Loaded 14715 existing records from primary storage. [2025-10-07T18:30:07.277046] [INFO ] [MAIN ] DSM: Loaded 14715 existing records. [2025-10-07T18:30:07.454324] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:30:07.454621] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-07T18:30:07.454704] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-07T18:30:07.455241] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-07T18:30:07.455301] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-07T18:30:07.830438] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:30:07.832182] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T18:30:07.847601] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-07T18:30:08.557341] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T18:30:08.647745] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-07T18:30:09.284246] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T18:30:09.447623] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-07T18:30:10.247683] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-07T18:30:10.279279] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T18:30:10.299332] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T18:30:11.047734] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-07T18:30:11.142561] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T18:30:11.847752] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-07T18:30:12.621149] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T18:30:12.647620] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-07T18:30:13.083335] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T18:30:13.447692] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-07T18:30:14.247713] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-07T18:30:14.426881] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T18:30:14.541818] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T18:30:14.760723] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-07T18:30:15.047745] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-07T18:30:15.847743] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-07T18:30:16.207908] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T18:30:16.647736] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-07T18:30:16.847997] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T18:30:17.262229] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T18:30:17.447610] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-07T18:30:18.247667] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-07T18:30:18.264943] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-07T18:30:19.047734] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-07T18:30:19.573839] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T18:30:19.847749] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-07T18:30:20.647709] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-07T18:30:20.923433] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-07T18:30:20.926852] [INFO ] [REMOTE ] DRI: Full fetch complete (69528 records). [2025-10-07T18:30:20.926987] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-07T18:30:21.343571] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-07T18:30:21.343730] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-07T18:30:21.344637] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-07T18:30:21.344869] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-07T18:30:21.362810] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T18:30:21.371586] [DEBUG] [LOCAL ] DRI: Trimmed 69528 records to 47703 (keeping 200 days of data) [2025-10-07T18:30:21.469782] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-07T18:30:21.693726] [DEBUG] [LOCAL ] DRI: Primary data saved (47703 records). [2025-10-07T18:30:21.693882] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-07T18:30:21.693973] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRI took 38.9s. Estimated remaining: 3h 58m 33s. Rate: 7.2 symbols/min [2025-10-07T18:30:21.806637] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T18:30:21.880442] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:30:21.880672] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-07T18:30:21.880728] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-07T18:30:21.880838] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-07T18:30:21.880880] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-07T18:30:21.880922] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-07T18:30:21.880953] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-07T18:30:22.227078] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:30:22.247600] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-07T18:30:22.897060] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T18:30:22.905578] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T18:30:22.908208] [INFO ] [REMOTE ] DSL: Full fetch complete (41623 records). [2025-10-07T18:30:22.908311] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-07T18:30:23.054992] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-07T18:30:23.286584] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-07T18:30:23.286709] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-07T18:30:23.287867] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-07T18:30:23.287929] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-07T18:30:23.288993] [DEBUG] [LOCAL ] DSL: Trimmed 41623 records to 28564 (keeping 200 days of data) [2025-10-07T18:30:23.471797] [DEBUG] [LOCAL ] DSL: Primary data saved (28564 records). [2025-10-07T18:30:23.471985] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-07T18:30:23.472097] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DSL took 26.4s. Estimated remaining: 3h 58m 8s. Rate: 7.2 symbols/min [2025-10-07T18:30:23.710634] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:30:23.737253] [DEBUG] [LOCAL ] DSU: Loaded 22739 existing records from primary storage. [2025-10-07T18:30:23.737614] [INFO ] [MAIN ] DSU: Loaded 22739 existing records. [2025-10-07T18:30:23.857175] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-07T18:30:23.969946] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T18:30:23.986345] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:30:23.989060] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-07T18:30:23.989697] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-07T18:30:23.990795] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-07T18:30:23.990873] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-07T18:30:24.434575] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:30:24.647715] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-07T18:30:25.008992] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T18:30:25.447725] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-07T18:30:25.802399] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T18:30:26.247795] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-07T18:30:26.412616] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T18:30:26.999911] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T18:30:27.047616] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-07T18:30:27.847717] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-07T18:30:28.056336] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T18:30:28.057397] [INFO ] [REMOTE ] DRLL: Full fetch complete (15110 records). [2025-10-07T18:30:28.057470] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-07T18:30:28.430160] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-07T18:30:28.430249] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-07T18:30:28.430601] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-07T18:30:28.430706] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-07T18:30:28.431293] [DEBUG] [LOCAL ] DRLL: Trimmed 15110 records to 9285 (keeping 200 days of data) [2025-10-07T18:30:28.489167] [DEBUG] [LOCAL ] DRLL: Primary data saved (9285 records). [2025-10-07T18:30:28.489319] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-07T18:30:28.489431] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DRLL took 38.3s. Estimated remaining: 3h 57m 51s. Rate: 7.2 symbols/min [2025-10-07T18:30:28.659987] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-07T18:30:28.664033] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:30:28.674454] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T18:30:28.705234] [DEBUG] [LOCAL ] DSX: Loaded 24112 existing records from primary storage. [2025-10-07T18:30:28.705543] [INFO ] [MAIN ] DSX: Loaded 24112 existing records. [2025-10-07T18:30:28.886907] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:30:28.887139] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-07T18:30:28.887188] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-07T18:30:28.888022] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-07T18:30:28.888089] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-07T18:30:29.209996] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-07T18:30:29.295908] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:30:29.447705] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-07T18:30:30.247749] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-07T18:30:30.702585] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-07T18:30:31.047719] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-07T18:30:31.192719] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T18:30:31.590690] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-07T18:30:31.847710] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-07T18:30:32.652796] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-07T18:30:32.662774] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T18:30:33.447710] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-07T18:30:33.556107] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T18:30:34.247735] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-07T18:30:34.574472] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T18:30:35.047684] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-07T18:30:35.372346] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T18:30:35.800193] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-07T18:30:35.847667] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-07T18:30:36.651263] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-07T18:30:37.092054] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T18:30:37.447708] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-07T18:30:37.720341] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T18:30:38.247745] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-07T18:30:38.429179] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T18:30:39.047711] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-07T18:30:39.551530] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T18:30:39.847684] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-07T18:30:40.116052] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T18:30:40.279084] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-07T18:30:40.647703] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-07T18:30:40.998315] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-07T18:30:41.447709] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-07T18:30:41.800807] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-07T18:30:42.247707] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-07T18:30:43.047787] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-07T18:30:43.595766] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T18:30:43.847688] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-07T18:30:44.178821] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-07T18:30:44.647717] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-07T18:30:44.719232] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T18:30:45.447724] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-07T18:30:45.480049] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T18:30:46.247737] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-07T18:30:46.580529] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T18:30:47.047681] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-07T18:30:47.306875] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T18:30:47.847726] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-07T18:30:48.047707] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T18:30:48.647733] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-07T18:30:48.711016] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T18:30:48.712302] [INFO ] [REMOTE ] DSM: Full fetch complete (24301 records). [2025-10-07T18:30:48.712374] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-07T18:30:49.065333] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-07T18:30:49.065411] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-07T18:30:49.065834] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-07T18:30:49.065899] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-07T18:30:49.066492] [DEBUG] [LOCAL ] DSM: Trimmed 24301 records to 14610 (keeping 200 days of data) [2025-10-07T18:30:49.152693] [DEBUG] [LOCAL ] DSM: Primary data saved (14610 records). [2025-10-07T18:30:49.152838] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-07T18:30:49.152933] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSM took 42.1s. Estimated remaining: 3h 58m 15s. Rate: 7.2 symbols/min [2025-10-07T18:30:49.341955] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:30:49.394866] [DEBUG] [LOCAL ] DT: Loaded 52945 existing records from primary storage. [2025-10-07T18:30:49.395260] [INFO ] [MAIN ] DT: Loaded 52945 existing records. [2025-10-07T18:30:49.455495] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-07T18:30:49.570958] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:30:49.571171] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-07T18:30:49.571221] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-07T18:30:49.571480] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-07T18:30:49.571538] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-07T18:30:49.677674] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T18:30:49.699950] [INFO ] [REMOTE ] DSX: Full fetch complete (36122 records). [2025-10-07T18:30:49.717039] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-07T18:30:49.731666] [FATAL] [VALIDATOR ] DSX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:30:49.747387] [FATAL] [MAIN ] DSX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:30:49.749093] [WARN ] [MAIN ] DSX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:30:49.829226] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-07T18:30:49.854610] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-07T18:30:49.870453] [INFO ] [LOCAL ] DSX: Starting deletion of derivative data. [2025-10-07T18:30:49.927169] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:30:49.927243] [DEBUG] [LOCAL ] DSX: Deleted derivative data file. [2025-10-07T18:30:49.927675] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSX took 21.4s. Estimated remaining: 3h 57m 47s. Rate: 7.2 symbols/min [2025-10-07T18:30:50.104440] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:30:50.111623] [DEBUG] [LOCAL ] DTB: Loaded 4928 existing records from primary storage. [2025-10-07T18:30:50.111874] [INFO ] [MAIN ] DTB: Loaded 4928 existing records. [2025-10-07T18:30:50.252928] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-07T18:30:50.295310] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:30:50.295907] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-07T18:30:50.296012] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-07T18:30:50.296469] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-07T18:30:50.296538] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-07T18:30:50.415506] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T18:30:50.687319] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:30:50.955888] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T18:30:51.047762] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-07T18:30:51.847746] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-07T18:30:52.387368] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-07T18:30:52.652768] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-07T18:30:52.671787] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T18:30:53.447672] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-07T18:30:53.801380] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T18:30:53.839161] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T18:30:53.840162] [INFO ] [REMOTE ] DSMC: Full fetch complete (2857 records). [2025-10-07T18:30:53.840246] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-07T18:30:54.201892] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-07T18:30:54.202230] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-07T18:30:54.202359] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-07T18:30:54.202401] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-07T18:30:54.202824] [DEBUG] [LOCAL ] DSMC: Trimmed 2857 records to 1845 (keeping 200 days of data) [2025-10-07T18:30:54.215304] [DEBUG] [LOCAL ] DSMC: Primary data saved (1845 records). [2025-10-07T18:30:54.215401] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-07T18:30:54.215482] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSMC took 32.5s. Estimated remaining: 3h 57m 28s. Rate: 7.2 symbols/min [2025-10-07T18:30:54.252889] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-07T18:30:54.389315] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:30:54.443984] [DEBUG] [LOCAL ] DTE: Loaded 47627 existing records from primary storage. [2025-10-07T18:30:54.444488] [INFO ] [MAIN ] DTE: Loaded 47627 existing records. [2025-10-07T18:30:54.631775] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:30:54.632048] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-07T18:30:54.632095] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-07T18:30:54.633871] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-07T18:30:54.633934] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-07T18:30:55.001748] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:30:55.047610] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-07T18:30:55.847714] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-07T18:30:56.113254] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T18:30:56.630951] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T18:30:56.647704] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-07T18:30:56.845814] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T18:30:57.208976] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T18:30:57.447700] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-07T18:30:57.996982] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T18:30:58.247714] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-07T18:30:58.824817] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T18:30:59.047805] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-07T18:30:59.847696] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-07T18:31:00.146941] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T18:31:00.338491] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-07T18:31:00.647699] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-07T18:31:01.447706] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-07T18:31:01.870482] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-07T18:31:02.247701] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-07T18:31:02.397555] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T18:31:03.047724] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-07T18:31:03.768487] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T18:31:03.847712] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-07T18:31:04.620450] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T18:31:04.647603] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-07T18:31:04.682331] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-07T18:31:05.447794] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-07T18:31:05.800891] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T18:31:05.802856] [INFO ] [REMOTE ] DSU: Full fetch complete (32915 records). [2025-10-07T18:31:05.802980] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-07T18:31:06.203690] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-07T18:31:06.203805] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-07T18:31:06.204339] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-07T18:31:06.204402] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-07T18:31:06.205561] [DEBUG] [LOCAL ] DSU: Trimmed 32915 records to 22802 (keeping 200 days of data) [2025-10-07T18:31:06.258167] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-07T18:31:06.347551] [DEBUG] [LOCAL ] DSU: Primary data saved (22802 records). [2025-10-07T18:31:06.347743] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-07T18:31:06.347837] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSU took 42.9s. Estimated remaining: 3h 57m 30s. Rate: 7.2 symbols/min [2025-10-07T18:31:06.516278] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:31:06.516481] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-07T18:31:06.516519] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-07T18:31:06.516638] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-07T18:31:06.516795] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-07T18:31:06.516872] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-07T18:31:06.516920] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-07T18:31:06.900882] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:31:07.047664] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-07T18:31:07.486062] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T18:31:07.762069] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-07T18:31:07.847721] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-07T18:31:08.070264] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T18:31:08.647740] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-07T18:31:09.447723] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-07T18:31:09.901320] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T18:31:09.919467] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-07T18:31:10.247726] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-07T18:31:10.453154] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T18:31:11.047717] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-07T18:31:11.847717] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-07T18:31:12.078798] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T18:31:12.647669] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-07T18:31:12.654107] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T18:31:12.750372] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T18:31:13.447749] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-07T18:31:13.780116] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-07T18:31:14.184416] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T18:31:14.247681] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-07T18:31:15.047830] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-07T18:31:15.847722] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-07T18:31:16.080954] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T18:31:16.478103] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T18:31:16.647732] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-07T18:31:16.696750] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T18:31:17.447734] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-07T18:31:18.030123] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T18:31:18.247674] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-07T18:31:18.624930] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T18:31:19.047718] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-07T18:31:19.494854] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-07T18:31:19.847739] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-07T18:31:19.967887] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T18:31:20.647727] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-07T18:31:21.447726] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-07T18:31:21.698604] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:31:22.208409] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T18:31:22.247712] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-07T18:31:22.389697] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T18:31:23.019778] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T18:31:23.020637] [INFO ] [REMOTE ] DTB: Full fetch complete (6835 records). [2025-10-07T18:31:23.020735] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-07T18:31:23.047727] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-07T18:31:23.432850] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-07T18:31:23.432959] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-07T18:31:23.433294] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-07T18:31:23.433341] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-07T18:31:23.433879] [DEBUG] [LOCAL ] DTB: Trimmed 6835 records to 4948 (keeping 200 days of data) [2025-10-07T18:31:23.471992] [DEBUG] [LOCAL ] DTB: Primary data saved (4948 records). [2025-10-07T18:31:23.472237] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-07T18:31:23.472352] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 33.5s. Estimated remaining: 3h 57m 44s. Rate: 7.2 symbols/min [2025-10-07T18:31:23.660267] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:31:23.673122] [DEBUG] [LOCAL ] DTG: Loaded 5777 existing records from primary storage. [2025-10-07T18:31:23.673416] [INFO ] [MAIN ] DTG: Loaded 5777 existing records. [2025-10-07T18:31:23.859109] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-07T18:31:23.885758] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:31:23.886487] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-07T18:31:23.886549] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-07T18:31:23.886975] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-07T18:31:23.887039] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-07T18:31:24.289614] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:31:24.647701] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-07T18:31:24.707588] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T18:31:24.711088] [INFO ] [REMOTE ] DT: Full fetch complete (76284 records). [2025-10-07T18:31:24.711229] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-07T18:31:24.712322] [FATAL] [VALIDATOR ] DT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:31:24.712437] [FATAL] [MAIN ] DT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:31:24.712502] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:31:24.712574] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-07T18:31:24.712664] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-07T18:31:24.712724] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-10-07T18:31:24.712925] [DEBUG] [LOCAL ] DT: Deleted derivative data file. [2025-10-07T18:31:24.713042] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 35.6s. Estimated remaining: 3h 57m 17s. Rate: 7.2 symbols/min [2025-10-07T18:31:24.881991] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:31:24.882236] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-07T18:31:24.882287] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-07T18:31:24.882405] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-07T18:31:24.882447] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-07T18:31:24.882495] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-07T18:31:24.882528] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-07T18:31:25.146693] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-07T18:31:25.282727] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:31:25.447801] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-07T18:31:25.624770] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T18:31:25.648309] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:31:25.648566] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-07T18:31:25.648681] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:31:25.648738] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-07T18:31:25.648805] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:31:25.648907] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-07T18:31:25.649020] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-07T18:31:25.649075] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-07T18:31:25.649134] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-07T18:31:25.649201] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTK took 0.9s. Estimated remaining: 3h 56m 50s. Rate: 7.2 symbols/min [2025-10-07T18:31:25.814433] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:31:25.814598] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-07T18:31:25.814676] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-07T18:31:25.814784] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-07T18:31:25.814827] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-07T18:31:25.814868] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-07T18:31:25.814900] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-07T18:31:26.160250] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:31:26.247606] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-07T18:31:27.047732] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-07T18:31:27.847789] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-07T18:31:28.142371] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T18:31:28.369254] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-07T18:31:28.647745] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-07T18:31:28.729197] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T18:31:29.447723] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-07T18:31:29.618059] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T18:31:29.716729] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-07T18:31:30.247751] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-07T18:31:31.047711] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-07T18:31:31.493838] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T18:31:31.847736] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-07T18:31:32.017568] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T18:31:32.269137] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-07T18:31:32.647724] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-07T18:31:33.072810] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-07T18:31:33.447743] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-07T18:31:33.962820] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T18:31:33.963586] [INFO ] [REMOTE ] DTF: Full fetch complete (1971 records). [2025-10-07T18:31:33.963688] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-07T18:31:34.150595] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-07T18:31:34.150850] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:31:34.150919] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:31:34.150992] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-07T18:31:34.151061] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-07T18:31:34.151097] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-07T18:31:34.151137] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-07T18:31:34.151195] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTF took 27.8s. Estimated remaining: 3h 56m 42s. Rate: 7.2 symbols/min [2025-10-07T18:31:34.254406] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-07T18:31:34.341562] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:31:34.341821] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-07T18:31:34.341865] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-07T18:31:34.341943] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-07T18:31:34.341981] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-07T18:31:34.342023] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-07T18:31:34.342057] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-07T18:31:34.702961] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:31:35.047721] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-07T18:31:35.847738] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-07T18:31:35.881537] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T18:31:35.884465] [INFO ] [REMOTE ] DTE: Full fetch complete (68494 records). [2025-10-07T18:31:35.884563] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-07T18:31:35.885363] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:31:35.885459] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:31:35.885527] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:31:35.885584] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-07T18:31:35.885748] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-07T18:31:35.886004] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-10-07T18:31:35.886329] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-10-07T18:31:35.886441] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 41.7s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-07T18:31:36.038949] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T18:31:36.073448] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:31:36.130522] [DEBUG] [LOCAL ] DUK: Loaded 53450 existing records from primary storage. [2025-10-07T18:31:36.130907] [INFO ] [MAIN ] DUK: Loaded 53450 existing records. [2025-10-07T18:31:36.303897] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:31:36.304129] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-07T18:31:36.304177] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-07T18:31:36.306310] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-07T18:31:36.306375] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-07T18:31:36.658864] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-07T18:31:36.665150] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:31:37.301204] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T18:31:37.457574] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-07T18:31:37.463395] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T18:31:38.247747] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-07T18:31:38.701079] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-07T18:31:39.047813] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-07T18:31:39.242746] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T18:31:39.643348] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T18:31:39.847743] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-07T18:31:40.647767] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-07T18:31:41.318188] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T18:31:41.447693] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-07T18:31:41.644134] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T18:31:42.058392] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T18:31:42.247806] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-07T18:31:43.047742] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-07T18:31:43.119821] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T18:31:43.702111] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T18:31:43.847866] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-07T18:31:44.647742] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-07T18:31:45.319090] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-07T18:31:45.447867] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-07T18:31:45.602429] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T18:31:46.247706] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-07T18:31:47.047719] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-07T18:31:47.416488] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T18:31:47.548851] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-07T18:31:47.847737] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-07T18:31:48.258635] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T18:31:48.647946] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-07T18:31:49.309514] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T18:31:49.352587] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T18:31:49.447727] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-07T18:31:50.247720] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-07T18:31:50.983497] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T18:31:51.047701] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-07T18:31:51.100995] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T18:31:51.595726] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T18:31:51.847716] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-07T18:31:52.647741] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-07T18:31:53.246895] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-07T18:31:53.447710] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-07T18:31:53.887318] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T18:31:53.888692] [INFO ] [REMOTE ] DTW: Full fetch complete (7467 records). [2025-10-07T18:31:53.888785] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-07T18:31:54.249159] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-07T18:31:54.353235] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-07T18:31:54.353582] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-07T18:31:54.354163] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-07T18:31:54.354625] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-07T18:31:54.356853] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-07T18:31:54.371745] [DEBUG] [LOCAL ] DTW: Trimmed 7467 records to 4907 (keeping 200 days of data) [2025-10-07T18:31:54.404160] [DEBUG] [LOCAL ] DTW: Primary data saved (4907 records). [2025-10-07T18:31:54.404317] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-07T18:31:54.404397] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTW took 20.3s. Estimated remaining: 3h 56m 35s. Rate: 7.2 symbols/min [2025-10-07T18:31:54.574744] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:31:54.583365] [DEBUG] [LOCAL ] DUKB: Loaded 6368 existing records from primary storage. [2025-10-07T18:31:54.583726] [INFO ] [MAIN ] DUKB: Loaded 6368 existing records. [2025-10-07T18:31:54.762604] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:31:54.762850] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-07T18:31:54.762898] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-07T18:31:54.763221] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-07T18:31:54.763282] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-07T18:31:55.047733] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-07T18:31:55.058891] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T18:31:55.143861] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:31:55.847734] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-07T18:31:56.390760] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-07T18:31:56.570136] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T18:31:56.647713] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-07T18:31:57.447754] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-07T18:31:58.034225] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T18:31:58.247638] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-07T18:31:58.421741] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T18:31:58.911841] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-07T18:31:59.047774] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-07T18:31:59.784770] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T18:31:59.847737] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-07T18:32:00.647715] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-07T18:32:01.447704] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-07T18:32:01.832390] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T18:32:01.906269] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T18:32:02.089850] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T18:32:02.247711] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-07T18:32:02.849424] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T18:32:03.047734] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-07T18:32:03.836696] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T18:32:03.847633] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-07T18:32:04.511595] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T18:32:04.512943] [INFO ] [REMOTE ] DTG: Full fetch complete (8875 records). [2025-10-07T18:32:04.513231] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-07T18:32:04.513822] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:32:04.513914] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:32:04.513960] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:32:04.514298] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-07T18:32:04.514408] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-07T18:32:04.514527] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-07T18:32:04.514881] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-10-07T18:32:04.514996] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTG took 41.0s. Estimated remaining: 3h 56m 31s. Rate: 7.2 symbols/min [2025-10-07T18:32:04.652837] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-07T18:32:04.722968] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:32:04.804417] [DEBUG] [LOCAL ] DV: Loaded 51300 existing records from primary storage. [2025-10-07T18:32:04.805265] [INFO ] [MAIN ] DV: Loaded 51300 existing records. [2025-10-07T18:32:05.038413] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:32:05.038954] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-07T18:32:05.039046] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-07T18:32:05.041020] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-07T18:32:05.041127] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-07T18:32:05.459528] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-07T18:32:05.488284] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:32:06.247738] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-07T18:32:06.625331] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T18:32:06.697617] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T18:32:07.047695] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-07T18:32:07.203986] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T18:32:07.847760] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-07T18:32:08.647695] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-07T18:32:08.711578] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T18:32:08.715100] [INFO ] [REMOTE ] DTM: Full fetch complete (64831 records). [2025-10-07T18:32:08.715430] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-07T18:32:09.136660] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-07T18:32:09.136783] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-07T18:32:09.137593] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-07T18:32:09.137705] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-07T18:32:09.139146] [DEBUG] [LOCAL ] DTM: Trimmed 64831 records to 44092 (keeping 200 days of data) [2025-10-07T18:32:09.443670] [DEBUG] [LOCAL ] DTM: Primary data saved (44092 records). [2025-10-07T18:32:09.443829] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-07T18:32:09.443910] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTM took 43.8s. Estimated remaining: 3h 56m 14s. Rate: 7.2 symbols/min [2025-10-07T18:32:09.455377] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-07T18:32:09.626826] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:32:09.664522] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T18:32:09.717174] [DEBUG] [LOCAL ] DVA: Loaded 41094 existing records from primary storage. [2025-10-07T18:32:09.717591] [INFO ] [MAIN ] DVA: Loaded 41094 existing records. [2025-10-07T18:32:09.897259] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:32:09.897533] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-07T18:32:09.897594] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-07T18:32:09.898572] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-07T18:32:09.898635] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-07T18:32:10.267672] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-07T18:32:10.277062] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T18:32:10.275776] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:32:10.496127] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T18:32:11.047718] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-07T18:32:11.847673] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-07T18:32:12.064262] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T18:32:12.647669] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-07T18:32:12.738598] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T18:32:13.384772] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T18:32:13.445955] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T18:32:13.454792] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-07T18:32:14.207556] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T18:32:14.247670] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-07T18:32:15.047749] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-07T18:32:15.687394] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-07T18:32:15.719327] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T18:32:15.847737] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-07T18:32:16.647750] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-07T18:32:17.381542] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T18:32:17.448438] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-07T18:32:17.451389] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T18:32:18.247697] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-07T18:32:19.047731] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-07T18:32:19.586093] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-07T18:32:19.800106] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T18:32:19.801631] [INFO ] [REMOTE ] DUKB: Full fetch complete (9419 records). [2025-10-07T18:32:19.801754] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-07T18:32:19.855189] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-07T18:32:20.030257] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T18:32:20.233009] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-07T18:32:20.233105] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-07T18:32:20.233333] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-07T18:32:20.233375] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-07T18:32:20.233903] [DEBUG] [LOCAL ] DUKB: Trimmed 9419 records to 6365 (keeping 200 days of data) [2025-10-07T18:32:20.273384] [DEBUG] [LOCAL ] DUKB: Primary data saved (6365 records). [2025-10-07T18:32:20.273524] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-07T18:32:20.273626] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUKB took 25.9s. Estimated remaining: 3h 56m 12s. Rate: 7.2 symbols/min [2025-10-07T18:32:20.444884] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:32:20.495363] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-07T18:32:20.495812] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-07T18:32:20.657903] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-07T18:32:20.680140] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:32:20.681235] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-07T18:32:20.681319] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-07T18:32:20.682991] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-07T18:32:20.683057] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-07T18:32:21.102906] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:32:21.447752] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-07T18:32:21.563608] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T18:32:22.247695] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-07T18:32:22.414551] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-07T18:32:22.417678] [INFO ] [REMOTE ] DUK: Full fetch complete (77010 records). [2025-10-07T18:32:22.417806] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-07T18:32:22.418507] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:32:22.418606] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:32:22.418706] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:32:22.418796] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-07T18:32:22.418897] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-07T18:32:22.418954] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-10-07T18:32:22.419224] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-10-07T18:32:22.419322] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUK took 46.5s. Estimated remaining: 3h 55m 48s. Rate: 7.2 symbols/min [2025-10-07T18:32:22.591588] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:32:22.650079] [DEBUG] [LOCAL ] DX: Loaded 52483 existing records from primary storage. [2025-10-07T18:32:22.650399] [INFO ] [MAIN ] DX: Loaded 52483 existing records. [2025-10-07T18:32:22.835951] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:32:22.836226] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-07T18:32:22.836276] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-07T18:32:22.837870] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-07T18:32:22.837931] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-07T18:32:23.058697] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-07T18:32:23.204033] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:32:23.232265] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:32:23.847734] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-07T18:32:24.074040] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T18:32:24.647740] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-07T18:32:24.797035] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T18:32:25.452937] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-07T18:32:25.465269] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T18:32:26.247698] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-07T18:32:26.903472] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-07T18:32:27.047851] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-07T18:32:27.167584] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T18:32:27.337591] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T18:32:27.847726] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-07T18:32:28.608794] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T18:32:28.647663] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-07T18:32:29.253402] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T18:32:29.447728] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-07T18:32:30.247744] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-07T18:32:30.415593] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T18:32:31.047715] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-07T18:32:31.411929] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-07T18:32:31.465609] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T18:32:31.847698] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-07T18:32:32.328783] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T18:32:32.647729] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-07T18:32:33.452851] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-07T18:32:33.467193] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T18:32:34.193224] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T18:32:34.247693] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-07T18:32:35.047740] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-07T18:32:35.847758] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-07T18:32:36.176588] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T18:32:36.252405] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-10-07T18:32:36.647768] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-07T18:32:36.780118] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T18:32:36.783204] [INFO ] [REMOTE ] DVA: Full fetch complete (59870 records). [2025-10-07T18:32:36.783338] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-07T18:32:37.194062] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-07T18:32:37.194149] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-07T18:32:37.194943] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-07T18:32:37.195010] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-07T18:32:37.196265] [DEBUG] [LOCAL ] DVA: Trimmed 59870 records to 41009 (keeping 200 days of data) [2025-10-07T18:32:37.447948] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-07T18:32:37.447871] [DEBUG] [LOCAL ] DVA: Primary data saved (41009 records). [2025-10-07T18:32:37.448953] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-07T18:32:37.449153] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DVA took 28.0s. Estimated remaining: 3h 55m 57s. Rate: 7.2 symbols/min [2025-10-07T18:32:37.648849] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:32:37.651593] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T18:32:37.706256] [DEBUG] [LOCAL ] DXC: Loaded 49859 existing records from primary storage. [2025-10-07T18:32:37.706571] [INFO ] [MAIN ] DXC: Loaded 49859 existing records. [2025-10-07T18:32:37.884558] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:32:37.884844] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-07T18:32:37.884899] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-07T18:32:37.885216] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-07T18:32:37.885274] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-07T18:32:38.243708] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:32:38.255774] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-07T18:32:38.276052] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T18:32:39.047742] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-07T18:32:39.360031] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T18:32:39.449271] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T18:32:39.847714] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-07T18:32:40.656478] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-07T18:32:40.662847] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:32:40.964999] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T18:32:41.447696] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-07T18:32:42.247710] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-07T18:32:42.439386] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:32:43.047704] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-07T18:32:43.191739] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T18:32:43.729607] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T18:32:43.847716] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-07T18:32:44.647730] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-07T18:32:44.950885] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-07T18:32:45.447470] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T18:32:45.447635] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-07T18:32:46.247699] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-07T18:32:46.423104] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-07T18:32:46.426569] [INFO ] [REMOTE ] DV: Full fetch complete (73585 records). [2025-10-07T18:32:46.426739] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-07T18:32:46.823849] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-07T18:32:46.823989] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-07T18:32:46.825022] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-07T18:32:46.825130] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-07T18:32:46.826821] [DEBUG] [LOCAL ] DV: Trimmed 73585 records to 51295 (keeping 200 days of data) [2025-10-07T18:32:47.048105] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-07T18:32:47.072849] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T18:32:47.190074] [DEBUG] [LOCAL ] DV: Primary data saved (51295 records). [2025-10-07T18:32:47.190243] [INFO ] [MAIN ] DV: Full history saved. [2025-10-07T18:32:47.191213] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DV took 42.7s. Estimated remaining: 3h 55m 53s. Rate: 7.2 symbols/min [2025-10-07T18:32:47.363770] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:32:47.405722] [DEBUG] [LOCAL ] DXYZ: Loaded 36973 existing records from primary storage. [2025-10-07T18:32:47.406051] [INFO ] [MAIN ] DXYZ: Loaded 36973 existing records. [2025-10-07T18:32:47.586366] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:32:47.586788] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-07T18:32:47.586846] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-07T18:32:47.587096] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-07T18:32:47.587153] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-07T18:32:47.855757] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-07T18:32:47.943899] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:32:47.973208] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T18:32:48.647716] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-07T18:32:49.182777] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-07T18:32:49.447803] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-07T18:32:49.678890] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T18:32:50.247718] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-07T18:32:51.047729] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-07T18:32:51.220494] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T18:32:51.270116] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-07T18:32:51.847719] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-07T18:32:52.060361] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T18:32:52.593255] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T18:32:52.647710] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-07T18:32:53.447679] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-07T18:32:53.528594] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T18:32:54.247747] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-07T18:32:54.407088] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T18:32:55.047741] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-07T18:32:55.574239] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T18:32:55.765568] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-07T18:32:55.847682] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-07T18:32:56.647701] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-07T18:32:56.766599] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T18:32:57.064447] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T18:32:57.447712] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-07T18:32:58.247671] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-07T18:32:58.544951] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-07T18:32:59.047695] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-07T18:32:59.130702] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T18:32:59.847724] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-07T18:32:59.902344] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T18:33:00.647755] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-07T18:33:01.385268] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-07T18:33:01.412267] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T18:33:01.415089] [INFO ] [REMOTE ] DXC: Full fetch complete (69228 records). [2025-10-07T18:33:01.415187] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-07T18:33:01.415990] [FATAL] [VALIDATOR ] DXC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:33:01.416079] [FATAL] [MAIN ] DXC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:33:01.416123] [WARN ] [MAIN ] DXC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:33:01.416191] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-07T18:33:01.416257] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-07T18:33:01.416292] [INFO ] [LOCAL ] DXC: Starting deletion of derivative data. [2025-10-07T18:33:01.416527] [DEBUG] [LOCAL ] DXC: Deleted derivative data file. [2025-10-07T18:33:01.416618] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DXC took 24.0s. Estimated remaining: 3h 55m 59s. Rate: 7.2 symbols/min [2025-10-07T18:33:01.452758] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-07T18:33:01.583265] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:33:01.583449] [DEBUG] [LOCAL ] DY: No existing data file found in primary storage. [2025-10-07T18:33:01.583487] [WARN ] [MAIN ] DY: No existing data found, performing full refresh instead. [2025-10-07T18:33:01.583594] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-07T18:33:01.583635] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-07T18:33:01.583720] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-10-07T18:33:01.583759] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-07T18:33:01.930990] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:33:02.247694] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-07T18:33:03.024394] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-07T18:33:03.047618] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-07T18:33:03.272932] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-07T18:33:03.276799] [INFO ] [REMOTE ] DVN: Full fetch complete (77376 records). [2025-10-07T18:33:03.276979] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-07T18:33:03.278118] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:33:03.278219] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:33:03.278267] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:33:03.278314] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-07T18:33:03.278385] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-07T18:33:03.278424] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-07T18:33:03.278740] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-10-07T18:33:03.278863] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DVN took 43.0s. Estimated remaining: 3h 55m 35s. Rate: 7.2 symbols/min [2025-10-07T18:33:03.474549] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:33:03.474766] [DEBUG] [LOCAL ] E: No existing data file found in primary storage. [2025-10-07T18:33:03.474812] [WARN ] [MAIN ] E: No existing data found, performing full refresh instead. [2025-10-07T18:33:03.474979] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-07T18:33:03.475031] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-07T18:33:03.475073] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-07T18:33:03.475106] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-07T18:33:03.829267] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:33:03.849438] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-07T18:33:03.851772] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T18:33:04.647667] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-07T18:33:04.956453] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T18:33:05.381796] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T18:33:05.447706] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-07T18:33:06.035176] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T18:33:06.247717] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-07T18:33:06.659405] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T18:33:07.047719] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-07T18:33:07.657738] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T18:33:07.847704] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-07T18:33:08.348471] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T18:33:08.647716] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-07T18:33:09.447737] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-07T18:33:09.643261] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T18:33:09.647113] [INFO ] [REMOTE ] DX: Full fetch complete (75530 records). [2025-10-07T18:33:09.647241] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-07T18:33:10.129322] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-07T18:33:10.129434] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-07T18:33:10.130381] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-07T18:33:10.130450] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-07T18:33:10.131996] [DEBUG] [LOCAL ] DX: Trimmed 75530 records to 52486 (keeping 200 days of data) [2025-10-07T18:33:10.249310] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-07T18:33:10.479467] [DEBUG] [LOCAL ] DX: Primary data saved (52486 records). [2025-10-07T18:33:10.479688] [INFO ] [MAIN ] DX: Full history saved. [2025-10-07T18:33:10.479823] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DX took 48.1s. Estimated remaining: 3h 55m 23s. Rate: 7.2 symbols/min [2025-10-07T18:33:10.654175] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:33:10.682148] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T18:33:10.729732] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T18:33:10.752523] [DEBUG] [LOCAL ] EAF: Loaded 42328 existing records from primary storage. [2025-10-07T18:33:10.752871] [INFO ] [MAIN ] EAF: Loaded 42328 existing records. [2025-10-07T18:33:10.931267] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:33:10.931547] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-07T18:33:10.931598] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-07T18:33:10.931982] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-07T18:33:10.932039] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-07T18:33:11.052752] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-07T18:33:11.281105] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:33:11.847742] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-07T18:33:11.971168] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T18:33:12.647764] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-07T18:33:12.871333] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T18:33:13.447729] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-07T18:33:13.566713] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T18:33:14.179321] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T18:33:14.247703] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-07T18:33:15.047717] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-07T18:33:15.145866] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T18:33:15.847728] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-07T18:33:15.975454] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T18:33:16.159067] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T18:33:16.647742] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-07T18:33:17.218550] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T18:33:17.447740] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-07T18:33:17.646218] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T18:33:18.247725] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-07T18:33:18.957065] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T18:33:19.047722] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-07T18:33:19.847679] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-07T18:33:20.098412] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T18:33:20.330488] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T18:33:20.647742] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-07T18:33:21.222826] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:33:21.447717] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-07T18:33:22.247682] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-07T18:33:22.636298] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T18:33:22.714980] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-07T18:33:23.047690] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-07T18:33:23.847666] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-07T18:33:23.984617] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T18:33:24.273431] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T18:33:24.647746] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-07T18:33:25.447692] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-07T18:33:25.641559] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T18:33:26.003465] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T18:33:26.247704] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-07T18:33:27.047750] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-07T18:33:27.223558] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T18:33:27.421754] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T18:33:27.847710] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-07T18:33:28.647758] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-07T18:33:28.911068] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-07T18:33:28.918288] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57662 records). [2025-10-07T18:33:28.918589] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-07T18:33:29.450604] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-07T18:33:29.453911] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-07T18:33:29.456994] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T18:33:29.455384] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-07T18:33:29.467163] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-07T18:33:29.468076] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-07T18:33:29.469960] [DEBUG] [LOCAL ] DXYZ: Trimmed 57662 records to 37024 (keeping 200 days of data) [2025-10-07T18:33:29.689227] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T18:33:29.724065] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37024 records). [2025-10-07T18:33:29.724208] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-07T18:33:29.725229] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DXYZ took 42.5s. Estimated remaining: 3h 55m 43s. Rate: 7.2 symbols/min [2025-10-07T18:33:29.894501] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:33:29.903298] [DEBUG] [LOCAL ] EAI: Loaded 3998 existing records from primary storage. [2025-10-07T18:33:29.903534] [INFO ] [MAIN ] EAI: Loaded 3998 existing records. [2025-10-07T18:33:30.078260] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:33:30.078518] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-07T18:33:30.078567] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-07T18:33:30.078812] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-07T18:33:30.078884] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-07T18:33:30.255589] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-07T18:33:30.428708] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:33:31.048620] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-07T18:33:31.050192] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T18:33:31.530127] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T18:33:31.532494] [INFO ] [REMOTE ] E: Full fetch complete (48075 records). [2025-10-07T18:33:31.532574] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-07T18:33:31.852849] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-07T18:33:31.920457] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-07T18:33:31.920533] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-07T18:33:31.921225] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-07T18:33:31.921292] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-07T18:33:31.922367] [DEBUG] [LOCAL ] E: Trimmed 48075 records to 33210 (keeping 200 days of data) [2025-10-07T18:33:32.128785] [DEBUG] [LOCAL ] E: Primary data saved (33210 records). [2025-10-07T18:33:32.128926] [INFO ] [MAIN ] E: Full history saved. [2025-10-07T18:33:32.129003] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. E took 28.8s. Estimated remaining: 3h 55m 19s. Rate: 7.2 symbols/min [2025-10-07T18:33:32.312070] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:33:32.312373] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-10-07T18:33:32.312558] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-10-07T18:33:32.312773] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-07T18:33:32.312883] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-07T18:33:32.313024] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-07T18:33:32.313098] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-07T18:33:32.640355] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T18:33:32.648341] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-07T18:33:32.651372] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T18:33:32.738301] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:33:33.282269] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T18:33:33.447720] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-07T18:33:34.247766] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-07T18:33:34.956661] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T18:33:35.047754] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-07T18:33:35.356166] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T18:33:35.358287] [INFO ] [REMOTE ] DY: Full fetch complete (43994 records). [2025-10-07T18:33:35.358393] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-07T18:33:35.730327] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-07T18:33:35.730454] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-07T18:33:35.731073] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-07T18:33:35.731154] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-07T18:33:35.732275] [DEBUG] [LOCAL ] DY: Trimmed 43994 records to 28615 (keeping 200 days of data) [2025-10-07T18:33:35.847771] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-07T18:33:35.916092] [DEBUG] [LOCAL ] DY: Primary data saved (28615 records). [2025-10-07T18:33:35.916251] [INFO ] [MAIN ] DY: Full history saved. [2025-10-07T18:33:35.916380] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. DY took 34.5s. Estimated remaining: 3h 54m 60s. Rate: 7.2 symbols/min [2025-10-07T18:33:36.118933] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:33:36.167728] [DEBUG] [LOCAL ] EAT: Loaded 49806 existing records from primary storage. [2025-10-07T18:33:36.168217] [INFO ] [MAIN ] EAT: Loaded 49806 existing records. [2025-10-07T18:33:36.350110] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:33:36.369324] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-07T18:33:36.369418] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-07T18:33:36.371317] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-07T18:33:36.371247] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T18:33:36.371506] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-07T18:33:36.486715] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T18:33:36.652965] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-07T18:33:36.747737] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:33:37.298467] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T18:33:37.447699] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-07T18:33:38.027561] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-07T18:33:38.247635] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-07T18:33:38.910043] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-07T18:33:39.047715] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-07T18:33:39.598204] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-07T18:33:39.847681] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-07T18:33:40.403481] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-07T18:33:40.647722] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-07T18:33:41.447712] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-07T18:33:42.247726] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-07T18:33:42.311153] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T18:33:42.910714] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T18:33:42.933129] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T18:33:43.047698] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-07T18:33:43.628336] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T18:33:43.847692] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-07T18:33:44.387175] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T18:33:44.388408] [INFO ] [REMOTE ] EAI: Full fetch complete (6151 records). [2025-10-07T18:33:44.388494] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-07T18:33:44.654163] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-07T18:33:44.843700] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-07T18:33:44.843793] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-07T18:33:44.843987] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-07T18:33:44.844028] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-07T18:33:44.844415] [DEBUG] [LOCAL ] EAI: Trimmed 6151 records to 3998 (keeping 200 days of data) [2025-10-07T18:33:44.874817] [DEBUG] [LOCAL ] EAI: Primary data saved (3998 records). [2025-10-07T18:33:44.874910] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-07T18:33:44.875026] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAI took 15.1s. Estimated remaining: 3h 54m 53s. Rate: 7.2 symbols/min [2025-10-07T18:33:45.084067] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:33:45.131148] [DEBUG] [LOCAL ] EB: Loaded 36985 existing records from primary storage. [2025-10-07T18:33:45.131477] [INFO ] [MAIN ] EB: Loaded 36985 existing records. [2025-10-07T18:33:45.336417] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:33:45.336689] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-07T18:33:45.336749] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-07T18:33:45.337010] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-07T18:33:45.337068] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-07T18:33:45.452918] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-07T18:33:45.704709] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:33:46.247705] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-07T18:33:46.718047] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-07T18:33:47.047716] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-07T18:33:47.405229] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T18:33:47.847730] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-07T18:33:47.927853] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T18:33:48.408606] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T18:33:48.647749] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-07T18:33:49.447757] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-07T18:33:49.579567] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T18:33:50.249982] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-07T18:33:50.252365] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T18:33:51.047756] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-07T18:33:51.277942] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T18:33:51.346693] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T18:33:51.847719] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-07T18:33:52.472843] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T18:33:52.647733] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-07T18:33:52.960347] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T18:33:52.963439] [INFO ] [REMOTE ] EAF: Full fetch complete (63301 records). [2025-10-07T18:33:52.963608] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-07T18:33:53.394007] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-07T18:33:53.394166] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-07T18:33:53.395495] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-07T18:33:53.395585] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-07T18:33:53.397927] [DEBUG] [LOCAL ] EAF: Trimmed 63301 records to 42243 (keeping 200 days of data) [2025-10-07T18:33:53.452514] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-07T18:33:53.681855] [DEBUG] [LOCAL ] EAF: Primary data saved (42243 records). [2025-10-07T18:33:53.682078] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-07T18:33:53.682215] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAF took 43.2s. Estimated remaining: 3h 54m 46s. Rate: 7.2 symbols/min [2025-10-07T18:33:53.839398] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T18:33:54.247747] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-07T18:33:54.616360] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T18:33:55.047723] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-07T18:33:55.380363] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T18:33:55.847746] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-07T18:33:56.245497] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T18:33:56.647753] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-07T18:33:56.886784] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T18:33:57.447760] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-07T18:33:58.247697] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-07T18:33:58.691082] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T18:33:58.963507] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T18:33:59.047731] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-07T18:33:59.406895] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T18:33:59.847748] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-07T18:34:00.490996] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T18:34:00.647745] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-07T18:34:01.451869] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-07T18:34:01.827363] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T18:34:01.873517] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T18:34:01.876199] [INFO ] [REMOTE ] EARN: Full fetch complete (45803 records). [2025-10-07T18:34:01.876291] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-07T18:34:02.260757] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-07T18:34:02.279437] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-07T18:34:02.279512] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-07T18:34:02.280511] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-07T18:34:02.280707] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-07T18:34:02.282145] [DEBUG] [LOCAL ] EARN: Trimmed 45803 records to 29238 (keeping 200 days of data) [2025-10-07T18:34:02.481338] [DEBUG] [LOCAL ] EARN: Primary data saved (29238 records). [2025-10-07T18:34:02.481554] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-07T18:34:02.481731] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 30.4s. Estimated remaining: 3h 54m 39s. Rate: 7.2 symbols/min [2025-10-07T18:34:02.849785] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T18:34:03.047750] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-07T18:34:04.335193] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-07T18:34:04.347383] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-07T18:34:04.600611] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T18:34:04.647738] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-07T18:34:06.150097] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T18:34:06.177063] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-07T18:34:06.193931] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T18:34:06.247781] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-07T18:34:07.566487] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T18:34:07.576502] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-07T18:34:08.096785] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T18:34:08.108585] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-07T18:34:08.655634] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T18:34:08.658300] [INFO ] [REMOTE ] EB: Full fetch complete (55704 records). [2025-10-07T18:34:08.658437] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-07T18:34:08.661187] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:34:08.661392] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:34:08.661465] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:34:08.661532] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-07T18:34:08.661624] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-07T18:34:08.661712] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-07T18:34:08.661960] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-10-07T18:34:08.662073] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EB took 23.8s. Estimated remaining: 3h 54m 25s. Rate: 7.2 symbols/min [2025-10-07T18:34:09.895128] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T18:34:09.905610] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-07T18:34:11.824617] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T18:34:11.838742] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-07T18:34:13.388404] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T18:34:13.391846] [INFO ] [REMOTE ] EAT: Full fetch complete (72098 records). [2025-10-07T18:34:13.391958] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-07T18:34:13.779924] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-07T18:34:13.780045] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-07T18:34:13.780865] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-07T18:34:13.780970] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-07T18:34:13.782494] [DEBUG] [LOCAL ] EAT: Trimmed 72098 records to 49804 (keeping 200 days of data) [2025-10-07T18:34:14.088444] [DEBUG] [LOCAL ] EAT: Primary data saved (49804 records). [2025-10-07T18:34:14.088595] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-07T18:34:14.088705] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EAT took 38.2s. Estimated remaining: 3h 54m 10s. Rate: 7.2 symbols/min [2025-10-07T18:34:14.734270] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:34:14.706372] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:34:14.739621] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-07T18:34:14.739789] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-07T18:34:14.732579] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:34:14.750247] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-07T18:34:14.764890] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-07T18:34:14.774015] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-07T18:34:14.794325] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-07T18:34:14.798075] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-07T18:34:14.797969] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-07T18:34:14.798188] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-07T18:34:14.797616] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:34:14.798315] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-07T18:34:14.828508] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-07T18:34:14.839693] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-07T18:34:15.094473] [DEBUG] [LOCAL ] EBF: Loaded 19101 existing records from primary storage. [2025-10-07T18:34:15.133500] [INFO ] [MAIN ] EBF: Loaded 19101 existing records. [2025-10-07T18:34:15.156237] [DEBUG] [LOCAL ] EBR: Loaded 43038 existing records from primary storage. [2025-10-07T18:34:15.237308] [INFO ] [MAIN ] EBR: Loaded 43038 existing records. [2025-10-07T18:34:15.769199] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:34:15.807765] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:34:15.844083] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-07T18:34:15.855318] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-07T18:34:15.868836] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-07T18:34:15.892718] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-07T18:34:15.903691] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-07T18:34:16.013930] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:34:16.060790] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-07T18:34:16.089854] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:34:16.101385] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-07T18:34:16.116990] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-07T18:34:16.127325] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-07T18:34:16.127495] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-07T18:34:16.667753] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:34:16.681976] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-07T18:34:16.787221] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:34:16.787597] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-07T18:34:18.080199] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T18:34:18.085481] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-07T18:34:18.087893] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-07T18:34:18.099776] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-07T18:34:18.142325] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-07T18:34:18.152092] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-07T18:34:18.605311] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T18:34:18.615282] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-07T18:34:19.077540] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T18:34:19.081371] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-07T18:34:19.510139] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T18:34:19.519180] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-07T18:34:19.554197] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T18:34:19.564069] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-07T18:34:19.838719] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T18:34:19.847808] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-07T18:34:20.269195] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T18:34:20.273676] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-07T18:34:21.123941] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T18:34:21.132951] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-07T18:34:21.200898] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T18:34:21.228756] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T18:34:21.388386] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T18:34:21.447704] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-07T18:34:22.247749] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-07T18:34:22.466430] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T18:34:23.047767] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-07T18:34:23.203299] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T18:34:23.250898] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-07T18:34:23.847715] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-07T18:34:24.655851] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-07T18:34:24.663187] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T18:34:24.890747] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T18:34:25.447729] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-07T18:34:26.247725] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-07T18:34:26.335628] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T18:34:27.047671] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-07T18:34:27.154733] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T18:34:27.207450] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T18:34:27.847725] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-07T18:34:28.647725] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-07T18:34:29.005746] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T18:34:29.092408] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-07T18:34:29.447717] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-07T18:34:30.247720] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-07T18:34:30.416866] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T18:34:30.656120] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T18:34:31.047742] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-07T18:34:31.847765] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-07T18:34:31.896466] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T18:34:32.647694] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-07T18:34:32.703028] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T18:34:32.823888] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T18:34:33.447783] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-07T18:34:34.049287] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T18:34:34.247699] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-07T18:34:34.397376] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T18:34:34.399242] [INFO ] [REMOTE ] EBF: Full fetch complete (27563 records). [2025-10-07T18:34:34.399314] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-07T18:34:34.754212] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-07T18:34:34.754292] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-07T18:34:34.754765] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-07T18:34:34.754828] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-07T18:34:34.755496] [DEBUG] [LOCAL ] EBF: Trimmed 27563 records to 19079 (keeping 200 days of data) [2025-10-07T18:34:34.869472] [DEBUG] [LOCAL ] EBF: Primary data saved (19079 records). [2025-10-07T18:34:34.869620] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-07T18:34:34.869737] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 20.8s. Estimated remaining: 3h 54m 32s. Rate: 7.2 symbols/min [2025-10-07T18:34:35.041979] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:34:35.042192] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-10-07T18:34:35.042247] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-10-07T18:34:35.042371] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-07T18:34:35.042413] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-07T18:34:35.042453] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-07T18:34:35.042485] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-07T18:34:35.055026] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-07T18:34:35.386263] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:34:35.839536] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T18:34:35.848396] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-07T18:34:36.647718] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-07T18:34:37.069819] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T18:34:37.216318] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T18:34:37.447760] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-07T18:34:38.296316] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-07T18:34:38.320995] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T18:34:39.047760] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-07T18:34:39.105945] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T18:34:39.611425] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T18:34:39.847722] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-07T18:34:40.647824] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-07T18:34:41.045967] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T18:34:41.122027] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T18:34:41.447714] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-07T18:34:42.202138] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T18:34:42.247691] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-07T18:34:43.047667] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-07T18:34:43.236785] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T18:34:43.307100] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T18:34:43.847675] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-07T18:34:44.427626] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T18:34:44.430942] [INFO ] [REMOTE ] EBS: Full fetch complete (67373 records). [2025-10-07T18:34:44.431052] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-07T18:34:44.652757] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-07T18:34:44.809490] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-07T18:34:44.809580] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-07T18:34:44.810359] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-07T18:34:44.810423] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-07T18:34:44.811867] [DEBUG] [LOCAL ] EBS: Trimmed 67373 records to 46746 (keeping 200 days of data) [2025-10-07T18:34:45.074659] [DEBUG] [LOCAL ] EBS: Primary data saved (46746 records). [2025-10-07T18:34:45.075243] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-07T18:34:45.075425] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBS took 31.0s. Estimated remaining: 3h 54m 29s. Rate: 7.2 symbols/min [2025-10-07T18:34:45.240288] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:34:45.279993] [DEBUG] [LOCAL ] ECC: Loaded 43187 existing records from primary storage. [2025-10-07T18:34:45.280368] [INFO ] [MAIN ] ECC: Loaded 43187 existing records. [2025-10-07T18:34:45.451828] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-07T18:34:45.457247] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:34:45.458565] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-07T18:34:45.458753] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-07T18:34:45.460039] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-07T18:34:45.460100] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-07T18:34:45.769193] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T18:34:45.862218] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:34:45.878471] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T18:34:46.247704] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-07T18:34:46.701065] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T18:34:47.047710] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-07T18:34:47.847736] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-07T18:34:47.932229] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T18:34:48.549988] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T18:34:48.647682] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-07T18:34:49.216293] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T18:34:49.219476] [INFO ] [REMOTE ] EBR: Full fetch complete (62521 records). [2025-10-07T18:34:49.219619] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-07T18:34:49.453792] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-07T18:34:49.646821] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-07T18:34:49.646952] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-07T18:34:49.647887] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-07T18:34:49.647971] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-07T18:34:49.649447] [DEBUG] [LOCAL ] EBR: Trimmed 62521 records to 43045 (keeping 200 days of data) [2025-10-07T18:34:49.917891] [DEBUG] [LOCAL ] EBR: Primary data saved (43045 records). [2025-10-07T18:34:49.918053] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-07T18:34:49.918158] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBR took 35.8s. Estimated remaining: 3h 54m 12s. Rate: 7.2 symbols/min [2025-10-07T18:34:50.086303] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:34:50.086682] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-07T18:34:50.086760] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-07T18:34:50.086905] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-07T18:34:50.087140] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-07T18:34:50.087213] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-07T18:34:50.094865] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-07T18:34:50.171197] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T18:34:50.254328] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-07T18:34:50.468215] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:34:50.751937] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-07T18:34:51.047727] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-07T18:34:51.855476] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-07T18:34:51.858399] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T18:34:52.272264] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-07T18:34:52.647701] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-07T18:34:52.877721] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T18:34:53.447700] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-07T18:34:53.919711] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-07T18:34:54.247746] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-07T18:34:54.513990] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-07T18:34:54.767217] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T18:34:55.047716] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-07T18:34:55.438161] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-07T18:34:55.847711] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-07T18:34:56.647707] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-07T18:34:57.202557] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T18:34:57.447718] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-07T18:34:57.792045] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-07T18:34:58.247722] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-07T18:34:58.337255] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T18:34:59.047750] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-07T18:34:59.765899] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T18:34:59.770428] [INFO ] [REMOTE ] EC: Full fetch complete (71843 records). [2025-10-07T18:34:59.770598] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-07T18:34:59.852816] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-07T18:35:00.160540] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-07T18:35:00.160738] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-07T18:35:00.162162] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-07T18:35:00.162227] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-07T18:35:00.163672] [DEBUG] [LOCAL ] EC: Trimmed 71843 records to 49091 (keeping 200 days of data) [2025-10-07T18:35:00.456249] [DEBUG] [LOCAL ] EC: Primary data saved (49091 records). [2025-10-07T18:35:00.456411] [INFO ] [MAIN ] EC: Full history saved. [2025-10-07T18:35:00.456490] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EC took 46.4s. Estimated remaining: 3h 54m 9s. Rate: 7.2 symbols/min [2025-10-07T18:35:00.580979] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T18:35:00.656017] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-07T18:35:00.658555] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:35:00.659473] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-07T18:35:00.659527] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-07T18:35:00.659632] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-07T18:35:00.659711] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-07T18:35:00.659765] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-07T18:35:00.659799] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-07T18:35:01.005442] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:35:01.403766] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T18:35:01.447629] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-07T18:35:02.183779] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T18:35:02.247740] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-07T18:35:02.881601] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T18:35:03.047714] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-07T18:35:03.530490] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-07T18:35:03.847775] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-07T18:35:04.006871] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T18:35:04.318354] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T18:35:04.647748] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-07T18:35:05.146404] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-07T18:35:05.447752] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-07T18:35:06.016893] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T18:35:06.247742] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-07T18:35:07.047733] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-07T18:35:07.319409] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-07T18:35:07.847675] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-07T18:35:08.011588] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T18:35:08.169100] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-07T18:35:08.647755] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-07T18:35:08.960533] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-07T18:35:09.447722] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-07T18:35:10.041481] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T18:35:10.247733] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-07T18:35:11.047737] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-07T18:35:11.549257] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-07T18:35:11.582405] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T18:35:11.585020] [INFO ] [REMOTE ] ECAT: Full fetch complete (42955 records). [2025-10-07T18:35:11.585134] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-07T18:35:11.852915] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-07T18:35:11.981215] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-07T18:35:11.981316] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-07T18:35:11.981942] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-07T18:35:11.982009] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-07T18:35:11.983180] [DEBUG] [LOCAL ] ECAT: Trimmed 42955 records to 29448 (keeping 200 days of data) [2025-10-07T18:35:12.168193] [DEBUG] [LOCAL ] ECAT: Primary data saved (29448 records). [2025-10-07T18:35:12.168383] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-07T18:35:12.168515] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECAT took 37.3s. Estimated remaining: 3h 54m 9s. Rate: 7.2 symbols/min [2025-10-07T18:35:12.278856] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-07T18:35:12.350617] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:35:12.350826] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-07T18:35:12.350871] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-07T18:35:12.350984] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-07T18:35:12.351027] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-07T18:35:12.351068] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-07T18:35:12.351101] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-07T18:35:12.652902] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-07T18:35:12.721745] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:35:13.447741] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-07T18:35:14.019749] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T18:35:14.020457] [INFO ] [REMOTE ] ECCC: Full fetch complete (1305 records). [2025-10-07T18:35:14.020526] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-07T18:35:14.214858] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-07T18:35:14.215108] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:35:14.215190] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:35:14.215425] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-07T18:35:14.215525] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-07T18:35:14.215611] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-07T18:35:14.215897] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-07T18:35:14.215997] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECCC took 24.3s. Estimated remaining: 3h 53m 45s. Rate: 7.2 symbols/min [2025-10-07T18:35:14.248942] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-07T18:35:14.430600] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:35:14.431972] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T18:35:14.442335] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-07T18:35:14.442621] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-07T18:35:14.443205] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-07T18:35:14.443258] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-07T18:35:14.443302] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-07T18:35:14.443334] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-07T18:35:14.787921] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:35:14.882173] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-07T18:35:15.047714] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-07T18:35:15.547525] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-07T18:35:15.847715] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-07T18:35:16.647719] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-07T18:35:16.989468] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-07T18:35:17.447682] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-07T18:35:17.457743] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T18:35:17.462909] [INFO ] [REMOTE ] ECC: Full fetch complete (60970 records). [2025-10-07T18:35:17.463034] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-07T18:35:17.797318] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-07T18:35:17.953367] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-07T18:35:17.953458] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-07T18:35:17.954327] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-07T18:35:17.954424] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-07T18:35:17.955997] [DEBUG] [LOCAL ] ECC: Trimmed 60970 records to 43086 (keeping 200 days of data) [2025-10-07T18:35:18.247681] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-07T18:35:18.253778] [DEBUG] [LOCAL ] ECC: Primary data saved (43086 records). [2025-10-07T18:35:18.253888] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-07T18:35:18.254910] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECC took 33.2s. Estimated remaining: 3h 53m 26s. Rate: 7.2 symbols/min [2025-10-07T18:35:18.452090] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:35:18.497289] [DEBUG] [LOCAL ] ECG: Loaded 33612 existing records from primary storage. [2025-10-07T18:35:18.497675] [INFO ] [MAIN ] ECG: Loaded 33612 existing records. [2025-10-07T18:35:18.628046] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-07T18:35:18.729459] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:35:18.729761] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-07T18:35:18.729847] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-07T18:35:18.730171] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-07T18:35:18.730255] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-07T18:35:19.048735] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-07T18:35:19.085151] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:35:19.444848] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-07T18:35:19.847710] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-07T18:35:20.513592] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T18:35:20.647758] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-07T18:35:21.447733] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-07T18:35:22.145473] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T18:35:22.247693] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-07T18:35:22.558203] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T18:35:22.652260] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-07T18:35:23.047710] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-07T18:35:23.478496] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-07T18:35:23.847731] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-07T18:35:24.304207] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T18:35:24.647778] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-07T18:35:24.966415] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-07T18:35:25.447724] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-07T18:35:25.779164] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-07T18:35:26.247708] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-07T18:35:26.655611] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-07T18:35:27.047715] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-07T18:35:27.509283] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-07T18:35:27.847720] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-07T18:35:28.416749] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T18:35:28.647698] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-07T18:35:29.447725] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-07T18:35:29.918228] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T18:35:29.919004] [INFO ] [REMOTE ] ECCU: Full fetch complete (4504 records). [2025-10-07T18:35:29.919079] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-07T18:35:30.108112] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T18:35:30.108349] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:35:30.108449] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:35:30.108706] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-07T18:35:30.108921] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-07T18:35:30.109015] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-07T18:35:30.109124] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-10-07T18:35:30.109284] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCU took 29.7s. Estimated remaining: 3h 53m 27s. Rate: 7.2 symbols/min [2025-10-07T18:35:30.248308] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-07T18:35:30.257227] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T18:35:30.348335] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:35:30.348579] [DEBUG] [LOCAL ] ECL: No existing data file found in primary storage. [2025-10-07T18:35:30.348631] [WARN ] [MAIN ] ECL: No existing data found, performing full refresh instead. [2025-10-07T18:35:30.348798] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-07T18:35:30.348868] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-07T18:35:30.348926] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-10-07T18:35:30.348959] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-07T18:35:30.686997] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-07T18:35:30.893945] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:35:31.047761] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-07T18:35:31.315589] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-07T18:35:31.847708] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-07T18:35:32.265379] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-07T18:35:32.647719] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-07T18:35:33.447702] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-07T18:35:34.142702] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T18:35:34.247707] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-07T18:35:35.047689] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-07T18:35:35.121245] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T18:35:35.303959] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-07T18:35:35.690013] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T18:35:35.847688] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-07T18:35:36.225821] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-07T18:35:36.647701] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-07T18:35:37.447711] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-07T18:35:37.799194] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-07T18:35:38.127461] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T18:35:38.247695] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-07T18:35:38.597899] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-07T18:35:39.047743] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-07T18:35:39.596741] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T18:35:39.847705] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-07T18:35:40.647736] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-07T18:35:41.151836] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-07T18:35:41.375976] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T18:35:41.447738] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-07T18:35:42.247761] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-07T18:35:42.612122] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T18:35:43.047722] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-07T18:35:43.847698] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-07T18:35:44.021982] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T18:35:44.231699] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T18:35:44.232490] [INFO ] [REMOTE ] ECCW: Full fetch complete (1409 records). [2025-10-07T18:35:44.232704] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-07T18:35:44.467404] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-07T18:35:44.467898] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:35:44.467979] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:35:44.468124] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-07T18:35:44.476981] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-07T18:35:44.492968] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-07T18:35:44.493812] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T18:35:44.493945] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-07T18:35:44.501194] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCW took 32.3s. Estimated remaining: 3h 53m 33s. Rate: 7.2 symbols/min [2025-10-07T18:35:44.656019] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-07T18:35:44.684747] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:35:44.704375] [DEBUG] [LOCAL ] ECO: Loaded 18421 existing records from primary storage. [2025-10-07T18:35:44.704621] [INFO ] [MAIN ] ECO: Loaded 18421 existing records. [2025-10-07T18:35:44.902288] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:35:44.902512] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-07T18:35:44.902562] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-07T18:35:44.902795] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-07T18:35:44.902855] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-07T18:35:45.193895] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-07T18:35:45.302331] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:35:45.447624] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-07T18:35:46.247726] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-07T18:35:46.631592] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T18:35:46.632350] [INFO ] [REMOTE ] ECCX: Full fetch complete (1484 records). [2025-10-07T18:35:46.632440] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-07T18:35:46.829603] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-07T18:35:46.830068] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:35:46.830196] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:35:46.830340] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-07T18:35:46.830487] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-07T18:35:46.830581] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-07T18:35:46.830720] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-07T18:35:46.831304] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCX took 32.6s. Estimated remaining: 3h 53m 10s. Rate: 7.2 symbols/min [2025-10-07T18:35:47.010725] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:35:47.029299] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T18:35:47.055574] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-07T18:35:47.077225] [DEBUG] [LOCAL ] ECVT: Loaded 43195 existing records from primary storage. [2025-10-07T18:35:47.077565] [INFO ] [MAIN ] ECVT: Loaded 43195 existing records. [2025-10-07T18:35:47.258545] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:35:47.258815] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-07T18:35:47.258865] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-07T18:35:47.259405] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-07T18:35:47.259464] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-07T18:35:47.611301] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:35:47.847714] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-07T18:35:48.384898] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T18:35:48.647730] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-07T18:35:49.447679] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-07T18:35:49.655670] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T18:35:50.247718] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-07T18:35:50.417545] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T18:35:50.797167] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T18:35:51.083431] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-07T18:35:51.098203] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-07T18:35:51.847750] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-07T18:35:52.647748] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-07T18:35:52.810942] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T18:35:53.188915] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T18:35:53.447754] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-07T18:35:53.879861] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T18:35:54.247701] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-07T18:35:55.047729] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-07T18:35:55.243784] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T18:35:55.647337] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T18:35:55.847697] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-07T18:35:56.237811] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T18:35:56.240172] [INFO ] [REMOTE ] ECG: Full fetch complete (51091 records). [2025-10-07T18:35:56.240267] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-07T18:35:56.611877] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-07T18:35:56.611967] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-07T18:35:56.612690] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-07T18:35:56.612760] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-07T18:35:56.614555] [DEBUG] [LOCAL ] ECG: Trimmed 51091 records to 33518 (keeping 200 days of data) [2025-10-07T18:35:56.666155] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-07T18:35:56.818562] [DEBUG] [LOCAL ] ECG: Primary data saved (33518 records). [2025-10-07T18:35:56.818785] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-07T18:35:56.818889] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 38.6s. Estimated remaining: 3h 53m 6s. Rate: 7.2 symbols/min [2025-10-07T18:35:56.993047] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:35:57.062759] [DEBUG] [LOCAL ] ED: Loaded 52735 existing records from primary storage. [2025-10-07T18:35:57.063385] [INFO ] [MAIN ] ED: Loaded 52735 existing records. [2025-10-07T18:35:57.289186] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:35:57.300746] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-07T18:35:57.301377] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-07T18:35:57.302451] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T18:35:57.312112] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-07T18:35:57.312718] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-07T18:35:57.452902] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-07T18:35:57.672875] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:35:57.897039] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-07T18:35:58.247772] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-07T18:35:58.816818] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T18:35:58.945489] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T18:35:59.047749] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-07T18:35:59.847718] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-07T18:36:00.647706] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-07T18:36:01.060068] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T18:36:01.447726] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-07T18:36:01.845588] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T18:36:01.843685] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T18:36:02.247716] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-07T18:36:02.722447] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-07T18:36:03.047694] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-07T18:36:03.699221] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T18:36:03.847702] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-07T18:36:04.437881] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T18:36:04.647696] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-07T18:36:05.447690] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-07T18:36:05.499179] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T18:36:06.247675] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-07T18:36:06.289509] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T18:36:06.547018] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T18:36:07.047682] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-07T18:36:07.847719] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-07T18:36:08.058141] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T18:36:08.481729] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T18:36:08.647678] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-07T18:36:09.001527] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T18:36:09.447698] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-07T18:36:10.158951] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T18:36:10.247632] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-07T18:36:11.047722] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-07T18:36:11.261403] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T18:36:11.847752] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-07T18:36:12.003347] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T18:36:12.048113] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T18:36:12.647699] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-07T18:36:13.451965] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-07T18:36:13.453634] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T18:36:13.457440] [INFO ] [REMOTE ] ECVT: Full fetch complete (60228 records). [2025-10-07T18:36:13.457615] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-07T18:36:13.850028] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T18:36:13.954078] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-07T18:36:13.954183] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-07T18:36:13.954984] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-07T18:36:13.955053] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-07T18:36:13.956479] [DEBUG] [LOCAL ] ECVT: Trimmed 60228 records to 43236 (keeping 200 days of data) [2025-10-07T18:36:14.211664] [DEBUG] [LOCAL ] ECVT: Primary data saved (43236 records). [2025-10-07T18:36:14.211889] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-07T18:36:14.212020] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECVT took 27.4s. Estimated remaining: 3h 53m 20s. Rate: 7.2 symbols/min [2025-10-07T18:36:14.254168] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-07T18:36:14.390329] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:36:14.418143] [DEBUG] [LOCAL ] EDD: Loaded 27034 existing records from primary storage. [2025-10-07T18:36:14.418401] [INFO ] [MAIN ] EDD: Loaded 27034 existing records. [2025-10-07T18:36:14.592933] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:36:14.593163] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-07T18:36:14.593223] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-07T18:36:14.593443] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-07T18:36:14.593500] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-07T18:36:14.942299] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:36:15.047631] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-07T18:36:15.417297] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T18:36:15.847746] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-07T18:36:15.878870] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T18:36:16.647729] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-07T18:36:16.680728] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T18:36:17.447676] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-07T18:36:17.583852] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T18:36:17.586300] [INFO ] [REMOTE ] ECO: Full fetch complete (28729 records). [2025-10-07T18:36:17.586382] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-07T18:36:18.022010] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-07T18:36:18.021904] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-07T18:36:18.032429] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-07T18:36:18.033473] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-07T18:36:18.033707] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-07T18:36:18.035003] [DEBUG] [LOCAL ] ECO: Trimmed 28729 records to 18390 (keeping 200 days of data) [2025-10-07T18:36:18.149426] [DEBUG] [LOCAL ] ECO: Primary data saved (18390 records). [2025-10-07T18:36:18.149580] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-07T18:36:18.149684] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECO took 33.6s. Estimated remaining: 3h 53m 1s. Rate: 7.2 symbols/min [2025-10-07T18:36:18.251712] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-07T18:36:18.321870] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:36:18.337352] [DEBUG] [LOCAL ] EDF: Loaded 13267 existing records from primary storage. [2025-10-07T18:36:18.337624] [INFO ] [MAIN ] EDF: Loaded 13267 existing records. [2025-10-07T18:36:18.517597] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:36:18.517822] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-07T18:36:18.517871] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-07T18:36:18.518115] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-07T18:36:18.518173] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-07T18:36:18.657751] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T18:36:18.886665] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:36:19.047676] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-07T18:36:19.847687] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-07T18:36:20.031783] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T18:36:20.306906] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T18:36:20.647739] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-07T18:36:21.447633] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-07T18:36:21.555699] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T18:36:21.562531] [INFO ] [REMOTE ] ECL: Full fetch complete (68012 records). [2025-10-07T18:36:21.562717] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-07T18:36:21.959609] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-07T18:36:21.959738] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-07T18:36:21.960518] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-07T18:36:21.960579] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-07T18:36:21.962181] [DEBUG] [LOCAL ] ECL: Trimmed 68012 records to 46705 (keeping 200 days of data) [2025-10-07T18:36:22.249354] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-07T18:36:22.263423] [DEBUG] [LOCAL ] ECL: Primary data saved (46705 records). [2025-10-07T18:36:22.263526] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-07T18:36:22.263615] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECL took 52.2s. Estimated remaining: 3h 52m 42s. Rate: 7.2 symbols/min [2025-10-07T18:36:22.441132] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:36:22.459933] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T18:36:22.501994] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T18:36:22.520473] [DEBUG] [LOCAL ] EDN: Loaded 18203 existing records from primary storage. [2025-10-07T18:36:22.520981] [INFO ] [MAIN ] EDN: Loaded 18203 existing records. [2025-10-07T18:36:22.752720] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:36:22.752980] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-07T18:36:22.753053] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-07T18:36:22.753308] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-07T18:36:22.753368] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-07T18:36:23.053413] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-07T18:36:23.268138] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:36:23.286703] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T18:36:23.847721] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-07T18:36:24.350307] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T18:36:24.647697] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-07T18:36:25.300901] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T18:36:25.447671] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-07T18:36:25.669848] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T18:36:26.247716] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-07T18:36:27.047710] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-07T18:36:27.578588] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T18:36:27.847697] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-07T18:36:28.072145] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:36:28.647683] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-07T18:36:28.660778] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T18:36:29.447744] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-07T18:36:30.247626] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-07T18:36:30.346979] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T18:36:30.465426] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T18:36:30.673820] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (5.23 seconds). [2025-10-07T18:36:31.047671] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-07T18:36:31.422791] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T18:36:31.847707] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-07T18:36:32.647673] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-07T18:36:32.783377] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-07T18:36:32.788257] [INFO ] [REMOTE ] ED: Full fetch complete (76319 records). [2025-10-07T18:36:32.788503] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-07T18:36:33.199553] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T18:36:33.245464] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-07T18:36:33.245559] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-07T18:36:33.246582] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-07T18:36:33.246676] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-07T18:36:33.248358] [DEBUG] [LOCAL ] ED: Trimmed 76319 records to 52726 (keeping 200 days of data) [2025-10-07T18:36:33.363747] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T18:36:33.454162] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-07T18:36:33.599096] [DEBUG] [LOCAL ] ED: Primary data saved (52726 records). [2025-10-07T18:36:33.599250] [INFO ] [MAIN ] ED: Full history saved. [2025-10-07T18:36:33.600226] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. ED took 36.8s. Estimated remaining: 3h 52m 41s. Rate: 7.2 symbols/min [2025-10-07T18:36:33.773139] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:36:33.816332] [DEBUG] [LOCAL ] EDU: Loaded 44860 existing records from primary storage. [2025-10-07T18:36:33.816678] [INFO ] [MAIN ] EDU: Loaded 44860 existing records. [2025-10-07T18:36:33.992363] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:36:33.992564] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-07T18:36:33.992611] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-07T18:36:33.992856] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-07T18:36:33.992912] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-07T18:36:34.252762] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-07T18:36:34.358621] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:36:34.418740] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-07T18:36:35.047683] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-07T18:36:35.157553] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T18:36:35.539779] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-07T18:36:35.847701] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-07T18:36:36.647683] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-07T18:36:36.679786] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T18:36:37.447768] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-07T18:36:37.943050] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T18:36:38.218058] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T18:36:38.219271] [INFO ] [REMOTE ] EDF: Full fetch complete (20663 records). [2025-10-07T18:36:38.219344] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-07T18:36:38.252857] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-07T18:36:38.580702] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-07T18:36:38.580794] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-07T18:36:38.581241] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-07T18:36:38.581282] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-07T18:36:38.581891] [DEBUG] [LOCAL ] EDF: Trimmed 20663 records to 13197 (keeping 200 days of data) [2025-10-07T18:36:38.657485] [DEBUG] [LOCAL ] EDF: Primary data saved (13197 records). [2025-10-07T18:36:38.657691] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-07T18:36:38.657791] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDF took 20.5s. Estimated remaining: 3h 52m 25s. Rate: 7.2 symbols/min [2025-10-07T18:36:38.830567] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:36:38.869430] [DEBUG] [LOCAL ] EE: Loaded 32610 existing records from primary storage. [2025-10-07T18:36:38.869740] [INFO ] [MAIN ] EE: Loaded 32610 existing records. [2025-10-07T18:36:39.047754] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:36:39.047912] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-07T18:36:39.048449] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-07T18:36:39.048563] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-07T18:36:39.050144] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-07T18:36:39.050209] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-07T18:36:39.407469] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:36:39.701050] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T18:36:39.847739] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-07T18:36:40.492243] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T18:36:40.647693] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-07T18:36:40.717143] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T18:36:41.447628] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-07T18:36:41.826469] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T18:36:42.247687] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-07T18:36:42.269747] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T18:36:43.047637] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-07T18:36:43.483956] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T18:36:43.847727] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-07T18:36:44.113914] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T18:36:44.647758] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-07T18:36:45.447667] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-07T18:36:45.536776] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T18:36:45.652150] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-07T18:36:46.247639] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-07T18:36:46.311536] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T18:36:47.047701] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-07T18:36:47.847686] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-07T18:36:48.024854] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T18:36:48.097529] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T18:36:48.099762] [INFO ] [REMOTE ] EDD: Full fetch complete (38668 records). [2025-10-07T18:36:48.099848] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-07T18:36:48.488101] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-07T18:36:48.488292] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-07T18:36:48.488904] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-07T18:36:48.489025] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-07T18:36:48.490016] [DEBUG] [LOCAL ] EDD: Trimmed 38668 records to 27101 (keeping 200 days of data) [2025-10-07T18:36:48.647765] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-07T18:36:48.655149] [DEBUG] [LOCAL ] EDD: Primary data saved (27101 records). [2025-10-07T18:36:48.655351] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-07T18:36:48.655493] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDD took 34.4s. Estimated remaining: 3h 52m 20s. Rate: 7.2 symbols/min [2025-10-07T18:36:48.822737] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:36:48.823032] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-07T18:36:48.823126] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-07T18:36:48.823291] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-07T18:36:48.823336] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-07T18:36:48.823378] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-07T18:36:48.823409] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-07T18:36:49.193465] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:36:49.210924] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T18:36:49.447638] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-07T18:36:49.680511] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T18:36:50.247743] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-07T18:36:50.978742] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T18:36:51.047695] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-07T18:36:51.232571] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T18:36:51.847721] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-07T18:36:52.391239] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T18:36:52.647777] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-07T18:36:53.447711] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-07T18:36:53.496236] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T18:36:53.662476] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T18:36:54.247625] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-07T18:36:54.705478] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T18:36:54.718671] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-07T18:36:55.047664] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-07T18:36:55.847704] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-07T18:36:56.100088] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T18:36:56.647766] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-07T18:36:57.426334] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T18:36:57.447625] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-07T18:36:57.665239] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T18:36:58.247762] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-07T18:36:58.713353] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-07T18:36:58.726008] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-07T18:36:59.047678] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-07T18:36:59.847695] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-07T18:37:00.292010] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T18:37:00.647739] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-07T18:37:01.167158] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-07T18:37:01.415847] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T18:37:01.447624] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-07T18:37:02.247691] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-07T18:37:02.989067] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T18:37:03.047623] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-07T18:37:03.292057] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T18:37:03.847734] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-07T18:37:04.647666] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-07T18:37:04.877875] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T18:37:04.961002] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T18:37:05.447700] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-07T18:37:05.763813] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T18:37:05.766355] [INFO ] [REMOTE ] EE: Full fetch complete (43701 records). [2025-10-07T18:37:05.766621] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-07T18:37:06.166541] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-07T18:37:06.166628] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-07T18:37:06.167485] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-07T18:37:06.167595] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-07T18:37:06.172399] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-07T18:37:06.174721] [DEBUG] [LOCAL ] EE: Trimmed 43701 records to 32733 (keeping 200 days of data) [2025-10-07T18:37:06.265812] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-07T18:37:06.385543] [DEBUG] [LOCAL ] EE: Primary data saved (32733 records). [2025-10-07T18:37:06.385742] [INFO ] [MAIN ] EE: Full history saved. [2025-10-07T18:37:06.385847] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EE took 27.7s. Estimated remaining: 3h 52m 35s. Rate: 7.2 symbols/min [2025-10-07T18:37:06.548936] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:37:06.561149] [DEBUG] [LOCAL ] EEX: Loaded 11058 existing records from primary storage. [2025-10-07T18:37:06.561362] [INFO ] [MAIN ] EEX: Loaded 11058 existing records. [2025-10-07T18:37:06.734132] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:37:06.734349] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-07T18:37:06.734397] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-07T18:37:06.734610] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-07T18:37:06.734700] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-07T18:37:06.816097] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-07T18:37:07.052775] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-07T18:37:07.089278] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:37:07.847684] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-07T18:37:08.636095] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T18:37:08.647619] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-07T18:37:09.123370] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T18:37:09.447692] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-07T18:37:09.940900] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T18:37:09.988597] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T18:37:10.247669] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-07T18:37:10.827457] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-07T18:37:11.047724] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-07T18:37:11.519749] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-07T18:37:11.847699] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-07T18:37:12.647700] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-07T18:37:13.131517] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-07T18:37:13.361987] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T18:37:13.365561] [INFO ] [REMOTE ] EDU: Full fetch complete (66432 records). [2025-10-07T18:37:13.365759] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-07T18:37:13.452854] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-07T18:37:13.814078] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-07T18:37:13.814171] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-07T18:37:13.814990] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-07T18:37:13.815057] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-07T18:37:13.816549] [DEBUG] [LOCAL ] EDU: Trimmed 66432 records to 44805 (keeping 200 days of data) [2025-10-07T18:37:14.076690] [DEBUG] [LOCAL ] EDU: Primary data saved (44805 records). [2025-10-07T18:37:14.076829] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-07T18:37:14.077774] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EDU took 40.5s. Estimated remaining: 3h 52m 25s. Rate: 7.2 symbols/min [2025-10-07T18:37:14.254591] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:37:14.249999] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-07T18:37:14.255629] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-07T18:37:14.255715] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-07T18:37:14.255838] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-07T18:37:14.255881] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-07T18:37:14.255924] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-07T18:37:14.255957] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-07T18:37:14.629565] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T18:37:14.720263] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:37:14.722223] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T18:37:14.722999] [INFO ] [REMOTE ] EEA: Full fetch complete (3884 records). [2025-10-07T18:37:14.723396] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-07T18:37:14.723799] [FATAL] [VALIDATOR ] EEA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:37:14.723897] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:37:14.724008] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:37:14.724103] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-07T18:37:14.724189] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-07T18:37:14.724227] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-07T18:37:14.724500] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-07T18:37:14.724724] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EEA took 26.1s. Estimated remaining: 3h 51m 58s. Rate: 7.2 symbols/min [2025-10-07T18:37:14.903716] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:37:14.903937] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-10-07T18:37:14.903975] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-10-07T18:37:14.904114] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-07T18:37:14.904193] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-07T18:37:14.904256] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-10-07T18:37:14.904292] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-07T18:37:15.054239] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-07T18:37:15.386344] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:37:15.847703] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-07T18:37:16.158974] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T18:37:16.647615] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-07T18:37:16.876274] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T18:37:16.878426] [INFO ] [REMOTE ] EDN: Full fetch complete (29718 records). [2025-10-07T18:37:16.878512] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-07T18:37:17.261927] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-07T18:37:17.262008] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-07T18:37:17.262474] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-07T18:37:17.262514] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-07T18:37:17.263232] [DEBUG] [LOCAL ] EDN: Trimmed 29718 records to 18236 (keeping 200 days of data) [2025-10-07T18:37:17.370780] [DEBUG] [LOCAL ] EDN: Primary data saved (18236 records). [2025-10-07T18:37:17.370940] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-07T18:37:17.371027] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EDN took 55.1s. Estimated remaining: 3h 51m 36s. Rate: 7.2 symbols/min [2025-10-07T18:37:17.452853] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-07T18:37:17.544419] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:37:17.544616] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-10-07T18:37:17.544693] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-10-07T18:37:17.544807] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-07T18:37:17.544848] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-07T18:37:17.544889] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-07T18:37:17.544921] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-07T18:37:17.841679] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T18:37:17.912408] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:37:18.247739] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-07T18:37:18.504167] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T18:37:18.825313] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T18:37:19.047698] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-07T18:37:19.847734] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-07T18:37:20.192523] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T18:37:20.510483] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T18:37:20.647701] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-07T18:37:21.447713] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-07T18:37:22.168028] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T18:37:22.247713] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-07T18:37:22.305901] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T18:37:23.047692] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-07T18:37:23.091350] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T18:37:23.847765] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-07T18:37:24.572937] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T18:37:24.601323] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T18:37:24.647677] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-07T18:37:25.447736] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-07T18:37:25.465558] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T18:37:26.188706] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T18:37:26.247674] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-07T18:37:27.047694] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-07T18:37:27.691046] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T18:37:27.847687] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-07T18:37:27.894139] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-07T18:37:28.647722] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-07T18:37:28.884589] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T18:37:29.447701] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-07T18:37:30.219204] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T18:37:30.247611] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-07T18:37:31.047748] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-07T18:37:31.235797] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T18:37:31.602214] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-07T18:37:31.847711] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-07T18:37:32.624148] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-07T18:37:32.647713] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-07T18:37:33.191585] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-07T18:37:33.447629] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-07T18:37:33.493952] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-07T18:37:34.247692] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-07T18:37:34.726701] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-07T18:37:35.047729] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-07T18:37:35.087601] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T18:37:35.847719] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-07T18:37:36.059363] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T18:37:36.443163] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T18:37:36.647725] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-07T18:37:37.439017] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T18:37:37.447621] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-07T18:37:38.134995] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T18:37:38.247701] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-07T18:37:39.047638] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-07T18:37:39.174327] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-07T18:37:39.847767] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-07T18:37:40.383935] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T18:37:40.647725] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-07T18:37:40.885500] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T18:37:41.447716] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-07T18:37:41.994924] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T18:37:42.247750] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-07T18:37:42.358043] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T18:37:42.359671] [INFO ] [REMOTE ] EFT: Full fetch complete (17983 records). [2025-10-07T18:37:42.359755] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-07T18:37:42.778262] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-07T18:37:42.778362] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-07T18:37:42.778971] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-07T18:37:42.779055] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-07T18:37:42.779858] [DEBUG] [LOCAL ] EFT: Trimmed 17983 records to 13169 (keeping 200 days of data) [2025-10-07T18:37:42.871192] [DEBUG] [LOCAL ] EFT: Primary data saved (13169 records). [2025-10-07T18:37:42.871344] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-07T18:37:42.871422] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFT took 25.5s. Estimated remaining: 3h 52m 9s. Rate: 7.2 symbols/min [2025-10-07T18:37:43.056935] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-07T18:37:43.094972] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:37:43.144708] [DEBUG] [LOCAL ] EFX: Loaded 44615 existing records from primary storage. [2025-10-07T18:37:43.145175] [INFO ] [MAIN ] EFX: Loaded 44615 existing records. [2025-10-07T18:37:43.342793] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T18:37:43.383233] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:37:43.383950] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-07T18:37:43.384035] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-07T18:37:43.384290] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-07T18:37:43.384384] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-07T18:37:43.752193] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:37:43.847692] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-07T18:37:44.647731] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-07T18:37:44.988550] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T18:37:45.269337] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T18:37:45.447671] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-07T18:37:45.582869] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T18:37:46.163585] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T18:37:46.247680] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-07T18:37:47.047703] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-07T18:37:47.799838] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T18:37:47.847608] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-07T18:37:48.647758] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-07T18:37:48.803441] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T18:37:49.448541] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T18:37:49.448716] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-07T18:37:49.643970] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T18:37:50.247752] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-07T18:37:51.047637] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-07T18:37:51.058005] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T18:37:51.062027] [INFO ] [REMOTE ] EFC: Full fetch complete (66617 records). [2025-10-07T18:37:51.062140] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-07T18:37:51.253848] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T18:37:51.280378] [INFO ] [REMOTE ] EFR: Full fetch complete (19132 records). [2025-10-07T18:37:51.349917] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-07T18:37:51.620025] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-07T18:37:51.625264] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-07T18:37:51.626247] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-07T18:37:51.631462] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-07T18:37:51.714003] [DEBUG] [LOCAL ] EFC: Trimmed 66617 records to 46373 (keeping 200 days of data) [2025-10-07T18:37:51.864361] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-07T18:37:51.957130] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T18:37:52.052087] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-07T18:37:52.052758] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-07T18:37:52.054853] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-07T18:37:52.054934] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-07T18:37:52.057045] [DEBUG] [LOCAL ] EFR: Trimmed 19132 records to 14868 (keeping 200 days of data) [2025-10-07T18:37:52.321989] [DEBUG] [LOCAL ] EFR: Primary data saved (14868 records). [2025-10-07T18:37:52.325943] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-07T18:37:52.334244] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFR took 37.6s. Estimated remaining: 3h 52m 3s. Rate: 7.2 symbols/min [2025-10-07T18:37:52.452976] [DEBUG] [LOCAL ] EFC: Primary data saved (46373 records). [2025-10-07T18:37:52.463429] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-07T18:37:52.468712] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFC took 38.4s. Estimated remaining: 3h 51m 35s. Rate: 7.2 symbols/min [2025-10-07T18:37:52.601070] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:37:52.667504] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-07T18:37:52.694063] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:37:52.717306] [DEBUG] [LOCAL ] EFXT: Loaded 29254 existing records from primary storage. [2025-10-07T18:37:52.717631] [INFO ] [MAIN ] EFXT: Loaded 29254 existing records. [2025-10-07T18:37:52.912430] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:37:52.907162] [DEBUG] [LOCAL ] EG: Loaded 27903 existing records from primary storage. [2025-10-07T18:37:52.912751] [INFO ] [MAIN ] EG: Loaded 27903 existing records. [2025-10-07T18:37:52.912848] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-07T18:37:52.943329] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-07T18:37:52.966303] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-07T18:37:52.980980] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-07T18:37:53.289377] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:37:53.337035] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-07T18:37:53.343414] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-07T18:37:53.369421] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-07T18:37:53.373481] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-07T18:37:53.369612] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T18:37:53.418902] [INFO ] [REMOTE ] EEX: Full fetch complete (19118 records). [2025-10-07T18:37:53.452799] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-07T18:37:53.582762] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:37:53.681785] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-07T18:37:54.199096] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-07T18:37:54.210192] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-07T18:37:54.210987] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-07T18:37:54.233454] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-07T18:37:54.276753] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:37:54.277236] [DEBUG] [LOCAL ] EEX: Trimmed 19118 records to 10938 (keeping 200 days of data) [2025-10-07T18:37:54.278544] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-07T18:37:54.282953] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-07T18:37:54.359752] [DEBUG] [LOCAL ] EEX: Primary data saved (10938 records). [2025-10-07T18:37:54.359916] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-07T18:37:54.360012] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EEX took 48.0s. Estimated remaining: 3h 51m 12s. Rate: 7.2 symbols/min [2025-10-07T18:37:54.525393] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:37:54.575677] [DEBUG] [LOCAL ] EGO: Loaded 51656 existing records from primary storage. [2025-10-07T18:37:54.576031] [INFO ] [MAIN ] EGO: Loaded 51656 existing records. [2025-10-07T18:37:54.748329] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:37:54.748559] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-07T18:37:54.748631] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-07T18:37:54.749082] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-07T18:37:54.749161] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-07T18:37:55.052717] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-07T18:37:55.124722] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:37:55.263485] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T18:37:55.704432] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T18:37:55.847708] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-07T18:37:56.647755] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-07T18:37:57.267287] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T18:37:57.384587] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-07T18:37:57.447614] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-07T18:37:57.588000] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T18:37:58.247747] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-07T18:37:58.895235] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T18:37:58.998134] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T18:37:59.047620] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-07T18:37:59.847675] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-07T18:38:00.589593] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T18:38:00.647638] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-07T18:38:01.099672] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T18:38:01.447746] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-07T18:38:02.247695] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-07T18:38:02.281393] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T18:38:02.908541] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T18:38:03.047732] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-07T18:38:03.847722] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-07T18:38:03.877115] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T18:38:04.647695] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-07T18:38:04.675124] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T18:38:05.203350] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T18:38:05.447753] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-07T18:38:06.135467] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T18:38:06.247731] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-07T18:38:07.047817] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-07T18:38:07.169073] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T18:38:07.231558] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T18:38:07.847716] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-07T18:38:08.647739] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-07T18:38:08.736774] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T18:38:08.815025] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-07T18:38:09.447702] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-07T18:38:09.998193] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T18:38:10.247730] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-07T18:38:11.047672] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-07T18:38:11.289692] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T18:38:11.832553] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T18:38:11.847611] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-07T18:38:12.258373] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T18:38:12.647731] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-07T18:38:13.447704] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-07T18:38:13.643127] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T18:38:14.107677] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T18:38:14.247715] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-07T18:38:15.047628] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-07T18:38:15.219330] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T18:38:15.436952] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T18:38:15.847746] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-07T18:38:16.559238] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T18:38:16.562969] [INFO ] [REMOTE ] EFX: Full fetch complete (64476 records). [2025-10-07T18:38:16.563164] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-07T18:38:16.652775] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-07T18:38:16.988909] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-07T18:38:16.988993] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-07T18:38:16.989750] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-07T18:38:16.989816] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-07T18:38:16.992106] [DEBUG] [LOCAL ] EFX: Trimmed 64476 records to 44568 (keeping 200 days of data) [2025-10-07T18:38:17.272533] [DEBUG] [LOCAL ] EFX: Primary data saved (44568 records). [2025-10-07T18:38:17.272694] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-07T18:38:17.272787] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFX took 34.4s. Estimated remaining: 3h 51m 38s. Rate: 7.2 symbols/min [2025-10-07T18:38:17.447446] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:38:17.447666] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-07T18:38:17.483611] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T18:38:17.518963] [DEBUG] [LOCAL ] EGP: Loaded 30780 existing records from primary storage. [2025-10-07T18:38:17.519252] [INFO ] [MAIN ] EGP: Loaded 30780 existing records. [2025-10-07T18:38:17.724249] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:38:17.724514] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-07T18:38:17.724565] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-07T18:38:17.724874] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-07T18:38:17.724934] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-07T18:38:18.080995] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:38:18.096157] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T18:38:18.247623] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-07T18:38:18.411013] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-07T18:38:19.047742] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-07T18:38:19.352777] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T18:38:19.354592] [INFO ] [REMOTE ] EG: Full fetch complete (43365 records). [2025-10-07T18:38:19.354712] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-07T18:38:19.729673] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-07T18:38:19.729784] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-07T18:38:19.730385] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-07T18:38:19.730429] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-07T18:38:19.731424] [DEBUG] [LOCAL ] EG: Trimmed 43365 records to 27855 (keeping 200 days of data) [2025-10-07T18:38:19.847833] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-07T18:38:19.905867] [DEBUG] [LOCAL ] EG: Primary data saved (27855 records). [2025-10-07T18:38:19.906004] [INFO ] [MAIN ] EG: Full history saved. [2025-10-07T18:38:19.906088] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EG took 27.4s. Estimated remaining: 3h 51m 16s. Rate: 7.2 symbols/min [2025-10-07T18:38:20.071426] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:38:20.116612] [DEBUG] [LOCAL ] EGY: Loaded 41895 existing records from primary storage. [2025-10-07T18:38:20.116993] [INFO ] [MAIN ] EGY: Loaded 41895 existing records. [2025-10-07T18:38:20.301803] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:38:20.302124] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-07T18:38:20.302185] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-07T18:38:20.302389] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-07T18:38:20.302445] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-07T18:38:20.652447] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-07T18:38:20.656189] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:38:20.847414] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T18:38:21.380841] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T18:38:21.447682] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-07T18:38:21.962824] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T18:38:22.247733] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-07T18:38:23.047688] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-07T18:38:23.127839] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T18:38:23.555117] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T18:38:23.847732] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-07T18:38:24.051315] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T18:38:24.647686] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-07T18:38:25.089163] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T18:38:25.447707] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-07T18:38:25.523869] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T18:38:25.526400] [INFO ] [REMOTE ] EFXT: Full fetch complete (44100 records). [2025-10-07T18:38:25.526535] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-07T18:38:25.911891] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-07T18:38:25.911970] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-07T18:38:25.912543] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-07T18:38:25.912583] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-07T18:38:25.913506] [DEBUG] [LOCAL ] EFXT: Trimmed 44100 records to 29278 (keeping 200 days of data) [2025-10-07T18:38:26.085492] [DEBUG] [LOCAL ] EFXT: Primary data saved (29278 records). [2025-10-07T18:38:26.085633] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-07T18:38:26.085768] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EFXT took 33.8s. Estimated remaining: 3h 51m 3s. Rate: 7.2 symbols/min [2025-10-07T18:38:26.250703] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-07T18:38:26.252219] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:38:26.253696] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-10-07T18:38:26.253755] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-10-07T18:38:26.253863] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-07T18:38:26.253904] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-07T18:38:26.253946] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-07T18:38:26.253978] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-07T18:38:26.629302] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:38:26.878899] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T18:38:27.047670] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-07T18:38:27.847634] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-07T18:38:28.099032] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T18:38:28.629439] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T18:38:28.653673] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-07T18:38:28.657624] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T18:38:29.447737] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-07T18:38:30.206861] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T18:38:30.247693] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-07T18:38:31.047698] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-07T18:38:31.269431] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:38:31.847692] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-07T18:38:32.080692] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T18:38:32.489802] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T18:38:32.647667] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-07T18:38:32.981219] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T18:38:33.447755] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-07T18:38:34.045901] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T18:38:34.247768] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-07T18:38:35.011564] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T18:38:35.047603] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-07T18:38:35.752811] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T18:38:35.847702] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-07T18:38:36.290934] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T18:38:36.647745] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-07T18:38:37.191409] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T18:38:37.447748] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-07T18:38:37.551071] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T18:38:38.247740] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-07T18:38:38.888737] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T18:38:39.053705] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-07T18:38:39.067516] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T18:38:39.847699] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-07T18:38:40.300896] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T18:38:40.647716] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-07T18:38:41.058575] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T18:38:41.447767] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-07T18:38:42.058268] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T18:38:42.062495] [INFO ] [REMOTE ] EGO: Full fetch complete (73836 records). [2025-10-07T18:38:42.062742] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-07T18:38:42.252897] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-07T18:38:42.477718] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-07T18:38:42.477833] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-07T18:38:42.478803] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-07T18:38:42.478887] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-07T18:38:42.480542] [DEBUG] [LOCAL ] EGO: Trimmed 73836 records to 51673 (keeping 200 days of data) [2025-10-07T18:38:42.797859] [DEBUG] [LOCAL ] EGO: Primary data saved (51673 records). [2025-10-07T18:38:42.798049] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-07T18:38:42.798179] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGO took 48.4s. Estimated remaining: 3h 51m 14s. Rate: 7.2 symbols/min [2025-10-07T18:38:42.976962] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:38:42.977254] [DEBUG] [LOCAL ] EHC: No existing data file found in primary storage. [2025-10-07T18:38:42.977494] [WARN ] [MAIN ] EHC: No existing data found, performing full refresh instead. [2025-10-07T18:38:42.985053] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-07T18:38:42.996954] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-07T18:38:42.997074] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-07T18:38:42.997738] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-07T18:38:43.029894] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T18:38:43.053366] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-07T18:38:43.373518] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:38:43.646552] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T18:38:43.848046] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-07T18:38:44.329409] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T18:38:44.647730] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-07T18:38:45.447734] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-07T18:38:45.530905] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T18:38:45.849939] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T18:38:45.852860] [INFO ] [REMOTE ] EGY: Full fetch complete (61264 records). [2025-10-07T18:38:45.852977] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-07T18:38:46.235839] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-07T18:38:46.235940] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-07T18:38:46.236688] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-07T18:38:46.236752] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-07T18:38:46.238006] [DEBUG] [LOCAL ] EGY: Trimmed 61264 records to 41850 (keeping 200 days of data) [2025-10-07T18:38:46.289765] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-07T18:38:46.490285] [DEBUG] [LOCAL ] EGY: Primary data saved (41850 records). [2025-10-07T18:38:46.490413] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-07T18:38:46.491279] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGY took 26.6s. Estimated remaining: 3h 50m 55s. Rate: 7.2 symbols/min [2025-10-07T18:38:46.661450] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:38:46.661787] [DEBUG] [LOCAL ] EHI: No existing data file found in primary storage. [2025-10-07T18:38:46.661855] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-10-07T18:38:46.661988] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-07T18:38:46.662103] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-07T18:38:46.662179] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-10-07T18:38:46.662221] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-07T18:38:46.932878] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T18:38:47.048219] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:38:47.048283] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-07T18:38:47.718812] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T18:38:47.847611] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-07T18:38:48.201242] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T18:38:48.647705] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-07T18:38:49.264512] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T18:38:49.447738] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-07T18:38:50.153944] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T18:38:50.247613] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-07T18:38:50.699553] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T18:38:51.047670] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-07T18:38:51.485141] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T18:38:51.847720] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-07T18:38:52.584430] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T18:38:52.647631] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-07T18:38:53.341557] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T18:38:53.447740] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-07T18:38:54.213412] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T18:38:54.248164] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-07T18:38:54.248061] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T18:38:55.047703] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-07T18:38:55.080868] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T18:38:55.847624] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-07T18:38:56.087262] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T18:38:56.634014] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T18:38:56.647624] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-07T18:38:57.447767] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-07T18:38:57.887611] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T18:38:57.889759] [INFO ] [REMOTE ] EGP: Full fetch complete (45435 records). [2025-10-07T18:38:57.889849] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-07T18:38:58.196320] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-07T18:38:58.248808] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-07T18:38:58.288964] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-07T18:38:58.289067] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-07T18:38:58.289835] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-07T18:38:58.289902] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-07T18:38:58.291096] [DEBUG] [LOCAL ] EGP: Trimmed 45435 records to 30699 (keeping 200 days of data) [2025-10-07T18:38:58.496861] [DEBUG] [LOCAL ] EGP: Primary data saved (30699 records). [2025-10-07T18:38:58.497092] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-07T18:38:58.497206] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGP took 41.2s. Estimated remaining: 3h 50m 55s. Rate: 7.2 symbols/min [2025-10-07T18:38:58.669175] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:38:58.695492] [DEBUG] [LOCAL ] EIC: Loaded 23167 existing records from primary storage. [2025-10-07T18:38:58.695803] [INFO ] [MAIN ] EIC: Loaded 23167 existing records. [2025-10-07T18:38:58.871790] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:38:58.872023] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-07T18:38:58.872071] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-07T18:38:58.872319] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-07T18:38:58.872378] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-07T18:38:59.049433] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-07T18:38:59.237449] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:38:59.298990] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T18:38:59.847710] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-07T18:38:59.972849] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-07T18:39:00.647749] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-07T18:39:01.369935] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T18:39:01.447754] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-07T18:39:01.595404] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T18:39:02.247731] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-07T18:39:02.591480] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T18:39:02.593530] [INFO ] [REMOTE ] EHAB: Full fetch complete (40867 records). [2025-10-07T18:39:02.593635] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-07T18:39:02.594585] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:39:02.594765] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:39:02.594815] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:39:02.594860] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-07T18:39:02.594943] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-07T18:39:02.595003] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-10-07T18:39:02.595068] [DEBUG] [LOCAL ] EHAB: No derivative data file found to delete. [2025-10-07T18:39:02.595182] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHAB took 36.5s. Estimated remaining: 3h 50m 37s. Rate: 7.2 symbols/min [2025-10-07T18:39:02.778387] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:39:02.778705] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-07T18:39:02.778761] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-07T18:39:02.778889] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-07T18:39:02.778933] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-07T18:39:02.778976] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-07T18:39:02.779011] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-07T18:39:03.052360] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-07T18:39:03.153256] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T18:39:03.201795] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:39:03.847725] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-07T18:39:04.319330] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-07T18:39:04.647678] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-07T18:39:04.705371] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T18:39:05.085818] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-07T18:39:05.447723] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-07T18:39:06.247724] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-07T18:39:06.288566] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T18:39:06.567402] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-07T18:39:07.047687] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-07T18:39:07.847717] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-07T18:39:08.192592] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-07T18:39:08.427828] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:39:08.647755] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-07T18:39:09.447676] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-07T18:39:09.740994] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T18:39:10.201854] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T18:39:10.247723] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-07T18:39:11.047743] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-07T18:39:11.080372] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T18:39:11.081877] [INFO ] [REMOTE ] EHI: Full fetch complete (16259 records). [2025-10-07T18:39:11.081959] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-07T18:39:11.082585] [FATAL] [VALIDATOR ] EHI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:39:11.082701] [FATAL] [MAIN ] EHI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:39:11.082753] [WARN ] [MAIN ] EHI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:39:11.082798] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-07T18:39:11.082879] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-10-07T18:39:11.082936] [INFO ] [LOCAL ] EHI: Starting deletion of derivative data. [2025-10-07T18:39:11.082980] [DEBUG] [LOCAL ] EHI: No derivative data file found to delete. [2025-10-07T18:39:11.083043] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHI took 24.6s. Estimated remaining: 3h 50m 29s. Rate: 7.2 symbols/min [2025-10-07T18:39:11.276145] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:39:11.276388] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-07T18:39:11.276427] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-07T18:39:11.276554] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-07T18:39:11.276597] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-07T18:39:11.276668] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-07T18:39:11.276726] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-07T18:39:11.451247] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-07T18:39:11.671020] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:39:11.847725] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-07T18:39:12.535182] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-07T18:39:12.647627] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-07T18:39:13.081821] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T18:39:13.447737] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-07T18:39:13.803356] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-07T18:39:14.247688] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-07T18:39:15.047728] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-07T18:39:15.476199] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-07T18:39:15.847634] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-07T18:39:15.909447] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T18:39:16.339667] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-07T18:39:16.647773] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-07T18:39:17.447715] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-07T18:39:17.804498] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-07T18:39:18.148604] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T18:39:18.247626] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-07T18:39:19.047707] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-07T18:39:19.330899] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-07T18:39:19.751045] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T18:39:19.847718] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-07T18:39:20.270126] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-07T18:39:20.647687] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-07T18:39:21.071674] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-07T18:39:21.447694] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-07T18:39:21.987985] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-07T18:39:22.247687] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-07T18:39:22.519241] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-07T18:39:23.047678] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-07T18:39:23.386223] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-07T18:39:23.847690] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-07T18:39:24.418970] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T18:39:24.647703] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-07T18:39:24.908252] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-07T18:39:25.447697] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-07T18:39:26.247676] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-07T18:39:26.671529] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T18:39:26.677623] [INFO ] [REMOTE ] EHC: Full fetch complete (58933 records). [2025-10-07T18:39:26.677754] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-07T18:39:26.677975] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-07T18:39:26.678726] [INFO ] [REMOTE ] EICA: Full fetch complete (1307 records). [2025-10-07T18:39:26.678960] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-07T18:39:27.064982] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-07T18:39:27.065208] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-07T18:39:27.088606] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:39:27.112348] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:39:27.124489] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-07T18:39:27.160116] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-07T18:39:27.169057] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-07T18:39:27.171499] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-07T18:39:27.171686] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EICA took 24.6s. Estimated remaining: 3h 50m 38s. Rate: 7.2 symbols/min [2025-10-07T18:39:27.423881] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-07T18:39:27.439438] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-07T18:39:27.443396] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-07T18:39:27.443497] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-07T18:39:27.442508] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:39:27.443916] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-07T18:39:27.443975] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-07T18:39:27.444665] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-07T18:39:27.444740] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-07T18:39:27.444858] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-07T18:39:27.444924] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-07T18:39:27.486850] [DEBUG] [LOCAL ] EHC: Trimmed 58933 records to 41268 (keeping 200 days of data) [2025-10-07T18:39:27.849775] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-07T18:39:27.921634] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:39:28.060811] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T18:39:28.114544] [DEBUG] [LOCAL ] EHC: Primary data saved (41268 records). [2025-10-07T18:39:28.114715] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-07T18:39:28.114807] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EHC took 45.3s. Estimated remaining: 3h 50m 13s. Rate: 7.2 symbols/min [2025-10-07T18:39:28.289507] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:39:28.310707] [DEBUG] [LOCAL ] EIG: Loaded 20309 existing records from primary storage. [2025-10-07T18:39:28.310982] [INFO ] [MAIN ] EIG: Loaded 20309 existing records. [2025-10-07T18:39:28.394923] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-07T18:39:28.503006] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:39:28.503338] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-07T18:39:28.503399] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-07T18:39:28.503790] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-07T18:39:28.503849] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-07T18:39:28.652883] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-07T18:39:28.856901] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:39:29.289239] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T18:39:29.290094] [INFO ] [REMOTE ] EICB: Full fetch complete (2715 records). [2025-10-07T18:39:29.290164] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-07T18:39:29.290517] [FATAL] [VALIDATOR ] EICB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:39:29.290594] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:39:29.290684] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:39:29.290757] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-07T18:39:29.290822] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-07T18:39:29.290856] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-07T18:39:29.290895] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-07T18:39:29.290983] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICB took 18.2s. Estimated remaining: 3h 49m 48s. Rate: 7.2 symbols/min [2025-10-07T18:39:29.455266] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-07T18:39:29.458683] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:39:29.540818] [DEBUG] [LOCAL ] EIX: Loaded 53343 existing records from primary storage. [2025-10-07T18:39:29.541161] [INFO ] [MAIN ] EIX: Loaded 53343 existing records. [2025-10-07T18:39:29.714854] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:39:29.715117] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-07T18:39:29.715164] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-07T18:39:29.715380] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-07T18:39:29.715435] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-07T18:39:30.062038] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:39:30.247624] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-07T18:39:30.728160] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T18:39:31.047684] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-07T18:39:31.810148] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T18:39:31.847627] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-07T18:39:32.365414] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-07T18:39:32.647743] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-07T18:39:32.993273] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T18:39:33.128385] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T18:39:33.447684] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-07T18:39:34.247749] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-07T18:39:34.827273] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T18:39:35.047731] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-07T18:39:35.484092] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T18:39:35.847695] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-07T18:39:36.647628] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-07T18:39:36.957969] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-07T18:39:37.071530] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T18:39:37.143748] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-07T18:39:37.447687] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-07T18:39:38.247624] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-07T18:39:38.391241] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T18:39:39.047685] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-07T18:39:39.847637] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-07T18:39:40.015630] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T18:39:40.064488] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T18:39:40.409099] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T18:39:40.647692] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-07T18:39:41.244452] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T18:39:41.447740] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-07T18:39:42.247700] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-07T18:39:42.942576] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T18:39:43.047692] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-07T18:39:43.444555] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-07T18:39:43.847748] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-07T18:39:44.297186] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T18:39:44.647720] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-07T18:39:45.447758] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-07T18:39:45.812080] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T18:39:46.247628] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-07T18:39:46.315546] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T18:39:46.416638] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-07T18:39:47.047733] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-07T18:39:47.209759] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T18:39:47.606137] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T18:39:47.847729] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-07T18:39:48.431719] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T18:39:48.647715] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-07T18:39:49.447626] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-07T18:39:49.609276] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T18:39:49.824795] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-07T18:39:50.247670] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-07T18:39:51.047704] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-07T18:39:51.674162] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T18:39:51.847746] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-07T18:39:52.072384] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T18:39:52.586155] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T18:39:52.647744] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-07T18:39:53.447688] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-07T18:39:53.467397] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T18:39:53.469076] [INFO ] [REMOTE ] EIC: Full fetch complete (34661 records). [2025-10-07T18:39:53.469154] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-07T18:39:53.840368] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-07T18:39:53.840470] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-07T18:39:53.841397] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-07T18:39:53.841465] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-07T18:39:53.842398] [DEBUG] [LOCAL ] EIC: Trimmed 34661 records to 23128 (keeping 200 days of data) [2025-10-07T18:39:53.991004] [DEBUG] [LOCAL ] EIC: Primary data saved (23128 records). [2025-10-07T18:39:53.991142] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-07T18:39:53.991255] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EIC took 55.5s. Estimated remaining: 3h 50m 17s. Rate: 7.2 symbols/min [2025-10-07T18:39:54.247776] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-07T18:39:54.843795] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T18:39:54.845111] [INFO ] [REMOTE ] EICC: Full fetch complete (8346 records). [2025-10-07T18:39:54.845189] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-07T18:39:54.845710] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:39:54.845800] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:39:54.845846] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:39:54.845893] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-07T18:39:54.845999] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-07T18:39:54.846049] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-07T18:39:54.846110] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-07T18:39:54.846192] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 27.7s. Estimated remaining: 3h 49m 52s. Rate: 7.2 symbols/min [2025-10-07T18:39:55.047743] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-07T18:39:55.238575] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T18:39:55.744113] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-07T18:39:55.847683] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-07T18:39:56.647733] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-07T18:39:56.938611] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T18:39:57.447725] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-07T18:39:58.284533] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T18:39:58.296789] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-07T18:39:58.323430] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T18:39:59.047689] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-07T18:39:59.762360] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T18:39:59.847625] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-07T18:40:00.032005] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T18:40:00.647714] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-07T18:40:00.740319] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T18:40:00.742129] [INFO ] [REMOTE ] EIG: Full fetch complete (27152 records). [2025-10-07T18:40:00.742210] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-07T18:40:01.147583] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-07T18:40:01.147716] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-07T18:40:01.148286] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-07T18:40:01.148351] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-07T18:40:01.149152] [DEBUG] [LOCAL ] EIG: Trimmed 27152 records to 20324 (keeping 200 days of data) [2025-10-07T18:40:01.276253] [DEBUG] [LOCAL ] EIG: Primary data saved (20324 records). [2025-10-07T18:40:01.276390] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-07T18:40:01.276472] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 33.2s. Estimated remaining: 3h 49m 39s. Rate: 7.2 symbols/min [2025-10-07T18:40:02.712143] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-07T18:40:02.725619] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-07T18:40:04.343482] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T18:40:04.347220] [INFO ] [REMOTE ] EIX: Full fetch complete (77095 records). [2025-10-07T18:40:04.347333] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-07T18:40:04.735412] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-07T18:40:04.735497] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-07T18:40:04.736463] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-07T18:40:04.736540] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-07T18:40:04.738237] [DEBUG] [LOCAL ] EIX: Trimmed 77095 records to 53343 (keeping 200 days of data) [2025-10-07T18:40:05.071355] [DEBUG] [LOCAL ] EIX: Primary data saved (53343 records). [2025-10-07T18:40:05.071522] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-07T18:40:05.072441] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 35.8s. Estimated remaining: 3h 49m 20s. Rate: 7.2 symbols/min [2025-10-07T18:40:05.663213] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:40:05.735515] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:40:05.802549] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:40:05.820751] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:40:05.833131] [DEBUG] [LOCAL ] ELC: Loaded 3501 existing records from primary storage. [2025-10-07T18:40:05.833585] [INFO ] [MAIN ] ELC: Loaded 3501 existing records. [2025-10-07T18:40:06.113615] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:40:06.115482] [DEBUG] [LOCAL ] ELF: Loaded 52098 existing records from primary storage. [2025-10-07T18:40:06.116137] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-07T18:40:06.116325] [INFO ] [MAIN ] ELF: Loaded 52098 existing records. [2025-10-07T18:40:06.116416] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-07T18:40:06.151315] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-07T18:40:06.162365] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-07T18:40:06.331890] [DEBUG] [LOCAL ] ELAN: Loaded 53267 existing records from primary storage. [2025-10-07T18:40:06.359501] [DEBUG] [LOCAL ] EL: Loaded 53370 existing records from primary storage. [2025-10-07T18:40:06.364782] [INFO ] [MAIN ] ELAN: Loaded 53267 existing records. [2025-10-07T18:40:06.403964] [INFO ] [MAIN ] EL: Loaded 53370 existing records. [2025-10-07T18:40:06.549195] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:40:06.690689] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-07T18:40:06.710301] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-07T18:40:06.798570] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-07T18:40:06.843140] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-07T18:40:07.064312] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:40:07.095097] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-07T18:40:07.165998] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-07T18:40:07.223449] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-07T18:40:07.223625] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-07T18:40:07.223347] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:40:07.233601] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-07T18:40:07.245107] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:40:07.245540] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-07T18:40:07.245421] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-07T18:40:07.310536] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-07T18:40:07.319329] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-07T18:40:08.012627] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:40:08.073687] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-07T18:40:08.207571] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-07T18:40:08.253141] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-07T18:40:08.290246] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:40:08.315184] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-07T18:40:08.375977] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:40:08.376270] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-07T18:40:08.930567] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T18:40:08.933842] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-07T18:40:09.446216] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-07T18:40:09.448953] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-07T18:40:10.095394] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T18:40:10.097038] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-07T18:40:10.148820] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-07T18:40:10.159173] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-07T18:40:10.405165] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T18:40:10.416126] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-07T18:40:10.521711] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-07T18:40:10.532880] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-07T18:40:10.686722] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T18:40:11.047748] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-07T18:40:11.674003] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T18:40:11.847779] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-07T18:40:11.981780] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T18:40:12.105356] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T18:40:12.150407] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T18:40:12.298752] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T18:40:12.647734] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-07T18:40:13.447686] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-07T18:40:14.247685] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-07T18:40:14.710465] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-07T18:40:14.967331] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T18:40:15.047879] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-07T18:40:15.847703] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-07T18:40:16.369382] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-07T18:40:16.544217] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T18:40:16.647684] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-07T18:40:16.883557] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T18:40:17.447680] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-07T18:40:18.003868] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T18:40:18.247709] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-07T18:40:18.508572] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T18:40:19.047750] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-07T18:40:19.723197] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-07T18:40:19.847684] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-07T18:40:19.992786] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T18:40:20.647702] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-07T18:40:21.447778] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-07T18:40:22.187133] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T18:40:22.188351] [INFO ] [REMOTE ] ELC: Full fetch complete (5072 records). [2025-10-07T18:40:22.188425] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-07T18:40:22.204578] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:40:22.223225] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:40:22.223319] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:40:22.223958] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-07T18:40:22.225007] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-07T18:40:22.225127] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-07T18:40:22.235719] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-10-07T18:40:22.236590] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-10-07T18:40:22.236718] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 17.2s. Estimated remaining: 3h 49m 32s. Rate: 7.2 symbols/min [2025-10-07T18:40:22.257207] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-07T18:40:22.411504] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:40:22.411733] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-07T18:40:22.411842] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-07T18:40:22.411927] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-07T18:40:22.411965] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-07T18:40:22.412005] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-07T18:40:22.412037] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-07T18:40:22.767754] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:40:22.801992] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-07T18:40:23.047627] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-07T18:40:23.847738] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-07T18:40:24.071625] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T18:40:24.647679] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-07T18:40:25.359846] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-07T18:40:25.447613] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-07T18:40:25.947831] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-07T18:40:26.247747] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-07T18:40:26.321726] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T18:40:27.047959] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-07T18:40:27.217695] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T18:40:27.847672] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-07T18:40:28.346585] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-07T18:40:28.647749] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-07T18:40:28.842336] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T18:40:29.374016] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T18:40:29.447610] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-07T18:40:30.247684] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-07T18:40:30.651233] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T18:40:30.772115] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T18:40:31.047730] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-07T18:40:31.847729] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-07T18:40:32.284454] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T18:40:32.570777] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T18:40:32.647706] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-07T18:40:33.447678] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-07T18:40:33.646135] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T18:40:34.247752] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-07T18:40:34.578362] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-07T18:40:34.786354] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-07T18:40:35.047700] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-07T18:40:35.834499] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T18:40:35.847620] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-07T18:40:36.647632] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-07T18:40:37.069636] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-07T18:40:37.448190] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-07T18:40:37.450035] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T18:40:37.453738] [INFO ] [REMOTE ] ELAN: Full fetch complete (76873 records). [2025-10-07T18:40:37.453855] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-07T18:40:37.873825] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-07T18:40:37.874052] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-07T18:40:37.875277] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-07T18:40:37.875433] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-07T18:40:37.903841] [DEBUG] [LOCAL ] ELAN: Trimmed 76873 records to 53273 (keeping 200 days of data) [2025-10-07T18:40:37.906271] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T18:40:38.240407] [DEBUG] [LOCAL ] ELAN: Primary data saved (53273 records). [2025-10-07T18:40:38.240582] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-07T18:40:38.240697] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELAN took 33.1s. Estimated remaining: 3h 49m 41s. Rate: 7.2 symbols/min [2025-10-07T18:40:38.253009] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-07T18:40:38.417240] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:40:38.443510] [DEBUG] [LOCAL ] ELP: Loaded 25589 existing records from primary storage. [2025-10-07T18:40:38.443830] [INFO ] [MAIN ] ELP: Loaded 25589 existing records. [2025-10-07T18:40:38.620860] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:40:38.621131] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-07T18:40:38.621186] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-07T18:40:38.621494] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-07T18:40:38.621552] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-07T18:40:38.964881] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:40:39.047735] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-07T18:40:39.499294] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T18:40:39.847673] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-07T18:40:40.158709] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-07T18:40:40.623979] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T18:40:40.647612] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-07T18:40:41.447760] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-07T18:40:41.673711] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T18:40:41.735769] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T18:40:42.247687] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-07T18:40:42.455454] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T18:40:43.047706] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-07T18:40:43.847625] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-07T18:40:43.939771] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-07T18:40:43.943083] [INFO ] [REMOTE ] ELF: Full fetch complete (75286 records). [2025-10-07T18:40:43.943205] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-07T18:40:44.089224] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T18:40:44.355826] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-07T18:40:44.355913] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-07T18:40:44.356763] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-07T18:40:44.356833] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-07T18:40:44.361444] [DEBUG] [LOCAL ] ELF: Trimmed 75286 records to 52072 (keeping 200 days of data) [2025-10-07T18:40:44.668575] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-07T18:40:44.724147] [DEBUG] [LOCAL ] ELF: Primary data saved (52072 records). [2025-10-07T18:40:44.724387] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-07T18:40:44.724518] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELF took 39.6s. Estimated remaining: 3h 49m 29s. Rate: 7.2 symbols/min [2025-10-07T18:40:44.914861] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:40:44.915245] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-07T18:40:44.915302] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-07T18:40:44.915454] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-07T18:40:44.915498] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-07T18:40:44.915543] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-07T18:40:44.915577] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-07T18:40:45.309333] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:40:45.447624] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-07T18:40:45.580110] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T18:40:45.586815] [INFO ] [REMOTE ] EL: Full fetch complete (77274 records). [2025-10-07T18:40:45.586954] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-07T18:40:45.906790] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T18:40:46.012014] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-07T18:40:46.012239] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-07T18:40:46.016999] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-07T18:40:46.017158] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-07T18:40:46.017343] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-07T18:40:46.023035] [DEBUG] [LOCAL ] EL: Trimmed 77274 records to 53369 (keeping 200 days of data) [2025-10-07T18:40:46.247954] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-07T18:40:46.366684] [DEBUG] [LOCAL ] EL: Primary data saved (53369 records). [2025-10-07T18:40:46.366857] [INFO ] [MAIN ] EL: Full history saved. [2025-10-07T18:40:46.367024] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. EL took 41.3s. Estimated remaining: 3h 49m 5s. Rate: 7.2 symbols/min [2025-10-07T18:40:46.545189] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:40:46.545380] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-10-07T18:40:46.545421] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-10-07T18:40:46.545542] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-07T18:40:46.545586] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-07T18:40:46.545630] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-07T18:40:46.545706] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-07T18:40:46.917751] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:40:47.047743] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-07T18:40:47.715359] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T18:40:47.847623] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-07T18:40:48.647718] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-07T18:40:48.679951] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T18:40:49.101369] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T18:40:49.438268] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T18:40:49.447616] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-07T18:40:49.739870] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-07T18:40:50.247697] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-07T18:40:51.047743] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-07T18:40:51.843444] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T18:40:51.852382] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-07T18:40:52.089513] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T18:40:52.194150] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-07T18:40:52.647743] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-07T18:40:53.092795] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-07T18:40:53.447725] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-07T18:40:54.247695] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-07T18:40:54.597335] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-07T18:40:55.047711] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-07T18:40:55.094546] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T18:40:55.392736] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-07T18:40:55.847693] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-07T18:40:56.647688] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-07T18:40:57.386167] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T18:40:57.447683] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-07T18:40:57.899572] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T18:40:58.247732] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-07T18:40:59.046887] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T18:40:59.056273] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-07T18:40:59.368679] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T18:40:59.372857] [INFO ] [REMOTE ] ELME: Full fetch complete (56127 records). [2025-10-07T18:40:59.372983] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-07T18:40:59.763268] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-07T18:40:59.763380] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-07T18:40:59.764079] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-07T18:40:59.764143] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-07T18:40:59.765284] [DEBUG] [LOCAL ] ELME: Trimmed 56127 records to 39289 (keeping 200 days of data) [2025-10-07T18:40:59.854694] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-07T18:41:00.013243] [DEBUG] [LOCAL ] ELME: Primary data saved (39289 records). [2025-10-07T18:41:00.013385] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-07T18:41:00.013461] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELME took 37.8s. Estimated remaining: 3h 49m 9s. Rate: 7.2 symbols/min [2025-10-07T18:41:00.182972] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:00.243695] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-07T18:41:00.243543] [DEBUG] [LOCAL ] ELV: Loaded 50614 existing records from primary storage. [2025-10-07T18:41:00.245495] [INFO ] [MAIN ] ELV: Loaded 50614 existing records. [2025-10-07T18:41:00.444089] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:41:00.445577] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T18:41:00.451443] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-07T18:41:00.451935] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-07T18:41:00.452486] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-07T18:41:00.452545] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-07T18:41:00.652813] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-07T18:41:00.814710] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:01.447752] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-07T18:41:02.247719] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-07T18:41:02.571578] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-07T18:41:02.763736] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T18:41:03.047630] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-07T18:41:03.328592] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T18:41:03.340852] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-07T18:41:03.847702] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-07T18:41:04.179233] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-07T18:41:04.179962] [INFO ] [REMOTE ] ELPC: Full fetch complete (1427 records). [2025-10-07T18:41:04.180034] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-07T18:41:04.180457] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:41:04.180546] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:41:04.180590] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:41:04.180659] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-07T18:41:04.180743] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-07T18:41:04.180782] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-07T18:41:04.180840] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-07T18:41:04.180919] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELPC took 19.5s. Estimated remaining: 3h 48m 51s. Rate: 7.2 symbols/min [2025-10-07T18:41:04.349943] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:04.350127] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-07T18:41:04.350165] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-07T18:41:04.350274] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-07T18:41:04.350316] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-07T18:41:04.350358] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-07T18:41:04.350391] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-07T18:41:04.652888] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-07T18:41:04.712463] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:05.447738] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-07T18:41:05.913745] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:41:05.914109] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-07T18:41:05.914201] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:41:05.914267] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-07T18:41:05.914333] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:41:05.914383] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-07T18:41:05.914630] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-07T18:41:05.914779] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-07T18:41:05.914837] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-07T18:41:05.914886] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. EMA took 1.7s. Estimated remaining: 3h 48m 27s. Rate: 7.2 symbols/min [2025-10-07T18:41:06.039883] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T18:41:06.108935] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:06.138709] [DEBUG] [LOCAL ] EMD: Loaded 21095 existing records from primary storage. [2025-10-07T18:41:06.138965] [INFO ] [MAIN ] EMD: Loaded 21095 existing records. [2025-10-07T18:41:06.271114] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-07T18:41:06.348636] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:41:06.348876] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-07T18:41:06.348923] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-07T18:41:06.349142] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-07T18:41:06.349199] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-07T18:41:06.698790] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:07.047706] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-07T18:41:07.847721] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-07T18:41:08.090546] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T18:41:08.485720] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T18:41:08.647739] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-07T18:41:09.022954] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T18:41:09.425011] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T18:41:09.447693] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-07T18:41:10.247679] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-07T18:41:10.581879] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T18:41:11.047670] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-07T18:41:11.107564] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T18:41:11.847681] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-07T18:41:12.647706] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-07T18:41:12.803218] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T18:41:12.898607] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T18:41:13.447728] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-07T18:41:13.764151] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T18:41:14.247707] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-07T18:41:15.047626] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-07T18:41:15.164683] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T18:41:15.847724] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-07T18:41:15.880332] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T18:41:16.065905] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T18:41:16.067710] [INFO ] [REMOTE ] ELP: Full fetch complete (36945 records). [2025-10-07T18:41:16.067787] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-07T18:41:16.444300] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-07T18:41:16.444387] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-07T18:41:16.444944] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-07T18:41:16.445007] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-07T18:41:16.445858] [DEBUG] [LOCAL ] ELP: Trimmed 36945 records to 25608 (keeping 200 days of data) [2025-10-07T18:41:16.597824] [DEBUG] [LOCAL ] ELP: Primary data saved (25608 records). [2025-10-07T18:41:16.597980] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-07T18:41:16.598087] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELP took 38.4s. Estimated remaining: 3h 48m 24s. Rate: 7.2 symbols/min [2025-10-07T18:41:16.652919] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-07T18:41:16.767353] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:16.799380] [DEBUG] [LOCAL ] EME: Loaded 31251 existing records from primary storage. [2025-10-07T18:41:16.799685] [INFO ] [MAIN ] EME: Loaded 31251 existing records. [2025-10-07T18:41:16.975945] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:41:16.976177] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-07T18:41:16.976227] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-07T18:41:16.976443] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-07T18:41:16.976499] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-07T18:41:17.338474] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:17.447611] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-07T18:41:17.633340] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T18:41:18.247710] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-07T18:41:18.421600] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T18:41:18.966928] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T18:41:19.047679] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-07T18:41:19.145943] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T18:41:19.847696] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-07T18:41:20.647636] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-07T18:41:20.766330] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T18:41:21.002699] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T18:41:21.447737] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-07T18:41:22.259297] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-07T18:41:22.281100] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T18:41:22.285370] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T18:41:23.047768] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-07T18:41:23.811122] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T18:41:23.848568] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-07T18:41:23.851051] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T18:41:24.647692] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-07T18:41:24.997070] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T18:41:25.447773] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-07T18:41:26.214543] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T18:41:26.247678] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-07T18:41:27.047760] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-07T18:41:27.438084] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T18:41:27.847759] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-07T18:41:28.074806] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T18:41:28.653719] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-07T18:41:28.668111] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T18:41:29.232214] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:41:29.447746] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-07T18:41:30.200915] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T18:41:30.204492] [INFO ] [REMOTE ] ELS: Full fetch complete (70908 records). [2025-10-07T18:41:30.204591] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-07T18:41:30.257989] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-07T18:41:30.591907] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-07T18:41:30.592104] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-07T18:41:30.593056] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-07T18:41:30.598333] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-07T18:41:30.606717] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T18:41:30.612633] [DEBUG] [LOCAL ] ELS: Trimmed 70908 records to 49737 (keeping 200 days of data) [2025-10-07T18:41:30.928313] [DEBUG] [LOCAL ] ELS: Primary data saved (49737 records). [2025-10-07T18:41:30.928508] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-07T18:41:30.928666] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELS took 44.6s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-10-07T18:41:31.052757] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-07T18:41:31.104410] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:31.110198] [DEBUG] [LOCAL ] EMF: Loaded 3285 existing records from primary storage. [2025-10-07T18:41:31.110379] [INFO ] [MAIN ] EMF: Loaded 3285 existing records. [2025-10-07T18:41:31.289481] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:41:31.289752] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-07T18:41:31.289806] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-07T18:41:31.289942] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-07T18:41:31.290034] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-07T18:41:31.647365] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:31.847609] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-07T18:41:32.416756] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-07T18:41:32.647616] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-07T18:41:32.698430] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T18:41:32.724062] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T18:41:33.447727] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-07T18:41:33.661258] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T18:41:34.247749] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-07T18:41:34.843139] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T18:41:35.047814] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-07T18:41:35.488923] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T18:41:35.490829] [INFO ] [REMOTE ] EMD: Full fetch complete (32403 records). [2025-10-07T18:41:35.490910] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-07T18:41:35.850910] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-07T18:41:35.850678] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-07T18:41:35.851036] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-07T18:41:35.852314] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-07T18:41:35.852378] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-07T18:41:35.853341] [DEBUG] [LOCAL ] EMD: Trimmed 32403 records to 21092 (keeping 200 days of data) [2025-10-07T18:41:35.988667] [DEBUG] [LOCAL ] EMD: Primary data saved (21092 records). [2025-10-07T18:41:35.988794] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-07T18:41:35.988878] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. EMD took 30.1s. Estimated remaining: 3h 48m 14s. Rate: 7.2 symbols/min [2025-10-07T18:41:36.158890] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:36.217012] [DEBUG] [LOCAL ] EMN: Loaded 50602 existing records from primary storage. [2025-10-07T18:41:36.217359] [INFO ] [MAIN ] EMN: Loaded 50602 existing records. [2025-10-07T18:41:36.396843] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:41:36.397145] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-07T18:41:36.397205] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-07T18:41:36.397503] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-07T18:41:36.397590] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-07T18:41:36.672373] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-07T18:41:36.665266] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T18:41:36.759354] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:37.029272] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T18:41:37.447748] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-07T18:41:38.099759] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T18:41:38.247739] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-07T18:41:39.047632] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-07T18:41:39.452738] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-07T18:41:39.847703] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-07T18:41:40.050001] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T18:41:40.241192] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-07T18:41:40.251280] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-07T18:41:40.647689] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-07T18:41:41.447698] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-07T18:41:42.155502] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T18:41:42.247709] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-07T18:41:43.047692] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-07T18:41:43.114837] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T18:41:43.715538] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T18:41:43.717977] [INFO ] [REMOTE ] EME: Full fetch complete (46902 records). [2025-10-07T18:41:43.718209] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-07T18:41:43.852750] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-07T18:41:43.952329] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T18:41:44.129633] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-07T18:41:44.129757] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-07T18:41:44.130415] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-07T18:41:44.130459] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-07T18:41:44.131694] [DEBUG] [LOCAL ] EME: Trimmed 46902 records to 31195 (keeping 200 days of data) [2025-10-07T18:41:44.338523] [DEBUG] [LOCAL ] EME: Primary data saved (31195 records). [2025-10-07T18:41:44.338705] [INFO ] [MAIN ] EME: Full history saved. [2025-10-07T18:41:44.338822] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EME took 27.7s. Estimated remaining: 3h 48m 5s. Rate: 7.2 symbols/min [2025-10-07T18:41:44.503815] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:44.517681] [DEBUG] [LOCAL ] EMO: Loaded 12701 existing records from primary storage. [2025-10-07T18:41:44.517878] [INFO ] [MAIN ] EMO: Loaded 12701 existing records. [2025-10-07T18:41:44.655123] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-07T18:41:44.695123] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:41:44.695297] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-07T18:41:44.695343] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-07T18:41:44.695570] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-07T18:41:44.695628] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-07T18:41:45.037934] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:45.254763] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T18:41:45.447952] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-07T18:41:45.826758] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-07T18:41:45.830366] [INFO ] [REMOTE ] ELV: Full fetch complete (73145 records). [2025-10-07T18:41:45.830529] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-07T18:41:46.223907] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-07T18:41:46.224045] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-07T18:41:46.224905] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-07T18:41:46.224969] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-07T18:41:46.226369] [DEBUG] [LOCAL ] ELV: Trimmed 73145 records to 50629 (keeping 200 days of data) [2025-10-07T18:41:46.290881] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-07T18:41:46.442463] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T18:41:46.582861] [DEBUG] [LOCAL ] ELV: Primary data saved (50629 records). [2025-10-07T18:41:46.583010] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-07T18:41:46.583095] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. ELV took 46.6s. Estimated remaining: 3h 47m 43s. Rate: 7.2 symbols/min [2025-10-07T18:41:46.710566] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-07T18:41:46.781629] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:46.788124] [DEBUG] [LOCAL ] EMP: Loaded 3074 existing records from primary storage. [2025-10-07T18:41:46.788366] [INFO ] [MAIN ] EMP: Loaded 3074 existing records. [2025-10-07T18:41:46.964128] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:41:46.964298] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-07T18:41:46.964347] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-07T18:41:46.964562] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-07T18:41:46.964621] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-07T18:41:47.052774] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-07T18:41:47.310546] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:47.847676] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-07T18:41:48.526937] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T18:41:48.646096] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T18:41:48.654730] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-07T18:41:49.447620] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-07T18:41:49.459128] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T18:41:50.247909] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-07T18:41:50.661716] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-07T18:41:51.047671] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-07T18:41:51.212488] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T18:41:51.381605] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-07T18:41:51.847686] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-07T18:41:52.647710] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-07T18:41:53.235721] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T18:41:53.447735] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-07T18:41:53.665115] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T18:41:54.053088] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T18:41:54.247734] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-07T18:41:54.879889] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-07T18:41:55.047734] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-07T18:41:55.155684] [DEBUG] [REMOTE ] EMF: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-07T18:41:55.155956] [WARN ] [REMOTE ] EMF: No data returned for month 2025-10 [2025-10-07T18:41:55.156046] [FATAL] [REMOTE ] EMF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:41:55.156184] [FATAL] [MAIN ] EMF: Failed to fetch primary data. [2025-10-07T18:41:55.156256] [WARN ] [MAIN ] EMF: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:41:55.156338] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-07T18:41:55.156433] [DEBUG] [LOCAL ] EMF: No primary data file found to delete. [2025-10-07T18:41:55.156494] [INFO ] [LOCAL ] EMF: Starting deletion of derivative data. [2025-10-07T18:41:55.156805] [DEBUG] [LOCAL ] EMF: Deleted derivative data file. [2025-10-07T18:41:55.156901] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMF took 24.2s. Estimated remaining: 3h 47m 36s. Rate: 7.2 symbols/min [2025-10-07T18:41:55.324489] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:41:55.377823] [DEBUG] [LOCAL ] EMR: Loaded 53243 existing records from primary storage. [2025-10-07T18:41:55.378190] [INFO ] [MAIN ] EMR: Loaded 53243 existing records. [2025-10-07T18:41:55.556186] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:41:55.556409] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-07T18:41:55.556457] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-07T18:41:55.556736] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-07T18:41:55.556794] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-07T18:41:55.852895] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-07T18:41:55.924213] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:41:56.647672] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-07T18:41:56.776031] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T18:41:57.447722] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-07T18:41:57.901462] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-07T18:41:58.247748] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-07T18:41:58.448312] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T18:41:59.036091] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T18:41:59.047629] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-07T18:41:59.847667] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-07T18:42:00.647702] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-07T18:42:01.036975] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T18:42:01.447671] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-07T18:42:01.515746] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T18:42:01.932847] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T18:42:02.247742] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-07T18:42:03.053282] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-07T18:42:03.061350] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T18:42:03.852117] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-07T18:42:03.856116] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T18:42:04.647761] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-07T18:42:05.425408] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-07T18:42:05.447601] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-07T18:42:05.693064] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T18:42:06.247750] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-07T18:42:06.523357] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T18:42:06.530980] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (4.28 seconds). [2025-10-07T18:42:07.047669] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-07T18:42:07.847679] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-07T18:42:07.956414] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T18:42:08.069340] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T18:42:08.409520] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-07T18:42:08.647699] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-07T18:42:09.447755] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-07T18:42:10.031809] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T18:42:10.247724] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-07T18:42:10.423720] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T18:42:11.047626] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-07T18:42:11.219433] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T18:42:11.847703] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-07T18:42:12.334375] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T18:42:12.647669] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-07T18:42:12.900033] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T18:42:13.447706] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-07T18:42:14.014279] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-07T18:42:14.091542] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T18:42:14.247687] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-07T18:42:15.047690] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-07T18:42:15.503071] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-07T18:42:15.847763] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-07T18:42:15.952824] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T18:42:15.956681] [INFO ] [REMOTE ] EMN: Full fetch complete (72118 records). [2025-10-07T18:42:15.956819] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-07T18:42:16.340280] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-07T18:42:16.340365] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-07T18:42:16.341184] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-07T18:42:16.341250] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-07T18:42:16.342852] [DEBUG] [LOCAL ] EMN: Trimmed 72118 records to 50612 (keeping 200 days of data) [2025-10-07T18:42:16.647757] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-07T18:42:16.665764] [DEBUG] [LOCAL ] EMN: Primary data saved (50612 records). [2025-10-07T18:42:16.665866] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-07T18:42:16.667489] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMN took 40.7s. Estimated remaining: 3h 47m 57s. Rate: 7.2 symbols/min [2025-10-07T18:42:16.837560] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T18:42:16.839807] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:42:16.841870] [INFO ] [REMOTE ] EMO: Full fetch complete (17431 records). [2025-10-07T18:42:16.841943] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-07T18:42:17.240830] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-07T18:42:17.240951] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-07T18:42:17.241361] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-07T18:42:17.241434] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-07T18:42:17.242122] [DEBUG] [LOCAL ] EMO: Trimmed 17431 records to 12812 (keeping 200 days of data) [2025-10-07T18:42:17.244451] [DEBUG] [LOCAL ] ENB: Loaded 53507 existing records from primary storage. [2025-10-07T18:42:17.302311] [INFO ] [MAIN ] ENB: Loaded 53507 existing records. [2025-10-07T18:42:17.369081] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T18:42:17.450669] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-07T18:42:17.495624] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:42:17.496837] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-07T18:42:17.498025] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-07T18:42:17.499409] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-07T18:42:17.500005] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-07T18:42:17.819250] [DEBUG] [LOCAL ] EMO: Primary data saved (12812 records). [2025-10-07T18:42:17.847796] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-07T18:42:17.874239] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMO took 33.5s. Estimated remaining: 3h 47m 32s. Rate: 7.2 symbols/min [2025-10-07T18:42:17.878698] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:42:18.051341] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:42:18.057347] [DEBUG] [LOCAL ] ENFY: Loaded 3206 existing records from primary storage. [2025-10-07T18:42:18.057699] [INFO ] [MAIN ] ENFY: Loaded 3206 existing records. [2025-10-07T18:42:18.136522] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T18:42:18.165065] [INFO ] [REMOTE ] EMP: Full fetch complete (4294 records). [2025-10-07T18:42:18.165350] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-07T18:42:18.252925] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-07T18:42:18.353263] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:42:18.364884] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-07T18:42:18.375290] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-07T18:42:18.427835] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-07T18:42:18.438128] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-07T18:42:18.808096] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-07T18:42:18.834954] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-07T18:42:18.871789] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-07T18:42:18.877417] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-07T18:42:18.903398] [DEBUG] [LOCAL ] EMP: Trimmed 4294 records to 3076 (keeping 200 days of data) [2025-10-07T18:42:18.972426] [DEBUG] [LOCAL ] EMP: Primary data saved (3076 records). [2025-10-07T18:42:18.997273] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-07T18:42:18.998542] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMP took 32.4s. Estimated remaining: 3h 47m 8s. Rate: 7.2 symbols/min [2025-10-07T18:42:19.002174] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:42:19.058928] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-07T18:42:19.180742] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:42:19.216073] [DEBUG] [LOCAL ] ENIC: Loaded 36237 existing records from primary storage. [2025-10-07T18:42:19.216396] [INFO ] [MAIN ] ENIC: Loaded 36237 existing records. [2025-10-07T18:42:19.408912] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:42:19.409200] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-07T18:42:19.409265] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-07T18:42:19.409724] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-07T18:42:19.409796] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-07T18:42:19.783147] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:42:19.847691] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-07T18:42:20.105312] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T18:42:20.246530] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T18:42:20.647770] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-07T18:42:21.130188] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T18:42:21.447718] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-07T18:42:22.247692] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-07T18:42:22.482876] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T18:42:23.047684] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-07T18:42:23.455513] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-07T18:42:23.730873] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T18:42:23.847739] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-07T18:42:24.647617] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-07T18:42:24.985848] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T18:42:25.054883] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-07T18:42:25.389448] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T18:42:25.447689] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-07T18:42:26.247777] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-07T18:42:26.911232] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T18:42:27.047921] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-07T18:42:27.476805] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-07T18:42:27.847697] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-07T18:42:28.523564] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T18:42:28.647713] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-07T18:42:29.447637] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-07T18:42:29.676894] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T18:42:30.177851] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T18:42:30.247620] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-07T18:42:30.975452] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T18:42:31.047621] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-07T18:42:31.847624] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-07T18:42:32.094086] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:42:32.571624] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T18:42:32.647674] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-07T18:42:33.040828] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-07T18:42:33.447713] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-07T18:42:33.612747] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T18:42:34.247733] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-07T18:42:34.831459] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:42:35.047712] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-07T18:42:35.431368] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-07T18:42:35.847691] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-07T18:42:35.948231] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T18:42:36.405002] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T18:42:36.647707] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-07T18:42:37.447717] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-07T18:42:38.247705] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-07T18:42:38.518822] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T18:42:38.594931] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-07T18:42:38.970492] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T18:42:39.047708] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-07T18:42:39.847720] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-07T18:42:40.427688] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T18:42:40.647695] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-07T18:42:40.655044] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T18:42:41.447746] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-07T18:42:42.247688] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-07T18:42:42.603302] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T18:42:42.833188] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T18:42:43.047738] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-07T18:42:43.633120] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-07T18:42:43.847623] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-07T18:42:43.913722] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T18:42:43.919181] [INFO ] [REMOTE ] EMR: Full fetch complete (77097 records). [2025-10-07T18:42:43.919373] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-07T18:42:44.323017] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-07T18:42:44.436318] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-07T18:42:44.436412] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-07T18:42:44.437401] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-07T18:42:44.437473] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-07T18:42:44.439923] [DEBUG] [LOCAL ] EMR: Trimmed 77097 records to 53240 (keeping 200 days of data) [2025-10-07T18:42:44.651877] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-07T18:42:44.829557] [DEBUG] [LOCAL ] EMR: Primary data saved (53240 records). [2025-10-07T18:42:44.829755] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-07T18:42:44.829914] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMR took 49.7s. Estimated remaining: 3h 47m 39s. Rate: 7.2 symbols/min [2025-10-07T18:42:45.050343] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:42:45.050568] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-07T18:42:45.050637] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-07T18:42:45.050794] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-07T18:42:45.050856] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-07T18:42:45.050942] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-07T18:42:45.050993] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-07T18:42:45.429515] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:42:45.447594] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-07T18:42:45.863308] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T18:42:45.867011] [INFO ] [REMOTE ] ENIC: Full fetch complete (51397 records). [2025-10-07T18:42:45.867341] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-07T18:42:46.128860] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T18:42:46.251737] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-07T18:42:46.296294] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-07T18:42:46.296415] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-07T18:42:46.297936] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-07T18:42:46.298199] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-07T18:42:46.300266] [DEBUG] [LOCAL ] ENIC: Trimmed 51397 records to 36328 (keeping 200 days of data) [2025-10-07T18:42:46.532314] [DEBUG] [LOCAL ] ENIC: Primary data saved (36328 records). [2025-10-07T18:42:46.532559] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-07T18:42:46.532749] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENIC took 27.5s. Estimated remaining: 3h 47m 15s. Rate: 7.2 symbols/min [2025-10-07T18:42:46.728153] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:42:46.733025] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T18:42:46.788010] [DEBUG] [LOCAL ] ENOV: Loaded 44760 existing records from primary storage. [2025-10-07T18:42:46.788449] [INFO ] [MAIN ] ENOV: Loaded 44760 existing records. [2025-10-07T18:42:46.974020] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:42:46.974358] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-07T18:42:46.974421] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-07T18:42:46.974930] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-07T18:42:46.975014] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-07T18:42:47.052936] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-07T18:42:47.353342] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:42:47.847681] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-07T18:42:48.647670] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-07T18:42:48.707444] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T18:42:49.096309] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-07T18:42:49.342798] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T18:42:49.447689] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-07T18:42:49.895709] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-07T18:42:49.896609] [INFO ] [REMOTE ] ENFY: Full fetch complete (5561 records). [2025-10-07T18:42:49.896714] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-07T18:42:50.252805] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-07T18:42:50.292802] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-07T18:42:50.292905] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-07T18:42:50.293174] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-07T18:42:50.293216] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-07T18:42:50.293613] [DEBUG] [LOCAL ] ENFY: Trimmed 5561 records to 3219 (keeping 200 days of data) [2025-10-07T18:42:50.315453] [DEBUG] [LOCAL ] ENFY: Primary data saved (3219 records). [2025-10-07T18:42:50.315573] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-07T18:42:50.315692] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENFY took 32.4s. Estimated remaining: 3h 46m 57s. Rate: 7.2 symbols/min [2025-10-07T18:42:50.486424] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:42:50.528849] [DEBUG] [LOCAL ] ENR: Loaded 43088 existing records from primary storage. [2025-10-07T18:42:50.529199] [INFO ] [MAIN ] ENR: Loaded 43088 existing records. [2025-10-07T18:42:50.702167] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:42:50.702437] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-07T18:42:50.702486] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-07T18:42:50.702764] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-07T18:42:50.702821] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-07T18:42:51.045031] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:42:51.047606] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-07T18:42:51.782839] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T18:42:51.847616] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-07T18:42:52.354409] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T18:42:52.647685] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-07T18:42:53.452717] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-07T18:42:53.466736] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T18:42:54.083083] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T18:42:54.247756] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-07T18:42:55.047755] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-07T18:42:55.418228] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T18:42:55.462242] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T18:42:55.847739] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-07T18:42:56.287101] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T18:42:56.647747] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-07T18:42:57.324126] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T18:42:57.447748] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-07T18:42:57.975387] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T18:42:58.012215] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T18:42:58.247706] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-07T18:42:59.047693] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-07T18:42:59.847763] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-07T18:43:00.210305] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-07T18:43:00.401898] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T18:43:00.647754] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-07T18:43:01.447733] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-07T18:43:01.510176] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T18:43:02.247785] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-07T18:43:02.578144] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T18:43:02.874529] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-07T18:43:03.029727] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T18:43:03.047607] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-07T18:43:03.847625] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-07T18:43:04.647717] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-07T18:43:04.809554] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T18:43:05.447752] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-07T18:43:05.536022] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-07T18:43:05.541073] [INFO ] [REMOTE ] ENB: Full fetch complete (77488 records). [2025-10-07T18:43:05.541223] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-07T18:43:05.930320] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-07T18:43:05.930409] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-07T18:43:05.931367] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-07T18:43:05.931437] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-07T18:43:05.933011] [DEBUG] [LOCAL ] ENB: Trimmed 77488 records to 53509 (keeping 200 days of data) [2025-10-07T18:43:06.261819] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-07T18:43:06.289309] [DEBUG] [LOCAL ] ENB: Primary data saved (53509 records). [2025-10-07T18:43:06.289468] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-07T18:43:06.290372] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENB took 49.6s. Estimated remaining: 3h 47m 5s. Rate: 7.2 symbols/min [2025-10-07T18:43:06.462208] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:43:06.498683] [DEBUG] [LOCAL ] ENS: Loaded 29382 existing records from primary storage. [2025-10-07T18:43:06.498974] [INFO ] [MAIN ] ENS: Loaded 29382 existing records. [2025-10-07T18:43:06.681388] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:43:06.681698] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-07T18:43:06.681946] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-07T18:43:06.682381] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-07T18:43:06.682443] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-07T18:43:06.768036] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-07T18:43:06.974065] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-07T18:43:07.052497] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-07T18:43:07.115794] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:43:07.147859] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T18:43:07.847700] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-07T18:43:08.647681] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-07T18:43:08.708309] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T18:43:09.093222] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T18:43:09.187578] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T18:43:09.447703] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-07T18:43:09.910092] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T18:43:10.247675] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-07T18:43:10.689186] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T18:43:11.047687] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-07T18:43:11.847708] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-07T18:43:12.224596] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-07T18:43:12.642023] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T18:43:12.651623] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-07T18:43:13.447714] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-07T18:43:13.821530] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T18:43:14.247691] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-07T18:43:14.859270] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T18:43:15.047739] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-07T18:43:15.405769] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-07T18:43:15.406487] [INFO ] [REMOTE ] ENO: Full fetch complete (3088 records). [2025-10-07T18:43:15.406573] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-07T18:43:15.406972] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:43:15.407055] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:43:15.407098] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:43:15.407136] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-07T18:43:15.407191] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-07T18:43:15.407226] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-10-07T18:43:15.407264] [DEBUG] [LOCAL ] ENO: No derivative data file found to delete. [2025-10-07T18:43:15.407335] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENO took 30.6s. Estimated remaining: 3h 46m 59s. Rate: 7.2 symbols/min [2025-10-07T18:43:15.575197] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:43:15.593335] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T18:43:15.620390] [DEBUG] [LOCAL ] ENVA: Loaded 25317 existing records from primary storage. [2025-10-07T18:43:15.620686] [INFO ] [MAIN ] ENVA: Loaded 25317 existing records. [2025-10-07T18:43:15.792110] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:43:15.792328] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-07T18:43:15.792374] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-07T18:43:15.792597] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-07T18:43:15.792694] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-07T18:43:15.852915] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-07T18:43:16.145896] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:43:16.647679] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-07T18:43:17.447713] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-07T18:43:17.694617] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T18:43:17.792128] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T18:43:18.247713] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-07T18:43:18.676476] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T18:43:18.679267] [INFO ] [REMOTE ] ENOV: Full fetch complete (63352 records). [2025-10-07T18:43:18.679379] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-07T18:43:19.054010] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-07T18:43:19.076128] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-07T18:43:19.076212] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-07T18:43:19.077228] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-07T18:43:19.077295] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-07T18:43:19.078869] [DEBUG] [LOCAL ] ENOV: Trimmed 63352 records to 44787 (keeping 200 days of data) [2025-10-07T18:43:19.352471] [DEBUG] [LOCAL ] ENOV: Primary data saved (44787 records). [2025-10-07T18:43:19.352609] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-07T18:43:19.352726] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENOV took 32.8s. Estimated remaining: 3h 46m 41s. Rate: 7.2 symbols/min [2025-10-07T18:43:19.534779] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:43:19.557458] [DEBUG] [LOCAL ] EOD: Loaded 14608 existing records from primary storage. [2025-10-07T18:43:19.557904] [INFO ] [MAIN ] EOD: Loaded 14608 existing records. [2025-10-07T18:43:19.683575] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T18:43:19.771008] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:43:19.771217] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-07T18:43:19.771264] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-07T18:43:19.771442] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-07T18:43:19.771499] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-07T18:43:19.853187] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-07T18:43:20.125684] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:43:20.176208] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T18:43:20.647729] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-07T18:43:20.987386] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T18:43:21.446502] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T18:43:21.448962] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-07T18:43:22.247763] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-07T18:43:22.902419] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-07T18:43:22.906562] [INFO ] [REMOTE ] ENR: Full fetch complete (58920 records). [2025-10-07T18:43:22.906775] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-07T18:43:23.054232] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-07T18:43:23.308568] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T18:43:23.332824] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-07T18:43:23.332912] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-07T18:43:23.333630] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-07T18:43:23.333725] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-07T18:43:23.335385] [DEBUG] [LOCAL ] ENR: Trimmed 58920 records to 43186 (keeping 200 days of data) [2025-10-07T18:43:23.609105] [DEBUG] [LOCAL ] ENR: Primary data saved (43186 records). [2025-10-07T18:43:23.609248] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-07T18:43:23.609332] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENR took 33.3s. Estimated remaining: 3h 46m 23s. Rate: 7.2 symbols/min [2025-10-07T18:43:23.776802] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:43:23.829051] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-07T18:43:23.829402] [INFO ] [MAIN ] EOG: Loaded 53344 existing records. [2025-10-07T18:43:23.859228] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-07T18:43:24.018461] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:43:24.018843] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-07T18:43:24.018897] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-07T18:43:24.019109] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-07T18:43:24.019167] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-07T18:43:24.394286] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:43:24.411549] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T18:43:24.647728] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-07T18:43:25.163632] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T18:43:25.447747] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-07T18:43:26.247711] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-07T18:43:26.506405] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T18:43:26.729735] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-07T18:43:26.790015] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T18:43:27.047705] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-07T18:43:27.847742] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-07T18:43:28.256037] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T18:43:28.351372] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-07T18:43:28.647677] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-07T18:43:29.447721] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-07T18:43:29.476942] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T18:43:30.247687] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-07T18:43:30.660674] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T18:43:31.047628] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-07T18:43:31.614804] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T18:43:31.651256] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T18:43:31.847685] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-07T18:43:32.647710] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-07T18:43:32.996146] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T18:43:33.266854] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T18:43:33.447717] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-07T18:43:34.247693] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-07T18:43:35.047754] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-07T18:43:35.220285] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T18:43:35.683248] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T18:43:35.847684] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-07T18:43:36.434409] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T18:43:36.647682] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-07T18:43:36.991519] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T18:43:37.447620] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-07T18:43:37.746939] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T18:43:38.247693] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-07T18:43:38.517097] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T18:43:39.047636] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-07T18:43:39.166819] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T18:43:39.847620] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-07T18:43:40.305314] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-07T18:43:40.647827] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-07T18:43:40.737193] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T18:43:41.447762] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-07T18:43:42.247633] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-07T18:43:42.294117] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T18:43:42.358764] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T18:43:42.967374] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T18:43:42.969130] [INFO ] [REMOTE ] EOD: Full fetch complete (20583 records). [2025-10-07T18:43:42.969258] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-07T18:43:43.052760] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-07T18:43:43.329102] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-07T18:43:43.329184] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-07T18:43:43.329584] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-07T18:43:43.329624] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-07T18:43:43.330206] [DEBUG] [LOCAL ] EOD: Trimmed 20583 records to 14699 (keeping 200 days of data) [2025-10-07T18:43:43.414950] [DEBUG] [LOCAL ] EOD: Primary data saved (14699 records). [2025-10-07T18:43:43.415089] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-07T18:43:43.415170] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. EOD took 24.1s. Estimated remaining: 3h 46m 40s. Rate: 7.2 symbols/min [2025-10-07T18:43:43.582932] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:43:43.596847] [DEBUG] [LOCAL ] EOI: Loaded 10822 existing records from primary storage. [2025-10-07T18:43:43.597090] [INFO ] [MAIN ] EOI: Loaded 10822 existing records. [2025-10-07T18:43:43.779926] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:43:43.780154] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-07T18:43:43.780205] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-07T18:43:43.780407] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-07T18:43:43.780467] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-07T18:43:43.852812] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-07T18:43:44.140813] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:43:44.647713] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-07T18:43:44.826689] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T18:43:45.244621] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T18:43:45.247107] [INFO ] [REMOTE ] ENS: Full fetch complete (42228 records). [2025-10-07T18:43:45.247227] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-07T18:43:45.455175] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-07T18:43:45.622199] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-07T18:43:45.622295] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-07T18:43:45.622868] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-07T18:43:45.622931] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-07T18:43:45.623808] [DEBUG] [LOCAL ] ENS: Trimmed 42228 records to 29309 (keeping 200 days of data) [2025-10-07T18:43:45.805062] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T18:43:45.826758] [DEBUG] [LOCAL ] ENS: Primary data saved (29309 records). [2025-10-07T18:43:45.826918] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-07T18:43:45.827007] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENS took 39.5s. Estimated remaining: 3h 46m 19s. Rate: 7.2 symbols/min [2025-10-07T18:43:45.990299] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:43:46.007697] [DEBUG] [LOCAL ] EOS: Loaded 15387 existing records from primary storage. [2025-10-07T18:43:46.007961] [INFO ] [MAIN ] EOS: Loaded 15387 existing records. [2025-10-07T18:43:46.183026] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:43:46.183259] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-07T18:43:46.183346] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-07T18:43:46.183575] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-07T18:43:46.183632] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-07T18:43:46.255740] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-07T18:43:46.530667] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:43:47.035224] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T18:43:47.047751] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-07T18:43:47.558970] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-07T18:43:47.847627] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-07T18:43:47.925683] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T18:43:48.647702] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-07T18:43:49.117905] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T18:43:49.447688] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-07T18:43:49.472814] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T18:43:50.247732] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-07T18:43:51.047634] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-07T18:43:51.261961] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T18:43:51.288711] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T18:43:51.847625] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-07T18:43:52.252432] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T18:43:52.616267] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T18:43:52.647796] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-07T18:43:53.447707] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-07T18:43:53.621221] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T18:43:54.247696] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-07T18:43:54.355428] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T18:43:54.357543] [INFO ] [REMOTE ] ENVA: Full fetch complete (36734 records). [2025-10-07T18:43:54.357678] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-07T18:43:54.833311] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-07T18:43:54.833440] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-07T18:43:54.834160] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-07T18:43:54.834255] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-07T18:43:54.835598] [DEBUG] [LOCAL ] ENVA: Trimmed 36734 records to 25309 (keeping 200 days of data) [2025-10-07T18:43:55.052835] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-07T18:43:55.071247] [DEBUG] [LOCAL ] ENVA: Primary data saved (25309 records). [2025-10-07T18:43:55.071444] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-07T18:43:55.071592] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. ENVA took 39.7s. Estimated remaining: 3h 46m 12s. Rate: 7.2 symbols/min [2025-10-07T18:43:55.308314] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:43:55.318670] [DEBUG] [LOCAL ] EOT: Loaded 6792 existing records from primary storage. [2025-10-07T18:43:55.318942] [INFO ] [MAIN ] EOT: Loaded 6792 existing records. [2025-10-07T18:43:55.509085] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:43:55.509413] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-07T18:43:55.509467] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-07T18:43:55.509873] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-07T18:43:55.509931] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-07T18:43:55.849076] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-07T18:43:55.865167] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T18:43:55.893338] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:43:56.132832] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-07T18:43:56.476980] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T18:43:56.647696] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-07T18:43:57.447689] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-07T18:43:57.706268] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T18:43:58.247676] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-07T18:43:59.054832] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-07T18:43:59.056063] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T18:43:59.313206] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T18:43:59.789847] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T18:43:59.847669] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-07T18:44:00.516494] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-07T18:44:00.647664] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-07T18:44:01.438067] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T18:44:01.447629] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-07T18:44:02.247722] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-07T18:44:02.304024] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T18:44:03.047701] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-07T18:44:03.453733] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T18:44:03.697732] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T18:44:03.699242] [INFO ] [REMOTE ] EOI: Full fetch complete (16275 records). [2025-10-07T18:44:03.699334] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-07T18:44:03.856989] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-07T18:44:04.076459] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-07T18:44:04.076537] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-07T18:44:04.076919] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-07T18:44:04.076981] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-07T18:44:04.077476] [DEBUG] [LOCAL ] EOI: Trimmed 16275 records to 10811 (keeping 200 days of data) [2025-10-07T18:44:04.144781] [DEBUG] [LOCAL ] EOI: Primary data saved (10811 records). [2025-10-07T18:44:04.144920] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-07T18:44:04.145006] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOI took 20.7s. Estimated remaining: 3h 46m 6s. Rate: 7.2 symbols/min [2025-10-07T18:44:04.317501] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:44:04.317729] [DEBUG] [LOCAL ] EPAC: No existing data file found in primary storage. [2025-10-07T18:44:04.317785] [WARN ] [MAIN ] EPAC: No existing data found, performing full refresh instead. [2025-10-07T18:44:04.317899] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-07T18:44:04.317943] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-07T18:44:04.317986] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-10-07T18:44:04.318019] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-07T18:44:04.652722] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-07T18:44:04.714937] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:44:05.382254] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T18:44:05.447621] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-07T18:44:05.670861] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T18:44:06.247621] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-07T18:44:06.597679] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T18:44:07.047677] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-07T18:44:07.847671] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-07T18:44:07.907753] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T18:44:08.261408] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T18:44:08.647691] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-07T18:44:08.688876] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-07T18:44:09.447726] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-07T18:44:09.541303] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-07T18:44:10.091191] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T18:44:10.247728] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-07T18:44:11.047709] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-07T18:44:11.513310] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-07T18:44:11.540479] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T18:44:11.847755] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-07T18:44:12.647706] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-07T18:44:13.365993] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T18:44:13.447728] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-07T18:44:13.720934] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-07T18:44:13.724477] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-07T18:44:13.724619] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-07T18:44:14.151678] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-07T18:44:14.155693] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-07T18:44:14.160410] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-07T18:44:14.160856] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-07T18:44:14.160743] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-07T18:44:14.165445] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 53344 (keeping 200 days of data) [2025-10-07T18:44:14.266950] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-07T18:44:14.515565] [DEBUG] [LOCAL ] EOG: Primary data saved (53344 records). [2025-10-07T18:44:14.515738] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-07T18:44:14.515881] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOG took 50.9s. Estimated remaining: 3h 46m 2s. Rate: 7.2 symbols/min [2025-10-07T18:44:14.682319] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:44:14.723242] [DEBUG] [LOCAL ] EPAM: Loaded 39686 existing records from primary storage. [2025-10-07T18:44:14.723537] [INFO ] [MAIN ] EPAM: Loaded 39686 existing records. [2025-10-07T18:44:14.896613] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:44:14.896836] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-07T18:44:14.896884] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-07T18:44:14.897153] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-07T18:44:14.897211] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-07T18:44:15.051954] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-07T18:44:15.251604] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:44:15.425000] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T18:44:15.847734] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-07T18:44:15.885026] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T18:44:16.647748] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-07T18:44:17.122884] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T18:44:17.447631] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-07T18:44:17.457485] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T18:44:18.247678] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-07T18:44:19.047698] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-07T18:44:19.091973] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-07T18:44:19.847375] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-07T18:44:19.848531] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-07T18:44:19.848719] [INFO ] [REMOTE ] EOT: Full fetch complete (10699 records). [2025-10-07T18:44:19.848805] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-07T18:44:20.210847] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-07T18:44:20.210925] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-07T18:44:20.211241] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-07T18:44:20.211303] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-07T18:44:20.211751] [DEBUG] [LOCAL ] EOT: Trimmed 10699 records to 6766 (keeping 200 days of data) [2025-10-07T18:44:20.252802] [DEBUG] [LOCAL ] EOT: Primary data saved (6766 records). [2025-10-07T18:44:20.252901] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-07T18:44:20.252977] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOT took 25.2s. Estimated remaining: 3h 45m 48s. Rate: 7.2 symbols/min [2025-10-07T18:44:20.419133] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:44:20.419343] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-07T18:44:20.419390] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-07T18:44:20.419509] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-07T18:44:20.419552] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-07T18:44:20.419596] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-07T18:44:20.419699] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-07T18:44:20.655822] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-07T18:44:20.712450] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T18:44:20.754865] [INFO ] [REMOTE ] EOS: Full fetch complete (23479 records). [2025-10-07T18:44:20.790954] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-07T18:44:20.796887] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:44:21.154416] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-10-07T18:44:21.234244] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-07T18:44:21.234328] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-07T18:44:21.234832] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-07T18:44:21.234898] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-07T18:44:21.235555] [DEBUG] [LOCAL ] EOS: Trimmed 23479 records to 15413 (keeping 200 days of data) [2025-10-07T18:44:21.333530] [DEBUG] [LOCAL ] EOS: Primary data saved (15413 records). [2025-10-07T18:44:21.333718] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-07T18:44:21.333818] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOS took 35.5s. Estimated remaining: 3h 45m 24s. Rate: 7.2 symbols/min [2025-10-07T18:44:21.452880] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-07T18:44:21.507485] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:44:21.563621] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-07T18:44:21.564025] [INFO ] [MAIN ] EPD: Loaded 53611 existing records. [2025-10-07T18:44:21.747237] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:44:21.747477] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-07T18:44:21.747560] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-07T18:44:21.747989] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-07T18:44:21.748064] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-07T18:44:22.128826] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T18:44:22.134132] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:44:22.247635] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-07T18:44:22.923367] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T18:44:23.047617] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-07T18:44:23.847737] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-07T18:44:23.931043] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T18:44:24.391327] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T18:44:24.647738] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-07T18:44:25.127173] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T18:44:25.447629] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-07T18:44:26.247706] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-07T18:44:26.574845] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T18:44:26.963572] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T18:44:27.047722] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-07T18:44:27.356880] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T18:44:27.847694] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-07T18:44:28.641567] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T18:44:28.650806] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-07T18:44:29.363963] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T18:44:29.447600] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-07T18:44:29.813068] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T18:44:30.247695] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-07T18:44:31.047724] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-07T18:44:31.268819] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T18:44:31.431511] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T18:44:31.847694] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-07T18:44:32.647796] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-07T18:44:32.801778] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T18:44:33.447625] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-07T18:44:33.932134] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-07T18:44:34.047797] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T18:44:34.247707] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-07T18:44:34.358488] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-07T18:44:35.047799] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-07T18:44:35.847701] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-07T18:44:36.212069] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T18:44:36.345351] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T18:44:36.647700] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-07T18:44:37.264037] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T18:44:37.447693] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-07T18:44:38.247680] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-07T18:44:38.411215] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T18:44:39.000284] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T18:44:39.047613] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-07T18:44:39.448574] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-07T18:44:39.847705] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-07T18:44:40.274876] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T18:44:40.647720] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-07T18:44:41.295132] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T18:44:41.447620] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-07T18:44:41.823548] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T18:44:42.247748] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-07T18:44:43.047676] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-07T18:44:43.157570] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T18:44:43.847713] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-07T18:44:44.087063] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T18:44:44.331544] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T18:44:44.647693] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-07T18:44:45.139332] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T18:44:45.447690] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-07T18:44:46.247730] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-07T18:44:46.831664] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-07T18:44:47.039146] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T18:44:47.049297] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-07T18:44:47.643953] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T18:44:47.847703] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-07T18:44:48.647699] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-07T18:44:48.860638] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T18:44:48.861427] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T18:44:48.878118] [INFO ] [REMOTE ] EPAC: Full fetch complete (38914 records). [2025-10-07T18:44:48.878256] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-07T18:44:49.243113] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-07T18:44:49.243206] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-07T18:44:49.243772] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-07T18:44:49.243849] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-07T18:44:49.244729] [DEBUG] [LOCAL ] EPAC: Trimmed 38914 records to 26790 (keeping 200 days of data) [2025-10-07T18:44:49.408958] [DEBUG] [LOCAL ] EPAC: Primary data saved (26790 records). [2025-10-07T18:44:49.409093] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-07T18:44:49.409172] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 45.3s. Estimated remaining: 3h 45m 58s. Rate: 7.2 symbols/min [2025-10-07T18:44:49.452831] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-07T18:44:49.576240] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:44:49.620839] [DEBUG] [LOCAL ] EPR: Loaded 43944 existing records from primary storage. [2025-10-07T18:44:49.621151] [INFO ] [MAIN ] EPR: Loaded 43944 existing records. [2025-10-07T18:44:49.801570] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:44:49.802582] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-07T18:44:49.802663] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-07T18:44:49.804153] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-07T18:44:49.804213] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-07T18:44:50.160142] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:44:50.202024] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T18:44:50.247608] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-07T18:44:51.047697] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-07T18:44:51.194357] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-07T18:44:51.197914] [INFO ] [REMOTE ] EPD: Full fetch complete (77251 records). [2025-10-07T18:44:51.198092] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-07T18:44:51.199241] [FATAL] [VALIDATOR ] EPD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:44:51.199372] [FATAL] [MAIN ] EPD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:44:51.199417] [WARN ] [MAIN ] EPD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:44:51.199461] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-07T18:44:51.199522] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-07T18:44:51.199572] [INFO ] [LOCAL ] EPD: Starting deletion of derivative data. [2025-10-07T18:44:51.200009] [DEBUG] [LOCAL ] EPD: Deleted derivative data file. [2025-10-07T18:44:51.202517] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPD took 29.9s. Estimated remaining: 3h 45m 35s. Rate: 7.2 symbols/min [2025-10-07T18:44:51.377702] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:44:51.432384] [DEBUG] [LOCAL ] EPRT: Loaded 48481 existing records from primary storage. [2025-10-07T18:44:51.432742] [INFO ] [MAIN ] EPRT: Loaded 48481 existing records. [2025-10-07T18:44:51.607908] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:44:51.608200] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-07T18:44:51.608249] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-07T18:44:51.609623] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-07T18:44:51.609708] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-07T18:44:51.789197] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T18:44:51.862300] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-07T18:44:51.895581] [INFO ] [REMOTE ] EPAM: Full fetch complete (56054 records). [2025-10-07T18:44:51.895834] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-07T18:44:52.087397] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:44:52.373740] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-07T18:44:52.373901] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-07T18:44:52.374812] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-07T18:44:52.374950] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-07T18:44:52.376154] [DEBUG] [LOCAL ] EPAM: Trimmed 56054 records to 39563 (keeping 200 days of data) [2025-10-07T18:44:52.497351] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T18:44:52.649358] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-07T18:44:52.650451] [DEBUG] [LOCAL ] EPAM: Primary data saved (39563 records). [2025-10-07T18:44:52.650594] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-07T18:44:52.650724] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPAM took 38.1s. Estimated remaining: 3h 45m 12s. Rate: 7.2 symbols/min [2025-10-07T18:44:52.822360] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:44:52.822530] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-07T18:44:52.822569] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-07T18:44:52.822706] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-07T18:44:52.822760] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-07T18:44:52.822808] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-07T18:44:52.822841] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-07T18:44:53.168744] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:44:53.447700] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-07T18:44:53.719681] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T18:44:54.144975] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T18:44:54.247710] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-07T18:44:54.348872] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-07T18:44:55.047729] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-07T18:44:55.579603] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T18:44:55.847679] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-07T18:44:56.413392] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T18:44:56.416190] [INFO ] [REMOTE ] EPC: Full fetch complete (57116 records). [2025-10-07T18:44:56.416275] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-07T18:44:56.653283] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-07T18:44:56.806523] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-07T18:44:56.806625] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-07T18:44:56.807395] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-07T18:44:56.807450] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-07T18:44:56.809213] [DEBUG] [LOCAL ] EPC: Trimmed 57116 records to 39861 (keeping 200 days of data) [2025-10-07T18:44:57.050892] [DEBUG] [LOCAL ] EPC: Primary data saved (39861 records). [2025-10-07T18:44:57.051043] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-07T18:44:57.051120] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPC took 36.8s. Estimated remaining: 3h 44m 55s. Rate: 7.2 symbols/min [2025-10-07T18:44:57.221676] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:44:57.275730] [DEBUG] [LOCAL ] EQH: Loaded 52656 existing records from primary storage. [2025-10-07T18:44:57.276095] [INFO ] [MAIN ] EQH: Loaded 52656 existing records. [2025-10-07T18:44:57.460518] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:44:57.490899] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-07T18:44:57.456243] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-07T18:44:57.491015] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-07T18:44:57.494817] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-07T18:44:57.494692] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T18:44:57.495095] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-07T18:44:57.860397] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:44:58.226751] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T18:44:58.247613] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-07T18:44:58.370521] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T18:44:59.047693] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-07T18:44:59.698485] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-07T18:44:59.847617] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-07T18:44:59.916885] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T18:45:00.647683] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-07T18:45:01.447677] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-07T18:45:01.494014] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T18:45:01.578746] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T18:45:02.247680] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-07T18:45:03.047689] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-07T18:45:03.315013] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T18:45:03.406084] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T18:45:03.847683] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-07T18:45:04.610441] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T18:45:04.647701] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-07T18:45:05.378896] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T18:45:05.447612] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-07T18:45:06.247627] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-07T18:45:06.427252] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T18:45:07.047670] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-07T18:45:07.128727] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T18:45:07.620447] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T18:45:07.847694] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-07T18:45:08.414134] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T18:45:08.647761] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-07T18:45:09.447724] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-07T18:45:09.714427] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T18:45:10.247676] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-07T18:45:10.343738] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T18:45:10.453313] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T18:45:11.047743] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-07T18:45:11.847696] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-07T18:45:12.013312] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T18:45:12.646822] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T18:45:12.656084] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-07T18:45:13.457050] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-07T18:45:13.462910] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:45:14.247707] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-07T18:45:14.530383] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T18:45:14.980765] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T18:45:14.993479] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T18:45:15.047622] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-07T18:45:15.847720] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-07T18:45:16.647741] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-07T18:45:16.770613] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T18:45:17.137349] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T18:45:17.447704] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-07T18:45:18.126751] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T18:45:18.233110] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T18:45:18.247592] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-07T18:45:19.047687] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-07T18:45:19.326000] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T18:45:19.847672] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-07T18:45:20.647631] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-07T18:45:20.808209] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T18:45:21.447759] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-07T18:45:21.546603] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T18:45:21.567976] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T18:45:22.247704] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-07T18:45:22.782391] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T18:45:22.785481] [INFO ] [REMOTE ] EPR: Full fetch complete (62749 records). [2025-10-07T18:45:22.785631] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-07T18:45:22.787691] [FATAL] [VALIDATOR ] EPR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:45:22.787957] [FATAL] [MAIN ] EPR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:45:22.788030] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:45:22.788134] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-07T18:45:22.788256] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-07T18:45:22.788317] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-10-07T18:45:22.788571] [DEBUG] [LOCAL ] EPR: Deleted derivative data file. [2025-10-07T18:45:22.788767] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 33.4s. Estimated remaining: 3h 45m 24s. Rate: 7.2 symbols/min [2025-10-07T18:45:22.970806] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:45:23.032547] [DEBUG] [LOCAL ] EQNR: Loaded 53023 existing records from primary storage. [2025-10-07T18:45:23.033043] [INFO ] [MAIN ] EQNR: Loaded 53023 existing records. [2025-10-07T18:45:23.053437] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-07T18:45:23.170548] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T18:45:23.226552] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:45:23.226832] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-07T18:45:23.226881] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-07T18:45:23.228125] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-07T18:45:23.228187] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-07T18:45:23.573886] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:45:23.847724] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-07T18:45:24.647723] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-07T18:45:24.946424] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T18:45:25.447768] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-07T18:45:25.782905] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T18:45:25.965186] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T18:45:26.247735] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-07T18:45:27.047755] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-07T18:45:27.113677] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T18:45:27.586009] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T18:45:27.587232] [INFO ] [REMOTE ] EQBK: Full fetch complete (15532 records). [2025-10-07T18:45:27.587305] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-07T18:45:27.858138] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-07T18:45:27.950265] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-07T18:45:27.950361] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-07T18:45:27.950814] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-07T18:45:27.950876] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-07T18:45:27.951382] [DEBUG] [LOCAL ] EQBK: Trimmed 15532 records to 10957 (keeping 200 days of data) [2025-10-07T18:45:28.023512] [DEBUG] [LOCAL ] EQBK: Primary data saved (10957 records). [2025-10-07T18:45:28.023667] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-07T18:45:28.023772] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EQBK took 35.4s. Estimated remaining: 3h 45m 9s. Rate: 7.2 symbols/min [2025-10-07T18:45:28.226485] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:45:28.255216] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-07T18:45:28.310521] [DEBUG] [LOCAL ] EQR: Loaded 51571 existing records from primary storage. [2025-10-07T18:45:28.310860] [INFO ] [MAIN ] EQR: Loaded 51571 existing records. [2025-10-07T18:45:28.488070] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:45:28.488286] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-07T18:45:28.488333] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-07T18:45:28.489950] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-07T18:45:28.490010] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-07T18:45:28.658882] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-07T18:45:28.841208] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:45:29.447629] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-07T18:45:29.577238] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T18:45:30.236492] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T18:45:30.247608] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-07T18:45:30.874337] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T18:45:30.877829] [INFO ] [REMOTE ] EPRT: Full fetch complete (68596 records). [2025-10-07T18:45:30.877931] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-07T18:45:30.878699] [FATAL] [VALIDATOR ] EPRT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:45:30.878786] [FATAL] [MAIN ] EPRT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:45:30.878829] [WARN ] [MAIN ] EPRT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:45:30.878908] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-07T18:45:30.878985] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-07T18:45:30.879021] [INFO ] [LOCAL ] EPRT: Starting deletion of derivative data. [2025-10-07T18:45:30.879218] [DEBUG] [LOCAL ] EPRT: Deleted derivative data file. [2025-10-07T18:45:30.879984] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 39.7s. Estimated remaining: 3h 44m 49s. Rate: 7.2 symbols/min [2025-10-07T18:45:31.047717] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-07T18:45:31.847635] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-07T18:45:32.089194] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T18:45:32.628107] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T18:45:32.631189] [INFO ] [REMOTE ] EQH: Full fetch complete (76008 records). [2025-10-07T18:45:32.631322] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-07T18:45:32.632288] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T18:45:32.632396] [FATAL] [MAIN ] EQH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:45:32.632441] [WARN ] [MAIN ] EQH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:45:32.632481] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-07T18:45:32.632541] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-07T18:45:32.632575] [INFO ] [LOCAL ] EQH: Starting deletion of derivative data. [2025-10-07T18:45:32.632790] [DEBUG] [LOCAL ] EQH: Deleted derivative data file. [2025-10-07T18:45:32.632894] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 35.6s. Estimated remaining: 3h 44m 27s. Rate: 7.2 symbols/min [2025-10-07T18:45:32.647616] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-07T18:45:33.537324] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T18:45:33.547441] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-07T18:45:34.493801] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T18:45:34.505205] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-07T18:45:34.782634] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T18:45:35.047758] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-07T18:45:36.363481] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T18:45:36.375097] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-07T18:45:36.432250] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T18:45:36.647783] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-07T18:45:38.224447] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T18:45:38.235930] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-07T18:45:38.421078] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T18:45:38.431682] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-07T18:45:40.170036] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T18:45:40.181597] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-07T18:45:40.221412] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T18:45:40.232510] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-07T18:45:41.910839] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T18:45:41.922320] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-07T18:45:41.957157] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T18:45:41.974370] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-07T18:45:43.843339] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T18:45:43.856670] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-07T18:45:43.889040] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T18:45:43.900231] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-07T18:45:45.533672] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T18:45:45.537212] [INFO ] [REMOTE ] EQNR: Full fetch complete (76813 records). [2025-10-07T18:45:45.537377] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-07T18:45:46.000675] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-07T18:45:46.004080] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-07T18:45:46.005300] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-07T18:45:46.005488] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-07T18:45:46.008230] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-07T18:45:46.021060] [DEBUG] [LOCAL ] EQNR: Trimmed 76813 records to 53034 (keeping 200 days of data) [2025-10-07T18:45:46.021602] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-07T18:45:46.363213] [DEBUG] [LOCAL ] EQNR: Primary data saved (53034 records). [2025-10-07T18:45:46.363395] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-07T18:45:46.363492] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 23.6s. Estimated remaining: 3h 44m 30s. Rate: 7.2 symbols/min [2025-10-07T18:45:47.657834] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T18:45:47.672525] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-07T18:45:49.366431] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T18:45:49.378017] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-07T18:45:51.001862] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T18:45:51.005328] [INFO ] [REMOTE ] EQR: Full fetch complete (74097 records). [2025-10-07T18:45:51.005447] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-07T18:45:51.419332] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-07T18:45:51.419458] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-07T18:45:51.420780] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-07T18:45:51.420871] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-07T18:45:51.422890] [DEBUG] [LOCAL ] EQR: Trimmed 74097 records to 51602 (keeping 200 days of data) [2025-10-07T18:45:51.753347] [DEBUG] [LOCAL ] EQR: Primary data saved (51602 records). [2025-10-07T18:45:51.753494] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-07T18:45:51.753577] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 23.7s. Estimated remaining: 3h 44m 15s. Rate: 7.2 symbols/min [2025-10-07T18:45:52.417830] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:45:52.460459] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:45:52.461108] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-07T18:45:52.456514] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:45:52.464848] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-07T18:45:52.481487] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-07T18:45:52.482454] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:45:52.483149] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-07T18:45:52.483823] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-07T18:45:52.484131] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-07T18:45:52.576080] [DEBUG] [LOCAL ] EQV: Loaded 2713 existing records from primary storage. [2025-10-07T18:45:52.593882] [INFO ] [MAIN ] EQV: Loaded 2713 existing records. [2025-10-07T18:45:52.995635] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:45:53.016876] [DEBUG] [LOCAL ] ERJ: Loaded 50587 existing records from primary storage. [2025-10-07T18:45:53.028000] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-07T18:45:53.027772] [INFO ] [MAIN ] ERJ: Loaded 50587 existing records. [2025-10-07T18:45:53.029403] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-07T18:45:53.057212] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-07T18:45:53.095993] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-10-07T18:45:53.122142] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-07T18:45:53.219322] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-07T18:45:53.389101] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:45:53.450886] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-07T18:45:53.590494] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:45:53.637577] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-07T18:45:53.637453] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:45:53.641283] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-07T18:45:53.641549] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-07T18:45:53.641804] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-07T18:45:53.647440] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-07T18:45:53.663821] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-07T18:45:53.681480] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-07T18:45:53.681615] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-07T18:45:54.248379] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:45:54.310130] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-07T18:45:54.504548] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T18:45:54.534917] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-07T18:45:54.591140] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:45:54.623241] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-07T18:45:54.645159] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:45:54.645523] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-07T18:45:54.990596] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-07T18:45:54.991714] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-07T18:45:55.237095] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T18:45:55.240259] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-07T18:45:55.260437] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-07T18:45:55.261630] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-07T18:45:55.563339] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-07T18:45:55.564572] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-07T18:45:55.859167] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-07T18:45:55.862048] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-07T18:45:55.897454] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-07T18:45:55.898892] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-07T18:45:56.248572] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-07T18:45:56.250273] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-07T18:45:56.289701] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T18:45:56.299497] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-07T18:45:56.324155] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T18:45:56.555243] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-07T18:45:56.559181] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T18:45:56.647740] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-07T18:45:57.447694] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-07T18:45:57.819533] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T18:45:57.930766] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-07T18:45:58.247680] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-07T18:45:58.767441] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-07T18:45:59.047681] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-07T18:45:59.698681] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T18:45:59.847693] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-07T18:45:59.925601] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T18:46:00.647697] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-07T18:46:01.447626] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-07T18:46:01.862710] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-07T18:46:02.141795] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T18:46:02.247664] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-07T18:46:02.799072] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-07T18:46:02.998844] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-07T18:46:03.047674] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-07T18:46:03.847723] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-07T18:46:04.444692] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-07T18:46:04.647698] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-07T18:46:04.851964] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T18:46:05.144393] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T18:46:05.145428] [INFO ] [REMOTE ] EQS: Full fetch complete (2481 records). [2025-10-07T18:46:05.145574] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-07T18:46:05.327660] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-07T18:46:05.327910] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:46:05.327983] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:46:05.328057] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-07T18:46:05.328140] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-07T18:46:05.328197] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-07T18:46:05.328256] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-07T18:46:05.328350] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQS took 13.6s. Estimated remaining: 3h 44m 18s. Rate: 7.2 symbols/min [2025-10-07T18:46:05.452846] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-07T18:46:05.517980] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:46:05.582480] [DEBUG] [LOCAL ] ERO: Loaded 41364 existing records from primary storage. [2025-10-07T18:46:05.582804] [INFO ] [MAIN ] ERO: Loaded 41364 existing records. [2025-10-07T18:46:05.756150] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:46:05.756343] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-07T18:46:05.756390] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-07T18:46:05.757407] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-07T18:46:05.757470] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-07T18:46:06.103010] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:46:06.247671] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-07T18:46:07.047693] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-07T18:46:07.433783] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T18:46:07.450011] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-07T18:46:07.683180] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T18:46:07.847679] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-07T18:46:08.269431] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-07T18:46:08.647702] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-07T18:46:09.447717] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-07T18:46:10.014108] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T18:46:10.247697] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-07T18:46:11.047689] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-07T18:46:11.376774] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T18:46:11.516354] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T18:46:11.816405] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T18:46:11.847627] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-07T18:46:12.647691] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-07T18:46:13.350202] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T18:46:13.447709] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-07T18:46:14.247637] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-07T18:46:14.589260] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T18:46:14.811293] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T18:46:15.049570] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-07T18:46:15.053261] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T18:46:15.847761] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-07T18:46:16.647628] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-07T18:46:16.836528] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T18:46:16.950174] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T18:46:17.031986] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-07T18:46:17.447706] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-07T18:46:17.887600] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T18:46:17.888406] [INFO ] [REMOTE ] EQV: Full fetch complete (5763 records). [2025-10-07T18:46:17.888482] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-07T18:46:18.237632] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-07T18:46:18.237742] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-07T18:46:18.237927] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-07T18:46:18.237988] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-07T18:46:18.238347] [DEBUG] [LOCAL ] EQV: Trimmed 5763 records to 2705 (keeping 200 days of data) [2025-10-07T18:46:18.250891] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-07T18:46:18.255943] [DEBUG] [LOCAL ] EQV: Primary data saved (2705 records). [2025-10-07T18:46:18.256135] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-07T18:46:18.256286] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQV took 26.5s. Estimated remaining: 3h 44m 19s. Rate: 7.2 symbols/min [2025-10-07T18:46:18.422083] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:46:18.472283] [DEBUG] [LOCAL ] ES: Loaded 52594 existing records from primary storage. [2025-10-07T18:46:18.472670] [INFO ] [MAIN ] ES: Loaded 52594 existing records. [2025-10-07T18:46:18.656557] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:46:18.656903] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-07T18:46:18.656969] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-07T18:46:18.658873] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-07T18:46:18.658952] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-07T18:46:19.025750] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:46:19.047637] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-07T18:46:19.847701] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-07T18:46:20.226256] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T18:46:20.534591] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T18:46:20.647747] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-07T18:46:21.447730] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-07T18:46:21.536376] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T18:46:21.995163] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T18:46:22.247743] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-07T18:46:22.962801] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T18:46:23.047674] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-07T18:46:23.847744] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-07T18:46:24.172937] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T18:46:24.647759] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-07T18:46:24.712240] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T18:46:25.452835] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-07T18:46:25.474680] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T18:46:25.901955] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T18:46:26.247705] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-07T18:46:26.885885] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T18:46:27.047707] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-07T18:46:27.829157] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T18:46:27.847610] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-07T18:46:28.354378] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T18:46:28.647754] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-07T18:46:29.447696] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-07T18:46:29.836229] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T18:46:30.247619] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-07T18:46:30.330015] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T18:46:30.844805] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T18:46:31.047711] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-07T18:46:31.832531] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T18:46:31.836029] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-10-07T18:46:31.836172] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-07T18:46:31.857326] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-07T18:46:32.226680] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-07T18:46:32.226775] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-07T18:46:32.227810] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-07T18:46:32.227876] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-07T18:46:32.229331] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 53682 (keeping 200 days of data) [2025-10-07T18:46:32.559668] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-10-07T18:46:32.559824] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-07T18:46:32.559909] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQT took 40.8s. Estimated remaining: 3h 44m 23s. Rate: 7.2 symbols/min [2025-10-07T18:46:32.649637] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-07T18:46:32.732302] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:46:32.768612] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T18:46:32.805521] [DEBUG] [LOCAL ] ESAB: Loaded 26153 existing records from primary storage. [2025-10-07T18:46:32.805820] [INFO ] [MAIN ] ESAB: Loaded 26153 existing records. [2025-10-07T18:46:32.981287] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:46:32.981559] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-07T18:46:32.981612] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-07T18:46:32.982566] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-07T18:46:32.982624] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-07T18:46:33.330111] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:46:33.350537] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T18:46:33.353965] [INFO ] [REMOTE ] ERO: Full fetch complete (59655 records). [2025-10-07T18:46:33.354102] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-07T18:46:33.451318] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-07T18:46:33.728356] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-07T18:46:33.728434] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-07T18:46:33.729153] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-07T18:46:33.729217] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-07T18:46:33.731556] [DEBUG] [LOCAL ] ERO: Trimmed 59655 records to 41407 (keeping 200 days of data) [2025-10-07T18:46:33.977858] [DEBUG] [LOCAL ] ERO: Primary data saved (41407 records). [2025-10-07T18:46:33.978100] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-07T18:46:33.978920] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ERO took 28.7s. Estimated remaining: 3h 44m 0s. Rate: 7.2 symbols/min [2025-10-07T18:46:34.145180] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:46:34.164060] [DEBUG] [LOCAL ] ESE: Loaded 16617 existing records from primary storage. [2025-10-07T18:46:34.164301] [INFO ] [MAIN ] ESE: Loaded 16617 existing records. [2025-10-07T18:46:34.259677] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-07T18:46:34.343607] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:46:34.343954] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-07T18:46:34.344114] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-07T18:46:34.344897] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-07T18:46:34.344958] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-07T18:46:34.675598] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T18:46:34.739069] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:46:35.047708] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-07T18:46:35.293931] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T18:46:35.620265] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T18:46:35.847712] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-07T18:46:36.553153] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T18:46:36.563143] [INFO ] [REMOTE ] ERJ: Full fetch complete (72503 records). [2025-10-07T18:46:36.563782] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-07T18:46:36.564043] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-07T18:46:36.652901] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-07T18:46:37.001328] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-07T18:46:37.001430] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-07T18:46:37.002297] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-07T18:46:37.002406] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-07T18:46:37.003889] [DEBUG] [LOCAL ] ERJ: Trimmed 72503 records to 50561 (keeping 200 days of data) [2025-10-07T18:46:37.312999] [DEBUG] [LOCAL ] ERJ: Primary data saved (50561 records). [2025-10-07T18:46:37.313144] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-07T18:46:37.313233] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERJ took 45.6s. Estimated remaining: 3h 43m 41s. Rate: 7.2 symbols/min [2025-10-07T18:46:37.452803] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-07T18:46:37.523180] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:46:37.571356] [DEBUG] [LOCAL ] ESI: Loaded 50703 existing records from primary storage. [2025-10-07T18:46:37.571787] [INFO ] [MAIN ] ESI: Loaded 50703 existing records. [2025-10-07T18:46:37.693621] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T18:46:37.775256] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:46:37.775516] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-07T18:46:37.775564] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-07T18:46:37.776911] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-07T18:46:37.776975] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-07T18:46:38.144214] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:46:38.247680] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-07T18:46:39.047694] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-07T18:46:39.094744] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T18:46:39.851252] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-07T18:46:39.858114] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T18:46:39.920196] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T18:46:40.647729] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-07T18:46:41.447682] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-07T18:46:41.580846] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T18:46:42.247615] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-07T18:46:42.301494] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T18:46:42.475222] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T18:46:43.047611] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-07T18:46:43.364740] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T18:46:43.847684] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-07T18:46:44.647728] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-07T18:46:44.769387] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T18:46:44.988291] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T18:46:45.447773] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-07T18:46:46.103124] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T18:46:46.247697] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-07T18:46:47.047670] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-07T18:46:47.202119] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T18:46:47.847764] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-07T18:46:48.043430] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T18:46:48.345511] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T18:46:48.647743] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-07T18:46:48.905546] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T18:46:49.447701] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-07T18:46:50.180260] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T18:46:50.184745] [INFO ] [REMOTE ] ES: Full fetch complete (76240 records). [2025-10-07T18:46:50.184884] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-07T18:46:50.250987] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-07T18:46:50.408379] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T18:46:50.634059] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-07T18:46:50.634145] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-07T18:46:50.635765] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-07T18:46:50.635829] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-07T18:46:50.638049] [DEBUG] [LOCAL ] ES: Trimmed 76240 records to 52614 (keeping 200 days of data) [2025-10-07T18:46:50.968204] [DEBUG] [LOCAL ] ES: Primary data saved (52614 records). [2025-10-07T18:46:50.968353] [INFO ] [MAIN ] ES: Full history saved. [2025-10-07T18:46:50.968455] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 32.7s. Estimated remaining: 3h 43m 44s. Rate: 7.2 symbols/min [2025-10-07T18:46:51.056239] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-07T18:46:51.140464] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:46:51.183633] [DEBUG] [LOCAL ] ESNT: Loaded 38283 existing records from primary storage. [2025-10-07T18:46:51.183959] [INFO ] [MAIN ] ESNT: Loaded 38283 existing records. [2025-10-07T18:46:51.372167] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:46:51.372425] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-07T18:46:51.372488] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-07T18:46:51.373546] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-07T18:46:51.373607] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-07T18:46:51.710259] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T18:46:51.780153] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:46:51.847671] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-07T18:46:52.647669] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-07T18:46:52.838544] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:46:52.918472] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T18:46:53.447683] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-07T18:46:53.664830] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T18:46:54.247714] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-07T18:46:54.511193] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T18:46:55.047758] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-07T18:46:55.304754] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T18:46:55.847703] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-07T18:46:56.113410] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T18:46:56.567537] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T18:46:56.647694] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-07T18:46:57.447712] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-07T18:46:57.700676] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T18:46:58.247674] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-07T18:46:59.047632] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-07T18:46:59.156130] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T18:46:59.158523] [INFO ] [REMOTE ] ESE: Full fetch complete (22413 records). [2025-10-07T18:46:59.158671] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-07T18:46:59.605016] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-07T18:46:59.605143] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-07T18:46:59.605626] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-07T18:46:59.605743] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-07T18:46:59.609012] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-07T18:46:59.619319] [DEBUG] [LOCAL ] ESE: Trimmed 22413 records to 16585 (keeping 200 days of data) [2025-10-07T18:46:59.743756] [DEBUG] [LOCAL ] ESE: Primary data saved (16585 records). [2025-10-07T18:46:59.743920] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-07T18:46:59.744021] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESE took 25.8s. Estimated remaining: 3h 43m 36s. Rate: 7.2 symbols/min [2025-10-07T18:46:59.852735] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-07T18:46:59.929572] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:46:59.985078] [DEBUG] [LOCAL ] ESRT: Loaded 46288 existing records from primary storage. [2025-10-07T18:46:59.985424] [INFO ] [MAIN ] ESRT: Loaded 46288 existing records. [2025-10-07T18:47:00.179855] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:47:00.180260] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-07T18:47:00.180319] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-07T18:47:00.180560] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-07T18:47:00.180617] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-07T18:47:00.565237] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:47:00.570289] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T18:47:00.647610] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-07T18:47:01.122323] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T18:47:01.447724] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-07T18:47:02.247636] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-07T18:47:02.329978] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T18:47:02.725948] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T18:47:03.047780] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-07T18:47:03.489068] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T18:47:03.847726] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-07T18:47:04.360567] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T18:47:04.647695] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-07T18:47:05.430706] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T18:47:05.447603] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-07T18:47:06.172869] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T18:47:06.247694] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-07T18:47:06.721559] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T18:47:07.047731] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-07T18:47:07.677270] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T18:47:07.847623] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-07T18:47:08.548968] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T18:47:08.647625] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-07T18:47:09.447730] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-07T18:47:09.580186] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T18:47:09.607012] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T18:47:09.609236] [INFO ] [REMOTE ] ESAB: Full fetch complete (35956 records). [2025-10-07T18:47:09.609319] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-07T18:47:09.989759] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-07T18:47:09.989843] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-07T18:47:09.990566] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-07T18:47:09.990632] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-07T18:47:09.991624] [DEBUG] [LOCAL ] ESAB: Trimmed 35956 records to 26108 (keeping 200 days of data) [2025-10-07T18:47:10.181707] [DEBUG] [LOCAL ] ESAB: Primary data saved (26108 records). [2025-10-07T18:47:10.181844] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-07T18:47:10.181940] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESAB took 37.6s. Estimated remaining: 3h 43m 32s. Rate: 7.2 symbols/min [2025-10-07T18:47:10.254046] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-07T18:47:10.351594] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:47:10.382984] [DEBUG] [LOCAL ] ESS: Loaded 29925 existing records from primary storage. [2025-10-07T18:47:10.383266] [INFO ] [MAIN ] ESS: Loaded 29925 existing records. [2025-10-07T18:47:10.553478] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:47:10.553750] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-07T18:47:10.553822] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-07T18:47:10.554879] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-07T18:47:10.554937] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-07T18:47:10.901178] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:47:11.047603] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-07T18:47:11.075031] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T18:47:11.619243] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T18:47:11.847730] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-07T18:47:12.275879] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T18:47:12.647691] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-07T18:47:13.149568] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T18:47:13.153285] [INFO ] [REMOTE ] ESI: Full fetch complete (72787 records). [2025-10-07T18:47:13.153444] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-07T18:47:13.452951] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-07T18:47:13.653019] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-07T18:47:13.653128] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-07T18:47:13.654161] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-07T18:47:13.654233] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-07T18:47:13.655744] [DEBUG] [LOCAL ] ESI: Trimmed 72787 records to 50698 (keeping 200 days of data) [2025-10-07T18:47:13.972373] [DEBUG] [LOCAL ] ESI: Primary data saved (50698 records). [2025-10-07T18:47:13.972510] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-07T18:47:13.972596] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESI took 36.7s. Estimated remaining: 3h 43m 14s. Rate: 7.2 symbols/min [2025-10-07T18:47:14.147439] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:47:14.167057] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T18:47:14.216297] [DEBUG] [LOCAL ] ESTC: Loaded 50008 existing records from primary storage. [2025-10-07T18:47:14.216626] [INFO ] [MAIN ] ESTC: Loaded 50008 existing records. [2025-10-07T18:47:14.257787] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-07T18:47:14.392078] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:47:14.392288] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-07T18:47:14.392335] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-07T18:47:14.393832] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-07T18:47:14.393892] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-07T18:47:14.750153] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:47:14.773301] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-07T18:47:15.047748] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-07T18:47:15.847700] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-07T18:47:15.891429] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T18:47:16.430614] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T18:47:16.647736] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-07T18:47:17.307689] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T18:47:17.447706] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-07T18:47:18.247636] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-07T18:47:18.319025] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T18:47:18.511365] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T18:47:19.047751] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-07T18:47:19.563594] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T18:47:19.847696] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-07T18:47:20.647736] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-07T18:47:20.691914] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T18:47:21.343813] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T18:47:21.447757] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-07T18:47:21.736750] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-07T18:47:22.247728] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-07T18:47:22.704008] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T18:47:23.047699] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-07T18:47:23.769036] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T18:47:23.847733] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-07T18:47:24.518261] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T18:47:24.647718] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-07T18:47:25.413734] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T18:47:25.447616] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-07T18:47:25.958161] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T18:47:26.247632] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-07T18:47:26.662857] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T18:47:27.047725] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-07T18:47:27.847627] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-07T18:47:28.041406] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T18:47:28.648324] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-07T18:47:28.649670] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T18:47:28.897991] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T18:47:29.447690] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-07T18:47:30.005556] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T18:47:30.247712] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-07T18:47:30.853885] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T18:47:31.047681] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-07T18:47:31.847669] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-07T18:47:31.892290] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T18:47:32.653093] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-07T18:47:32.666374] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T18:47:33.102635] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T18:47:33.105607] [INFO ] [REMOTE ] ESNT: Full fetch complete (57160 records). [2025-10-07T18:47:33.105786] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-07T18:47:33.448128] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-07T18:47:33.486178] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-07T18:47:33.486275] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-07T18:47:33.487040] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-07T18:47:33.487107] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-07T18:47:33.488431] [DEBUG] [LOCAL ] ESNT: Trimmed 57160 records to 38318 (keeping 200 days of data) [2025-10-07T18:47:33.738102] [DEBUG] [LOCAL ] ESNT: Primary data saved (38318 records). [2025-10-07T18:47:33.738262] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-07T18:47:33.738366] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESNT took 42.8s. Estimated remaining: 3h 43m 30s. Rate: 7.2 symbols/min [2025-10-07T18:47:33.911600] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:47:33.968683] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-07T18:47:33.969038] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-07T18:47:34.155501] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:47:34.155753] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-07T18:47:34.155806] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-07T18:47:34.156124] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-07T18:47:34.156182] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-07T18:47:34.256057] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-07T18:47:34.543188] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T18:47:34.562013] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:47:34.826515] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:47:35.047745] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-07T18:47:35.847734] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-07T18:47:35.991788] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T18:47:36.438409] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T18:47:36.441450] [INFO ] [REMOTE ] ESRT: Full fetch complete (66465 records). [2025-10-07T18:47:36.441576] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-07T18:47:36.658400] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-07T18:47:36.819441] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-07T18:47:36.819526] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-07T18:47:36.820374] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-07T18:47:36.820441] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-07T18:47:36.821813] [DEBUG] [LOCAL ] ESRT: Trimmed 66465 records to 46351 (keeping 200 days of data) [2025-10-07T18:47:37.090817] [DEBUG] [LOCAL ] ESRT: Primary data saved (46351 records). [2025-10-07T18:47:37.090955] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-07T18:47:37.091039] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESRT took 37.3s. Estimated remaining: 3h 43m 11s. Rate: 7.2 symbols/min [2025-10-07T18:47:37.258984] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:47:37.273572] [DEBUG] [LOCAL ] ETB: Loaded 12264 existing records from primary storage. [2025-10-07T18:47:37.273879] [INFO ] [MAIN ] ETB: Loaded 12264 existing records. [2025-10-07T18:47:37.444954] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:47:37.445218] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-07T18:47:37.445271] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-07T18:47:37.445472] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-07T18:47:37.445529] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-07T18:47:37.476432] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-07T18:47:37.809963] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:47:37.842455] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T18:47:37.988448] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T18:47:38.247743] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-07T18:47:39.047731] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-07T18:47:39.279292] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T18:47:39.312526] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T18:47:39.847722] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-07T18:47:40.647741] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-07T18:47:41.103946] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-07T18:47:41.399727] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T18:47:41.403849] [INFO ] [REMOTE ] ESTC: Full fetch complete (72083 records). [2025-10-07T18:47:41.404031] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-07T18:47:41.452893] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-07T18:47:41.856215] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-07T18:47:41.856344] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-07T18:47:41.857589] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-07T18:47:41.857686] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-07T18:47:41.860260] [DEBUG] [LOCAL ] ESTC: Trimmed 72083 records to 50060 (keeping 200 days of data) [2025-10-07T18:47:41.981139] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T18:47:42.223718] [DEBUG] [LOCAL ] ESTC: Primary data saved (50060 records). [2025-10-07T18:47:42.223938] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-07T18:47:42.224052] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESTC took 28.3s. Estimated remaining: 3h 42m 56s. Rate: 7.2 symbols/min [2025-10-07T18:47:42.256712] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-07T18:47:42.423206] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:47:42.454477] [DEBUG] [LOCAL ] ETD: Loaded 27331 existing records from primary storage. [2025-10-07T18:47:42.454875] [INFO ] [MAIN ] ETD: Loaded 27331 existing records. [2025-10-07T18:47:42.662436] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:47:42.662801] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-07T18:47:42.662860] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-07T18:47:42.663210] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-07T18:47:42.663271] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-07T18:47:43.050129] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:47:43.050305] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-07T18:47:43.416021] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-07T18:47:43.431070] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T18:47:43.433265] [INFO ] [REMOTE ] ESS: Full fetch complete (43400 records). [2025-10-07T18:47:43.433356] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-07T18:47:43.798131] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-07T18:47:43.798212] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-07T18:47:43.798810] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-07T18:47:43.798874] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-07T18:47:43.799849] [DEBUG] [LOCAL ] ESS: Trimmed 43400 records to 29871 (keeping 200 days of data) [2025-10-07T18:47:43.855622] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-07T18:47:44.002341] [DEBUG] [LOCAL ] ESS: Primary data saved (29871 records). [2025-10-07T18:47:44.002998] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-07T18:47:44.003235] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ESS took 33.8s. Estimated remaining: 3h 42m 34s. Rate: 7.2 symbols/min [2025-10-07T18:47:44.129825] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T18:47:44.187223] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:47:44.203725] [DEBUG] [LOCAL ] ETG: Loaded 16551 existing records from primary storage. [2025-10-07T18:47:44.203954] [INFO ] [MAIN ] ETG: Loaded 16551 existing records. [2025-10-07T18:47:44.376947] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:47:44.377213] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-07T18:47:44.377276] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-07T18:47:44.377838] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-07T18:47:44.377899] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-07T18:47:44.652853] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-07T18:47:44.727867] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:47:45.447715] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-07T18:47:45.604943] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T18:47:46.124504] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-07T18:47:46.247627] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-07T18:47:46.534167] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T18:47:47.047697] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-07T18:47:47.847688] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-07T18:47:48.130544] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T18:47:48.294730] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T18:47:48.647638] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-07T18:47:48.936456] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T18:47:49.447752] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-07T18:47:50.200853] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T18:47:50.247684] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-07T18:47:50.917809] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-07T18:47:51.047623] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-07T18:47:51.298106] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T18:47:51.847753] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-07T18:47:52.647664] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-07T18:47:52.837636] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T18:47:53.103314] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-07T18:47:53.447709] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-07T18:47:53.709811] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T18:47:54.247707] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-07T18:47:55.047708] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-07T18:47:55.553884] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T18:47:55.807399] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-07T18:47:55.847620] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-07T18:47:56.056567] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T18:47:56.647683] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-07T18:47:57.447748] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-07T18:47:57.968245] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T18:47:58.075453] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-07T18:47:58.247717] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-07T18:47:58.413343] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T18:47:59.047670] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-07T18:47:59.202777] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T18:47:59.847681] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-07T18:48:00.096910] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T18:48:00.458372] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T18:48:00.647695] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-07T18:48:01.417368] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T18:48:01.447692] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-07T18:48:02.247688] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-07T18:48:02.483757] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T18:48:03.047744] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-07T18:48:03.847715] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-07T18:48:04.229868] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T18:48:04.544399] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-07T18:48:04.567473] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T18:48:04.647629] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-07T18:48:05.447714] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-07T18:48:06.247735] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-07T18:48:06.524792] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T18:48:06.686371] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-07T18:48:06.692507] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-07T18:48:06.692635] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-07T18:48:07.061018] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-07T18:48:07.087302] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-07T18:48:07.087412] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-07T18:48:07.088597] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-07T18:48:07.088889] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-07T18:48:07.098810] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T18:48:07.098469] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-10-07T18:48:07.449011] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-07T18:48:07.449208] [INFO ] [MAIN ] ET: Full history saved. [2025-10-07T18:48:07.449371] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ET took 33.7s. Estimated remaining: 3h 42m 57s. Rate: 7.2 symbols/min [2025-10-07T18:48:07.614694] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:48:07.632224] [DEBUG] [LOCAL ] ETJ: Loaded 16949 existing records from primary storage. [2025-10-07T18:48:07.632469] [INFO ] [MAIN ] ETJ: Loaded 16949 existing records. [2025-10-07T18:48:07.805015] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:48:07.805253] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-07T18:48:07.805300] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-07T18:48:07.805851] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-07T18:48:07.805910] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-07T18:48:07.858600] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-07T18:48:08.161930] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:48:08.283221] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T18:48:08.647689] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-07T18:48:08.974497] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T18:48:09.428421] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T18:48:09.447607] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-07T18:48:10.247669] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-07T18:48:10.437232] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T18:48:11.047725] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-07T18:48:11.088761] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T18:48:11.090286] [INFO ] [REMOTE ] ETB: Full fetch complete (18327 records). [2025-10-07T18:48:11.090357] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-07T18:48:11.446523] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-07T18:48:11.446604] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-07T18:48:11.447157] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-07T18:48:11.447221] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-07T18:48:11.447817] [DEBUG] [LOCAL ] ETB: Trimmed 18327 records to 12221 (keeping 200 days of data) [2025-10-07T18:48:11.522156] [DEBUG] [LOCAL ] ETB: Primary data saved (12221 records). [2025-10-07T18:48:11.522296] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-07T18:48:11.522380] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETB took 34.4s. Estimated remaining: 3h 42m 40s. Rate: 7.2 symbols/min [2025-10-07T18:48:11.685310] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:48:11.735947] [DEBUG] [LOCAL ] ETN: Loaded 52723 existing records from primary storage. [2025-10-07T18:48:11.736283] [INFO ] [MAIN ] ETN: Loaded 52723 existing records. [2025-10-07T18:48:11.852845] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-07T18:48:11.912984] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:48:11.913232] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-07T18:48:11.913279] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-07T18:48:11.915044] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-07T18:48:11.915105] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-07T18:48:12.273181] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:48:12.298061] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T18:48:12.647672] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-07T18:48:12.948724] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T18:48:13.447683] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-07T18:48:14.247628] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-07T18:48:14.356579] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T18:48:14.379168] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T18:48:15.047739] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-07T18:48:15.611249] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T18:48:15.847744] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-07T18:48:16.647631] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-07T18:48:17.049059] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T18:48:17.143311] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T18:48:17.447740] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-07T18:48:17.618146] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T18:48:18.247623] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-07T18:48:18.282726] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T18:48:18.284803] [INFO ] [REMOTE ] ETD: Full fetch complete (38438 records). [2025-10-07T18:48:18.284888] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-07T18:48:18.665630] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-07T18:48:18.665747] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-07T18:48:18.666417] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-07T18:48:18.666497] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-07T18:48:18.667505] [DEBUG] [LOCAL ] ETD: Trimmed 38438 records to 27351 (keeping 200 days of data) [2025-10-07T18:48:18.849214] [DEBUG] [LOCAL ] ETD: Primary data saved (27351 records). [2025-10-07T18:48:18.849356] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-07T18:48:18.849441] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETD took 36.6s. Estimated remaining: 3h 42m 29s. Rate: 7.2 symbols/min [2025-10-07T18:48:19.014695] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:48:19.022420] [DEBUG] [LOCAL ] ETO: Loaded 6695 existing records from primary storage. [2025-10-07T18:48:19.022608] [INFO ] [MAIN ] ETO: Loaded 6695 existing records. [2025-10-07T18:48:19.052760] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-07T18:48:19.173517] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-07T18:48:19.279143] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:48:19.279403] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-07T18:48:19.279479] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-07T18:48:19.279963] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-07T18:48:19.280051] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-07T18:48:19.720768] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:48:19.847682] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-07T18:48:20.483516] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T18:48:20.647626] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-07T18:48:20.808405] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T18:48:21.198714] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-07T18:48:21.447719] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-07T18:48:22.003261] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T18:48:22.247711] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-07T18:48:22.839480] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T18:48:22.841977] [INFO ] [REMOTE ] ETG: Full fetch complete (24922 records). [2025-10-07T18:48:22.842116] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-07T18:48:23.053387] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-07T18:48:23.234082] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-07T18:48:23.234167] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-07T18:48:23.234856] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-07T18:48:23.234921] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-07T18:48:23.235738] [DEBUG] [LOCAL ] ETG: Trimmed 24922 records to 16574 (keeping 200 days of data) [2025-10-07T18:48:23.340169] [DEBUG] [LOCAL ] ETG: Primary data saved (16574 records). [2025-10-07T18:48:23.340329] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-07T18:48:23.340418] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETG took 39.3s. Estimated remaining: 3h 42m 13s. Rate: 7.2 symbols/min [2025-10-07T18:48:23.508948] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:48:23.563169] [DEBUG] [LOCAL ] ETR: Loaded 53231 existing records from primary storage. [2025-10-07T18:48:23.563557] [INFO ] [MAIN ] ETR: Loaded 53231 existing records. [2025-10-07T18:48:23.758116] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:48:23.758407] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-07T18:48:23.758460] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-07T18:48:23.758832] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-07T18:48:23.758894] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-07T18:48:23.852835] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-07T18:48:24.161398] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:48:24.647735] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-07T18:48:24.914386] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T18:48:25.263526] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-07T18:48:25.272468] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T18:48:25.447695] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-07T18:48:26.247729] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-07T18:48:26.730542] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-07T18:48:27.049154] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-07T18:48:27.055930] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T18:48:27.847728] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-07T18:48:28.150509] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T18:48:28.586614] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T18:48:28.647700] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-07T18:48:29.447748] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-07T18:48:30.238067] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T18:48:30.247594] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-07T18:48:30.418814] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T18:48:30.981572] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T18:48:31.047637] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-07T18:48:31.847689] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-07T18:48:32.017557] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T18:48:32.647736] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-07T18:48:33.447738] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-07T18:48:33.598227] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T18:48:33.698505] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T18:48:34.221978] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T18:48:34.247715] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-07T18:48:34.957843] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-07T18:48:35.047707] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-07T18:48:35.847671] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-07T18:48:36.473933] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T18:48:36.647621] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-07T18:48:37.044379] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T18:48:37.447721] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-07T18:48:37.991454] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T18:48:38.044104] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-07T18:48:38.247690] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-07T18:48:39.047700] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-07T18:48:39.154620] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T18:48:39.847698] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-07T18:48:40.569176] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T18:48:40.570374] [INFO ] [REMOTE ] ETO: Full fetch complete (9554 records). [2025-10-07T18:48:40.570443] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-07T18:48:40.649216] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-07T18:48:40.976778] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-07T18:48:40.977134] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-07T18:48:40.977427] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-07T18:48:40.988699] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-07T18:48:41.006863] [DEBUG] [LOCAL ] ETO: Trimmed 9554 records to 6736 (keeping 200 days of data) [2025-10-07T18:48:41.008990] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T18:48:41.063546] [DEBUG] [LOCAL ] ETO: Primary data saved (6736 records). [2025-10-07T18:48:41.063741] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-07T18:48:41.063878] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETO took 22.2s. Estimated remaining: 3h 42m 23s. Rate: 7.2 symbols/min [2025-10-07T18:48:41.238020] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:48:41.262819] [DEBUG] [LOCAL ] ETV: Loaded 21817 existing records from primary storage. [2025-10-07T18:48:41.263115] [INFO ] [MAIN ] ETV: Loaded 21817 existing records. [2025-10-07T18:48:41.446001] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:48:41.446292] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-07T18:48:41.446364] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-07T18:48:41.446935] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-07T18:48:41.447022] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-07T18:48:41.458399] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-07T18:48:41.642133] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T18:48:41.743561] [INFO ] [REMOTE ] ETJ: Full fetch complete (25761 records). [2025-10-07T18:48:41.753793] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-07T18:48:41.942339] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:48:42.216497] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-07T18:48:42.216579] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-07T18:48:42.217039] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-07T18:48:42.217110] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-07T18:48:42.217781] [DEBUG] [LOCAL ] ETJ: Trimmed 25761 records to 17010 (keeping 200 days of data) [2025-10-07T18:48:42.260365] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-07T18:48:42.322023] [DEBUG] [LOCAL ] ETJ: Primary data saved (17010 records). [2025-10-07T18:48:42.322144] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-07T18:48:42.322230] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETJ took 34.9s. Estimated remaining: 3h 42m 1s. Rate: 7.2 symbols/min [2025-10-07T18:48:42.492375] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:48:42.516951] [DEBUG] [LOCAL ] ETW: Loaded 25222 existing records from primary storage. [2025-10-07T18:48:42.517251] [INFO ] [MAIN ] ETW: Loaded 25222 existing records. [2025-10-07T18:48:42.690550] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:48:42.690814] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-07T18:48:42.690901] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-07T18:48:42.691614] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-07T18:48:42.691710] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-07T18:48:43.048763] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:48:43.048863] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-07T18:48:43.300980] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T18:48:43.847695] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-07T18:48:44.090947] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T18:48:44.140522] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T18:48:44.647613] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-07T18:48:44.951415] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T18:48:45.447685] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-07T18:48:46.247730] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-07T18:48:46.384400] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T18:48:46.535833] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T18:48:47.047755] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-07T18:48:47.334760] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T18:48:47.847700] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-07T18:48:48.647623] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-07T18:48:49.166660] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-07T18:48:49.447727] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-07T18:48:49.691783] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T18:48:50.123225] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T18:48:50.247709] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-07T18:48:51.047686] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-07T18:48:51.847717] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-07T18:48:51.910149] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-07T18:48:52.121587] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T18:48:52.300560] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-07T18:48:52.647712] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-07T18:48:52.924773] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T18:48:53.447683] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-07T18:48:54.247614] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-07T18:48:54.324008] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T18:48:54.555487] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T18:48:55.047700] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-07T18:48:55.476363] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T18:48:55.847702] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-07T18:48:56.647682] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-07T18:48:56.783714] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T18:48:57.192010] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T18:48:57.447631] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-07T18:48:57.716867] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T18:48:58.247700] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-07T18:48:58.448276] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T18:48:58.618340] [DEBUG] [REMOTE ] ETN: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-07T18:48:58.618695] [WARN ] [REMOTE ] ETN: No data returned for month 2025-09 [2025-10-07T18:48:58.618789] [FATAL] [REMOTE ] ETN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:48:58.618891] [FATAL] [MAIN ] ETN: Failed to fetch primary data. [2025-10-07T18:48:58.618966] [WARN ] [MAIN ] ETN: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:48:58.619020] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-07T18:48:58.619150] [DEBUG] [LOCAL ] ETN: No primary data file found to delete. [2025-10-07T18:48:58.619204] [INFO ] [LOCAL ] ETN: Starting deletion of derivative data. [2025-10-07T18:48:58.619457] [DEBUG] [LOCAL ] ETN: Deleted derivative data file. [2025-10-07T18:48:58.620557] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 47.1s. Estimated remaining: 3h 42m 8s. Rate: 7.2 symbols/min [2025-10-07T18:48:58.799540] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:48:58.811321] [DEBUG] [LOCAL ] ETX: Loaded 5157 existing records from primary storage. [2025-10-07T18:48:58.811550] [INFO ] [MAIN ] ETX: Loaded 5157 existing records. [2025-10-07T18:48:58.985184] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:48:58.985450] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-07T18:48:58.985519] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-07T18:48:58.985755] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-07T18:48:58.985831] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-07T18:48:59.052804] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-07T18:48:59.336151] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:48:59.847681] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-07T18:49:00.647610] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-07T18:49:00.692336] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T18:49:00.696214] [INFO ] [REMOTE ] ETR: Full fetch complete (77094 records). [2025-10-07T18:49:00.696361] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-07T18:49:01.092897] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-07T18:49:01.107626] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-07T18:49:01.111001] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-07T18:49:01.117059] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-07T18:49:01.122802] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T18:49:01.123188] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-07T18:49:01.130893] [DEBUG] [LOCAL ] ETR: Trimmed 77094 records to 53233 (keeping 200 days of data) [2025-10-07T18:49:01.463007] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-07T18:49:01.519418] [DEBUG] [LOCAL ] ETR: Primary data saved (53233 records). [2025-10-07T18:49:01.519578] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-07T18:49:01.519764] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETR took 38.2s. Estimated remaining: 3h 41m 49s. Rate: 7.2 symbols/min [2025-10-07T18:49:01.745793] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:49:01.773887] [DEBUG] [LOCAL ] ETY: Loaded 22976 existing records from primary storage. [2025-10-07T18:49:01.774224] [INFO ] [MAIN ] ETY: Loaded 22976 existing records. [2025-10-07T18:49:02.020310] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:49:02.020563] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-07T18:49:02.020621] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-07T18:49:02.021368] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-07T18:49:02.021427] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-07T18:49:02.175435] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-07T18:49:02.252785] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-07T18:49:02.396044] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:49:03.047638] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-07T18:49:03.324722] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T18:49:03.847630] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-07T18:49:04.225863] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T18:49:04.647747] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-07T18:49:04.894472] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T18:49:05.196114] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T18:49:05.447702] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-07T18:49:06.247691] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-07T18:49:06.550561] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T18:49:06.564851] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-07T18:49:07.047722] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-07T18:49:07.847619] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-07T18:49:08.171742] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T18:49:08.414863] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T18:49:08.647699] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-07T18:49:09.215999] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T18:49:09.447673] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-07T18:49:10.247630] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-07T18:49:10.574265] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T18:49:10.968593] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T18:49:11.047691] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-07T18:49:11.847694] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-07T18:49:12.043594] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T18:49:12.647688] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-07T18:49:13.056498] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T18:49:13.233491] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T18:49:13.447730] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-07T18:49:14.162538] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-07T18:49:14.247691] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-07T18:49:15.047634] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-07T18:49:15.337528] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T18:49:15.847704] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-07T18:49:15.977526] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T18:49:16.479896] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-07T18:49:16.647696] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-07T18:49:17.447714] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-07T18:49:17.553996] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T18:49:18.247713] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-07T18:49:18.493430] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T18:49:18.495954] [INFO ] [REMOTE ] ETV: Full fetch complete (32115 records). [2025-10-07T18:49:18.496104] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-07T18:49:18.874613] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-07T18:49:18.874721] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-07T18:49:18.875236] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-07T18:49:18.875277] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-07T18:49:18.876024] [DEBUG] [LOCAL ] ETV: Trimmed 32115 records to 21890 (keeping 200 days of data) [2025-10-07T18:49:19.011082] [DEBUG] [LOCAL ] ETV: Primary data saved (21890 records). [2025-10-07T18:49:19.011221] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-07T18:49:19.011314] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETV took 37.9s. Estimated remaining: 3h 41m 59s. Rate: 7.2 symbols/min [2025-10-07T18:49:19.052892] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-07T18:49:19.184111] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:49:19.201687] [DEBUG] [LOCAL ] EVC: Loaded 18396 existing records from primary storage. [2025-10-07T18:49:19.201937] [INFO ] [MAIN ] EVC: Loaded 18396 existing records. [2025-10-07T18:49:19.375768] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:49:19.376136] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-07T18:49:19.376260] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-07T18:49:19.376927] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-07T18:49:19.376988] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-07T18:49:19.676458] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T18:49:19.757773] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T18:49:19.762987] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:49:19.764028] [INFO ] [REMOTE ] ETX: Full fetch complete (7019 records). [2025-10-07T18:49:19.764318] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-07T18:49:19.852934] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-07T18:49:20.130061] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-07T18:49:20.130145] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-07T18:49:20.130365] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-07T18:49:20.130406] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-07T18:49:20.130893] [DEBUG] [LOCAL ] ETX: Trimmed 7019 records to 5181 (keeping 200 days of data) [2025-10-07T18:49:20.164593] [DEBUG] [LOCAL ] ETX: Primary data saved (5181 records). [2025-10-07T18:49:20.164728] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-07T18:49:20.164818] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETX took 21.5s. Estimated remaining: 3h 41m 36s. Rate: 7.2 symbols/min [2025-10-07T18:49:20.357238] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:49:20.401959] [DEBUG] [LOCAL ] EVEX: Loaded 30942 existing records from primary storage. [2025-10-07T18:49:20.402278] [INFO ] [MAIN ] EVEX: Loaded 30942 existing records. [2025-10-07T18:49:20.574869] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:49:20.575128] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-07T18:49:20.575244] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-07T18:49:20.576431] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-07T18:49:20.576490] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-07T18:49:20.647962] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-07T18:49:20.929384] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:49:21.051309] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T18:49:21.447712] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-07T18:49:21.736154] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T18:49:21.738751] [INFO ] [REMOTE ] ETW: Full fetch complete (36647 records). [2025-10-07T18:49:21.738835] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-07T18:49:22.121034] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-07T18:49:22.121152] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-07T18:49:22.121790] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-07T18:49:22.121865] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-07T18:49:22.122930] [DEBUG] [LOCAL ] ETW: Trimmed 36647 records to 25336 (keeping 200 days of data) [2025-10-07T18:49:22.247881] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-07T18:49:22.285740] [DEBUG] [LOCAL ] ETW: Primary data saved (25336 records). [2025-10-07T18:49:22.285879] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-07T18:49:22.285972] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 40.0s. Estimated remaining: 3h 41m 15s. Rate: 7.2 symbols/min [2025-10-07T18:49:22.456957] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T18:49:22.519854] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:49:22.530539] [DEBUG] [LOCAL ] EVF: Loaded 9540 existing records from primary storage. [2025-10-07T18:49:22.530763] [INFO ] [MAIN ] EVF: Loaded 9540 existing records. [2025-10-07T18:49:22.735358] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:49:22.735603] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-07T18:49:22.735676] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-07T18:49:22.736172] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-07T18:49:22.736231] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-07T18:49:23.054885] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-07T18:49:23.085010] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:49:23.660806] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T18:49:23.847746] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-07T18:49:24.178075] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T18:49:24.647687] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-07T18:49:25.324618] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T18:49:25.441610] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T18:49:25.448630] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-07T18:49:26.247694] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-07T18:49:26.651244] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T18:49:27.047687] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-07T18:49:27.433726] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T18:49:27.737368] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-07T18:49:27.847718] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-07T18:49:28.647636] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-07T18:49:28.936417] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T18:49:29.236403] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T18:49:29.447758] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-07T18:49:30.247723] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-07T18:49:30.492791] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T18:49:30.977026] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T18:49:31.047698] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-07T18:49:31.847675] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-07T18:49:32.071349] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T18:49:32.647625] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-07T18:49:33.041394] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T18:49:33.447629] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-07T18:49:33.718999] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-07T18:49:33.721122] [INFO ] [REMOTE ] ETY: Full fetch complete (34345 records). [2025-10-07T18:49:33.721207] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-07T18:49:34.090705] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-07T18:49:34.090801] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-07T18:49:34.091322] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-07T18:49:34.091372] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-07T18:49:34.092253] [DEBUG] [LOCAL ] ETY: Trimmed 34345 records to 23014 (keeping 200 days of data) [2025-10-07T18:49:34.237069] [DEBUG] [LOCAL ] ETY: Primary data saved (23014 records). [2025-10-07T18:49:34.237238] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-07T18:49:34.237326] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETY took 32.7s. Estimated remaining: 3h 41m 14s. Rate: 7.2 symbols/min [2025-10-07T18:49:34.257929] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-07T18:49:34.421234] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:49:34.429606] [DEBUG] [LOCAL ] EVG: Loaded 5987 existing records from primary storage. [2025-10-07T18:49:34.429954] [INFO ] [MAIN ] EVG: Loaded 5987 existing records. [2025-10-07T18:49:34.617568] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:49:34.617817] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-07T18:49:34.617867] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-07T18:49:34.618191] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-07T18:49:34.618249] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-07T18:49:34.955290] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T18:49:35.038872] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:49:35.047690] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-07T18:49:35.442146] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T18:49:35.847714] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-07T18:49:35.948442] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T18:49:36.616165] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-07T18:49:36.647619] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-07T18:49:37.271906] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T18:49:37.447703] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-07T18:49:38.141141] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T18:49:38.247694] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-07T18:49:39.047627] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-07T18:49:39.135032] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T18:49:39.847720] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-07T18:49:40.121523] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T18:49:40.647639] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-07T18:49:40.861203] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T18:49:41.388289] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T18:49:41.447769] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-07T18:49:42.247699] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-07T18:49:42.534726] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T18:49:43.047717] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-07T18:49:43.130179] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T18:49:43.847676] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-07T18:49:44.091517] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T18:49:44.647666] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-07T18:49:44.902070] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T18:49:45.447742] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-07T18:49:45.633849] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T18:49:46.247672] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-07T18:49:46.563313] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T18:49:47.047627] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-07T18:49:47.287124] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T18:49:47.847705] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-07T18:49:48.534825] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-07T18:49:48.558746] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T18:49:48.647698] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-07T18:49:49.420577] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T18:49:49.422099] [INFO ] [REMOTE ] EVC: Full fetch complete (29640 records). [2025-10-07T18:49:49.422173] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-07T18:49:49.452784] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-07T18:49:49.786898] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-07T18:49:49.786978] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-07T18:49:49.787445] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-07T18:49:49.787545] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-07T18:49:49.788272] [DEBUG] [LOCAL ] EVC: Trimmed 29640 records to 18322 (keeping 200 days of data) [2025-10-07T18:49:49.894580] [DEBUG] [LOCAL ] EVC: Primary data saved (18322 records). [2025-10-07T18:49:49.894750] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-07T18:49:49.894844] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 30.9s. Estimated remaining: 3h 41m 20s. Rate: 7.2 symbols/min [2025-10-07T18:49:50.061152] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:49:50.106021] [DEBUG] [LOCAL ] EVH: Loaded 49465 existing records from primary storage. [2025-10-07T18:49:50.106355] [INFO ] [MAIN ] EVH: Loaded 49465 existing records. [2025-10-07T18:49:50.252883] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-07T18:49:50.290922] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:49:50.291612] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-07T18:49:50.291694] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-07T18:49:50.292987] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-07T18:49:50.293048] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-07T18:49:50.641564] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:49:50.962802] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T18:49:50.965090] [INFO ] [REMOTE ] EVF: Full fetch complete (12480 records). [2025-10-07T18:49:50.965175] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-07T18:49:51.052967] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-07T18:49:51.254633] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T18:49:51.366485] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-07T18:49:51.366614] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-07T18:49:51.366993] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-07T18:49:51.367058] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-07T18:49:51.367584] [DEBUG] [LOCAL ] EVF: Trimmed 12480 records to 9610 (keeping 200 days of data) [2025-10-07T18:49:51.425672] [DEBUG] [LOCAL ] EVF: Primary data saved (9610 records). [2025-10-07T18:49:51.425832] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-07T18:49:51.425924] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVF took 29.1s. Estimated remaining: 3h 40m 58s. Rate: 7.2 symbols/min [2025-10-07T18:49:51.593445] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:49:51.605017] [DEBUG] [LOCAL ] EVN: Loaded 11130 existing records from primary storage. [2025-10-07T18:49:51.605247] [INFO ] [MAIN ] EVN: Loaded 11130 existing records. [2025-10-07T18:49:51.685054] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T18:49:51.809036] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:49:51.809328] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-07T18:49:51.809412] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-07T18:49:51.809990] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-07T18:49:51.810052] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-07T18:49:51.852755] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-07T18:49:52.158796] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:49:52.647720] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-07T18:49:53.447702] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-07T18:49:53.512048] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T18:49:54.247670] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-07T18:49:54.299153] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T18:49:54.369616] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T18:49:55.047752] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-07T18:49:55.851338] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-07T18:49:55.856823] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T18:49:56.063753] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T18:49:56.647712] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-07T18:49:57.113857] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T18:49:57.116967] [INFO ] [REMOTE ] EVEX: Full fetch complete (42654 records). [2025-10-07T18:49:57.117046] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-07T18:49:57.227015] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T18:49:57.452830] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-07T18:49:57.502161] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-07T18:49:57.502257] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-07T18:49:57.502941] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-07T18:49:57.503006] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-07T18:49:57.503960] [DEBUG] [LOCAL ] EVEX: Trimmed 42654 records to 31180 (keeping 200 days of data) [2025-10-07T18:49:57.677877] [DEBUG] [LOCAL ] EVEX: Primary data saved (31180 records). [2025-10-07T18:49:57.678024] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-07T18:49:57.678123] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVEX took 37.5s. Estimated remaining: 3h 40m 45s. Rate: 7.2 symbols/min [2025-10-07T18:49:57.853119] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:49:57.891335] [DEBUG] [LOCAL ] EVR: Loaded 34649 existing records from primary storage. [2025-10-07T18:49:57.891630] [INFO ] [MAIN ] EVR: Loaded 34649 existing records. [2025-10-07T18:49:58.007943] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-07T18:49:58.078331] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:49:58.078562] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-07T18:49:58.078610] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-07T18:49:58.079564] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-07T18:49:58.079626] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-07T18:49:58.255466] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-07T18:49:58.426581] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:49:59.047744] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-07T18:49:59.713134] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-07T18:49:59.847624] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-07T18:50:00.018968] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T18:50:00.647639] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-07T18:50:00.659922] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T18:50:01.447742] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-07T18:50:02.247689] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-07T18:50:02.319159] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T18:50:02.335261] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-07T18:50:02.789694] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-07T18:50:03.047717] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-07T18:50:03.847627] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-07T18:50:04.647752] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-07T18:50:04.747993] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T18:50:04.810669] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T18:50:05.447726] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-07T18:50:05.973007] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-07T18:50:06.059562] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T18:50:06.247697] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-07T18:50:07.047724] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-07T18:50:07.705042] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T18:50:07.847696] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-07T18:50:07.874231] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T18:50:08.647735] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-07T18:50:09.390239] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T18:50:09.439673] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T18:50:09.448271] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-07T18:50:10.247682] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-07T18:50:10.768636] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T18:50:10.967391] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T18:50:11.047692] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-07T18:50:11.847675] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-07T18:50:12.524581] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T18:50:12.605272] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T18:50:12.647689] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-07T18:50:13.447761] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-07T18:50:14.247707] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-07T18:50:14.346596] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T18:50:14.858119] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T18:50:15.053367] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-07T18:50:15.073480] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T18:50:15.701338] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T18:50:15.702726] [INFO ] [REMOTE ] EVG: Full fetch complete (8259 records). [2025-10-07T18:50:15.702817] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-07T18:50:15.858725] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-07T18:50:16.082569] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-07T18:50:16.082667] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-07T18:50:16.082921] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-07T18:50:16.083007] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-07T18:50:16.083494] [DEBUG] [LOCAL ] EVG: Trimmed 8259 records to 5964 (keeping 200 days of data) [2025-10-07T18:50:16.118546] [DEBUG] [LOCAL ] EVG: Primary data saved (5964 records). [2025-10-07T18:50:16.118630] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-07T18:50:16.118739] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVG took 41.9s. Estimated remaining: 3h 40m 57s. Rate: 7.2 symbols/min [2025-10-07T18:50:16.282266] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:50:16.298847] [DEBUG] [LOCAL ] EVT: Loaded 16858 existing records from primary storage. [2025-10-07T18:50:16.299085] [INFO ] [MAIN ] EVT: Loaded 16858 existing records. [2025-10-07T18:50:16.481754] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:50:16.481989] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-07T18:50:16.482037] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-07T18:50:16.482599] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-07T18:50:16.482697] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-07T18:50:16.660106] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-07T18:50:16.849925] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:50:17.373073] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T18:50:17.447613] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-07T18:50:18.247628] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-07T18:50:18.461957] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T18:50:18.870054] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T18:50:19.047702] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-07T18:50:19.048866] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T18:50:19.837365] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T18:50:19.847599] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-07T18:50:20.648443] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-07T18:50:20.654027] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T18:50:21.447753] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-07T18:50:22.247638] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-07T18:50:22.258024] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T18:50:22.371114] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T18:50:23.047735] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-07T18:50:23.297762] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T18:50:23.847754] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-07T18:50:24.647630] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-07T18:50:24.790157] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T18:50:25.296137] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T18:50:25.447622] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-07T18:50:25.617916] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T18:50:26.247706] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-07T18:50:26.684624] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T18:50:26.884925] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T18:50:26.886379] [INFO ] [REMOTE ] EVN: Full fetch complete (17728 records). [2025-10-07T18:50:26.886458] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-07T18:50:27.056497] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-07T18:50:27.284296] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-07T18:50:27.284376] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-07T18:50:27.284794] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-07T18:50:27.284856] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-07T18:50:27.285387] [DEBUG] [LOCAL ] EVN: Trimmed 17728 records to 11046 (keeping 200 days of data) [2025-10-07T18:50:27.355251] [DEBUG] [LOCAL ] EVN: Primary data saved (11046 records). [2025-10-07T18:50:27.355398] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-07T18:50:27.355483] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVN took 35.9s. Estimated remaining: 3h 40m 55s. Rate: 7.2 symbols/min [2025-10-07T18:50:27.524286] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:50:27.550797] [DEBUG] [LOCAL ] EVTC: Loaded 26337 existing records from primary storage. [2025-10-07T18:50:27.551093] [INFO ] [MAIN ] EVTC: Loaded 26337 existing records. [2025-10-07T18:50:27.728329] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:50:27.728604] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-07T18:50:27.728687] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-07T18:50:27.729401] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-07T18:50:27.729459] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-07T18:50:27.852732] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-07T18:50:28.090313] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:50:28.589943] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T18:50:28.593453] [INFO ] [REMOTE ] EVH: Full fetch complete (71771 records). [2025-10-07T18:50:28.593588] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-07T18:50:28.656784] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-07T18:50:29.003311] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-07T18:50:29.003466] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-07T18:50:29.004731] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-07T18:50:29.009996] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-07T18:50:29.018353] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T18:50:29.023887] [DEBUG] [LOCAL ] EVH: Trimmed 71771 records to 49492 (keeping 200 days of data) [2025-10-07T18:50:29.332325] [DEBUG] [LOCAL ] EVH: Primary data saved (49492 records). [2025-10-07T18:50:29.332485] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-07T18:50:29.332597] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 39.4s. Estimated remaining: 3h 40m 33s. Rate: 7.2 symbols/min [2025-10-07T18:50:29.452764] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-07T18:50:29.530471] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:50:29.566791] [DEBUG] [LOCAL ] EVTL: Loaded 38735 existing records from primary storage. [2025-10-07T18:50:29.567129] [INFO ] [MAIN ] EVTL: Loaded 38735 existing records. [2025-10-07T18:50:29.783712] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:50:29.784520] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-07T18:50:29.784578] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-07T18:50:29.785546] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-07T18:50:29.785608] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-07T18:50:30.152050] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T18:50:30.164582] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:50:30.247622] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-07T18:50:30.610191] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T18:50:31.047690] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-07T18:50:31.492139] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T18:50:31.847765] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-07T18:50:32.121537] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T18:50:32.647753] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-07T18:50:33.452776] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-07T18:50:33.475588] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T18:50:33.551689] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T18:50:34.247762] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-07T18:50:34.595370] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T18:50:34.599176] [INFO ] [REMOTE ] EVR: Full fetch complete (50706 records). [2025-10-07T18:50:34.599414] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-07T18:50:34.994229] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-07T18:50:34.994355] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-07T18:50:34.995303] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-07T18:50:34.995394] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-07T18:50:34.997002] [DEBUG] [LOCAL ] EVR: Trimmed 50706 records to 34643 (keeping 200 days of data) [2025-10-07T18:50:35.056860] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-07T18:50:35.242527] [DEBUG] [LOCAL ] EVR: Primary data saved (34643 records). [2025-10-07T18:50:35.242790] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-07T18:50:35.244039] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 37.6s. Estimated remaining: 3h 40m 20s. Rate: 7.2 symbols/min [2025-10-07T18:50:35.424872] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:50:35.454200] [DEBUG] [LOCAL ] EVTR: Loaded 24050 existing records from primary storage. [2025-10-07T18:50:35.454617] [INFO ] [MAIN ] EVTR: Loaded 24050 existing records. [2025-10-07T18:50:35.678864] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:50:35.681988] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-07T18:50:35.681722] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T18:50:35.682220] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-07T18:50:35.693480] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-07T18:50:35.693688] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-07T18:50:35.851864] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-07T18:50:36.121301] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:50:36.167837] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T18:50:36.647683] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-07T18:50:36.941920] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T18:50:37.447691] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-07T18:50:37.657818] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T18:50:38.247672] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-07T18:50:38.474069] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T18:50:39.047723] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-07T18:50:39.337298] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T18:50:39.784742] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T18:50:39.847736] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-07T18:50:40.647720] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-07T18:50:41.092034] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T18:50:41.447743] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-07T18:50:41.659906] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T18:50:42.247636] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-07T18:50:42.465080] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T18:50:43.047699] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-07T18:50:43.273126] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T18:50:43.847713] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-07T18:50:43.882039] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T18:50:43.883618] [INFO ] [REMOTE ] EVT: Full fetch complete (25268 records). [2025-10-07T18:50:43.883736] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-07T18:50:44.251683] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-07T18:50:44.251794] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-07T18:50:44.252301] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-07T18:50:44.252347] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-07T18:50:44.253856] [DEBUG] [LOCAL ] EVT: Trimmed 25268 records to 16888 (keeping 200 days of data) [2025-10-07T18:50:44.362133] [DEBUG] [LOCAL ] EVT: Primary data saved (16888 records). [2025-10-07T18:50:44.362292] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-07T18:50:44.362380] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 28.2s. Estimated remaining: 3h 40m 13s. Rate: 7.2 symbols/min [2025-10-07T18:50:44.544742] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:50:44.600233] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-07T18:50:44.600856] [INFO ] [MAIN ] EW: Loaded 53402 existing records. [2025-10-07T18:50:44.664871] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-07T18:50:44.785236] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:50:44.785580] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-07T18:50:44.785634] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-07T18:50:44.787441] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-07T18:50:44.787528] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-07T18:50:45.148588] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:50:45.164380] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T18:50:45.447701] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-07T18:50:46.252751] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-07T18:50:46.262427] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T18:50:46.942227] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T18:50:47.047689] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-07T18:50:47.794468] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T18:50:47.847672] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-07T18:50:48.034750] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T18:50:48.647704] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-07T18:50:49.452749] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-07T18:50:49.467775] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T18:50:49.700679] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T18:50:50.247676] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-07T18:50:50.711267] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T18:50:51.047630] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-07T18:50:51.143782] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T18:50:51.847684] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-07T18:50:52.100800] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T18:50:52.647690] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-07T18:50:53.447626] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-07T18:50:53.527556] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T18:50:53.916762] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T18:50:54.247629] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-07T18:50:54.567916] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T18:50:55.047678] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-07T18:50:55.799039] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T18:50:55.847598] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-07T18:50:56.169772] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T18:50:56.647705] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-07T18:50:57.447728] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-07T18:50:57.723979] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T18:50:58.247622] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-07T18:50:58.541678] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T18:50:58.718614] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-07T18:50:59.047702] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-07T18:50:59.351352] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T18:50:59.847742] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-07T18:51:00.647742] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-07T18:51:01.007677] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T18:51:01.058121] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T18:51:01.447698] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-07T18:51:01.880056] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T18:51:02.247702] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-07T18:51:03.047696] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-07T18:51:03.374015] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T18:51:03.717356] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T18:51:03.847636] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-07T18:51:04.647630] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-07T18:51:04.758045] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T18:51:04.786198] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T18:51:04.788629] [INFO ] [REMOTE ] EVTR: Full fetch complete (32783 records). [2025-10-07T18:51:04.788733] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-07T18:51:05.158056] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-07T18:51:05.158145] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-07T18:51:05.158677] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-07T18:51:05.158743] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-07T18:51:05.159681] [DEBUG] [LOCAL ] EVTR: Trimmed 32783 records to 24189 (keeping 200 days of data) [2025-10-07T18:51:05.312325] [DEBUG] [LOCAL ] EVTR: Primary data saved (24189 records). [2025-10-07T18:51:05.312468] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-07T18:51:05.312553] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTR took 30.1s. Estimated remaining: 3h 40m 30s. Rate: 7.2 symbols/min [2025-10-07T18:51:05.450488] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-07T18:51:05.470942] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T18:51:05.492152] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:51:05.495044] [INFO ] [REMOTE ] EVTC: Full fetch complete (38134 records). [2025-10-07T18:51:05.495155] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-07T18:51:05.811025] [DEBUG] [LOCAL ] EXG: Loaded 34162 existing records from primary storage. [2025-10-07T18:51:05.821268] [INFO ] [MAIN ] EXG: Loaded 34162 existing records. [2025-10-07T18:51:06.063690] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-07T18:51:06.078982] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-07T18:51:06.085017] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-07T18:51:06.084287] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:51:06.085145] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-07T18:51:06.085387] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-07T18:51:06.085445] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-07T18:51:06.086588] [DEBUG] [LOCAL ] EVTC: Trimmed 38134 records to 26406 (keeping 200 days of data) [2025-10-07T18:51:06.086669] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-07T18:51:06.087029] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-07T18:51:06.250089] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-07T18:51:06.565947] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:51:06.616998] [DEBUG] [LOCAL ] EVTC: Primary data saved (26406 records). [2025-10-07T18:51:06.617152] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-07T18:51:06.617299] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTC took 39.3s. Estimated remaining: 3h 40m 7s. Rate: 7.2 symbols/min [2025-10-07T18:51:06.786776] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:51:06.844484] [DEBUG] [LOCAL ] EXK: Loaded 53138 existing records from primary storage. [2025-10-07T18:51:06.844860] [INFO ] [MAIN ] EXK: Loaded 53138 existing records. [2025-10-07T18:51:07.020084] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:51:07.020280] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-07T18:51:07.020326] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-07T18:51:07.021580] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-07T18:51:07.021668] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-07T18:51:07.052888] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-07T18:51:07.383941] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:51:07.548943] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-07T18:51:07.847708] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-07T18:51:07.949878] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T18:51:08.471815] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T18:51:08.647606] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-07T18:51:09.312791] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T18:51:09.316234] [INFO ] [REMOTE ] EVTL: Full fetch complete (53009 records). [2025-10-07T18:51:09.316348] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-07T18:51:09.452896] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-07T18:51:09.702056] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-07T18:51:09.702190] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-07T18:51:09.702912] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-07T18:51:09.702979] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-07T18:51:09.704503] [DEBUG] [LOCAL ] EVTL: Trimmed 53009 records to 38975 (keeping 200 days of data) [2025-10-07T18:51:09.923674] [DEBUG] [LOCAL ] EVTL: Primary data saved (38975 records). [2025-10-07T18:51:09.923820] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-07T18:51:09.923904] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTL took 40.6s. Estimated remaining: 3h 39m 49s. Rate: 7.2 symbols/min [2025-10-07T18:51:10.084368] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T18:51:10.123070] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:51:10.151238] [DEBUG] [LOCAL ] EXP: Loaded 29678 existing records from primary storage. [2025-10-07T18:51:10.151508] [INFO ] [MAIN ] EXP: Loaded 29678 existing records. [2025-10-07T18:51:10.249750] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-07T18:51:10.329078] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:51:10.329264] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-07T18:51:10.329310] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-07T18:51:10.330066] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-07T18:51:10.330125] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-07T18:51:10.689757] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:51:11.047723] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-07T18:51:11.416085] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T18:51:11.664224] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T18:51:11.847699] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-07T18:51:12.348905] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-07T18:51:12.647707] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-07T18:51:13.447685] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-07T18:51:13.554820] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T18:51:13.618850] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T18:51:14.247680] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-07T18:51:14.994447] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T18:51:15.047638] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-07T18:51:15.194639] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T18:51:15.847747] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-07T18:51:16.604511] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T18:51:16.647606] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-07T18:51:17.447740] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-07T18:51:17.619795] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T18:51:18.000762] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T18:51:18.247719] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-07T18:51:19.047693] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-07T18:51:19.506533] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-07T18:51:19.807052] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T18:51:19.847711] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-07T18:51:20.649943] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-07T18:51:20.652732] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T18:51:21.447786] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-07T18:51:21.702249] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:51:22.247726] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-07T18:51:22.496777] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T18:51:22.882562] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T18:51:23.047752] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-07T18:51:23.794945] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T18:51:23.799136] [INFO ] [REMOTE ] EW: Full fetch complete (77348 records). [2025-10-07T18:51:23.799313] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-07T18:51:23.852877] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-07T18:51:24.212314] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-07T18:51:24.212435] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-07T18:51:24.213368] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-07T18:51:24.213439] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-07T18:51:24.215194] [DEBUG] [LOCAL ] EW: Trimmed 77348 records to 53402 (keeping 200 days of data) [2025-10-07T18:51:24.445131] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T18:51:24.572624] [DEBUG] [LOCAL ] EW: Primary data saved (53402 records). [2025-10-07T18:51:24.572817] [INFO ] [MAIN ] EW: Full history saved. [2025-10-07T18:51:24.572909] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EW took 40.2s. Estimated remaining: 3h 39m 53s. Rate: 7.2 symbols/min [2025-10-07T18:51:24.647734] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-07T18:51:25.293588] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T18:51:25.447683] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-07T18:51:25.956330] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T18:51:26.247749] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-07T18:51:26.739570] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T18:51:27.047761] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-07T18:51:27.718040] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T18:51:27.847731] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-07T18:51:28.271990] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T18:51:28.647723] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-07T18:51:28.920630] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T18:51:29.447744] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-07T18:51:30.247680] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-07T18:51:30.446086] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T18:51:30.677076] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T18:51:31.047735] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-07T18:51:31.137706] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T18:51:31.140257] [INFO ] [REMOTE ] EXG: Full fetch complete (49920 records). [2025-10-07T18:51:31.140371] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-07T18:51:31.518350] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-07T18:51:31.518459] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-07T18:51:31.519127] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-07T18:51:31.519190] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-07T18:51:31.520333] [DEBUG] [LOCAL ] EXG: Trimmed 49920 records to 34226 (keeping 200 days of data) [2025-10-07T18:51:31.731559] [DEBUG] [LOCAL ] EXG: Primary data saved (34226 records). [2025-10-07T18:51:31.731724] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-07T18:51:31.731832] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXG took 26.4s. Estimated remaining: 3h 39m 42s. Rate: 7.2 symbols/min [2025-10-07T18:51:31.843285] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T18:51:31.849067] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-07T18:51:32.647757] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-07T18:51:33.759299] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-07T18:51:33.773227] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-07T18:51:33.782047] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T18:51:33.784290] [INFO ] [REMOTE ] EXP: Full fetch complete (42846 records). [2025-10-07T18:51:33.784478] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-07T18:51:34.166267] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-07T18:51:34.166358] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-07T18:51:34.166974] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-07T18:51:34.167038] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-07T18:51:34.168153] [DEBUG] [LOCAL ] EXP: Trimmed 42846 records to 29608 (keeping 200 days of data) [2025-10-07T18:51:34.357314] [DEBUG] [LOCAL ] EXP: Primary data saved (29608 records). [2025-10-07T18:51:34.357456] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-07T18:51:34.357578] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXP took 24.4s. Estimated remaining: 3h 39m 22s. Rate: 7.2 symbols/min [2025-10-07T18:51:35.551928] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T18:51:35.566577] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-07T18:51:37.335708] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T18:51:37.348186] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-07T18:51:39.136962] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T18:51:39.149081] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-07T18:51:41.060474] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-07T18:51:41.072323] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-07T18:51:42.778520] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T18:51:42.782078] [INFO ] [REMOTE ] EXK: Full fetch complete (76563 records). [2025-10-07T18:51:42.782185] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-07T18:51:43.162582] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-07T18:51:43.162689] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-07T18:51:43.163554] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-07T18:51:43.163597] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-07T18:51:43.165091] [DEBUG] [LOCAL ] EXK: Trimmed 76563 records to 53139 (keeping 200 days of data) [2025-10-07T18:51:43.475967] [DEBUG] [LOCAL ] EXK: Primary data saved (53139 records). [2025-10-07T18:51:43.476134] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-07T18:51:43.476246] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXK took 36.9s. Estimated remaining: 3h 39m 16s. Rate: 7.2 symbols/min [2025-10-07T18:51:44.145556] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:51:44.200599] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:51:44.228492] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:51:44.254847] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:51:44.330255] [DEBUG] [LOCAL ] FAF: Loaded 41653 existing records from primary storage. [2025-10-07T18:51:44.330742] [INFO ] [MAIN ] FAF: Loaded 41653 existing records. [2025-10-07T18:51:44.472912] [DEBUG] [LOCAL ] EXPD: Loaded 47837 existing records from primary storage. [2025-10-07T18:51:44.495307] [INFO ] [MAIN ] EXPD: Loaded 47837 existing records. [2025-10-07T18:51:44.489724] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-07T18:51:44.518613] [DEBUG] [LOCAL ] EXR: Loaded 45249 existing records from primary storage. [2025-10-07T18:51:44.545403] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-07T18:51:44.635836] [INFO ] [MAIN ] EXR: Loaded 45249 existing records. [2025-10-07T18:51:44.810974] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:51:44.902184] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-07T18:51:44.938712] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-07T18:51:44.954679] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-07T18:51:44.975351] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-07T18:51:45.204452] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:51:45.195725] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:51:45.237911] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-07T18:51:45.278780] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-07T18:51:45.279061] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-07T18:51:45.260980] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:51:45.300394] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-07T18:51:45.300283] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-07T18:51:45.300556] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-07T18:51:45.311135] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-07T18:51:45.322126] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-07T18:51:45.340373] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-07T18:51:45.360390] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-07T18:51:45.365849] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-07T18:51:45.371493] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-07T18:51:46.576424] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:51:46.637964] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-07T18:51:46.808993] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:51:46.826052] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-07T18:51:46.868129] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:51:46.889480] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-07T18:51:46.893630] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:51:46.895606] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-07T18:51:48.121202] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T18:51:48.128919] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-07T18:51:48.213773] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T18:51:48.223352] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-07T18:51:48.301185] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T18:51:48.309988] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-07T18:51:48.999889] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-07T18:51:49.013269] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-07T18:51:49.249149] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T18:51:49.257990] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-07T18:51:49.572596] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T18:51:49.582191] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-07T18:51:49.967426] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T18:51:49.976992] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-07T18:51:50.612852] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T18:51:50.620681] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-07T18:51:51.197394] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T18:51:51.206313] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-07T18:51:51.405788] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T18:51:51.415334] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-07T18:51:51.502573] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-07T18:51:51.514431] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-07T18:51:51.964521] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T18:51:51.974315] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-07T18:51:52.769489] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T18:51:52.779765] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-07T18:51:53.131226] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T18:51:53.141825] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-07T18:51:53.230396] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T18:51:53.240064] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-07T18:51:53.798441] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-07T18:51:53.809066] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-07T18:51:54.554181] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T18:51:54.592235] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-07T18:51:54.595497] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T18:51:54.607068] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-07T18:51:54.765170] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T18:51:55.047780] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-07T18:51:56.215933] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-07T18:51:56.233738] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-07T18:51:56.360896] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T18:51:56.401451] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T18:51:56.443423] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T18:51:56.647753] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-07T18:51:57.447677] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-07T18:51:57.945891] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T18:51:58.247745] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-07T18:51:58.476518] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-07T18:51:58.655893] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T18:51:59.047732] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-07T18:51:59.799385] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T18:51:59.847602] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-07T18:52:00.647725] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-07T18:52:00.706329] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T18:52:01.222576] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T18:52:01.447719] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-07T18:52:02.247732] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-07T18:52:02.284419] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T18:52:02.962256] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T18:52:03.047721] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-07T18:52:03.847752] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-07T18:52:04.538740] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T18:52:04.542960] [INFO ] [REMOTE ] EXPD: Full fetch complete (69248 records). [2025-10-07T18:52:04.543061] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-07T18:52:04.649538] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-07T18:52:04.970782] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-07T18:52:04.989931] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-07T18:52:05.001047] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-07T18:52:05.002434] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-07T18:52:05.002522] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-07T18:52:05.004613] [DEBUG] [LOCAL ] EXPD: Trimmed 69248 records to 47815 (keeping 200 days of data) [2025-10-07T18:52:05.313748] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T18:52:05.333815] [DEBUG] [LOCAL ] EXPD: Primary data saved (47815 records). [2025-10-07T18:52:05.333985] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-07T18:52:05.334085] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. EXPD took 21.9s. Estimated remaining: 3h 39m 34s. Rate: 7.2 symbols/min [2025-10-07T18:52:05.452901] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-07T18:52:05.502122] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:05.546228] [DEBUG] [LOCAL ] FBIN: Loaded 50431 existing records from primary storage. [2025-10-07T18:52:05.546563] [INFO ] [MAIN ] FBIN: Loaded 50431 existing records. [2025-10-07T18:52:05.721452] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:52:05.721716] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-07T18:52:05.721772] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-07T18:52:05.722024] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-07T18:52:05.722080] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-07T18:52:06.063578] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:52:06.247605] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-07T18:52:06.470491] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T18:52:07.047779] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-07T18:52:07.855697] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-07T18:52:07.877110] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T18:52:08.181868] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-10-07T18:52:08.647709] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-07T18:52:08.730408] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T18:52:09.069424] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T18:52:09.447723] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-07T18:52:10.247660] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-07T18:52:10.372959] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T18:52:10.763471] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T18:52:10.766494] [INFO ] [REMOTE ] FAF: Full fetch complete (57740 records). [2025-10-07T18:52:10.766621] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-07T18:52:11.052792] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-07T18:52:11.190522] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-07T18:52:11.190666] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-07T18:52:11.191743] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-07T18:52:11.191847] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-07T18:52:11.193839] [DEBUG] [LOCAL ] FAF: Trimmed 57740 records to 41605 (keeping 200 days of data) [2025-10-07T18:52:11.477000] [DEBUG] [LOCAL ] FAF: Primary data saved (41605 records). [2025-10-07T18:52:11.477147] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-07T18:52:11.477239] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. FAF took 28.0s. Estimated remaining: 3h 39m 21s. Rate: 7.2 symbols/min [2025-10-07T18:52:11.656145] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T18:52:11.658784] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:11.664215] [INFO ] [REMOTE ] EXR: Full fetch complete (65959 records). [2025-10-07T18:52:11.664373] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-07T18:52:11.858935] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-07T18:52:11.942597] [DEBUG] [LOCAL ] FBK: Loaded 26494 existing records from primary storage. [2025-10-07T18:52:11.968813] [INFO ] [MAIN ] FBK: Loaded 26494 existing records. [2025-10-07T18:52:12.287393] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-07T18:52:12.310532] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-07T18:52:12.310341] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:52:12.310878] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-07T18:52:12.312120] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-07T18:52:12.312275] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-07T18:52:12.312401] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-07T18:52:12.312959] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-07T18:52:12.313021] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-07T18:52:12.414733] [DEBUG] [LOCAL ] EXR: Trimmed 65959 records to 45261 (keeping 200 days of data) [2025-10-07T18:52:12.797243] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:52:12.800576] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-07T18:52:12.834937] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T18:52:13.029979] [DEBUG] [LOCAL ] EXR: Primary data saved (45261 records). [2025-10-07T18:52:13.030174] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-07T18:52:13.031441] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXR took 29.5s. Estimated remaining: 3h 38m 59s. Rate: 7.2 symbols/min [2025-10-07T18:52:13.200985] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:13.248217] [DEBUG] [LOCAL ] FBP: Loaded 45899 existing records from primary storage. [2025-10-07T18:52:13.248552] [INFO ] [MAIN ] FBP: Loaded 45899 existing records. [2025-10-07T18:52:13.424558] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:52:13.424850] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-07T18:52:13.424898] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-07T18:52:13.425114] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-07T18:52:13.425171] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-07T18:52:13.455926] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-07T18:52:13.795954] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:52:13.797506] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T18:52:14.247705] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-07T18:52:14.636095] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-07T18:52:14.991786] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T18:52:15.047609] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-07T18:52:15.219737] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T18:52:15.847731] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-07T18:52:16.552860] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T18:52:16.647701] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-07T18:52:17.447677] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-07T18:52:18.064586] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-07T18:52:18.085764] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T18:52:18.247755] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-07T18:52:18.542282] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T18:52:19.047735] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-07T18:52:19.847696] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-07T18:52:19.923369] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T18:52:19.972152] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T18:52:20.647694] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-07T18:52:21.444189] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T18:52:21.453527] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-07T18:52:22.258731] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-07T18:52:22.263548] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T18:52:23.047737] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-07T18:52:23.847622] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-07T18:52:23.898830] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-07T18:52:24.000897] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T18:52:24.504138] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T18:52:24.647674] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-07T18:52:24.779289] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T18:52:25.447707] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-07T18:52:26.180739] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T18:52:26.247737] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-07T18:52:27.047734] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-07T18:52:27.571367] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-07T18:52:27.575147] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-07T18:52:27.575284] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-07T18:52:27.853139] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-07T18:52:27.986419] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-07T18:52:27.986749] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-07T18:52:27.987939] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-07T18:52:27.988110] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-07T18:52:27.990415] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-07T18:52:28.127993] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T18:52:28.126803] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T18:52:28.387350] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-07T18:52:28.387536] [INFO ] [MAIN ] F: Full history saved. [2025-10-07T18:52:28.387634] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 44.9s. Estimated remaining: 3h 39m 4s. Rate: 7.2 symbols/min [2025-10-07T18:52:28.550769] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:28.584001] [DEBUG] [LOCAL ] FBRT: Loaded 34881 existing records from primary storage. [2025-10-07T18:52:28.584310] [INFO ] [MAIN ] FBRT: Loaded 34881 existing records. [2025-10-07T18:52:28.655897] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-07T18:52:28.759280] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:52:28.759463] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-07T18:52:28.759508] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-07T18:52:28.759780] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-07T18:52:28.759839] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-07T18:52:29.105420] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:52:29.452778] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-07T18:52:29.471069] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:52:30.247624] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-07T18:52:30.249218] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T18:52:30.529418] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T18:52:31.047683] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-07T18:52:31.284729] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T18:52:31.847676] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-07T18:52:32.647713] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-07T18:52:32.683611] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T18:52:33.274677] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T18:52:33.447713] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-07T18:52:33.924107] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T18:52:34.247737] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-07T18:52:34.783258] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T18:52:35.047668] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-07T18:52:35.525785] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T18:52:35.847636] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-07T18:52:36.169231] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T18:52:36.647690] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-07T18:52:37.112281] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T18:52:37.115724] [INFO ] [REMOTE ] FBIN: Full fetch complete (72735 records). [2025-10-07T18:52:37.115842] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-07T18:52:37.452802] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-07T18:52:37.509965] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-07T18:52:37.510044] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-07T18:52:37.510973] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-07T18:52:37.511044] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-07T18:52:37.512559] [DEBUG] [LOCAL ] FBIN: Trimmed 72735 records to 50405 (keeping 200 days of data) [2025-10-07T18:52:37.841211] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T18:52:37.858763] [DEBUG] [LOCAL ] FBIN: Primary data saved (50405 records). [2025-10-07T18:52:37.858947] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-07T18:52:37.859062] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBIN took 32.5s. Estimated remaining: 3h 38m 58s. Rate: 7.2 symbols/min [2025-10-07T18:52:38.026733] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:38.043583] [DEBUG] [LOCAL ] FC: Loaded 15376 existing records from primary storage. [2025-10-07T18:52:38.043860] [INFO ] [MAIN ] FC: Loaded 15376 existing records. [2025-10-07T18:52:38.223203] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:52:38.223438] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-07T18:52:38.223485] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-07T18:52:38.223704] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-07T18:52:38.223773] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-07T18:52:38.253387] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-07T18:52:38.571429] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:52:39.047709] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-07T18:52:39.269059] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T18:52:39.406549] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T18:52:39.410949] [INFO ] [REMOTE ] FBK: Full fetch complete (34123 records). [2025-10-07T18:52:39.411226] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-07T18:52:39.780001] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-07T18:52:39.780086] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-07T18:52:39.780680] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-07T18:52:39.780744] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-07T18:52:39.781585] [DEBUG] [LOCAL ] FBK: Trimmed 34123 records to 26609 (keeping 200 days of data) [2025-10-07T18:52:39.871903] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-07T18:52:39.899792] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T18:52:39.962822] [DEBUG] [LOCAL ] FBK: Primary data saved (26609 records). [2025-10-07T18:52:39.962998] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-07T18:52:39.963104] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBK took 28.5s. Estimated remaining: 3h 38m 37s. Rate: 7.2 symbols/min [2025-10-07T18:52:40.133847] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:40.175037] [DEBUG] [LOCAL ] FCF: Loaded 39322 existing records from primary storage. [2025-10-07T18:52:40.175355] [INFO ] [MAIN ] FCF: Loaded 39322 existing records. [2025-10-07T18:52:40.357607] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:52:40.357864] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-07T18:52:40.357914] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-07T18:52:40.358145] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-07T18:52:40.358205] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-07T18:52:40.652748] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-07T18:52:40.714332] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:52:41.452732] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-07T18:52:41.469128] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T18:52:42.072297] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-07T18:52:42.247705] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-07T18:52:42.607688] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T18:52:43.047679] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-07T18:52:43.636933] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T18:52:43.847726] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-07T18:52:43.941003] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T18:52:44.647695] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-07T18:52:44.967167] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T18:52:45.447729] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-07T18:52:45.652149] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-07T18:52:46.247683] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-07T18:52:46.815925] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T18:52:47.047635] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-07T18:52:47.289682] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T18:52:47.847695] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-07T18:52:48.304051] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T18:52:48.647712] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-07T18:52:48.731315] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T18:52:49.447699] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-07T18:52:50.105255] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T18:52:50.247764] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-07T18:52:50.861929] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T18:52:51.047696] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-07T18:52:51.646888] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T18:52:51.853127] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-07T18:52:51.855428] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T18:52:52.647701] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-07T18:52:53.079119] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T18:52:53.447748] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-07T18:52:53.802249] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T18:52:54.247734] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-07T18:52:54.633121] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T18:52:54.636410] [INFO ] [REMOTE ] FBRT: Full fetch complete (49237 records). [2025-10-07T18:52:54.636524] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-07T18:52:55.058000] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-07T18:52:55.062031] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-07T18:52:55.062147] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-07T18:52:55.063163] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-07T18:52:55.063291] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-07T18:52:55.065008] [DEBUG] [LOCAL ] FBRT: Trimmed 49237 records to 35007 (keeping 200 days of data) [2025-10-07T18:52:55.297814] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T18:52:55.329899] [DEBUG] [LOCAL ] FBRT: Primary data saved (35007 records). [2025-10-07T18:52:55.330128] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-07T18:52:55.330244] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBRT took 26.9s. Estimated remaining: 3h 38m 43s. Rate: 7.2 symbols/min [2025-10-07T18:52:55.512677] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:55.544564] [DEBUG] [LOCAL ] FCN: Loaded 25991 existing records from primary storage. [2025-10-07T18:52:55.545002] [INFO ] [MAIN ] FCN: Loaded 25991 existing records. [2025-10-07T18:52:55.728939] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:52:55.729318] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-07T18:52:55.729471] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-07T18:52:55.731027] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-07T18:52:55.731091] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-07T18:52:55.852869] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-07T18:52:56.113439] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:52:56.265863] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T18:52:56.269636] [INFO ] [REMOTE ] FBP: Full fetch complete (66467 records). [2025-10-07T18:52:56.269869] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-07T18:52:56.647638] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-07T18:52:56.749106] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-07T18:52:56.749285] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-07T18:52:56.750257] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-07T18:52:56.750330] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-07T18:52:56.751719] [DEBUG] [LOCAL ] FBP: Trimmed 66467 records to 45850 (keeping 200 days of data) [2025-10-07T18:52:56.881937] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T18:52:57.058615] [DEBUG] [LOCAL ] FBP: Primary data saved (45850 records). [2025-10-07T18:52:57.058801] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-07T18:52:57.058929] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBP took 44.0s. Estimated remaining: 3h 38m 21s. Rate: 7.2 symbols/min [2025-10-07T18:52:57.223896] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:57.263756] [DEBUG] [LOCAL ] FCPT: Loaded 37322 existing records from primary storage. [2025-10-07T18:52:57.264062] [INFO ] [MAIN ] FCPT: Loaded 37322 existing records. [2025-10-07T18:52:57.436057] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:52:57.436311] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-07T18:52:57.436359] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-07T18:52:57.436746] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-07T18:52:57.436805] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-07T18:52:57.456767] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-07T18:52:57.827636] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:52:58.077839] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T18:52:58.104056] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T18:52:58.247681] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-07T18:52:59.047674] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-07T18:52:59.055920] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T18:52:59.057323] [INFO ] [REMOTE ] FC: Full fetch complete (21807 records). [2025-10-07T18:52:59.057411] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-07T18:52:59.423968] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-07T18:52:59.424046] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-07T18:52:59.424478] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-07T18:52:59.424517] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-07T18:52:59.425106] [DEBUG] [LOCAL ] FC: Trimmed 21807 records to 15301 (keeping 200 days of data) [2025-10-07T18:52:59.514630] [DEBUG] [LOCAL ] FC: Primary data saved (15301 records). [2025-10-07T18:52:59.514803] [INFO ] [MAIN ] FC: Full history saved. [2025-10-07T18:52:59.514886] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 21.7s. Estimated remaining: 3h 38m 1s. Rate: 7.2 symbols/min [2025-10-07T18:52:59.679228] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:52:59.679409] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-07T18:52:59.679445] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-07T18:52:59.679553] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-07T18:52:59.679690] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-07T18:52:59.679755] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-07T18:52:59.679790] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-07T18:52:59.853002] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-07T18:53:00.035581] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:53:00.420915] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T18:53:00.647667] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-07T18:53:00.999611] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T18:53:01.128241] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T18:53:01.447756] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-07T18:53:01.824744] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-07T18:53:02.247675] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-07T18:53:02.669692] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-07T18:53:03.047738] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-07T18:53:03.847729] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-07T18:53:04.624850] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T18:53:04.647597] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-07T18:53:04.684714] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-07T18:53:05.447741] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-07T18:53:06.142970] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T18:53:06.247675] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-07T18:53:06.604313] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T18:53:06.657004] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-07T18:53:07.047733] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-07T18:53:07.847751] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-07T18:53:08.281066] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T18:53:08.647713] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-07T18:53:09.016771] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-07T18:53:09.035084] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T18:53:09.447713] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-07T18:53:10.247716] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-07T18:53:10.902432] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T18:53:11.047719] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-07T18:53:11.676474] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T18:53:11.847784] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-07T18:53:12.166235] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-07T18:53:12.575050] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T18:53:12.647608] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-07T18:53:13.447609] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-07T18:53:13.900306] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-07T18:53:14.247703] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-07T18:53:14.630525] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T18:53:15.047617] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-07T18:53:15.374983] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T18:53:15.847753] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-07T18:53:16.301521] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T18:53:16.647697] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-07T18:53:16.772161] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-07T18:53:17.447738] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-07T18:53:18.142605] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T18:53:18.247740] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-07T18:53:19.011515] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T18:53:19.047608] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-07T18:53:19.442070] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T18:53:19.847711] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-07T18:53:20.488045] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T18:53:20.647708] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-07T18:53:20.924956] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T18:53:21.035739] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-07T18:53:21.447767] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-07T18:53:22.247715] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-07T18:53:22.576115] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-07T18:53:22.647945] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-07T18:53:23.047694] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-07T18:53:23.847812] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-07T18:53:24.187737] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-07T18:53:24.409315] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T18:53:24.647689] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-07T18:53:25.447758] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-07T18:53:26.247674] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-07T18:53:26.422851] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T18:53:26.703546] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T18:53:27.047739] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-07T18:53:27.678914] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T18:53:27.682616] [INFO ] [REMOTE ] FCF: Full fetch complete (58176 records). [2025-10-07T18:53:27.682803] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-07T18:53:27.851944] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-07T18:53:28.135087] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-07T18:53:28.135248] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-07T18:53:28.136505] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-07T18:53:28.141931] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-07T18:53:28.142865] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T18:53:28.146585] [INFO ] [REMOTE ] FCN: Full fetch complete (35748 records). [2025-10-07T18:53:28.146861] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-07T18:53:28.153298] [DEBUG] [LOCAL ] FCF: Trimmed 58176 records to 39294 (keeping 200 days of data) [2025-10-07T18:53:28.470082] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-07T18:53:28.648921] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-07T18:53:28.876153] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-07T18:53:28.876688] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-07T18:53:28.879064] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-07T18:53:28.879688] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-07T18:53:28.884105] [DEBUG] [LOCAL ] FCN: Trimmed 35748 records to 26013 (keeping 200 days of data) [2025-10-07T18:53:29.151591] [DEBUG] [LOCAL ] FCF: Primary data saved (39294 records). [2025-10-07T18:53:29.155037] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-07T18:53:29.155194] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCF took 49.2s. Estimated remaining: 3h 38m 34s. Rate: 7.1 symbols/min [2025-10-07T18:53:29.340560] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:53:29.391221] [DEBUG] [LOCAL ] FCT: Loaded 14710 existing records from primary storage. [2025-10-07T18:53:29.392568] [INFO ] [MAIN ] FCT: Loaded 14710 existing records. [2025-10-07T18:53:29.457342] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-07T18:53:29.577863] [DEBUG] [LOCAL ] FCN: Primary data saved (26013 records). [2025-10-07T18:53:29.607290] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-07T18:53:29.607425] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCN took 34.3s. Estimated remaining: 3h 38m 10s. Rate: 7.2 symbols/min [2025-10-07T18:53:29.607167] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:53:29.672186] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-07T18:53:29.677767] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-07T18:53:29.713388] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-07T18:53:29.713480] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-07T18:53:29.886874] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:53:30.116808] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T18:53:30.151216] [INFO ] [REMOTE ] FCRX: Full fetch complete (1674 records). [2025-10-07T18:53:30.159709] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-07T18:53:30.194594] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:53:30.248748] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-07T18:53:30.286863] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-07T18:53:30.294142] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T18:53:30.306669] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-07T18:53:30.581008] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-07T18:53:30.597682] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:53:30.602260] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:53:30.602375] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:53:30.602639] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-07T18:53:30.602758] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-07T18:53:30.602847] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-07T18:53:30.603024] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-07T18:53:30.603081] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-07T18:53:30.603125] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-07T18:53:30.603214] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCRX took 31.1s. Estimated remaining: 3h 37m 48s. Rate: 7.2 symbols/min [2025-10-07T18:53:30.603285] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-07T18:53:30.603384] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-07T18:53:30.955559] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:53:31.053888] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-07T18:53:31.167615] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:53:31.191073] [DEBUG] [LOCAL ] FDP: Loaded 30103 existing records from primary storage. [2025-10-07T18:53:31.192012] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T18:53:31.196844] [INFO ] [MAIN ] FDP: Loaded 30103 existing records. [2025-10-07T18:53:31.372110] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:53:31.372330] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-07T18:53:31.372380] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-07T18:53:31.372606] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-07T18:53:31.372697] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-07T18:53:31.714314] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:53:31.847712] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-07T18:53:32.573782] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T18:53:32.647720] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-07T18:53:33.447668] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-07T18:53:33.927256] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-07T18:53:33.939547] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T18:53:33.954537] [INFO ] [REMOTE ] FCPT: Full fetch complete (53836 records). [2025-10-07T18:53:33.954670] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-07T18:53:34.252779] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-07T18:53:34.335371] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-07T18:53:34.335461] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-07T18:53:34.336231] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-07T18:53:34.336298] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-07T18:53:34.339986] [DEBUG] [LOCAL ] FCPT: Trimmed 53836 records to 37319 (keeping 200 days of data) [2025-10-07T18:53:34.453670] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T18:53:34.591529] [DEBUG] [LOCAL ] FCPT: Primary data saved (37319 records). [2025-10-07T18:53:34.591717] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-07T18:53:34.591819] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCPT took 37.5s. Estimated remaining: 3h 37m 31s. Rate: 7.2 symbols/min [2025-10-07T18:53:34.759075] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:53:34.788178] [DEBUG] [LOCAL ] FDS: Loaded 26884 existing records from primary storage. [2025-10-07T18:53:34.788441] [INFO ] [MAIN ] FDS: Loaded 26884 existing records. [2025-10-07T18:53:34.966411] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:53:34.966679] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-07T18:53:34.966749] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-07T18:53:34.967000] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-07T18:53:34.967059] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-07T18:53:35.052819] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-07T18:53:35.329661] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:53:35.847605] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-07T18:53:36.186161] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T18:53:36.232513] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T18:53:36.647689] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-07T18:53:37.085768] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T18:53:37.447757] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-07T18:53:38.247627] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-07T18:53:38.518701] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-07T18:53:38.551257] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T18:53:39.047734] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-07T18:53:39.538786] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T18:53:39.847702] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-07T18:53:39.877144] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T18:53:40.647693] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-07T18:53:40.857861] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T18:53:41.447694] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-07T18:53:41.834668] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T18:53:42.247696] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-07T18:53:42.338420] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-07T18:53:43.047741] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-07T18:53:43.364855] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T18:53:43.847683] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-07T18:53:44.647783] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-07T18:53:45.022167] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T18:53:45.316348] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-07T18:53:45.447632] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-07T18:53:45.682035] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T18:53:46.247686] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-07T18:53:46.684827] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T18:53:47.037230] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T18:53:47.047669] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-07T18:53:47.847715] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-07T18:53:48.207059] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T18:53:48.647797] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-07T18:53:49.059191] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T18:53:49.447679] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-07T18:53:50.247628] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-07T18:53:50.649204] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T18:53:50.762108] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T18:53:51.047638] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-07T18:53:51.215373] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T18:53:51.847755] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-07T18:53:52.328412] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T18:53:52.647696] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-07T18:53:52.891392] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T18:53:53.447737] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-07T18:53:54.247670] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-07T18:53:54.375900] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T18:53:54.571144] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T18:53:55.047751] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-07T18:53:55.531254] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-07T18:53:55.847702] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-07T18:53:55.866840] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T18:53:56.647664] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-07T18:53:57.093635] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T18:53:57.447733] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-07T18:53:58.247693] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-07T18:53:58.723155] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-07T18:53:59.047739] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-07T18:53:59.090612] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T18:53:59.244505] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T18:53:59.847663] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-07T18:54:00.647759] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-07T18:54:01.162591] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T18:54:01.258741] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-07T18:54:01.447737] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-07T18:54:01.952459] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T18:54:01.956066] [INFO ] [REMOTE ] FDS: Full fetch complete (38053 records). [2025-10-07T18:54:01.956170] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-07T18:54:02.249778] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-07T18:54:02.379765] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-07T18:54:02.379990] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-07T18:54:02.380867] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-07T18:54:02.380941] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-07T18:54:02.382149] [DEBUG] [LOCAL ] FDS: Trimmed 38053 records to 26938 (keeping 200 days of data) [2025-10-07T18:54:02.494759] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T18:54:02.592265] [DEBUG] [LOCAL ] FDS: Primary data saved (26938 records). [2025-10-07T18:54:02.592505] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-07T18:54:02.592623] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FDS took 28.0s. Estimated remaining: 3h 38m 0s. Rate: 7.1 symbols/min [2025-10-07T18:54:02.772551] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:54:02.832592] [DEBUG] [LOCAL ] FDX: Loaded 51530 existing records from primary storage. [2025-10-07T18:54:02.833095] [INFO ] [MAIN ] FDX: Loaded 51530 existing records. [2025-10-07T18:54:03.028972] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:54:03.029301] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-07T18:54:03.029365] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-07T18:54:03.029711] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-07T18:54:03.029774] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-07T18:54:03.052809] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-07T18:54:03.443202] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:54:03.731011] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T18:54:03.847697] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-07T18:54:04.647632] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-07T18:54:04.876049] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T18:54:04.878260] [INFO ] [REMOTE ] FDP: Full fetch complete (42909 records). [2025-10-07T18:54:04.878348] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-07T18:54:05.269806] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-07T18:54:05.269941] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-07T18:54:05.270915] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-07T18:54:05.271026] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-07T18:54:05.302829] [DEBUG] [LOCAL ] FDP: Trimmed 42909 records to 30089 (keeping 200 days of data) [2025-10-07T18:54:05.305354] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-07T18:54:05.467240] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-07T18:54:05.506022] [DEBUG] [LOCAL ] FDP: Primary data saved (30089 records). [2025-10-07T18:54:05.506143] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-07T18:54:05.506227] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDP took 34.9s. Estimated remaining: 3h 37m 41s. Rate: 7.1 symbols/min [2025-10-07T18:54:05.674679] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:54:05.725214] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-07T18:54:05.725625] [INFO ] [MAIN ] FE: Loaded 53430 existing records. [2025-10-07T18:54:05.900809] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:54:05.901019] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-07T18:54:05.901131] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-07T18:54:05.901354] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-07T18:54:05.901411] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-07T18:54:06.257380] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:54:06.250946] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-07T18:54:06.586058] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T18:54:07.047621] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-07T18:54:07.095842] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T18:54:07.097490] [INFO ] [REMOTE ] FCT: Full fetch complete (21194 records). [2025-10-07T18:54:07.097563] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-07T18:54:07.528797] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-07T18:54:07.528960] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-07T18:54:07.530061] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-07T18:54:07.530161] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-07T18:54:07.531507] [DEBUG] [LOCAL ] FCT: Trimmed 21194 records to 14747 (keeping 200 days of data) [2025-10-07T18:54:07.662571] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-07T18:54:07.687388] [DEBUG] [LOCAL ] FCT: Primary data saved (14747 records). [2025-10-07T18:54:07.687617] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-07T18:54:07.687771] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCT took 38.5s. Estimated remaining: 3h 37m 21s. Rate: 7.2 symbols/min [2025-10-07T18:54:07.853127] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-07T18:54:07.856616] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:54:07.857548] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-07T18:54:07.857602] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-07T18:54:07.857757] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-07T18:54:07.857802] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-07T18:54:07.857845] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-07T18:54:07.857879] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-07T18:54:08.209448] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:54:08.647659] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-07T18:54:08.864978] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T18:54:09.081511] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-07T18:54:09.447734] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-07T18:54:09.863994] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-07T18:54:09.971937] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-07T18:54:09.976025] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-07T18:54:09.976175] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-07T18:54:10.255598] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-07T18:54:10.454863] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-07T18:54:10.454944] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-07T18:54:10.455852] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-07T18:54:10.455925] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-07T18:54:10.457501] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 53700 (keeping 200 days of data) [2025-10-07T18:54:10.795953] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-10-07T18:54:10.796098] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-07T18:54:10.796204] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FCX took 41.2s. Estimated remaining: 3h 37m 3s. Rate: 7.2 symbols/min [2025-10-07T18:54:10.961945] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:54:11.007409] [DEBUG] [LOCAL ] FERG: Loaded 48790 existing records from primary storage. [2025-10-07T18:54:11.007815] [INFO ] [MAIN ] FERG: Loaded 48790 existing records. [2025-10-07T18:54:11.052877] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-07T18:54:11.223301] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:54:11.223573] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-07T18:54:11.223619] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-07T18:54:11.223925] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-07T18:54:11.223985] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-07T18:54:11.577504] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-07T18:54:11.583054] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:54:11.847637] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-07T18:54:12.040798] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T18:54:12.336408] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-07T18:54:12.647708] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-07T18:54:13.447721] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-07T18:54:13.906286] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-07T18:54:14.247621] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-07T18:54:14.415918] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T18:54:14.795755] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-07T18:54:15.047692] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-07T18:54:15.847765] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-07T18:54:16.647678] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-07T18:54:16.903045] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T18:54:17.447713] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-07T18:54:17.722855] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-07T18:54:17.878994] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T18:54:18.247747] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-07T18:54:18.443444] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T18:54:19.047770] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-07T18:54:19.847702] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-07T18:54:20.073235] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T18:54:20.647728] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-07T18:54:20.773700] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T18:54:21.246895] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T18:54:21.447769] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-07T18:54:22.252707] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-07T18:54:22.258698] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T18:54:23.047321] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T18:54:23.057847] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-07T18:54:23.422394] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-07T18:54:23.805110] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T18:54:23.847701] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-07T18:54:24.207719] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-07T18:54:24.647696] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-07T18:54:25.447694] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-07T18:54:25.902837] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-07T18:54:26.247625] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-07T18:54:26.281365] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T18:54:26.649579] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-07T18:54:26.650333] [INFO ] [REMOTE ] FENG: Full fetch complete (2265 records). [2025-10-07T18:54:26.650403] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-07T18:54:26.837959] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T18:54:26.838181] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T18:54:26.838271] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T18:54:26.838370] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-07T18:54:26.838467] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-07T18:54:26.838526] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-07T18:54:26.838573] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-07T18:54:26.838635] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FENG took 19.2s. Estimated remaining: 3h 37m 9s. Rate: 7.2 symbols/min [2025-10-07T18:54:27.012165] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:54:27.027909] [DEBUG] [LOCAL ] FET: Loaded 12814 existing records from primary storage. [2025-10-07T18:54:27.028167] [INFO ] [MAIN ] FET: Loaded 12814 existing records. [2025-10-07T18:54:27.057345] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-07T18:54:27.214657] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:54:27.215175] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-07T18:54:27.215236] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-07T18:54:27.215492] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-07T18:54:27.215552] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-07T18:54:27.571693] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:54:27.847687] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-07T18:54:28.647687] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-07T18:54:29.076404] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-07T18:54:29.447674] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-07T18:54:29.590140] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T18:54:30.044726] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T18:54:30.246808] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T18:54:30.256552] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-07T18:54:31.047678] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-07T18:54:31.847674] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-07T18:54:32.156994] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-07T18:54:32.647622] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-07T18:54:32.987889] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T18:54:33.223732] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T18:54:33.447690] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-07T18:54:34.247806] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-07T18:54:34.372169] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T18:54:34.675490] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T18:54:35.047739] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-07T18:54:35.852716] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-07T18:54:35.865481] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T18:54:36.647681] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-07T18:54:36.917096] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T18:54:37.447675] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-07T18:54:37.550132] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T18:54:38.247620] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-07T18:54:38.612031] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T18:54:38.891718] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T18:54:38.929023] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T18:54:39.047692] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-07T18:54:39.847713] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-07T18:54:40.623852] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T18:54:40.647603] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-07T18:54:40.818191] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-07T18:54:40.821982] [INFO ] [REMOTE ] FDX: Full fetch complete (74413 records). [2025-10-07T18:54:40.822135] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-07T18:54:41.245150] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-07T18:54:41.245340] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-07T18:54:41.246390] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-07T18:54:41.246522] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-07T18:54:41.248376] [DEBUG] [LOCAL ] FDX: Trimmed 74413 records to 51485 (keeping 200 days of data) [2025-10-07T18:54:41.450298] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-07T18:54:41.500439] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T18:54:41.615742] [DEBUG] [LOCAL ] FDX: Primary data saved (51485 records). [2025-10-07T18:54:41.615900] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-07T18:54:41.616815] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FDX took 39.0s. Estimated remaining: 3h 37m 13s. Rate: 7.1 symbols/min [2025-10-07T18:54:41.791772] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:54:41.819391] [DEBUG] [LOCAL ] FF: Loaded 24656 existing records from primary storage. [2025-10-07T18:54:41.819692] [INFO ] [MAIN ] FF: Loaded 24656 existing records. [2025-10-07T18:54:41.998576] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:54:41.998854] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-07T18:54:41.998909] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-07T18:54:41.999172] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-07T18:54:41.999231] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-07T18:54:42.252809] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-07T18:54:42.358845] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:54:43.047690] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-07T18:54:43.242085] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T18:54:43.242410] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-07T18:54:43.847696] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-07T18:54:44.476820] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T18:54:44.647714] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-07T18:54:45.173169] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T18:54:45.176850] [INFO ] [REMOTE ] FE: Full fetch complete (77280 records). [2025-10-07T18:54:45.176997] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-07T18:54:45.452924] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-07T18:54:45.560758] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-07T18:54:45.560903] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-07T18:54:45.561879] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-07T18:54:45.561946] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-07T18:54:45.563460] [DEBUG] [LOCAL ] FE: Trimmed 77280 records to 53431 (keeping 200 days of data) [2025-10-07T18:54:45.796857] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T18:54:45.915409] [DEBUG] [LOCAL ] FE: Primary data saved (53431 records). [2025-10-07T18:54:45.915563] [INFO ] [MAIN ] FE: Full history saved. [2025-10-07T18:54:45.915677] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FE took 40.4s. Estimated remaining: 3h 36m 56s. Rate: 7.1 symbols/min [2025-10-07T18:54:46.085755] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:54:46.094054] [DEBUG] [LOCAL ] FFA: Loaded 5960 existing records from primary storage. [2025-10-07T18:54:46.094261] [INFO ] [MAIN ] FFA: Loaded 5960 existing records. [2025-10-07T18:54:46.247711] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-07T18:54:46.268502] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:54:46.269714] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-07T18:54:46.269771] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-07T18:54:46.269988] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-07T18:54:46.270044] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-07T18:54:46.617794] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:54:47.047627] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-07T18:54:47.217825] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T18:54:47.564582] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T18:54:47.847639] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-07T18:54:47.952384] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T18:54:48.647616] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-07T18:54:48.967501] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T18:54:49.447633] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-07T18:54:49.506538] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-07T18:54:50.247679] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-07T18:54:50.851683] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T18:54:50.950968] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T18:54:50.954611] [INFO ] [REMOTE ] FERG: Full fetch complete (70896 records). [2025-10-07T18:54:50.954756] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-07T18:54:51.052869] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-07T18:54:51.410550] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-07T18:54:51.410636] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-07T18:54:51.411502] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-07T18:54:51.411551] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-07T18:54:51.412969] [DEBUG] [LOCAL ] FERG: Trimmed 70896 records to 48782 (keeping 200 days of data) [2025-10-07T18:54:51.740353] [DEBUG] [LOCAL ] FERG: Primary data saved (48782 records). [2025-10-07T18:54:51.740536] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-07T18:54:51.740677] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FERG took 40.9s. Estimated remaining: 3h 36m 43s. Rate: 7.2 symbols/min [2025-10-07T18:54:51.852740] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-07T18:54:51.918001] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:54:51.918729] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T18:54:51.939421] [DEBUG] [LOCAL ] FFC: Loaded 16713 existing records from primary storage. [2025-10-07T18:54:51.939711] [INFO ] [MAIN ] FFC: Loaded 16713 existing records. [2025-10-07T18:54:52.110587] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:54:52.110845] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-07T18:54:52.110893] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-07T18:54:52.111185] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-07T18:54:52.111242] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-07T18:54:52.459044] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:54:52.647638] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-07T18:54:53.244154] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T18:54:53.447623] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-07T18:54:53.687117] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T18:54:54.247702] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-07T18:54:54.803015] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T18:54:55.047633] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-07T18:54:55.247024] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T18:54:55.847620] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-07T18:54:56.216593] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T18:54:56.647705] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-07T18:54:56.830720] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T18:54:57.447619] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-07T18:54:57.499002] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T18:54:58.026831] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T18:54:58.247680] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-07T18:54:59.047626] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-07T18:54:59.189491] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-07T18:54:59.847639] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-07T18:55:00.024205] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T18:55:00.647630] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-07T18:55:00.899859] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T18:55:01.447708] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-07T18:55:01.518978] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T18:55:02.053335] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-07T18:55:02.247704] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-07T18:55:03.047636] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-07T18:55:03.308626] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T18:55:03.718325] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T18:55:03.847685] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-07T18:55:04.647624] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-07T18:55:04.889181] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T18:55:05.361112] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T18:55:05.447762] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-07T18:55:06.247673] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-07T18:55:06.300080] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T18:55:06.301531] [INFO ] [REMOTE ] FET: Full fetch complete (18340 records). [2025-10-07T18:55:06.301602] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-07T18:55:06.653587] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-07T18:55:06.653702] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-07T18:55:06.654113] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-07T18:55:06.654155] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-07T18:55:06.654706] [DEBUG] [LOCAL ] FET: Trimmed 18340 records to 12791 (keeping 200 days of data) [2025-10-07T18:55:06.735661] [DEBUG] [LOCAL ] FET: Primary data saved (12791 records). [2025-10-07T18:55:06.735824] [INFO ] [MAIN ] FET: Full history saved. [2025-10-07T18:55:06.735935] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FET took 39.9s. Estimated remaining: 3h 36m 47s. Rate: 7.1 symbols/min [2025-10-07T18:55:06.905522] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:55:06.940025] [DEBUG] [LOCAL ] FFWM: Loaded 35744 existing records from primary storage. [2025-10-07T18:55:06.940311] [INFO ] [MAIN ] FFWM: Loaded 35744 existing records. [2025-10-07T18:55:07.049774] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-07T18:55:07.157638] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:55:07.163223] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-07T18:55:07.169803] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-07T18:55:07.170944] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T18:55:07.175282] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-07T18:55:07.175730] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-07T18:55:07.587173] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:55:07.764184] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T18:55:07.847624] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-07T18:55:08.647692] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-07T18:55:08.768114] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T18:55:08.769817] [INFO ] [REMOTE ] FF: Full fetch complete (36632 records). [2025-10-07T18:55:08.769901] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-07T18:55:09.144713] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-07T18:55:09.144874] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-07T18:55:09.145565] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-07T18:55:09.145635] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-07T18:55:09.146694] [DEBUG] [LOCAL ] FF: Trimmed 36632 records to 24565 (keeping 200 days of data) [2025-10-07T18:55:09.315365] [DEBUG] [LOCAL ] FF: Primary data saved (24565 records). [2025-10-07T18:55:09.315509] [INFO ] [MAIN ] FF: Full history saved. [2025-10-07T18:55:09.315612] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FF took 27.7s. Estimated remaining: 3h 36m 28s. Rate: 7.2 symbols/min [2025-10-07T18:55:09.463964] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-07T18:55:09.497797] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:55:09.498097] [DEBUG] [LOCAL ] FG: No existing data file found in primary storage. [2025-10-07T18:55:09.498201] [WARN ] [MAIN ] FG: No existing data found, performing full refresh instead. [2025-10-07T18:55:09.498359] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-07T18:55:09.498531] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-07T18:55:09.498735] [DEBUG] [LOCAL ] FG: No primary data file found to delete. [2025-10-07T18:55:09.498810] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-07T18:55:09.587799] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T18:55:09.879156] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:55:10.247673] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-07T18:55:10.556168] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T18:55:10.679229] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-07T18:55:11.047686] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-07T18:55:11.847772] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-07T18:55:12.567599] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T18:55:12.647728] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-07T18:55:12.755284] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T18:55:13.447772] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-07T18:55:14.025464] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T18:55:14.247706] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-07T18:55:14.525889] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T18:55:14.825309] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T18:55:15.047719] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-07T18:55:15.847696] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-07T18:55:15.995327] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-07T18:55:16.587891] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-07T18:55:16.647760] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-07T18:55:17.447693] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-07T18:55:17.996511] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T18:55:18.213623] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T18:55:18.247612] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-07T18:55:19.047627] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-07T18:55:19.058950] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T18:55:19.847686] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-07T18:55:20.357121] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T18:55:20.647748] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-07T18:55:20.935709] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T18:55:21.030231] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-07T18:55:21.447711] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-07T18:55:22.247689] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-07T18:55:22.848333] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T18:55:22.962017] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T18:55:23.047691] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-07T18:55:23.847685] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-07T18:55:24.026902] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T18:55:24.028995] [INFO ] [REMOTE ] FFC: Full fetch complete (24689 records). [2025-10-07T18:55:24.029092] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-07T18:55:24.411214] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-07T18:55:24.411297] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-07T18:55:24.411814] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-07T18:55:24.411876] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-07T18:55:24.412560] [DEBUG] [LOCAL ] FFC: Trimmed 24689 records to 16682 (keeping 200 days of data) [2025-10-07T18:55:24.515561] [DEBUG] [LOCAL ] FFC: Primary data saved (16682 records). [2025-10-07T18:55:24.515743] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-07T18:55:24.515842] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FFC took 32.8s. Estimated remaining: 3h 36m 32s. Rate: 7.1 symbols/min [2025-10-07T18:55:24.653058] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-07T18:55:24.687978] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:55:24.694873] [DEBUG] [LOCAL ] FGN: Loaded 3847 existing records from primary storage. [2025-10-07T18:55:24.695084] [INFO ] [MAIN ] FGN: Loaded 3847 existing records. [2025-10-07T18:55:24.878475] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:55:24.878767] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-07T18:55:24.878821] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-07T18:55:24.879014] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-07T18:55:24.879071] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-07T18:55:25.301362] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T18:55:25.307570] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:55:25.332580] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-07T18:55:25.447694] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-07T18:55:26.022521] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-07T18:55:26.247665] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-07T18:55:26.925660] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T18:55:26.927154] [INFO ] [REMOTE ] FFA: Full fetch complete (8632 records). [2025-10-07T18:55:26.927240] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-07T18:55:27.052081] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-07T18:55:27.331357] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-07T18:55:27.331433] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-07T18:55:27.331674] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-07T18:55:27.331736] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-07T18:55:27.332136] [DEBUG] [LOCAL ] FFA: Trimmed 8632 records to 5982 (keeping 200 days of data) [2025-10-07T18:55:27.372204] [DEBUG] [LOCAL ] FFA: Primary data saved (5982 records). [2025-10-07T18:55:27.372322] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-07T18:55:27.372404] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFA took 41.5s. Estimated remaining: 3h 36m 13s. Rate: 7.1 symbols/min [2025-10-07T18:55:27.534961] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:55:27.535157] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-07T18:55:27.535194] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-07T18:55:27.535315] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-07T18:55:27.535357] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-07T18:55:27.535398] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-07T18:55:27.535431] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-07T18:55:27.854879] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-07T18:55:27.884176] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:55:28.589399] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T18:55:28.647693] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-07T18:55:29.175420] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T18:55:29.447700] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-07T18:55:29.867409] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T18:55:30.028562] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-07T18:55:30.247626] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-07T18:55:30.724594] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-07T18:55:31.047696] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-07T18:55:31.470202] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-07T18:55:31.847756] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-07T18:55:32.419790] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T18:55:32.647758] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-07T18:55:33.447693] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-07T18:55:33.754264] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T18:55:34.008046] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T18:55:34.247701] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-07T18:55:34.456021] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:55:34.456332] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-07T18:55:34.456440] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:55:34.456521] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-07T18:55:34.456607] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:55:34.456725] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-07T18:55:34.456799] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-07T18:55:34.456835] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-07T18:55:34.456873] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-07T18:55:34.456918] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 7.1s. Estimated remaining: 3h 36m 3s. Rate: 7.2 symbols/min [2025-10-07T18:55:34.622572] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:55:34.660979] [DEBUG] [LOCAL ] FHI: Loaded 40064 existing records from primary storage. [2025-10-07T18:55:34.661273] [INFO ] [MAIN ] FHI: Loaded 40064 existing records. [2025-10-07T18:55:34.839361] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:55:34.839585] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-07T18:55:34.839635] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-07T18:55:34.840143] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-07T18:55:34.840204] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-07T18:55:35.053147] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-07T18:55:35.218397] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:55:35.792785] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T18:55:35.847690] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-07T18:55:36.647701] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-07T18:55:37.306201] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T18:55:37.447713] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-07T18:55:37.669839] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T18:55:38.247618] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-07T18:55:38.707060] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T18:55:38.706894] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T18:55:39.047702] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-07T18:55:39.847698] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-07T18:55:40.107002] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T18:55:40.268195] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-07T18:55:40.647742] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-07T18:55:41.200217] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-07T18:55:41.447721] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-07T18:55:42.247759] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-07T18:55:42.469873] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T18:55:43.047740] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-07T18:55:43.527085] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T18:55:43.691035] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-07T18:55:43.847672] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-07T18:55:44.647740] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-07T18:55:44.991161] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T18:55:44.993716] [INFO ] [REMOTE ] FFWM: Full fetch complete (51865 records). [2025-10-07T18:55:44.993911] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-07T18:55:45.376284] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-07T18:55:45.376361] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-07T18:55:45.377224] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-07T18:55:45.377293] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-07T18:55:45.378611] [DEBUG] [LOCAL ] FFWM: Trimmed 51865 records to 35834 (keeping 200 days of data) [2025-10-07T18:55:45.461430] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-07T18:55:45.591341] [DEBUG] [LOCAL ] FFWM: Primary data saved (35834 records). [2025-10-07T18:55:45.591488] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-07T18:55:45.591588] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FFWM took 38.9s. Estimated remaining: 3h 35m 59s. Rate: 7.1 symbols/min [2025-10-07T18:55:45.768069] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:55:45.823571] [DEBUG] [LOCAL ] FHN: Loaded 53368 existing records from primary storage. [2025-10-07T18:55:45.823988] [INFO ] [MAIN ] FHN: Loaded 53368 existing records. [2025-10-07T18:55:45.939616] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T18:55:45.987827] [INFO ] [REMOTE ] FGN: Full fetch complete (5741 records). [2025-10-07T18:55:46.026114] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-07T18:55:46.025980] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T18:55:46.059262] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:55:46.059622] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-07T18:55:46.059730] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-07T18:55:46.108060] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-07T18:55:46.129036] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-07T18:55:46.252798] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-07T18:55:46.748429] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-07T18:55:46.754471] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-07T18:55:46.768847] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-07T18:55:46.769216] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-07T18:55:46.792111] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:55:46.792681] [DEBUG] [LOCAL ] FGN: Trimmed 5741 records to 3819 (keeping 200 days of data) [2025-10-07T18:55:46.819141] [DEBUG] [LOCAL ] FGN: Primary data saved (3819 records). [2025-10-07T18:55:46.819259] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-07T18:55:46.819352] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FGN took 22.3s. Estimated remaining: 3h 35m 38s. Rate: 7.2 symbols/min [2025-10-07T18:55:46.982273] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:55:47.034762] [DEBUG] [LOCAL ] FI: Loaded 53525 existing records from primary storage. [2025-10-07T18:55:47.035119] [INFO ] [MAIN ] FI: Loaded 53525 existing records. [2025-10-07T18:55:47.055339] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-07T18:55:47.210679] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:55:47.211507] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-07T18:55:47.211562] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-07T18:55:47.211812] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-07T18:55:47.211869] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-07T18:55:47.324277] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-07T18:55:47.371666] [INFO ] [REMOTE ] FG: Full fetch complete (27979 records). [2025-10-07T18:55:47.392581] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-07T18:55:47.735846] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:55:47.859335] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-07T18:55:47.987568] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-07T18:55:47.987672] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-07T18:55:47.988155] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-07T18:55:47.988196] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-07T18:55:47.988895] [DEBUG] [LOCAL ] FG: Trimmed 27979 records to 22959 (keeping 200 days of data) [2025-10-07T18:55:48.137066] [DEBUG] [LOCAL ] FG: Primary data saved (22959 records). [2025-10-07T18:55:48.137230] [INFO ] [MAIN ] FG: Full history saved. [2025-10-07T18:55:48.137303] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FG took 38.8s. Estimated remaining: 3h 35m 16s. Rate: 7.2 symbols/min [2025-10-07T18:55:48.308594] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:55:48.332790] [DEBUG] [LOCAL ] FICO: Loaded 21078 existing records from primary storage. [2025-10-07T18:55:48.333052] [INFO ] [MAIN ] FICO: Loaded 21078 existing records. [2025-10-07T18:55:48.509489] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:55:48.509727] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-07T18:55:48.509819] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-07T18:55:48.510032] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-07T18:55:48.510088] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-07T18:55:48.652327] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-07T18:55:48.868095] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:55:48.897327] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T18:55:49.447710] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-07T18:55:49.538391] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T18:55:50.247715] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-07T18:55:50.458635] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T18:55:50.537951] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T18:55:51.047775] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-07T18:55:51.849372] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-07T18:55:51.852057] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T18:55:52.658771] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-07T18:55:52.661301] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T18:55:53.171269] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T18:55:53.447745] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-07T18:55:54.247696] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-07T18:55:54.318181] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T18:55:55.047632] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-07T18:55:55.243194] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T18:55:55.747072] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T18:55:55.847678] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-07T18:55:56.354192] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T18:55:56.647755] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-07T18:55:57.235570] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T18:55:57.447613] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-07T18:55:58.247700] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-07T18:55:58.431485] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T18:55:58.877509] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T18:55:59.047608] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-07T18:55:59.847738] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-07T18:55:59.996611] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T18:56:00.500464] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T18:56:00.647605] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-07T18:56:01.447685] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-07T18:56:01.633102] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T18:56:02.220345] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T18:56:02.247621] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-07T18:56:03.047750] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-07T18:56:03.404293] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T18:56:03.482243] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T18:56:03.484965] [INFO ] [REMOTE ] FHI: Full fetch complete (57569 records). [2025-10-07T18:56:03.485082] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-07T18:56:03.854728] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-07T18:56:03.869253] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-07T18:56:03.869417] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-07T18:56:03.870228] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-07T18:56:03.870380] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-07T18:56:03.872603] [DEBUG] [LOCAL ] FHI: Trimmed 57569 records to 39965 (keeping 200 days of data) [2025-10-07T18:56:04.113920] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T18:56:04.150476] [DEBUG] [LOCAL ] FHI: Primary data saved (39965 records). [2025-10-07T18:56:04.150627] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-07T18:56:04.150764] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHI took 29.7s. Estimated remaining: 3h 35m 22s. Rate: 7.2 symbols/min [2025-10-07T18:56:04.315912] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:56:04.316099] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-07T18:56:04.316137] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-07T18:56:04.316246] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-07T18:56:04.316310] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-07T18:56:04.316378] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-07T18:56:04.316413] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-07T18:56:04.661385] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:56:04.648918] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-07T18:56:05.447764] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-07T18:56:05.708258] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T18:56:05.785095] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T18:56:06.247743] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-07T18:56:07.045996] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T18:56:07.056292] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-07T18:56:07.379071] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T18:56:07.847705] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-07T18:56:08.647726] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-07T18:56:08.937926] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-07T18:56:08.981318] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-07T18:56:08.996456] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T18:56:09.447730] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-07T18:56:09.679092] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-07T18:56:10.247694] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-07T18:56:11.047628] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-07T18:56:11.185214] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T18:56:11.847690] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-07T18:56:12.083441] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-07T18:56:12.647710] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-07T18:56:12.955400] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T18:56:13.447719] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-07T18:56:13.786781] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-07T18:56:13.910558] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T18:56:14.247692] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-07T18:56:15.047710] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-07T18:56:15.847713] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-07T18:56:15.891863] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T18:56:16.135055] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T18:56:16.647687] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-07T18:56:17.447718] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-07T18:56:17.742834] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T18:56:17.780259] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-07T18:56:17.781961] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T18:56:18.247690] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-07T18:56:19.047686] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-07T18:56:19.380052] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-07T18:56:19.847626] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-07T18:56:19.959000] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T18:56:20.647736] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-07T18:56:20.848406] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:56:20.848757] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-07T18:56:20.848852] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:56:20.848939] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-07T18:56:20.849007] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:56:20.849102] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-07T18:56:20.849198] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-07T18:56:20.849241] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-07T18:56:20.849301] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-07T18:56:20.849373] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FIG took 16.7s. Estimated remaining: 3h 35m 29s. Rate: 7.1 symbols/min [2025-10-07T18:56:21.028143] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:56:21.077007] [DEBUG] [LOCAL ] FIGS: Loaded 48868 existing records from primary storage. [2025-10-07T18:56:21.077402] [INFO ] [MAIN ] FIGS: Loaded 48868 existing records. [2025-10-07T18:56:21.254164] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:56:21.254367] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-07T18:56:21.254460] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-07T18:56:21.254727] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-07T18:56:21.254784] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-07T18:56:21.452801] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-07T18:56:21.613200] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:56:21.862614] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T18:56:22.247671] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-07T18:56:22.957127] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T18:56:22.961128] [INFO ] [REMOTE ] FI: Full fetch complete (77216 records). [2025-10-07T18:56:22.961276] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-07T18:56:23.052758] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-07T18:56:23.372971] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-07T18:56:23.373128] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-07T18:56:23.374141] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-07T18:56:23.374226] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-07T18:56:23.387543] [DEBUG] [LOCAL ] FI: Trimmed 77216 records to 53526 (keeping 200 days of data) [2025-10-07T18:56:23.412071] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T18:56:23.763411] [DEBUG] [LOCAL ] FI: Primary data saved (53526 records). [2025-10-07T18:56:23.763564] [INFO ] [MAIN ] FI: Full history saved. [2025-10-07T18:56:23.763667] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FI took 36.9s. Estimated remaining: 3h 35m 10s. Rate: 7.2 symbols/min [2025-10-07T18:56:23.852805] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-07T18:56:23.940684] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:56:23.978615] [DEBUG] [LOCAL ] FIHL: Loaded 39695 existing records from primary storage. [2025-10-07T18:56:23.978963] [INFO ] [MAIN ] FIHL: Loaded 39695 existing records. [2025-10-07T18:56:24.168123] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:56:24.168396] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-07T18:56:24.168473] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-07T18:56:24.168855] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-07T18:56:24.169003] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-07T18:56:24.332239] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T18:56:24.556883] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:56:24.647621] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-07T18:56:25.198728] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T18:56:25.447679] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-07T18:56:25.587136] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T18:56:25.589819] [INFO ] [REMOTE ] FICO: Full fetch complete (29168 records). [2025-10-07T18:56:25.589938] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-07T18:56:25.965326] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-07T18:56:25.965405] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-07T18:56:25.965918] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-07T18:56:25.966042] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-07T18:56:25.966744] [DEBUG] [LOCAL ] FICO: Trimmed 29168 records to 21194 (keeping 200 days of data) [2025-10-07T18:56:26.108355] [DEBUG] [LOCAL ] FICO: Primary data saved (21194 records). [2025-10-07T18:56:26.108523] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-07T18:56:26.108618] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FICO took 38.0s. Estimated remaining: 3h 34m 51s. Rate: 7.2 symbols/min [2025-10-07T18:56:26.253070] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-07T18:56:26.280843] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:56:26.292063] [DEBUG] [LOCAL ] FINS: Loaded 8268 existing records from primary storage. [2025-10-07T18:56:26.292299] [INFO ] [MAIN ] FINS: Loaded 8268 existing records. [2025-10-07T18:56:26.467148] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:56:26.467358] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-07T18:56:26.467405] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-07T18:56:26.467610] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-07T18:56:26.467696] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-07T18:56:26.829101] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:56:26.872183] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T18:56:27.047702] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-07T18:56:27.698747] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T18:56:27.847609] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-07T18:56:28.203681] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T18:56:28.647719] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-07T18:56:28.895606] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T18:56:29.447735] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-07T18:56:30.247749] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-07T18:56:30.336366] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T18:56:30.674231] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T18:56:30.678003] [INFO ] [REMOTE ] FHN: Full fetch complete (77288 records). [2025-10-07T18:56:30.678126] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-07T18:56:31.058987] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-07T18:56:31.062901] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-07T18:56:31.064261] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-07T18:56:31.065258] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-07T18:56:31.065453] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-07T18:56:31.067033] [DEBUG] [LOCAL ] FHN: Trimmed 77288 records to 53368 (keeping 200 days of data) [2025-10-07T18:56:31.321327] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T18:56:31.463545] [DEBUG] [LOCAL ] FHN: Primary data saved (53368 records). [2025-10-07T18:56:31.463782] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-07T18:56:31.463912] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FHN took 45.9s. Estimated remaining: 3h 34m 37s. Rate: 7.2 symbols/min [2025-10-07T18:56:31.640842] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:56:31.652080] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-07T18:56:31.694217] [DEBUG] [LOCAL ] FINV: Loaded 45189 existing records from primary storage. [2025-10-07T18:56:31.694548] [INFO ] [MAIN ] FINV: Loaded 45189 existing records. [2025-10-07T18:56:31.850378] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-07T18:56:31.872874] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:56:31.873265] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-07T18:56:31.873314] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-07T18:56:31.873512] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-07T18:56:31.873569] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-07T18:56:32.222536] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:56:32.647692] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-07T18:56:33.414160] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T18:56:33.447605] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-07T18:56:34.077705] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T18:56:34.247635] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-07T18:56:35.047779] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-07T18:56:35.189730] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T18:56:35.750970] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T18:56:35.787803] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T18:56:35.847598] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-07T18:56:36.542934] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-07T18:56:36.647629] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-07T18:56:37.447701] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-07T18:56:38.217103] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T18:56:38.247609] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-07T18:56:38.776824] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T18:56:39.047675] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-07T18:56:39.816103] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T18:56:39.847608] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-07T18:56:40.424755] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T18:56:40.647738] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-07T18:56:41.447742] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-07T18:56:41.574756] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T18:56:41.690894] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T18:56:41.826338] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-07T18:56:42.247721] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-07T18:56:42.946329] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T18:56:43.047606] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-07T18:56:43.787445] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T18:56:43.847663] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-07T18:56:44.585425] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T18:56:44.647601] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-07T18:56:45.373403] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-07T18:56:45.447725] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-07T18:56:46.247763] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-07T18:56:46.971846] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T18:56:47.047720] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-07T18:56:47.663462] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T18:56:47.847671] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-07T18:56:48.610410] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T18:56:48.647614] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-07T18:56:49.146021] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T18:56:49.447756] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-07T18:56:49.905674] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T18:56:49.909128] [INFO ] [REMOTE ] FIGS: Full fetch complete (70931 records). [2025-10-07T18:56:49.909231] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-07T18:56:50.252747] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-07T18:56:50.299780] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-07T18:56:50.299846] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-07T18:56:50.300695] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-07T18:56:50.300862] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-07T18:56:50.302264] [DEBUG] [LOCAL ] FIGS: Trimmed 70931 records to 48805 (keeping 200 days of data) [2025-10-07T18:56:50.585346] [DEBUG] [LOCAL ] FIGS: Primary data saved (48805 records). [2025-10-07T18:56:50.585769] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-07T18:56:50.585933] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 29.7s. Estimated remaining: 3h 34m 48s. Rate: 7.2 symbols/min [2025-10-07T18:56:50.760253] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:56:50.809882] [DEBUG] [LOCAL ] FIS: Loaded 53356 existing records from primary storage. [2025-10-07T18:56:50.810208] [INFO ] [MAIN ] FIS: Loaded 53356 existing records. [2025-10-07T18:56:50.996234] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:56:50.997280] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-07T18:56:50.997815] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-07T18:56:51.002287] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-07T18:56:51.002444] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-07T18:56:51.005341] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T18:56:51.052756] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-07T18:56:51.203256] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T18:56:51.420331] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:56:51.824879] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T18:56:51.847606] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-07T18:56:52.314792] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T18:56:52.316208] [INFO ] [REMOTE ] FINS: Full fetch complete (11977 records). [2025-10-07T18:56:52.316296] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-07T18:56:52.662764] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-07T18:56:52.719969] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-07T18:56:52.720124] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-07T18:56:52.720722] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-07T18:56:52.720825] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-07T18:56:52.722031] [DEBUG] [LOCAL ] FINS: Trimmed 11977 records to 8266 (keeping 200 days of data) [2025-10-07T18:56:52.780471] [DEBUG] [LOCAL ] FINS: Primary data saved (8266 records). [2025-10-07T18:56:52.780712] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-07T18:56:52.780838] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 26.7s. Estimated remaining: 3h 34m 28s. Rate: 7.2 symbols/min [2025-10-07T18:56:52.959889] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:56:52.996719] [DEBUG] [LOCAL ] FIX: Loaded 29431 existing records from primary storage. [2025-10-07T18:56:52.997093] [INFO ] [MAIN ] FIX: Loaded 29431 existing records. [2025-10-07T18:56:53.183034] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:56:53.183391] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-07T18:56:53.183444] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-07T18:56:53.183884] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-07T18:56:53.183947] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-07T18:56:53.453826] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-07T18:56:53.539897] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:56:54.119598] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T18:56:54.247754] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-07T18:56:55.033686] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T18:56:55.047599] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-07T18:56:55.830421] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T18:56:55.847596] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-07T18:56:56.458353] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T18:56:56.647617] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-07T18:56:57.067697] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T18:56:57.070517] [INFO ] [REMOTE ] FIHL: Full fetch complete (55970 records). [2025-10-07T18:56:57.070621] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-07T18:56:57.466731] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-07T18:56:57.448958] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-07T18:56:57.468026] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-07T18:56:57.468927] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-07T18:56:57.468998] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-07T18:56:57.470323] [DEBUG] [LOCAL ] FIHL: Trimmed 55970 records to 39681 (keeping 200 days of data) [2025-10-07T18:56:57.715801] [DEBUG] [LOCAL ] FIHL: Primary data saved (39681 records). [2025-10-07T18:56:57.715990] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-07T18:56:57.716144] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 34.0s. Estimated remaining: 3h 34m 14s. Rate: 7.2 symbols/min [2025-10-07T18:56:58.041711] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T18:56:58.247685] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-07T18:56:59.047729] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-07T18:56:59.188763] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T18:56:59.525146] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T18:56:59.847678] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-07T18:57:00.445586] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T18:57:00.647704] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-07T18:57:01.061510] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T18:57:01.447743] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-07T18:57:02.256593] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-07T18:57:02.291509] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T18:57:03.031259] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T18:57:03.047592] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-07T18:57:03.847771] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-07T18:57:04.202790] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T18:57:04.647796] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-07T18:57:04.681127] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T18:57:05.434403] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T18:57:05.447594] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-07T18:57:06.247725] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-07T18:57:06.431465] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T18:57:06.633884] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T18:57:06.639228] [INFO ] [REMOTE ] FINV: Full fetch complete (63712 records). [2025-10-07T18:57:06.639328] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-07T18:57:07.023246] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-07T18:57:07.023328] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-07T18:57:07.024118] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-07T18:57:07.024184] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-07T18:57:07.025506] [DEBUG] [LOCAL ] FINV: Trimmed 63712 records to 45208 (keeping 200 days of data) [2025-10-07T18:57:07.072760] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-07T18:57:07.293072] [DEBUG] [LOCAL ] FINV: Primary data saved (45208 records). [2025-10-07T18:57:07.293236] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-07T18:57:07.293340] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FINV took 35.8s. Estimated remaining: 3h 34m 8s. Rate: 7.2 symbols/min [2025-10-07T18:57:07.488273] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T18:57:07.847797] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-07T18:57:08.944946] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T18:57:08.956151] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-07T18:57:09.291940] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T18:57:09.447773] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-07T18:57:10.716368] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-07T18:57:10.723207] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-07T18:57:10.895860] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T18:57:11.047674] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-07T18:57:12.165153] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T18:57:12.171920] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-07T18:57:12.832455] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T18:57:12.843585] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-07T18:57:13.515868] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T18:57:13.521964] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-07T18:57:14.610747] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T18:57:14.623360] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-07T18:57:14.864946] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T18:57:15.047769] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-07T18:57:16.266741] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T18:57:16.269588] [INFO ] [REMOTE ] FIX: Full fetch complete (45425 records). [2025-10-07T18:57:16.269737] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-07T18:57:16.659436] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T18:57:16.707385] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-07T18:57:16.707493] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-07T18:57:16.708305] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-07T18:57:16.708852] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-07T18:57:16.708763] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-07T18:57:16.710752] [DEBUG] [LOCAL ] FIX: Trimmed 45425 records to 29405 (keeping 200 days of data) [2025-10-07T18:57:16.900853] [DEBUG] [LOCAL ] FIX: Primary data saved (29405 records). [2025-10-07T18:57:16.900995] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-07T18:57:16.901076] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 24.1s. Estimated remaining: 3h 34m 1s. Rate: 7.2 symbols/min [2025-10-07T18:57:18.151580] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T18:57:18.163382] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-07T18:57:20.022863] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T18:57:20.034891] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-07T18:57:21.643994] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T18:57:21.647724] [INFO ] [REMOTE ] FIS: Full fetch complete (77183 records). [2025-10-07T18:57:21.647845] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-07T18:57:22.037989] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-07T18:57:22.038063] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-07T18:57:22.039070] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-07T18:57:22.039135] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-07T18:57:22.040551] [DEBUG] [LOCAL ] FIS: Trimmed 77183 records to 53356 (keeping 200 days of data) [2025-10-07T18:57:22.368132] [DEBUG] [LOCAL ] FIS: Primary data saved (53356 records). [2025-10-07T18:57:22.368285] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-07T18:57:22.368371] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIS took 31.8s. Estimated remaining: 3h 33m 48s. Rate: 7.2 symbols/min [2025-10-07T18:57:22.976759] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:23.025614] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:23.037635] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-07T18:57:23.040555] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-07T18:57:23.060283] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-07T18:57:23.077978] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-07T18:57:23.079689] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:23.081890] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-07T18:57:23.081252] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:23.082008] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-07T18:57:23.172266] [DEBUG] [LOCAL ] FLC: Loaded 5358 existing records from primary storage. [2025-10-07T18:57:23.190487] [INFO ] [MAIN ] FLC: Loaded 5358 existing records. [2025-10-07T18:57:23.401563] [DEBUG] [LOCAL ] FLNG: Loaded 33633 existing records from primary storage. [2025-10-07T18:57:23.479060] [INFO ] [MAIN ] FLNG: Loaded 33633 existing records. [2025-10-07T18:57:23.684537] [DEBUG] [LOCAL ] FLG: Loaded 53331 existing records from primary storage. [2025-10-07T18:57:23.726693] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:57:23.740274] [INFO ] [MAIN ] FLG: Loaded 53331 existing records. [2025-10-07T18:57:23.753939] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-07T18:57:23.765174] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-07T18:57:23.819700] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-07T18:57:23.909987] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:23.931896] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-07T18:57:23.958588] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-07T18:57:24.004418] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:57:24.056280] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-07T18:57:24.080754] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-07T18:57:24.091160] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-07T18:57:24.096425] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-07T18:57:24.214377] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:57:24.287068] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:57:24.316967] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-07T18:57:24.322785] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-07T18:57:24.362717] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:57:24.396661] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-07T18:57:24.417608] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-07T18:57:24.487211] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-07T18:57:24.524387] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:57:24.527892] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-07T18:57:24.544568] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-07T18:57:24.605387] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-07T18:57:24.639746] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-07T18:57:24.732952] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-07T18:57:24.788186] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.4s. Estimated remaining: 3h 33m 29s. Rate: 7.2 symbols/min [2025-10-07T18:57:24.910949] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:25.006382] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-07T18:57:25.123018] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:25.161958] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-07T18:57:25.309160] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:25.383876] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:25.384271] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-07T18:57:25.427370] [DEBUG] [LOCAL ] FLO: Loaded 51944 existing records from primary storage. [2025-10-07T18:57:25.427761] [INFO ] [MAIN ] FLO: Loaded 51944 existing records. [2025-10-07T18:57:25.600736] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:57:25.601021] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-07T18:57:25.601088] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-07T18:57:25.601391] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-07T18:57:25.601450] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-07T18:57:25.777015] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T18:57:25.790086] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-07T18:57:25.974831] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:25.975169] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-07T18:57:26.471114] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T18:57:26.473019] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-07T18:57:26.710300] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T18:57:26.718400] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-07T18:57:27.159831] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T18:57:27.171890] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-07T18:57:27.221737] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T18:57:27.223339] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-07T18:57:27.317496] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T18:57:27.328081] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-07T18:57:27.746867] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T18:57:27.754355] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-07T18:57:27.882155] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T18:57:27.884206] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-07T18:57:28.591316] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T18:57:28.647672] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-07T18:57:28.872478] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T18:57:28.910718] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T18:57:28.992886] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T18:57:29.250928] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-07T18:57:29.447718] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-07T18:57:30.247752] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-07T18:57:31.047742] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-07T18:57:31.109242] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T18:57:31.255738] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T18:57:31.456679] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-07T18:57:31.847716] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-07T18:57:32.647754] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-07T18:57:33.117077] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T18:57:33.447684] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-07T18:57:33.535895] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T18:57:34.146479] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T18:57:34.247704] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-07T18:57:35.047749] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-07T18:57:35.847629] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-07T18:57:35.924211] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T18:57:36.402472] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T18:57:36.647674] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-07T18:57:37.312158] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T18:57:37.447753] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-07T18:57:37.946246] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-07T18:57:38.247754] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-07T18:57:39.047745] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-07T18:57:39.238256] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T18:57:39.653590] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T18:57:39.658383] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T18:57:39.847719] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-07T18:57:40.647737] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-07T18:57:41.339169] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T18:57:41.447705] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-07T18:57:41.534827] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T18:57:41.535714] [INFO ] [REMOTE ] FLC: Full fetch complete (7852 records). [2025-10-07T18:57:41.535789] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-07T18:57:41.912483] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-07T18:57:41.912673] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-07T18:57:41.912898] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-07T18:57:41.912939] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-07T18:57:41.913338] [DEBUG] [LOCAL ] FLC: Trimmed 7852 records to 5372 (keeping 200 days of data) [2025-10-07T18:57:41.947335] [DEBUG] [LOCAL ] FLC: Primary data saved (5372 records). [2025-10-07T18:57:41.947440] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-07T18:57:41.947531] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 19.5s. Estimated remaining: 3h 33m 36s. Rate: 7.2 symbols/min [2025-10-07T18:57:42.114532] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:42.114828] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-07T18:57:42.114879] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-07T18:57:42.115050] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-07T18:57:42.115099] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-07T18:57:42.115148] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-07T18:57:42.115186] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-07T18:57:42.253231] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-07T18:57:42.473032] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:42.850961] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T18:57:43.047634] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-07T18:57:43.672409] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T18:57:43.847684] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-07T18:57:44.222349] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-07T18:57:44.647730] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-07T18:57:45.447755] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-07T18:57:45.602144] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T18:57:45.639184] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T18:57:45.639496] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-07T18:57:45.639585] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T18:57:45.639636] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-07T18:57:45.639732] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T18:57:45.639805] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-07T18:57:45.639872] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-07T18:57:45.639944] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-07T18:57:45.640003] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-07T18:57:45.640053] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLOC took 3.7s. Estimated remaining: 3h 33m 19s. Rate: 7.2 symbols/min [2025-10-07T18:57:45.804834] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:45.854571] [DEBUG] [LOCAL ] FLR: Loaded 53157 existing records from primary storage. [2025-10-07T18:57:45.854929] [INFO ] [MAIN ] FLR: Loaded 53157 existing records. [2025-10-07T18:57:46.035166] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:57:46.035476] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-07T18:57:46.035532] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-07T18:57:46.035766] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-07T18:57:46.035830] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-07T18:57:46.247632] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-07T18:57:46.400593] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:46.569016] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T18:57:47.047731] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-07T18:57:47.847775] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-07T18:57:48.061865] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T18:57:48.647629] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-07T18:57:48.831310] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:57:49.447703] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-07T18:57:49.490885] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T18:57:50.247731] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-07T18:57:50.418461] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T18:57:50.682397] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T18:57:50.686738] [INFO ] [REMOTE ] FLNG: Full fetch complete (50350 records). [2025-10-07T18:57:50.686843] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-07T18:57:51.057499] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-07T18:57:51.075328] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-07T18:57:51.076229] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-07T18:57:51.076959] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-07T18:57:51.077025] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-07T18:57:51.078355] [DEBUG] [LOCAL ] FLNG: Trimmed 50350 records to 33596 (keeping 200 days of data) [2025-10-07T18:57:51.290569] [DEBUG] [LOCAL ] FLNG: Primary data saved (33596 records). [2025-10-07T18:57:51.290742] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-07T18:57:51.290850] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLNG took 28.9s. Estimated remaining: 3h 33m 6s. Rate: 7.2 symbols/min [2025-10-07T18:57:51.458418] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:51.506218] [DEBUG] [LOCAL ] FLS: Loaded 50202 existing records from primary storage. [2025-10-07T18:57:51.506559] [INFO ] [MAIN ] FLS: Loaded 50202 existing records. [2025-10-07T18:57:51.682479] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:57:51.682720] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-07T18:57:51.682777] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-07T18:57:51.683080] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-07T18:57:51.683140] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-07T18:57:51.862072] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-07T18:57:52.078870] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:52.081261] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T18:57:52.647706] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-07T18:57:52.721921] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T18:57:52.728172] [INFO ] [REMOTE ] FLO: Full fetch complete (75041 records). [2025-10-07T18:57:52.728305] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-07T18:57:53.209301] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-07T18:57:53.209423] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-07T18:57:53.210602] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-07T18:57:53.210705] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-07T18:57:53.212762] [DEBUG] [LOCAL ] FLO: Trimmed 75041 records to 51949 (keeping 200 days of data) [2025-10-07T18:57:53.460395] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-07T18:57:53.591246] [DEBUG] [LOCAL ] FLO: Primary data saved (51949 records). [2025-10-07T18:57:53.591420] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-07T18:57:53.591561] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLO took 28.8s. Estimated remaining: 3h 32m 47s. Rate: 7.2 symbols/min [2025-10-07T18:57:53.819782] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:57:53.853287] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T18:57:53.915664] [DEBUG] [LOCAL ] FLUT: Loaded 50782 existing records from primary storage. [2025-10-07T18:57:53.916150] [INFO ] [MAIN ] FLUT: Loaded 50782 existing records. [2025-10-07T18:57:54.138449] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:57:54.138892] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-07T18:57:54.138955] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-07T18:57:54.139213] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-07T18:57:54.139273] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-07T18:57:54.269400] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-07T18:57:54.348531] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T18:57:54.563256] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:57:54.889299] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T18:57:55.047683] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-07T18:57:55.847697] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-07T18:57:56.212996] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T18:57:56.647686] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-07T18:57:56.650463] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T18:57:57.199405] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T18:57:57.447762] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-07T18:57:58.247738] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-07T18:57:58.436299] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T18:57:58.965018] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T18:57:59.047677] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-07T18:57:59.586123] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T18:57:59.847673] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-07T18:58:00.647698] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-07T18:58:01.089318] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-07T18:58:01.447746] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-07T18:58:01.532639] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T18:58:02.207857] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T18:58:02.247596] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-07T18:58:03.047677] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-07T18:58:03.383560] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T18:58:03.607276] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T18:58:03.847728] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-07T18:58:04.647710] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-07T18:58:04.939976] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T18:58:05.458878] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-07T18:58:05.464500] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T18:58:06.247734] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-07T18:58:06.390573] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T18:58:07.047736] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-07T18:58:07.407955] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T18:58:07.726367] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T18:58:07.730269] [INFO ] [REMOTE ] FLG: Full fetch complete (77304 records). [2025-10-07T18:58:07.730427] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-07T18:58:07.854747] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-07T18:58:08.168977] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-07T18:58:08.169059] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-07T18:58:08.169958] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-07T18:58:08.170026] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-07T18:58:08.173532] [DEBUG] [LOCAL ] FLG: Trimmed 77304 records to 53331 (keeping 200 days of data) [2025-10-07T18:58:08.514091] [DEBUG] [LOCAL ] FLG: Primary data saved (53331 records). [2025-10-07T18:58:08.514232] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-07T18:58:08.514342] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLG took 46.1s. Estimated remaining: 3h 32m 50s. Rate: 7.2 symbols/min [2025-10-07T18:58:08.651968] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-07T18:58:08.682779] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:58:08.705493] [DEBUG] [LOCAL ] FLXR: Loaded 20614 existing records from primary storage. [2025-10-07T18:58:08.705786] [INFO ] [MAIN ] FLXR: Loaded 20614 existing records. [2025-10-07T18:58:08.889462] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:58:08.889880] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-07T18:58:08.890064] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-07T18:58:08.890461] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-07T18:58:08.890521] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-07T18:58:09.148923] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-07T18:58:09.295567] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:58:09.447629] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-07T18:58:09.679551] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T18:58:10.247722] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-07T18:58:10.359877] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T18:58:10.904760] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T18:58:10.960568] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-07T18:58:11.047636] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-07T18:58:11.847691] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-07T18:58:12.613511] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T18:58:12.647687] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-07T18:58:12.807061] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T18:58:13.447617] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-07T18:58:14.247632] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-07T18:58:14.492921] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T18:58:14.748984] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-07T18:58:15.047733] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-07T18:58:15.324164] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T18:58:15.847685] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-07T18:58:16.647713] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-07T18:58:16.805252] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-07T18:58:16.808847] [INFO ] [REMOTE ] FLR: Full fetch complete (76479 records). [2025-10-07T18:58:16.808965] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-07T18:58:17.204516] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-07T18:58:17.204706] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-07T18:58:17.205755] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-07T18:58:17.205876] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-07T18:58:17.207395] [DEBUG] [LOCAL ] FLR: Trimmed 76479 records to 53161 (keeping 200 days of data) [2025-10-07T18:58:17.274261] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-07T18:58:17.447734] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-07T18:58:17.553691] [DEBUG] [LOCAL ] FLR: Primary data saved (53161 records). [2025-10-07T18:58:17.553847] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-07T18:58:17.553947] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLR took 31.9s. Estimated remaining: 3h 32m 43s. Rate: 7.2 symbols/min [2025-10-07T18:58:17.732812] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:58:17.765481] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T18:58:17.826931] [DEBUG] [LOCAL ] FMC: Loaded 51802 existing records from primary storage. [2025-10-07T18:58:17.827308] [INFO ] [MAIN ] FMC: Loaded 51802 existing records. [2025-10-07T18:58:18.006690] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:58:18.006946] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-07T18:58:18.006995] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-07T18:58:18.008944] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-07T18:58:18.009037] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-07T18:58:18.252821] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-07T18:58:18.374704] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:58:18.499275] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T18:58:19.047694] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-07T18:58:19.762489] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T18:58:19.847694] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-07T18:58:20.647627] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-07T18:58:20.809886] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T18:58:21.447634] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-07T18:58:21.608049] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T18:58:21.651040] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T18:58:22.247689] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-07T18:58:23.047632] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-07T18:58:23.306839] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-07T18:58:23.554119] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T18:58:23.847729] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-07T18:58:24.025085] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T18:58:24.647719] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-07T18:58:25.294917] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-07T18:58:25.447667] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-07T18:58:25.636668] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T18:58:26.247703] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-07T18:58:27.047754] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-07T18:58:27.135634] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T18:58:27.546829] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-07T18:58:27.775457] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-07T18:58:27.847697] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-07T18:58:28.647681] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-07T18:58:29.213342] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T18:58:29.447787] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-07T18:58:30.247773] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-07T18:58:30.533434] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-07T18:58:31.047754] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-07T18:58:31.199464] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T18:58:31.847720] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-07T18:58:31.884297] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T18:58:31.888764] [INFO ] [REMOTE ] FLUT: Full fetch complete (72988 records). [2025-10-07T18:58:31.888976] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-07T18:58:32.013383] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T18:58:32.061427] [INFO ] [REMOTE ] FLXR: Full fetch complete (26076 records). [2025-10-07T18:58:32.087426] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-07T18:58:32.519238] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-07T18:58:32.541540] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-07T18:58:32.556357] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-07T18:58:32.556467] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-07T18:58:32.630005] [DEBUG] [LOCAL ] FLUT: Trimmed 72988 records to 50783 (keeping 200 days of data) [2025-10-07T18:58:32.657493] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-07T18:58:32.818901] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-07T18:58:32.819613] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-07T18:58:32.820274] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-07T18:58:32.820359] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-07T18:58:32.822576] [DEBUG] [LOCAL ] FLXR: Trimmed 26076 records to 20685 (keeping 200 days of data) [2025-10-07T18:58:33.090580] [DEBUG] [LOCAL ] FLXR: Primary data saved (20685 records). [2025-10-07T18:58:33.091309] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-07T18:58:33.091705] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLXR took 24.6s. Estimated remaining: 3h 32m 47s. Rate: 7.2 symbols/min [2025-10-07T18:58:33.278959] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:58:33.294530] [DEBUG] [LOCAL ] FMN: Loaded 5340 existing records from primary storage. [2025-10-07T18:58:33.295941] [INFO ] [MAIN ] FMN: Loaded 5340 existing records. [2025-10-07T18:58:33.496332] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:58:33.524051] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-07T18:58:33.524255] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-07T18:58:33.530144] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-07T18:58:33.544067] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-07T18:58:33.869756] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-07T18:58:33.886732] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-07T18:58:33.978720] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:58:33.984256] [DEBUG] [LOCAL ] FLUT: Primary data saved (50783 records). [2025-10-07T18:58:33.984421] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-07T18:58:33.984514] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLUT took 40.4s. Estimated remaining: 3h 32m 26s. Rate: 7.2 symbols/min [2025-10-07T18:58:34.155845] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:58:34.187119] [DEBUG] [LOCAL ] FMS: Loaded 30006 existing records from primary storage. [2025-10-07T18:58:34.187613] [INFO ] [MAIN ] FMS: Loaded 30006 existing records. [2025-10-07T18:58:34.254774] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-07T18:58:34.406011] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:58:34.407263] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-07T18:58:34.407428] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-07T18:58:34.407163] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-07T18:58:34.410637] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-07T18:58:34.411108] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-07T18:58:34.416800] [INFO ] [REMOTE ] FLS: Full fetch complete (71737 records). [2025-10-07T18:58:34.462279] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-07T18:58:35.093979] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T18:58:35.142526] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-07T18:58:35.176906] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:58:35.268002] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-07T18:58:35.268119] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-07T18:58:35.269208] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-07T18:58:35.269358] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-07T18:58:35.273908] [DEBUG] [LOCAL ] FLS: Trimmed 71737 records to 50242 (keeping 200 days of data) [2025-10-07T18:58:35.648693] [DEBUG] [LOCAL ] FLS: Primary data saved (50242 records). [2025-10-07T18:58:35.648949] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-07T18:58:35.649078] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLS took 44.4s. Estimated remaining: 3h 32m 5s. Rate: 7.2 symbols/min [2025-10-07T18:58:35.793452] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T18:58:35.856447] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-07T18:58:35.884362] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:58:35.925141] [DEBUG] [LOCAL ] FMX: Loaded 40749 existing records from primary storage. [2025-10-07T18:58:35.925500] [INFO ] [MAIN ] FMX: Loaded 40749 existing records. [2025-10-07T18:58:36.119020] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:58:36.119764] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-07T18:58:36.120083] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T18:58:36.120206] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-07T18:58:36.124496] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-07T18:58:36.124558] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-07T18:58:36.476507] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:58:36.647678] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-07T18:58:37.097838] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T18:58:37.447691] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-07T18:58:38.039461] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T18:58:38.247637] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-07T18:58:38.822900] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T18:58:39.047685] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-07T18:58:39.712024] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T18:58:39.738708] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T18:58:39.847686] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-07T18:58:40.647683] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-07T18:58:41.052093] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T18:58:41.447745] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-07T18:58:42.247742] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-07T18:58:42.343212] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T18:58:42.909869] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T18:58:43.047730] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-07T18:58:43.423715] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T18:58:43.847750] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-07T18:58:44.611428] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T18:58:44.647635] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-07T18:58:45.226265] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T18:58:45.447773] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-07T18:58:46.001684] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T18:58:46.247738] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-07T18:58:47.005939] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-07T18:58:47.047738] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-07T18:58:47.262808] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T18:58:47.847761] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-07T18:58:48.515450] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T18:58:48.647686] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-07T18:58:49.447750] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-07T18:58:49.517171] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T18:58:49.638127] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-07T18:58:50.247746] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-07T18:58:50.894282] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T18:58:51.047624] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-07T18:58:51.514092] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-07T18:58:51.847620] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-07T18:58:51.974466] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T18:58:52.647674] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-07T18:58:53.207508] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T18:58:53.447704] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-07T18:58:54.247731] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-07T18:58:54.413760] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T18:58:54.529049] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T18:58:54.816351] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T18:58:55.047729] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-07T18:58:55.847634] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-07T18:58:56.279387] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T18:58:56.499112] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-07T18:58:56.647746] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-07T18:58:57.447665] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-07T18:58:57.773159] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T18:58:58.247738] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-07T18:58:58.900333] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-07T18:58:58.904161] [INFO ] [REMOTE ] FMC: Full fetch complete (75137 records). [2025-10-07T18:58:58.904308] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-07T18:58:59.052880] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-07T18:58:59.307290] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T18:58:59.480987] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-07T18:58:59.481124] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-07T18:58:59.482729] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-07T18:58:59.482853] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-07T18:58:59.485072] [DEBUG] [LOCAL ] FMC: Trimmed 75137 records to 51806 (keeping 200 days of data) [2025-10-07T18:58:59.792241] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T18:58:59.858864] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-07T18:58:59.886060] [DEBUG] [LOCAL ] FMC: Primary data saved (51806 records). [2025-10-07T18:58:59.886232] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-07T18:58:59.886334] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMC took 42.3s. Estimated remaining: 3h 32m 25s. Rate: 7.2 symbols/min [2025-10-07T18:59:00.066243] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:00.069965] [DEBUG] [LOCAL ] FMY: Loaded 1383 existing records from primary storage. [2025-10-07T18:59:00.070132] [INFO ] [MAIN ] FMY: Loaded 1383 existing records. [2025-10-07T18:59:00.254914] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:00.255201] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-07T18:59:00.255251] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-07T18:59:00.255555] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-07T18:59:00.255617] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-07T18:59:00.555243] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T18:59:00.624418] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:00.647597] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-07T18:59:01.066851] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-07T18:59:01.447699] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-07T18:59:02.012141] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T18:59:02.247723] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-07T18:59:03.047708] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-07T18:59:03.492737] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-07T18:59:03.656134] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T18:59:03.847692] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-07T18:59:04.210258] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-07T18:59:04.647767] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-07T18:59:05.447716] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-07T18:59:05.702028] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T18:59:05.704224] [INFO ] [REMOTE ] FMS: Full fetch complete (42436 records). [2025-10-07T18:59:05.704315] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-07T18:59:05.973461] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T18:59:06.088378] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-07T18:59:06.088463] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-07T18:59:06.089095] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-07T18:59:06.089163] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-07T18:59:06.090209] [DEBUG] [LOCAL ] FMS: Trimmed 42436 records to 29997 (keeping 200 days of data) [2025-10-07T18:59:06.258387] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-07T18:59:06.279092] [DEBUG] [LOCAL ] FMS: Primary data saved (29997 records). [2025-10-07T18:59:06.279231] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-07T18:59:06.279318] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMS took 32.3s. Estimated remaining: 3h 32m 13s. Rate: 7.2 symbols/min [2025-10-07T18:59:06.445971] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:06.486116] [DEBUG] [LOCAL ] FN: Loaded 38314 existing records from primary storage. [2025-10-07T18:59:06.486483] [INFO ] [MAIN ] FN: Loaded 38314 existing records. [2025-10-07T18:59:06.661929] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-07T18:59:06.667080] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:06.668438] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-07T18:59:06.668491] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-07T18:59:06.669753] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-07T18:59:06.669814] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-07T18:59:07.015876] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:07.047604] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-07T18:59:07.847632] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-07T18:59:08.400057] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T18:59:08.647745] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-07T18:59:09.396178] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T18:59:09.447697] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-07T18:59:09.898472] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T18:59:10.118033] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T18:59:10.247705] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-07T18:59:10.841675] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T18:59:11.047688] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-07T18:59:11.505146] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T18:59:11.847688] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-07T18:59:12.647749] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-07T18:59:13.117265] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T18:59:13.120233] [INFO ] [REMOTE ] FMX: Full fetch complete (57656 records). [2025-10-07T18:59:13.120357] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-07T18:59:13.450191] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-07T18:59:13.592959] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-07T18:59:13.593038] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-07T18:59:13.593774] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-07T18:59:13.593837] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-07T18:59:13.595027] [DEBUG] [LOCAL ] FMX: Trimmed 57656 records to 40660 (keeping 200 days of data) [2025-10-07T18:59:13.849512] [DEBUG] [LOCAL ] FMX: Primary data saved (40660 records). [2025-10-07T18:59:13.849675] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-07T18:59:13.849775] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMX took 38.2s. Estimated remaining: 3h 32m 3s. Rate: 7.2 symbols/min [2025-10-07T18:59:14.024871] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:14.089672] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T18:59:14.091145] [INFO ] [REMOTE ] FMN: Full fetch complete (9929 records). [2025-10-07T18:59:14.091982] [DEBUG] [LOCAL ] FNB: Loaded 52507 existing records from primary storage. [2025-10-07T18:59:14.092246] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-07T18:59:14.113961] [INFO ] [MAIN ] FNB: Loaded 52507 existing records. [2025-10-07T18:59:14.275984] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-07T18:59:14.546185] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:14.600040] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-07T18:59:14.610253] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-07T18:59:14.631618] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-07T18:59:14.670100] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-07T18:59:14.672208] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-07T18:59:14.710446] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-07T18:59:14.738624] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-07T18:59:14.750941] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-07T18:59:14.772735] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-07T18:59:14.799985] [DEBUG] [LOCAL ] FMN: Trimmed 9929 records to 5266 (keeping 200 days of data) [2025-10-07T18:59:14.995833] [DEBUG] [LOCAL ] FMN: Primary data saved (5266 records). [2025-10-07T18:59:15.012753] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-07T18:59:15.023183] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMN took 41.9s. Estimated remaining: 3h 31m 42s. Rate: 7.2 symbols/min [2025-10-07T18:59:15.041885] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T18:59:15.052690] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-07T18:59:15.264741] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:15.296233] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:15.347089] [DEBUG] [LOCAL ] FND: Loaded 52088 existing records from primary storage. [2025-10-07T18:59:15.347497] [INFO ] [MAIN ] FND: Loaded 52088 existing records. [2025-10-07T18:59:15.528333] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:15.528534] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-07T18:59:15.528584] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-07T18:59:15.530063] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-07T18:59:15.530123] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-07T18:59:15.631200] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T18:59:15.852750] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-07T18:59:15.893156] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:16.647594] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-07T18:59:17.447742] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-07T18:59:17.663202] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T18:59:18.247708] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-07T18:59:18.308495] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T18:59:19.047628] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-07T18:59:19.172350] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T18:59:19.426991] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T18:59:19.427740] [INFO ] [REMOTE ] FMY: Full fetch complete (1960 records). [2025-10-07T18:59:19.427811] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-07T18:59:19.796443] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-07T18:59:19.796542] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-07T18:59:19.796733] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-07T18:59:19.796809] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-07T18:59:19.797339] [DEBUG] [LOCAL ] FMY: Trimmed 1960 records to 1385 (keeping 200 days of data) [2025-10-07T18:59:19.837357] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T18:59:19.848907] [DEBUG] [LOCAL ] FMY: Primary data saved (1385 records). [2025-10-07T18:59:19.849741] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-07T18:59:19.849895] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 20.0s. Estimated remaining: 3h 31m 28s. Rate: 7.2 symbols/min [2025-10-07T18:59:19.848553] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-07T18:59:20.030595] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:20.080136] [DEBUG] [LOCAL ] FNF: Loaded 48975 existing records from primary storage. [2025-10-07T18:59:20.080504] [INFO ] [MAIN ] FNF: Loaded 48975 existing records. [2025-10-07T18:59:20.257740] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:20.257982] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-07T18:59:20.258037] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-07T18:59:20.259444] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-07T18:59:20.259515] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-07T18:59:20.616283] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:20.647621] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-07T18:59:21.447714] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-07T18:59:21.514268] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T18:59:22.171074] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T18:59:22.247751] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-07T18:59:23.047695] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-07T18:59:23.116196] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T18:59:23.722916] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T18:59:23.847687] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-07T18:59:24.637982] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T18:59:24.647591] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-07T18:59:25.379355] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T18:59:25.447628] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-07T18:59:26.209624] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T18:59:26.247598] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-07T18:59:27.047683] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-07T18:59:27.210381] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T18:59:27.633602] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T18:59:27.847762] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-07T18:59:28.647742] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-07T18:59:28.771227] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T18:59:29.447741] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-07T18:59:29.584580] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T18:59:30.247731] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-07T18:59:30.446383] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T18:59:30.525595] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T18:59:31.047780] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-07T18:59:31.847705] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-07T18:59:31.997947] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T18:59:32.647743] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-07T18:59:32.753987] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T18:59:33.142922] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T18:59:33.447776] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-07T18:59:34.247671] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-07T18:59:34.386781] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T18:59:35.052794] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-07T18:59:35.071917] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T18:59:35.617792] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T18:59:35.847702] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-07T18:59:36.647628] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-07T18:59:36.834701] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T18:59:37.355336] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T18:59:37.447733] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-07T18:59:38.247719] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-07T18:59:38.352497] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T18:59:39.047675] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-07T18:59:39.171787] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T18:59:39.847620] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-07T18:59:39.978049] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T18:59:40.647611] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-07T18:59:40.900188] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T18:59:41.096059] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T18:59:41.099327] [INFO ] [REMOTE ] FN: Full fetch complete (56215 records). [2025-10-07T18:59:41.099523] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-07T18:59:41.463557] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-07T18:59:41.486101] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-07T18:59:41.486160] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-07T18:59:41.486901] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-07T18:59:41.486967] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-07T18:59:41.488219] [DEBUG] [LOCAL ] FN: Trimmed 56215 records to 38245 (keeping 200 days of data) [2025-10-07T18:59:41.723873] [DEBUG] [LOCAL ] FN: Primary data saved (38245 records). [2025-10-07T18:59:41.724025] [INFO ] [MAIN ] FN: Full history saved. [2025-10-07T18:59:41.724110] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 35.4s. Estimated remaining: 3h 31m 43s. Rate: 7.2 symbols/min [2025-10-07T18:59:41.891302] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:41.937734] [DEBUG] [LOCAL ] FNV: Loaded 46139 existing records from primary storage. [2025-10-07T18:59:41.938073] [INFO ] [MAIN ] FNV: Loaded 46139 existing records. [2025-10-07T18:59:42.116494] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:42.116806] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-07T18:59:42.116986] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-07T18:59:42.122266] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-07T18:59:42.122362] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-07T18:59:42.249427] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-07T18:59:42.313276] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T18:59:42.524308] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:43.047682] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-07T18:59:43.263131] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T18:59:43.847632] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-07T18:59:43.951348] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T18:59:44.647738] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-07T18:59:44.879670] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T18:59:45.421336] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T18:59:45.447695] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-07T18:59:45.904347] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T18:59:46.247736] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-07T18:59:46.947116] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T18:59:46.952304] [INFO ] [REMOTE ] FNB: Full fetch complete (75883 records). [2025-10-07T18:59:46.952491] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-07T18:59:47.053038] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-07T18:59:47.356356] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-07T18:59:47.356452] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-07T18:59:47.357435] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-07T18:59:47.357507] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-07T18:59:47.359160] [DEBUG] [LOCAL ] FNB: Trimmed 75883 records to 52527 (keeping 200 days of data) [2025-10-07T18:59:47.704789] [DEBUG] [LOCAL ] FNB: Primary data saved (52527 records). [2025-10-07T18:59:47.705189] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-07T18:59:47.705297] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FNB took 33.9s. Estimated remaining: 3h 31m 30s. Rate: 7.2 symbols/min [2025-10-07T18:59:47.852892] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-07T18:59:47.880517] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:47.897758] [DEBUG] [LOCAL ] FOA: Loaded 13043 existing records from primary storage. [2025-10-07T18:59:47.898155] [INFO ] [MAIN ] FOA: Loaded 13043 existing records. [2025-10-07T18:59:48.075340] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:48.075693] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-07T18:59:48.075756] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-07T18:59:48.076278] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-07T18:59:48.076336] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-07T18:59:48.362852] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-07T18:59:48.532234] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:48.634608] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T18:59:48.647596] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-07T18:59:49.437429] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T18:59:49.447600] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-07T18:59:49.829800] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T18:59:49.833064] [INFO ] [REMOTE ] FNF: Full fetch complete (69696 records). [2025-10-07T18:59:49.833189] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-07T18:59:50.221435] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-07T18:59:50.221534] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-07T18:59:50.222394] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-07T18:59:50.222460] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-07T18:59:50.224114] [DEBUG] [LOCAL ] FNF: Trimmed 69696 records to 48940 (keeping 200 days of data) [2025-10-07T18:59:50.278716] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-07T18:59:50.531267] [DEBUG] [LOCAL ] FNF: Primary data saved (48940 records). [2025-10-07T18:59:50.531421] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-07T18:59:50.531545] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNF took 30.7s. Estimated remaining: 3h 31m 12s. Rate: 7.2 symbols/min [2025-10-07T18:59:50.702194] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:50.712874] [DEBUG] [LOCAL ] FOF: Loaded 8463 existing records from primary storage. [2025-10-07T18:59:50.713048] [INFO ] [MAIN ] FOF: Loaded 8463 existing records. [2025-10-07T18:59:50.896472] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:50.896855] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-07T18:59:50.896932] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-07T18:59:50.897675] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-07T18:59:50.897742] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-07T18:59:51.057905] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-07T18:59:51.150783] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T18:59:51.319304] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:51.853244] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-07T18:59:51.862585] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T18:59:52.215396] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T18:59:52.647736] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-07T18:59:53.384762] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T18:59:53.447611] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-07T18:59:54.233747] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T18:59:54.238793] [INFO ] [REMOTE ] FND: Full fetch complete (74679 records). [2025-10-07T18:59:54.238960] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-07T18:59:54.254530] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-07T18:59:54.651503] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-07T18:59:54.651601] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-07T18:59:54.652524] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-07T18:59:54.652605] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-07T18:59:54.658709] [DEBUG] [LOCAL ] FND: Trimmed 74679 records to 52089 (keeping 200 days of data) [2025-10-07T18:59:54.993059] [DEBUG] [LOCAL ] FND: Primary data saved (52089 records). [2025-10-07T18:59:54.993220] [INFO ] [MAIN ] FND: Full history saved. [2025-10-07T18:59:54.993311] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FND took 40.0s. Estimated remaining: 3h 30m 57s. Rate: 7.2 symbols/min [2025-10-07T18:59:55.052938] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-07T18:59:55.176521] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T18:59:55.198242] [DEBUG] [LOCAL ] FOR: Loaded 19733 existing records from primary storage. [2025-10-07T18:59:55.198505] [INFO ] [MAIN ] FOR: Loaded 19733 existing records. [2025-10-07T18:59:55.380355] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T18:59:55.381359] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-07T18:59:55.381494] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-07T18:59:55.381809] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-07T18:59:55.381955] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-07T18:59:55.524615] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-07T18:59:55.587871] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T18:59:55.817716] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T18:59:55.818277] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T18:59:55.847603] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-07T18:59:56.647629] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-07T18:59:56.800179] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T18:59:57.447707] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-07T18:59:57.655734] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T18:59:58.247619] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-07T18:59:58.555997] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T18:59:59.047692] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-07T18:59:59.847621] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-07T18:59:59.950788] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T19:00:00.149410] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T19:00:00.297299] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T19:00:00.647682] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-07T19:00:01.447749] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-07T19:00:01.486337] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T19:00:02.247732] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-07T19:00:03.048895] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-07T19:00:03.068596] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T19:00:03.282023] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-07T19:00:03.847710] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-07T19:00:04.162188] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T19:00:04.647673] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-07T19:00:04.737178] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T19:00:05.446006] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T19:00:05.447920] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-07T19:00:06.247712] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-07T19:00:07.047635] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-07T19:00:07.228072] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T19:00:07.480177] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T19:00:07.560426] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-07T19:00:07.847680] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-07T19:00:08.647670] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-07T19:00:08.913832] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T19:00:09.447623] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-07T19:00:09.536499] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T19:00:10.183689] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T19:00:10.247693] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-07T19:00:11.001539] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T19:00:11.047689] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-07T19:00:11.737443] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T19:00:11.847679] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-07T19:00:12.647779] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-07T19:00:13.447699] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-07T19:00:13.605067] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-07T19:00:13.638760] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T19:00:13.905330] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-07T19:00:14.247709] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-07T19:00:15.047702] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-07T19:00:15.111784] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T19:00:15.847739] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-07T19:00:16.442019] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T19:00:16.603682] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T19:00:16.647626] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-07T19:00:17.418735] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T19:00:17.447682] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-07T19:00:18.226942] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T19:00:18.247608] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-07T19:00:19.047705] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-07T19:00:19.668311] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T19:00:19.672959] [INFO ] [REMOTE ] FNV: Full fetch complete (66465 records). [2025-10-07T19:00:19.673107] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-07T19:00:19.854430] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-07T19:00:20.077054] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-07T19:00:20.077147] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-07T19:00:20.077958] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-07T19:00:20.078025] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-07T19:00:20.079593] [DEBUG] [LOCAL ] FNV: Trimmed 66465 records to 46152 (keeping 200 days of data) [2025-10-07T19:00:20.188510] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T19:00:20.399488] [DEBUG] [LOCAL ] FNV: Primary data saved (46152 records). [2025-10-07T19:00:20.399669] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-07T19:00:20.399791] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 38.7s. Estimated remaining: 3h 31m 19s. Rate: 7.2 symbols/min [2025-10-07T19:00:20.577266] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:00:20.623302] [DEBUG] [LOCAL ] FOUR: Loaded 49579 existing records from primary storage. [2025-10-07T19:00:20.623687] [INFO ] [MAIN ] FOUR: Loaded 49579 existing records. [2025-10-07T19:00:20.653947] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-07T19:00:20.822575] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:00:20.822906] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-07T19:00:20.823005] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-07T19:00:20.824733] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-07T19:00:20.824815] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-07T19:00:21.009024] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T19:00:21.224383] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:00:21.447683] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-07T19:00:22.116481] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T19:00:22.117767] [INFO ] [REMOTE ] FOF: Full fetch complete (11913 records). [2025-10-07T19:00:22.117849] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-07T19:00:22.253975] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-07T19:00:22.489544] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-07T19:00:22.489634] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-07T19:00:22.489958] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-07T19:00:22.490006] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-07T19:00:22.490478] [DEBUG] [LOCAL ] FOF: Trimmed 11913 records to 8500 (keeping 200 days of data) [2025-10-07T19:00:22.548441] [DEBUG] [LOCAL ] FOF: Primary data saved (8500 records). [2025-10-07T19:00:22.548621] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-07T19:00:22.548774] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOF took 32.0s. Estimated remaining: 3h 30m 59s. Rate: 7.2 symbols/min [2025-10-07T19:00:22.745799] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:00:22.766306] [DEBUG] [LOCAL ] FPF: Loaded 18409 existing records from primary storage. [2025-10-07T19:00:22.766598] [INFO ] [MAIN ] FPF: Loaded 18409 existing records. [2025-10-07T19:00:22.942092] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:00:22.942309] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-07T19:00:22.942356] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-07T19:00:22.942991] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-07T19:00:22.943052] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-07T19:00:23.052936] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-07T19:00:23.296920] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:00:23.506925] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-07T19:00:23.558626] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-07T19:00:23.847698] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-07T19:00:24.202996] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T19:00:24.647632] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-07T19:00:24.914593] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T19:00:25.447725] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-07T19:00:26.247724] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-07T19:00:26.404029] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T19:00:26.564636] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T19:00:26.566075] [INFO ] [REMOTE ] FOA: Full fetch complete (22256 records). [2025-10-07T19:00:26.566177] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-07T19:00:26.930586] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-07T19:00:26.930702] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-07T19:00:26.931173] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-07T19:00:26.931218] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-07T19:00:26.932008] [DEBUG] [LOCAL ] FOA: Trimmed 22256 records to 13075 (keeping 200 days of data) [2025-10-07T19:00:27.019590] [DEBUG] [LOCAL ] FOA: Primary data saved (13075 records). [2025-10-07T19:00:27.019798] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-07T19:00:27.019925] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOA took 39.3s. Estimated remaining: 3h 30m 44s. Rate: 7.2 symbols/min [2025-10-07T19:00:27.052379] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-07T19:00:27.157129] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T19:00:27.230298] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:00:27.252062] [DEBUG] [LOCAL ] FPH: Loaded 19298 existing records from primary storage. [2025-10-07T19:00:27.252347] [INFO ] [MAIN ] FPH: Loaded 19298 existing records. [2025-10-07T19:00:27.436339] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:00:27.436573] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-07T19:00:27.436620] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-07T19:00:27.437169] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-07T19:00:27.437228] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-07T19:00:27.781170] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:00:27.847615] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-07T19:00:28.076305] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T19:00:28.077851] [INFO ] [REMOTE ] FOR: Full fetch complete (29844 records). [2025-10-07T19:00:28.077924] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-07T19:00:28.449790] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-07T19:00:28.450025] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-07T19:00:28.450818] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-07T19:00:28.450933] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-07T19:00:28.462459] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-07T19:00:28.462054] [DEBUG] [LOCAL ] FOR: Trimmed 29844 records to 19691 (keeping 200 days of data) [2025-10-07T19:00:28.589242] [DEBUG] [LOCAL ] FOR: Primary data saved (19691 records). [2025-10-07T19:00:28.589415] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-07T19:00:28.589508] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOR took 33.6s. Estimated remaining: 3h 30m 24s. Rate: 7.2 symbols/min [2025-10-07T19:00:28.655354] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-07T19:00:28.801392] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:00:28.838886] [DEBUG] [LOCAL ] FPI: Loaded 31057 existing records from primary storage. [2025-10-07T19:00:28.839212] [INFO ] [MAIN ] FPI: Loaded 31057 existing records. [2025-10-07T19:00:29.022330] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:00:29.022539] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-07T19:00:29.022585] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-07T19:00:29.024091] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-07T19:00:29.024150] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-07T19:00:29.370075] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:00:29.447623] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-07T19:00:30.247755] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-07T19:00:30.531833] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-07T19:00:30.855884] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T19:00:31.047669] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-07T19:00:31.207516] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T19:00:31.847727] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-07T19:00:32.324460] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T19:00:32.527747] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T19:00:32.647627] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-07T19:00:33.447709] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-07T19:00:33.844589] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T19:00:34.247706] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-07T19:00:34.375963] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-07T19:00:35.047704] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-07T19:00:35.847748] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-07T19:00:36.018522] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T19:00:36.228775] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T19:00:36.647700] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-07T19:00:36.847444] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T19:00:37.447618] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-07T19:00:37.893200] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T19:00:38.247686] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-07T19:00:38.442108] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T19:00:39.047742] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-07T19:00:39.333858] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-07T19:00:39.847723] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-07T19:00:40.647631] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-07T19:00:40.775810] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:00:41.078834] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T19:00:41.344886] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T19:00:41.447726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-07T19:00:42.247722] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-07T19:00:42.491961] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T19:00:43.047743] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-07T19:00:43.623588] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T19:00:43.847724] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-07T19:00:44.647676] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-07T19:00:44.787534] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T19:00:44.831379] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T19:00:45.447740] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-07T19:00:45.847763] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T19:00:46.247749] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-07T19:00:46.832413] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T19:00:47.047743] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-07T19:00:47.847768] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-07T19:00:47.912572] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T19:00:48.201819] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T19:00:48.647734] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-07T19:00:48.934075] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T19:00:48.936110] [INFO ] [REMOTE ] FPF: Full fetch complete (26731 records). [2025-10-07T19:00:48.936218] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-07T19:00:49.301507] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-07T19:00:49.301685] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-07T19:00:49.302188] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-07T19:00:49.302231] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-07T19:00:49.302905] [DEBUG] [LOCAL ] FPF: Trimmed 26731 records to 18492 (keeping 200 days of data) [2025-10-07T19:00:49.428537] [DEBUG] [LOCAL ] FPF: Primary data saved (18492 records). [2025-10-07T19:00:49.428731] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-07T19:00:49.428847] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPF took 26.9s. Estimated remaining: 3h 30m 37s. Rate: 7.2 symbols/min [2025-10-07T19:00:49.452808] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-07T19:00:49.603159] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T19:00:49.620678] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:00:49.668567] [DEBUG] [LOCAL ] FR: Loaded 46451 existing records from primary storage. [2025-10-07T19:00:49.668930] [INFO ] [MAIN ] FR: Loaded 46451 existing records. [2025-10-07T19:00:49.842145] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:00:49.842330] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-07T19:00:49.842391] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-07T19:00:49.844117] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-07T19:00:49.844180] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-07T19:00:50.205212] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:00:50.247604] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-07T19:00:51.047713] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-07T19:00:51.499303] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T19:00:51.681579] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T19:00:51.847621] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-07T19:00:52.580052] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T19:00:52.647614] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-07T19:00:53.440254] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T19:00:53.450985] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-07T19:00:54.123771] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T19:00:54.188370] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T19:00:54.247688] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-07T19:00:55.047716] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-07T19:00:55.847782] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-07T19:00:55.958393] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T19:00:55.962034] [INFO ] [REMOTE ] FOUR: Full fetch complete (72065 records). [2025-10-07T19:00:55.962189] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-07T19:00:56.342155] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-07T19:00:56.342251] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-07T19:00:56.343158] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-07T19:00:56.343243] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-07T19:00:56.344937] [DEBUG] [LOCAL ] FOUR: Trimmed 72065 records to 49599 (keeping 200 days of data) [2025-10-07T19:00:56.648366] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-07T19:00:56.648511] [DEBUG] [LOCAL ] FOUR: Primary data saved (49599 records). [2025-10-07T19:00:56.649716] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-07T19:00:56.649849] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FOUR took 36.2s. Estimated remaining: 3h 30m 27s. Rate: 7.2 symbols/min [2025-10-07T19:00:56.835081] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T19:00:56.878103] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T19:00:56.880396] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:00:56.899433] [DEBUG] [LOCAL ] FRA: Loaded 14576 existing records from primary storage. [2025-10-07T19:00:56.899684] [INFO ] [MAIN ] FRA: Loaded 14576 existing records. [2025-10-07T19:00:57.072009] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:00:57.072291] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-07T19:00:57.072343] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-07T19:00:57.072903] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-07T19:00:57.072964] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-07T19:00:57.415750] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:00:57.447608] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-07T19:00:57.655709] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T19:00:58.247742] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-07T19:00:59.055320] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-07T19:00:59.074751] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T19:00:59.346384] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T19:00:59.847807] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-07T19:01:00.396442] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T19:01:00.647674] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-07T19:01:01.072497] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T19:01:01.447711] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-07T19:01:01.955871] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T19:01:01.958575] [INFO ] [REMOTE ] FPI: Full fetch complete (44183 records). [2025-10-07T19:01:01.958799] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-07T19:01:02.252835] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-07T19:01:02.355923] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-07T19:01:02.356018] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-07T19:01:02.356871] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-07T19:01:02.356938] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-07T19:01:02.358221] [DEBUG] [LOCAL ] FPI: Trimmed 44183 records to 31067 (keeping 200 days of data) [2025-10-07T19:01:02.561000] [DEBUG] [LOCAL ] FPI: Primary data saved (31067 records). [2025-10-07T19:01:02.561166] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-07T19:01:02.561259] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPI took 34.0s. Estimated remaining: 3h 30m 14s. Rate: 7.2 symbols/min [2025-10-07T19:01:02.736439] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:01:02.760776] [DEBUG] [LOCAL ] FRGE: Loaded 17112 existing records from primary storage. [2025-10-07T19:01:02.761100] [INFO ] [MAIN ] FRGE: Loaded 17112 existing records. [2025-10-07T19:01:02.945506] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:01:02.945757] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-07T19:01:02.945813] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-07T19:01:02.946741] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-07T19:01:02.946808] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-07T19:01:03.050129] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-07T19:01:03.320865] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T19:01:03.398782] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:01:03.414113] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T19:01:03.847687] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-07T19:01:04.198881] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T19:01:04.647757] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-07T19:01:05.447704] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-07T19:01:05.673209] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T19:01:05.797306] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T19:01:06.247635] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-07T19:01:06.566968] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T19:01:07.047687] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-07T19:01:07.254076] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T19:01:07.847694] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-07T19:01:08.591692] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T19:01:08.647741] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-07T19:01:09.320714] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T19:01:09.447630] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-07T19:01:09.653393] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T19:01:10.247702] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-07T19:01:10.813464] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T19:01:11.047680] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-07T19:01:11.124219] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T19:01:11.126763] [INFO ] [REMOTE ] FPH: Full fetch complete (31283 records). [2025-10-07T19:01:11.126919] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-07T19:01:11.596167] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-07T19:01:11.596305] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-07T19:01:11.597497] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-07T19:01:11.597634] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-07T19:01:11.599002] [DEBUG] [LOCAL ] FPH: Trimmed 31283 records to 19275 (keeping 200 days of data) [2025-10-07T19:01:11.723417] [DEBUG] [LOCAL ] FPH: Primary data saved (19275 records). [2025-10-07T19:01:11.723663] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-07T19:01:11.723843] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPH took 44.7s. Estimated remaining: 3h 30m 7s. Rate: 7.2 symbols/min [2025-10-07T19:01:11.852724] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-07T19:01:11.920334] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:01:11.942403] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T19:01:11.986444] [DEBUG] [LOCAL ] FRO: Loaded 51693 existing records from primary storage. [2025-10-07T19:01:11.986823] [INFO ] [MAIN ] FRO: Loaded 51693 existing records. [2025-10-07T19:01:12.158843] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:01:12.159060] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-07T19:01:12.159107] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-07T19:01:12.159407] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-07T19:01:12.159466] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-07T19:01:12.509240] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:01:12.647710] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-07T19:01:13.447721] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-07T19:01:13.618752] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T19:01:13.940213] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T19:01:14.247687] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-07T19:01:15.047725] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-07T19:01:15.229023] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T19:01:15.487695] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-07T19:01:15.847733] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-07T19:01:16.431779] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T19:01:16.647730] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-07T19:01:17.447704] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-07T19:01:17.876878] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-07T19:01:18.199734] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T19:01:18.247705] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-07T19:01:18.861637] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T19:01:19.047772] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-07T19:01:19.853224] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-07T19:01:19.858685] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T19:01:19.902567] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T19:01:20.647711] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-07T19:01:21.378837] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T19:01:21.447699] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-07T19:01:22.247675] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-07T19:01:22.312001] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T19:01:22.886910] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T19:01:23.004352] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T19:01:23.007635] [INFO ] [REMOTE ] FR: Full fetch complete (66745 records). [2025-10-07T19:01:23.007793] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-07T19:01:23.052781] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-07T19:01:23.394047] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-07T19:01:23.394147] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-07T19:01:23.394957] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-07T19:01:23.395025] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-07T19:01:23.396353] [DEBUG] [LOCAL ] FR: Trimmed 66745 records to 46429 (keeping 200 days of data) [2025-10-07T19:01:23.678032] [DEBUG] [LOCAL ] FR: Primary data saved (46429 records). [2025-10-07T19:01:23.678169] [INFO ] [MAIN ] FR: Full history saved. [2025-10-07T19:01:23.678252] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FR took 34.2s. Estimated remaining: 3h 30m 5s. Rate: 7.2 symbols/min [2025-10-07T19:01:23.845630] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:01:23.847630] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-07T19:01:23.889018] [DEBUG] [LOCAL ] FRT: Loaded 41945 existing records from primary storage. [2025-10-07T19:01:23.889366] [INFO ] [MAIN ] FRT: Loaded 41945 existing records. [2025-10-07T19:01:24.017157] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T19:01:24.089342] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:01:24.089572] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-07T19:01:24.089620] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-07T19:01:24.089907] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-07T19:01:24.089965] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-07T19:01:24.459704] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:01:24.650331] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-07T19:01:24.652996] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T19:01:25.447731] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-07T19:01:26.162234] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T19:01:26.247736] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-07T19:01:26.338290] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T19:01:27.047809] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-07T19:01:27.715521] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T19:01:27.847687] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-07T19:01:28.051922] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T19:01:28.647674] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-07T19:01:29.305835] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T19:01:29.447677] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-07T19:01:30.247619] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-07T19:01:30.379175] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T19:01:30.427738] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T19:01:31.047636] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-07T19:01:31.069389] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T19:01:31.070950] [INFO ] [REMOTE ] FRA: Full fetch complete (23952 records). [2025-10-07T19:01:31.071025] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-07T19:01:31.445330] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-07T19:01:31.445413] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-07T19:01:31.445927] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-07T19:01:31.445990] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-07T19:01:31.446630] [DEBUG] [LOCAL ] FRA: Trimmed 23952 records to 14607 (keeping 200 days of data) [2025-10-07T19:01:31.544216] [DEBUG] [LOCAL ] FRA: Primary data saved (14607 records). [2025-10-07T19:01:31.544561] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-07T19:01:31.544674] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FRA took 34.9s. Estimated remaining: 3h 29m 55s. Rate: 7.2 symbols/min [2025-10-07T19:01:31.715600] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:01:31.752106] [DEBUG] [LOCAL ] FSCO: Loaded 37913 existing records from primary storage. [2025-10-07T19:01:31.752436] [INFO ] [MAIN ] FSCO: Loaded 37913 existing records. [2025-10-07T19:01:31.851766] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-07T19:01:31.935700] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:01:31.935908] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-07T19:01:31.935956] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-07T19:01:31.936226] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-07T19:01:31.936283] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-07T19:01:32.296792] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:01:32.647704] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-07T19:01:32.740765] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T19:01:32.770969] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T19:01:33.447707] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-07T19:01:34.247635] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-07T19:01:34.417682] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T19:01:34.929146] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T19:01:35.047707] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-07T19:01:35.713178] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T19:01:35.847703] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-07T19:01:36.479451] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T19:01:36.605830] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T19:01:36.607101] [INFO ] [REMOTE ] FRGE: Full fetch complete (31883 records). [2025-10-07T19:01:36.607179] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-07T19:01:36.652789] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-07T19:01:36.973396] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-07T19:01:36.973479] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-07T19:01:36.974086] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-07T19:01:36.974151] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-07T19:01:36.974921] [DEBUG] [LOCAL ] FRGE: Trimmed 31883 records to 16981 (keeping 200 days of data) [2025-10-07T19:01:37.085123] [DEBUG] [LOCAL ] FRGE: Primary data saved (16981 records). [2025-10-07T19:01:37.085579] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-07T19:01:37.085718] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 34.5s. Estimated remaining: 3h 29m 42s. Rate: 7.2 symbols/min [2025-10-07T19:01:37.265606] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:01:37.312819] [DEBUG] [LOCAL ] FSK: Loaded 49404 existing records from primary storage. [2025-10-07T19:01:37.313228] [INFO ] [MAIN ] FSK: Loaded 49404 existing records. [2025-10-07T19:01:37.452749] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-07T19:01:37.491340] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:01:37.491753] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-07T19:01:37.491849] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-07T19:01:37.493357] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-07T19:01:37.493424] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-07T19:01:37.843868] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:01:38.247711] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-07T19:01:38.547927] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T19:01:38.658098] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T19:01:39.047634] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-07T19:01:39.856874] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-07T19:01:39.877809] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T19:01:40.647668] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-07T19:01:40.874691] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T19:01:41.130088] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T19:01:41.447747] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-07T19:01:41.853277] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T19:01:42.247677] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-07T19:01:42.539479] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T19:01:43.047699] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-07T19:01:43.800759] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T19:01:43.847605] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-07T19:01:44.647709] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-07T19:01:44.735791] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T19:01:45.324390] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:01:45.447608] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-07T19:01:46.247633] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-07T19:01:46.282881] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T19:01:47.024248] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T19:01:47.047607] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-07T19:01:47.847681] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-07T19:01:48.066841] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-07T19:01:48.354282] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T19:01:48.647753] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-07T19:01:49.454364] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-07T19:01:49.457000] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T19:01:50.165491] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T19:01:50.247686] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-07T19:01:51.047759] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-07T19:01:51.223895] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-07T19:01:51.229019] [INFO ] [REMOTE ] FRO: Full fetch complete (75195 records). [2025-10-07T19:01:51.229208] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-07T19:01:51.644125] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-07T19:01:51.644418] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-07T19:01:51.645611] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-07T19:01:51.645797] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-07T19:01:51.647854] [DEBUG] [LOCAL ] FRO: Trimmed 75195 records to 51679 (keeping 200 days of data) [2025-10-07T19:01:51.790301] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T19:01:51.918509] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-07T19:01:52.147787] [DEBUG] [LOCAL ] FRO: Primary data saved (51679 records). [2025-10-07T19:01:52.148009] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-07T19:01:52.148147] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 40.4s. Estimated remaining: 3h 29m 45s. Rate: 7.2 symbols/min [2025-10-07T19:01:52.438006] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:01:52.505105] [DEBUG] [LOCAL ] FSLY: Loaded 51238 existing records from primary storage. [2025-10-07T19:01:52.505791] [INFO ] [MAIN ] FSLY: Loaded 51238 existing records. [2025-10-07T19:01:52.652984] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-07T19:01:52.777621] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:01:52.780854] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-07T19:01:52.780962] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-07T19:01:52.783480] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T19:01:52.783551] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-07T19:01:52.791785] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-07T19:01:53.241582] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:01:53.331808] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T19:01:53.335491] [INFO ] [REMOTE ] FRT: Full fetch complete (60445 records). [2025-10-07T19:01:53.335685] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-07T19:01:53.451181] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-07T19:01:53.845443] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-07T19:01:53.845565] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-07T19:01:53.846672] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-07T19:01:53.846796] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-07T19:01:53.849220] [DEBUG] [LOCAL ] FRT: Trimmed 60445 records to 41989 (keeping 200 days of data) [2025-10-07T19:01:54.124131] [DEBUG] [LOCAL ] FRT: Primary data saved (41989 records). [2025-10-07T19:01:54.124271] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-07T19:01:54.124381] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 30.4s. Estimated remaining: 3h 29m 26s. Rate: 7.2 symbols/min [2025-10-07T19:01:54.248326] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-07T19:01:54.327719] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:01:54.363168] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T19:01:54.423375] [DEBUG] [LOCAL ] FSM: Loaded 53295 existing records from primary storage. [2025-10-07T19:01:54.423804] [INFO ] [MAIN ] FSM: Loaded 53295 existing records. [2025-10-07T19:01:54.607968] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:01:54.608383] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-07T19:01:54.608592] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-07T19:01:54.610192] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-07T19:01:54.610257] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-07T19:01:54.800989] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T19:01:55.010323] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:01:55.047615] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-07T19:01:55.851609] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-07T19:01:55.858317] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T19:01:56.647707] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-07T19:01:56.790482] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T19:01:57.452754] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-07T19:01:57.473215] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T19:01:58.247686] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-07T19:01:58.395367] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T19:01:59.047628] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-07T19:01:59.161149] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T19:01:59.847634] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-07T19:01:59.942345] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T19:02:00.647674] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-07T19:02:00.737061] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T19:02:01.417133] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T19:02:01.447680] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-07T19:02:02.245253] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T19:02:02.254019] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-07T19:02:03.047737] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-07T19:02:03.847759] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-07T19:02:04.046555] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-07T19:02:04.233481] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T19:02:04.491309] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T19:02:04.496063] [INFO ] [REMOTE ] FSCO: Full fetch complete (54631 records). [2025-10-07T19:02:04.496301] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-07T19:02:04.670685] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-07T19:02:04.886550] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-07T19:02:04.886682] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-07T19:02:04.887561] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-07T19:02:04.887671] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-07T19:02:04.889222] [DEBUG] [LOCAL ] FSCO: Trimmed 54631 records to 37940 (keeping 200 days of data) [2025-10-07T19:02:05.133829] [DEBUG] [LOCAL ] FSCO: Primary data saved (37940 records). [2025-10-07T19:02:05.133999] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-07T19:02:05.134108] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSCO took 33.6s. Estimated remaining: 3h 29m 22s. Rate: 7.2 symbols/min [2025-10-07T19:02:05.344362] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:02:05.376581] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:02:05.418600] [DEBUG] [LOCAL ] FSS: Loaded 34047 existing records from primary storage. [2025-10-07T19:02:05.418915] [INFO ] [MAIN ] FSS: Loaded 34047 existing records. [2025-10-07T19:02:05.452886] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-07T19:02:05.598061] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:02:05.598265] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-07T19:02:05.598314] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-07T19:02:05.599620] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-07T19:02:05.599707] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-07T19:02:05.955919] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:02:06.247759] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-07T19:02:06.701108] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T19:02:07.047694] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-07T19:02:07.235396] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T19:02:07.475270] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T19:02:07.847728] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-07T19:02:08.647745] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-07T19:02:08.869401] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T19:02:09.158582] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T19:02:09.447725] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-07T19:02:10.152860] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T19:02:10.247615] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-07T19:02:10.773688] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-07T19:02:11.047736] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-07T19:02:11.727125] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T19:02:11.847698] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-07T19:02:12.616139] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T19:02:12.647611] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-07T19:02:13.447627] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-07T19:02:13.703463] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T19:02:14.247739] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-07T19:02:14.297052] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T19:02:14.881893] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T19:02:14.889101] [INFO ] [REMOTE ] FSK: Full fetch complete (71663 records). [2025-10-07T19:02:14.889239] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-07T19:02:15.060861] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-07T19:02:15.350323] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-07T19:02:15.350427] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-07T19:02:15.351296] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-07T19:02:15.351364] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-07T19:02:15.352932] [DEBUG] [LOCAL ] FSK: Trimmed 71663 records to 49404 (keeping 200 days of data) [2025-10-07T19:02:15.661632] [DEBUG] [LOCAL ] FSK: Primary data saved (49404 records). [2025-10-07T19:02:15.661820] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-07T19:02:15.661947] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 38.6s. Estimated remaining: 3h 29m 17s. Rate: 7.2 symbols/min [2025-10-07T19:02:15.831829] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:02:15.831997] [DEBUG] [LOCAL ] FT: No existing data file found in primary storage. [2025-10-07T19:02:15.832033] [WARN ] [MAIN ] FT: No existing data found, performing full refresh instead. [2025-10-07T19:02:15.832150] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-07T19:02:15.832214] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-07T19:02:15.832282] [DEBUG] [LOCAL ] FT: No primary data file found to delete. [2025-10-07T19:02:15.832317] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-07T19:02:15.862599] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-07T19:02:16.193483] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:02:16.236122] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T19:02:16.647707] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-07T19:02:16.972728] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-07T19:02:17.356452] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T19:02:17.447619] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-07T19:02:18.247634] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-07T19:02:18.280390] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T19:02:18.770227] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T19:02:18.904350] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T19:02:19.047728] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-07T19:02:19.847733] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-07T19:02:20.564020] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T19:02:20.647759] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-07T19:02:21.447693] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-07T19:02:21.562508] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T19:02:21.980355] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T19:02:22.247725] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-07T19:02:23.047743] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-07T19:02:23.394967] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T19:02:23.577859] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T19:02:23.682731] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T19:02:23.847742] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-07T19:02:24.647727] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-07T19:02:25.133326] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T19:02:25.307177] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T19:02:25.447745] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-07T19:02:26.103638] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T19:02:26.247729] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-07T19:02:27.047690] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-07T19:02:27.847685] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-07T19:02:28.057129] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T19:02:28.537830] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T19:02:28.647724] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-07T19:02:28.984885] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T19:02:28.987960] [INFO ] [REMOTE ] FSS: Full fetch complete (48483 records). [2025-10-07T19:02:28.988117] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-07T19:02:29.361765] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-07T19:02:29.361871] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-07T19:02:29.362542] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-07T19:02:29.362589] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-07T19:02:29.363825] [DEBUG] [LOCAL ] FSS: Trimmed 48483 records to 33992 (keeping 200 days of data) [2025-10-07T19:02:29.453387] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-07T19:02:29.576163] [DEBUG] [LOCAL ] FSS: Primary data saved (33992 records). [2025-10-07T19:02:29.576313] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-07T19:02:29.576400] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSS took 24.4s. Estimated remaining: 3h 29m 18s. Rate: 7.1 symbols/min [2025-10-07T19:02:29.747399] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:02:29.759897] [DEBUG] [LOCAL ] FTHY: Loaded 12272 existing records from primary storage. [2025-10-07T19:02:29.760107] [INFO ] [MAIN ] FTHY: Loaded 12272 existing records. [2025-10-07T19:02:29.933107] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:02:29.933274] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-07T19:02:29.933319] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-07T19:02:29.933869] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-07T19:02:29.933928] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-07T19:02:30.259679] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-07T19:02:30.254345] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T19:02:30.298231] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:02:30.308161] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T19:02:30.311599] [INFO ] [REMOTE ] FSM: Full fetch complete (76811 records). [2025-10-07T19:02:30.311715] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-07T19:02:30.691079] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-07T19:02:30.691156] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-07T19:02:30.692010] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-07T19:02:30.692075] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-07T19:02:30.693448] [DEBUG] [LOCAL ] FSM: Trimmed 76811 records to 53294 (keeping 200 days of data) [2025-10-07T19:02:30.993055] [DEBUG] [LOCAL ] FSM: Primary data saved (53294 records). [2025-10-07T19:02:30.993191] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-07T19:02:30.993272] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSM took 36.9s. Estimated remaining: 3h 28m 58s. Rate: 7.2 symbols/min [2025-10-07T19:02:31.055835] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-07T19:02:31.166740] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:02:31.217516] [DEBUG] [LOCAL ] FTI: Loaded 53298 existing records from primary storage. [2025-10-07T19:02:31.218067] [INFO ] [MAIN ] FTI: Loaded 53298 existing records. [2025-10-07T19:02:31.391034] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:02:31.391222] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-07T19:02:31.391268] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-07T19:02:31.393093] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-07T19:02:31.393154] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-07T19:02:31.738915] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:02:31.847596] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-07T19:02:31.906477] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T19:02:32.143866] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T19:02:32.647745] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-07T19:02:33.447701] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-07T19:02:33.628722] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T19:02:34.247633] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-07T19:02:34.451554] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T19:02:34.507166] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-07T19:02:34.511151] [INFO ] [REMOTE ] FSLY: Full fetch complete (74887 records). [2025-10-07T19:02:34.511309] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-07T19:02:34.921520] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-07T19:02:34.921604] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-07T19:02:34.922467] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-07T19:02:34.922532] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-07T19:02:34.924118] [DEBUG] [LOCAL ] FSLY: Trimmed 74887 records to 51244 (keeping 200 days of data) [2025-10-07T19:02:35.085159] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-07T19:02:35.224694] [DEBUG] [LOCAL ] FSLY: Primary data saved (51244 records). [2025-10-07T19:02:35.224894] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-07T19:02:35.224999] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSLY took 43.1s. Estimated remaining: 3h 28m 43s. Rate: 7.2 symbols/min [2025-10-07T19:02:35.630090] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T19:02:35.778996] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T19:02:35.847707] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-07T19:02:36.572842] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-07T19:02:36.647754] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-07T19:02:37.447812] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-07T19:02:38.247722] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-07T19:02:38.364599] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T19:02:38.408292] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T19:02:38.993558] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T19:02:39.047712] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-07T19:02:39.847742] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-07T19:02:40.573672] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T19:02:40.647754] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-07T19:02:41.069888] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-07T19:02:41.356068] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T19:02:41.357086] [INFO ] [REMOTE ] FT: Full fetch complete (9163 records). [2025-10-07T19:02:41.357155] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-07T19:02:41.453617] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-07T19:02:41.718836] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-07T19:02:41.718916] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-07T19:02:41.719112] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-07T19:02:41.719151] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-07T19:02:41.719555] [DEBUG] [LOCAL ] FT: Trimmed 9163 records to 6560 (keeping 200 days of data) [2025-10-07T19:02:41.759438] [DEBUG] [LOCAL ] FT: Primary data saved (6560 records). [2025-10-07T19:02:41.759542] [INFO ] [MAIN ] FT: Full history saved. [2025-10-07T19:02:41.759613] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FT took 26.1s. Estimated remaining: 3h 28m 31s. Rate: 7.2 symbols/min [2025-10-07T19:02:42.247761] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-07T19:02:43.023134] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T19:02:43.047625] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-07T19:02:43.314503] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T19:02:43.852969] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-07T19:02:43.859780] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T19:02:44.647749] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-07T19:02:45.596090] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T19:02:45.600400] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-07T19:02:45.732526] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T19:02:46.075792] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-07T19:02:46.247675] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-07T19:02:47.047675] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-07T19:02:47.107735] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-07T19:02:47.847759] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-07T19:02:48.620913] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T19:02:48.647694] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-07T19:02:48.759796] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T19:02:49.447700] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-07T19:02:49.500614] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T19:02:50.247681] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-07T19:02:51.069464] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T19:02:51.072587] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-07T19:02:51.172061] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T19:02:51.847635] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-07T19:02:51.900012] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T19:02:51.901737] [INFO ] [REMOTE ] FTHY: Full fetch complete (17567 records). [2025-10-07T19:02:51.901812] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-07T19:02:52.263439] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-07T19:02:52.263543] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-07T19:02:52.263982] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-07T19:02:52.264046] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-07T19:02:52.264588] [DEBUG] [LOCAL ] FTHY: Trimmed 17567 records to 12266 (keeping 200 days of data) [2025-10-07T19:02:52.340210] [DEBUG] [LOCAL ] FTHY: Primary data saved (12266 records). [2025-10-07T19:02:52.340354] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-07T19:02:52.340495] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 22.8s. Estimated remaining: 3h 28m 26s. Rate: 7.2 symbols/min [2025-10-07T19:02:53.501770] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T19:02:53.513993] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-07T19:02:55.234697] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T19:02:55.246833] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-07T19:02:56.776058] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T19:02:56.781249] [INFO ] [REMOTE ] FTI: Full fetch complete (77127 records). [2025-10-07T19:02:56.781457] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-07T19:02:57.178983] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-07T19:02:57.179068] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-07T19:02:57.179962] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-07T19:02:57.180026] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-07T19:02:57.181477] [DEBUG] [LOCAL ] FTI: Trimmed 77127 records to 53292 (keeping 200 days of data) [2025-10-07T19:02:57.506342] [DEBUG] [LOCAL ] FTI: Primary data saved (53292 records). [2025-10-07T19:02:57.506519] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-07T19:02:57.506616] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 26.5s. Estimated remaining: 3h 28m 13s. Rate: 7.2 symbols/min [2025-10-07T19:02:58.208449] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:02:58.216859] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:02:58.226421] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:02:58.281585] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:02:58.287936] [DEBUG] [LOCAL ] FTWO: Loaded 1872 existing records from primary storage. [2025-10-07T19:02:58.288384] [INFO ] [MAIN ] FTWO: Loaded 1872 existing records. [2025-10-07T19:02:58.487947] [DEBUG] [LOCAL ] FTK: Loaded 32430 existing records from primary storage. [2025-10-07T19:02:58.552052] [INFO ] [MAIN ] FTK: Loaded 32430 existing records. [2025-10-07T19:02:58.580043] [DEBUG] [LOCAL ] FTS: Loaded 42375 existing records from primary storage. [2025-10-07T19:02:58.573806] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:02:58.589147] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-07T19:02:58.589416] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-07T19:02:58.611299] [INFO ] [MAIN ] FTS: Loaded 42375 existing records. [2025-10-07T19:02:58.643455] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-07T19:02:58.720675] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-07T19:02:58.776321] [DEBUG] [LOCAL ] FTV: Loaded 52977 existing records from primary storage. [2025-10-07T19:02:58.887946] [INFO ] [MAIN ] FTV: Loaded 52977 existing records. [2025-10-07T19:02:59.129185] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:02:59.191923] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:02:59.185773] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-07T19:02:59.201822] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-07T19:02:59.201764] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-07T19:02:59.246406] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-07T19:02:59.280869] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-07T19:02:59.246327] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-07T19:02:59.286665] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-07T19:02:59.286582] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-07T19:02:59.727061] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:02:59.754830] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-07T19:02:59.790940] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-07T19:02:59.821602] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-07T19:02:59.892003] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-07T19:03:00.096634] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:00.172046] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-07T19:03:00.521488] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:00.566142] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-07T19:03:00.595837] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:00.651984] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-07T19:03:00.835963] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:00.836474] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-07T19:03:00.881546] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-07T19:03:00.883138] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-07T19:03:01.685207] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T19:03:01.687069] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-07T19:03:01.871405] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T19:03:01.876604] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-07T19:03:02.175627] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T19:03:02.178892] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-07T19:03:02.177274] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T19:03:02.188443] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-07T19:03:02.303031] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T19:03:02.314016] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-07T19:03:02.664600] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-07T19:03:02.665891] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-07T19:03:02.961054] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-07T19:03:03.047741] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-07T19:03:03.082275] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T19:03:03.248868] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T19:03:03.411999] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-07T19:03:03.698912] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T19:03:03.847630] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-07T19:03:04.647678] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-07T19:03:05.452569] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-07T19:03:05.458852] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T19:03:05.907117] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T19:03:06.114961] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T19:03:06.247729] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-07T19:03:07.047748] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-07T19:03:07.495414] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T19:03:07.847679] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-07T19:03:08.103129] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T19:03:08.647735] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-07T19:03:08.876894] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T19:03:09.021283] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-07T19:03:09.447858] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-07T19:03:10.247742] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-07T19:03:10.688702] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-07T19:03:10.994118] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T19:03:11.047712] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-07T19:03:11.521760] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T19:03:11.522671] [INFO ] [REMOTE ] FTWO: Full fetch complete (3336 records). [2025-10-07T19:03:11.522747] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-07T19:03:11.852888] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-07T19:03:11.897569] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-07T19:03:11.897880] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-07T19:03:11.898062] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-07T19:03:11.898105] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-07T19:03:11.898482] [DEBUG] [LOCAL ] FTWO: Trimmed 3336 records to 1866 (keeping 200 days of data) [2025-10-07T19:03:11.911324] [DEBUG] [LOCAL ] FTWO: Primary data saved (1866 records). [2025-10-07T19:03:11.911395] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-07T19:03:11.911483] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 14.4s. Estimated remaining: 3h 28m 14s. Rate: 7.2 symbols/min [2025-10-07T19:03:12.078962] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:03:12.133055] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-10-07T19:03:12.133484] [INFO ] [MAIN ] FUBO: Loaded 53700 existing records. [2025-10-07T19:03:12.365098] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:03:12.365391] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-07T19:03:12.365465] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-07T19:03:12.367154] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-07T19:03:12.367234] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-07T19:03:12.652871] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-07T19:03:12.822205] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:13.447725] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-07T19:03:13.853591] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T19:03:13.962134] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T19:03:14.247688] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-07T19:03:14.646204] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T19:03:15.047740] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-07T19:03:15.847639] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-07T19:03:16.200557] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T19:03:16.237312] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T19:03:16.647762] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-07T19:03:17.447637] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-07T19:03:17.771016] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T19:03:18.007486] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-07T19:03:18.247725] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-07T19:03:19.047743] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-07T19:03:19.194090] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T19:03:19.748765] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T19:03:19.847946] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-07T19:03:20.181663] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T19:03:20.647703] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-07T19:03:21.447634] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-07T19:03:21.740134] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T19:03:22.067512] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T19:03:22.247697] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-07T19:03:23.047723] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-07T19:03:23.636573] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T19:03:23.862667] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-07T19:03:23.890775] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-07T19:03:24.650291] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-07T19:03:24.656392] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T19:03:25.191695] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T19:03:25.447702] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-07T19:03:26.247633] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-07T19:03:26.453284] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T19:03:26.969448] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T19:03:27.047677] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-07T19:03:27.847674] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-07T19:03:28.295305] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T19:03:28.361342] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-07T19:03:28.647700] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-07T19:03:29.447712] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-07T19:03:29.599669] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T19:03:30.247721] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-07T19:03:30.903315] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T19:03:30.906758] [INFO ] [REMOTE ] FTS: Full fetch complete (60257 records). [2025-10-07T19:03:30.906896] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-07T19:03:31.047853] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-07T19:03:31.122078] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-07T19:03:31.358482] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-07T19:03:31.358561] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-07T19:03:31.359528] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-07T19:03:31.359592] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-07T19:03:31.360983] [DEBUG] [LOCAL ] FTS: Trimmed 60257 records to 42398 (keeping 200 days of data) [2025-10-07T19:03:31.475832] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T19:03:31.481426] [INFO ] [REMOTE ] FTV: Full fetch complete (76390 records). [2025-10-07T19:03:31.481784] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-07T19:03:31.852328] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-07T19:03:32.006062] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-07T19:03:32.007353] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-07T19:03:32.008585] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-07T19:03:32.008963] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-07T19:03:32.013243] [DEBUG] [LOCAL ] FTV: Trimmed 76390 records to 52985 (keeping 200 days of data) [2025-10-07T19:03:32.192108] [DEBUG] [LOCAL ] FTS: Primary data saved (42398 records). [2025-10-07T19:03:32.192817] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-07T19:03:32.193425] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTS took 34.7s. Estimated remaining: 3h 28m 26s. Rate: 7.1 symbols/min [2025-10-07T19:03:32.477003] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:03:32.517585] [DEBUG] [LOCAL ] FUL: Loaded 32931 existing records from primary storage. [2025-10-07T19:03:32.518637] [INFO ] [MAIN ] FUL: Loaded 32931 existing records. [2025-10-07T19:03:32.731069] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:03:32.738714] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-07T19:03:32.750591] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-07T19:03:32.753364] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-07T19:03:32.753088] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T19:03:32.753478] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-07T19:03:32.860394] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-07T19:03:33.239232] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:33.247195] [DEBUG] [LOCAL ] FTV: Primary data saved (52985 records). [2025-10-07T19:03:33.247292] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-07T19:03:33.247398] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTV took 35.7s. Estimated remaining: 3h 28m 5s. Rate: 7.2 symbols/min [2025-10-07T19:03:33.413506] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:03:33.447631] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-07T19:03:33.463460] [DEBUG] [LOCAL ] FUN: Loaded 51688 existing records from primary storage. [2025-10-07T19:03:33.463796] [INFO ] [MAIN ] FUN: Loaded 51688 existing records. [2025-10-07T19:03:33.640035] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:03:33.640235] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-07T19:03:33.640282] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-07T19:03:33.641562] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-07T19:03:33.641621] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-07T19:03:34.001931] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:34.122232] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-07T19:03:34.195729] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T19:03:34.198491] [INFO ] [REMOTE ] FTK: Full fetch complete (43680 records). [2025-10-07T19:03:34.198575] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-07T19:03:34.255223] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-07T19:03:34.593293] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-07T19:03:34.593373] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-07T19:03:34.594064] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-07T19:03:34.594127] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-07T19:03:34.595086] [DEBUG] [LOCAL ] FTK: Trimmed 43680 records to 32577 (keeping 200 days of data) [2025-10-07T19:03:34.790562] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T19:03:34.823737] [DEBUG] [LOCAL ] FTK: Primary data saved (32577 records). [2025-10-07T19:03:34.823951] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-07T19:03:34.824100] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTK took 37.3s. Estimated remaining: 3h 27m 45s. Rate: 7.2 symbols/min [2025-10-07T19:03:34.998118] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:03:35.020781] [DEBUG] [LOCAL ] FVR: Loaded 21748 existing records from primary storage. [2025-10-07T19:03:35.021098] [INFO ] [MAIN ] FVR: Loaded 21748 existing records. [2025-10-07T19:03:35.052823] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-07T19:03:35.204078] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:03:35.204309] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-07T19:03:35.204358] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-07T19:03:35.205086] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-07T19:03:35.205147] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-07T19:03:35.569337] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:35.847622] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-07T19:03:35.946205] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T19:03:36.603341] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T19:03:36.647675] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-07T19:03:36.672294] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-07T19:03:37.447744] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-07T19:03:37.913723] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T19:03:38.247742] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-07T19:03:38.931478] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T19:03:39.047611] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-07T19:03:39.847687] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-07T19:03:40.592877] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-07T19:03:40.636305] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T19:03:40.647591] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-07T19:03:40.885561] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T19:03:41.447744] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-07T19:03:42.247728] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-07T19:03:42.333778] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T19:03:42.383961] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-07T19:03:43.047682] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-07T19:03:43.847705] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-07T19:03:44.390182] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-07T19:03:44.647627] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-07T19:03:44.688295] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T19:03:45.140934] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T19:03:45.447677] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-07T19:03:46.247770] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-07T19:03:46.870184] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-07T19:03:47.047696] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-07T19:03:47.330451] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T19:03:47.427768] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T19:03:47.847709] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-07T19:03:48.647746] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-07T19:03:48.905270] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T19:03:49.295047] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-07T19:03:49.447897] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-07T19:03:50.232563] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T19:03:50.247606] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-07T19:03:50.990494] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T19:03:51.047680] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-07T19:03:51.847717] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-07T19:03:52.142048] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T19:03:52.314970] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-07T19:03:52.647732] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-07T19:03:52.969942] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T19:03:53.447744] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-07T19:03:54.247719] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-07T19:03:54.600017] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T19:03:54.885489] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-07T19:03:55.047689] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-07T19:03:55.667517] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T19:03:55.847687] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-07T19:03:56.273626] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T19:03:56.647720] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-07T19:03:57.447695] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-07T19:03:57.865321] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-07T19:03:57.869256] [INFO ] [REMOTE ] FUBO: Full fetch complete (77770 records). [2025-10-07T19:03:57.869394] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-07T19:03:58.264743] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-07T19:03:58.265050] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-07T19:03:58.265671] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-07T19:03:58.267589] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-07T19:03:58.267796] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-07T19:03:58.269729] [DEBUG] [LOCAL ] FUBO: Trimmed 77770 records to 53701 (keeping 200 days of data) [2025-10-07T19:03:58.370568] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T19:03:58.533967] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T19:03:58.666877] [DEBUG] [LOCAL ] FUBO: Primary data saved (53701 records). [2025-10-07T19:03:58.667109] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-07T19:03:58.667334] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUBO took 46.8s. Estimated remaining: 3h 28m 3s. Rate: 7.1 symbols/min [2025-10-07T19:03:58.834905] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:03:58.880266] [DEBUG] [LOCAL ] FVRR: Loaded 40140 existing records from primary storage. [2025-10-07T19:03:58.880614] [INFO ] [MAIN ] FVRR: Loaded 40140 existing records. [2025-10-07T19:03:59.053318] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-07T19:03:59.058747] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:03:59.059688] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-07T19:03:59.059750] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-07T19:03:59.060908] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-07T19:03:59.060973] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-07T19:03:59.422095] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:03:59.623556] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T19:03:59.847675] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-07T19:04:00.647630] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-07T19:04:00.771855] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-07T19:04:00.777627] [INFO ] [REMOTE ] FUN: Full fetch complete (72961 records). [2025-10-07T19:04:00.777864] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-07T19:04:01.197806] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-07T19:04:01.197962] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-07T19:04:01.199088] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-07T19:04:01.199156] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-07T19:04:01.201098] [DEBUG] [LOCAL ] FUN: Trimmed 72961 records to 51731 (keeping 200 days of data) [2025-10-07T19:04:01.448751] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-07T19:04:01.453238] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T19:04:01.570217] [DEBUG] [LOCAL ] FUN: Primary data saved (51731 records). [2025-10-07T19:04:01.570409] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-07T19:04:01.570519] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUN took 28.3s. Estimated remaining: 3h 27m 45s. Rate: 7.1 symbols/min [2025-10-07T19:04:01.739134] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:04:01.742165] [DEBUG] [LOCAL ] FXED: Loaded 1246 existing records from primary storage. [2025-10-07T19:04:01.742307] [INFO ] [MAIN ] FXED: Loaded 1246 existing records. [2025-10-07T19:04:01.924563] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:04:01.924888] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-07T19:04:01.924958] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-07T19:04:01.925312] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-07T19:04:01.925410] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-07T19:04:02.161122] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T19:04:02.252942] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-07T19:04:02.381619] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:04:02.577159] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T19:04:03.047751] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-07T19:04:03.830391] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T19:04:03.832271] [INFO ] [REMOTE ] FVR: Full fetch complete (29969 records). [2025-10-07T19:04:03.832347] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-07T19:04:03.852816] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-07T19:04:04.032347] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T19:04:04.259997] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-07T19:04:04.260076] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-07T19:04:04.260581] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-07T19:04:04.260621] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-07T19:04:04.261952] [DEBUG] [LOCAL ] FVR: Trimmed 29969 records to 21680 (keeping 200 days of data) [2025-10-07T19:04:04.392037] [DEBUG] [LOCAL ] FVR: Primary data saved (21680 records). [2025-10-07T19:04:04.392166] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-07T19:04:04.392258] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FVR took 29.6s. Estimated remaining: 3h 27m 28s. Rate: 7.2 symbols/min [2025-10-07T19:04:04.560426] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:04:04.611606] [DEBUG] [LOCAL ] G: Loaded 49955 existing records from primary storage. [2025-10-07T19:04:04.611950] [INFO ] [MAIN ] G: Loaded 49955 existing records. [2025-10-07T19:04:04.653525] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-07T19:04:04.795802] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:04:04.796020] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-07T19:04:04.796067] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-07T19:04:04.797552] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-07T19:04:04.797612] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-07T19:04:05.150670] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:04:05.235027] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T19:04:05.447638] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-07T19:04:06.247736] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-07T19:04:06.487072] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T19:04:06.625722] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-07T19:04:06.825439] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T19:04:07.047640] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-07T19:04:07.497766] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T19:04:07.847705] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-07T19:04:08.647712] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-07T19:04:09.359162] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T19:04:09.400182] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T19:04:09.447622] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-07T19:04:10.247707] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-07T19:04:11.058282] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-07T19:04:11.088516] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T19:04:11.495014] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-07T19:04:11.847628] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-07T19:04:11.964977] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T19:04:12.269255] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-07T19:04:12.647693] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-07T19:04:13.447689] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-07T19:04:13.832733] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-07T19:04:13.899711] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T19:04:13.902205] [INFO ] [REMOTE ] FUL: Full fetch complete (47823 records). [2025-10-07T19:04:13.902302] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-07T19:04:14.254393] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-07T19:04:14.272209] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-07T19:04:14.272283] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-07T19:04:14.272959] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-07T19:04:14.273024] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-07T19:04:14.274420] [DEBUG] [LOCAL ] FUL: Trimmed 47823 records to 32878 (keeping 200 days of data) [2025-10-07T19:04:14.478317] [DEBUG] [LOCAL ] FUL: Primary data saved (32878 records). [2025-10-07T19:04:14.478458] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-07T19:04:14.478541] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FUL took 42.3s. Estimated remaining: 3h 27m 22s. Rate: 7.2 symbols/min [2025-10-07T19:04:14.641322] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:04:14.669128] [DEBUG] [LOCAL ] GAB: Loaded 27872 existing records from primary storage. [2025-10-07T19:04:14.669396] [INFO ] [MAIN ] GAB: Loaded 27872 existing records. [2025-10-07T19:04:14.844593] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:04:14.844863] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-07T19:04:14.844922] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-07T19:04:14.845993] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-07T19:04:14.846053] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-07T19:04:15.057673] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-07T19:04:15.191264] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:04:15.482304] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-07T19:04:15.815569] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T19:04:15.847601] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-07T19:04:16.647636] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-07T19:04:17.455059] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-07T19:04:17.457899] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T19:04:17.910612] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T19:04:18.247732] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-07T19:04:18.972964] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T19:04:19.047613] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-07T19:04:19.847758] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-07T19:04:19.972276] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T19:04:20.279332] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T19:04:20.297319] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T19:04:20.647691] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-07T19:04:21.447712] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-07T19:04:21.609435] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T19:04:22.247749] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-07T19:04:22.799514] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T19:04:23.047711] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-07T19:04:23.625589] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T19:04:23.847708] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-07T19:04:24.647681] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-07T19:04:24.763507] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T19:04:25.087572] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T19:04:25.239802] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T19:04:25.447622] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-07T19:04:26.247703] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-07T19:04:27.047670] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-07T19:04:27.231450] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T19:04:27.319394] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-07T19:04:27.847622] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-07T19:04:27.885610] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T19:04:28.647633] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-07T19:04:28.983366] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T19:04:29.447673] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-07T19:04:30.247638] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-07T19:04:30.299045] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T19:04:30.654826] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-07T19:04:30.655776] [INFO ] [REMOTE ] FXED: Full fetch complete (1808 records). [2025-10-07T19:04:30.670124] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-07T19:04:30.739712] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T19:04:31.041414] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-07T19:04:31.041491] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-07T19:04:31.041575] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-07T19:04:31.041614] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-07T19:04:31.041959] [DEBUG] [LOCAL ] FXED: Trimmed 1808 records to 1252 (keeping 200 days of data) [2025-10-07T19:04:31.048290] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-07T19:04:31.051127] [DEBUG] [LOCAL ] FXED: Primary data saved (1252 records). [2025-10-07T19:04:31.051186] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-07T19:04:31.051254] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 29.5s. Estimated remaining: 3h 27m 27s. Rate: 7.1 symbols/min [2025-10-07T19:04:31.220536] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:04:31.226127] [DEBUG] [LOCAL ] GAM: Loaded 4002 existing records from primary storage. [2025-10-07T19:04:31.226299] [INFO ] [MAIN ] GAM: Loaded 4002 existing records. [2025-10-07T19:04:31.408013] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:04:31.408220] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-07T19:04:31.408268] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-07T19:04:31.408571] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-07T19:04:31.408631] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-07T19:04:31.761937] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:04:31.847697] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-07T19:04:32.353434] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T19:04:32.516621] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T19:04:32.647696] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-07T19:04:33.447735] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-07T19:04:34.247721] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-07T19:04:34.500098] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T19:04:34.556229] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T19:04:34.845343] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-07T19:04:35.047680] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-07T19:04:35.847692] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-07T19:04:36.424589] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T19:04:36.647700] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-07T19:04:37.447624] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-07T19:04:37.475392] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T19:04:37.694355] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T19:04:37.696412] [INFO ] [REMOTE ] GAB: Full fetch complete (39565 records). [2025-10-07T19:04:37.696500] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-07T19:04:38.079801] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-07T19:04:38.079886] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-07T19:04:38.080448] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-07T19:04:38.080489] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-07T19:04:38.081379] [DEBUG] [LOCAL ] GAB: Trimmed 39565 records to 27802 (keeping 200 days of data) [2025-10-07T19:04:38.244704] [DEBUG] [LOCAL ] GAB: Primary data saved (27802 records). [2025-10-07T19:04:38.244838] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-07T19:04:38.244920] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. GAB took 23.8s. Estimated remaining: 3h 27m 17s. Rate: 7.1 symbols/min [2025-10-07T19:04:38.255934] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-07T19:04:38.417287] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:04:38.466853] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-07T19:04:38.467205] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-07T19:04:38.637897] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:04:38.638109] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-07T19:04:38.638156] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-07T19:04:38.640310] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-07T19:04:38.640372] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-07T19:04:39.000793] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-07T19:04:38.995200] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:04:39.047591] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-07T19:04:39.233742] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T19:04:39.847755] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-07T19:04:40.576046] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T19:04:40.647674] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-07T19:04:40.911820] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T19:04:41.447675] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-07T19:04:41.861946] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-07T19:04:42.120182] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T19:04:42.124337] [INFO ] [REMOTE ] FVRR: Full fetch complete (59151 records). [2025-10-07T19:04:42.124452] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-07T19:04:42.260954] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-07T19:04:42.515638] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-07T19:04:42.515763] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-07T19:04:42.517113] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-07T19:04:42.517180] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-07T19:04:42.519695] [DEBUG] [LOCAL ] FVRR: Trimmed 59151 records to 40180 (keeping 200 days of data) [2025-10-07T19:04:42.765154] [DEBUG] [LOCAL ] FVRR: Primary data saved (40180 records). [2025-10-07T19:04:42.765411] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-07T19:04:42.765521] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. FVRR took 44.1s. Estimated remaining: 3h 27m 2s. Rate: 7.1 symbols/min [2025-10-07T19:04:42.936491] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:04:42.959466] [DEBUG] [LOCAL ] GATX: Loaded 18134 existing records from primary storage. [2025-10-07T19:04:42.959837] [INFO ] [MAIN ] GATX: Loaded 18134 existing records. [2025-10-07T19:04:43.052789] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-07T19:04:43.143338] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:04:43.143601] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-07T19:04:43.143676] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-07T19:04:43.144333] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-07T19:04:43.144393] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-07T19:04:43.510931] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:04:43.847612] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-07T19:04:44.215188] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T19:04:44.647604] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-07T19:04:44.760542] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T19:04:44.944506] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T19:04:45.447683] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-07T19:04:46.252787] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-07T19:04:46.272151] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:04:47.047697] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-07T19:04:47.056240] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T19:04:47.201417] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T19:04:47.847708] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-07T19:04:48.647631] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-07T19:04:48.995631] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-07T19:04:49.250689] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T19:04:49.254191] [INFO ] [REMOTE ] G: Full fetch complete (71717 records). [2025-10-07T19:04:49.254311] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-07T19:04:49.367771] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T19:04:49.455470] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-07T19:04:49.657997] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-07T19:04:49.658098] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-07T19:04:49.658998] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-07T19:04:49.659063] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-07T19:04:49.660916] [DEBUG] [LOCAL ] G: Trimmed 71717 records to 49989 (keeping 200 days of data) [2025-10-07T19:04:49.977297] [DEBUG] [LOCAL ] G: Primary data saved (49989 records). [2025-10-07T19:04:49.977459] [INFO ] [MAIN ] G: Full history saved. [2025-10-07T19:04:49.977551] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. G took 45.6s. Estimated remaining: 3h 26m 52s. Rate: 7.1 symbols/min [2025-10-07T19:04:50.146260] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:04:50.152793] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T19:04:50.166435] [DEBUG] [LOCAL ] GBAB: Loaded 12982 existing records from primary storage. [2025-10-07T19:04:50.166674] [INFO ] [MAIN ] GBAB: Loaded 12982 existing records. [2025-10-07T19:04:50.252855] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-07T19:04:50.353530] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:04:50.354167] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-07T19:04:50.354230] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-07T19:04:50.355192] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-07T19:04:50.355256] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-07T19:04:50.713896] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:04:51.047687] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-07T19:04:51.691921] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-07T19:04:51.847616] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-07T19:04:52.295304] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T19:04:52.647629] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-07T19:04:52.848117] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T19:04:52.993639] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-07T19:04:53.447677] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-07T19:04:54.247639] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-07T19:04:54.368520] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T19:04:55.047693] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-07T19:04:55.278936] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T19:04:55.847694] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-07T19:04:56.647629] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-07T19:04:56.900001] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T19:04:57.075842] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T19:04:57.447699] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-07T19:04:57.517895] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T19:04:57.921749] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T19:04:57.922555] [INFO ] [REMOTE ] GAM: Full fetch complete (6688 records). [2025-10-07T19:04:57.922623] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-07T19:04:58.249101] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-07T19:04:58.277846] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-07T19:04:58.277969] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-07T19:04:58.278914] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-07T19:04:58.278977] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-07T19:04:58.279362] [DEBUG] [LOCAL ] GAM: Trimmed 6688 records to 4015 (keeping 200 days of data) [2025-10-07T19:04:58.304036] [DEBUG] [LOCAL ] GAM: Primary data saved (4015 records). [2025-10-07T19:04:58.304124] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-07T19:04:58.304211] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GAM took 27.3s. Estimated remaining: 3h 26m 43s. Rate: 7.1 symbols/min [2025-10-07T19:04:58.475475] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:04:58.512403] [DEBUG] [LOCAL ] GBCI: Loaded 40436 existing records from primary storage. [2025-10-07T19:04:58.512947] [INFO ] [MAIN ] GBCI: Loaded 40436 existing records. [2025-10-07T19:04:58.695192] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:04:58.695417] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-07T19:04:58.695465] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-07T19:04:58.696794] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-07T19:04:58.696856] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-07T19:04:59.050192] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-07T19:04:59.050055] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:04:59.388601] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T19:04:59.847721] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-07T19:05:00.647613] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-07T19:05:00.936111] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T19:05:01.447750] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-07T19:05:01.602291] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-07T19:05:02.247728] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-07T19:05:02.328780] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T19:05:02.450984] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T19:05:03.047706] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-07T19:05:03.847695] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-07T19:05:04.201733] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T19:05:04.283857] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T19:05:04.647786] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-07T19:05:05.447680] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-07T19:05:05.481810] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T19:05:06.247668] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-07T19:05:06.279462] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T19:05:06.554695] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T19:05:07.047634] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-07T19:05:07.246146] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T19:05:07.847687] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-07T19:05:08.235442] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T19:05:08.647629] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-07T19:05:08.792850] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T19:05:09.447708] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-07T19:05:10.141843] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T19:05:10.247636] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-07T19:05:10.358209] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T19:05:11.047639] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-07T19:05:11.740678] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T19:05:11.847701] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-07T19:05:12.647632] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-07T19:05:13.068281] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-07T19:05:13.310741] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T19:05:13.447623] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-07T19:05:13.645059] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T19:05:14.247696] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-07T19:05:14.952794] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T19:05:15.047673] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-07T19:05:15.243988] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T19:05:15.847731] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-07T19:05:16.647634] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-07T19:05:16.786209] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-07T19:05:16.790172] [INFO ] [REMOTE ] GAP: Full fetch complete (77633 records). [2025-10-07T19:05:16.790339] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-07T19:05:17.201239] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-07T19:05:17.201418] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-07T19:05:17.202446] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-07T19:05:17.202563] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-07T19:05:17.204413] [DEBUG] [LOCAL ] GAP: Trimmed 77633 records to 53653 (keeping 200 days of data) [2025-10-07T19:05:17.298761] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T19:05:17.473923] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-07T19:05:17.607265] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-07T19:05:17.607465] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-07T19:05:17.607579] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAP took 39.4s. Estimated remaining: 3h 26m 53s. Rate: 7.1 symbols/min [2025-10-07T19:05:17.779440] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:05:17.792868] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-07T19:05:17.793261] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T19:05:17.797746] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-07T19:05:17.798347] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-07T19:05:17.798697] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-07T19:05:17.798756] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-07T19:05:17.798791] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-07T19:05:18.143774] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:05:18.181122] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-07T19:05:18.247612] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-07T19:05:19.047680] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-07T19:05:19.109286] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T19:05:19.492209] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-07T19:05:19.847692] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-07T19:05:20.647693] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-07T19:05:20.685204] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-07T19:05:21.447686] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-07T19:05:21.688963] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T19:05:21.690790] [INFO ] [REMOTE ] GATX: Full fetch complete (25120 records). [2025-10-07T19:05:21.691410] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-07T19:05:22.059432] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-07T19:05:22.059512] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-07T19:05:22.060121] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-07T19:05:22.060185] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-07T19:05:22.060818] [DEBUG] [LOCAL ] GATX: Trimmed 25120 records to 18153 (keeping 200 days of data) [2025-10-07T19:05:22.156001] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T19:05:22.158145] [INFO ] [REMOTE ] GBAB: Full fetch complete (19564 records). [2025-10-07T19:05:22.158250] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-07T19:05:22.251872] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-07T19:05:22.476962] [DEBUG] [LOCAL ] GATX: Primary data saved (18153 records). [2025-10-07T19:05:22.479813] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-07T19:05:22.485429] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GATX took 39.7s. Estimated remaining: 3h 26m 39s. Rate: 7.1 symbols/min [2025-10-07T19:05:22.686595] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-07T19:05:22.697002] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-07T19:05:22.721079] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-07T19:05:22.728143] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-07T19:05:22.755558] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:05:22.756146] [DEBUG] [LOCAL ] GBAB: Trimmed 19564 records to 13001 (keeping 200 days of data) [2025-10-07T19:05:22.861745] [DEBUG] [LOCAL ] GBAB: Primary data saved (13001 records). [2025-10-07T19:05:22.862587] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-07T19:05:22.875006] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBAB took 32.9s. Estimated remaining: 3h 26m 17s. Rate: 7.2 symbols/min [2025-10-07T19:05:22.882840] [DEBUG] [LOCAL ] GBTG: Loaded 40019 existing records from primary storage. [2025-10-07T19:05:22.909671] [INFO ] [MAIN ] GBTG: Loaded 40019 existing records. [2025-10-07T19:05:23.060670] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-07T19:05:23.265525] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:05:23.302858] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:05:23.303176] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-07T19:05:23.303227] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-07T19:05:23.304289] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-07T19:05:23.304353] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-07T19:05:23.594224] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-07T19:05:23.583583] [DEBUG] [LOCAL ] GBX: Loaded 29064 existing records from primary storage. [2025-10-07T19:05:23.611004] [INFO ] [MAIN ] GBX: Loaded 29064 existing records. [2025-10-07T19:05:23.784251] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:05:23.850303] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-07T19:05:23.927508] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:05:23.927829] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-07T19:05:23.927970] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-07T19:05:23.937994] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-07T19:05:23.951613] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-07T19:05:24.024285] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T19:05:24.330194] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:05:24.647701] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-07T19:05:24.883758] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-07T19:05:25.454573] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-07T19:05:25.459552] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T19:05:26.247692] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-07T19:05:27.057567] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-07T19:05:27.060385] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T19:05:27.507533] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T19:05:27.847636] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-07T19:05:28.239932] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T19:05:28.647681] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-07T19:05:29.181934] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T19:05:29.185762] [INFO ] [REMOTE ] GBCI: Full fetch complete (58542 records). [2025-10-07T19:05:29.185922] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-07T19:05:29.458450] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-07T19:05:29.588011] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-07T19:05:29.588136] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-07T19:05:29.589346] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-07T19:05:29.589443] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-07T19:05:29.591224] [DEBUG] [LOCAL ] GBCI: Trimmed 58542 records to 40500 (keeping 200 days of data) [2025-10-07T19:05:29.848122] [DEBUG] [LOCAL ] GBCI: Primary data saved (40500 records). [2025-10-07T19:05:29.848256] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-07T19:05:29.848355] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBCI took 31.5s. Estimated remaining: 3h 26m 6s. Rate: 7.2 symbols/min [2025-10-07T19:05:30.027961] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:05:30.040492] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T19:05:30.087397] [DEBUG] [LOCAL ] GCI: Loaded 44118 existing records from primary storage. [2025-10-07T19:05:30.087741] [INFO ] [MAIN ] GCI: Loaded 44118 existing records. [2025-10-07T19:05:30.251158] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-07T19:05:30.264769] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:05:30.265627] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-07T19:05:30.265761] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-07T19:05:30.268058] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-07T19:05:30.268123] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-07T19:05:30.636824] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:05:30.655841] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T19:05:30.672538] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-07T19:05:31.047719] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-07T19:05:31.496901] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-07T19:05:31.847700] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-07T19:05:32.647608] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-07T19:05:32.932751] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T19:05:33.447683] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-07T19:05:34.155880] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T19:05:34.247634] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-07T19:05:34.901115] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T19:05:35.047627] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-07T19:05:35.770269] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T19:05:35.847621] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-07T19:05:36.494519] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T19:05:36.647698] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-07T19:05:37.010161] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-07T19:05:37.298491] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T19:05:37.447680] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-07T19:05:38.248306] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-07T19:05:38.509216] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-07T19:05:38.746279] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T19:05:39.047734] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-07T19:05:39.847725] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-07T19:05:40.447753] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T19:05:40.647671] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-07T19:05:41.268634] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T19:05:41.447633] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-07T19:05:42.175284] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:05:42.247603] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-07T19:05:43.035993] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T19:05:43.047590] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-07T19:05:43.602966] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T19:05:43.847685] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-07T19:05:44.148840] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-07T19:05:44.363539] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T19:05:44.647677] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-07T19:05:45.120720] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-07T19:05:45.447696] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-07T19:05:46.247763] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-07T19:05:46.898200] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T19:05:47.047712] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-07T19:05:47.392496] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-07T19:05:47.706964] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T19:05:47.847686] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-07T19:05:48.647689] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-07T19:05:49.447721] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-07T19:05:49.544872] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T19:05:50.247629] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-07T19:05:50.276786] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T19:05:50.892065] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T19:05:50.894846] [INFO ] [REMOTE ] GBTG: Full fetch complete (56608 records). [2025-10-07T19:05:50.894948] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-07T19:05:51.047748] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-07T19:05:51.289620] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-07T19:05:51.304064] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-07T19:05:51.305723] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-07T19:05:51.306351] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T19:05:51.311708] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-07T19:05:51.313661] [DEBUG] [LOCAL ] GBTG: Trimmed 56608 records to 40073 (keeping 200 days of data) [2025-10-07T19:05:51.537425] [DEBUG] [LOCAL ] GBTG: Primary data saved (40073 records). [2025-10-07T19:05:51.537561] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-07T19:05:51.537665] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBTG took 29.1s. Estimated remaining: 3h 26m 20s. Rate: 7.1 symbols/min [2025-10-07T19:05:51.704263] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:05:51.727434] [DEBUG] [LOCAL ] GCO: Loaded 24281 existing records from primary storage. [2025-10-07T19:05:51.727767] [INFO ] [MAIN ] GCO: Loaded 24281 existing records. [2025-10-07T19:05:51.852821] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-07T19:05:51.920968] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:05:51.921183] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-07T19:05:51.921229] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-07T19:05:51.922223] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-07T19:05:51.922283] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-07T19:05:52.305361] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-07T19:05:52.313248] [INFO ] [REMOTE ] GBLI: Full fetch complete (1324 records). [2025-10-07T19:05:52.311876] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:05:52.313699] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-07T19:05:52.508926] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-07T19:05:52.509349] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:05:52.509430] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:05:52.509517] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-07T19:05:52.509587] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-07T19:05:52.509623] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-07T19:05:52.509701] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-07T19:05:52.509777] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBLI took 34.9s. Estimated remaining: 3h 25m 59s. Rate: 7.1 symbols/min [2025-10-07T19:05:52.654682] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-07T19:05:52.689207] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:05:52.710289] [DEBUG] [LOCAL ] GCTS: Loaded 20127 existing records from primary storage. [2025-10-07T19:05:52.710612] [INFO ] [MAIN ] GCTS: Loaded 20127 existing records. [2025-10-07T19:05:52.913135] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:05:52.933049] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-07T19:05:52.933167] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-07T19:05:52.935766] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T19:05:52.935886] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-07T19:05:52.945483] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-07T19:05:53.295865] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:05:53.447694] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-07T19:05:53.921201] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T19:05:54.247764] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-07T19:05:55.053964] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-07T19:05:55.057278] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T19:05:55.281468] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T19:05:55.847627] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-07T19:05:56.125876] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T19:05:56.647766] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-07T19:05:57.421528] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T19:05:57.447603] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-07T19:05:58.112236] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T19:05:58.247737] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-07T19:05:58.555959] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T19:05:59.047625] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-07T19:05:59.300846] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T19:05:59.847683] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-07T19:06:00.179971] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T19:06:00.647623] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-07T19:06:00.969864] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T19:06:01.447686] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-07T19:06:02.118362] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T19:06:02.122748] [INFO ] [REMOTE ] GCI: Full fetch complete (63209 records). [2025-10-07T19:06:02.122966] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-07T19:06:02.261722] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-07T19:06:02.516768] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-07T19:06:02.517118] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-07T19:06:02.517976] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-07T19:06:02.518066] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-07T19:06:02.519531] [DEBUG] [LOCAL ] GCI: Trimmed 63209 records to 44112 (keeping 200 days of data) [2025-10-07T19:06:02.609324] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T19:06:02.617415] [INFO ] [REMOTE ] GBX: Full fetch complete (42787 records). [2025-10-07T19:06:02.630739] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-07T19:06:03.053288] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-07T19:06:03.150953] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-07T19:06:03.152061] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-07T19:06:03.153218] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-07T19:06:03.158907] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-07T19:06:03.182277] [DEBUG] [LOCAL ] GCI: Primary data saved (44112 records). [2025-10-07T19:06:03.182390] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-07T19:06:03.180411] [DEBUG] [LOCAL ] GBX: Trimmed 42787 records to 29133 (keeping 200 days of data) [2025-10-07T19:06:03.182547] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCI took 33.3s. Estimated remaining: 3h 25m 55s. Rate: 7.1 symbols/min [2025-10-07T19:06:03.394099] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T19:06:03.470853] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:06:03.482189] [DEBUG] [LOCAL ] GCV: Loaded 7525 existing records from primary storage. [2025-10-07T19:06:03.483044] [INFO ] [MAIN ] GCV: Loaded 7525 existing records. [2025-10-07T19:06:03.696443] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:06:03.697132] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-07T19:06:03.697562] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-07T19:06:03.698464] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-07T19:06:03.698921] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-07T19:06:03.849591] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-07T19:06:04.157124] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:06:04.161739] [DEBUG] [LOCAL ] GBX: Primary data saved (29133 records). [2025-10-07T19:06:04.161991] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-07T19:06:04.175037] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GBX took 41.3s. Estimated remaining: 3h 25m 34s. Rate: 7.2 symbols/min [2025-10-07T19:06:04.176444] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T19:06:04.359591] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:06:04.404581] [DEBUG] [LOCAL ] GD: Loaded 47000 existing records from primary storage. [2025-10-07T19:06:04.404938] [INFO ] [MAIN ] GD: Loaded 47000 existing records. [2025-10-07T19:06:04.583992] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:06:04.584233] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-07T19:06:04.584281] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-07T19:06:04.585304] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-07T19:06:04.585364] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-07T19:06:04.648024] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-07T19:06:04.872170] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-07T19:06:04.955609] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:06:05.276953] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-07T19:06:05.447692] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-07T19:06:06.247699] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-07T19:06:06.819147] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T19:06:07.047752] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-07T19:06:07.612391] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T19:06:07.847697] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-07T19:06:08.271914] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-07T19:06:08.647632] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-07T19:06:08.945267] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T19:06:09.243469] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T19:06:09.447675] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-07T19:06:10.247745] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-07T19:06:11.047772] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-07T19:06:11.354595] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-07T19:06:11.729563] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:06:11.847708] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-07T19:06:12.230116] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T19:06:12.451990] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T19:06:12.647743] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-07T19:06:13.325245] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T19:06:13.447631] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-07T19:06:14.247710] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-07T19:06:15.047633] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-07T19:06:15.260550] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T19:06:15.609571] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T19:06:15.724047] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-07T19:06:15.847696] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-07T19:06:16.471252] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T19:06:16.647694] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-07T19:06:17.447722] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-07T19:06:17.799836] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T19:06:18.077130] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T19:06:18.247682] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-07T19:06:19.047664] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-07T19:06:19.320038] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T19:06:19.847695] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-07T19:06:20.647636] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-07T19:06:20.899221] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T19:06:20.922042] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T19:06:21.447705] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-07T19:06:21.801286] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T19:06:22.247724] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-07T19:06:22.632930] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T19:06:22.696143] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-07T19:06:23.047732] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-07T19:06:23.847626] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-07T19:06:24.130631] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T19:06:24.647716] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-07T19:06:24.754504] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T19:06:24.756852] [INFO ] [REMOTE ] GCTS: Full fetch complete (27076 records). [2025-10-07T19:06:24.756963] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-07T19:06:25.213742] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-07T19:06:25.213859] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-07T19:06:25.214439] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-07T19:06:25.214506] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-07T19:06:25.215274] [DEBUG] [LOCAL ] GCTS: Trimmed 27076 records to 20339 (keeping 200 days of data) [2025-10-07T19:06:25.339458] [DEBUG] [LOCAL ] GCTS: Primary data saved (20339 records). [2025-10-07T19:06:25.339592] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-07T19:06:25.339692] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCTS took 32.8s. Estimated remaining: 3h 25m 47s. Rate: 7.1 symbols/min [2025-10-07T19:06:25.452819] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-07T19:06:25.513082] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:06:25.568451] [DEBUG] [LOCAL ] GDDY: Loaded 49828 existing records from primary storage. [2025-10-07T19:06:25.568832] [INFO ] [MAIN ] GDDY: Loaded 49828 existing records. [2025-10-07T19:06:25.752457] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:06:25.752761] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-07T19:06:25.752819] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-07T19:06:25.754282] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-07T19:06:25.754344] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-07T19:06:26.112723] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:06:26.247711] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-07T19:06:26.519132] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T19:06:26.556127] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T19:06:27.047776] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-07T19:06:27.676389] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T19:06:27.847721] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-07T19:06:28.147337] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T19:06:28.611849] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T19:06:28.647613] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-07T19:06:29.271345] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T19:06:29.272558] [INFO ] [REMOTE ] GCV: Full fetch complete (9560 records). [2025-10-07T19:06:29.272628] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-07T19:06:29.453849] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-07T19:06:29.636259] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-07T19:06:29.636338] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-07T19:06:29.636568] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-07T19:06:29.636607] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-07T19:06:29.637096] [DEBUG] [LOCAL ] GCV: Trimmed 9560 records to 7535 (keeping 200 days of data) [2025-10-07T19:06:29.684321] [DEBUG] [LOCAL ] GCV: Primary data saved (7535 records). [2025-10-07T19:06:29.684458] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-07T19:06:29.684555] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 26.5s. Estimated remaining: 3h 25m 32s. Rate: 7.1 symbols/min [2025-10-07T19:06:29.853019] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:06:29.858787] [DEBUG] [LOCAL ] GDIV: Loaded 3609 existing records from primary storage. [2025-10-07T19:06:29.858945] [INFO ] [MAIN ] GDIV: Loaded 3609 existing records. [2025-10-07T19:06:30.037707] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:06:30.038088] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-07T19:06:30.038160] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-07T19:06:30.038348] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-07T19:06:30.038406] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-07T19:06:30.252785] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-07T19:06:30.470241] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:06:31.047767] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-07T19:06:31.199427] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T19:06:31.703344] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T19:06:31.847701] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-07T19:06:32.073789] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T19:06:32.647688] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-07T19:06:33.447612] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-07T19:06:33.482567] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:06:33.646359] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T19:06:33.647957] [INFO ] [REMOTE ] GCO: Full fetch complete (35345 records). [2025-10-07T19:06:33.648035] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-07T19:06:34.014321] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-07T19:06:34.014433] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-07T19:06:34.015001] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-07T19:06:34.015065] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-07T19:06:34.015850] [DEBUG] [LOCAL ] GCO: Trimmed 35345 records to 24194 (keeping 200 days of data) [2025-10-07T19:06:34.165249] [DEBUG] [LOCAL ] GCO: Primary data saved (24194 records). [2025-10-07T19:06:34.165398] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-07T19:06:34.165504] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCO took 42.6s. Estimated remaining: 3h 25m 17s. Rate: 7.1 symbols/min [2025-10-07T19:06:34.254967] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-07T19:06:34.337279] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:06:34.341942] [DEBUG] [LOCAL ] GDL: Loaded 2554 existing records from primary storage. [2025-10-07T19:06:34.342185] [INFO ] [MAIN ] GDL: Loaded 2554 existing records. [2025-10-07T19:06:34.544619] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:06:34.544898] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-07T19:06:34.544971] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-07T19:06:34.545256] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-07T19:06:34.545316] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-07T19:06:34.908524] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-07T19:06:34.931838] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:06:35.047627] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-07T19:06:35.140683] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T19:06:35.519672] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-07T19:06:35.847629] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-07T19:06:36.647722] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-07T19:06:37.228392] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T19:06:37.447639] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-07T19:06:37.724811] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T19:06:38.247675] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-07T19:06:38.826500] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T19:06:38.881037] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T19:06:39.047697] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-07T19:06:39.847737] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-07T19:06:40.443796] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T19:06:40.647627] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-07T19:06:40.819035] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T19:06:40.964223] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-07T19:06:41.447675] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-07T19:06:41.911850] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T19:06:42.247683] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-07T19:06:42.833435] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T19:06:43.047678] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-07T19:06:43.662741] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T19:06:43.847675] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-07T19:06:44.402279] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-07T19:06:44.647684] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-07T19:06:45.112571] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-07T19:06:45.447665] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-07T19:06:46.247720] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-07T19:06:46.782795] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-07T19:06:47.047635] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-07T19:06:47.158298] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T19:06:47.847686] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-07T19:06:48.647727] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-07T19:06:48.779401] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:06:49.125440] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-07T19:06:49.452786] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-07T19:06:49.466483] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T19:06:49.781032] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-07T19:06:50.247718] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-07T19:06:50.706062] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T19:06:50.706910] [INFO ] [REMOTE ] GDIV: Full fetch complete (5467 records). [2025-10-07T19:06:50.706980] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-07T19:06:51.065423] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-07T19:06:51.111281] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-07T19:06:51.111350] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-07T19:06:51.111522] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-07T19:06:51.111579] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-07T19:06:51.112125] [DEBUG] [LOCAL ] GDIV: Trimmed 5467 records to 3613 (keeping 200 days of data) [2025-10-07T19:06:51.134875] [DEBUG] [LOCAL ] GDIV: Primary data saved (3613 records). [2025-10-07T19:06:51.134964] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-07T19:06:51.135044] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDIV took 21.5s. Estimated remaining: 3h 25m 22s. Rate: 7.1 symbols/min [2025-10-07T19:06:51.325731] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:06:51.333562] [DEBUG] [LOCAL ] GDO: Loaded 5937 existing records from primary storage. [2025-10-07T19:06:51.333748] [INFO ] [MAIN ] GDO: Loaded 5937 existing records. [2025-10-07T19:06:51.520816] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:06:51.521076] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-07T19:06:51.521127] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-07T19:06:51.521270] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-07T19:06:51.521311] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-07T19:06:51.856215] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-07T19:06:51.898197] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:06:52.373444] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-07T19:06:52.647635] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-07T19:06:52.724562] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T19:06:53.447723] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-07T19:06:54.238606] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T19:06:54.247590] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-07T19:06:54.327848] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T19:06:54.331283] [INFO ] [REMOTE ] GD: Full fetch complete (70074 records). [2025-10-07T19:06:54.331399] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-07T19:06:54.748377] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-07T19:06:54.748461] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-07T19:06:54.749371] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-07T19:06:54.749439] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-07T19:06:54.753532] [DEBUG] [LOCAL ] GD: Trimmed 70074 records to 46964 (keeping 200 days of data) [2025-10-07T19:06:54.954197] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-07T19:06:55.050698] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-07T19:06:55.065112] [DEBUG] [LOCAL ] GD: Primary data saved (46964 records). [2025-10-07T19:06:55.065213] [INFO ] [MAIN ] GD: Full history saved. [2025-10-07T19:06:55.065298] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GD took 50.9s. Estimated remaining: 3h 25m 7s. Rate: 7.1 symbols/min [2025-10-07T19:06:55.241513] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:06:55.280983] [DEBUG] [LOCAL ] GDOT: Loaded 38015 existing records from primary storage. [2025-10-07T19:06:55.281297] [INFO ] [MAIN ] GDOT: Loaded 38015 existing records. [2025-10-07T19:06:55.487285] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:06:55.487574] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-07T19:06:55.487626] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-07T19:06:55.487929] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-07T19:06:55.487987] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-07T19:06:55.855934] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-07T19:06:55.861841] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:06:56.647792] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-07T19:06:56.682030] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T19:06:56.723807] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T19:06:57.110285] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-07T19:06:57.447620] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-07T19:06:57.968374] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T19:06:58.247693] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-07T19:06:58.911747] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T19:06:59.047668] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-07T19:06:59.744670] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T19:06:59.847676] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-07T19:07:00.565793] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T19:07:00.647697] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-07T19:07:01.447708] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-07T19:07:01.568273] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T19:07:02.247709] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-07T19:07:02.878925] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T19:07:03.047633] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-07T19:07:03.441275] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T19:07:03.847736] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-07T19:07:03.874144] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T19:07:04.647685] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-07T19:07:05.279989] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-07T19:07:05.447704] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-07T19:07:05.530426] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T19:07:06.247700] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-07T19:07:06.750070] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T19:07:06.751148] [INFO ] [REMOTE ] GDO: Full fetch complete (8886 records). [2025-10-07T19:07:06.751233] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-07T19:07:06.837309] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T19:07:07.048079] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-07T19:07:07.129451] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-07T19:07:07.129526] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-07T19:07:07.129775] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-07T19:07:07.129837] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-07T19:07:07.130236] [DEBUG] [LOCAL ] GDO: Trimmed 8886 records to 5920 (keeping 200 days of data) [2025-10-07T19:07:07.165788] [DEBUG] [LOCAL ] GDO: Primary data saved (5920 records). [2025-10-07T19:07:07.165880] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-07T19:07:07.165960] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDO took 16.0s. Estimated remaining: 3h 25m 4s. Rate: 7.1 symbols/min [2025-10-07T19:07:07.329883] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:07:07.349208] [DEBUG] [LOCAL ] GDV: Loaded 19450 existing records from primary storage. [2025-10-07T19:07:07.349462] [INFO ] [MAIN ] GDV: Loaded 19450 existing records. [2025-10-07T19:07:07.527835] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:07:07.528116] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-07T19:07:07.528165] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-07T19:07:07.528443] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-07T19:07:07.528501] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-07T19:07:07.852853] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-07T19:07:07.882835] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:07:08.353517] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-07T19:07:08.647813] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-07T19:07:08.651030] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T19:07:08.654871] [INFO ] [REMOTE ] GDDY: Full fetch complete (71721 records). [2025-10-07T19:07:08.654988] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-07T19:07:09.061907] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-07T19:07:09.061991] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-07T19:07:09.062853] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-07T19:07:09.062919] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-07T19:07:09.064405] [DEBUG] [LOCAL ] GDDY: Trimmed 71721 records to 49795 (keeping 200 days of data) [2025-10-07T19:07:09.282525] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-07T19:07:09.379666] [DEBUG] [LOCAL ] GDDY: Primary data saved (49795 records). [2025-10-07T19:07:09.379820] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-07T19:07:09.379908] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDDY took 44.0s. Estimated remaining: 3h 24m 46s. Rate: 7.1 symbols/min [2025-10-07T19:07:09.452917] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-07T19:07:09.551325] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:07:09.604520] [DEBUG] [LOCAL ] GE: Loaded 53712 existing records from primary storage. [2025-10-07T19:07:09.604906] [INFO ] [MAIN ] GE: Loaded 53712 existing records. [2025-10-07T19:07:09.787057] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:07:09.787371] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-07T19:07:09.787440] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-07T19:07:09.787735] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-07T19:07:09.787794] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-07T19:07:10.136382] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:07:10.247624] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-07T19:07:10.864077] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T19:07:11.047699] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-07T19:07:11.847629] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-07T19:07:12.053502] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T19:07:12.399038] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-07T19:07:12.647722] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-07T19:07:13.071044] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T19:07:13.447687] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-07T19:07:14.247849] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-07T19:07:14.780283] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-07T19:07:15.050251] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-07T19:07:15.054341] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T19:07:15.101374] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T19:07:15.847699] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-07T19:07:16.447330] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T19:07:16.448174] [INFO ] [REMOTE ] GDL: Full fetch complete (3609 records). [2025-10-07T19:07:16.448259] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-07T19:07:16.656012] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-07T19:07:16.811070] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-07T19:07:16.811291] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-07T19:07:16.811481] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-07T19:07:16.811563] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-07T19:07:16.812226] [DEBUG] [LOCAL ] GDL: Trimmed 3609 records to 2551 (keeping 200 days of data) [2025-10-07T19:07:16.828592] [DEBUG] [LOCAL ] GDL: Primary data saved (2551 records). [2025-10-07T19:07:16.828699] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-07T19:07:16.828802] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDL took 42.7s. Estimated remaining: 3h 24m 36s. Rate: 7.1 symbols/min [2025-10-07T19:07:17.029437] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:07:17.031859] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-07T19:07:17.062613] [DEBUG] [LOCAL ] GEF: Loaded 20723 existing records from primary storage. [2025-10-07T19:07:17.062956] [INFO ] [MAIN ] GEF: Loaded 20723 existing records. [2025-10-07T19:07:17.237448] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:07:17.237872] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-07T19:07:17.237930] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-07T19:07:17.238165] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-07T19:07:17.238233] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-07T19:07:17.454942] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-07T19:07:17.595923] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:07:17.701056] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T19:07:18.247628] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-07T19:07:18.943369] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T19:07:19.047612] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-07T19:07:19.847719] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-07T19:07:20.299374] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-07T19:07:20.558783] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T19:07:20.647600] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-07T19:07:20.893238] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T19:07:21.447633] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-07T19:07:22.035618] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T19:07:22.247718] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-07T19:07:23.047692] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-07T19:07:23.313678] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T19:07:23.728077] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-07T19:07:23.847762] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-07T19:07:24.167453] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T19:07:24.647721] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-07T19:07:25.389312] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T19:07:25.447704] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-07T19:07:25.717104] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T19:07:26.247744] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-07T19:07:26.938831] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T19:07:27.047615] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-07T19:07:27.383604] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T19:07:27.847742] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-07T19:07:28.509746] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T19:07:28.647627] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-07T19:07:28.933737] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T19:07:29.447667] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-07T19:07:29.953464] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T19:07:29.956320] [INFO ] [REMOTE ] GDOT: Full fetch complete (53204 records). [2025-10-07T19:07:29.956444] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-07T19:07:30.252783] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-07T19:07:30.345920] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-07T19:07:30.346079] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-07T19:07:30.347438] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-07T19:07:30.347520] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-07T19:07:30.349548] [DEBUG] [LOCAL ] GDOT: Trimmed 53204 records to 37959 (keeping 200 days of data) [2025-10-07T19:07:30.571968] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T19:07:30.615247] [DEBUG] [LOCAL ] GDOT: Primary data saved (37959 records). [2025-10-07T19:07:30.615471] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-07T19:07:30.615591] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDOT took 35.5s. Estimated remaining: 3h 24m 36s. Rate: 7.1 symbols/min [2025-10-07T19:07:30.808158] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:07:30.808441] [DEBUG] [LOCAL ] GEL: No existing data file found in primary storage. [2025-10-07T19:07:30.808484] [WARN ] [MAIN ] GEL: No existing data found, performing full refresh instead. [2025-10-07T19:07:30.808620] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-07T19:07:30.808700] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-07T19:07:30.808760] [DEBUG] [LOCAL ] GEL: No primary data file found to delete. [2025-10-07T19:07:30.808797] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-07T19:07:31.054354] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-07T19:07:31.207075] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:07:31.847696] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-07T19:07:31.990145] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-07T19:07:32.653365] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-07T19:07:32.676970] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-07T19:07:32.966116] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T19:07:33.447611] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-07T19:07:33.754240] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T19:07:34.247683] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-07T19:07:35.047724] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-07T19:07:35.224375] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T19:07:35.443801] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T19:07:35.847740] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-07T19:07:36.204674] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T19:07:36.647739] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-07T19:07:37.334063] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T19:07:37.447633] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-07T19:07:37.747488] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T19:07:38.247666] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-07T19:07:38.452901] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T19:07:39.047743] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-07T19:07:39.847638] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-07T19:07:40.127952] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T19:07:40.309791] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-07T19:07:40.647700] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-07T19:07:40.716294] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T19:07:41.447678] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-07T19:07:42.247621] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-07T19:07:42.492042] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T19:07:42.636486] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T19:07:42.879889] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T19:07:43.047704] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-07T19:07:43.847737] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-07T19:07:44.105549] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-07T19:07:44.647692] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-07T19:07:45.447672] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-07T19:07:45.933599] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-07T19:07:46.245600] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T19:07:46.254238] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-07T19:07:46.292194] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T19:07:46.294043] [INFO ] [REMOTE ] GDV: Full fetch complete (28539 records). [2025-10-07T19:07:46.294118] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-07T19:07:46.657137] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-07T19:07:46.657216] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-07T19:07:46.657841] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-07T19:07:46.657919] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-07T19:07:46.658585] [DEBUG] [LOCAL ] GDV: Trimmed 28539 records to 19508 (keeping 200 days of data) [2025-10-07T19:07:46.782497] [DEBUG] [LOCAL ] GDV: Primary data saved (19508 records). [2025-10-07T19:07:46.782660] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-07T19:07:46.782766] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDV took 39.6s. Estimated remaining: 3h 24m 40s. Rate: 7.1 symbols/min [2025-10-07T19:07:46.949584] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:07:46.999662] [DEBUG] [LOCAL ] GENI: Loaded 52944 existing records from primary storage. [2025-10-07T19:07:46.999992] [INFO ] [MAIN ] GENI: Loaded 52944 existing records. [2025-10-07T19:07:47.054090] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-07T19:07:47.179082] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:07:47.179305] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-07T19:07:47.179391] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-07T19:07:47.179634] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-07T19:07:47.179721] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-07T19:07:47.526373] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:07:47.847668] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-07T19:07:48.102183] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T19:07:48.104031] [INFO ] [REMOTE ] GEF: Full fetch complete (29464 records). [2025-10-07T19:07:48.104144] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-07T19:07:48.402516] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-07T19:07:48.427850] [INFO ] [REMOTE ] GE: Full fetch complete (77777 records). [2025-10-07T19:07:48.443566] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-07T19:07:48.627102] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-07T19:07:48.638145] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-07T19:07:48.648558] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-07T19:07:48.670100] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-07T19:07:48.683155] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-07T19:07:48.775153] [DEBUG] [LOCAL ] GEF: Trimmed 29464 records to 20741 (keeping 200 days of data) [2025-10-07T19:07:49.066104] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-07T19:07:49.067703] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-07T19:07:49.072227] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-07T19:07:49.072325] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-07T19:07:49.085757] [DEBUG] [LOCAL ] GE: Trimmed 77777 records to 53712 (keeping 200 days of data) [2025-10-07T19:07:49.193814] [DEBUG] [LOCAL ] GEF: Primary data saved (20741 records). [2025-10-07T19:07:49.195015] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-07T19:07:49.196232] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEF took 32.4s. Estimated remaining: 3h 24m 22s. Rate: 7.1 symbols/min [2025-10-07T19:07:49.384448] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:07:49.416724] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T19:07:49.459560] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-07T19:07:49.563841] [DEBUG] [LOCAL ] GEO: Loaded 51904 existing records from primary storage. [2025-10-07T19:07:49.591754] [INFO ] [MAIN ] GEO: Loaded 51904 existing records. [2025-10-07T19:07:49.782380] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:07:49.783782] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-07T19:07:49.784038] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-07T19:07:49.785635] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-07T19:07:49.786473] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-07T19:07:50.130301] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:07:50.248687] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-07T19:07:50.319636] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:07:50.355260] [DEBUG] [LOCAL ] GE: Primary data saved (53712 records). [2025-10-07T19:07:50.355498] [INFO ] [MAIN ] GE: Full history saved. [2025-10-07T19:07:50.357388] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GE took 41.0s. Estimated remaining: 3h 24m 2s. Rate: 7.1 symbols/min [2025-10-07T19:07:50.530856] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:07:50.579591] [DEBUG] [LOCAL ] GES: Loaded 38989 existing records from primary storage. [2025-10-07T19:07:50.580105] [INFO ] [MAIN ] GES: Loaded 38989 existing records. [2025-10-07T19:07:50.767195] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:07:50.767845] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-07T19:07:50.767942] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-07T19:07:50.768216] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-07T19:07:50.768280] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-07T19:07:51.055686] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-07T19:07:51.153498] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:07:51.183105] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T19:07:51.693235] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T19:07:51.847684] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-07T19:07:52.647704] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-07T19:07:52.944708] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T19:07:53.447697] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-07T19:07:53.453165] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T19:07:53.660199] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T19:07:54.247747] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-07T19:07:55.047739] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-07T19:07:55.240411] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-07T19:07:55.629987] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T19:07:55.847639] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-07T19:07:56.200311] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T19:07:56.647701] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-07T19:07:57.447673] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-07T19:07:57.641889] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T19:07:58.101274] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T19:07:58.247705] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-07T19:07:59.047635] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-07T19:07:59.238161] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T19:07:59.347608] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T19:07:59.847691] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-07T19:08:00.584076] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T19:08:00.647702] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-07T19:08:01.448770] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-07T19:08:01.448685] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T19:08:02.247627] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-07T19:08:02.427126] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T19:08:02.429020] [INFO ] [REMOTE ] GEL: Full fetch complete (48285 records). [2025-10-07T19:08:02.429102] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-07T19:08:02.816809] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-07T19:08:02.870713] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-07T19:08:02.870797] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-07T19:08:02.871602] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-07T19:08:02.871669] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-07T19:08:02.872725] [DEBUG] [LOCAL ] GEL: Trimmed 48285 records to 32496 (keeping 200 days of data) [2025-10-07T19:08:03.052772] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-07T19:08:03.074889] [DEBUG] [LOCAL ] GEL: Primary data saved (32496 records). [2025-10-07T19:08:03.075060] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-07T19:08:03.075145] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEL took 32.5s. Estimated remaining: 3h 24m 1s. Rate: 7.1 symbols/min [2025-10-07T19:08:03.252554] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:08:03.289231] [DEBUG] [LOCAL ] GETY: Loaded 35319 existing records from primary storage. [2025-10-07T19:08:03.289540] [INFO ] [MAIN ] GETY: Loaded 35319 existing records. [2025-10-07T19:08:03.473281] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:08:03.473559] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-07T19:08:03.473608] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-07T19:08:03.473930] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-07T19:08:03.473990] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-07T19:08:03.840550] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:08:03.847598] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-07T19:08:04.054909] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T19:08:04.647673] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-07T19:08:04.931052] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T19:08:05.205535] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T19:08:05.447674] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-07T19:08:06.247628] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-07T19:08:06.324616] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T19:08:07.047636] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-07T19:08:07.180725] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:08:07.847621] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-07T19:08:08.178858] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T19:08:08.647626] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-07T19:08:08.772007] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T19:08:09.447628] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-07T19:08:09.584711] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T19:08:10.247724] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-07T19:08:10.388242] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T19:08:10.968605] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T19:08:11.047710] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-07T19:08:11.847627] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-07T19:08:12.094101] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T19:08:12.627500] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T19:08:12.647609] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-07T19:08:13.447637] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-07T19:08:13.686160] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T19:08:14.247688] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-07T19:08:14.374967] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T19:08:15.047636] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-07T19:08:15.385795] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T19:08:15.444267] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T19:08:15.847686] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-07T19:08:16.527070] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T19:08:16.647687] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-07T19:08:17.447620] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-07T19:08:17.782442] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T19:08:18.007169] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T19:08:18.247687] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-07T19:08:19.027685] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T19:08:19.047619] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-07T19:08:19.509673] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T19:08:19.847765] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-07T19:08:20.636964] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T19:08:20.640878] [INFO ] [REMOTE ] GENI: Full fetch complete (75562 records). [2025-10-07T19:08:20.641022] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-07T19:08:20.653760] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-07T19:08:21.044553] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-07T19:08:21.044728] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-07T19:08:21.045623] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-07T19:08:21.045705] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-07T19:08:21.047281] [DEBUG] [LOCAL ] GENI: Trimmed 75562 records to 52945 (keeping 200 days of data) [2025-10-07T19:08:21.364688] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T19:08:21.390551] [DEBUG] [LOCAL ] GENI: Primary data saved (52945 records). [2025-10-07T19:08:21.390766] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-07T19:08:21.390849] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GENI took 34.6s. Estimated remaining: 3h 24m 8s. Rate: 7.1 symbols/min [2025-10-07T19:08:21.452770] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-07T19:08:21.561169] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:08:21.612190] [DEBUG] [LOCAL ] GEV: Loaded 53024 existing records from primary storage. [2025-10-07T19:08:21.612512] [INFO ] [MAIN ] GEV: Loaded 53024 existing records. [2025-10-07T19:08:21.787486] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:08:21.787718] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-07T19:08:21.787774] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-07T19:08:21.788159] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-07T19:08:21.788218] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-07T19:08:22.119890] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T19:08:22.167161] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:08:22.247608] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-07T19:08:23.047705] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-07T19:08:23.085052] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T19:08:23.736483] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T19:08:23.847624] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-07T19:08:24.647728] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-07T19:08:25.225705] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-07T19:08:25.272557] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T19:08:25.447701] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-07T19:08:26.184519] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T19:08:26.247677] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-07T19:08:26.842277] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T19:08:27.047697] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-07T19:08:27.277705] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T19:08:27.847677] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-07T19:08:28.647773] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-07T19:08:29.241758] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-07T19:08:29.390603] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T19:08:29.397571] [INFO ] [REMOTE ] GEO: Full fetch complete (75455 records). [2025-10-07T19:08:29.397747] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-07T19:08:29.459136] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-07T19:08:29.710206] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T19:08:29.762828] [INFO ] [REMOTE ] GETY: Full fetch complete (55487 records). [2025-10-07T19:08:29.776707] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-07T19:08:29.897019] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-07T19:08:29.918038] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-07T19:08:29.919143] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-07T19:08:29.919545] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-07T19:08:29.987807] [DEBUG] [LOCAL ] GEO: Trimmed 75455 records to 51896 (keeping 200 days of data) [2025-10-07T19:08:30.248061] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-07T19:08:30.313703] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-07T19:08:30.315114] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-07T19:08:30.316634] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-07T19:08:30.317075] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-07T19:08:30.323766] [DEBUG] [LOCAL ] GETY: Trimmed 55487 records to 35311 (keeping 200 days of data) [2025-10-07T19:08:30.739094] [DEBUG] [LOCAL ] GETY: Primary data saved (35311 records). [2025-10-07T19:08:30.739572] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-07T19:08:30.740310] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GETY took 27.7s. Estimated remaining: 3h 24m 1s. Rate: 7.1 symbols/min [2025-10-07T19:08:30.919771] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:08:30.923082] [DEBUG] [LOCAL ] GEO: Primary data saved (51896 records). [2025-10-07T19:08:30.923250] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-07T19:08:30.923370] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GEO took 41.7s. Estimated remaining: 3h 23m 40s. Rate: 7.1 symbols/min [2025-10-07T19:08:30.928165] [DEBUG] [LOCAL ] GF: Loaded 2827 existing records from primary storage. [2025-10-07T19:08:30.928334] [INFO ] [MAIN ] GF: Loaded 2827 existing records. [2025-10-07T19:08:31.108775] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:08:31.109032] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-07T19:08:31.109083] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-07T19:08:31.109270] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-07T19:08:31.109328] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-07T19:08:31.415512] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T19:08:31.474833] [INFO ] [REMOTE ] GES: Full fetch complete (59168 records). [2025-10-07T19:08:31.502354] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-07T19:08:31.707818] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:08:31.771247] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-07T19:08:31.778900] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-07T19:08:31.847732] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-07T19:08:32.205473] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-07T19:08:32.205598] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-07T19:08:32.206498] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-07T19:08:32.206568] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-07T19:08:32.210282] [DEBUG] [LOCAL ] GES: Trimmed 59168 records to 38833 (keeping 200 days of data) [2025-10-07T19:08:32.434723] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T19:08:32.471779] [DEBUG] [LOCAL ] GES: Primary data saved (38833 records). [2025-10-07T19:08:32.471946] [INFO ] [MAIN ] GES: Full history saved. [2025-10-07T19:08:32.472037] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GES took 42.1s. Estimated remaining: 3h 23m 20s. Rate: 7.1 symbols/min [2025-10-07T19:08:32.647797] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-07T19:08:33.123132] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T19:08:33.447679] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-07T19:08:34.036694] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T19:08:34.211478] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-07T19:08:34.247598] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-07T19:08:35.047744] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-07T19:08:35.803459] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-07T19:08:35.847601] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-07T19:08:36.183428] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-07T19:08:36.656394] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-07T19:08:36.659427] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-07T19:08:37.265071] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T19:08:37.447638] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-07T19:08:37.994522] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-07T19:08:38.247676] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-07T19:08:38.706681] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T19:08:39.047727] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-07T19:08:39.522488] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-07T19:08:39.847686] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-07T19:08:40.316269] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-07T19:08:40.647775] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-07T19:08:41.447769] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-07T19:08:41.857623] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-07T19:08:41.858353] [INFO ] [REMOTE ] GF: Full fetch complete (5073 records). [2025-10-07T19:08:41.858422] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-07T19:08:42.204891] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-07T19:08:42.204970] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-07T19:08:42.205112] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-07T19:08:42.205150] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-07T19:08:42.205492] [DEBUG] [LOCAL ] GF: Trimmed 5073 records to 2801 (keeping 200 days of data) [2025-10-07T19:08:42.222941] [DEBUG] [LOCAL ] GF: Primary data saved (2801 records). [2025-10-07T19:08:42.223006] [INFO ] [MAIN ] GF: Full history saved. [2025-10-07T19:08:42.223089] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 11.5s. Estimated remaining: 3h 23m 14s. Rate: 7.1 symbols/min [2025-10-07T19:08:43.016617] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-07T19:08:43.027997] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-07T19:08:45.330136] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-07T19:08:45.341075] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-07T19:08:47.884536] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-07T19:08:47.900410] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-07T19:08:50.321092] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-07T19:08:50.332539] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-07T19:08:52.816630] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-07T19:08:52.828018] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-07T19:08:55.048953] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-07T19:08:55.053170] [INFO ] [REMOTE ] GEV: Full fetch complete (76909 records). [2025-10-07T19:08:55.053315] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-07T19:08:55.471993] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-07T19:08:55.472107] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-07T19:08:55.473105] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-07T19:08:55.473174] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-07T19:08:55.474680] [DEBUG] [LOCAL ] GEV: Trimmed 76909 records to 53018 (keeping 200 days of data) [2025-10-07T19:08:55.814029] [DEBUG] [LOCAL ] GEV: Primary data saved (53018 records). [2025-10-07T19:08:55.814185] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-07T19:08:55.814270] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 34.4s. Estimated remaining: 3h 23m 14s. Rate: 7.1 symbols/min [2025-10-07T19:08:56.346013] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:08:56.435176] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:08:56.505181] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:08:56.527458] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:08:56.532520] [DEBUG] [LOCAL ] GFR: Loaded 8022 existing records from primary storage. [2025-10-07T19:08:56.532738] [INFO ] [MAIN ] GFR: Loaded 8022 existing records. [2025-10-07T19:08:56.749135] [DEBUG] [LOCAL ] GFF: Loaded 30332 existing records from primary storage. [2025-10-07T19:08:56.763556] [INFO ] [MAIN ] GFF: Loaded 30332 existing records. [2025-10-07T19:08:56.788879] [DEBUG] [LOCAL ] GFI: Loaded 53100 existing records from primary storage. [2025-10-07T19:08:56.799697] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:08:56.809354] [INFO ] [MAIN ] GFI: Loaded 53100 existing records. [2025-10-07T19:08:56.861536] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-07T19:08:56.861787] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-07T19:08:56.954940] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-07T19:08:56.975444] [DEBUG] [LOCAL ] GFL: Loaded 47867 existing records from primary storage. [2025-10-07T19:08:56.975613] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-07T19:08:57.002329] [INFO ] [MAIN ] GFL: Loaded 47867 existing records. [2025-10-07T19:08:57.217886] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:08:57.254246] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-07T19:08:57.264759] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-07T19:08:57.373664] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-07T19:08:57.409554] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-07T19:08:57.418738] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:08:57.473024] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-07T19:08:57.487546] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-07T19:08:57.604536] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-07T19:08:57.640197] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-07T19:08:57.655123] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:08:57.795738] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-07T19:08:57.868428] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-07T19:08:57.906553] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-07T19:08:57.925537] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-07T19:08:58.252006] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:08:58.302718] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-07T19:08:58.801422] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:08:58.863498] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-07T19:08:58.869067] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:08:58.886679] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-07T19:08:58.964161] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:08:58.964484] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-07T19:08:59.444170] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T19:08:59.447485] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-07T19:08:59.939196] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-07T19:08:59.941959] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-07T19:08:59.958829] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T19:08:59.964860] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-07T19:09:00.161298] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T19:09:00.170393] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-07T19:09:00.377073] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T19:09:00.387548] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-07T19:09:00.470428] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-07T19:09:00.472700] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-07T19:09:01.003342] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T19:09:01.006694] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-07T19:09:01.258363] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T19:09:01.264981] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-07T19:09:01.488221] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T19:09:01.497824] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-07T19:09:01.532301] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T19:09:01.536340] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-07T19:09:02.314098] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T19:09:02.324707] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-07T19:09:02.365376] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T19:09:02.368825] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-07T19:09:02.534125] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T19:09:02.540946] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-07T19:09:02.827032] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-07T19:09:02.829444] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-07T19:09:03.027205] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T19:09:03.037409] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-07T19:09:03.429276] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-07T19:09:03.431745] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-07T19:09:03.903147] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T19:09:03.911768] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-07T19:09:04.002858] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T19:09:04.013228] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-07T19:09:04.026955] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T19:09:04.029423] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-07T19:09:04.300183] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T19:09:04.647778] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-07T19:09:04.737451] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T19:09:04.989485] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T19:09:05.447772] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-07T19:09:06.071455] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T19:09:06.072604] [INFO ] [REMOTE ] GFR: Full fetch complete (12438 records). [2025-10-07T19:09:06.072704] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-07T19:09:06.257805] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-07T19:09:06.405934] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-07T19:09:06.528802] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-07T19:09:06.528921] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-07T19:09:06.529379] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-07T19:09:06.529461] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-07T19:09:06.554786] [DEBUG] [LOCAL ] GFR: Trimmed 12438 records to 8002 (keeping 200 days of data) [2025-10-07T19:09:06.587377] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T19:09:06.632684] [DEBUG] [LOCAL ] GFR: Primary data saved (8002 records). [2025-10-07T19:09:06.632905] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-07T19:09:06.633018] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 10.8s. Estimated remaining: 3h 23m 9s. Rate: 7.1 symbols/min [2025-10-07T19:09:06.817628] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:09:06.873002] [DEBUG] [LOCAL ] GGB: Loaded 51155 existing records from primary storage. [2025-10-07T19:09:06.873513] [INFO ] [MAIN ] GGB: Loaded 51155 existing records. [2025-10-07T19:09:07.047808] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-07T19:09:07.072525] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:09:07.074182] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-07T19:09:07.074241] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-07T19:09:07.074516] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-07T19:09:07.074576] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-07T19:09:07.470685] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:09:07.815470] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T19:09:07.847604] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-07T19:09:08.647660] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-07T19:09:09.026371] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T19:09:09.206972] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-07T19:09:09.447731] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-07T19:09:10.247744] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-07T19:09:10.336753] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T19:09:11.047695] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-07T19:09:11.449974] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T19:09:11.847765] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-07T19:09:11.979536] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T19:09:12.293613] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T19:09:12.647706] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-07T19:09:13.447637] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-07T19:09:13.724368] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-07T19:09:14.247705] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-07T19:09:14.312021] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T19:09:14.844875] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T19:09:15.047688] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-07T19:09:15.807839] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T19:09:15.847624] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-07T19:09:16.647733] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-07T19:09:16.764900] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T19:09:17.089552] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-07T19:09:17.447670] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-07T19:09:18.247697] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-07T19:09:18.626392] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T19:09:19.004540] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T19:09:19.047633] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-07T19:09:19.379530] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T19:09:19.847685] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-07T19:09:20.647628] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-07T19:09:20.857456] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T19:09:20.859607] [INFO ] [REMOTE ] GFF: Full fetch complete (44195 records). [2025-10-07T19:09:20.859814] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-07T19:09:21.278138] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-07T19:09:21.280609] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-07T19:09:21.290946] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-07T19:09:21.292246] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-07T19:09:21.292353] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-07T19:09:21.293978] [DEBUG] [LOCAL ] GFF: Trimmed 44195 records to 30268 (keeping 200 days of data) [2025-10-07T19:09:21.449242] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-07T19:09:21.491934] [DEBUG] [LOCAL ] GFF: Primary data saved (30268 records). [2025-10-07T19:09:21.492105] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-07T19:09:21.492200] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 25.7s. Estimated remaining: 3h 23m 11s. Rate: 7.1 symbols/min [2025-10-07T19:09:21.669300] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:09:21.707892] [DEBUG] [LOCAL ] GGG: Loaded 40905 existing records from primary storage. [2025-10-07T19:09:21.708225] [INFO ] [MAIN ] GGG: Loaded 40905 existing records. [2025-10-07T19:09:21.883146] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:09:21.883396] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-07T19:09:21.883444] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-07T19:09:21.883697] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-07T19:09:21.883754] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-07T19:09:22.249299] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-07T19:09:22.253494] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:09:22.703397] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-07T19:09:23.047749] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-07T19:09:23.584489] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-07T19:09:23.847750] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-07T19:09:23.945959] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T19:09:24.146978] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T19:09:24.153769] [INFO ] [REMOTE ] GFL: Full fetch complete (69304 records). [2025-10-07T19:09:24.153972] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-07T19:09:24.647824] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-07T19:09:24.680163] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-07T19:09:24.680322] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-07T19:09:24.681931] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-07T19:09:24.682216] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-07T19:09:24.684474] [DEBUG] [LOCAL ] GFL: Trimmed 69304 records to 47875 (keeping 200 days of data) [2025-10-07T19:09:25.019202] [DEBUG] [LOCAL ] GFL: Primary data saved (47875 records). [2025-10-07T19:09:25.019412] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-07T19:09:25.019548] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 29.2s. Estimated remaining: 3h 22m 55s. Rate: 7.1 symbols/min [2025-10-07T19:09:25.185766] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:09:25.201190] [DEBUG] [LOCAL ] GGT: Loaded 14104 existing records from primary storage. [2025-10-07T19:09:25.201452] [INFO ] [MAIN ] GGT: Loaded 14104 existing records. [2025-10-07T19:09:25.376230] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:09:25.376526] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-07T19:09:25.376583] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-07T19:09:25.377205] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-07T19:09:25.377266] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-07T19:09:25.452936] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-07T19:09:25.729961] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:09:25.750520] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-07T19:09:25.754920] [INFO ] [REMOTE ] GFI: Full fetch complete (76468 records). [2025-10-07T19:09:25.755036] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-07T19:09:26.137885] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-07T19:09:26.137987] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-07T19:09:26.138936] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-07T19:09:26.139004] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-07T19:09:26.140810] [DEBUG] [LOCAL ] GFI: Trimmed 76468 records to 53101 (keeping 200 days of data) [2025-10-07T19:09:26.249688] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-07T19:09:26.491879] [DEBUG] [LOCAL ] GFI: Primary data saved (53101 records). [2025-10-07T19:09:26.502135] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-07T19:09:26.502263] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 30.7s. Estimated remaining: 3h 22m 36s. Rate: 7.1 symbols/min [2025-10-07T19:09:26.526734] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T19:09:26.691804] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:09:26.697129] [DEBUG] [LOCAL ] GGZ: Loaded 2424 existing records from primary storage. [2025-10-07T19:09:26.697433] [INFO ] [MAIN ] GGZ: Loaded 2424 existing records. [2025-10-07T19:09:26.881210] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:09:26.881576] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-07T19:09:26.881638] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-07T19:09:26.881866] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-07T19:09:26.881924] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-07T19:09:27.055563] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-07T19:09:27.118165] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T19:09:27.234576] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T19:09:27.309337] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:09:27.847721] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-07T19:09:28.569582] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T19:09:28.647782] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-07T19:09:28.877950] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T19:09:29.447737] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-07T19:09:30.103363] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T19:09:30.175613] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T19:09:30.247610] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-07T19:09:31.047754] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-07T19:09:31.738361] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-07T19:09:31.762164] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:09:31.847693] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-07T19:09:32.647684] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-07T19:09:33.447611] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-07T19:09:33.550217] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T19:09:33.849773] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T19:09:34.065156] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-07T19:09:34.247728] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-07T19:09:34.740481] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T19:09:35.047676] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-07T19:09:35.847688] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-07T19:09:36.647632] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-07T19:09:36.689826] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T19:09:37.128368] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T19:09:37.447637] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-07T19:09:37.527410] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T19:09:37.927788] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-07T19:09:38.247744] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-07T19:09:39.047700] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-07T19:09:39.847721] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-07T19:09:39.985609] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T19:09:40.024828] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T19:09:40.647733] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-07T19:09:41.382051] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:09:41.447612] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-07T19:09:41.970525] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T19:09:42.247708] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-07T19:09:42.807054] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T19:09:42.906689] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T19:09:43.047621] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-07T19:09:43.548321] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-07T19:09:43.847695] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-07T19:09:44.305840] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-07T19:09:44.647706] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-07T19:09:45.447676] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-07T19:09:46.179820] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T19:09:46.183792] [INFO ] [REMOTE ] GGB: Full fetch complete (74099 records). [2025-10-07T19:09:46.183964] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-07T19:09:46.252746] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-07T19:09:46.612199] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-07T19:09:46.612284] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-07T19:09:46.613183] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-07T19:09:46.613251] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-07T19:09:46.614784] [DEBUG] [LOCAL ] GGB: Trimmed 74099 records to 51168 (keeping 200 days of data) [2025-10-07T19:09:46.934950] [DEBUG] [LOCAL ] GGB: Primary data saved (51168 records). [2025-10-07T19:09:46.935103] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-07T19:09:46.935191] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGB took 40.3s. Estimated remaining: 3h 22m 46s. Rate: 7.1 symbols/min [2025-10-07T19:09:47.051474] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-07T19:09:47.139158] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T19:09:47.137054] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:09:47.147821] [DEBUG] [LOCAL ] GHC: No existing data file found in primary storage. [2025-10-07T19:09:47.155442] [WARN ] [MAIN ] GHC: No existing data found, performing full refresh instead. [2025-10-07T19:09:47.156677] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-07T19:09:47.156789] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-07T19:09:47.156439] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T19:09:47.159855] [DEBUG] [LOCAL ] GHC: No primary data file found to delete. [2025-10-07T19:09:47.160289] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-07T19:09:47.506903] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:09:47.546554] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-07T19:09:47.847685] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-07T19:09:48.647693] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-07T19:09:48.851419] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T19:09:49.447738] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-07T19:09:49.831341] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-07T19:09:49.854021] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T19:09:50.247701] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-07T19:09:50.688910] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-07T19:09:51.047676] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-07T19:09:51.561257] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-07T19:09:51.847681] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-07T19:09:52.647618] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-07T19:09:52.908760] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T19:09:53.157634] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-07T19:09:53.447691] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-07T19:09:53.957042] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T19:09:53.957922] [INFO ] [REMOTE ] GGZ: Full fetch complete (4119 records). [2025-10-07T19:09:53.957993] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-07T19:09:54.252902] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-07T19:09:54.326614] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-07T19:09:54.326743] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-07T19:09:54.326945] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-07T19:09:54.327021] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-07T19:09:54.327479] [DEBUG] [LOCAL ] GGZ: Trimmed 4119 records to 2428 (keeping 200 days of data) [2025-10-07T19:09:54.343043] [DEBUG] [LOCAL ] GGZ: Primary data saved (2428 records). [2025-10-07T19:09:54.343121] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-07T19:09:54.343222] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGZ took 27.8s. Estimated remaining: 3h 22m 36s. Rate: 7.1 symbols/min [2025-10-07T19:09:54.508511] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:09:54.515185] [DEBUG] [LOCAL ] GHG: Loaded 3180 existing records from primary storage. [2025-10-07T19:09:54.515474] [INFO ] [MAIN ] GHG: Loaded 3180 existing records. [2025-10-07T19:09:54.691288] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:09:54.691525] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-07T19:09:54.691575] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-07T19:09:54.691726] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-07T19:09:54.691788] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-07T19:09:55.040196] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:09:55.047601] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-07T19:09:55.286069] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T19:09:55.488750] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-07T19:09:55.847752] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-07T19:09:56.204387] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-07T19:09:56.647683] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-07T19:09:57.447688] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-07T19:09:58.085668] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T19:09:58.111504] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T19:09:58.247677] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-07T19:09:59.047724] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-07T19:09:59.526059] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T19:09:59.532965] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-07T19:09:59.534534] [INFO ] [REMOTE ] GGG: Full fetch complete (59434 records). [2025-10-07T19:09:59.534636] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-07T19:09:59.852808] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-07T19:09:59.960003] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-07T19:09:59.960087] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-07T19:09:59.960860] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-07T19:09:59.961043] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-07T19:09:59.962331] [DEBUG] [LOCAL ] GGG: Trimmed 59434 records to 40843 (keeping 200 days of data) [2025-10-07T19:10:00.217015] [DEBUG] [LOCAL ] GGG: Primary data saved (40843 records). [2025-10-07T19:10:00.217173] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-07T19:10:00.217267] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGG took 38.7s. Estimated remaining: 3h 22m 24s. Rate: 7.1 symbols/min [2025-10-07T19:10:00.388293] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:10:00.398588] [DEBUG] [LOCAL ] GHI: Loaded 7131 existing records from primary storage. [2025-10-07T19:10:00.398845] [INFO ] [MAIN ] GHI: Loaded 7131 existing records. [2025-10-07T19:10:00.497839] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T19:10:00.607242] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:10:00.607553] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-07T19:10:00.607603] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-07T19:10:00.607924] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-07T19:10:00.607982] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-07T19:10:00.652799] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-07T19:10:00.953006] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:10:01.447623] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-07T19:10:01.854032] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T19:10:02.247714] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-07T19:10:02.420779] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T19:10:02.674956] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-07T19:10:03.047721] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-07T19:10:03.516934] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T19:10:03.847686] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-07T19:10:04.647693] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-07T19:10:04.902272] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T19:10:05.447669] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-07T19:10:05.460684] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T19:10:06.130610] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T19:10:06.247724] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-07T19:10:06.838230] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T19:10:07.047668] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-07T19:10:07.674346] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T19:10:07.847724] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-07T19:10:08.647665] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-07T19:10:08.677892] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T19:10:08.679303] [INFO ] [REMOTE ] GGT: Full fetch complete (18779 records). [2025-10-07T19:10:08.679373] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-07T19:10:09.048523] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-07T19:10:09.048632] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-07T19:10:09.049081] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-07T19:10:09.049129] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-07T19:10:09.049788] [DEBUG] [LOCAL ] GGT: Trimmed 18779 records to 14149 (keeping 200 days of data) [2025-10-07T19:10:09.137457] [DEBUG] [LOCAL ] GGT: Primary data saved (14149 records). [2025-10-07T19:10:09.137621] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-07T19:10:09.137745] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGT took 44.1s. Estimated remaining: 3h 22m 16s. Rate: 7.1 symbols/min [2025-10-07T19:10:09.286740] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-07T19:10:09.314329] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:10:09.322035] [DEBUG] [LOCAL ] GHLD: Loaded 4174 existing records from primary storage. [2025-10-07T19:10:09.322263] [INFO ] [MAIN ] GHLD: Loaded 4174 existing records. [2025-10-07T19:10:09.457725] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-07T19:10:09.505964] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:10:09.507051] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-07T19:10:09.507117] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-07T19:10:09.507982] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-07T19:10:09.508044] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-07T19:10:09.867362] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:10:10.247708] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-07T19:10:10.313841] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T19:10:10.755078] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-07T19:10:11.047720] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-07T19:10:11.581229] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T19:10:11.847739] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-07T19:10:12.444896] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-07T19:10:12.647791] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-07T19:10:13.099746] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-07T19:10:13.447633] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-07T19:10:13.987591] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-07T19:10:14.247696] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-07T19:10:14.923423] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T19:10:14.924707] [INFO ] [REMOTE ] GHC: Full fetch complete (3419 records). [2025-10-07T19:10:14.924805] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-07T19:10:15.052843] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-07T19:10:15.283748] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-07T19:10:15.283833] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-07T19:10:15.283959] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-07T19:10:15.283997] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-07T19:10:15.284349] [DEBUG] [LOCAL ] GHC: Trimmed 3419 records to 2760 (keeping 200 days of data) [2025-10-07T19:10:15.302249] [DEBUG] [LOCAL ] GHC: Primary data saved (2760 records). [2025-10-07T19:10:15.302330] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-07T19:10:15.302421] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 28.4s. Estimated remaining: 3h 22m 4s. Rate: 7.1 symbols/min [2025-10-07T19:10:15.464831] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:10:15.480369] [DEBUG] [LOCAL ] GHM: Loaded 14084 existing records from primary storage. [2025-10-07T19:10:15.480615] [INFO ] [MAIN ] GHM: Loaded 14084 existing records. [2025-10-07T19:10:15.659975] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:10:15.660310] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-07T19:10:15.660364] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-07T19:10:15.660595] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-07T19:10:15.660691] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-07T19:10:15.768297] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T19:10:15.857435] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-07T19:10:16.035870] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:10:16.565599] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T19:10:16.647739] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-07T19:10:17.094254] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T19:10:17.447713] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-07T19:10:18.196761] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T19:10:18.247608] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-07T19:10:19.047941] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-07T19:10:19.051837] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T19:10:19.847696] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-07T19:10:19.947267] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-07T19:10:20.183062] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-07T19:10:20.647696] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-07T19:10:21.447696] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-07T19:10:21.718170] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T19:10:22.234621] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T19:10:22.247611] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-07T19:10:22.909625] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T19:10:22.910843] [INFO ] [REMOTE ] GHI: Full fetch complete (11471 records). [2025-10-07T19:10:22.910915] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-07T19:10:23.052738] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-07T19:10:23.294511] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-07T19:10:23.294597] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-07T19:10:23.294883] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-07T19:10:23.294945] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-07T19:10:23.297217] [DEBUG] [LOCAL ] GHI: Trimmed 11471 records to 7175 (keeping 200 days of data) [2025-10-07T19:10:23.342799] [DEBUG] [LOCAL ] GHI: Primary data saved (7175 records). [2025-10-07T19:10:23.342948] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-07T19:10:23.343068] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHI took 23.1s. Estimated remaining: 3h 21m 55s. Rate: 7.1 symbols/min [2025-10-07T19:10:23.510309] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:10:23.537443] [DEBUG] [LOCAL ] GHY: Loaded 20917 existing records from primary storage. [2025-10-07T19:10:23.537762] [INFO ] [MAIN ] GHY: Loaded 20917 existing records. [2025-10-07T19:10:23.715728] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:10:23.716013] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-07T19:10:23.716074] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-07T19:10:23.716308] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-07T19:10:23.716365] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-07T19:10:23.819183] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T19:10:23.859582] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-07T19:10:24.082960] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:10:24.492824] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T19:10:24.647711] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-07T19:10:25.117718] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T19:10:25.447667] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-07T19:10:26.247620] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-07T19:10:26.551249] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T19:10:27.047672] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-07T19:10:27.335961] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T19:10:27.519351] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-07T19:10:27.847687] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-07T19:10:28.435218] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T19:10:28.647676] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-07T19:10:29.193729] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T19:10:29.194501] [INFO ] [REMOTE ] GHG: Full fetch complete (4044 records). [2025-10-07T19:10:29.194571] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-07T19:10:29.452884] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-07T19:10:29.555494] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-07T19:10:29.555626] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-07T19:10:29.555824] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-07T19:10:29.555888] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-07T19:10:29.556282] [DEBUG] [LOCAL ] GHG: Trimmed 4044 records to 3190 (keeping 200 days of data) [2025-10-07T19:10:29.575267] [DEBUG] [LOCAL ] GHG: Primary data saved (3190 records). [2025-10-07T19:10:29.575347] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-07T19:10:29.575422] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHG took 35.2s. Estimated remaining: 3h 21m 44s. Rate: 7.1 symbols/min [2025-10-07T19:10:29.742987] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:10:29.788324] [DEBUG] [LOCAL ] GIB: Loaded 31983 existing records from primary storage. [2025-10-07T19:10:29.788680] [INFO ] [MAIN ] GIB: Loaded 31983 existing records. [2025-10-07T19:10:29.976082] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:10:29.976387] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-07T19:10:29.978856] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-07T19:10:29.979463] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T19:10:29.980855] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-07T19:10:29.980919] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-07T19:10:30.252964] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-07T19:10:30.364421] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:10:31.047692] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-07T19:10:31.606954] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T19:10:31.847615] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-07T19:10:32.043795] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-07T19:10:32.647710] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-07T19:10:32.877256] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T19:10:33.447633] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-07T19:10:33.460158] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T19:10:34.247686] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-07T19:10:34.664781] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-07T19:10:35.047707] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-07T19:10:35.143063] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T19:10:35.848063] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-07T19:10:36.280696] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-07T19:10:36.317139] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T19:10:36.647687] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-07T19:10:37.239329] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T19:10:37.447719] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-07T19:10:38.247795] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-07T19:10:38.747031] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T19:10:38.859730] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T19:10:39.047702] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-07T19:10:39.847706] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-07T19:10:40.433464] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T19:10:40.647678] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-07T19:10:40.824305] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T19:10:41.447681] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-07T19:10:42.152876] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-07T19:10:42.179283] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T19:10:42.247697] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-07T19:10:43.047633] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-07T19:10:43.226806] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T19:10:43.396422] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-07T19:10:43.847690] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-07T19:10:44.647637] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-07T19:10:44.931349] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-07T19:10:45.447687] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-07T19:10:45.979143] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T19:10:46.247699] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-07T19:10:46.606757] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T19:10:47.047705] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-07T19:10:47.573199] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-07T19:10:47.853566] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-07T19:10:47.857319] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T19:10:48.647733] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-07T19:10:49.187703] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T19:10:49.447706] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-07T19:10:49.650026] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T19:10:49.964297] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T19:10:49.965184] [INFO ] [REMOTE ] GHLD: Full fetch complete (4838 records). [2025-10-07T19:10:49.965254] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-07T19:10:50.252818] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-07T19:10:50.316720] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-07T19:10:50.316812] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-07T19:10:50.316987] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-07T19:10:50.317026] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-07T19:10:50.317435] [DEBUG] [LOCAL ] GHLD: Trimmed 4838 records to 4186 (keeping 200 days of data) [2025-10-07T19:10:50.343982] [DEBUG] [LOCAL ] GHLD: Primary data saved (4186 records). [2025-10-07T19:10:50.344106] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-07T19:10:50.344248] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 41.2s. Estimated remaining: 3h 21m 54s. Rate: 7.1 symbols/min [2025-10-07T19:10:50.523940] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:10:50.542704] [DEBUG] [LOCAL ] GIC: Loaded 13433 existing records from primary storage. [2025-10-07T19:10:50.542975] [INFO ] [MAIN ] GIC: Loaded 13433 existing records. [2025-10-07T19:10:50.763827] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:10:50.764175] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-07T19:10:50.764266] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-07T19:10:50.764535] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-07T19:10:50.764611] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-07T19:10:51.052898] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-07T19:10:51.144579] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:10:51.313601] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T19:10:51.847717] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-07T19:10:52.456061] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T19:10:52.647696] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-07T19:10:52.737021] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T19:10:52.738516] [INFO ] [REMOTE ] GHM: Full fetch complete (21863 records). [2025-10-07T19:10:52.738591] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-07T19:10:53.112142] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-07T19:10:53.112238] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-07T19:10:53.112736] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-07T19:10:53.112798] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-07T19:10:53.113412] [DEBUG] [LOCAL ] GHM: Trimmed 21863 records to 14153 (keeping 200 days of data) [2025-10-07T19:10:53.199733] [DEBUG] [LOCAL ] GHM: Primary data saved (14153 records). [2025-10-07T19:10:53.199873] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-07T19:10:53.199970] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHM took 37.9s. Estimated remaining: 3h 21m 37s. Rate: 7.1 symbols/min [2025-10-07T19:10:53.373414] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:10:53.386270] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T19:10:53.426222] [DEBUG] [LOCAL ] GIL: Loaded 43543 existing records from primary storage. [2025-10-07T19:10:53.426529] [INFO ] [MAIN ] GIL: Loaded 43543 existing records. [2025-10-07T19:10:53.454943] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-07T19:10:53.604176] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:10:53.604445] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-07T19:10:53.604500] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-07T19:10:53.604728] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-07T19:10:53.604786] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-07T19:10:53.958053] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:10:54.247693] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-07T19:10:54.683910] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T19:10:55.047701] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-07T19:10:55.613614] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T19:10:55.847770] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-07T19:10:56.112516] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T19:10:56.647636] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-07T19:10:56.775340] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T19:10:57.447631] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-07T19:10:57.543747] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T19:10:58.247696] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-07T19:10:58.948946] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T19:10:59.047683] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-07T19:10:59.079432] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T19:10:59.847713] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-07T19:11:00.590179] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T19:11:00.647693] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-07T19:11:00.837044] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T19:11:01.447706] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-07T19:11:02.252841] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-07T19:11:02.267549] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:11:02.553247] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T19:11:02.555221] [INFO ] [REMOTE ] GHY: Full fetch complete (32315 records). [2025-10-07T19:11:02.555299] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-07T19:11:02.923394] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-07T19:11:02.923487] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-07T19:11:02.924041] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-07T19:11:02.924104] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-07T19:11:02.924917] [DEBUG] [LOCAL ] GHY: Trimmed 32315 records to 20933 (keeping 200 days of data) [2025-10-07T19:11:03.047859] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-07T19:11:03.065514] [DEBUG] [LOCAL ] GHY: Primary data saved (20933 records). [2025-10-07T19:11:03.065628] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-07T19:11:03.065756] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHY took 39.7s. Estimated remaining: 3h 21m 31s. Rate: 7.1 symbols/min [2025-10-07T19:11:03.231596] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:11:03.282203] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-07T19:11:03.282558] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-07T19:11:03.457669] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:11:03.457878] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-07T19:11:03.457927] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-07T19:11:03.458143] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-07T19:11:03.458201] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-07T19:11:03.822028] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:11:03.822966] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T19:11:03.825690] [INFO ] [REMOTE ] GIB: Full fetch complete (45768 records). [2025-10-07T19:11:03.825770] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-07T19:11:03.855185] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-07T19:11:04.087945] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T19:11:04.214334] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-07T19:11:04.214416] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-07T19:11:04.215071] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-07T19:11:04.215133] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-07T19:11:04.216079] [DEBUG] [LOCAL ] GIB: Trimmed 45768 records to 31877 (keeping 200 days of data) [2025-10-07T19:11:04.416232] [DEBUG] [LOCAL ] GIB: Primary data saved (31877 records). [2025-10-07T19:11:04.416378] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-07T19:11:04.417548] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIB took 34.8s. Estimated remaining: 3h 21m 12s. Rate: 7.1 symbols/min [2025-10-07T19:11:04.586636] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:11:04.648477] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-07T19:11:04.648368] [DEBUG] [LOCAL ] GKOS: Loaded 42686 existing records from primary storage. [2025-10-07T19:11:04.649113] [INFO ] [MAIN ] GKOS: Loaded 42686 existing records. [2025-10-07T19:11:04.871108] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:11:04.871358] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-07T19:11:04.871408] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-07T19:11:04.871665] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-07T19:11:04.871727] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-07T19:11:05.238098] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:11:05.447631] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-07T19:11:05.496415] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T19:11:06.247724] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-07T19:11:06.575404] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-07T19:11:06.903172] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T19:11:07.047620] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-07T19:11:07.287066] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T19:11:07.847747] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-07T19:11:08.647926] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-07T19:11:08.732960] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T19:11:08.806770] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T19:11:09.447624] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-07T19:11:09.535236] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T19:11:10.247704] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-07T19:11:10.942205] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T19:11:11.012180] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T19:11:11.047678] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-07T19:11:11.847618] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-07T19:11:11.861310] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T19:11:12.647674] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-07T19:11:13.447621] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-07T19:11:13.482362] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T19:11:13.944081] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T19:11:14.247688] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-07T19:11:14.437366] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T19:11:15.047720] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-07T19:11:15.856044] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-07T19:11:15.861109] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T19:11:16.647742] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-07T19:11:16.899227] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T19:11:16.989691] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T19:11:17.447693] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-07T19:11:18.256951] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-07T19:11:18.284367] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T19:11:18.434952] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T19:11:19.047683] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-07T19:11:19.719843] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T19:11:19.847685] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-07T19:11:20.308346] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T19:11:20.647681] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-07T19:11:21.019243] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T19:11:21.447669] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-07T19:11:22.247632] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-07T19:11:22.335174] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T19:11:22.336463] [INFO ] [REMOTE ] GIC: Full fetch complete (20208 records). [2025-10-07T19:11:22.336535] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-07T19:11:22.721207] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-07T19:11:22.721398] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-07T19:11:22.721908] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-07T19:11:22.732853] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-07T19:11:22.752167] [DEBUG] [LOCAL ] GIC: Trimmed 20208 records to 13473 (keeping 200 days of data) [2025-10-07T19:11:22.754214] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T19:11:22.849845] [DEBUG] [LOCAL ] GIC: Primary data saved (13473 records). [2025-10-07T19:11:22.849996] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-07T19:11:22.850083] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIC took 32.5s. Estimated remaining: 3h 21m 19s. Rate: 7.1 symbols/min [2025-10-07T19:11:23.014274] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:11:23.052798] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-07T19:11:23.054866] [DEBUG] [LOCAL ] GL: Loaded 37789 existing records from primary storage. [2025-10-07T19:11:23.055174] [INFO ] [MAIN ] GL: Loaded 37789 existing records. [2025-10-07T19:11:23.231031] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:11:23.231302] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-07T19:11:23.231351] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-07T19:11:23.231568] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-07T19:11:23.231626] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-07T19:11:23.620550] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:11:23.808467] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T19:11:23.847599] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-07T19:11:24.639245] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T19:11:24.649857] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-07T19:11:25.395380] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T19:11:25.447691] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-07T19:11:26.252732] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-07T19:11:26.275469] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T19:11:27.047621] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-07T19:11:27.309100] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T19:11:27.812016] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T19:11:27.847601] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-07T19:11:28.335177] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T19:11:28.647682] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-07T19:11:29.360707] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T19:11:29.447609] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-07T19:11:30.247701] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-07T19:11:30.624701] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T19:11:30.953755] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:11:31.047676] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-07T19:11:31.349960] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T19:11:31.353085] [INFO ] [REMOTE ] GIL: Full fetch complete (61743 records). [2025-10-07T19:11:31.353196] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-07T19:11:31.795426] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-07T19:11:31.795572] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-07T19:11:31.797262] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-07T19:11:31.797440] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-07T19:11:31.799429] [DEBUG] [LOCAL ] GIL: Trimmed 61743 records to 43629 (keeping 200 days of data) [2025-10-07T19:11:31.861994] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-07T19:11:32.092054] [DEBUG] [LOCAL ] GIL: Primary data saved (43629 records). [2025-10-07T19:11:32.092671] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-07T19:11:32.092890] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIL took 38.9s. Estimated remaining: 3h 21m 12s. Rate: 7.1 symbols/min [2025-10-07T19:11:32.262771] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:11:32.306756] [DEBUG] [LOCAL ] GLOB: Loaded 47770 existing records from primary storage. [2025-10-07T19:11:32.307127] [INFO ] [MAIN ] GLOB: Loaded 47770 existing records. [2025-10-07T19:11:32.493777] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:11:32.494060] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-07T19:11:32.494111] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-07T19:11:32.494363] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-07T19:11:32.494423] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-07T19:11:32.648165] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-07T19:11:32.866858] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:11:32.992295] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T19:11:33.431210] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T19:11:33.447608] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-07T19:11:33.914274] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T19:11:34.247705] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-07T19:11:34.892438] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T19:11:35.047731] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-07T19:11:35.846938] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T19:11:35.855296] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-07T19:11:36.451155] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T19:11:36.647607] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-07T19:11:37.447614] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-07T19:11:37.816902] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T19:11:38.111721] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T19:11:38.247695] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-07T19:11:38.982899] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T19:11:39.047715] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-07T19:11:39.635800] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T19:11:39.847700] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-07T19:11:40.342839] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T19:11:40.345910] [INFO ] [REMOTE ] GKOS: Full fetch complete (60084 records). [2025-10-07T19:11:40.346038] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-07T19:11:40.654028] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-07T19:11:40.752877] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-07T19:11:40.752984] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-07T19:11:40.753786] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-07T19:11:40.753856] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-07T19:11:40.755273] [DEBUG] [LOCAL ] GKOS: Trimmed 60084 records to 42637 (keeping 200 days of data) [2025-10-07T19:11:41.035091] [DEBUG] [LOCAL ] GKOS: Primary data saved (42637 records). [2025-10-07T19:11:41.035231] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-07T19:11:41.035331] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GKOS took 36.6s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-10-07T19:11:41.224945] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:11:41.236912] [DEBUG] [LOCAL ] GLP: Loaded 9299 existing records from primary storage. [2025-10-07T19:11:41.237173] [INFO ] [MAIN ] GLP: Loaded 9299 existing records. [2025-10-07T19:11:41.422452] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:11:41.422742] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-07T19:11:41.422797] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-07T19:11:41.422987] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-07T19:11:41.423045] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-07T19:11:41.456226] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-07T19:11:41.699441] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-07T19:11:41.738301] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-07T19:11:41.754252] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-07T19:11:41.901380] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:11:42.228131] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-07T19:11:42.228253] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-07T19:11:42.229406] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-07T19:11:42.229570] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-07T19:11:42.231567] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 53672 (keeping 200 days of data) [2025-10-07T19:11:42.295408] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-07T19:11:42.350262] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T19:11:42.521129] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T19:11:42.645783] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-10-07T19:11:42.645951] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-07T19:11:42.646053] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIS took 39.6s. Estimated remaining: 3h 20m 45s. Rate: 7.1 symbols/min [2025-10-07T19:11:42.853350] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:11:42.908558] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-07T19:11:42.909086] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-07T19:11:43.052857] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-07T19:11:43.094549] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:11:43.094875] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-07T19:11:43.094927] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-07T19:11:43.095173] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-07T19:11:43.095229] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-07T19:11:43.225900] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T19:11:43.477316] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:11:43.847735] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-07T19:11:44.647686] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-07T19:11:44.815267] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T19:11:45.447739] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-07T19:11:45.671505] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T19:11:45.755853] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T19:11:46.247752] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-07T19:11:46.755382] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T19:11:47.051962] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-07T19:11:47.054172] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T19:11:47.847702] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-07T19:11:48.007909] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T19:11:48.647700] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-07T19:11:49.447749] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-07T19:11:49.759871] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-07T19:11:50.247639] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-07T19:11:50.391633] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T19:11:50.395077] [INFO ] [REMOTE ] GL: Full fetch complete (55267 records). [2025-10-07T19:11:50.395310] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-07T19:11:50.643537] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T19:11:50.883777] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-07T19:11:50.883891] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-07T19:11:50.885315] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-07T19:11:50.885386] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-07T19:11:50.886977] [DEBUG] [LOCAL ] GL: Trimmed 55267 records to 37747 (keeping 200 days of data) [2025-10-07T19:11:51.072485] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-07T19:11:51.141095] [DEBUG] [LOCAL ] GL: Primary data saved (37747 records). [2025-10-07T19:11:51.141242] [INFO ] [MAIN ] GL: Full history saved. [2025-10-07T19:11:51.141332] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GL took 28.3s. Estimated remaining: 3h 20m 37s. Rate: 7.1 symbols/min [2025-10-07T19:11:51.308824] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:11:51.362129] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-07T19:11:51.362482] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-07T19:11:51.539834] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:11:51.540207] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-07T19:11:51.540286] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-07T19:11:51.541071] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-07T19:11:51.541134] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-07T19:11:51.851507] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-07T19:11:51.927607] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:11:51.940155] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T19:11:51.958670] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T19:11:52.647675] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-07T19:11:53.447701] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-07T19:11:53.510427] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T19:11:54.247669] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-07T19:11:54.439899] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T19:11:55.042517] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T19:11:55.047598] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-07T19:11:55.296386] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T19:11:55.774031] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T19:11:55.847712] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-07T19:11:56.647736] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-07T19:11:57.447630] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-07T19:11:57.943988] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T19:11:58.247624] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-07T19:11:58.385186] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T19:11:58.758203] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-07T19:11:58.922701] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:11:59.047695] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-07T19:11:59.847689] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-07T19:12:00.647711] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-07T19:12:00.716381] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T19:12:01.318869] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-07T19:12:01.447636] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-07T19:12:02.247692] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-07T19:12:02.704471] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-07T19:12:02.981690] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-07T19:12:03.047601] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-07T19:12:03.235630] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T19:12:03.847755] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-07T19:12:04.647732] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-07T19:12:05.314268] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-07T19:12:05.447623] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-07T19:12:05.709688] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-07T19:12:06.042619] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T19:12:06.247630] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-07T19:12:07.047701] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-07T19:12:07.847624] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-07T19:12:08.114546] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (3.47 seconds). [2025-10-07T19:12:08.254370] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-07T19:12:08.468290] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T19:12:08.469492] [INFO ] [REMOTE ] GLP: Full fetch complete (14328 records). [2025-10-07T19:12:08.469563] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-07T19:12:08.649822] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-07T19:12:08.843125] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-07T19:12:08.843199] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-07T19:12:08.843536] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-07T19:12:08.843596] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-07T19:12:08.844077] [DEBUG] [LOCAL ] GLP: Trimmed 14328 records to 9284 (keeping 200 days of data) [2025-10-07T19:12:08.899949] [DEBUG] [LOCAL ] GLP: Primary data saved (9284 records). [2025-10-07T19:12:08.900070] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-07T19:12:08.900177] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLP took 27.9s. Estimated remaining: 3h 20m 43s. Rate: 7.1 symbols/min [2025-10-07T19:12:09.069617] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:12:09.119521] [DEBUG] [LOCAL ] GME: Loaded 53775 existing records from primary storage. [2025-10-07T19:12:09.119864] [INFO ] [MAIN ] GME: Loaded 53775 existing records. [2025-10-07T19:12:09.297125] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:12:09.297488] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-07T19:12:09.297583] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-07T19:12:09.297878] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-07T19:12:09.297959] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-07T19:12:09.439739] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-07T19:12:09.450119] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-07T19:12:09.708756] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:12:10.247682] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-07T19:12:10.526955] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T19:12:11.047685] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-07T19:12:11.302459] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T19:12:11.847729] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-07T19:12:12.195812] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T19:12:12.647735] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-07T19:12:13.447770] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-07T19:12:13.702984] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-07T19:12:13.996213] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-07T19:12:13.999777] [INFO ] [REMOTE ] GLW: Full fetch complete (77619 records). [2025-10-07T19:12:13.999885] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-07T19:12:14.249573] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-07T19:12:14.423489] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-07T19:12:14.423668] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-07T19:12:14.425083] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-07T19:12:14.425169] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-07T19:12:14.427077] [DEBUG] [LOCAL ] GLW: Trimmed 77619 records to 53636 (keeping 200 days of data) [2025-10-07T19:12:14.548820] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-07T19:12:14.799095] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-07T19:12:14.799228] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-07T19:12:14.799312] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLW took 32.2s. Estimated remaining: 3h 20m 30s. Rate: 7.1 symbols/min [2025-10-07T19:12:14.911540] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T19:12:14.925699] [INFO ] [REMOTE ] GLOB: Full fetch complete (64579 records). [2025-10-07T19:12:14.953699] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-07T19:12:15.049171] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-07T19:12:15.028765] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:12:15.399440] [DEBUG] [LOCAL ] GMED: Loaded 48398 existing records from primary storage. [2025-10-07T19:12:15.402741] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-07T19:12:15.402869] [INFO ] [MAIN ] GMED: Loaded 48398 existing records. [2025-10-07T19:12:15.434157] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-07T19:12:15.467178] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-07T19:12:15.472707] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-07T19:12:15.505049] [DEBUG] [LOCAL ] GLOB: Trimmed 64579 records to 47732 (keeping 200 days of data) [2025-10-07T19:12:15.675038] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:12:15.676271] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-07T19:12:15.676572] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-07T19:12:15.677733] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-07T19:12:15.679290] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-07T19:12:16.054767] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:12:16.055838] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-07T19:12:16.234088] [DEBUG] [LOCAL ] GLOB: Primary data saved (47732 records). [2025-10-07T19:12:16.234237] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-07T19:12:16.234320] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLOB took 44.1s. Estimated remaining: 3h 20m 11s. Rate: 7.1 symbols/min [2025-10-07T19:12:16.398112] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:12:16.432481] [DEBUG] [LOCAL ] GMRE: Loaded 37203 existing records from primary storage. [2025-10-07T19:12:16.432807] [INFO ] [MAIN ] GMRE: Loaded 37203 existing records. [2025-10-07T19:12:16.608987] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:12:16.609189] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-07T19:12:16.609235] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-07T19:12:16.609545] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-07T19:12:16.609602] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-07T19:12:16.969036] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:12:16.969496] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-07T19:12:17.003561] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-07T19:12:17.045014] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T19:12:17.447678] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-07T19:12:17.576783] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T19:12:18.247725] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-07T19:12:18.409361] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T19:12:19.047760] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-07T19:12:19.767288] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-07T19:12:19.847623] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-07T19:12:19.897939] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T19:12:20.647688] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-07T19:12:20.794810] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T19:12:20.840690] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T19:12:21.447698] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-07T19:12:22.235865] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T19:12:22.247599] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-07T19:12:22.674487] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T19:12:23.047725] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-07T19:12:23.592606] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T19:12:23.847685] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-07T19:12:24.487035] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T19:12:24.647639] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-07T19:12:25.447740] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-07T19:12:25.817362] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T19:12:26.010364] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-07T19:12:26.247679] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-07T19:12:27.047736] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-07T19:12:27.298925] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T19:12:27.847620] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-07T19:12:28.246409] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-10-07T19:12:28.647704] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-07T19:12:29.447689] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-07T19:12:30.026541] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-07T19:12:30.247631] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-07T19:12:30.383420] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T19:12:30.592265] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T19:12:30.703143] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (3.66 seconds). [2025-10-07T19:12:31.047744] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-07T19:12:31.847717] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-07T19:12:32.271917] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-07T19:12:32.647621] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-07T19:12:33.302214] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T19:12:33.408463] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-07T19:12:33.447599] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-07T19:12:33.924555] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T19:12:34.247680] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-07T19:12:35.047692] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-07T19:12:35.690122] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T19:12:35.795495] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-07T19:12:35.847599] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-07T19:12:36.319446] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T19:12:36.647691] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-07T19:12:37.447737] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-07T19:12:38.247714] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-07T19:12:38.336493] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T19:12:38.464323] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-07T19:12:39.047673] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-07T19:12:39.202206] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-07T19:12:39.206591] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-07T19:12:39.206772] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-07T19:12:39.612405] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-07T19:12:39.612494] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-07T19:12:39.613544] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-07T19:12:39.613613] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-07T19:12:39.617466] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53729 (keeping 200 days of data) [2025-10-07T19:12:39.729222] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T19:12:39.864987] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-07T19:12:39.985429] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-07T19:12:39.985585] [INFO ] [MAIN ] GM: Full history saved. [2025-10-07T19:12:39.985718] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 48.8s. Estimated remaining: 3h 20m 26s. Rate: 7.1 symbols/min [2025-10-07T19:12:40.151233] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:12:40.170514] [DEBUG] [LOCAL ] GNE: Loaded 17825 existing records from primary storage. [2025-10-07T19:12:40.170786] [INFO ] [MAIN ] GNE: Loaded 17825 existing records. [2025-10-07T19:12:40.342945] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:12:40.343181] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-07T19:12:40.343228] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-07T19:12:40.343614] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-07T19:12:40.343702] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-07T19:12:40.649409] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-07T19:12:40.704484] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:12:40.737455] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T19:12:41.062904] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T19:12:41.067033] [INFO ] [REMOTE ] GMRE: Full fetch complete (53153 records). [2025-10-07T19:12:41.067187] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-07T19:12:41.434676] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-07T19:12:41.434770] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-07T19:12:41.435466] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-07T19:12:41.435535] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-07T19:12:41.437554] [DEBUG] [LOCAL ] GMRE: Trimmed 53153 records to 37200 (keeping 200 days of data) [2025-10-07T19:12:41.494932] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-07T19:12:41.674295] [DEBUG] [LOCAL ] GMRE: Primary data saved (37200 records). [2025-10-07T19:12:41.674440] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-07T19:12:41.674540] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMRE took 25.4s. Estimated remaining: 3h 20m 8s. Rate: 7.1 symbols/min [2025-10-07T19:12:41.840510] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:12:41.879604] [DEBUG] [LOCAL ] GNK: Loaded 40229 existing records from primary storage. [2025-10-07T19:12:41.879930] [INFO ] [MAIN ] GNK: Loaded 40229 existing records. [2025-10-07T19:12:42.052180] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:12:42.052386] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-07T19:12:42.052436] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-07T19:12:42.052745] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-07T19:12:42.052803] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-07T19:12:42.259397] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-07T19:12:42.403320] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:12:42.999819] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T19:12:42.999453] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-07T19:12:43.014223] [INFO ] [REMOTE ] GMED: Full fetch complete (69767 records). [2025-10-07T19:12:43.014390] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-07T19:12:43.058855] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-07T19:12:43.164056] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-07T19:12:43.420915] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-07T19:12:43.421001] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-07T19:12:43.421887] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-07T19:12:43.421951] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-07T19:12:43.423967] [DEBUG] [LOCAL ] GMED: Trimmed 69767 records to 48385 (keeping 200 days of data) [2025-10-07T19:12:43.714436] [DEBUG] [LOCAL ] GMED: Primary data saved (48385 records). [2025-10-07T19:12:43.714700] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-07T19:12:43.714845] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GMED took 28.9s. Estimated remaining: 3h 19m 50s. Rate: 7.1 symbols/min [2025-10-07T19:12:43.856207] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-07T19:12:43.890055] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:12:43.933819] [DEBUG] [LOCAL ] GNL: Loaded 46772 existing records from primary storage. [2025-10-07T19:12:43.934187] [INFO ] [MAIN ] GNL: Loaded 46772 existing records. [2025-10-07T19:12:44.111040] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:12:44.111303] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-07T19:12:44.111350] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-07T19:12:44.111586] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-07T19:12:44.111678] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-07T19:12:44.484614] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:12:44.647630] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-07T19:12:44.671917] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T19:12:45.447624] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-07T19:12:45.674729] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-07T19:12:46.247691] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-07T19:12:46.298431] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T19:12:46.314489] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-07T19:12:47.047702] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-07T19:12:47.624343] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T19:12:47.639176] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T19:12:47.847725] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-07T19:12:48.647731] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-07T19:12:49.447753] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-07T19:12:50.188497] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-07T19:12:50.195143] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-07T19:12:50.195289] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-07T19:12:50.249292] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-07T19:12:50.303989] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-07T19:12:50.408094] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T19:12:50.629693] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-07T19:12:50.629778] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-07T19:12:50.630667] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-07T19:12:50.630731] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-07T19:12:50.632132] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53782 (keeping 200 days of data) [2025-10-07T19:12:50.972903] [DEBUG] [LOCAL ] GME: Primary data saved (53782 records). [2025-10-07T19:12:50.973043] [INFO ] [MAIN ] GME: Full history saved. [2025-10-07T19:12:50.973147] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GME took 42.1s. Estimated remaining: 3h 19m 39s. Rate: 7.1 symbols/min [2025-10-07T19:12:51.052903] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-07T19:12:51.141161] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:12:51.184400] [DEBUG] [LOCAL ] GNRC: Loaded 45174 existing records from primary storage. [2025-10-07T19:12:51.184724] [INFO ] [MAIN ] GNRC: Loaded 45174 existing records. [2025-10-07T19:12:51.357599] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:12:51.357926] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-07T19:12:51.357973] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-07T19:12:51.358185] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-07T19:12:51.358240] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-07T19:12:51.713293] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:12:51.732461] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T19:12:51.847593] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-07T19:12:52.109515] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T19:12:52.647610] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-07T19:12:53.351246] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T19:12:53.447621] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-07T19:12:53.991426] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T19:12:54.247626] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-07T19:12:54.549300] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T19:12:55.047695] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-07T19:12:55.826671] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T19:12:55.847595] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-07T19:12:55.890033] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T19:12:56.647709] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-07T19:12:57.432460] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T19:12:57.447592] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-07T19:12:58.239194] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T19:12:58.247624] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-07T19:12:58.978635] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:12:59.047620] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-07T19:12:59.535047] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T19:12:59.847626] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-07T19:13:00.491700] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T19:13:00.647717] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-07T19:13:01.246990] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T19:13:01.447610] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-07T19:13:01.515379] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T19:13:02.247745] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-07T19:13:03.019211] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T19:13:03.047714] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-07T19:13:03.239991] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T19:13:03.847704] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-07T19:13:04.653477] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-07T19:13:04.668228] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T19:13:05.441721] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T19:13:05.450088] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-07T19:13:05.606357] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T19:13:05.608944] [INFO ] [REMOTE ] GNE: Full fetch complete (22533 records). [2025-10-07T19:13:05.609037] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-07T19:13:06.054067] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-07T19:13:06.054157] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-07T19:13:06.054710] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-07T19:13:06.054777] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-07T19:13:06.055462] [DEBUG] [LOCAL ] GNE: Trimmed 22533 records to 17867 (keeping 200 days of data) [2025-10-07T19:13:06.178271] [DEBUG] [LOCAL ] GNE: Primary data saved (17867 records). [2025-10-07T19:13:06.178443] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-07T19:13:06.178550] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNE took 26.2s. Estimated remaining: 3h 19m 41s. Rate: 7.1 symbols/min [2025-10-07T19:13:06.254163] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-07T19:13:06.394795] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:13:06.410389] [DEBUG] [LOCAL ] GNT: Loaded 8216 existing records from primary storage. [2025-10-07T19:13:06.410704] [INFO ] [MAIN ] GNT: Loaded 8216 existing records. [2025-10-07T19:13:06.591101] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:13:06.591318] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-07T19:13:06.591378] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-07T19:13:06.591629] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-07T19:13:06.591712] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-07T19:13:06.951553] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:13:07.046211] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T19:13:07.055445] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-07T19:13:07.650185] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-07T19:13:07.847664] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-07T19:13:07.899598] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T19:13:08.647723] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-07T19:13:09.447632] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-07T19:13:09.596482] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T19:13:10.107490] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T19:13:10.247635] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-07T19:13:10.765059] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T19:13:11.047739] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-07T19:13:11.655602] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-07T19:13:11.680601] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T19:13:11.847677] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-07T19:13:12.647687] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-07T19:13:13.118526] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T19:13:13.121734] [INFO ] [REMOTE ] GNK: Full fetch complete (57161 records). [2025-10-07T19:13:13.121892] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-07T19:13:13.452861] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-07T19:13:13.531598] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-07T19:13:13.531722] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-07T19:13:13.532614] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-07T19:13:13.532704] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-07T19:13:13.533942] [DEBUG] [LOCAL ] GNK: Trimmed 57161 records to 40272 (keeping 200 days of data) [2025-10-07T19:13:13.782458] [DEBUG] [LOCAL ] GNK: Primary data saved (40272 records). [2025-10-07T19:13:13.782615] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-07T19:13:13.782734] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNK took 32.1s. Estimated remaining: 3h 19m 32s. Rate: 7.1 symbols/min [2025-10-07T19:13:13.953503] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:13:14.001392] [DEBUG] [LOCAL ] GNW: Loaded 51370 existing records from primary storage. [2025-10-07T19:13:14.001775] [INFO ] [MAIN ] GNW: Loaded 51370 existing records. [2025-10-07T19:13:14.179549] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:13:14.179857] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-07T19:13:14.179906] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-07T19:13:14.180154] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-07T19:13:14.180211] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-07T19:13:14.268682] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-07T19:13:14.424494] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T19:13:14.597596] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:13:14.601638] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T19:13:15.047685] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-07T19:13:15.638370] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T19:13:15.847694] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-07T19:13:16.541426] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T19:13:16.647709] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-07T19:13:17.447688] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-07T19:13:17.645375] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T19:13:18.059499] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-07T19:13:18.162324] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T19:13:18.247604] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-07T19:13:19.047682] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-07T19:13:19.847724] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-07T19:13:19.962486] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T19:13:20.654249] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-07T19:13:20.674300] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T19:13:21.318930] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T19:13:21.322194] [INFO ] [REMOTE ] GNL: Full fetch complete (68179 records). [2025-10-07T19:13:21.322351] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-07T19:13:21.452759] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-07T19:13:21.766595] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-07T19:13:21.766738] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-07T19:13:21.767729] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-07T19:13:21.767802] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-07T19:13:21.769393] [DEBUG] [LOCAL ] GNL: Trimmed 68179 records to 46755 (keeping 200 days of data) [2025-10-07T19:13:22.064951] [DEBUG] [LOCAL ] GNL: Primary data saved (46755 records). [2025-10-07T19:13:22.065104] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-07T19:13:22.065278] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNL took 38.4s. Estimated remaining: 3h 19m 23s. Rate: 7.1 symbols/min [2025-10-07T19:13:22.234507] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:13:22.256887] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-07T19:13:22.277086] [DEBUG] [LOCAL ] GOF: Loaded 42540 existing records from primary storage. [2025-10-07T19:13:22.277473] [INFO ] [MAIN ] GOF: Loaded 42540 existing records. [2025-10-07T19:13:22.384833] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T19:13:22.467879] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:13:22.468204] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-07T19:13:22.468343] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-07T19:13:22.468618] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-07T19:13:22.468764] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-07T19:13:22.669682] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-07T19:13:22.878704] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:13:23.047681] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-07T19:13:23.847635] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-07T19:13:24.206303] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T19:13:24.543263] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T19:13:24.647718] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-07T19:13:24.797187] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T19:13:25.447688] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-07T19:13:26.247638] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-07T19:13:26.313336] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T19:13:27.022281] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T19:13:27.047666] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-07T19:13:27.454194] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T19:13:27.457778] [INFO ] [REMOTE ] GNRC: Full fetch complete (65368 records). [2025-10-07T19:13:27.457928] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-07T19:13:27.686297] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T19:13:27.852873] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-07T19:13:27.902442] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-07T19:13:27.902571] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-07T19:13:27.903865] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-07T19:13:27.903941] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-07T19:13:27.906355] [DEBUG] [LOCAL ] GNRC: Trimmed 65368 records to 45210 (keeping 200 days of data) [2025-10-07T19:13:28.225321] [DEBUG] [LOCAL ] GNRC: Primary data saved (45210 records). [2025-10-07T19:13:28.225485] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-07T19:13:28.225585] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 37.3s. Estimated remaining: 3h 19m 11s. Rate: 7.1 symbols/min [2025-10-07T19:13:28.393380] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:13:28.424757] [DEBUG] [LOCAL ] GOLF: Loaded 31144 existing records from primary storage. [2025-10-07T19:13:28.425108] [INFO ] [MAIN ] GOLF: Loaded 31144 existing records. [2025-10-07T19:13:28.607561] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:13:28.608091] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-07T19:13:28.608153] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-07T19:13:28.609400] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-07T19:13:28.609463] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-07T19:13:28.652993] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-07T19:13:29.002843] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:13:29.452576] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-07T19:13:29.450142] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-07T19:13:29.481374] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T19:13:30.247613] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-07T19:13:30.262469] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T19:13:31.047684] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-07T19:13:31.666804] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T19:13:31.849549] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-07T19:13:31.852319] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T19:13:32.647725] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-07T19:13:33.195140] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T19:13:33.447722] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-07T19:13:33.767314] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T19:13:34.247757] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-07T19:13:35.037212] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T19:13:35.047758] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-07T19:13:35.847666] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-07T19:13:36.045976] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T19:13:36.547618] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T19:13:36.636404] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T19:13:36.647592] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-07T19:13:37.339299] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T19:13:37.340525] [INFO ] [REMOTE ] GNT: Full fetch complete (10956 records). [2025-10-07T19:13:37.340595] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-07T19:13:37.449287] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-07T19:13:37.725947] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-07T19:13:37.726059] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-07T19:13:37.726399] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-07T19:13:37.726443] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-07T19:13:37.727098] [DEBUG] [LOCAL ] GNT: Trimmed 10956 records to 8259 (keeping 200 days of data) [2025-10-07T19:13:37.778563] [DEBUG] [LOCAL ] GNT: Primary data saved (8259 records). [2025-10-07T19:13:37.778740] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-07T19:13:37.778852] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNT took 31.6s. Estimated remaining: 3h 19m 4s. Rate: 7.1 symbols/min [2025-10-07T19:13:37.958069] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:13:38.002263] [DEBUG] [LOCAL ] GOOS: Loaded 44826 existing records from primary storage. [2025-10-07T19:13:38.002699] [INFO ] [MAIN ] GOOS: Loaded 44826 existing records. [2025-10-07T19:13:38.183886] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:13:38.184182] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-07T19:13:38.184229] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-07T19:13:38.185747] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-07T19:13:38.185807] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-07T19:13:38.257676] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-07T19:13:38.557302] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:13:38.951358] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T19:13:39.047711] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-07T19:13:39.847712] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-07T19:13:40.020074] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-07T19:13:40.608484] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T19:13:40.647609] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-07T19:13:41.369416] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T19:13:41.447666] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-07T19:13:41.761434] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T19:13:42.247671] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-07T19:13:43.020279] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T19:13:43.047630] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-07T19:13:43.552615] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-07T19:13:43.847674] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-07T19:13:44.583090] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T19:13:44.647613] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-07T19:13:45.431602] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T19:13:45.447591] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-07T19:13:46.247724] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-07T19:13:46.370919] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T19:13:47.047680] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-07T19:13:47.116554] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T19:13:47.847674] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-07T19:13:47.882717] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T19:13:48.647611] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-07T19:13:48.841427] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T19:13:49.179880] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T19:13:49.447712] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-07T19:13:50.247620] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-07T19:13:50.336726] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T19:13:50.671240] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T19:13:51.047716] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-07T19:13:51.723443] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:13:51.847613] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-07T19:13:51.884319] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T19:13:52.647698] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-07T19:13:53.365540] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T19:13:53.447627] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-07T19:13:54.247618] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-07T19:13:54.334881] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T19:13:54.973389] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T19:13:55.047624] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-07T19:13:55.847631] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-07T19:13:55.876136] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T19:13:56.647729] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-07T19:13:56.768868] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T19:13:57.447631] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-07T19:13:57.646631] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T19:13:58.064156] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T19:13:58.067604] [INFO ] [REMOTE ] GOF: Full fetch complete (62070 records). [2025-10-07T19:13:58.067739] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-07T19:13:58.252912] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-07T19:13:58.534359] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-07T19:13:58.534439] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-07T19:13:58.535251] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-07T19:13:58.535317] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-07T19:13:58.536520] [DEBUG] [LOCAL ] GOF: Trimmed 62070 records to 42499 (keeping 200 days of data) [2025-10-07T19:13:58.796503] [DEBUG] [LOCAL ] GOF: Primary data saved (42499 records). [2025-10-07T19:13:58.796664] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-07T19:13:58.796796] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GOF took 36.7s. Estimated remaining: 3h 19m 15s. Rate: 7.1 symbols/min [2025-10-07T19:13:58.973631] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:13:59.008723] [DEBUG] [LOCAL ] GOTU: Loaded 38020 existing records from primary storage. [2025-10-07T19:13:59.009046] [INFO ] [MAIN ] GOTU: Loaded 38020 existing records. [2025-10-07T19:13:59.050889] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-07T19:13:59.190249] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:13:59.190460] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-07T19:13:59.190514] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-07T19:13:59.191451] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-07T19:13:59.191511] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-07T19:13:59.320216] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T19:13:59.589201] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:13:59.660033] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T19:13:59.847693] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-07T19:14:00.647714] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-07T19:14:00.788951] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-07T19:14:00.795232] [INFO ] [REMOTE ] GNW: Full fetch complete (73673 records). [2025-10-07T19:14:00.795371] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-07T19:14:01.190987] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-07T19:14:01.191104] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-07T19:14:01.192191] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-07T19:14:01.192279] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-07T19:14:01.193878] [DEBUG] [LOCAL ] GNW: Trimmed 73673 records to 51367 (keeping 200 days of data) [2025-10-07T19:14:01.429195] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T19:14:01.448478] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-07T19:14:01.534879] [DEBUG] [LOCAL ] GNW: Primary data saved (51367 records). [2025-10-07T19:14:01.535035] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-07T19:14:01.535125] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GNW took 47.8s. Estimated remaining: 3h 18m 58s. Rate: 7.1 symbols/min [2025-10-07T19:14:01.714497] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:14:01.757238] [DEBUG] [LOCAL ] GPC: Loaded 46272 existing records from primary storage. [2025-10-07T19:14:01.757595] [INFO ] [MAIN ] GPC: Loaded 46272 existing records. [2025-10-07T19:14:01.948418] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:14:01.948685] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-07T19:14:01.948746] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-07T19:14:01.948974] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-07T19:14:01.949032] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-07T19:14:02.263510] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-07T19:14:02.318995] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:14:02.345613] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T19:14:02.662496] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T19:14:03.047936] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-07T19:14:03.847755] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-07T19:14:03.984316] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T19:14:04.116499] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-07T19:14:04.119313] [INFO ] [REMOTE ] GOLF: Full fetch complete (45138 records). [2025-10-07T19:14:04.119414] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-07T19:14:04.526384] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-07T19:14:04.526484] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-07T19:14:04.527248] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-07T19:14:04.527321] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-07T19:14:04.528679] [DEBUG] [LOCAL ] GOLF: Trimmed 45138 records to 31098 (keeping 200 days of data) [2025-10-07T19:14:04.648775] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-07T19:14:04.734765] [DEBUG] [LOCAL ] GOLF: Primary data saved (31098 records). [2025-10-07T19:14:04.734925] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-07T19:14:04.735015] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOLF took 36.5s. Estimated remaining: 3h 18m 42s. Rate: 7.1 symbols/min [2025-10-07T19:14:04.901974] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:14:04.917447] [DEBUG] [LOCAL ] GPI: Loaded 14633 existing records from primary storage. [2025-10-07T19:14:04.917782] [INFO ] [MAIN ] GPI: Loaded 14633 existing records. [2025-10-07T19:14:05.093445] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:14:05.094028] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-07T19:14:05.094115] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-07T19:14:05.094721] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-07T19:14:05.094783] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-07T19:14:05.346711] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T19:14:05.380289] [INFO ] [REMOTE ] GOOS: Full fetch complete (65201 records). [2025-10-07T19:14:05.380715] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-07T19:14:05.482256] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-07T19:14:05.533756] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:14:05.843419] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-07T19:14:05.843517] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-07T19:14:05.844384] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-07T19:14:05.844457] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-07T19:14:05.845990] [DEBUG] [LOCAL ] GOOS: Trimmed 65201 records to 44748 (keeping 200 days of data) [2025-10-07T19:14:06.111357] [DEBUG] [LOCAL ] GOOS: Primary data saved (44748 records). [2025-10-07T19:14:06.111491] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-07T19:14:06.111587] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 28.3s. Estimated remaining: 3h 18m 23s. Rate: 7.1 symbols/min [2025-10-07T19:14:06.255986] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-07T19:14:06.281499] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:14:06.288812] [DEBUG] [LOCAL ] GPJA: Loaded 4264 existing records from primary storage. [2025-10-07T19:14:06.289046] [INFO ] [MAIN ] GPJA: Loaded 4264 existing records. [2025-10-07T19:14:06.508050] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:14:06.510121] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T19:14:06.519076] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-07T19:14:06.519553] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-07T19:14:06.520227] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-07T19:14:06.520288] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-07T19:14:06.866718] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:14:07.047595] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-07T19:14:07.312153] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T19:14:07.717076] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-07T19:14:07.847604] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-07T19:14:08.475429] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-07T19:14:08.647637] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-07T19:14:08.812318] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T19:14:09.447678] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-07T19:14:09.493929] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T19:14:10.092377] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T19:14:10.247680] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-07T19:14:11.047629] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-07T19:14:11.110938] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T19:14:11.847731] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-07T19:14:12.398132] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T19:14:12.574151] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T19:14:12.647686] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-07T19:14:13.447708] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-07T19:14:13.976445] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T19:14:14.247626] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-07T19:14:14.307422] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T19:14:15.047696] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-07T19:14:15.358285] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T19:14:15.608259] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-07T19:14:15.847675] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-07T19:14:16.647626] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-07T19:14:16.926537] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T19:14:17.447677] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-07T19:14:18.125630] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:14:18.247688] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-07T19:14:19.047821] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-07T19:14:19.047750] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T19:14:19.205061] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T19:14:19.847694] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-07T19:14:20.398739] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-07T19:14:20.652927] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-07T19:14:20.670832] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T19:14:21.264691] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T19:14:21.447639] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-07T19:14:22.247696] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-07T19:14:22.877470] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T19:14:23.047685] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-07T19:14:23.847710] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-07T19:14:23.990616] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T19:14:24.056795] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-07T19:14:24.417801] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-07T19:14:24.647691] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-07T19:14:25.231557] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T19:14:25.447668] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-07T19:14:26.039589] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T19:14:26.247670] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-07T19:14:27.047690] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-07T19:14:27.629235] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T19:14:27.630205] [INFO ] [REMOTE ] GPJA: Full fetch complete (7294 records). [2025-10-07T19:14:27.630354] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-07T19:14:27.856946] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-07T19:14:28.025023] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-07T19:14:28.025108] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-07T19:14:28.025329] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-07T19:14:28.025395] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-07T19:14:28.025848] [DEBUG] [LOCAL ] GPJA: Trimmed 7294 records to 4266 (keeping 200 days of data) [2025-10-07T19:14:28.074006] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T19:14:28.091321] [DEBUG] [LOCAL ] GPJA: Primary data saved (4266 records). [2025-10-07T19:14:28.091433] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-07T19:14:28.091506] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GPJA took 22.0s. Estimated remaining: 3h 18m 35s. Rate: 7.1 symbols/min [2025-10-07T19:14:28.647629] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-07T19:14:28.857402] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T19:14:29.447676] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-07T19:14:30.077236] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T19:14:30.247679] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-07T19:14:30.943842] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T19:14:31.047599] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-07T19:14:31.239779] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T19:14:31.847737] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-07T19:14:32.650488] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-07T19:14:32.651508] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T19:14:32.748678] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T19:14:33.447729] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-07T19:14:33.664453] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T19:14:34.247682] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-07T19:14:35.047753] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-07T19:14:35.086618] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T19:14:35.507271] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T19:14:35.510912] [INFO ] [REMOTE ] GOTU: Full fetch complete (58805 records). [2025-10-07T19:14:35.511046] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-07T19:14:35.858767] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-07T19:14:35.918552] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-07T19:14:35.918691] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-07T19:14:35.929535] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-07T19:14:35.929933] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-07T19:14:35.931247] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T19:14:35.936185] [DEBUG] [LOCAL ] GOTU: Trimmed 58805 records to 37911 (keeping 200 days of data) [2025-10-07T19:14:36.149510] [DEBUG] [LOCAL ] GOTU: Primary data saved (37911 records). [2025-10-07T19:14:36.149698] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-07T19:14:36.149825] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GOTU took 37.4s. Estimated remaining: 3h 18m 26s. Rate: 7.1 symbols/min [2025-10-07T19:14:36.647765] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-07T19:14:37.487427] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T19:14:37.498846] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-07T19:14:37.562627] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T19:14:37.564208] [INFO ] [REMOTE ] GPI: Full fetch complete (21158 records). [2025-10-07T19:14:37.564281] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-07T19:14:37.930989] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-07T19:14:37.931082] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-07T19:14:37.931552] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-07T19:14:37.931616] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-07T19:14:37.932362] [DEBUG] [LOCAL ] GPI: Trimmed 21158 records to 14631 (keeping 200 days of data) [2025-10-07T19:14:38.028874] [DEBUG] [LOCAL ] GPI: Primary data saved (14631 records). [2025-10-07T19:14:38.029016] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-07T19:14:38.029127] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPI took 33.3s. Estimated remaining: 3h 18m 8s. Rate: 7.1 symbols/min [2025-10-07T19:14:38.857428] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T19:14:38.862581] [INFO ] [REMOTE ] GPC: Full fetch complete (68836 records). [2025-10-07T19:14:38.862835] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-07T19:14:39.322478] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-07T19:14:39.322619] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-07T19:14:39.323802] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-07T19:14:39.323871] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-07T19:14:39.325816] [DEBUG] [LOCAL ] GPC: Trimmed 68836 records to 46229 (keeping 200 days of data) [2025-10-07T19:14:39.661012] [DEBUG] [LOCAL ] GPC: Primary data saved (46229 records). [2025-10-07T19:14:39.661182] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-07T19:14:39.661282] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 38.1s. Estimated remaining: 3h 17m 49s. Rate: 7.1 symbols/min [2025-10-07T19:14:40.377588] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:14:40.401074] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:14:40.431909] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:14:40.453023] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:14:40.492293] [DEBUG] [LOCAL ] GPMT: Loaded 25788 existing records from primary storage. [2025-10-07T19:14:40.500709] [INFO ] [MAIN ] GPMT: Loaded 25788 existing records. [2025-10-07T19:14:40.500525] [DEBUG] [LOCAL ] GPOR: Loaded 23195 existing records from primary storage. [2025-10-07T19:14:40.547793] [INFO ] [MAIN ] GPOR: Loaded 23195 existing records. [2025-10-07T19:14:40.807836] [DEBUG] [LOCAL ] GPK: Loaded 52659 existing records from primary storage. [2025-10-07T19:14:40.840075] [INFO ] [MAIN ] GPK: Loaded 52659 existing records. [2025-10-07T19:14:40.880686] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:14:40.906127] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-07T19:14:40.940762] [DEBUG] [LOCAL ] GPN: Loaded 52052 existing records from primary storage. [2025-10-07T19:14:40.960023] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-07T19:14:40.976831] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-07T19:14:41.005402] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-07T19:14:41.008123] [INFO ] [MAIN ] GPN: Loaded 52052 existing records. [2025-10-07T19:14:41.055580] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:14:41.101607] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-07T19:14:41.176740] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-07T19:14:41.335746] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-07T19:14:41.372441] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:14:41.397836] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-07T19:14:41.417711] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-07T19:14:41.417895] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-07T19:14:41.499923] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-07T19:14:41.516005] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-07T19:14:41.717974] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:14:41.839753] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-07T19:14:41.863734] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-07T19:14:41.934051] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-07T19:14:42.040137] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-07T19:14:42.138034] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:14:42.237019] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-07T19:14:42.649722] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:14:42.685172] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-07T19:14:42.743785] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:14:42.763476] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-07T19:14:42.920405] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:14:42.920780] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-07T19:14:43.718223] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T19:14:43.724331] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-07T19:14:44.054100] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T19:14:44.062779] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-07T19:14:44.459542] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T19:14:44.465072] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-07T19:14:44.503231] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T19:14:44.513435] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-07T19:14:44.761526] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T19:14:44.771927] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-07T19:14:45.534729] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T19:14:45.540371] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-07T19:14:46.074733] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T19:14:46.157029] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T19:14:46.247701] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-07T19:14:47.053253] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-07T19:14:47.065732] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T19:14:47.844414] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T19:14:47.853639] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-07T19:14:48.635025] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (4.57 seconds). [2025-10-07T19:14:48.647605] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-07T19:14:48.707804] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T19:14:48.905666] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T19:14:49.447686] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-07T19:14:49.796567] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T19:14:50.247725] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-07T19:14:51.047769] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-07T19:14:51.126501] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T19:14:51.498737] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T19:14:51.847719] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-07T19:14:52.468234] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T19:14:52.647623] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-07T19:14:53.008876] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T19:14:53.447714] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-07T19:14:53.969804] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T19:14:54.247691] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-07T19:14:54.965018] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T19:14:55.047696] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-07T19:14:55.666439] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T19:14:55.847756] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-07T19:14:56.097140] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T19:14:56.647719] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-07T19:14:57.447619] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-07T19:14:57.588981] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T19:14:57.640605] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T19:14:58.247678] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-07T19:14:59.047698] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-07T19:14:59.206607] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T19:14:59.406397] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T19:14:59.847720] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-07T19:15:00.583271] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T19:15:00.647620] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-07T19:15:00.787219] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T19:15:01.447694] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-07T19:15:02.247709] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-07T19:15:02.412262] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T19:15:02.413985] [INFO ] [REMOTE ] GPMT: Full fetch complete (37201 records). [2025-10-07T19:15:02.414065] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-07T19:15:02.814167] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-07T19:15:02.814357] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-07T19:15:02.815037] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-07T19:15:02.815122] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-07T19:15:02.816465] [DEBUG] [LOCAL ] GPMT: Trimmed 37201 records to 25876 (keeping 200 days of data) [2025-10-07T19:15:02.929408] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-07T19:15:02.968234] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T19:15:03.030513] [DEBUG] [LOCAL ] GPMT: Primary data saved (25876 records). [2025-10-07T19:15:03.030704] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-07T19:15:03.030826] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPMT took 23.4s. Estimated remaining: 3h 18m 3s. Rate: 7.1 symbols/min [2025-10-07T19:15:03.052934] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-07T19:15:03.210068] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:15:03.247232] [DEBUG] [LOCAL ] GPRK: Loaded 39398 existing records from primary storage. [2025-10-07T19:15:03.247580] [INFO ] [MAIN ] GPRK: Loaded 39398 existing records. [2025-10-07T19:15:03.426112] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:15:03.426382] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-07T19:15:03.426443] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-07T19:15:03.426734] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-07T19:15:03.426798] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-07T19:15:03.804038] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:15:03.847603] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-07T19:15:04.292475] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-07T19:15:04.647709] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-07T19:15:05.317291] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T19:15:05.447697] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-07T19:15:06.247764] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-07T19:15:06.601069] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T19:15:07.031805] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T19:15:07.050787] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-07T19:15:07.060591] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T19:15:07.847742] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-07T19:15:08.647734] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-07T19:15:08.877232] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T19:15:09.379696] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T19:15:09.447620] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-07T19:15:10.247771] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-07T19:15:10.348539] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T19:15:10.968476] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T19:15:11.047734] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-07T19:15:11.722373] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T19:15:11.847688] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-07T19:15:12.647735] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-07T19:15:12.855929] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T19:15:13.171302] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T19:15:13.173231] [INFO ] [REMOTE ] GPOR: Full fetch complete (35018 records). [2025-10-07T19:15:13.173330] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-07T19:15:13.457847] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-07T19:15:13.546362] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-07T19:15:13.546455] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-07T19:15:13.547095] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-07T19:15:13.547158] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-07T19:15:13.547978] [DEBUG] [LOCAL ] GPOR: Trimmed 35018 records to 23208 (keeping 200 days of data) [2025-10-07T19:15:13.685489] [DEBUG] [LOCAL ] GPOR: Primary data saved (23208 records). [2025-10-07T19:15:13.685621] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-07T19:15:13.685733] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPOR took 34.0s. Estimated remaining: 3h 17m 57s. Rate: 7.1 symbols/min [2025-10-07T19:15:13.851240] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:15:13.877876] [DEBUG] [LOCAL ] GRBK: Loaded 27003 existing records from primary storage. [2025-10-07T19:15:13.878138] [INFO ] [MAIN ] GRBK: Loaded 27003 existing records. [2025-10-07T19:15:14.062825] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:15:14.063156] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-07T19:15:14.063444] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-07T19:15:14.063833] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-07T19:15:14.064011] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-07T19:15:14.249020] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-07T19:15:14.390188] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T19:15:14.468612] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:15:14.628752] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T19:15:15.047691] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-07T19:15:15.847721] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-07T19:15:16.008571] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T19:15:16.593629] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T19:15:16.647685] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-07T19:15:17.227197] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T19:15:17.447679] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-07T19:15:18.247666] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-07T19:15:18.248146] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T19:15:18.253936] [INFO ] [REMOTE ] GPK: Full fetch complete (75618 records). [2025-10-07T19:15:18.254152] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-07T19:15:18.651577] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-07T19:15:18.651695] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-07T19:15:18.652608] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-07T19:15:18.652681] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-07T19:15:18.654203] [DEBUG] [LOCAL ] GPK: Trimmed 75618 records to 52658 (keeping 200 days of data) [2025-10-07T19:15:18.987512] [DEBUG] [LOCAL ] GPK: Primary data saved (52658 records). [2025-10-07T19:15:18.987720] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-07T19:15:18.987856] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 39.3s. Estimated remaining: 3h 17m 44s. Rate: 7.1 symbols/min [2025-10-07T19:15:19.054107] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-07T19:15:19.166162] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:15:19.178867] [DEBUG] [LOCAL ] GRC: Loaded 9136 existing records from primary storage. [2025-10-07T19:15:19.179107] [INFO ] [MAIN ] GRC: Loaded 9136 existing records. [2025-10-07T19:15:19.360927] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:15:19.361155] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-07T19:15:19.361236] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-07T19:15:19.361455] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-07T19:15:19.361546] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-07T19:15:19.493060] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-07T19:15:19.771912] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:15:19.793483] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T19:15:19.847599] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-07T19:15:20.432542] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T19:15:20.634741] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T19:15:20.647603] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-07T19:15:21.447747] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-07T19:15:22.177270] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T19:15:22.181815] [INFO ] [REMOTE ] GPN: Full fetch complete (74932 records). [2025-10-07T19:15:22.182027] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-07T19:15:22.259971] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-07T19:15:22.625018] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-07T19:15:22.625171] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-07T19:15:22.626261] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-07T19:15:22.626366] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-07T19:15:22.628137] [DEBUG] [LOCAL ] GPN: Trimmed 74932 records to 52045 (keeping 200 days of data) [2025-10-07T19:15:22.764217] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T19:15:22.986046] [DEBUG] [LOCAL ] GPN: Primary data saved (52045 records). [2025-10-07T19:15:22.986290] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-07T19:15:22.986396] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 43.3s. Estimated remaining: 3h 17m 30s. Rate: 7.1 symbols/min [2025-10-07T19:15:23.052868] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-07T19:15:23.158317] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:15:23.179611] [DEBUG] [LOCAL ] GRDN: Loaded 20751 existing records from primary storage. [2025-10-07T19:15:23.179891] [INFO ] [MAIN ] GRDN: Loaded 20751 existing records. [2025-10-07T19:15:23.355101] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:15:23.355335] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-07T19:15:23.355392] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-07T19:15:23.355633] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-07T19:15:23.355732] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-07T19:15:23.716738] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:15:23.849811] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-07T19:15:23.854608] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T19:15:24.440766] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T19:15:24.647717] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-07T19:15:24.890985] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T19:15:25.447719] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-07T19:15:25.466899] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T19:15:26.217068] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T19:15:26.247711] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-07T19:15:27.047733] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-07T19:15:27.157845] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-07T19:15:27.811133] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T19:15:27.847615] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-07T19:15:28.647740] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-07T19:15:28.694372] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T19:15:29.447735] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-07T19:15:29.760872] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T19:15:29.908562] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T19:15:30.247700] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-07T19:15:31.047707] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-07T19:15:31.847638] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-07T19:15:31.897818] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T19:15:31.970760] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T19:15:32.647617] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-07T19:15:32.737697] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-07T19:15:33.200922] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-07T19:15:33.447695] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-07T19:15:34.247745] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-07T19:15:34.523053] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T19:15:35.047742] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-07T19:15:35.582065] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T19:15:35.847686] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-07T19:15:36.519331] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T19:15:36.647630] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-07T19:15:36.901748] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T19:15:37.447686] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-07T19:15:37.854928] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T19:15:38.247698] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-07T19:15:38.911338] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T19:15:38.915536] [INFO ] [REMOTE ] GPRK: Full fetch complete (57573 records). [2025-10-07T19:15:38.915712] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-07T19:15:39.062167] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-07T19:15:39.326292] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-07T19:15:39.326441] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-07T19:15:39.327258] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-07T19:15:39.327361] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-07T19:15:39.328772] [DEBUG] [LOCAL ] GPRK: Trimmed 57573 records to 39388 (keeping 200 days of data) [2025-10-07T19:15:39.427048] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T19:15:39.580845] [DEBUG] [LOCAL ] GPRK: Primary data saved (39388 records). [2025-10-07T19:15:39.581014] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-07T19:15:39.581115] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPRK took 36.6s. Estimated remaining: 3h 17m 33s. Rate: 7.1 symbols/min [2025-10-07T19:15:39.750942] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:15:39.793425] [DEBUG] [LOCAL ] GRMN: Loaded 40885 existing records from primary storage. [2025-10-07T19:15:39.793778] [INFO ] [MAIN ] GRMN: Loaded 40885 existing records. [2025-10-07T19:15:39.847712] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-07T19:15:39.974844] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:15:39.975143] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-07T19:15:39.981753] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-07T19:15:39.982458] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T19:15:39.984793] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-07T19:15:39.985460] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-07T19:15:40.337796] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:15:40.647726] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-07T19:15:41.011864] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T19:15:41.447702] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-07T19:15:41.674206] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T19:15:42.247740] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-07T19:15:42.986297] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T19:15:43.047607] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-07T19:15:43.509841] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T19:15:43.847746] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-07T19:15:44.235915] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T19:15:44.238148] [INFO ] [REMOTE ] GRBK: Full fetch complete (40666 records). [2025-10-07T19:15:44.238234] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-07T19:15:44.622126] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-07T19:15:44.628886] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-07T19:15:44.629833] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-07T19:15:44.629166] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T19:15:44.629979] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-07T19:15:44.633436] [DEBUG] [LOCAL ] GRBK: Trimmed 40666 records to 26976 (keeping 200 days of data) [2025-10-07T19:15:44.683065] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-07T19:15:44.792611] [DEBUG] [LOCAL ] GRBK: Primary data saved (26976 records). [2025-10-07T19:15:44.792772] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-07T19:15:44.792873] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GRBK took 31.1s. Estimated remaining: 3h 17m 20s. Rate: 7.1 symbols/min [2025-10-07T19:15:44.960500] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:15:45.008023] [DEBUG] [LOCAL ] GRND: Loaded 49982 existing records from primary storage. [2025-10-07T19:15:45.008565] [INFO ] [MAIN ] GRND: Loaded 49982 existing records. [2025-10-07T19:15:45.185317] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:15:45.185562] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-07T19:15:45.185615] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-07T19:15:45.186993] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-07T19:15:45.187053] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-07T19:15:45.452924] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-07T19:15:45.472208] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T19:15:45.552731] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:15:46.247683] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-07T19:15:46.642296] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T19:15:46.644303] [INFO ] [REMOTE ] GRDN: Full fetch complete (26329 records). [2025-10-07T19:15:46.644377] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-07T19:15:47.048385] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-07T19:15:47.048158] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-07T19:15:47.049240] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-07T19:15:47.049793] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-07T19:15:47.049855] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-07T19:15:47.050755] [DEBUG] [LOCAL ] GRDN: Trimmed 26329 records to 20854 (keeping 200 days of data) [2025-10-07T19:15:47.174693] [DEBUG] [LOCAL ] GRDN: Primary data saved (20854 records). [2025-10-07T19:15:47.174829] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-07T19:15:47.174909] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRDN took 24.2s. Estimated remaining: 3h 17m 3s. Rate: 7.1 symbols/min [2025-10-07T19:15:47.340497] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:15:47.371663] [DEBUG] [LOCAL ] GRNT: Loaded 33784 existing records from primary storage. [2025-10-07T19:15:47.371955] [INFO ] [MAIN ] GRNT: Loaded 33784 existing records. [2025-10-07T19:15:47.550033] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:15:47.550248] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-07T19:15:47.550332] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-07T19:15:47.551602] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-07T19:15:47.551691] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-07T19:15:47.856033] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-07T19:15:47.932439] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:15:47.934574] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T19:15:48.273312] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T19:15:48.647627] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-07T19:15:48.765288] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T19:15:49.447747] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-07T19:15:50.247687] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-07T19:15:50.281472] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T19:15:50.645728] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T19:15:51.047708] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-07T19:15:51.674633] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T19:15:51.847698] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-07T19:15:52.518153] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-07T19:15:52.647681] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-07T19:15:52.763609] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T19:15:53.447744] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-07T19:15:53.482886] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-07T19:15:54.247706] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-07T19:15:55.021011] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T19:15:55.022493] [INFO ] [REMOTE ] GRC: Full fetch complete (13301 records). [2025-10-07T19:15:55.022563] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-07T19:15:55.055181] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-07T19:15:55.348885] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T19:15:55.441755] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-07T19:15:55.441843] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-07T19:15:55.442276] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-07T19:15:55.442319] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-07T19:15:55.442818] [DEBUG] [LOCAL ] GRC: Trimmed 13301 records to 9198 (keeping 200 days of data) [2025-10-07T19:15:55.499867] [DEBUG] [LOCAL ] GRC: Primary data saved (9198 records). [2025-10-07T19:15:55.500026] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-07T19:15:55.500119] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 36.5s. Estimated remaining: 3h 16m 54s. Rate: 7.1 symbols/min [2025-10-07T19:15:55.665062] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:15:55.676548] [DEBUG] [LOCAL ] GROV: Loaded 8836 existing records from primary storage. [2025-10-07T19:15:55.676821] [INFO ] [MAIN ] GROV: Loaded 8836 existing records. [2025-10-07T19:15:55.852153] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-07T19:15:55.851988] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:15:55.853886] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-07T19:15:55.853976] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-07T19:15:55.854354] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-07T19:15:55.854430] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-07T19:15:56.215223] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:15:56.647713] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-07T19:15:56.781090] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T19:15:57.447810] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-07T19:15:57.553418] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-07T19:15:57.695596] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T19:15:58.247673] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-07T19:15:58.422168] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T19:15:59.047687] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-07T19:15:59.839528] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T19:15:59.849970] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-07T19:15:59.944901] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T19:16:00.647763] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-07T19:16:01.447711] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-07T19:16:01.631738] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T19:16:01.902922] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T19:16:02.006193] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T19:16:02.247723] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-07T19:16:03.013568] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-07T19:16:03.047610] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-07T19:16:03.847739] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-07T19:16:03.853763] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T19:16:04.647707] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-07T19:16:05.298980] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T19:16:05.426877] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T19:16:05.447604] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-07T19:16:06.226351] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-07T19:16:06.247674] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-07T19:16:07.047675] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-07T19:16:07.847630] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-07T19:16:08.018049] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T19:16:08.080828] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T19:16:08.647696] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-07T19:16:09.145694] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T19:16:09.447706] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-07T19:16:10.228688] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T19:16:10.247601] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-07T19:16:11.012295] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T19:16:11.047599] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-07T19:16:11.650073] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T19:16:11.847616] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-07T19:16:12.520590] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T19:16:12.647682] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-07T19:16:13.447631] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-07T19:16:13.567054] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T19:16:13.962884] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T19:16:13.965681] [INFO ] [REMOTE ] GRMN: Full fetch complete (59896 records). [2025-10-07T19:16:13.965799] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-07T19:16:14.252863] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-07T19:16:14.367800] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T19:16:14.370976] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-07T19:16:14.371461] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-07T19:16:14.372432] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-07T19:16:14.372500] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-07T19:16:14.375909] [DEBUG] [LOCAL ] GRMN: Trimmed 59896 records to 40786 (keeping 200 days of data) [2025-10-07T19:16:14.637617] [DEBUG] [LOCAL ] GRMN: Primary data saved (40786 records). [2025-10-07T19:16:14.637791] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-07T19:16:14.637879] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRMN took 35.1s. Estimated remaining: 3h 17m 1s. Rate: 7.1 symbols/min [2025-10-07T19:16:14.804045] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:16:14.809863] [DEBUG] [LOCAL ] GRX: Loaded 4771 existing records from primary storage. [2025-10-07T19:16:14.810014] [INFO ] [MAIN ] GRX: Loaded 4771 existing records. [2025-10-07T19:16:14.985831] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:16:14.986055] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-07T19:16:14.986102] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-07T19:16:14.986453] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-07T19:16:14.986511] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-07T19:16:15.052972] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-07T19:16:15.342870] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:16:15.847737] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-07T19:16:16.458056] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-07T19:16:16.508836] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T19:16:16.647725] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-07T19:16:17.233288] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T19:16:17.332960] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-07T19:16:17.447689] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-07T19:16:17.910192] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T19:16:18.247701] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-07T19:16:19.047684] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-07T19:16:19.420627] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T19:16:19.424086] [INFO ] [REMOTE ] GRND: Full fetch complete (71073 records). [2025-10-07T19:16:19.424187] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-07T19:16:19.807312] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-07T19:16:19.807423] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-07T19:16:19.808292] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-07T19:16:19.808357] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-07T19:16:19.809905] [DEBUG] [LOCAL ] GRND: Trimmed 71073 records to 49989 (keeping 200 days of data) [2025-10-07T19:16:19.867736] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-07T19:16:20.112051] [DEBUG] [LOCAL ] GRND: Primary data saved (49989 records). [2025-10-07T19:16:20.112196] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-07T19:16:20.112285] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRND took 35.3s. Estimated remaining: 3h 16m 49s. Rate: 7.1 symbols/min [2025-10-07T19:16:20.281739] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:16:20.330819] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T19:16:20.353270] [DEBUG] [LOCAL ] GS: Loaded 51804 existing records from primary storage. [2025-10-07T19:16:20.353598] [INFO ] [MAIN ] GS: Loaded 51804 existing records. [2025-10-07T19:16:20.454794] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T19:16:20.531752] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:16:20.531937] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-07T19:16:20.531984] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-07T19:16:20.533436] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-07T19:16:20.533496] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-07T19:16:20.652785] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-07T19:16:20.885621] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:16:21.248242] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T19:16:21.447714] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-07T19:16:21.950541] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T19:16:21.951518] [INFO ] [REMOTE ] GROV: Full fetch complete (14280 records). [2025-10-07T19:16:21.951591] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-07T19:16:22.259793] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-07T19:16:22.303927] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-07T19:16:22.304098] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-07T19:16:22.304431] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-07T19:16:22.304472] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-07T19:16:22.304997] [DEBUG] [LOCAL ] GROV: Trimmed 14280 records to 8861 (keeping 200 days of data) [2025-10-07T19:16:22.355496] [DEBUG] [LOCAL ] GROV: Primary data saved (8861 records). [2025-10-07T19:16:22.355635] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-07T19:16:22.355759] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GROV took 26.9s. Estimated remaining: 3h 16m 31s. Rate: 7.1 symbols/min [2025-10-07T19:16:22.520347] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:16:22.559608] [DEBUG] [LOCAL ] GSBD: Loaded 39199 existing records from primary storage. [2025-10-07T19:16:22.559955] [INFO ] [MAIN ] GSBD: Loaded 39199 existing records. [2025-10-07T19:16:22.731922] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:16:22.732117] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-07T19:16:22.732164] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-07T19:16:22.732376] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-07T19:16:22.732433] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-07T19:16:22.984841] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T19:16:23.052762] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-07T19:16:23.088373] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:16:23.847709] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-07T19:16:24.647617] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-07T19:16:24.987775] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T19:16:25.210246] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-07T19:16:25.213635] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T19:16:25.447679] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-07T19:16:26.247718] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-07T19:16:26.259601] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T19:16:27.047715] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-07T19:16:27.847690] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-07T19:16:27.883535] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T19:16:28.373028] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T19:16:28.466061] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T19:16:28.647748] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-07T19:16:29.447747] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-07T19:16:30.022971] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T19:16:30.247686] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-07T19:16:31.051519] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-07T19:16:31.054816] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T19:16:31.060303] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T19:16:31.847684] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-07T19:16:32.435197] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T19:16:32.570757] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T19:16:32.571717] [INFO ] [REMOTE ] GRX: Full fetch complete (6659 records). [2025-10-07T19:16:32.571788] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-07T19:16:32.652721] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-07T19:16:32.926468] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-07T19:16:32.926548] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-07T19:16:32.926738] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-07T19:16:32.926800] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-07T19:16:32.927191] [DEBUG] [LOCAL ] GRX: Trimmed 6659 records to 4786 (keeping 200 days of data) [2025-10-07T19:16:32.955998] [DEBUG] [LOCAL ] GRX: Primary data saved (4786 records). [2025-10-07T19:16:32.956090] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-07T19:16:32.956166] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRX took 18.3s. Estimated remaining: 3h 16m 26s. Rate: 7.1 symbols/min [2025-10-07T19:16:33.122415] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:16:33.172087] [DEBUG] [LOCAL ] GSK: Loaded 53496 existing records from primary storage. [2025-10-07T19:16:33.172445] [INFO ] [MAIN ] GSK: Loaded 53496 existing records. [2025-10-07T19:16:33.344431] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:16:33.344697] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-07T19:16:33.344756] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-07T19:16:33.345884] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-07T19:16:33.345946] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-07T19:16:33.452712] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-07T19:16:33.695125] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:16:34.171366] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T19:16:34.247716] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-07T19:16:35.047727] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-07T19:16:35.693456] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-07T19:16:35.758536] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T19:16:35.847603] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-07T19:16:36.647713] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-07T19:16:37.093364] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-07T19:16:37.171289] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T19:16:37.447777] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-07T19:16:38.247608] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-07T19:16:38.566779] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T19:16:38.570756] [INFO ] [REMOTE ] GRNT: Full fetch complete (48425 records). [2025-10-07T19:16:38.570884] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-07T19:16:38.754127] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-07T19:16:39.048691] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-07T19:16:39.062290] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-07T19:16:39.063462] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-07T19:16:39.064267] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-07T19:16:39.064457] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-07T19:16:39.068010] [DEBUG] [LOCAL ] GRNT: Trimmed 48425 records to 33812 (keeping 200 days of data) [2025-10-07T19:16:39.302178] [DEBUG] [LOCAL ] GRNT: Primary data saved (33812 records). [2025-10-07T19:16:39.302356] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-07T19:16:39.302460] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRNT took 52.1s. Estimated remaining: 3h 16m 15s. Rate: 7.1 symbols/min [2025-10-07T19:16:39.526255] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:16:39.563502] [DEBUG] [LOCAL ] GSL: Loaded 33204 existing records from primary storage. [2025-10-07T19:16:39.563834] [INFO ] [MAIN ] GSL: Loaded 33204 existing records. [2025-10-07T19:16:39.784928] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:16:39.785266] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-07T19:16:39.785333] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-07T19:16:39.795278] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-07T19:16:39.807216] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-07T19:16:39.848984] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-07T19:16:39.857000] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T19:16:40.240228] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:16:40.647702] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-07T19:16:40.988764] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T19:16:41.447708] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-07T19:16:41.771481] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T19:16:41.841155] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T19:16:42.247616] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-07T19:16:42.439052] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T19:16:43.047677] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-07T19:16:43.847722] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-07T19:16:43.874321] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T19:16:44.386983] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T19:16:44.647738] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-07T19:16:45.447728] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-07T19:16:46.010383] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-07T19:16:46.247718] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-07T19:16:46.563444] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-07T19:16:46.628619] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T19:16:47.047698] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-07T19:16:47.847751] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-07T19:16:48.388536] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T19:16:48.433372] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-07T19:16:48.647725] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-07T19:16:48.861847] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T19:16:49.447703] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-07T19:16:50.247615] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-07T19:16:50.333261] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T19:16:50.819205] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-07T19:16:51.047715] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-07T19:16:51.738712] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T19:16:51.847725] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-07T19:16:52.647812] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-07T19:16:53.255146] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-07T19:16:53.447728] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-07T19:16:54.058498] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-07T19:16:54.125586] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T19:16:54.247633] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-07T19:16:54.600467] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T19:16:55.047754] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-07T19:16:55.728222] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T19:16:55.847726] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-07T19:16:56.648128] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-07T19:16:57.072785] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-07T19:16:57.447712] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-07T19:16:57.782761] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T19:16:57.967314] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T19:16:57.970919] [INFO ] [REMOTE ] GSBD: Full fetch complete (58488 records). [2025-10-07T19:16:57.971032] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-07T19:16:58.257024] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-07T19:16:58.353690] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-07T19:16:58.353928] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-07T19:16:58.354717] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-07T19:16:58.354884] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-07T19:16:58.356761] [DEBUG] [LOCAL ] GSBD: Trimmed 58488 records to 39246 (keeping 200 days of data) [2025-10-07T19:16:58.473071] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T19:16:58.628290] [DEBUG] [LOCAL ] GSBD: Primary data saved (39246 records). [2025-10-07T19:16:58.628508] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-07T19:16:58.628616] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GSBD took 36.3s. Estimated remaining: 3h 16m 22s. Rate: 7.1 symbols/min [2025-10-07T19:16:58.796835] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:16:58.848697] [DEBUG] [LOCAL ] GTES: Loaded 50481 existing records from primary storage. [2025-10-07T19:16:58.849037] [INFO ] [MAIN ] GTES: Loaded 50481 existing records. [2025-10-07T19:16:59.023093] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:16:59.023295] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-07T19:16:59.023341] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-07T19:16:59.024961] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-07T19:16:59.025027] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-07T19:16:59.056387] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-07T19:16:59.385127] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:16:59.847703] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-07T19:17:00.297556] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-07T19:17:00.647698] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-07T19:17:00.832804] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T19:17:01.447689] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-07T19:17:01.637070] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T19:17:02.247742] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-07T19:17:02.813362] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-07T19:17:03.047720] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-07T19:17:03.302402] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T19:17:03.678966] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T19:17:03.847719] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-07T19:17:04.647674] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-07T19:17:04.837880] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-07T19:17:04.842813] [INFO ] [REMOTE ] GS: Full fetch complete (75660 records). [2025-10-07T19:17:04.842992] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-07T19:17:05.244756] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-07T19:17:05.244928] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-07T19:17:05.245937] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-07T19:17:05.246006] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-07T19:17:05.247470] [DEBUG] [LOCAL ] GS: Trimmed 75660 records to 51792 (keeping 200 days of data) [2025-10-07T19:17:05.470702] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-07T19:17:05.528395] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T19:17:05.639159] [DEBUG] [LOCAL ] GS: Primary data saved (51792 records). [2025-10-07T19:17:05.639351] [INFO ] [MAIN ] GS: Full history saved. [2025-10-07T19:17:05.639467] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GS took 45.5s. Estimated remaining: 3h 16m 11s. Rate: 7.1 symbols/min [2025-10-07T19:17:05.806626] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:17:05.846846] [DEBUG] [LOCAL ] GTLS: Loaded 42958 existing records from primary storage. [2025-10-07T19:17:05.847144] [INFO ] [MAIN ] GTLS: Loaded 42958 existing records. [2025-10-07T19:17:06.025328] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:17:06.025748] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-07T19:17:06.025835] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-07T19:17:06.027205] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-07T19:17:06.027268] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-07T19:17:06.156851] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T19:17:06.259876] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-07T19:17:06.406855] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:17:07.047719] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-07T19:17:07.464309] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-07T19:17:07.695237] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T19:17:07.697907] [INFO ] [REMOTE ] GSL: Full fetch complete (47894 records). [2025-10-07T19:17:07.697991] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-07T19:17:07.852036] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-07T19:17:08.077371] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-07T19:17:08.077496] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-07T19:17:08.078188] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-07T19:17:08.078251] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-07T19:17:08.081234] [DEBUG] [LOCAL ] GSL: Trimmed 47894 records to 33185 (keeping 200 days of data) [2025-10-07T19:17:08.287001] [DEBUG] [LOCAL ] GSL: Primary data saved (33185 records). [2025-10-07T19:17:08.287138] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-07T19:17:08.287221] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSL took 29.0s. Estimated remaining: 3h 15m 55s. Rate: 7.1 symbols/min [2025-10-07T19:17:08.491001] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:17:08.493334] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T19:17:08.544184] [DEBUG] [LOCAL ] GTN: Loaded 45354 existing records from primary storage. [2025-10-07T19:17:08.544552] [INFO ] [MAIN ] GTN: Loaded 45354 existing records. [2025-10-07T19:17:08.652757] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-07T19:17:08.721855] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:17:08.722073] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-07T19:17:08.722119] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-07T19:17:08.723285] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-07T19:17:08.723344] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-07T19:17:09.068715] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:17:09.447707] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-07T19:17:09.524437] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T19:17:10.247737] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-07T19:17:10.970631] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-07T19:17:11.008946] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T19:17:11.047599] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-07T19:17:11.814477] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T19:17:11.847600] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-07T19:17:12.573357] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T19:17:12.647694] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-07T19:17:12.987335] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T19:17:13.447725] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-07T19:17:14.247687] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-07T19:17:14.324814] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T19:17:15.001877] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T19:17:15.047611] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-07T19:17:15.847639] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-07T19:17:16.148772] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-07T19:17:16.647695] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-07T19:17:16.725315] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T19:17:17.447796] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-07T19:17:17.533230] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T19:17:18.257081] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-07T19:17:18.282437] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T19:17:18.618867] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T19:17:19.047763] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-07T19:17:19.847734] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-07T19:17:20.092761] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T19:17:20.618913] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T19:17:20.647673] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-07T19:17:21.191964] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T19:17:21.447764] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-07T19:17:22.247679] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-07T19:17:22.627585] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-07T19:17:23.047739] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-07T19:17:23.335940] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-07T19:17:23.774845] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:17:23.847734] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-07T19:17:24.647727] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-07T19:17:24.822294] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-07T19:17:24.827431] [INFO ] [REMOTE ] GSK: Full fetch complete (77476 records). [2025-10-07T19:17:24.827678] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-07T19:17:25.293568] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-07T19:17:25.293840] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-07T19:17:25.295566] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-07T19:17:25.295711] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-07T19:17:25.298157] [DEBUG] [LOCAL ] GSK: Trimmed 77476 records to 53502 (keeping 200 days of data) [2025-10-07T19:17:25.451774] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-07T19:17:25.592908] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T19:17:25.719529] [DEBUG] [LOCAL ] GSK: Primary data saved (53502 records). [2025-10-07T19:17:25.719735] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-07T19:17:25.719854] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSK took 52.8s. Estimated remaining: 3h 15m 59s. Rate: 7.1 symbols/min [2025-10-07T19:17:25.895206] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:17:25.927579] [DEBUG] [LOCAL ] GTY: Loaded 30203 existing records from primary storage. [2025-10-07T19:17:25.927917] [INFO ] [MAIN ] GTY: Loaded 30203 existing records. [2025-10-07T19:17:26.106813] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:17:26.107049] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-07T19:17:26.107097] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-07T19:17:26.107346] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-07T19:17:26.107433] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-07T19:17:26.255315] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-07T19:17:26.496424] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:17:26.498176] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T19:17:27.047712] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-07T19:17:27.255796] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T19:17:27.600751] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T19:17:27.847625] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-07T19:17:28.647694] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-07T19:17:28.674701] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T19:17:29.447634] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-07T19:17:29.509946] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T19:17:30.178310] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T19:17:30.247621] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-07T19:17:30.569201] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T19:17:31.047754] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-07T19:17:31.629353] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T19:17:31.632458] [INFO ] [REMOTE ] GTLS: Full fetch complete (61438 records). [2025-10-07T19:17:31.632559] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-07T19:17:31.853945] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-07T19:17:32.023069] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-07T19:17:32.023152] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-07T19:17:32.023940] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-07T19:17:32.024006] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-07T19:17:32.025229] [DEBUG] [LOCAL ] GTLS: Trimmed 61438 records to 42987 (keeping 200 days of data) [2025-10-07T19:17:32.283970] [DEBUG] [LOCAL ] GTLS: Primary data saved (42987 records). [2025-10-07T19:17:32.284101] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-07T19:17:32.284212] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GTLS took 26.6s. Estimated remaining: 3h 15m 48s. Rate: 7.1 symbols/min [2025-10-07T19:17:32.456424] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:17:32.471181] [DEBUG] [LOCAL ] GUG: Loaded 12145 existing records from primary storage. [2025-10-07T19:17:32.471432] [INFO ] [MAIN ] GUG: Loaded 12145 existing records. [2025-10-07T19:17:32.649493] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-07T19:17:32.653182] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T19:17:32.703134] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:17:32.704101] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-07T19:17:32.704591] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-07T19:17:32.704819] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-07T19:17:32.705251] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-07T19:17:33.052943] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:17:33.214859] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T19:17:33.447685] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-07T19:17:33.824831] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T19:17:33.828934] [INFO ] [REMOTE ] GTES: Full fetch complete (73821 records). [2025-10-07T19:17:33.829079] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-07T19:17:34.249748] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-07T19:17:34.296855] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-07T19:17:34.297020] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-07T19:17:34.298157] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-07T19:17:34.298228] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-07T19:17:34.299848] [DEBUG] [LOCAL ] GTES: Trimmed 73821 records to 50458 (keeping 200 days of data) [2025-10-07T19:17:34.523404] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T19:17:34.647223] [DEBUG] [LOCAL ] GTES: Primary data saved (50458 records). [2025-10-07T19:17:34.647445] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-07T19:17:34.647555] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 36.0s. Estimated remaining: 3h 15m 31s. Rate: 7.1 symbols/min [2025-10-07T19:17:34.858242] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:17:34.877245] [DEBUG] [LOCAL ] GUT: Loaded 15409 existing records from primary storage. [2025-10-07T19:17:34.877590] [INFO ] [MAIN ] GUT: Loaded 15409 existing records. [2025-10-07T19:17:35.052727] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-07T19:17:35.088024] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:17:35.088351] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-07T19:17:35.088402] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-07T19:17:35.088845] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-07T19:17:35.088906] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-07T19:17:35.531532] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:17:35.847627] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-07T19:17:35.889597] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T19:17:36.331374] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T19:17:36.647635] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-07T19:17:36.884020] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T19:17:37.447767] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-07T19:17:38.247695] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-07T19:17:38.308400] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T19:17:38.786734] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T19:17:39.047759] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-07T19:17:39.256360] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T19:17:39.847692] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-07T19:17:40.387606] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T19:17:40.390927] [INFO ] [REMOTE ] GTN: Full fetch complete (66348 records). [2025-10-07T19:17:40.391039] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-07T19:17:40.655173] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-07T19:17:40.825943] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-07T19:17:40.826028] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-07T19:17:40.827036] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-07T19:17:40.827106] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-07T19:17:40.828888] [DEBUG] [LOCAL ] GTN: Trimmed 66348 records to 45327 (keeping 200 days of data) [2025-10-07T19:17:41.101468] [DEBUG] [LOCAL ] GTN: Primary data saved (45327 records). [2025-10-07T19:17:41.101635] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-07T19:17:41.101810] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTN took 32.8s. Estimated remaining: 3h 15m 20s. Rate: 7.1 symbols/min [2025-10-07T19:17:41.272275] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:17:41.313924] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T19:17:41.332274] [DEBUG] [LOCAL ] GVA: Loaded 33051 existing records from primary storage. [2025-10-07T19:17:41.332556] [INFO ] [MAIN ] GVA: Loaded 33051 existing records. [2025-10-07T19:17:41.451129] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-07T19:17:41.509780] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:17:41.509970] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-07T19:17:41.510017] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-07T19:17:41.510254] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-07T19:17:41.510312] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-07T19:17:41.625446] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T19:17:41.875374] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:17:42.247682] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-07T19:17:42.809745] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T19:17:43.047712] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-07T19:17:43.173300] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T19:17:43.847734] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-07T19:17:44.457881] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T19:17:44.647681] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-07T19:17:45.017491] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T19:17:45.447742] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-07T19:17:45.778715] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T19:17:46.050197] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-07T19:17:46.247717] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-07T19:17:47.047634] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-07T19:17:47.630308] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T19:17:47.847632] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-07T19:17:48.429851] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T19:17:48.557751] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T19:17:48.647766] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-07T19:17:49.447757] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-07T19:17:49.884542] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T19:17:50.123298] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-07T19:17:50.247738] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-07T19:17:51.047758] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-07T19:17:51.159807] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-07T19:17:51.847709] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-07T19:17:52.234005] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T19:17:52.647620] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-07T19:17:52.859575] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T19:17:53.447618] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-07T19:17:53.523404] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T19:17:54.247684] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-07T19:17:55.047624] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-07T19:17:55.113951] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T19:17:55.149975] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T19:17:55.847662] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-07T19:17:55.917620] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T19:17:55.920026] [INFO ] [REMOTE ] GTY: Full fetch complete (43672 records). [2025-10-07T19:17:55.920129] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-07T19:17:56.300635] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-07T19:17:56.300749] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-07T19:17:56.301626] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-07T19:17:56.301704] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-07T19:17:56.302689] [DEBUG] [LOCAL ] GTY: Trimmed 43672 records to 30174 (keeping 200 days of data) [2025-10-07T19:17:56.491860] [DEBUG] [LOCAL ] GTY: Primary data saved (30174 records). [2025-10-07T19:17:56.492020] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-07T19:17:56.492111] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTY took 30.8s. Estimated remaining: 3h 15m 21s. Rate: 7.1 symbols/min [2025-10-07T19:17:56.665355] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:17:56.661414] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-07T19:17:56.683593] [DEBUG] [LOCAL ] GWH: Loaded 16637 existing records from primary storage. [2025-10-07T19:17:56.683877] [INFO ] [MAIN ] GWH: Loaded 16637 existing records. [2025-10-07T19:17:56.858779] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:17:56.859016] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-07T19:17:56.859065] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-07T19:17:56.859623] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-07T19:17:56.859715] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-07T19:17:57.240984] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:17:57.378445] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T19:17:57.447607] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-07T19:17:57.468761] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T19:17:58.247728] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-07T19:17:58.996439] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T19:17:59.047674] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-07T19:17:59.231242] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T19:17:59.847659] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-07T19:18:00.391329] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T19:18:00.647716] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-07T19:18:00.975586] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T19:18:01.447629] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-07T19:18:01.514694] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T19:18:02.247712] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-07T19:18:02.428689] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T19:18:03.047727] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-07T19:18:03.368182] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T19:18:03.840397] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T19:18:03.841962] [INFO ] [REMOTE ] GUG: Full fetch complete (19650 records). [2025-10-07T19:18:03.842051] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-07T19:18:03.854434] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-07T19:18:04.210803] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-07T19:18:04.210892] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-07T19:18:04.211348] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-07T19:18:04.211389] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-07T19:18:04.212082] [DEBUG] [LOCAL ] GUG: Trimmed 19650 records to 12172 (keeping 200 days of data) [2025-10-07T19:18:04.290360] [DEBUG] [LOCAL ] GUG: Primary data saved (12172 records). [2025-10-07T19:18:04.290524] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-07T19:18:04.290615] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUG took 32.0s. Estimated remaining: 3h 15m 12s. Rate: 7.1 symbols/min [2025-10-07T19:18:04.460045] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:18:04.500863] [DEBUG] [LOCAL ] GWRE: Loaded 40309 existing records from primary storage. [2025-10-07T19:18:04.501195] [INFO ] [MAIN ] GWRE: Loaded 40309 existing records. [2025-10-07T19:18:04.650562] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-07T19:18:04.690573] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:18:04.690879] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-07T19:18:04.690929] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-07T19:18:04.692105] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-07T19:18:04.692169] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-07T19:18:04.884136] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T19:18:05.078405] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:18:05.447742] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-07T19:18:06.191349] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T19:18:06.247667] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-07T19:18:07.047678] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-07T19:18:07.109091] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T19:18:07.263358] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T19:18:07.847640] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-07T19:18:08.084623] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T19:18:08.647731] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-07T19:18:09.212011] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T19:18:09.447632] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-07T19:18:09.511554] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-07T19:18:10.247673] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-07T19:18:10.757894] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T19:18:10.760335] [INFO ] [REMOTE ] GVA: Full fetch complete (48559 records). [2025-10-07T19:18:10.760425] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-07T19:18:11.052757] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-07T19:18:11.140865] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-07T19:18:11.141028] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-07T19:18:11.150116] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-07T19:18:11.150495] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T19:18:11.150687] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-07T19:18:11.155317] [DEBUG] [LOCAL ] GVA: Trimmed 48559 records to 32996 (keeping 200 days of data) [2025-10-07T19:18:11.363916] [DEBUG] [LOCAL ] GVA: Primary data saved (32996 records). [2025-10-07T19:18:11.364068] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-07T19:18:11.364152] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GVA took 30.3s. Estimated remaining: 3h 15m 1s. Rate: 7.1 symbols/min [2025-10-07T19:18:11.528255] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:18:11.547585] [DEBUG] [LOCAL ] GWW: Loaded 19489 existing records from primary storage. [2025-10-07T19:18:11.547875] [INFO ] [MAIN ] GWW: Loaded 19489 existing records. [2025-10-07T19:18:11.719679] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:18:11.719918] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-07T19:18:11.719965] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-07T19:18:11.720737] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-07T19:18:11.720796] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-07T19:18:11.855418] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-07T19:18:12.071183] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:18:12.647679] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-07T19:18:12.656140] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T19:18:12.695735] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T19:18:13.447625] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-07T19:18:13.701447] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T19:18:14.247639] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-07T19:18:14.987216] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T19:18:15.005015] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T19:18:15.047697] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-07T19:18:15.847739] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-07T19:18:16.111152] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T19:18:16.647693] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-07T19:18:17.447622] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-07T19:18:17.481196] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T19:18:17.533464] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T19:18:18.247631] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-07T19:18:18.464490] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T19:18:19.047696] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-07T19:18:19.773244] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:18:19.847626] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-07T19:18:20.136295] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T19:18:20.647675] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-07T19:18:20.843425] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T19:18:21.447623] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-07T19:18:21.674208] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T19:18:22.247700] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-07T19:18:22.579967] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-07T19:18:23.047709] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-07T19:18:23.852781] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-07T19:18:23.864464] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T19:18:24.235761] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-07T19:18:24.647678] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-07T19:18:25.086566] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T19:18:25.447722] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-07T19:18:26.183031] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T19:18:26.247672] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-07T19:18:26.287711] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T19:18:26.289189] [INFO ] [REMOTE ] GUT: Full fetch complete (22694 records). [2025-10-07T19:18:26.289276] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-07T19:18:26.655881] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-07T19:18:26.655973] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-07T19:18:26.656448] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-07T19:18:26.656489] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-07T19:18:26.657283] [DEBUG] [LOCAL ] GUT: Trimmed 22694 records to 15453 (keeping 200 days of data) [2025-10-07T19:18:26.753187] [DEBUG] [LOCAL ] GUT: Primary data saved (15453 records). [2025-10-07T19:18:26.753347] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-07T19:18:26.753439] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 52.1s. Estimated remaining: 3h 15m 3s. Rate: 7.1 symbols/min [2025-10-07T19:18:26.923533] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:18:26.964800] [DEBUG] [LOCAL ] GXO: Loaded 47204 existing records from primary storage. [2025-10-07T19:18:26.965114] [INFO ] [MAIN ] GXO: Loaded 47204 existing records. [2025-10-07T19:18:27.053506] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-07T19:18:27.145055] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:18:27.145305] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-07T19:18:27.145355] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-07T19:18:27.146715] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-07T19:18:27.146810] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-07T19:18:27.276919] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T19:18:27.520295] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:18:27.847696] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-07T19:18:28.407700] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T19:18:28.647708] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-07T19:18:28.951476] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T19:18:29.424921] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T19:18:29.447686] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-07T19:18:30.247704] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-07T19:18:30.406126] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T19:18:31.047740] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-07T19:18:31.847717] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-07T19:18:31.900436] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T19:18:32.647637] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-07T19:18:32.726806] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T19:18:33.050235] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T19:18:33.052509] [INFO ] [REMOTE ] GWH: Full fetch complete (21878 records). [2025-10-07T19:18:33.052581] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-07T19:18:33.428037] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-07T19:18:33.428117] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-07T19:18:33.428569] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-07T19:18:33.428682] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-07T19:18:33.429295] [DEBUG] [LOCAL ] GWH: Trimmed 21878 records to 16885 (keeping 200 days of data) [2025-10-07T19:18:33.467334] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-07T19:18:33.527018] [DEBUG] [LOCAL ] GWH: Primary data saved (16885 records). [2025-10-07T19:18:33.527143] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-07T19:18:33.527228] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GWH took 37.0s. Estimated remaining: 3h 14m 52s. Rate: 7.1 symbols/min [2025-10-07T19:18:33.712318] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:18:33.715406] [DEBUG] [LOCAL ] GYLD: Loaded 1533 existing records from primary storage. [2025-10-07T19:18:33.715548] [INFO ] [MAIN ] GYLD: Loaded 1533 existing records. [2025-10-07T19:18:33.898537] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:18:33.898781] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-07T19:18:33.898833] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-07T19:18:33.899037] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-07T19:18:33.899096] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-07T19:18:34.012244] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T19:18:34.047973] [INFO ] [REMOTE ] GWRE: Full fetch complete (60716 records). [2025-10-07T19:18:34.071529] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-07T19:18:34.248724] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-07T19:18:34.461410] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:18:34.690066] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-07T19:18:34.690144] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-07T19:18:34.690909] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-07T19:18:34.690973] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-07T19:18:34.692189] [DEBUG] [LOCAL ] GWRE: Trimmed 60716 records to 40202 (keeping 200 days of data) [2025-10-07T19:18:34.939243] [DEBUG] [LOCAL ] GWRE: Primary data saved (40202 records). [2025-10-07T19:18:34.939379] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-07T19:18:34.939464] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWRE took 30.6s. Estimated remaining: 3h 14m 34s. Rate: 7.1 symbols/min [2025-10-07T19:18:35.049281] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-07T19:18:35.134399] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:18:35.183477] [DEBUG] [LOCAL ] H: Loaded 44555 existing records from primary storage. [2025-10-07T19:18:35.184028] [INFO ] [MAIN ] H: Loaded 44555 existing records. [2025-10-07T19:18:35.382509] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:18:35.399817] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-07T19:18:35.413904] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-07T19:18:35.416871] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-07T19:18:35.416781] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T19:18:35.417111] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-07T19:18:35.463761] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-07T19:18:35.609200] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-07T19:18:35.843915] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:18:35.847616] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-07T19:18:36.647735] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-07T19:18:37.305601] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T19:18:37.447736] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-07T19:18:38.247750] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-07T19:18:38.306457] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T19:18:38.387417] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T19:18:39.047718] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-07T19:18:39.368696] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T19:18:39.847762] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-07T19:18:40.647696] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-07T19:18:40.767855] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T19:18:40.911445] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-07T19:18:40.937383] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T19:18:41.447737] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-07T19:18:41.813990] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-07T19:18:42.247734] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-07T19:18:43.047706] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-07T19:18:43.520836] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T19:18:43.847712] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-07T19:18:43.880812] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T19:18:44.647739] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-07T19:18:45.177669] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T19:18:45.416457] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T19:18:45.447626] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-07T19:18:46.247728] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-07T19:18:47.047745] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-07T19:18:47.119441] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T19:18:47.173050] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T19:18:47.175110] [INFO ] [REMOTE ] GWW: Full fetch complete (29227 records). [2025-10-07T19:18:47.175211] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-07T19:18:47.559236] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-07T19:18:47.559325] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-07T19:18:47.559857] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-07T19:18:47.559918] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-07T19:18:47.560574] [DEBUG] [LOCAL ] GWW: Trimmed 29227 records to 19466 (keeping 200 days of data) [2025-10-07T19:18:47.685522] [DEBUG] [LOCAL ] GWW: Primary data saved (19466 records). [2025-10-07T19:18:47.685704] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-07T19:18:47.685862] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWW took 36.3s. Estimated remaining: 3h 14m 31s. Rate: 7.1 symbols/min [2025-10-07T19:18:47.856876] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-07T19:18:47.860690] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:18:47.904383] [DEBUG] [LOCAL ] HAE: Loaded 39450 existing records from primary storage. [2025-10-07T19:18:47.904707] [INFO ] [MAIN ] HAE: Loaded 39450 existing records. [2025-10-07T19:18:48.080226] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:18:48.080472] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-07T19:18:48.080519] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-07T19:18:48.080831] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-07T19:18:48.080889] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-07T19:18:48.320582] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-07T19:18:48.446970] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:18:48.647634] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-07T19:18:48.734255] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T19:18:49.447750] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-07T19:18:50.086513] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T19:18:50.247698] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-07T19:18:50.738083] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T19:18:51.047704] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-07T19:18:51.796884] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T19:18:51.847679] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-07T19:18:52.630807] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T19:18:52.647598] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-07T19:18:53.441443] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T19:18:53.450497] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-07T19:18:54.180800] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T19:18:54.247612] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-07T19:18:54.942207] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T19:18:55.047669] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-07T19:18:55.823254] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T19:18:55.847613] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-07T19:18:56.647609] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-07T19:18:56.690504] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T19:18:57.088432] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-07T19:18:57.378751] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T19:18:57.447602] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-07T19:18:58.247758] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-07T19:18:58.513503] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T19:18:59.047710] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-07T19:18:59.800599] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T19:18:59.847633] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-07T19:19:00.333742] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T19:19:00.647755] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-07T19:19:01.447758] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-07T19:19:01.934046] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-07T19:19:02.013629] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-07T19:19:02.247692] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-07T19:19:02.726056] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-07T19:19:03.052716] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-07T19:19:03.065599] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T19:19:03.847698] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-07T19:19:04.413426] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T19:19:04.647675] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-07T19:19:05.169042] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T19:19:05.447690] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-07T19:19:05.688409] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T19:19:05.691524] [INFO ] [REMOTE ] H: Full fetch complete (62483 records). [2025-10-07T19:19:05.691663] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-07T19:19:06.077418] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-07T19:19:06.077505] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-07T19:19:06.078303] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-07T19:19:06.078369] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-07T19:19:06.079584] [DEBUG] [LOCAL ] H: Trimmed 62483 records to 44572 (keeping 200 days of data) [2025-10-07T19:19:06.261511] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-07T19:19:06.366706] [DEBUG] [LOCAL ] H: Primary data saved (44572 records). [2025-10-07T19:19:06.366979] [INFO ] [MAIN ] H: Full history saved. [2025-10-07T19:19:06.367152] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. H took 31.4s. Estimated remaining: 3h 14m 37s. Rate: 7.1 symbols/min [2025-10-07T19:19:06.544762] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:19:06.583398] [DEBUG] [LOCAL ] HAFN: Loaded 43169 existing records from primary storage. [2025-10-07T19:19:06.583728] [INFO ] [MAIN ] HAFN: Loaded 43169 existing records. [2025-10-07T19:19:06.760983] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:19:06.761261] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-07T19:19:06.761318] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-07T19:19:06.761516] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-07T19:19:06.761572] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-07T19:19:06.867571] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T19:19:06.897429] [INFO ] [REMOTE ] GXO: Full fetch complete (69852 records). [2025-10-07T19:19:06.919732] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-07T19:19:07.061220] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-07T19:19:07.433436] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:19:07.528733] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-07T19:19:07.528848] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-07T19:19:07.529819] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-07T19:19:07.529895] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-07T19:19:07.534006] [DEBUG] [LOCAL ] GXO: Trimmed 69852 records to 47159 (keeping 200 days of data) [2025-10-07T19:19:07.712540] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-07T19:19:07.815257] [DEBUG] [LOCAL ] GXO: Primary data saved (47159 records). [2025-10-07T19:19:07.815399] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-07T19:19:07.815485] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GXO took 41.1s. Estimated remaining: 3h 14m 19s. Rate: 7.1 symbols/min [2025-10-07T19:19:07.852800] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-07T19:19:07.989389] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:19:08.015704] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T19:19:08.075620] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-07T19:19:08.075974] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-07T19:19:08.257667] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:19:08.257894] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-07T19:19:08.257946] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-07T19:19:08.258182] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-07T19:19:08.258240] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-07T19:19:08.410579] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T19:19:08.628375] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:19:08.647598] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-07T19:19:09.447686] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-07T19:19:10.247631] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-07T19:19:10.582944] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T19:19:11.047691] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-07T19:19:11.313531] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T19:19:11.430937] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T19:19:11.847697] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-07T19:19:12.229225] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T19:19:12.230028] [INFO ] [REMOTE ] GYLD: Full fetch complete (2074 records). [2025-10-07T19:19:12.230097] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-07T19:19:12.584359] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-07T19:19:12.584492] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-07T19:19:12.584598] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-07T19:19:12.584637] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-07T19:19:12.585069] [DEBUG] [LOCAL ] GYLD: Trimmed 2074 records to 1538 (keeping 200 days of data) [2025-10-07T19:19:12.595362] [DEBUG] [LOCAL ] GYLD: Primary data saved (1538 records). [2025-10-07T19:19:12.595427] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-07T19:19:12.595526] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GYLD took 39.1s. Estimated remaining: 3h 14m 5s. Rate: 7.1 symbols/min [2025-10-07T19:19:12.655090] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-07T19:19:12.765701] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:19:12.815592] [DEBUG] [LOCAL ] HASI: Loaded 47215 existing records from primary storage. [2025-10-07T19:19:12.815965] [INFO ] [MAIN ] HASI: Loaded 47215 existing records. [2025-10-07T19:19:12.993251] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:19:12.993620] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-07T19:19:12.993716] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-07T19:19:12.993927] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-07T19:19:12.993989] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-07T19:19:13.149310] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T19:19:13.393899] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:19:13.447614] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-07T19:19:14.247681] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-07T19:19:14.663154] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-07T19:19:14.996080] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T19:19:15.047614] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-07T19:19:15.824626] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T19:19:15.847597] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-07T19:19:16.591247] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T19:19:16.647689] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-07T19:19:17.447669] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-07T19:19:17.796683] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-07T19:19:18.247621] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-07T19:19:18.427448] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T19:19:18.586785] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T19:19:19.047694] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-07T19:19:19.847712] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-07T19:19:19.893684] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-07T19:19:19.897168] [INFO ] [REMOTE ] HAE: Full fetch complete (58478 records). [2025-10-07T19:19:19.897259] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-07T19:19:20.287337] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-07T19:19:20.287432] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-07T19:19:20.288268] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-07T19:19:20.288334] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-07T19:19:20.290525] [DEBUG] [LOCAL ] HAE: Trimmed 58478 records to 39434 (keeping 200 days of data) [2025-10-07T19:19:20.526534] [DEBUG] [LOCAL ] HAE: Primary data saved (39434 records). [2025-10-07T19:19:20.526746] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-07T19:19:20.526869] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. HAE took 32.8s. Estimated remaining: 3h 13m 56s. Rate: 7.1 symbols/min [2025-10-07T19:19:20.652806] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-07T19:19:20.704117] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:19:20.750042] [DEBUG] [LOCAL ] HAYW: Loaded 48771 existing records from primary storage. [2025-10-07T19:19:20.750464] [INFO ] [MAIN ] HAYW: Loaded 48771 existing records. [2025-10-07T19:19:20.928085] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:19:20.928409] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-07T19:19:20.928476] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-07T19:19:20.928898] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-07T19:19:20.928984] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-07T19:19:21.104047] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-07T19:19:21.340470] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:19:21.421000] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T19:19:21.447599] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-07T19:19:22.116805] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T19:19:22.247708] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-07T19:19:23.010310] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T19:19:23.047676] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-07T19:19:23.847718] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-07T19:19:24.278672] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T19:19:24.323913] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-07T19:19:24.647697] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-07T19:19:25.447634] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-07T19:19:25.638849] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T19:19:26.253164] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-07T19:19:26.258921] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T19:19:26.985189] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T19:19:27.047602] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-07T19:19:27.847671] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-07T19:19:27.898427] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T19:19:28.628078] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T19:19:28.647614] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-07T19:19:29.080827] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T19:19:29.447758] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-07T19:19:30.219790] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T19:19:30.247611] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-07T19:19:31.054558] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-07T19:19:31.057579] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T19:19:31.847718] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-07T19:19:31.931206] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T19:19:32.647682] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-07T19:19:33.074135] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-07T19:19:33.447744] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-07T19:19:33.484631] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T19:19:33.976033] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T19:19:34.247741] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-07T19:19:35.047732] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-07T19:19:35.442902] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-07T19:19:35.735392] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T19:19:35.739523] [INFO ] [REMOTE ] HASI: Full fetch complete (68076 records). [2025-10-07T19:19:35.739696] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-07T19:19:35.852813] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-07T19:19:36.126612] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-07T19:19:36.126737] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-07T19:19:36.127593] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-07T19:19:36.127685] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-07T19:19:36.129143] [DEBUG] [LOCAL ] HASI: Trimmed 68076 records to 47253 (keeping 200 days of data) [2025-10-07T19:19:36.400269] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T19:19:36.471806] [DEBUG] [LOCAL ] HASI: Primary data saved (47253 records). [2025-10-07T19:19:36.471958] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-07T19:19:36.472045] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HASI took 23.9s. Estimated remaining: 3h 13m 58s. Rate: 7.1 symbols/min [2025-10-07T19:19:36.646946] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:19:36.647707] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-07T19:19:36.657081] [DEBUG] [LOCAL ] HBB: Loaded 6528 existing records from primary storage. [2025-10-07T19:19:36.657349] [INFO ] [MAIN ] HBB: Loaded 6528 existing records. [2025-10-07T19:19:36.871837] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:19:36.872115] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-07T19:19:36.872171] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-07T19:19:36.872376] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-07T19:19:36.872435] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-07T19:19:37.219108] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:19:37.447704] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-07T19:19:37.848941] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T19:19:38.236753] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T19:19:38.247599] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-07T19:19:39.047727] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-07T19:19:39.102556] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T19:19:39.825266] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T19:19:39.847680] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-07T19:19:40.653632] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-07T19:19:40.668295] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T19:19:41.452750] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-07T19:19:41.467364] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T19:19:42.120594] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T19:19:42.247704] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-07T19:19:43.047692] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-07T19:19:43.208852] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-07T19:19:43.213259] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-07T19:19:43.213413] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-07T19:19:43.339307] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T19:19:43.378078] [INFO ] [REMOTE ] HAFN: Full fetch complete (65323 records). [2025-10-07T19:19:43.387634] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-07T19:19:43.856549] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-07T19:19:43.912767] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-07T19:19:43.918150] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-07T19:19:43.932005] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-07T19:19:43.937306] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-07T19:19:43.980949] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T19:19:44.028336] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-10-07T19:19:44.140268] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-07T19:19:44.170016] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-07T19:19:44.171723] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-07T19:19:44.171844] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-07T19:19:44.194746] [DEBUG] [LOCAL ] HAFN: Trimmed 65323 records to 43197 (keeping 200 days of data) [2025-10-07T19:19:44.649425] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-07T19:19:44.706090] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-07T19:19:44.707148] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-07T19:19:44.708215] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAL took 36.9s. Estimated remaining: 3h 13m 50s. Rate: 7.1 symbols/min [2025-10-07T19:19:44.831590] [DEBUG] [LOCAL ] HAFN: Primary data saved (43197 records). [2025-10-07T19:19:44.851836] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-07T19:19:44.852066] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAFN took 38.5s. Estimated remaining: 3h 13m 30s. Rate: 7.1 symbols/min [2025-10-07T19:19:45.052397] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:19:45.120445] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:19:45.182263] [DEBUG] [LOCAL ] HBI: Loaded 52991 existing records from primary storage. [2025-10-07T19:19:45.182757] [INFO ] [MAIN ] HBI: Loaded 52991 existing records. [2025-10-07T19:19:45.318001] [DEBUG] [LOCAL ] HBM: Loaded 52914 existing records from primary storage. [2025-10-07T19:19:45.318433] [INFO ] [MAIN ] HBM: Loaded 52914 existing records. [2025-10-07T19:19:45.482965] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:19:45.500429] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-07T19:19:45.513295] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-07T19:19:45.517600] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-07T19:19:45.523120] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-07T19:19:45.683945] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:19:45.703677] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-07T19:19:45.708122] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-07T19:19:45.760118] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-07T19:19:45.763905] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T19:19:45.788780] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-07T19:19:45.822319] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-07T19:19:46.098918] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-07T19:19:46.176390] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:19:46.252755] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-07T19:19:46.393421] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:19:46.510275] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T19:19:47.047726] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-07T19:19:47.847624] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-07T19:19:48.124427] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T19:19:48.626743] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T19:19:48.647617] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-07T19:19:49.198028] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T19:19:49.447740] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-07T19:19:50.232904] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T19:19:50.247624] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-07T19:19:50.287225] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T19:19:51.047701] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-07T19:19:51.114867] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T19:19:51.847695] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-07T19:19:52.582867] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T19:19:52.647626] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-07T19:19:53.447692] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-07T19:19:53.522414] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T19:19:54.252887] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-07T19:19:54.276297] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:19:54.999373] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T19:19:55.052785] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-07T19:19:55.066955] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T19:19:55.684860] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T19:19:55.847728] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-07T19:19:56.647708] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-07T19:19:57.207428] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T19:19:57.212027] [INFO ] [REMOTE ] HAYW: Full fetch complete (70814 records). [2025-10-07T19:19:57.212163] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-07T19:19:57.457303] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-07T19:19:57.629481] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-07T19:19:57.629576] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-07T19:19:57.630556] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-07T19:19:57.630635] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-07T19:19:57.632249] [DEBUG] [LOCAL ] HAYW: Trimmed 70814 records to 48748 (keeping 200 days of data) [2025-10-07T19:19:57.923404] [DEBUG] [LOCAL ] HAYW: Primary data saved (48748 records). [2025-10-07T19:19:57.923554] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-07T19:19:57.923660] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HAYW took 37.4s. Estimated remaining: 3h 13m 28s. Rate: 7.1 symbols/min [2025-10-07T19:19:58.102119] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:19:58.147951] [DEBUG] [LOCAL ] HCA: Loaded 46826 existing records from primary storage. [2025-10-07T19:19:58.148310] [INFO ] [MAIN ] HCA: Loaded 46826 existing records. [2025-10-07T19:19:58.254002] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-07T19:19:58.264849] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T19:19:58.353165] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:19:58.353525] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-07T19:19:58.353581] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-07T19:19:58.354081] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-07T19:19:58.354142] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-07T19:19:58.754040] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-07T19:19:58.757284] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:19:59.047705] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-07T19:19:59.847711] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-07T19:19:59.949358] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T19:20:00.647743] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-07T19:20:00.730262] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T19:20:01.309991] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-07T19:20:01.447701] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-07T19:20:02.247705] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-07T19:20:02.607009] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T19:20:02.760638] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T19:20:03.047697] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-07T19:20:03.390119] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-07T19:20:03.663125] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T19:20:03.847689] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-07T19:20:04.647679] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-07T19:20:05.447620] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-07T19:20:05.672566] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T19:20:05.957033] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T19:20:05.958009] [INFO ] [REMOTE ] HBB: Full fetch complete (9489 records). [2025-10-07T19:20:05.958089] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-07T19:20:06.252897] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-07T19:20:06.326299] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-07T19:20:06.326612] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-07T19:20:06.327026] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-07T19:20:06.327140] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-07T19:20:06.327998] [DEBUG] [LOCAL ] HBB: Trimmed 9489 records to 6499 (keeping 200 days of data) [2025-10-07T19:20:06.370422] [DEBUG] [LOCAL ] HBB: Primary data saved (6499 records). [2025-10-07T19:20:06.370637] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-07T19:20:06.370773] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HBB took 29.9s. Estimated remaining: 3h 13m 19s. Rate: 7.1 symbols/min [2025-10-07T19:20:06.552383] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:20:06.570978] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-07T19:20:06.621097] [DEBUG] [LOCAL ] HCC: Loaded 45347 existing records from primary storage. [2025-10-07T19:20:06.621439] [INFO ] [MAIN ] HCC: Loaded 45347 existing records. [2025-10-07T19:20:06.792671] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:20:06.792929] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-07T19:20:06.792979] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-07T19:20:06.793199] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-07T19:20:06.793257] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-07T19:20:07.052908] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-07T19:20:07.148829] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:20:07.847775] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-07T19:20:08.253029] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T19:20:08.647732] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-07T19:20:08.778141] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T19:20:09.447639] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-07T19:20:09.772673] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T19:20:09.833181] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T19:20:10.247613] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-07T19:20:10.938312] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T19:20:11.047603] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-07T19:20:11.852871] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-07T19:20:11.865617] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T19:20:12.498535] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T19:20:12.647732] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-07T19:20:13.447627] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-07T19:20:13.700136] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T19:20:14.201383] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T19:20:14.247632] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-07T19:20:15.047671] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-07T19:20:15.286994] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T19:20:15.847623] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-07T19:20:15.959988] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T19:20:16.647744] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-07T19:20:16.941787] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T19:20:17.196831] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T19:20:17.447742] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-07T19:20:18.247680] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-07T19:20:18.431614] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T19:20:19.047741] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-07T19:20:19.339007] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T19:20:19.563613] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T19:20:19.847699] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-07T19:20:20.647738] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-07T19:20:20.778676] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:20:21.447673] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-07T19:20:21.555705] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T19:20:22.246628] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T19:20:22.250262] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-07T19:20:22.251329] [INFO ] [REMOTE ] HBM: Full fetch complete (76285 records). [2025-10-07T19:20:22.251418] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-07T19:20:22.649200] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-07T19:20:22.649316] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-07T19:20:22.650245] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-07T19:20:22.650316] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-07T19:20:22.651916] [DEBUG] [LOCAL ] HBM: Trimmed 76285 records to 52924 (keeping 200 days of data) [2025-10-07T19:20:22.984568] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T19:20:23.005132] [DEBUG] [LOCAL ] HBM: Primary data saved (52924 records). [2025-10-07T19:20:23.005246] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-07T19:20:23.005337] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HBM took 38.2s. Estimated remaining: 3h 13m 22s. Rate: 7.1 symbols/min [2025-10-07T19:20:23.047595] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-07T19:20:23.847759] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-07T19:20:23.909599] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T19:20:24.609166] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T19:20:24.647720] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-07T19:20:25.292953] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-07T19:20:25.296475] [INFO ] [REMOTE ] HBI: Full fetch complete (76881 records). [2025-10-07T19:20:25.296618] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-07T19:20:25.453209] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-07T19:20:25.702632] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-07T19:20:25.702824] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-07T19:20:25.703837] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-07T19:20:25.703966] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-07T19:20:25.705492] [DEBUG] [LOCAL ] HBI: Trimmed 76881 records to 52991 (keeping 200 days of data) [2025-10-07T19:20:25.953961] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T19:20:26.055387] [DEBUG] [LOCAL ] HBI: Primary data saved (52991 records). [2025-10-07T19:20:26.055549] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-07T19:20:26.055669] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 41.3s. Estimated remaining: 3h 13m 6s. Rate: 7.1 symbols/min [2025-10-07T19:20:26.247708] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-07T19:20:27.348549] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T19:20:27.359471] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-07T19:20:27.746867] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T19:20:27.847675] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-07T19:20:28.959245] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T19:20:28.969419] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-07T19:20:29.213157] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T19:20:29.216202] [INFO ] [REMOTE ] HCC: Full fetch complete (64701 records). [2025-10-07T19:20:29.216294] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-07T19:20:29.591866] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-07T19:20:29.591962] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-07T19:20:29.592796] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-07T19:20:29.592866] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-07T19:20:29.594273] [DEBUG] [LOCAL ] HCC: Trimmed 64701 records to 45348 (keeping 200 days of data) [2025-10-07T19:20:29.863574] [DEBUG] [LOCAL ] HCC: Primary data saved (45348 records). [2025-10-07T19:20:29.863765] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-07T19:20:29.863852] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HCC took 23.5s. Estimated remaining: 3h 12m 51s. Rate: 7.1 symbols/min [2025-10-07T19:20:30.637004] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-07T19:20:30.646599] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-07T19:20:32.587755] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-07T19:20:32.590827] [INFO ] [REMOTE ] HCA: Full fetch complete (68754 records). [2025-10-07T19:20:32.590923] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-07T19:20:32.974373] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-07T19:20:32.974450] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-07T19:20:32.975293] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-07T19:20:32.975357] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-07T19:20:32.976635] [DEBUG] [LOCAL ] HCA: Trimmed 68754 records to 46862 (keeping 200 days of data) [2025-10-07T19:20:33.283712] [DEBUG] [LOCAL ] HCA: Primary data saved (46862 records). [2025-10-07T19:20:33.283820] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-07T19:20:33.284972] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCA took 35.4s. Estimated remaining: 3h 12m 36s. Rate: 7.1 symbols/min [2025-10-07T19:20:33.802977] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:20:33.892197] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:20:33.963956] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:20:33.996693] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:20:33.997261] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-07T19:20:33.997332] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-07T19:20:33.997467] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-07T19:20:33.998153] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-07T19:20:33.998225] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-07T19:20:33.998262] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-07T19:20:34.140499] [DEBUG] [LOCAL ] HCI: Loaded 13998 existing records from primary storage. [2025-10-07T19:20:34.210432] [INFO ] [MAIN ] HCI: Loaded 13998 existing records. [2025-10-07T19:20:34.360774] [DEBUG] [LOCAL ] HDB: Loaded 51935 existing records from primary storage. [2025-10-07T19:20:34.427955] [INFO ] [MAIN ] HDB: Loaded 51935 existing records. [2025-10-07T19:20:34.557534] [DEBUG] [LOCAL ] HD: Loaded 53493 existing records from primary storage. [2025-10-07T19:20:34.691275] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:20:34.706993] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-07T19:20:34.699175] [INFO ] [MAIN ] HD: Loaded 53493 existing records. [2025-10-07T19:20:34.726499] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:20:34.814166] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-07T19:20:34.866322] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-07T19:20:34.935994] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:20:34.936236] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-07T19:20:34.936313] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-07T19:20:34.936712] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-07T19:20:34.936296] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-07T19:20:34.977686] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-07T19:20:35.040343] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-07T19:20:35.113955] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:20:35.187443] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T19:20:35.197922] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-07T19:20:35.198964] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-07T19:20:35.199071] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-07T19:20:35.240371] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-07T19:20:35.366509] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-07T19:20:35.604297] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-07T19:20:35.651865] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-07T19:20:35.899157] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:20:35.922685] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-07T19:20:36.006375] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:20:36.029227] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-07T19:20:36.175754] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:20:36.177555] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-07T19:20:36.177888] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-07T19:20:36.178764] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-07T19:20:36.499762] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-07T19:20:36.500610] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-07T19:20:36.751371] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-07T19:20:36.752228] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-07T19:20:36.969953] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T19:20:36.989099] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-07T19:20:37.447588] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-07T19:20:37.528401] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T19:20:37.849185] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T19:20:37.969178] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-07T19:20:38.247661] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-07T19:20:38.577234] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-07T19:20:39.047731] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-07T19:20:39.847633] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-07T19:20:39.856332] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T19:20:40.106969] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-07T19:20:40.647676] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-07T19:20:40.962865] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-07T19:20:41.447710] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-07T19:20:42.247750] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-07T19:20:42.489477] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-07T19:20:43.047621] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-07T19:20:43.133498] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T19:20:43.396902] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-07T19:20:43.397592] [INFO ] [REMOTE ] HCXY: Full fetch complete (538 records). [2025-10-07T19:20:43.397685] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-07T19:20:43.573060] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-07T19:20:43.573265] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:20:43.573337] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:20:43.573413] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-07T19:20:43.573507] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-07T19:20:43.573564] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-07T19:20:43.573626] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-07T19:20:43.573735] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 10.3s. Estimated remaining: 3h 12m 30s. Rate: 7.1 symbols/min [2025-10-07T19:20:43.741257] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:20:43.787429] [DEBUG] [LOCAL ] HE: Loaded 48994 existing records from primary storage. [2025-10-07T19:20:43.787895] [INFO ] [MAIN ] HE: Loaded 48994 existing records. [2025-10-07T19:20:43.852955] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-07T19:20:43.971007] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:20:43.971228] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-07T19:20:43.971307] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-07T19:20:43.971547] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-07T19:20:43.971609] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-07T19:20:44.322904] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:20:44.647735] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-07T19:20:45.353237] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T19:20:45.447606] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-07T19:20:45.513825] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T19:20:46.247725] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-07T19:20:47.047681] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-07T19:20:47.174785] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T19:20:47.847685] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-07T19:20:47.984975] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T19:20:48.242597] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-07T19:20:48.647750] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-07T19:20:49.452832] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-07T19:20:49.473706] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T19:20:50.247726] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-07T19:20:50.627812] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-07T19:20:51.047725] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-07T19:20:51.287178] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T19:20:51.847718] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-07T19:20:52.042913] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T19:20:52.647671] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-07T19:20:53.096414] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-07T19:20:53.447727] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-07T19:20:53.593765] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T19:20:54.134407] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T19:20:54.247708] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-07T19:20:54.282976] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T19:20:55.047724] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-07T19:20:55.847617] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-07T19:20:55.906761] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T19:20:56.082783] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T19:20:56.647689] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-07T19:20:57.447616] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-07T19:20:57.662886] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T19:20:57.969096] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T19:20:58.247682] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-07T19:20:58.471891] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-07T19:20:59.047757] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-07T19:20:59.847623] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-07T19:21:00.000203] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T19:21:00.054427] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T19:21:00.647689] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-07T19:21:01.447684] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-07T19:21:02.043187] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-07T19:21:02.247690] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-07T19:21:02.352783] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T19:21:02.389106] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T19:21:03.047736] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-07T19:21:03.847735] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-07T19:21:03.928388] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T19:21:03.929892] [INFO ] [REMOTE ] HCI: Full fetch complete (19527 records). [2025-10-07T19:21:03.929972] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-07T19:21:04.299193] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-07T19:21:04.299276] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-07T19:21:04.299834] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-07T19:21:04.299932] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-07T19:21:04.300777] [DEBUG] [LOCAL ] HCI: Trimmed 19527 records to 14035 (keeping 200 days of data) [2025-10-07T19:21:04.399226] [DEBUG] [LOCAL ] HCI: Primary data saved (14035 records). [2025-10-07T19:21:04.399380] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-07T19:21:04.399465] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 31.1s. Estimated remaining: 3h 12m 39s. Rate: 7.1 symbols/min [2025-10-07T19:21:04.582793] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:21:04.619313] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-07T19:21:04.648529] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-07T19:21:04.663568] [DEBUG] [LOCAL ] HEI: Loaded 31769 existing records from primary storage. [2025-10-07T19:21:04.663956] [INFO ] [MAIN ] HEI: Loaded 31769 existing records. [2025-10-07T19:21:04.840702] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:21:04.840952] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-07T19:21:04.841009] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-07T19:21:04.841294] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-07T19:21:04.841351] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-07T19:21:05.193257] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:21:05.447617] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-07T19:21:05.509583] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T19:21:06.247722] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-07T19:21:06.610031] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T19:21:07.001279] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T19:21:07.047630] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-07T19:21:07.852742] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-07T19:21:07.868082] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T19:21:08.562846] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T19:21:08.647603] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-07T19:21:09.138998] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T19:21:09.142452] [INFO ] [REMOTE ] HDB: Full fetch complete (75309 records). [2025-10-07T19:21:09.142582] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-07T19:21:09.452791] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-07T19:21:09.538797] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-07T19:21:09.538900] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-07T19:21:09.540030] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-07T19:21:09.540107] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-07T19:21:09.542108] [DEBUG] [LOCAL ] HDB: Trimmed 75309 records to 51936 (keeping 200 days of data) [2025-10-07T19:21:09.887595] [DEBUG] [LOCAL ] HDB: Primary data saved (51936 records). [2025-10-07T19:21:09.887794] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-07T19:21:09.887901] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HDB took 36.6s. Estimated remaining: 3h 12m 26s. Rate: 7.1 symbols/min [2025-10-07T19:21:10.063204] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:21:10.072046] [DEBUG] [LOCAL ] HEQ: Loaded 6477 existing records from primary storage. [2025-10-07T19:21:10.072321] [INFO ] [MAIN ] HEQ: Loaded 6477 existing records. [2025-10-07T19:21:10.252275] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-07T19:21:10.274365] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:21:10.275747] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:21:10.283522] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-07T19:21:10.283976] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-07T19:21:10.284196] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-07T19:21:10.284255] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-07T19:21:10.632515] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:21:11.047761] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-07T19:21:11.592197] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-07T19:21:11.847739] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-07T19:21:11.988291] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T19:21:12.131165] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-07T19:21:12.647712] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-07T19:21:13.447715] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-07T19:21:14.073905] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-07T19:21:14.078024] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-07T19:21:14.247706] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-07T19:21:14.401446] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T19:21:15.047758] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-07T19:21:15.667187] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-07T19:21:15.847682] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-07T19:21:16.345237] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-07T19:21:16.647691] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-07T19:21:17.447690] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-07T19:21:17.555730] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T19:21:18.064730] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T19:21:18.170687] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T19:21:18.247612] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-07T19:21:19.047684] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-07T19:21:19.454072] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T19:21:19.847756] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-07T19:21:20.207737] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T19:21:20.211028] [INFO ] [REMOTE ] HE: Full fetch complete (72270 records). [2025-10-07T19:21:20.211157] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-07T19:21:20.604608] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-07T19:21:20.604822] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-07T19:21:20.605908] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-07T19:21:20.605980] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-07T19:21:20.611025] [DEBUG] [LOCAL ] HE: Trimmed 72270 records to 48998 (keeping 200 days of data) [2025-10-07T19:21:20.662254] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-07T19:21:20.945535] [DEBUG] [LOCAL ] HE: Primary data saved (48998 records). [2025-10-07T19:21:20.945701] [INFO ] [MAIN ] HE: Full history saved. [2025-10-07T19:21:20.945797] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HE took 37.4s. Estimated remaining: 3h 12m 21s. Rate: 7.1 symbols/min [2025-10-07T19:21:21.114008] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:21:21.158408] [DEBUG] [LOCAL ] HESM: Loaded 48236 existing records from primary storage. [2025-10-07T19:21:21.158746] [INFO ] [MAIN ] HESM: Loaded 48236 existing records. [2025-10-07T19:21:21.329676] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:21:21.329993] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-07T19:21:21.330053] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-07T19:21:21.330999] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-07T19:21:21.331061] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-07T19:21:21.452946] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-07T19:21:21.684974] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:21:21.959252] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-07T19:21:22.118872] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T19:21:22.164635] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T19:21:22.247681] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-07T19:21:22.706325] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-07T19:21:23.047702] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-07T19:21:23.654618] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T19:21:23.847685] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-07T19:21:24.601422] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T19:21:24.647695] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-07T19:21:25.447745] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-07T19:21:25.945687] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T19:21:26.247751] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-07T19:21:27.034577] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T19:21:27.047594] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-07T19:21:27.847711] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-07T19:21:28.145313] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-07T19:21:28.148837] [INFO ] [REMOTE ] HD: Full fetch complete (77446 records). [2025-10-07T19:21:28.148940] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-07T19:21:28.555466] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-07T19:21:28.555765] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-07T19:21:28.562108] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-07T19:21:28.570953] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T19:21:28.578554] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-07T19:21:28.589251] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T19:21:28.599328] [DEBUG] [LOCAL ] HD: Trimmed 77446 records to 53492 (keeping 200 days of data) [2025-10-07T19:21:28.657389] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-07T19:21:28.943981] [DEBUG] [LOCAL ] HD: Primary data saved (53492 records). [2025-10-07T19:21:28.944118] [INFO ] [MAIN ] HD: Full history saved. [2025-10-07T19:21:28.944202] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HD took 55.7s. Estimated remaining: 3h 12m 12s. Rate: 7.1 symbols/min [2025-10-07T19:21:29.108194] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:21:29.108372] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-07T19:21:29.108426] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-07T19:21:29.108532] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-07T19:21:29.108573] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-07T19:21:29.108616] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-07T19:21:29.108673] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-07T19:21:29.459019] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:21:29.454277] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-07T19:21:30.186822] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T19:21:30.247693] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-07T19:21:30.831910] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T19:21:31.047739] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-07T19:21:31.847736] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-07T19:21:31.898705] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T19:21:31.964550] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T19:21:32.509354] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-07T19:21:32.647756] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-07T19:21:33.405077] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T19:21:33.447711] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-07T19:21:34.247732] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-07T19:21:34.670777] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-07T19:21:35.047780] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-07T19:21:35.102057] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T19:21:35.397779] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T19:21:35.847686] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-07T19:21:36.154208] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-07T19:21:36.647697] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-07T19:21:37.447721] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-07T19:21:38.217913] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T19:21:38.219088] [INFO ] [REMOTE ] HEQ: Full fetch complete (9384 records). [2025-10-07T19:21:38.219191] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-07T19:21:38.252811] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-07T19:21:38.629129] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-07T19:21:38.629318] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-07T19:21:38.629713] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-07T19:21:38.629794] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-07T19:21:38.630499] [DEBUG] [LOCAL ] HEQ: Trimmed 9384 records to 6524 (keeping 200 days of data) [2025-10-07T19:21:38.651858] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-07T19:21:38.702163] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-07T19:21:38.715320] [DEBUG] [LOCAL ] HEQ: Primary data saved (6524 records). [2025-10-07T19:21:38.715824] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-07T19:21:38.715920] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEQ took 28.8s. Estimated remaining: 3h 12m 6s. Rate: 7.1 symbols/min [2025-10-07T19:21:38.894601] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:21:38.894849] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-07T19:21:38.894899] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-07T19:21:38.895029] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-07T19:21:38.895072] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-07T19:21:38.895115] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-07T19:21:38.895149] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-07T19:21:39.057606] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-07T19:21:39.263098] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:21:39.847700] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-07T19:21:40.156273] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T19:21:40.158583] [INFO ] [REMOTE ] HEI: Full fetch complete (48390 records). [2025-10-07T19:21:40.158704] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-07T19:21:40.312109] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-07T19:21:40.539802] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-07T19:21:40.539886] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-07T19:21:40.540612] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-07T19:21:40.540684] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-07T19:21:40.541726] [DEBUG] [LOCAL ] HEI: Trimmed 48390 records to 31750 (keeping 200 days of data) [2025-10-07T19:21:40.647843] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-07T19:21:40.758884] [DEBUG] [LOCAL ] HEI: Primary data saved (31750 records). [2025-10-07T19:21:40.759168] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-07T19:21:40.759294] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HEI took 36.4s. Estimated remaining: 3h 11m 49s. Rate: 7.1 symbols/min [2025-10-07T19:21:40.930174] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:21:40.949397] [DEBUG] [LOCAL ] HFRO: Loaded 17511 existing records from primary storage. [2025-10-07T19:21:40.949667] [INFO ] [MAIN ] HFRO: Loaded 17511 existing records. [2025-10-07T19:21:41.130307] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:21:41.130557] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-07T19:21:41.130607] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-07T19:21:41.130913] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-07T19:21:41.130973] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-07T19:21:41.452763] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-07T19:21:41.490456] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:21:41.749448] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-07T19:21:42.247676] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-07T19:21:42.311965] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T19:21:42.498590] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-07T19:21:43.047680] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-07T19:21:43.302785] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-07T19:21:43.847739] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-07T19:21:44.457245] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T19:21:44.647706] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-07T19:21:44.873620] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-07T19:21:45.447680] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-07T19:21:46.247736] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-07T19:21:47.047628] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-07T19:21:47.122371] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T19:21:47.281906] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-07T19:21:47.444108] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T19:21:47.847677] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-07T19:21:48.647623] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-07T19:21:48.932469] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T19:21:48.988287] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-07T19:21:49.447772] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-07T19:21:49.871235] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-07T19:21:50.247685] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-07T19:21:50.712779] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T19:21:50.713450] [INFO ] [REMOTE ] HF: Full fetch complete (449 records). [2025-10-07T19:21:50.713521] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-07T19:21:50.906071] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-07T19:21:50.906287] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:21:50.906359] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:21:50.906432] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-07T19:21:50.906499] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-07T19:21:50.906536] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-07T19:21:50.906599] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-07T19:21:50.906719] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HF took 22.0s. Estimated remaining: 3h 11m 43s. Rate: 7.1 symbols/min [2025-10-07T19:21:51.052802] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-07T19:21:51.078954] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:21:51.102799] [DEBUG] [LOCAL ] HGER: Loaded 13996 existing records from primary storage. [2025-10-07T19:21:51.103040] [INFO ] [MAIN ] HGER: Loaded 13996 existing records. [2025-10-07T19:21:51.275625] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:21:51.275900] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-07T19:21:51.275949] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-07T19:21:51.276146] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-07T19:21:51.276203] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-07T19:21:51.655878] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:21:51.847675] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-07T19:21:52.120080] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T19:21:52.647698] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-07T19:21:53.095156] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-07T19:21:53.447626] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-07T19:21:53.559719] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T19:21:54.247683] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-07T19:21:54.601379] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T19:21:55.047691] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-07T19:21:55.847630] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-07T19:21:55.988294] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T19:21:56.012777] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-07T19:21:56.599344] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T19:21:56.647621] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-07T19:21:57.067244] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-07T19:21:57.447692] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-07T19:21:57.761172] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-07T19:21:58.247695] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-07T19:21:59.047675] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-07T19:21:59.247265] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T19:21:59.847675] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-07T19:22:00.257837] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-07T19:22:00.647668] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-07T19:22:00.755796] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T19:22:00.759214] [INFO ] [REMOTE ] HESM: Full fetch complete (69403 records). [2025-10-07T19:22:00.759335] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-07T19:22:01.141681] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-07T19:22:01.141780] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-07T19:22:01.142614] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-07T19:22:01.142691] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-07T19:22:01.145560] [DEBUG] [LOCAL ] HESM: Trimmed 69403 records to 48284 (keeping 200 days of data) [2025-10-07T19:22:01.387336] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T19:22:01.447900] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-07T19:22:01.463467] [DEBUG] [LOCAL ] HESM: Primary data saved (48284 records). [2025-10-07T19:22:01.463578] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-07T19:22:01.463704] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HESM took 40.5s. Estimated remaining: 3h 11m 37s. Rate: 7.1 symbols/min [2025-10-07T19:22:01.641184] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:22:01.653712] [DEBUG] [LOCAL ] HGLB: Loaded 9702 existing records from primary storage. [2025-10-07T19:22:01.653965] [INFO ] [MAIN ] HGLB: Loaded 9702 existing records. [2025-10-07T19:22:01.865564] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:22:01.865815] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-07T19:22:01.865865] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-07T19:22:01.866072] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-07T19:22:01.866131] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-07T19:22:02.187013] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-07T19:22:02.267077] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-07T19:22:02.274379] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:22:03.047626] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-07T19:22:03.368182] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T19:22:03.804041] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T19:22:03.847601] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-07T19:22:04.582322] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T19:22:04.647610] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-07T19:22:05.447777] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-07T19:22:05.489926] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T19:22:05.883341] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-07T19:22:06.247690] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-07T19:22:07.047623] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-07T19:22:07.209150] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-07T19:22:07.778164] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T19:22:07.847727] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-07T19:22:08.647683] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-07T19:22:08.864361] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T19:22:09.089247] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T19:22:09.447748] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-07T19:22:10.245683] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T19:22:10.248583] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-07T19:22:11.047623] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-07T19:22:11.309322] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-07T19:22:11.533874] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-07T19:22:11.847741] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-07T19:22:12.647623] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-07T19:22:12.789603] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T19:22:12.791424] [INFO ] [REMOTE ] HFRO: Full fetch complete (28702 records). [2025-10-07T19:22:12.791543] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-07T19:22:13.170040] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-07T19:22:13.170141] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-07T19:22:13.170742] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-07T19:22:13.170812] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-07T19:22:13.171734] [DEBUG] [LOCAL ] HFRO: Trimmed 28702 records to 17508 (keeping 200 days of data) [2025-10-07T19:22:13.276787] [DEBUG] [LOCAL ] HFRO: Primary data saved (17508 records). [2025-10-07T19:22:13.276969] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-07T19:22:13.277115] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HFRO took 32.5s. Estimated remaining: 3h 11m 33s. Rate: 7.1 symbols/min [2025-10-07T19:22:13.451308] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:22:13.448670] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-07T19:22:13.461460] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T19:22:13.476125] [DEBUG] [LOCAL ] HGTY: Loaded 13227 existing records from primary storage. [2025-10-07T19:22:13.476356] [INFO ] [MAIN ] HGTY: Loaded 13227 existing records. [2025-10-07T19:22:13.648638] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:22:13.648889] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-07T19:22:13.648994] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-07T19:22:13.649176] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-07T19:22:13.649233] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-07T19:22:14.004427] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:22:14.187471] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T19:22:14.247606] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-07T19:22:15.047710] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-07T19:22:15.138469] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T19:22:15.470624] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-07T19:22:15.847735] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-07T19:22:16.199320] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-07T19:22:16.200035] [INFO ] [REMOTE ] HFND: Full fetch complete (1778 records). [2025-10-07T19:22:16.200104] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-07T19:22:16.381263] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-07T19:22:16.381454] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:22:16.381522] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:22:16.381596] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-07T19:22:16.381687] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-07T19:22:16.381743] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-07T19:22:16.381788] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-07T19:22:16.381846] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFND took 37.7s. Estimated remaining: 3h 11m 17s. Rate: 7.1 symbols/min [2025-10-07T19:22:16.547766] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:22:16.607751] [DEBUG] [LOCAL ] HGV: Loaded 46518 existing records from primary storage. [2025-10-07T19:22:16.608080] [INFO ] [MAIN ] HGV: Loaded 46518 existing records. [2025-10-07T19:22:16.652845] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-07T19:22:16.787149] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:22:16.787423] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-07T19:22:16.787478] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-07T19:22:16.787751] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-07T19:22:16.787810] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-07T19:22:17.153218] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:22:17.447687] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-07T19:22:17.601857] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T19:22:18.210061] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T19:22:18.247725] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-07T19:22:18.948940] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T19:22:19.047686] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-07T19:22:19.828138] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T19:22:19.847602] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-07T19:22:20.541941] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-07T19:22:20.647736] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-07T19:22:21.447698] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-07T19:22:22.134238] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T19:22:22.175462] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T19:22:22.247599] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-07T19:22:23.047749] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-07T19:22:23.684862] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T19:22:23.847694] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-07T19:22:23.927445] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T19:22:24.647736] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-07T19:22:25.325252] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T19:22:25.392383] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T19:22:25.447684] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-07T19:22:26.247799] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-07T19:22:27.049678] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T19:22:27.049844] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-07T19:22:27.133581] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T19:22:27.847619] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-07T19:22:27.855730] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T19:22:28.647672] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-07T19:22:28.734365] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T19:22:29.406510] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T19:22:29.447601] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-07T19:22:30.247736] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-07T19:22:30.816163] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T19:22:31.045714] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T19:22:31.047944] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-07T19:22:31.847675] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-07T19:22:32.538991] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T19:22:32.584861] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T19:22:32.647611] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-07T19:22:33.447732] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-07T19:22:34.079603] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T19:22:34.237691] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T19:22:34.247592] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-07T19:22:35.047878] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-07T19:22:35.323471] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T19:22:35.832235] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T19:22:35.833717] [INFO ] [REMOTE ] HGLB: Full fetch complete (14860 records). [2025-10-07T19:22:35.833857] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-07T19:22:35.855265] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-07T19:22:36.199690] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-07T19:22:36.199780] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-07T19:22:36.200140] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-07T19:22:36.200179] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-07T19:22:36.200731] [DEBUG] [LOCAL ] HGLB: Trimmed 14860 records to 9696 (keeping 200 days of data) [2025-10-07T19:22:36.258510] [DEBUG] [LOCAL ] HGLB: Primary data saved (9696 records). [2025-10-07T19:22:36.258689] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-07T19:22:36.258790] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGLB took 34.8s. Estimated remaining: 3h 11m 24s. Rate: 7.1 symbols/min [2025-10-07T19:22:36.425420] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:22:36.459190] [DEBUG] [LOCAL ] HHH: Loaded 32909 existing records from primary storage. [2025-10-07T19:22:36.459478] [INFO ] [MAIN ] HHH: Loaded 32909 existing records. [2025-10-07T19:22:36.635115] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:22:36.635391] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-07T19:22:36.635438] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-07T19:22:36.635759] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-07T19:22:36.635817] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-07T19:22:36.656137] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-07T19:22:36.994028] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:22:37.447733] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-07T19:22:37.598847] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T19:22:37.822786] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-07T19:22:38.247827] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-07T19:22:38.250045] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T19:22:39.047632] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-07T19:22:39.344340] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T19:22:39.847673] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-07T19:22:40.604972] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T19:22:40.647623] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-07T19:22:40.754008] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T19:22:40.756527] [INFO ] [REMOTE ] HGER: Full fetch complete (17496 records). [2025-10-07T19:22:40.756695] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-07T19:22:41.164345] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-07T19:22:41.164456] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-07T19:22:41.164940] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-07T19:22:41.165011] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-07T19:22:41.165666] [DEBUG] [LOCAL ] HGER: Trimmed 17496 records to 14155 (keeping 200 days of data) [2025-10-07T19:22:41.266075] [DEBUG] [LOCAL ] HGER: Primary data saved (14155 records). [2025-10-07T19:22:41.266238] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-07T19:22:41.266329] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HGER took 50.4s. Estimated remaining: 3h 11m 11s. Rate: 7.1 symbols/min [2025-10-07T19:22:41.450580] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-07T19:22:41.473786] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:22:41.515817] [DEBUG] [LOCAL ] HI: Loaded 35378 existing records from primary storage. [2025-10-07T19:22:41.516240] [INFO ] [MAIN ] HI: Loaded 35378 existing records. [2025-10-07T19:22:41.734074] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:22:41.734325] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-07T19:22:41.734374] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-07T19:22:41.734608] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-07T19:22:41.734712] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-07T19:22:42.156078] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:22:42.185949] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T19:22:42.247679] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-07T19:22:42.274964] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T19:22:42.276420] [INFO ] [REMOTE ] HGTY: Full fetch complete (17307 records). [2025-10-07T19:22:42.276506] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-07T19:22:42.651553] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-07T19:22:42.651677] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-07T19:22:42.652136] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-07T19:22:42.652201] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-07T19:22:42.652857] [DEBUG] [LOCAL ] HGTY: Trimmed 17307 records to 13274 (keeping 200 days of data) [2025-10-07T19:22:42.732015] [DEBUG] [LOCAL ] HGTY: Primary data saved (13274 records). [2025-10-07T19:22:42.732175] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-07T19:22:42.732282] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGTY took 29.5s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-07T19:22:42.899471] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:22:42.950495] [DEBUG] [LOCAL ] HIG: Loaded 51186 existing records from primary storage. [2025-10-07T19:22:42.950849] [INFO ] [MAIN ] HIG: Loaded 51186 existing records. [2025-10-07T19:22:43.048859] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-07T19:22:43.127956] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:22:43.128142] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-07T19:22:43.128190] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-07T19:22:43.128531] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-07T19:22:43.128590] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-07T19:22:43.485457] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:22:43.538128] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T19:22:43.847713] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-07T19:22:44.423936] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T19:22:44.426873] [INFO ] [REMOTE ] HGV: Full fetch complete (65974 records). [2025-10-07T19:22:44.426968] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-07T19:22:44.655941] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-07T19:22:44.804538] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-07T19:22:44.804616] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-07T19:22:44.805445] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-07T19:22:44.805502] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-07T19:22:44.806851] [DEBUG] [LOCAL ] HGV: Trimmed 65974 records to 46457 (keeping 200 days of data) [2025-10-07T19:22:45.081212] [DEBUG] [LOCAL ] HGV: Primary data saved (46457 records). [2025-10-07T19:22:45.081341] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-07T19:22:45.081420] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGV took 28.7s. Estimated remaining: 3h 10m 37s. Rate: 7.1 symbols/min [2025-10-07T19:22:45.248621] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:22:45.281254] [DEBUG] [LOCAL ] HII: Loaded 34309 existing records from primary storage. [2025-10-07T19:22:45.281529] [INFO ] [MAIN ] HII: Loaded 34309 existing records. [2025-10-07T19:22:45.454451] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-07T19:22:45.460234] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:22:45.461490] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-07T19:22:45.461543] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-07T19:22:45.461781] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-07T19:22:45.461838] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-07T19:22:45.849593] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:22:45.844069] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T19:22:45.978733] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T19:22:46.247621] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-07T19:22:46.784194] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T19:22:47.047751] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-07T19:22:47.787147] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T19:22:47.847601] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-07T19:22:47.944933] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T19:22:48.647733] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-07T19:22:49.297335] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T19:22:49.447673] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-07T19:22:50.247676] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-07T19:22:50.338763] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T19:22:51.047709] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-07T19:22:51.072955] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:22:51.572289] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T19:22:51.847675] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-07T19:22:52.647684] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-07T19:22:53.447697] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-07T19:23:05.340877] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (14.29 seconds). [2025-10-07T19:23:05.348131] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-07T19:23:05.426043] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (13.58 seconds). [2025-10-07T19:23:05.433414] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-07T19:23:06.137811] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (13.49 seconds). [2025-10-07T19:23:06.149172] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-07T19:23:06.609153] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T19:23:06.615141] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-07T19:23:07.066205] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (13.62 seconds). [2025-10-07T19:23:07.075955] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-07T19:23:07.659961] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-07T19:23:07.668806] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-07T19:23:07.756721] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T19:23:07.766229] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-07T19:23:08.340584] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:23:08.350249] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-07T19:23:08.448534] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T19:23:08.460095] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-07T19:23:08.815721] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T19:23:08.823758] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-07T19:23:08.869212] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T19:23:08.877500] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-07T19:23:09.766746] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T19:23:09.775267] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-07T19:23:09.876920] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T19:23:09.888381] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-07T19:23:09.914564] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T19:23:09.922208] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-07T19:23:10.275229] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T19:23:10.282695] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-07T19:23:11.160865] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T19:23:11.168858] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-07T19:23:11.249110] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T19:23:11.256910] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-07T19:23:11.599107] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T19:23:11.610606] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-07T19:23:12.003428] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T19:23:12.011980] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-07T19:23:12.527710] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T19:23:12.535030] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-07T19:23:13.115294] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T19:23:13.124373] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-07T19:23:13.449630] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T19:23:13.456793] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-07T19:23:14.044521] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T19:23:14.052121] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-07T19:23:14.141786] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-07T19:23:14.152248] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-07T19:23:14.528904] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T19:23:14.536336] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-07T19:23:14.934747] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T19:23:14.937716] [INFO ] [REMOTE ] HHH: Full fetch complete (45715 records). [2025-10-07T19:23:14.937844] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-07T19:23:15.265721] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T19:23:15.315166] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-07T19:23:15.409421] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-07T19:23:15.409513] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-07T19:23:15.410503] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-07T19:23:15.410571] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-07T19:23:15.411701] [DEBUG] [LOCAL ] HHH: Trimmed 45715 records to 32912 (keeping 200 days of data) [2025-10-07T19:23:15.616825] [DEBUG] [LOCAL ] HHH: Primary data saved (32912 records). [2025-10-07T19:23:15.616969] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-07T19:23:15.617056] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HHH took 39.4s. Estimated remaining: 3h 10m 58s. Rate: 7.1 symbols/min [2025-10-07T19:23:15.785549] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:23:15.835959] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-07T19:23:15.836320] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-07T19:23:15.942448] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T19:23:15.996165] [INFO ] [REMOTE ] HI: Full fetch complete (50047 records). [2025-10-07T19:23:16.027608] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:23:16.028088] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-07T19:23:16.028154] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-07T19:23:16.028442] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-07T19:23:16.028505] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-07T19:23:16.063422] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-07T19:23:16.559472] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-07T19:23:16.708935] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-07T19:23:16.788390] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T19:23:16.847283] [INFO ] [REMOTE ] HII: Full fetch complete (52813 records). [2025-10-07T19:23:16.864183] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-07T19:23:16.885187] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:23:16.879331] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-07T19:23:16.916497] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-07T19:23:16.916096] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-07T19:23:16.922827] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-07T19:23:16.930454] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-07T19:23:17.053255] [DEBUG] [LOCAL ] HI: Trimmed 50047 records to 35337 (keeping 200 days of data) [2025-10-07T19:23:17.392726] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-07T19:23:17.393057] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-07T19:23:17.394173] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-07T19:23:17.394514] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-07T19:23:17.397624] [DEBUG] [LOCAL ] HII: Trimmed 52813 records to 34213 (keeping 200 days of data) [2025-10-07T19:23:17.646128] [DEBUG] [LOCAL ] HI: Primary data saved (35337 records). [2025-10-07T19:23:17.646917] [INFO ] [MAIN ] HI: Full history saved. [2025-10-07T19:23:17.648233] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HI took 36.4s. Estimated remaining: 3h 10m 41s. Rate: 7.1 symbols/min [2025-10-07T19:23:17.971625] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:23:17.981498] [DEBUG] [LOCAL ] HII: Primary data saved (34213 records). [2025-10-07T19:23:17.982115] [INFO ] [MAIN ] HII: Full history saved. [2025-10-07T19:23:17.983226] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HII took 32.9s. Estimated remaining: 3h 10m 22s. Rate: 7.1 symbols/min [2025-10-07T19:23:18.168332] [DEBUG] [LOCAL ] HIO: Loaded 23975 existing records from primary storage. [2025-10-07T19:23:18.172431] [INFO ] [MAIN ] HIO: Loaded 23975 existing records. [2025-10-07T19:23:18.172072] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:23:18.374858] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:23:18.375271] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-07T19:23:18.371270] [DEBUG] [LOCAL ] HIPO: Loaded 22020 existing records from primary storage. [2025-10-07T19:23:18.375710] [INFO ] [MAIN ] HIPO: Loaded 22020 existing records. [2025-10-07T19:23:18.386860] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-07T19:23:18.472336] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-07T19:23:18.475954] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-07T19:23:18.684118] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:23:18.704201] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-07T19:23:18.709618] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-07T19:23:18.760042] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-07T19:23:18.779594] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-07T19:23:19.042580] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:23:19.064794] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-07T19:23:19.205181] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-07T19:23:19.284162] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-07T19:23:19.372841] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:23:19.373274] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-07T19:23:19.463167] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-07T19:23:19.474381] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-07T19:23:20.290033] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T19:23:20.296287] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-07T19:23:20.514916] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T19:23:20.647726] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-07T19:23:20.997713] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T19:23:21.324829] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T19:23:21.429515] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T19:23:21.447717] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-07T19:23:21.613973] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-07T19:23:22.247738] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-07T19:23:22.649500] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T19:23:22.653926] [INFO ] [REMOTE ] HIG: Full fetch complete (73203 records). [2025-10-07T19:23:22.654114] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-07T19:23:23.049376] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-07T19:23:23.071058] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-07T19:23:23.071165] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-07T19:23:23.072324] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-07T19:23:23.072505] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-07T19:23:23.074116] [DEBUG] [LOCAL ] HIG: Trimmed 73203 records to 51176 (keeping 200 days of data) [2025-10-07T19:23:23.423422] [DEBUG] [LOCAL ] HIG: Primary data saved (51176 records). [2025-10-07T19:23:23.423590] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-07T19:23:23.423706] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HIG took 40.7s. Estimated remaining: 3h 10m 9s. Rate: 7.1 symbols/min [2025-10-07T19:23:23.600674] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:23:23.653080] [DEBUG] [LOCAL ] HIW: Loaded 44532 existing records from primary storage. [2025-10-07T19:23:23.653482] [INFO ] [MAIN ] HIW: Loaded 44532 existing records. [2025-10-07T19:23:23.855461] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-07T19:23:23.868117] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:23:23.869635] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-07T19:23:23.869752] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-07T19:23:23.870399] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-07T19:23:23.870586] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-07T19:23:24.261378] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:23:24.279546] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T19:23:24.647638] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-07T19:23:24.833838] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-07T19:23:24.897035] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T19:23:25.447666] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-07T19:23:25.935096] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T19:23:26.247741] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-07T19:23:26.933120] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T19:23:27.047608] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-07T19:23:27.326235] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-07T19:23:27.847745] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-07T19:23:28.531268] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T19:23:28.647630] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-07T19:23:29.447688] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-07T19:23:30.157800] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:23:30.247634] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-07T19:23:30.468930] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-07T19:23:30.502509] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T19:23:31.047631] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-07T19:23:31.304031] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T19:23:31.847621] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-07T19:23:31.926816] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T19:23:32.647700] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-07T19:23:32.977292] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T19:23:33.447733] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-07T19:23:34.227742] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T19:23:34.247600] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-07T19:23:35.047753] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-07T19:23:35.838123] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T19:23:35.849328] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-07T19:23:35.926459] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-07T19:23:36.254044] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T19:23:36.647619] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-07T19:23:36.881440] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T19:23:37.447605] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-07T19:23:37.837633] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T19:23:38.247735] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-07T19:23:38.541888] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T19:23:39.047698] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-07T19:23:39.847692] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-07T19:23:40.647619] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-07T19:23:40.695541] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T19:23:40.927170] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T19:23:41.020837] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-07T19:23:41.447745] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-07T19:23:41.484787] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T19:23:42.247688] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-07T19:23:42.931769] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T19:23:43.047695] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-07T19:23:43.235528] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T19:23:43.847758] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-07T19:23:44.575762] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:23:44.647689] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-07T19:23:45.447762] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-07T19:23:46.247716] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-07T19:23:46.286582] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T19:23:46.460125] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T19:23:46.461768] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-07T19:23:46.473666] [INFO ] [REMOTE ] HIPO: Full fetch complete (31495 records). [2025-10-07T19:23:46.473894] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-07T19:23:46.928594] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-07T19:23:46.928705] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-07T19:23:46.929318] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-07T19:23:46.929382] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-07T19:23:46.930178] [DEBUG] [LOCAL ] HIPO: Trimmed 31495 records to 22014 (keeping 200 days of data) [2025-10-07T19:23:47.052518] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-07T19:23:47.079502] [DEBUG] [LOCAL ] HIPO: Primary data saved (22014 records). [2025-10-07T19:23:47.079618] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-07T19:23:47.079738] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIPO took 29.1s. Estimated remaining: 3h 10m 21s. Rate: 7.1 symbols/min [2025-10-07T19:23:47.249474] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:23:47.270112] [DEBUG] [LOCAL ] HIX: Loaded 20616 existing records from primary storage. [2025-10-07T19:23:47.270374] [INFO ] [MAIN ] HIX: Loaded 20616 existing records. [2025-10-07T19:23:47.448165] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:23:47.448815] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-07T19:23:47.449078] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-07T19:23:47.449672] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-07T19:23:47.449731] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-07T19:23:47.585986] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T19:23:47.854256] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:23:47.850314] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-07T19:23:48.647688] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-07T19:23:49.411460] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T19:23:49.447613] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-07T19:23:49.854395] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-07T19:23:49.882545] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T19:23:50.247697] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-07T19:23:50.811442] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T19:23:50.814855] [INFO ] [REMOTE ] HIW: Full fetch complete (64858 records). [2025-10-07T19:23:50.815015] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-07T19:23:51.056991] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-07T19:23:51.208082] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-07T19:23:51.208161] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-07T19:23:51.208974] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-07T19:23:51.209038] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-07T19:23:51.210376] [DEBUG] [LOCAL ] HIW: Trimmed 64858 records to 44561 (keeping 200 days of data) [2025-10-07T19:23:51.489456] [DEBUG] [LOCAL ] HIW: Primary data saved (44561 records). [2025-10-07T19:23:51.489611] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-07T19:23:51.489734] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIW took 28.1s. Estimated remaining: 3h 10m 7s. Rate: 7.1 symbols/min [2025-10-07T19:23:51.657680] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:23:51.676414] [DEBUG] [LOCAL ] HKD: Loaded 18473 existing records from primary storage. [2025-10-07T19:23:51.676671] [INFO ] [MAIN ] HKD: Loaded 18473 existing records. [2025-10-07T19:23:51.854596] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-07T19:23:51.859451] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:23:51.860593] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-07T19:23:51.861595] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-07T19:23:51.861872] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-07T19:23:51.861933] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-07T19:23:52.234866] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:23:52.258061] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T19:23:52.536208] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-07T19:23:52.647618] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-07T19:23:53.080489] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T19:23:53.083240] [INFO ] [REMOTE ] HIO: Full fetch complete (37806 records). [2025-10-07T19:23:53.083330] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-07T19:23:53.452722] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-07T19:23:53.453173] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-07T19:23:53.454060] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-07T19:23:53.454711] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-07T19:23:53.454776] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-07T19:23:53.456241] [DEBUG] [LOCAL ] HIO: Trimmed 37806 records to 24020 (keeping 200 days of data) [2025-10-07T19:23:53.602184] [DEBUG] [LOCAL ] HIO: Primary data saved (24020 records). [2025-10-07T19:23:53.602316] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-07T19:23:53.602399] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIO took 36.0s. Estimated remaining: 3h 9m 50s. Rate: 7.1 symbols/min [2025-10-07T19:23:53.757194] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T19:23:53.840415] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:23:53.892865] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-10-07T19:23:53.893218] [INFO ] [MAIN ] HL: Loaded 53671 existing records. [2025-10-07T19:23:54.067178] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:23:54.067433] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-07T19:23:54.067483] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-07T19:23:54.067822] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-07T19:23:54.067879] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-07T19:23:54.255838] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-07T19:23:54.419133] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:23:55.047632] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-07T19:23:55.385451] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T19:23:55.807720] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-07T19:23:55.851941] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-07T19:23:55.855253] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T19:23:56.647616] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-07T19:23:56.859547] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T19:23:57.447695] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-07T19:23:57.908890] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T19:23:58.247758] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-07T19:23:58.541275] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-07T19:23:59.047696] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-07T19:23:59.847692] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-07T19:24:00.133383] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T19:24:00.647705] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-07T19:24:00.950145] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T19:24:01.447616] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-07T19:24:01.614001] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-07T19:24:01.626187] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-07T19:24:01.626414] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-07T19:24:02.052873] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-07T19:24:02.052969] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-07T19:24:02.053901] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-07T19:24:02.053972] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-07T19:24:02.055902] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-10-07T19:24:02.263990] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-07T19:24:02.393338] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-07T19:24:02.393887] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-07T19:24:02.394131] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIMS took 46.8s. Estimated remaining: 3h 9m 42s. Rate: 7.1 symbols/min [2025-10-07T19:24:02.475238] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T19:24:02.587285] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:24:02.617710] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-07T19:24:02.663466] [DEBUG] [LOCAL ] HLF: Loaded 48493 existing records from primary storage. [2025-10-07T19:24:02.663834] [INFO ] [MAIN ] HLF: Loaded 48493 existing records. [2025-10-07T19:24:02.836258] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:24:02.836459] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-07T19:24:02.836615] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-07T19:24:02.836870] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-07T19:24:02.836951] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-07T19:24:03.050764] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-07T19:24:03.191817] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:24:03.324205] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T19:24:03.847704] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-07T19:24:04.647717] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-07T19:24:04.859228] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T19:24:05.211273] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-07T19:24:05.447696] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-07T19:24:05.792936] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T19:24:06.247757] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-07T19:24:07.047698] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-07T19:24:07.112591] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T19:24:07.459356] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T19:24:07.847683] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-07T19:24:08.647708] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-07T19:24:09.074573] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T19:24:09.101412] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T19:24:09.447734] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-07T19:24:10.247707] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-07T19:24:10.308371] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T19:24:10.532413] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T19:24:10.534405] [INFO ] [REMOTE ] HIX: Full fetch complete (30683 records). [2025-10-07T19:24:10.534500] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-07T19:24:10.916708] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-07T19:24:10.916825] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-07T19:24:10.917372] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-07T19:24:10.917444] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-07T19:24:10.918221] [DEBUG] [LOCAL ] HIX: Trimmed 30683 records to 20709 (keeping 200 days of data) [2025-10-07T19:24:11.045528] [DEBUG] [LOCAL ] HIX: Primary data saved (20709 records). [2025-10-07T19:24:11.045680] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-07T19:24:11.045805] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIX took 24.0s. Estimated remaining: 3h 9m 34s. Rate: 7.1 symbols/min [2025-10-07T19:24:11.057043] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-07T19:24:11.214467] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:24:11.255306] [DEBUG] [LOCAL ] HLI: Loaded 30859 existing records from primary storage. [2025-10-07T19:24:11.255572] [INFO ] [MAIN ] HLI: Loaded 30859 existing records. [2025-10-07T19:24:11.427846] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:24:11.428037] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-07T19:24:11.428149] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-07T19:24:11.428407] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-07T19:24:11.428463] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-07T19:24:11.781083] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:24:11.847594] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-07T19:24:12.078258] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T19:24:12.524450] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-07T19:24:12.647607] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-07T19:24:13.201788] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T19:24:13.447728] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-07T19:24:14.247747] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-07T19:24:14.568886] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T19:24:14.751403] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T19:24:15.047739] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-07T19:24:15.692668] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T19:24:15.847687] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-07T19:24:16.647766] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-07T19:24:16.814835] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T19:24:17.216334] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T19:24:17.447711] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-07T19:24:18.247729] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-07T19:24:18.546519] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T19:24:18.816330] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T19:24:19.047750] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-07T19:24:19.419078] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T19:24:19.847698] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-07T19:24:20.492226] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T19:24:20.647712] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-07T19:24:21.447725] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-07T19:24:21.855619] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T19:24:21.895455] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T19:24:22.247754] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-07T19:24:22.844499] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T19:24:22.926229] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-07T19:24:23.047626] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-07T19:24:23.847716] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-07T19:24:24.243030] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T19:24:24.647747] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-07T19:24:25.447690] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-07T19:24:25.896016] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T19:24:25.897551] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T19:24:26.247750] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-07T19:24:26.316184] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T19:24:26.317928] [INFO ] [REMOTE ] HKD: Full fetch complete (28282 records). [2025-10-07T19:24:26.318001] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-07T19:24:26.692863] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-07T19:24:26.692949] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-07T19:24:26.693454] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-07T19:24:26.693495] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-07T19:24:26.694184] [DEBUG] [LOCAL ] HKD: Trimmed 28282 records to 18519 (keeping 200 days of data) [2025-10-07T19:24:26.801552] [DEBUG] [LOCAL ] HKD: Primary data saved (18519 records). [2025-10-07T19:24:26.801725] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-07T19:24:26.801821] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HKD took 35.3s. Estimated remaining: 3h 9m 35s. Rate: 7.1 symbols/min [2025-10-07T19:24:26.984854] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:24:27.021341] [DEBUG] [LOCAL ] HLIO: Loaded 27953 existing records from primary storage. [2025-10-07T19:24:27.021696] [INFO ] [MAIN ] HLIO: Loaded 27953 existing records. [2025-10-07T19:24:27.055598] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-07T19:24:27.242391] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:24:27.242680] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-07T19:24:27.242744] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-07T19:24:27.243017] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-07T19:24:27.243076] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-07T19:24:27.686793] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T19:24:27.846344] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:24:27.847619] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-07T19:24:28.647726] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-07T19:24:28.847221] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T19:24:29.311474] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-07T19:24:29.447741] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-07T19:24:30.018235] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T19:24:30.247619] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-07T19:24:30.734350] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T19:24:31.047635] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-07T19:24:31.554277] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T19:24:31.847689] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-07T19:24:32.156259] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T19:24:32.647735] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-07T19:24:33.447623] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-07T19:24:33.594679] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T19:24:33.698505] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-07T19:24:33.702169] [INFO ] [REMOTE ] HL: Full fetch complete (77663 records). [2025-10-07T19:24:33.702283] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-07T19:24:34.099448] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-07T19:24:34.099529] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-07T19:24:34.100448] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-07T19:24:34.100514] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-07T19:24:34.102019] [DEBUG] [LOCAL ] HL: Trimmed 77663 records to 53671 (keeping 200 days of data) [2025-10-07T19:24:34.279232] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-07T19:24:34.434602] [DEBUG] [LOCAL ] HL: Primary data saved (53671 records). [2025-10-07T19:24:34.434761] [INFO ] [MAIN ] HL: Full history saved. [2025-10-07T19:24:34.434850] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HL took 40.8s. Estimated remaining: 3h 9m 26s. Rate: 7.1 symbols/min [2025-10-07T19:24:34.609434] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:24:34.614356] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T19:24:34.616630] [INFO ] [REMOTE ] HLI: Full fetch complete (45174 records). [2025-10-07T19:24:34.616748] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-07T19:24:34.914946] [DEBUG] [LOCAL ] HLLY: Loaded 33352 existing records from primary storage. [2025-10-07T19:24:34.944680] [INFO ] [MAIN ] HLLY: Loaded 33352 existing records. [2025-10-07T19:24:35.056720] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-07T19:24:35.192561] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-07T19:24:35.207029] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-07T19:24:35.209199] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-07T19:24:35.215928] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-07T19:24:35.229727] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:24:35.230056] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-07T19:24:35.230386] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-07T19:24:35.230743] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-07T19:24:35.230803] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-07T19:24:35.230884] [DEBUG] [LOCAL ] HLI: Trimmed 45174 records to 30814 (keeping 200 days of data) [2025-10-07T19:24:35.702278] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:24:35.799789] [DEBUG] [LOCAL ] HLI: Primary data saved (30814 records). [2025-10-07T19:24:35.799925] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-07T19:24:35.800867] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLI took 24.8s. Estimated remaining: 3h 9m 8s. Rate: 7.1 symbols/min [2025-10-07T19:24:35.855303] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-07T19:24:35.984188] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:24:36.022479] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T19:24:36.071160] [DEBUG] [LOCAL ] HLN: Loaded 53099 existing records from primary storage. [2025-10-07T19:24:36.071573] [INFO ] [MAIN ] HLN: Loaded 53099 existing records. [2025-10-07T19:24:36.264417] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:24:36.264902] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-07T19:24:36.264995] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-07T19:24:36.265524] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-07T19:24:36.265586] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-07T19:24:36.384591] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T19:24:36.643258] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:24:36.647592] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-07T19:24:37.180213] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T19:24:37.447698] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-07T19:24:38.247632] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-07T19:24:38.408218] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T19:24:38.477323] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T19:24:38.986159] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T19:24:39.047703] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-07T19:24:39.847683] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-07T19:24:40.376054] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T19:24:40.647713] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-07T19:24:41.447717] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-07T19:24:41.482080] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T19:24:41.723609] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T19:24:42.247694] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-07T19:24:42.984059] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T19:24:43.047689] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-07T19:24:43.552297] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T19:24:43.847693] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-07T19:24:44.647681] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-07T19:24:44.830199] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T19:24:45.155142] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T19:24:45.447703] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-07T19:24:45.628140] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T19:24:46.247704] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-07T19:24:46.786480] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T19:24:47.047678] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-07T19:24:47.158285] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T19:24:47.847715] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-07T19:24:48.395423] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T19:24:48.647744] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-07T19:24:49.447620] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-07T19:24:49.551697] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T19:24:50.255965] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-07T19:24:50.260771] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T19:24:50.562870] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T19:24:51.047684] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-07T19:24:51.137708] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T19:24:51.847724] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-07T19:24:52.432066] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T19:24:52.647722] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-07T19:24:53.167080] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T19:24:53.170908] [INFO ] [REMOTE ] HLF: Full fetch complete (71052 records). [2025-10-07T19:24:53.171096] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-07T19:24:53.456752] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-07T19:24:53.606305] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-07T19:24:53.616329] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-07T19:24:53.616995] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T19:24:53.618520] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-07T19:24:53.623466] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-07T19:24:53.626116] [DEBUG] [LOCAL ] HLF: Trimmed 71052 records to 48469 (keeping 200 days of data) [2025-10-07T19:24:53.929814] [DEBUG] [LOCAL ] HLF: Primary data saved (48469 records). [2025-10-07T19:24:53.930017] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-07T19:24:53.930149] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLF took 51.5s. Estimated remaining: 3h 9m 12s. Rate: 7.1 symbols/min [2025-10-07T19:24:54.127364] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:24:54.183637] [DEBUG] [LOCAL ] HLT: Loaded 50609 existing records from primary storage. [2025-10-07T19:24:54.184165] [INFO ] [MAIN ] HLT: Loaded 50609 existing records. [2025-10-07T19:24:54.253012] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-07T19:24:54.381512] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:24:54.381882] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-07T19:24:54.381938] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-07T19:24:54.382325] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-07T19:24:54.382389] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-07T19:24:54.773874] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:24:54.922160] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T19:24:55.047739] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-07T19:24:55.300696] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T19:24:55.302717] [INFO ] [REMOTE ] HLIO: Full fetch complete (36378 records). [2025-10-07T19:24:55.302808] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-07T19:24:55.671086] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-07T19:24:55.671168] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-07T19:24:55.671828] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-07T19:24:55.671903] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-07T19:24:55.672792] [DEBUG] [LOCAL ] HLIO: Trimmed 36378 records to 27889 (keeping 200 days of data) [2025-10-07T19:24:55.846554] [DEBUG] [LOCAL ] HLIO: Primary data saved (27889 records). [2025-10-07T19:24:55.846726] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-07T19:24:55.846827] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLIO took 29.0s. Estimated remaining: 3h 8m 55s. Rate: 7.1 symbols/min [2025-10-07T19:24:55.857792] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-07T19:24:56.050407] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:24:56.092627] [DEBUG] [LOCAL ] HLX: Loaded 47698 existing records from primary storage. [2025-10-07T19:24:56.093041] [INFO ] [MAIN ] HLX: Loaded 47698 existing records. [2025-10-07T19:24:56.303629] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:24:56.303937] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-07T19:24:56.303987] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-07T19:24:56.304231] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-07T19:24:56.304289] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-07T19:24:56.651685] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-07T19:24:56.657130] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:24:56.784905] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T19:24:57.331390] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T19:24:57.447599] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-07T19:24:58.073387] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T19:24:58.247728] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-07T19:24:59.047694] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-07T19:24:59.237275] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T19:24:59.835313] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T19:24:59.847599] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-07T19:25:00.615340] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T19:25:00.647697] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-07T19:25:01.447715] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-07T19:25:01.723749] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T19:25:02.247746] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-07T19:25:02.491489] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T19:25:03.047736] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-07T19:25:03.225101] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T19:25:03.227673] [INFO ] [REMOTE ] HLLY: Full fetch complete (46273 records). [2025-10-07T19:25:03.227779] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-07T19:25:03.565494] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-07T19:25:03.669874] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-07T19:25:03.669999] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-07T19:25:03.670767] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-07T19:25:03.670842] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-07T19:25:03.672120] [DEBUG] [LOCAL ] HLLY: Trimmed 46273 records to 33426 (keeping 200 days of data) [2025-10-07T19:25:03.847964] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-07T19:25:03.871146] [DEBUG] [LOCAL ] HLLY: Primary data saved (33426 records). [2025-10-07T19:25:03.871302] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-07T19:25:03.871397] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLLY took 29.4s. Estimated remaining: 3h 8m 46s. Rate: 7.1 symbols/min [2025-10-07T19:25:04.043749] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:25:04.085777] [DEBUG] [LOCAL ] HMC: Loaded 46633 existing records from primary storage. [2025-10-07T19:25:04.086108] [INFO ] [MAIN ] HMC: Loaded 46633 existing records. [2025-10-07T19:25:04.262188] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:25:04.262574] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-07T19:25:04.262687] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-07T19:25:04.263343] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-07T19:25:04.263502] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-07T19:25:04.407848] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T19:25:04.654278] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-07T19:25:04.659002] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:25:05.447714] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-07T19:25:05.605334] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T19:25:06.248426] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-07T19:25:06.254078] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T19:25:07.047721] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-07T19:25:07.134817] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T19:25:07.847629] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-07T19:25:08.096107] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T19:25:08.625008] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T19:25:08.647608] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-07T19:25:09.447617] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-07T19:25:09.857939] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-07T19:25:10.247688] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-07T19:25:10.321510] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T19:25:11.047630] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-07T19:25:11.136941] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T19:25:11.756492] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T19:25:11.847628] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-07T19:25:12.647637] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-07T19:25:13.086701] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T19:25:13.337422] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T19:25:13.447701] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-07T19:25:14.247638] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-07T19:25:14.318479] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T19:25:15.047729] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-07T19:25:15.408944] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T19:25:15.847625] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-07T19:25:16.089169] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T19:25:16.647718] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-07T19:25:16.831790] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T19:25:17.183769] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T19:25:17.447639] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-07T19:25:18.247629] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-07T19:25:18.432857] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T19:25:19.047673] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-07T19:25:19.196930] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T19:25:19.847755] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-07T19:25:20.036761] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T19:25:20.610831] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T19:25:20.615036] [INFO ] [REMOTE ] HLN: Full fetch complete (76819 records). [2025-10-07T19:25:20.615186] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-07T19:25:20.653629] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-07T19:25:21.056087] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-07T19:25:21.056173] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-07T19:25:21.057176] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-07T19:25:21.057244] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-07T19:25:21.058877] [DEBUG] [LOCAL ] HLN: Trimmed 76819 records to 53099 (keeping 200 days of data) [2025-10-07T19:25:21.416896] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T19:25:21.428438] [DEBUG] [LOCAL ] HLN: Primary data saved (53099 records). [2025-10-07T19:25:21.428925] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-07T19:25:21.429039] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLN took 45.6s. Estimated remaining: 3h 8m 50s. Rate: 7.1 symbols/min [2025-10-07T19:25:21.449983] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-07T19:25:21.601481] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:25:21.625075] [DEBUG] [LOCAL ] HMN: Loaded 23470 existing records from primary storage. [2025-10-07T19:25:21.625339] [INFO ] [MAIN ] HMN: Loaded 23470 existing records. [2025-10-07T19:25:21.801435] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:25:21.801706] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-07T19:25:21.801768] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-07T19:25:21.802568] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-07T19:25:21.802626] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-07T19:25:22.159050] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:25:22.247721] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-07T19:25:22.448479] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T19:25:22.891169] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T19:25:23.047629] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-07T19:25:23.329547] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T19:25:23.847694] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-07T19:25:24.031866] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T19:25:24.647738] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-07T19:25:24.998549] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T19:25:25.002888] [INFO ] [REMOTE ] HLX: Full fetch complete (69155 records). [2025-10-07T19:25:25.003135] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-07T19:25:25.442666] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-07T19:25:25.442798] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-07T19:25:25.444197] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-07T19:25:25.444275] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-07T19:25:25.445981] [DEBUG] [LOCAL ] HLX: Trimmed 69155 records to 47654 (keeping 200 days of data) [2025-10-07T19:25:25.447678] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-07T19:25:25.728172] [DEBUG] [LOCAL ] HLX: Primary data saved (47654 records). [2025-10-07T19:25:25.728324] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-07T19:25:25.728434] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLX took 29.9s. Estimated remaining: 3h 8m 36s. Rate: 7.1 symbols/min [2025-10-07T19:25:25.893202] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:25:25.945355] [DEBUG] [LOCAL ] HMY: Loaded 53139 existing records from primary storage. [2025-10-07T19:25:25.945751] [INFO ] [MAIN ] HMY: Loaded 53139 existing records. [2025-10-07T19:25:26.124765] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:25:26.125132] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-07T19:25:26.125227] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-07T19:25:26.126628] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-07T19:25:26.126718] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-07T19:25:26.252455] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-07T19:25:26.376597] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T19:25:26.541299] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:25:26.555373] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T19:25:27.047696] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-07T19:25:27.847747] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-07T19:25:27.936283] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T19:25:28.490984] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T19:25:28.647696] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-07T19:25:28.847761] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-07T19:25:29.447628] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-07T19:25:30.259447] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-07T19:25:30.265385] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T19:25:31.047805] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-07T19:25:31.497969] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-07T19:25:31.847680] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-07T19:25:31.949794] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T19:25:32.013437] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-07T19:25:32.647737] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-07T19:25:33.256620] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T19:25:33.260245] [INFO ] [REMOTE ] HLT: Full fetch complete (73492 records). [2025-10-07T19:25:33.260372] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-07T19:25:33.453590] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-07T19:25:33.650601] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-07T19:25:33.650716] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-07T19:25:33.651593] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-07T19:25:33.651664] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-07T19:25:33.653162] [DEBUG] [LOCAL ] HLT: Trimmed 73492 records to 50618 (keeping 200 days of data) [2025-10-07T19:25:33.979897] [DEBUG] [LOCAL ] HLT: Primary data saved (50618 records). [2025-10-07T19:25:33.980040] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-07T19:25:33.980163] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLT took 40.0s. Estimated remaining: 3h 8m 27s. Rate: 7.1 symbols/min [2025-10-07T19:25:34.155596] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:25:34.155838] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-07T19:25:34.155890] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-07T19:25:34.156006] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-07T19:25:34.156048] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-07T19:25:34.156091] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-07T19:25:34.156124] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-07T19:25:34.248197] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-07T19:25:34.521736] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:25:34.550807] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-07T19:25:34.740729] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T19:25:35.047701] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-07T19:25:35.454286] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T19:25:35.847684] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-07T19:25:36.647618] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-07T19:25:36.782956] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T19:25:36.946919] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T19:25:37.447686] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-07T19:25:37.655053] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:25:37.655372] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-07T19:25:37.655465] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:25:37.655524] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-07T19:25:37.655605] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:25:37.655726] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-07T19:25:37.655810] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-07T19:25:37.655861] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-07T19:25:37.655947] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-07T19:25:37.656064] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HNGE took 3.7s. Estimated remaining: 3h 8m 13s. Rate: 7.1 symbols/min [2025-10-07T19:25:37.831300] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:25:37.860249] [DEBUG] [LOCAL ] HNI: Loaded 29391 existing records from primary storage. [2025-10-07T19:25:37.860530] [INFO ] [MAIN ] HNI: Loaded 29391 existing records. [2025-10-07T19:25:38.039490] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:25:38.039773] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-07T19:25:38.039850] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-07T19:25:38.040797] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-07T19:25:38.040860] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-07T19:25:38.254059] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-07T19:25:38.408408] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:25:38.435168] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T19:25:39.047742] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-07T19:25:39.847612] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-07T19:25:40.171221] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T19:25:40.310071] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-07T19:25:40.647691] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-07T19:25:41.114937] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T19:25:41.118243] [INFO ] [REMOTE ] HMC: Full fetch complete (69296 records). [2025-10-07T19:25:41.118368] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-07T19:25:41.452827] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-07T19:25:41.528233] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-07T19:25:41.528313] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-07T19:25:41.529343] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-07T19:25:41.529426] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-07T19:25:41.531415] [DEBUG] [LOCAL ] HMC: Trimmed 69296 records to 46638 (keeping 200 days of data) [2025-10-07T19:25:41.813503] [DEBUG] [LOCAL ] HMC: Primary data saved (46638 records). [2025-10-07T19:25:41.813703] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-07T19:25:41.813814] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMC took 37.9s. Estimated remaining: 3h 7m 59s. Rate: 7.1 symbols/min [2025-10-07T19:25:41.980485] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:25:42.026278] [DEBUG] [LOCAL ] HOG: Loaded 51071 existing records from primary storage. [2025-10-07T19:25:42.026614] [INFO ] [MAIN ] HOG: Loaded 51071 existing records. [2025-10-07T19:25:42.201135] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:25:42.201351] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-07T19:25:42.201399] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-07T19:25:42.202938] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-07T19:25:42.203000] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-07T19:25:42.254915] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-07T19:25:42.617912] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:25:42.634847] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T19:25:42.743728] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-07T19:25:43.047699] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-07T19:25:43.533548] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T19:25:43.847707] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-07T19:25:44.647683] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-07T19:25:44.743047] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T19:25:44.924261] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T19:25:45.447748] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-07T19:25:46.247749] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-07T19:25:46.446799] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T19:25:47.047714] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-07T19:25:47.137909] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T19:25:47.393477] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T19:25:47.847690] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-07T19:25:48.647737] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-07T19:25:49.021399] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T19:25:49.087874] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T19:25:49.447721] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-07T19:25:50.247759] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-07T19:25:50.336445] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T19:25:51.047631] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-07T19:25:51.343639] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T19:25:51.462389] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-07T19:25:51.847684] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-07T19:25:52.647627] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-07T19:25:52.786329] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T19:25:52.908847] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T19:25:52.910498] [INFO ] [REMOTE ] HMN: Full fetch complete (31510 records). [2025-10-07T19:25:52.910574] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-07T19:25:53.292583] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-07T19:25:53.292716] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-07T19:25:53.293270] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-07T19:25:53.293314] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-07T19:25:53.294061] [DEBUG] [LOCAL ] HMN: Trimmed 31510 records to 23451 (keeping 200 days of data) [2025-10-07T19:25:53.438122] [DEBUG] [LOCAL ] HMN: Primary data saved (23451 records). [2025-10-07T19:25:53.438259] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-07T19:25:53.438341] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMN took 32.0s. Estimated remaining: 3h 7m 54s. Rate: 7.1 symbols/min [2025-10-07T19:25:53.452857] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-07T19:25:53.611623] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:25:53.611765] [DEBUG] [LOCAL ] HOMB: No existing data file found in primary storage. [2025-10-07T19:25:53.611854] [WARN ] [MAIN ] HOMB: No existing data found, performing full refresh instead. [2025-10-07T19:25:53.611981] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-07T19:25:53.612024] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-07T19:25:53.612066] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-07T19:25:53.612098] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-07T19:25:53.963908] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:25:54.247716] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-07T19:25:54.704287] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-07T19:25:55.047718] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-07T19:25:55.373752] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T19:25:55.708604] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T19:25:55.847681] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-07T19:25:56.647626] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-07T19:25:56.729226] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-07T19:25:56.732780] [INFO ] [REMOTE ] HMY: Full fetch complete (76768 records). [2025-10-07T19:25:56.732931] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-07T19:25:57.147506] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T19:25:57.177421] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-07T19:25:57.177915] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-07T19:25:57.178951] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-07T19:25:57.179018] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-07T19:25:57.180484] [DEBUG] [LOCAL ] HMY: Trimmed 76768 records to 53140 (keeping 200 days of data) [2025-10-07T19:25:57.455861] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-07T19:25:57.504729] [DEBUG] [LOCAL ] HMY: Primary data saved (53140 records). [2025-10-07T19:25:57.504871] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-07T19:25:57.504956] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HMY took 31.8s. Estimated remaining: 3h 7m 40s. Rate: 7.1 symbols/min [2025-10-07T19:25:58.247745] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-07T19:25:58.314418] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T19:25:59.029783] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T19:25:59.047586] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-07T19:25:59.427843] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T19:25:59.847743] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-07T19:26:00.597139] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T19:26:00.647688] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-07T19:26:01.054949] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T19:26:01.447699] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-07T19:26:02.236124] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T19:26:02.247608] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-07T19:26:03.047759] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-07T19:26:03.232865] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T19:26:03.849469] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T19:26:03.848130] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-07T19:26:03.894442] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T19:26:04.647752] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-07T19:26:05.447701] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-07T19:26:05.725163] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T19:26:06.259965] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-07T19:26:06.262523] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T19:26:06.858685] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T19:26:07.047689] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-07T19:26:07.847629] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-07T19:26:07.981048] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T19:26:08.434368] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T19:26:08.647666] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-07T19:26:09.084428] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T19:26:09.447689] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-07T19:26:10.247740] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-07T19:26:10.340338] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T19:26:10.809251] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T19:26:10.813280] [INFO ] [REMOTE ] HNI: Full fetch complete (42066 records). [2025-10-07T19:26:10.813408] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-07T19:26:11.052730] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-07T19:26:11.196165] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-07T19:26:11.196259] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-07T19:26:11.196979] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-07T19:26:11.197044] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-07T19:26:11.198209] [DEBUG] [LOCAL ] HNI: Trimmed 42066 records to 29406 (keeping 200 days of data) [2025-10-07T19:26:11.386428] [DEBUG] [LOCAL ] HNI: Primary data saved (29406 records). [2025-10-07T19:26:11.386578] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-07T19:26:11.386685] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HNI took 33.7s. Estimated remaining: 3h 7m 39s. Rate: 7.1 symbols/min [2025-10-07T19:26:11.812828] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T19:26:11.847608] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-07T19:26:12.636415] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T19:26:12.641921] [INFO ] [REMOTE ] HOG: Full fetch complete (74182 records). [2025-10-07T19:26:12.642160] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-07T19:26:13.214322] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-07T19:26:13.214610] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-07T19:26:13.216132] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-07T19:26:13.216368] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-07T19:26:13.218771] [DEBUG] [LOCAL ] HOG: Trimmed 74182 records to 51064 (keeping 200 days of data) [2025-10-07T19:26:13.353555] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T19:26:13.369870] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-07T19:26:13.590536] [DEBUG] [LOCAL ] HOG: Primary data saved (51064 records). [2025-10-07T19:26:13.590701] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-07T19:26:13.590797] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOG took 31.8s. Estimated remaining: 3h 7m 22s. Rate: 7.1 symbols/min [2025-10-07T19:26:14.900022] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T19:26:14.910128] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-07T19:26:16.164850] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T19:26:16.168190] [INFO ] [REMOTE ] HOMB: Full fetch complete (64008 records). [2025-10-07T19:26:16.168340] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-07T19:26:16.567113] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-07T19:26:16.567213] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-07T19:26:16.568082] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-07T19:26:16.568156] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-07T19:26:16.571738] [DEBUG] [LOCAL ] HOMB: Trimmed 64008 records to 43458 (keeping 200 days of data) [2025-10-07T19:26:16.842501] [DEBUG] [LOCAL ] HOMB: Primary data saved (43458 records). [2025-10-07T19:26:16.842676] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-07T19:26:16.842777] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOMB took 23.4s. Estimated remaining: 3h 7m 7s. Rate: 7.1 symbols/min [2025-10-07T19:26:17.466935] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:26:17.463766] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:26:17.529556] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:26:17.550549] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:26:17.568210] [DEBUG] [LOCAL ] HOV: Loaded 13870 existing records from primary storage. [2025-10-07T19:26:17.578800] [INFO ] [MAIN ] HOV: Loaded 13870 existing records. [2025-10-07T19:26:17.703260] [DEBUG] [LOCAL ] HOUS: Loaded 44769 existing records from primary storage. [2025-10-07T19:26:17.745628] [INFO ] [MAIN ] HOUS: Loaded 44769 existing records. [2025-10-07T19:26:17.848287] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:26:17.874450] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-07T19:26:17.947871] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-07T19:26:17.947796] [DEBUG] [LOCAL ] HP: Loaded 51643 existing records from primary storage. [2025-10-07T19:26:17.952109] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-07T19:26:17.952926] [INFO ] [MAIN ] HP: Loaded 51643 existing records. [2025-10-07T19:26:17.958129] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-07T19:26:17.969030] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-07T19:26:17.978732] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-07T19:26:18.305217] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:26:18.335944] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-07T19:26:18.339640] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-07T19:26:18.443231] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-07T19:26:18.571436] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:26:18.568372] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-07T19:26:18.621753] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-07T19:26:18.650450] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-07T19:26:18.641743] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:26:18.676745] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-07T19:26:18.691445] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-07T19:26:18.716493] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-07T19:26:18.767634] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-07T19:26:18.817946] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-07T19:26:18.899194] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-07T19:26:18.942205] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:26:18.958477] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-07T19:26:19.713886] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:26:19.757283] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:26:19.779940] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-07T19:26:19.781078] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-07T19:26:19.865211] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:26:19.865515] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-07T19:26:20.052113] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T19:26:20.055714] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-07T19:26:20.922153] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T19:26:20.925361] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-07T19:26:21.210207] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T19:26:21.218827] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-07T19:26:21.298304] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T19:26:21.308411] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-07T19:26:21.629463] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T19:26:21.640497] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-07T19:26:21.744954] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T19:26:21.748211] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-07T19:26:22.336671] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T19:26:22.345612] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-07T19:26:22.525123] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-07T19:26:22.710546] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T19:26:23.047682] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-07T19:26:23.213886] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T19:26:23.317141] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T19:26:23.847612] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-07T19:26:23.937197] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T19:26:24.647696] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-07T19:26:25.325969] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T19:26:25.447699] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-07T19:26:26.247720] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-07T19:26:26.285776] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T19:26:26.301925] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T19:26:27.047701] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-07T19:26:27.855677] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-07T19:26:27.861027] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T19:26:28.086998] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T19:26:28.647637] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-07T19:26:29.447717] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-07T19:26:29.641053] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T19:26:30.247726] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-07T19:26:30.354947] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T19:26:30.972681] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T19:26:31.047621] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-07T19:26:31.847633] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-07T19:26:32.053006] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-07T19:26:32.235137] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-07T19:26:32.647666] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-07T19:26:33.295015] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T19:26:33.447615] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-07T19:26:33.797385] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T19:26:34.247700] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-07T19:26:34.909574] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T19:26:35.047728] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-07T19:26:35.847729] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-07T19:26:36.016680] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T19:26:36.501867] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T19:26:36.538089] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T19:26:36.647623] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-07T19:26:37.447685] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-07T19:26:38.247669] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-07T19:26:38.417582] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T19:26:38.924171] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T19:26:38.925608] [INFO ] [REMOTE ] HOV: Full fetch complete (19170 records). [2025-10-07T19:26:38.925716] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-07T19:26:39.048274] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-07T19:26:39.294409] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-07T19:26:39.294516] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-07T19:26:39.295123] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-07T19:26:39.295221] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-07T19:26:39.321358] [DEBUG] [LOCAL ] HOV: Trimmed 19170 records to 13932 (keeping 200 days of data) [2025-10-07T19:26:39.324310] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T19:26:39.419099] [DEBUG] [LOCAL ] HOV: Primary data saved (13932 records). [2025-10-07T19:26:39.419242] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-07T19:26:39.419351] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 22.6s. Estimated remaining: 3h 7m 17s. Rate: 7.1 symbols/min [2025-10-07T19:26:39.589500] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:26:39.598895] [DEBUG] [LOCAL ] HPF: Loaded 7465 existing records from primary storage. [2025-10-07T19:26:39.599120] [INFO ] [MAIN ] HPF: Loaded 7465 existing records. [2025-10-07T19:26:39.772404] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:26:39.772627] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-07T19:26:39.772724] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-07T19:26:39.773232] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-07T19:26:39.773304] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-07T19:26:39.852886] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-07T19:26:40.117147] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:26:40.647636] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-07T19:26:40.955277] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T19:26:41.334286] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T19:26:41.338059] [INFO ] [REMOTE ] HOUS: Full fetch complete (63890 records). [2025-10-07T19:26:41.338213] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-07T19:26:41.449035] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-07T19:26:41.751231] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-07T19:26:41.751334] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-07T19:26:41.752187] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-07T19:26:41.752258] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-07T19:26:41.753917] [DEBUG] [LOCAL ] HOUS: Trimmed 63890 records to 44807 (keeping 200 days of data) [2025-10-07T19:26:42.014436] [DEBUG] [LOCAL ] HOUS: Primary data saved (44807 records). [2025-10-07T19:26:42.014610] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-07T19:26:42.014737] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOUS took 25.2s. Estimated remaining: 3h 7m 1s. Rate: 7.1 symbols/min [2025-10-07T19:26:42.194389] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:26:42.233874] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T19:26:42.250006] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-07T19:26:42.250359] [DEBUG] [LOCAL ] HPI: Loaded 10524 existing records from primary storage. [2025-10-07T19:26:42.251846] [INFO ] [MAIN ] HPI: Loaded 10524 existing records. [2025-10-07T19:26:42.336208] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T19:26:42.444881] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:26:42.445136] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-07T19:26:42.445223] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-07T19:26:42.445857] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-07T19:26:42.445916] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-07T19:26:42.829487] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:26:43.047741] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-07T19:26:43.810133] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T19:26:43.847735] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-07T19:26:44.266411] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-07T19:26:44.647696] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-07T19:26:45.447750] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-07T19:26:45.664995] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T19:26:45.902474] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T19:26:46.247725] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-07T19:26:46.589480] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T19:26:47.047723] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-07T19:26:47.847737] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-07T19:26:47.927808] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T19:26:47.955865] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T19:26:48.291524] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-07T19:26:48.647725] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-07T19:26:49.447762] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-07T19:26:50.062617] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-07T19:26:50.247754] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-07T19:26:50.704880] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-07T19:26:50.849034] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T19:26:51.047694] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-07T19:26:51.847686] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-07T19:26:52.647740] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-07T19:26:53.002863] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-07T19:26:53.362723] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T19:26:53.447754] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-07T19:26:53.526186] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T19:26:54.247769] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-07T19:26:55.047709] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-07T19:26:55.558742] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-07T19:26:55.559545] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-07T19:26:55.721971] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T19:26:55.725384] [INFO ] [REMOTE ] HP: Full fetch complete (74009 records). [2025-10-07T19:26:55.725499] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-07T19:26:55.852762] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-07T19:26:56.118022] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-07T19:26:56.118162] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-07T19:26:56.119098] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-07T19:26:56.119163] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-07T19:26:56.120616] [DEBUG] [LOCAL ] HP: Trimmed 74009 records to 51653 (keeping 200 days of data) [2025-10-07T19:26:56.442474] [DEBUG] [LOCAL ] HP: Primary data saved (51653 records). [2025-10-07T19:26:56.442665] [INFO ] [MAIN ] HP: Full history saved. [2025-10-07T19:26:56.442771] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HP took 39.6s. Estimated remaining: 3h 7m 0s. Rate: 7.1 symbols/min [2025-10-07T19:26:56.609671] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:26:56.654008] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-07T19:26:56.657116] [DEBUG] [LOCAL ] HPP: Loaded 51012 existing records from primary storage. [2025-10-07T19:26:56.657602] [INFO ] [MAIN ] HPP: Loaded 51012 existing records. [2025-10-07T19:26:56.833524] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:26:56.833819] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-07T19:26:56.833877] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-07T19:26:56.835178] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-07T19:26:56.835238] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-07T19:26:57.188354] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:26:57.447612] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-07T19:26:57.461674] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T19:26:57.810980] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-07T19:26:57.814509] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-07T19:26:57.814612] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-07T19:26:58.195321] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-07T19:26:58.195409] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-07T19:26:58.196343] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-07T19:26:58.196412] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-07T19:26:58.197979] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-10-07T19:26:58.268234] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-07T19:26:58.550799] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-07T19:26:58.550953] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-07T19:26:58.551058] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HPE took 41.7s. Estimated remaining: 3h 6m 44s. Rate: 7.1 symbols/min [2025-10-07T19:26:58.726538] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:26:58.778731] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-07T19:26:58.779093] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-07T19:26:58.958481] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:26:58.958717] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-07T19:26:58.958773] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-07T19:26:58.958979] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-07T19:26:58.959034] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-07T19:26:59.053260] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-07T19:26:59.196966] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-07T19:26:59.353924] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:26:59.356593] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T19:26:59.847738] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-07T19:26:59.868413] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T19:27:00.647686] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-07T19:27:01.203113] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T19:27:01.450899] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-07T19:27:01.452525] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T19:27:02.247698] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-07T19:27:03.047734] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-07T19:27:03.233118] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T19:27:03.802074] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T19:27:03.848918] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-07T19:27:03.852742] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T19:27:04.647693] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-07T19:27:05.447769] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-07T19:27:05.468459] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T19:27:05.748518] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T19:27:06.000833] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-07T19:27:06.247772] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-07T19:27:07.047733] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-07T19:27:07.847732] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-07T19:27:07.952147] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T19:27:08.009711] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T19:27:08.549270] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T19:27:08.647731] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-07T19:27:09.432031] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T19:27:09.447607] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-07T19:27:10.090868] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T19:27:10.092007] [INFO ] [REMOTE ] HPF: Full fetch complete (10829 records). [2025-10-07T19:27:10.092077] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-07T19:27:10.251360] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-07T19:27:10.455485] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-07T19:27:10.455559] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-07T19:27:10.455818] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-07T19:27:10.455879] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-07T19:27:10.456307] [DEBUG] [LOCAL ] HPF: Trimmed 10829 records to 7495 (keeping 200 days of data) [2025-10-07T19:27:10.501974] [DEBUG] [LOCAL ] HPF: Primary data saved (7495 records). [2025-10-07T19:27:10.502063] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-07T19:27:10.502139] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 31.1s. Estimated remaining: 3h 6m 40s. Rate: 7.1 symbols/min [2025-10-07T19:27:10.673625] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:27:10.685166] [DEBUG] [LOCAL ] HPS: Loaded 10238 existing records from primary storage. [2025-10-07T19:27:10.685369] [INFO ] [MAIN ] HPS: Loaded 10238 existing records. [2025-10-07T19:27:10.857830] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:27:10.858024] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-07T19:27:10.858069] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-07T19:27:10.858472] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-07T19:27:10.858531] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-07T19:27:11.059486] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-07T19:27:11.209076] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:27:11.847694] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-07T19:27:11.939149] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T19:27:11.983209] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T19:27:12.647723] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-07T19:27:13.447632] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-07T19:27:13.693312] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T19:27:13.694722] [INFO ] [REMOTE ] HPI: Full fetch complete (13994 records). [2025-10-07T19:27:13.694793] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-07T19:27:14.041418] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-07T19:27:14.041785] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-07T19:27:14.115985] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-07T19:27:14.116096] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-07T19:27:14.116463] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-07T19:27:14.116507] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-07T19:27:14.117086] [DEBUG] [LOCAL ] HPI: Trimmed 13994 records to 10570 (keeping 200 days of data) [2025-10-07T19:27:14.194542] [DEBUG] [LOCAL ] HPI: Primary data saved (10570 records). [2025-10-07T19:27:14.195327] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-07T19:27:14.195605] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 32.2s. Estimated remaining: 3h 6m 25s. Rate: 7.1 symbols/min [2025-10-07T19:27:14.258056] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-07T19:27:14.375879] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:27:14.401224] [DEBUG] [LOCAL ] HQH: Loaded 25404 existing records from primary storage. [2025-10-07T19:27:14.401536] [INFO ] [MAIN ] HQH: Loaded 25404 existing records. [2025-10-07T19:27:14.573108] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:27:14.573345] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-07T19:27:14.573392] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-07T19:27:14.574205] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-07T19:27:14.574266] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-07T19:27:14.917852] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:27:15.047625] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-07T19:27:15.847695] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-07T19:27:16.356854] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T19:27:16.437697] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-07T19:27:16.647683] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-07T19:27:17.447668] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-07T19:27:17.566793] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T19:27:17.822557] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T19:27:18.196842] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T19:27:18.247605] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-07T19:27:19.047626] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-07T19:27:19.064692] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T19:27:19.847734] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-07T19:27:20.647710] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-07T19:27:21.048263] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T19:27:21.447751] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-07T19:27:21.513677] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T19:27:21.562734] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T19:27:22.220534] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-07T19:27:22.247718] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-07T19:27:23.047737] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-07T19:27:23.058705] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T19:27:23.847724] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-07T19:27:24.098215] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T19:27:24.647666] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-07T19:27:25.447663] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-07T19:27:25.451066] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T19:27:26.247704] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-07T19:27:26.273855] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T19:27:26.525098] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-07T19:27:27.047701] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-07T19:27:27.783059] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T19:27:27.837306] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T19:27:27.847583] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-07T19:27:28.647621] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-07T19:27:28.783875] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-07T19:27:29.447763] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-07T19:27:30.247624] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-07T19:27:30.306107] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T19:27:30.598736] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T19:27:31.047750] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-07T19:27:31.700008] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T19:27:31.831357] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T19:27:31.847604] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-07T19:27:32.647677] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-07T19:27:33.447624] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-07T19:27:33.511539] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T19:27:33.785889] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T19:27:34.247707] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-07T19:27:35.047627] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-07T19:27:35.383633] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T19:27:35.386266] [INFO ] [REMOTE ] HPS: Full fetch complete (15253 records). [2025-10-07T19:27:35.388260] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T19:27:35.388428] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-07T19:27:35.804920] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-07T19:27:35.805010] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-07T19:27:35.805351] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-07T19:27:35.805392] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-07T19:27:35.805919] [DEBUG] [LOCAL ] HPS: Trimmed 15253 records to 10266 (keeping 200 days of data) [2025-10-07T19:27:35.851076] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-07T19:27:35.871428] [DEBUG] [LOCAL ] HPS: Primary data saved (10266 records). [2025-10-07T19:27:35.871572] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-07T19:27:35.871678] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPS took 25.4s. Estimated remaining: 3h 6m 33s. Rate: 7.1 symbols/min [2025-10-07T19:27:36.038763] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:27:36.057987] [DEBUG] [LOCAL ] HQL: Loaded 16481 existing records from primary storage. [2025-10-07T19:27:36.058274] [INFO ] [MAIN ] HQL: Loaded 16481 existing records. [2025-10-07T19:27:36.238016] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:27:36.238295] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-07T19:27:36.238351] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-07T19:27:36.238604] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-07T19:27:36.238707] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-07T19:27:36.558013] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T19:27:36.628664] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:27:36.647599] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-07T19:27:37.378266] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T19:27:37.381694] [INFO ] [REMOTE ] HPP: Full fetch complete (73322 records). [2025-10-07T19:27:37.381808] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-07T19:27:37.450383] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-07T19:27:37.684110] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T19:27:37.790883] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-07T19:27:37.790962] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-07T19:27:37.791871] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-07T19:27:37.791995] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-07T19:27:37.796105] [DEBUG] [LOCAL ] HPP: Trimmed 73322 records to 51040 (keeping 200 days of data) [2025-10-07T19:27:38.079704] [DEBUG] [LOCAL ] HPP: Primary data saved (51040 records). [2025-10-07T19:27:38.079839] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-07T19:27:38.079922] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 41.6s. Estimated remaining: 3h 6m 17s. Rate: 7.1 symbols/min [2025-10-07T19:27:38.246935] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:27:38.247638] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-07T19:27:38.297935] [DEBUG] [LOCAL ] HR: Loaded 51938 existing records from primary storage. [2025-10-07T19:27:38.298256] [INFO ] [MAIN ] HR: Loaded 51938 existing records. [2025-10-07T19:27:38.472854] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:27:38.473081] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-07T19:27:38.473191] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-07T19:27:38.473520] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-07T19:27:38.473599] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-07T19:27:38.828156] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:27:39.047634] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-07T19:27:39.263067] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T19:27:39.494249] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T19:27:39.847691] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-07T19:27:40.161829] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T19:27:40.647681] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-07T19:27:41.447715] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-07T19:27:41.609866] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T19:27:41.947095] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T19:27:42.048746] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T19:27:42.247687] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-07T19:27:43.047708] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-07T19:27:43.318632] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T19:27:43.847611] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-07T19:27:44.218278] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T19:27:44.425577] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-07T19:27:44.647707] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-07T19:27:45.447716] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-07T19:27:46.255101] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-07T19:27:46.260559] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T19:27:46.318944] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T19:27:47.047735] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-07T19:27:47.847694] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-07T19:27:47.888670] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T19:27:47.892280] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-07T19:27:47.892451] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-07T19:27:48.048517] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T19:27:48.300497] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-07T19:27:48.300575] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-07T19:27:48.302123] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-07T19:27:48.302194] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-07T19:27:48.303702] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 53668 (keeping 200 days of data) [2025-10-07T19:27:48.629252] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-10-07T19:27:48.629395] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-07T19:27:48.629480] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPQ took 50.1s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-07T19:27:48.652720] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-07T19:27:48.803847] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:27:48.845221] [DEBUG] [LOCAL ] HRB: Loaded 48434 existing records from primary storage. [2025-10-07T19:27:48.845556] [INFO ] [MAIN ] HRB: Loaded 48434 existing records. [2025-10-07T19:27:49.062791] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:27:49.063544] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T19:27:49.065663] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-07T19:27:49.065830] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-07T19:27:49.065973] [INFO ] [REMOTE ] HQH: Full fetch complete (37410 records). [2025-10-07T19:27:49.066050] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-07T19:27:49.066158] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-07T19:27:49.066262] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-07T19:27:49.448138] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-07T19:27:49.600830] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T19:27:49.819389] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-07T19:27:49.820270] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-07T19:27:49.820945] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-07T19:27:49.821027] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-07T19:27:49.824855] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:27:49.825780] [DEBUG] [LOCAL ] HQH: Trimmed 37410 records to 25466 (keeping 200 days of data) [2025-10-07T19:27:49.987465] [DEBUG] [LOCAL ] HQH: Primary data saved (25466 records). [2025-10-07T19:27:49.987608] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-07T19:27:49.987722] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HQH took 35.8s. Estimated remaining: 3h 5m 54s. Rate: 7.1 symbols/min [2025-10-07T19:27:50.157718] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:27:50.191904] [DEBUG] [LOCAL ] HRI: Loaded 32701 existing records from primary storage. [2025-10-07T19:27:50.192273] [INFO ] [MAIN ] HRI: Loaded 32701 existing records. [2025-10-07T19:27:50.258530] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-07T19:27:50.378385] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:27:50.378587] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-07T19:27:50.378704] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-07T19:27:50.379020] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-07T19:27:50.379077] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-07T19:27:50.736678] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:27:51.047627] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-07T19:27:51.106717] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T19:27:51.415907] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T19:27:51.847712] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-07T19:27:52.262808] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-07T19:27:52.647670] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-07T19:27:53.447718] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-07T19:27:53.503572] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T19:27:54.156908] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T19:27:54.247615] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-07T19:27:54.686802] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T19:27:55.047695] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-07T19:27:55.843729] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T19:27:55.853022] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-07T19:27:56.647720] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-07T19:27:56.850605] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T19:27:57.200234] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T19:27:57.447777] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-07T19:27:58.252896] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-07T19:27:58.273421] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:27:59.047708] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-07T19:27:59.112943] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T19:27:59.833169] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T19:27:59.847605] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-07T19:28:00.091729] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T19:28:00.647684] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-07T19:28:01.448299] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-07T19:28:01.451552] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T19:28:02.247678] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-07T19:28:02.610908] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-07T19:28:02.802948] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T19:28:03.047762] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-07T19:28:03.655482] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T19:28:03.847686] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-07T19:28:04.543230] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T19:28:04.647628] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-07T19:28:05.159272] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T19:28:05.447705] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-07T19:28:06.247718] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-07T19:28:06.345284] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T19:28:06.513712] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T19:28:07.047670] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-07T19:28:07.792096] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T19:28:07.847604] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-07T19:28:08.647710] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-07T19:28:08.687428] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T19:28:08.800933] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T19:28:09.328115] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T19:28:09.330126] [INFO ] [REMOTE ] HQL: Full fetch complete (25056 records). [2025-10-07T19:28:09.330202] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-07T19:28:09.452747] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-07T19:28:09.713942] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-07T19:28:09.714021] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-07T19:28:09.714559] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-07T19:28:09.714599] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-07T19:28:09.715248] [DEBUG] [LOCAL ] HQL: Trimmed 25056 records to 16555 (keeping 200 days of data) [2025-10-07T19:28:09.817104] [DEBUG] [LOCAL ] HQL: Primary data saved (16555 records). [2025-10-07T19:28:09.817236] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-07T19:28:09.817350] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQL took 33.9s. Estimated remaining: 3h 5m 60s. Rate: 7.1 symbols/min [2025-10-07T19:28:09.990487] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:28:10.039830] [DEBUG] [LOCAL ] HRL: Loaded 53083 existing records from primary storage. [2025-10-07T19:28:10.040164] [INFO ] [MAIN ] HRL: Loaded 53083 existing records. [2025-10-07T19:28:10.220588] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:28:10.220840] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-07T19:28:10.220892] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-07T19:28:10.221139] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-07T19:28:10.221198] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-07T19:28:10.252923] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-07T19:28:10.585889] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:28:11.047719] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-07T19:28:11.263322] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T19:28:11.615091] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T19:28:11.847684] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-07T19:28:12.628543] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T19:28:12.647602] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-07T19:28:13.447639] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-07T19:28:13.511205] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T19:28:13.870301] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T19:28:13.874113] [INFO ] [REMOTE ] HRI: Full fetch complete (46306 records). [2025-10-07T19:28:13.874287] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-07T19:28:14.262411] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-07T19:28:14.329105] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-07T19:28:14.329271] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-07T19:28:14.330071] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-07T19:28:14.330137] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-07T19:28:14.331356] [DEBUG] [LOCAL ] HRI: Trimmed 46306 records to 32653 (keeping 200 days of data) [2025-10-07T19:28:14.538186] [DEBUG] [LOCAL ] HRI: Primary data saved (32653 records). [2025-10-07T19:28:14.538327] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-07T19:28:14.538411] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HRI took 24.6s. Estimated remaining: 3h 5m 47s. Rate: 7.1 symbols/min [2025-10-07T19:28:14.706339] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:28:14.737722] [DEBUG] [LOCAL ] HRTG: Loaded 33628 existing records from primary storage. [2025-10-07T19:28:14.738004] [INFO ] [MAIN ] HRTG: Loaded 33628 existing records. [2025-10-07T19:28:14.925201] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:28:14.926193] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-07T19:28:14.926253] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-07T19:28:14.926947] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-07T19:28:14.927006] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-07T19:28:15.052045] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-07T19:28:15.326154] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:28:15.328945] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T19:28:15.847673] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-07T19:28:16.028366] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T19:28:16.408581] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T19:28:16.412134] [INFO ] [REMOTE ] HR: Full fetch complete (74836 records). [2025-10-07T19:28:16.412247] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-07T19:28:16.652912] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-07T19:28:16.808148] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-07T19:28:16.808297] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-07T19:28:16.809458] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-07T19:28:16.809598] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-07T19:28:16.811380] [DEBUG] [LOCAL ] HR: Trimmed 74836 records to 51972 (keeping 200 days of data) [2025-10-07T19:28:16.949393] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T19:28:17.153515] [DEBUG] [LOCAL ] HR: Primary data saved (51972 records). [2025-10-07T19:28:17.153689] [INFO ] [MAIN ] HR: Full history saved. [2025-10-07T19:28:17.153889] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 39.1s. Estimated remaining: 3h 5m 31s. Rate: 7.1 symbols/min [2025-10-07T19:28:17.324546] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:28:17.373748] [DEBUG] [LOCAL ] HSBC: Loaded 50991 existing records from primary storage. [2025-10-07T19:28:17.374116] [INFO ] [MAIN ] HSBC: Loaded 50991 existing records. [2025-10-07T19:28:17.452823] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-07T19:28:17.548737] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:28:17.548957] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-07T19:28:17.549004] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-07T19:28:17.549264] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-07T19:28:17.549321] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-07T19:28:17.901309] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:28:18.254941] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-07T19:28:18.277446] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T19:28:18.518287] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T19:28:19.047709] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-07T19:28:19.847707] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-07T19:28:19.950192] [DEBUG] [REMOTE ] HSBC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-07T19:28:19.950669] [WARN ] [REMOTE ] HSBC: No data returned for month 2024-12 [2025-10-07T19:28:19.950760] [FATAL] [REMOTE ] HSBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:28:19.950818] [FATAL] [MAIN ] HSBC: Failed to fetch primary data. [2025-10-07T19:28:19.950879] [WARN ] [MAIN ] HSBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:28:19.950951] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-07T19:28:19.951017] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-07T19:28:19.951054] [INFO ] [LOCAL ] HSBC: Starting deletion of derivative data. [2025-10-07T19:28:19.951342] [DEBUG] [LOCAL ] HSBC: Deleted derivative data file. [2025-10-07T19:28:19.951468] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HSBC took 2.8s. Estimated remaining: 3h 5m 15s. Rate: 7.1 symbols/min [2025-10-07T19:28:20.126783] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:28:20.154707] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T19:28:20.179673] [DEBUG] [LOCAL ] HSHP: Loaded 15249 existing records from primary storage. [2025-10-07T19:28:20.179901] [INFO ] [MAIN ] HSHP: Loaded 15249 existing records. [2025-10-07T19:28:20.369315] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:28:20.369609] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-07T19:28:20.369699] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-07T19:28:20.369865] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-07T19:28:20.369906] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-07T19:28:20.650826] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-07T19:28:20.686888] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T19:28:20.778559] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:28:21.447635] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-07T19:28:21.694041] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T19:28:22.247676] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-07T19:28:22.969188] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T19:28:22.975145] [INFO ] [REMOTE ] HRB: Full fetch complete (69958 records). [2025-10-07T19:28:22.975347] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-07T19:28:23.050066] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-07T19:28:23.318570] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T19:28:23.400077] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-07T19:28:23.400180] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-07T19:28:23.401097] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-07T19:28:23.401176] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-07T19:28:23.404695] [DEBUG] [LOCAL ] HRB: Trimmed 69958 records to 48437 (keeping 200 days of data) [2025-10-07T19:28:23.707141] [DEBUG] [LOCAL ] HRB: Primary data saved (48437 records). [2025-10-07T19:28:23.707321] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-07T19:28:23.707437] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRB took 35.1s. Estimated remaining: 3h 5m 1s. Rate: 7.1 symbols/min [2025-10-07T19:28:23.852872] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-07T19:28:23.929310] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:28:23.989550] [DEBUG] [LOCAL ] HSY: Loaded 50371 existing records from primary storage. [2025-10-07T19:28:23.989972] [INFO ] [MAIN ] HSY: Loaded 50371 existing records. [2025-10-07T19:28:24.175183] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:28:24.175447] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-07T19:28:24.175498] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-07T19:28:24.175768] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-07T19:28:24.175828] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-07T19:28:24.540342] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:28:24.647669] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-07T19:28:24.816458] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T19:28:25.364216] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T19:28:25.447675] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-07T19:28:26.234377] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T19:28:26.247599] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-07T19:28:26.656901] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T19:28:27.047701] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-07T19:28:27.847745] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-07T19:28:28.066764] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T19:28:28.132249] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T19:28:28.647690] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-07T19:28:29.282463] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T19:28:29.447682] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-07T19:28:30.247673] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-07T19:28:30.578021] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-07T19:28:30.791336] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T19:28:31.047685] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-07T19:28:31.847732] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-07T19:28:32.082779] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T19:28:32.140511] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T19:28:32.647768] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-07T19:28:33.447694] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-07T19:28:33.659850] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T19:28:34.247708] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-07T19:28:34.394862] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T19:28:34.552052] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T19:28:35.047710] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-07T19:28:35.689239] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T19:28:35.847731] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-07T19:28:36.647732] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-07T19:28:36.803049] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T19:28:37.076050] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T19:28:37.079814] [INFO ] [REMOTE ] HRTG: Full fetch complete (43305 records). [2025-10-07T19:28:37.079911] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-07T19:28:37.448546] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-07T19:28:37.463929] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-07T19:28:37.464016] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-07T19:28:37.464693] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-07T19:28:37.464768] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-07T19:28:37.466053] [DEBUG] [LOCAL ] HRTG: Trimmed 43305 records to 33749 (keeping 200 days of data) [2025-10-07T19:28:37.668259] [DEBUG] [LOCAL ] HRTG: Primary data saved (33749 records). [2025-10-07T19:28:37.668398] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-07T19:28:37.668495] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRTG took 23.1s. Estimated remaining: 3h 4m 60s. Rate: 7.1 symbols/min [2025-10-07T19:28:37.835850] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:28:37.836044] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-07T19:28:37.836085] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-07T19:28:37.836195] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-07T19:28:37.836261] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-07T19:28:37.836338] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-07T19:28:37.836374] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-07T19:28:38.230870] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:28:38.247601] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-07T19:28:38.441444] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T19:28:38.445844] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:28:38.452837] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-07T19:28:38.453356] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:28:38.453431] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-07T19:28:38.453474] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:28:38.453513] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-07T19:28:38.453574] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-07T19:28:38.453612] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-07T19:28:38.453677] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-07T19:28:38.453742] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HTB took 0.8s. Estimated remaining: 3h 4m 42s. Rate: 7.1 symbols/min [2025-10-07T19:28:38.628186] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:28:38.643520] [DEBUG] [LOCAL ] HTD: Loaded 13905 existing records from primary storage. [2025-10-07T19:28:38.643784] [INFO ] [MAIN ] HTD: Loaded 13905 existing records. [2025-10-07T19:28:38.818351] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:28:38.818608] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-07T19:28:38.818734] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-07T19:28:38.819060] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-07T19:28:38.819124] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-07T19:28:39.052741] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-07T19:28:39.132919] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T19:28:39.221579] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:28:39.847701] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-07T19:28:40.647704] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-07T19:28:40.789534] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T19:28:41.065483] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T19:28:41.447626] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-07T19:28:41.553329] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-07T19:28:42.247684] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-07T19:28:43.047637] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-07T19:28:43.076819] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T19:28:43.254561] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T19:28:43.847701] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-07T19:28:44.647744] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-07T19:28:44.840546] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T19:28:45.070111] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T19:28:45.447798] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-07T19:28:46.252002] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-07T19:28:46.253557] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T19:28:46.597407] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T19:28:47.012663] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T19:28:47.047685] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-07T19:28:47.847679] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-07T19:28:47.864162] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T19:28:48.647753] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-07T19:28:48.839372] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-07T19:28:49.447719] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-07T19:28:49.474752] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T19:28:50.203607] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T19:28:50.247609] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-07T19:28:51.047709] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-07T19:28:51.303941] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T19:28:51.847720] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-07T19:28:52.647614] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-07T19:28:52.921289] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T19:28:52.923059] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T19:28:53.447756] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-07T19:28:54.247732] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-07T19:28:54.327271] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T19:28:54.352295] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T19:28:55.047748] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-07T19:28:55.847740] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-07T19:28:56.101621] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-07T19:28:56.105345] [INFO ] [REMOTE ] HRL: Full fetch complete (76687 records). [2025-10-07T19:28:56.105510] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-07T19:28:56.507262] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-07T19:28:56.507476] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-07T19:28:56.508500] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-07T19:28:56.508570] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-07T19:28:56.512028] [DEBUG] [LOCAL ] HRL: Trimmed 76687 records to 53093 (keeping 200 days of data) [2025-10-07T19:28:56.692144] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-07T19:28:56.748578] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T19:28:56.856973] [DEBUG] [LOCAL ] HRL: Primary data saved (53093 records). [2025-10-07T19:28:56.857224] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-07T19:28:56.857479] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HRL took 47.0s. Estimated remaining: 3h 4m 46s. Rate: 7.1 symbols/min [2025-10-07T19:28:56.971254] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T19:28:57.078194] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:28:57.078438] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-07T19:28:57.078506] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-07T19:28:57.078626] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-07T19:28:57.078704] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-07T19:28:57.078759] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-07T19:28:57.078793] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-07T19:28:57.431625] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:28:57.447603] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-07T19:28:57.491007] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T19:28:57.796685] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-07T19:28:58.247726] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-07T19:28:58.582557] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-07T19:28:59.047700] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-07T19:28:59.369987] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-07T19:28:59.847696] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-07T19:29:00.647670] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-07T19:29:00.873701] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T19:29:01.079851] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-07T19:29:01.447699] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-07T19:29:02.247705] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-07T19:29:03.047638] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-07T19:29:03.197212] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-07T19:29:03.200603] [INFO ] [REMOTE ] HSY: Full fetch complete (73561 records). [2025-10-07T19:29:03.200736] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-07T19:29:03.322482] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T19:29:03.495929] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-07T19:29:03.611428] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-07T19:29:03.611558] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-07T19:29:03.613715] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-07T19:29:03.613806] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-07T19:29:03.615790] [DEBUG] [LOCAL ] HSY: Trimmed 73561 records to 50359 (keeping 200 days of data) [2025-10-07T19:29:03.848052] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-07T19:29:03.948809] [DEBUG] [LOCAL ] HSY: Primary data saved (50359 records). [2025-10-07T19:29:03.948981] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-07T19:29:03.949085] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSY took 40.2s. Estimated remaining: 3h 4m 35s. Rate: 7.1 symbols/min [2025-10-07T19:29:04.114997] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:29:04.160887] [DEBUG] [LOCAL ] HTGC: Loaded 47393 existing records from primary storage. [2025-10-07T19:29:04.161219] [INFO ] [MAIN ] HTGC: Loaded 47393 existing records. [2025-10-07T19:29:04.335137] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:29:04.335382] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-07T19:29:04.335429] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-07T19:29:04.335728] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-07T19:29:04.335785] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-07T19:29:04.649499] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-07T19:29:04.688731] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:29:04.727266] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T19:29:04.729104] [INFO ] [REMOTE ] HSHP: Full fetch complete (23277 records). [2025-10-07T19:29:04.729212] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-07T19:29:05.057822] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-07T19:29:05.093710] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-07T19:29:05.093802] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-07T19:29:05.094401] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-07T19:29:05.094444] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-07T19:29:05.095065] [DEBUG] [LOCAL ] HSHP: Trimmed 23277 records to 15141 (keeping 200 days of data) [2025-10-07T19:29:05.187918] [DEBUG] [LOCAL ] HSHP: Primary data saved (15141 records). [2025-10-07T19:29:05.188088] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-07T19:29:05.188196] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSHP took 45.2s. Estimated remaining: 3h 4m 18s. Rate: 7.1 symbols/min [2025-10-07T19:29:05.357252] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:29:05.393051] [DEBUG] [LOCAL ] HTH: Loaded 32268 existing records from primary storage. [2025-10-07T19:29:05.393404] [INFO ] [MAIN ] HTH: Loaded 32268 existing records. [2025-10-07T19:29:05.454679] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-07T19:29:05.594230] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:29:05.594488] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-07T19:29:05.594538] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-07T19:29:05.594772] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-07T19:29:05.594830] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-07T19:29:06.081441] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:29:06.247745] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-07T19:29:06.320428] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T19:29:07.047712] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-07T19:29:07.692787] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T19:29:07.847715] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-07T19:29:08.171626] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-07T19:29:08.188103] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T19:29:08.647763] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-07T19:29:08.872208] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-10-07T19:29:09.447692] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-07T19:29:09.718973] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-07T19:29:10.247702] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-07T19:29:10.562980] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-07T19:29:11.047708] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-07T19:29:11.847710] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-07T19:29:12.297841] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T19:29:12.647686] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-07T19:29:13.175179] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T19:29:13.447694] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-07T19:29:13.780163] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T19:29:13.839230] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T19:29:13.840129] [INFO ] [REMOTE ] HTFC: Full fetch complete (845 records). [2025-10-07T19:29:13.840239] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-07T19:29:13.840719] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T19:29:13.840811] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:29:13.840888] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:29:13.840959] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-07T19:29:13.841051] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-07T19:29:13.841110] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-07T19:29:13.841171] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-07T19:29:13.841247] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTFC took 17.0s. Estimated remaining: 3h 4m 10s. Rate: 7.1 symbols/min [2025-10-07T19:29:14.014220] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:29:14.050343] [DEBUG] [LOCAL ] HUBB: Loaded 36613 existing records from primary storage. [2025-10-07T19:29:14.050682] [INFO ] [MAIN ] HUBB: Loaded 36613 existing records. [2025-10-07T19:29:14.232534] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:29:14.232805] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-07T19:29:14.232856] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-07T19:29:14.233163] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-07T19:29:14.233223] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-07T19:29:14.254045] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-07T19:29:14.582579] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:29:15.047738] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-07T19:29:15.765476] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:29:15.847695] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-07T19:29:16.449895] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T19:29:16.647736] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-07T19:29:17.182612] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T19:29:17.447849] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-07T19:29:17.579137] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T19:29:17.580869] [INFO ] [REMOTE ] HTD: Full fetch complete (19165 records). [2025-10-07T19:29:17.580943] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-07T19:29:17.960426] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-07T19:29:17.960526] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-07T19:29:17.961065] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-07T19:29:17.961142] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-07T19:29:17.961726] [DEBUG] [LOCAL ] HTD: Trimmed 19165 records to 13918 (keeping 200 days of data) [2025-10-07T19:29:18.047176] [DEBUG] [LOCAL ] HTD: Primary data saved (13918 records). [2025-10-07T19:29:18.047724] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-07T19:29:18.048013] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTD took 39.6s. Estimated remaining: 3h 3m 56s. Rate: 7.1 symbols/min [2025-10-07T19:29:18.218047] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:29:18.255019] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-07T19:29:18.257853] [DEBUG] [LOCAL ] HUBS: Loaded 39538 existing records from primary storage. [2025-10-07T19:29:18.258161] [INFO ] [MAIN ] HUBS: Loaded 39538 existing records. [2025-10-07T19:29:18.436515] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:29:18.436782] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-07T19:29:18.436837] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-07T19:29:18.437072] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-07T19:29:18.437130] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-07T19:29:18.806960] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:29:18.959756] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:29:19.047743] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-07T19:29:19.239862] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T19:29:19.847719] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-07T19:29:20.647762] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-07T19:29:20.797413] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T19:29:20.871976] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T19:29:21.447692] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-07T19:29:22.011393] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T19:29:22.247691] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-07T19:29:22.865343] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T19:29:23.047684] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-07T19:29:23.655022] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T19:29:23.847673] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-07T19:29:24.576410] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:29:24.647695] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-07T19:29:25.353740] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:29:25.447755] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-07T19:29:26.018638] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T19:29:26.247711] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-07T19:29:27.047744] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-07T19:29:27.139478] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T19:29:27.820876] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T19:29:27.847618] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-07T19:29:28.310054] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-07T19:29:28.647763] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-07T19:29:29.447729] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-07T19:29:29.586536] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T19:29:30.261067] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-07T19:29:30.264395] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T19:29:31.000546] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T19:29:31.047698] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-07T19:29:31.847632] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-07T19:29:32.131603] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T19:29:32.435401] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-07T19:29:32.647753] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-07T19:29:33.163347] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T19:29:33.447733] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-07T19:29:34.247731] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-07T19:29:34.506520] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T19:29:35.052723] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-07T19:29:35.068598] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T19:29:35.372422] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T19:29:35.374832] [INFO ] [REMOTE ] HTH: Full fetch complete (46858 records). [2025-10-07T19:29:35.374920] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-07T19:29:35.770768] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-07T19:29:35.770878] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-07T19:29:35.771605] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-07T19:29:35.771696] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-07T19:29:35.772780] [DEBUG] [LOCAL ] HTH: Trimmed 46858 records to 32391 (keeping 200 days of data) [2025-10-07T19:29:35.860360] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-07T19:29:35.973513] [DEBUG] [LOCAL ] HTH: Primary data saved (32391 records). [2025-10-07T19:29:35.973698] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-07T19:29:35.973820] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTH took 30.8s. Estimated remaining: 3h 3m 59s. Rate: 7.1 symbols/min [2025-10-07T19:29:36.139583] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:29:36.139829] [DEBUG] [LOCAL ] HUM: No existing data file found in primary storage. [2025-10-07T19:29:36.139883] [WARN ] [MAIN ] HUM: No existing data found, performing full refresh instead. [2025-10-07T19:29:36.139993] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-07T19:29:36.140034] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-07T19:29:36.140076] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-07T19:29:36.140108] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-07T19:29:36.496481] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:29:36.613136] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T19:29:36.616513] [INFO ] [REMOTE ] HTGC: Full fetch complete (68352 records). [2025-10-07T19:29:36.616610] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-07T19:29:36.652881] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-07T19:29:36.996827] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-07T19:29:36.996947] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-07T19:29:36.997828] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-07T19:29:36.997893] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-07T19:29:36.999221] [DEBUG] [LOCAL ] HTGC: Trimmed 68352 records to 47448 (keeping 200 days of data) [2025-10-07T19:29:37.291294] [DEBUG] [LOCAL ] HTGC: Primary data saved (47448 records). [2025-10-07T19:29:37.291455] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-07T19:29:37.291549] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTGC took 33.3s. Estimated remaining: 3h 3m 42s. Rate: 7.1 symbols/min [2025-10-07T19:29:37.459027] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-07T19:29:37.466216] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:29:37.517733] [DEBUG] [LOCAL ] HUN: Loaded 53203 existing records from primary storage. [2025-10-07T19:29:37.518206] [INFO ] [MAIN ] HUN: Loaded 53203 existing records. [2025-10-07T19:29:37.649821] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T19:29:37.730971] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:29:37.731198] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-07T19:29:37.731246] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-07T19:29:37.731506] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-07T19:29:37.731563] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-07T19:29:38.077719] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:29:38.247623] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-07T19:29:38.340611] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T19:29:39.047719] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-07T19:29:39.268020] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T19:29:39.473928] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T19:29:39.847752] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-07T19:29:40.296558] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T19:29:40.647675] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-07T19:29:41.352892] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T19:29:41.447623] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-07T19:29:42.259984] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-07T19:29:42.285733] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T19:29:43.003355] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T19:29:43.047673] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-07T19:29:43.804588] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T19:29:43.847605] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-07T19:29:44.381365] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T19:29:44.647739] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-07T19:29:44.875774] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T19:29:45.447723] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-07T19:29:45.987469] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T19:29:46.247678] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-07T19:29:46.747824] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T19:29:47.047730] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-07T19:29:47.847744] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-07T19:29:47.971273] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T19:29:48.593761] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T19:29:48.597008] [INFO ] [REMOTE ] HUBS: Full fetch complete (55868 records). [2025-10-07T19:29:48.597116] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-07T19:29:48.652845] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-07T19:29:49.014387] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-07T19:29:49.014482] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-07T19:29:49.015318] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-07T19:29:49.015384] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-07T19:29:49.016596] [DEBUG] [LOCAL ] HUBS: Trimmed 55868 records to 39612 (keeping 200 days of data) [2025-10-07T19:29:49.275764] [DEBUG] [LOCAL ] HUBS: Primary data saved (39612 records). [2025-10-07T19:29:49.275944] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-07T19:29:49.276049] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBS took 31.2s. Estimated remaining: 3h 3m 38s. Rate: 7.1 symbols/min [2025-10-07T19:29:49.450737] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-07T19:29:49.468285] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:29:49.484537] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T19:29:49.534393] [DEBUG] [LOCAL ] HUYA: Loaded 43951 existing records from primary storage. [2025-10-07T19:29:49.534742] [INFO ] [MAIN ] HUYA: Loaded 43951 existing records. [2025-10-07T19:29:49.709788] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:29:49.710051] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-07T19:29:49.710099] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-07T19:29:49.710308] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-07T19:29:49.710365] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-07T19:29:50.063775] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:29:50.247680] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-07T19:29:50.407675] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T19:29:51.047721] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-07T19:29:51.274751] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T19:29:51.696474] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T19:29:51.847746] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-07T19:29:52.534922] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T19:29:52.647697] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-07T19:29:53.447677] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-07T19:29:53.490928] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T19:29:54.101129] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T19:29:54.247683] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-07T19:29:55.047706] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-07T19:29:55.167510] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T19:29:55.487584] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T19:29:55.847748] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-07T19:29:56.433835] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T19:29:56.436393] [INFO ] [REMOTE ] HUBB: Full fetch complete (53817 records). [2025-10-07T19:29:56.436478] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-07T19:29:56.657068] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-07T19:29:56.820437] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-07T19:29:56.820519] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-07T19:29:56.821339] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-07T19:29:56.821405] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-07T19:29:56.822515] [DEBUG] [LOCAL ] HUBB: Trimmed 53817 records to 36598 (keeping 200 days of data) [2025-10-07T19:29:57.054011] [DEBUG] [LOCAL ] HUBB: Primary data saved (36598 records). [2025-10-07T19:29:57.054153] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-07T19:29:57.054236] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBB took 43.2s. Estimated remaining: 3h 3m 29s. Rate: 7.1 symbols/min [2025-10-07T19:29:57.231876] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:29:57.248978] [DEBUG] [LOCAL ] HVT: Loaded 15312 existing records from primary storage. [2025-10-07T19:29:57.249222] [INFO ] [MAIN ] HVT: Loaded 15312 existing records. [2025-10-07T19:29:57.437459] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:29:57.437827] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-07T19:29:57.437899] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-07T19:29:57.438092] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-07T19:29:57.438150] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-07T19:29:57.452769] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-07T19:29:57.738367] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T19:29:57.853392] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:29:58.247725] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-07T19:29:58.350406] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T19:29:58.966520] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:29:59.047756] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-07T19:29:59.847693] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-07T19:29:59.963699] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T19:30:00.581739] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:30:00.647739] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-07T19:30:00.835873] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T19:30:01.447728] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-07T19:30:02.247756] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-07T19:30:02.415257] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T19:30:02.452819] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T19:30:03.047734] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-07T19:30:03.847733] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-07T19:30:03.994230] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T19:30:04.290792] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T19:30:04.647749] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-07T19:30:05.447727] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-07T19:30:05.595240] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T19:30:06.206699] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T19:30:06.247612] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-07T19:30:07.047711] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-07T19:30:07.152190] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T19:30:07.729041] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T19:30:07.847711] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-07T19:30:08.582175] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T19:30:08.647637] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-07T19:30:08.812513] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T19:30:09.447691] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-07T19:30:10.121011] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T19:30:10.247673] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-07T19:30:10.608569] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T19:30:11.047705] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-07T19:30:11.852771] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-07T19:30:11.868894] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T19:30:12.647610] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-07T19:30:12.771991] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T19:30:13.009540] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T19:30:13.447688] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-07T19:30:13.875956] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T19:30:14.249702] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-07T19:30:14.251471] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T19:30:15.047709] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-07T19:30:15.556717] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T19:30:15.559878] [INFO ] [REMOTE ] HUYA: Full fetch complete (63706 records). [2025-10-07T19:30:15.559985] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-07T19:30:15.849748] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-07T19:30:15.944228] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-07T19:30:15.944320] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-07T19:30:15.945148] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-07T19:30:15.945214] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-07T19:30:15.946581] [DEBUG] [LOCAL ] HUYA: Trimmed 63706 records to 43908 (keeping 200 days of data) [2025-10-07T19:30:16.199181] [DEBUG] [LOCAL ] HUYA: Primary data saved (43908 records). [2025-10-07T19:30:16.199329] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-07T19:30:16.199454] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUYA took 26.9s. Estimated remaining: 3h 3m 34s. Rate: 7.1 symbols/min [2025-10-07T19:30:16.372850] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:30:16.425555] [DEBUG] [LOCAL ] HWM: Loaded 52914 existing records from primary storage. [2025-10-07T19:30:16.425968] [INFO ] [MAIN ] HWM: Loaded 52914 existing records. [2025-10-07T19:30:16.614319] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:30:16.614764] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-07T19:30:16.614895] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-07T19:30:16.615331] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-07T19:30:16.615473] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-07T19:30:16.681772] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-07T19:30:17.004519] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T19:30:17.039423] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:30:17.447608] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-07T19:30:17.622558] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T19:30:17.684261] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T19:30:18.247700] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-07T19:30:19.047715] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-07T19:30:19.159884] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T19:30:19.319572] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-07T19:30:19.323484] [INFO ] [REMOTE ] HUN: Full fetch complete (76727 records). [2025-10-07T19:30:19.323725] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-07T19:30:19.729735] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-07T19:30:19.729855] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-07T19:30:19.731080] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-07T19:30:19.731151] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-07T19:30:19.733150] [DEBUG] [LOCAL ] HUN: Trimmed 76727 records to 53204 (keeping 200 days of data) [2025-10-07T19:30:19.847778] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-07T19:30:20.095991] [DEBUG] [LOCAL ] HUN: Primary data saved (53204 records). [2025-10-07T19:30:20.096286] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-07T19:30:20.096450] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUN took 42.8s. Estimated remaining: 3h 3m 20s. Rate: 7.1 symbols/min [2025-10-07T19:30:20.276908] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:30:20.325120] [DEBUG] [LOCAL ] HXL: Loaded 45883 existing records from primary storage. [2025-10-07T19:30:20.325535] [INFO ] [MAIN ] HXL: Loaded 45883 existing records. [2025-10-07T19:30:20.534719] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:30:20.535300] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-07T19:30:20.535459] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-07T19:30:20.535850] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-07T19:30:20.535958] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-07T19:30:20.655105] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-07T19:30:20.665078] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T19:30:20.685803] [INFO ] [REMOTE ] HUM: Full fetch complete (71021 records). [2025-10-07T19:30:20.696540] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-07T19:30:21.004799] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T19:30:21.203287] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:30:21.415067] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-07T19:30:21.415149] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-07T19:30:21.416041] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-07T19:30:21.416106] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-07T19:30:21.417564] [DEBUG] [LOCAL ] HUM: Trimmed 71021 records to 48999 (keeping 200 days of data) [2025-10-07T19:30:21.471715] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-07T19:30:21.722317] [DEBUG] [LOCAL ] HUM: Primary data saved (48999 records). [2025-10-07T19:30:21.722459] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-07T19:30:21.722535] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUM took 45.7s. Estimated remaining: 3h 3m 3s. Rate: 7.1 symbols/min [2025-10-07T19:30:21.887833] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:30:21.899173] [DEBUG] [LOCAL ] HY: Loaded 9953 existing records from primary storage. [2025-10-07T19:30:21.899362] [INFO ] [MAIN ] HY: Loaded 9953 existing records. [2025-10-07T19:30:22.070993] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:30:22.071221] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-07T19:30:22.071269] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-07T19:30:22.071494] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-07T19:30:22.071553] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-07T19:30:22.248577] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-07T19:30:22.433913] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:30:22.444518] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T19:30:22.536758] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T19:30:23.047733] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-07T19:30:23.619166] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T19:30:23.847755] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-07T19:30:23.881464] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T19:30:24.647730] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-07T19:30:25.447686] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-07T19:30:25.480626] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T19:30:26.242681] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T19:30:26.247602] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-07T19:30:26.493127] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T19:30:27.013407] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T19:30:27.047612] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-07T19:30:27.821528] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T19:30:27.847701] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-07T19:30:28.647746] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-07T19:30:28.676145] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T19:30:29.447711] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-07T19:30:30.149567] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T19:30:30.247749] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-07T19:30:31.047687] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-07T19:30:31.369249] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T19:30:31.429022] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T19:30:31.819418] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T19:30:31.821379] [INFO ] [REMOTE ] HVT: Full fetch complete (23322 records). [2025-10-07T19:30:31.821490] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-07T19:30:31.854216] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-07T19:30:32.199144] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-07T19:30:32.199224] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-07T19:30:32.199726] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-07T19:30:32.199788] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-07T19:30:32.200382] [DEBUG] [LOCAL ] HVT: Trimmed 23322 records to 15322 (keeping 200 days of data) [2025-10-07T19:30:32.294331] [DEBUG] [LOCAL ] HVT: Primary data saved (15322 records). [2025-10-07T19:30:32.294475] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-07T19:30:32.294589] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 35.2s. Estimated remaining: 3h 2m 57s. Rate: 7.1 symbols/min [2025-10-07T19:30:32.461253] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:30:32.461408] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-07T19:30:32.461445] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-07T19:30:32.461552] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-07T19:30:32.461595] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-07T19:30:32.461659] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-07T19:30:32.461717] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-07T19:30:32.656154] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-07T19:30:32.822019] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:30:32.835945] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T19:30:33.447746] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-07T19:30:34.187760] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T19:30:34.225611] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T19:30:34.247621] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-07T19:30:34.622110] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-07T19:30:35.047709] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-07T19:30:35.778185] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T19:30:35.847682] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-07T19:30:36.170472] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-07T19:30:36.647697] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-07T19:30:36.969575] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-07T19:30:37.447758] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-07T19:30:37.680513] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-07T19:30:38.247711] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-07T19:30:39.047752] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-07T19:30:39.529055] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-07T19:30:39.847622] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-07T19:30:40.147559] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T19:30:40.614853] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T19:30:40.647722] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-07T19:30:41.447748] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-07T19:30:41.792041] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-07T19:30:42.205162] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T19:30:42.247706] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-07T19:30:43.047714] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-07T19:30:43.082477] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T19:30:43.847698] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-07T19:30:44.647690] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-07T19:30:44.698636] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-07T19:30:44.760874] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T19:30:44.970721] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-07T19:30:45.447689] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-07T19:30:45.870758] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-07T19:30:46.247717] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-07T19:30:47.047695] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-07T19:30:47.730307] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T19:30:47.731466] [INFO ] [REMOTE ] HY: Full fetch complete (15177 records). [2025-10-07T19:30:47.731552] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-07T19:30:47.852865] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-07T19:30:48.121349] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-07T19:30:48.121482] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-07T19:30:48.121943] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-07T19:30:48.122072] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-07T19:30:48.123055] [DEBUG] [LOCAL ] HY: Trimmed 15177 records to 10004 (keeping 200 days of data) [2025-10-07T19:30:48.209639] [DEBUG] [LOCAL ] HY: Primary data saved (10004 records). [2025-10-07T19:30:48.223429] [INFO ] [MAIN ] HY: Full history saved. [2025-10-07T19:30:48.224510] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HY took 26.5s. Estimated remaining: 3h 2m 58s. Rate: 7.1 symbols/min [2025-10-07T19:30:48.225814] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T19:30:48.412894] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:30:48.413075] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-07T19:30:48.413112] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-07T19:30:48.413350] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-07T19:30:48.413404] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-07T19:30:48.413447] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-07T19:30:48.413479] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-07T19:30:48.647801] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-07T19:30:48.784055] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:30:49.446634] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T19:30:49.456403] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-07T19:30:49.833372] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-07T19:30:50.247714] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-07T19:30:50.543693] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T19:30:51.047768] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-07T19:30:51.394956] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T19:30:51.833165] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T19:30:51.847616] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-07T19:30:52.647727] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-07T19:30:52.882307] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-07T19:30:53.432184] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T19:30:53.447615] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-07T19:30:54.247706] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-07T19:30:54.582223] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T19:30:54.585595] [INFO ] [REMOTE ] HXL: Full fetch complete (66289 records). [2025-10-07T19:30:54.585774] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-07T19:30:55.049668] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-07T19:30:55.068018] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-07T19:30:55.068180] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-07T19:30:55.070040] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-07T19:30:55.070464] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-07T19:30:55.072610] [DEBUG] [LOCAL ] HXL: Trimmed 66289 records to 45917 (keeping 200 days of data) [2025-10-07T19:30:55.314738] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-07T19:30:55.393279] [DEBUG] [LOCAL ] HXL: Primary data saved (45917 records). [2025-10-07T19:30:55.393533] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-07T19:30:55.393674] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HXL took 35.3s. Estimated remaining: 3h 2m 48s. Rate: 7.1 symbols/min [2025-10-07T19:30:55.569502] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:30:55.584442] [DEBUG] [LOCAL ] HYI: Loaded 9840 existing records from primary storage. [2025-10-07T19:30:55.584787] [INFO ] [MAIN ] HYI: Loaded 9840 existing records. [2025-10-07T19:30:55.788075] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:30:55.788414] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-07T19:30:55.788475] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-07T19:30:55.788839] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-07T19:30:55.788924] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-07T19:30:55.850702] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-07T19:30:56.164307] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-07T19:30:56.192535] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:30:56.250674] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-07T19:30:56.647730] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-07T19:30:56.958660] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-07T19:30:56.959576] [INFO ] [REMOTE ] HYAC: Full fetch complete (877 records). [2025-10-07T19:30:56.959688] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-07T19:30:56.960142] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T19:30:56.960240] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:30:56.960286] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:30:56.960333] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-07T19:30:56.960409] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-07T19:30:56.960450] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-07T19:30:56.960534] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-07T19:30:56.960625] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 24.7s. Estimated remaining: 3h 2m 31s. Rate: 7.1 symbols/min [2025-10-07T19:30:57.144257] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:30:57.194391] [DEBUG] [LOCAL ] HYT: Loaded 33640 existing records from primary storage. [2025-10-07T19:30:57.194956] [INFO ] [MAIN ] HYT: Loaded 33640 existing records. [2025-10-07T19:30:57.393436] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:30:57.394009] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-07T19:30:57.394087] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-07T19:30:57.394421] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-07T19:30:57.394480] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-07T19:30:57.457561] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-07T19:30:57.771788] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:30:57.775485] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-07T19:30:58.247702] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-07T19:30:58.581969] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-07T19:30:59.047716] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-07T19:30:59.847715] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-07T19:30:59.904195] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T19:31:00.396747] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-07T19:31:00.647781] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-07T19:31:01.037689] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-07T19:31:01.447735] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-07T19:31:02.226957] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T19:31:02.247726] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-07T19:31:03.047739] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-07T19:31:03.796419] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T19:31:03.847606] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-07T19:31:04.113220] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T19:31:04.587775] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T19:31:04.647756] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-07T19:31:05.447736] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-07T19:31:05.594124] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T19:31:06.247697] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-07T19:31:06.783192] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T19:31:07.047726] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-07T19:31:07.368327] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-07T19:31:07.847717] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-07T19:31:07.972054] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T19:31:08.569992] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T19:31:08.647676] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-07T19:31:09.186924] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-07T19:31:09.447764] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-07T19:31:09.772536] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-07T19:31:10.247669] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-07T19:31:11.047714] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-07T19:31:11.847714] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-07T19:31:12.052335] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T19:31:12.058539] [INFO ] [REMOTE ] HWM: Full fetch complete (76584 records). [2025-10-07T19:31:12.058875] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-07T19:31:12.547615] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T19:31:12.624727] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T19:31:12.654204] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-07T19:31:12.755673] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-07T19:31:12.755782] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-07T19:31:12.757179] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-07T19:31:12.757273] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-07T19:31:12.759917] [DEBUG] [LOCAL ] HWM: Trimmed 76584 records to 52904 (keeping 200 days of data) [2025-10-07T19:31:13.115216] [DEBUG] [LOCAL ] HWM: Primary data saved (52904 records). [2025-10-07T19:31:13.115380] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-07T19:31:13.115470] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HWM took 56.9s. Estimated remaining: 3h 2m 32s. Rate: 7.1 symbols/min [2025-10-07T19:31:13.295748] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:31:13.301259] [DEBUG] [LOCAL ] HYTR: Loaded 3133 existing records from primary storage. [2025-10-07T19:31:13.301487] [INFO ] [MAIN ] HYTR: Loaded 3133 existing records. [2025-10-07T19:31:13.451845] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-07T19:31:13.491800] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:31:13.493036] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-07T19:31:13.493100] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-07T19:31:13.493492] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-07T19:31:13.493966] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-07T19:31:13.648622] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T19:31:13.922221] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:31:14.247695] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-07T19:31:14.700267] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-07T19:31:14.787128] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T19:31:15.047757] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-07T19:31:15.579152] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-07T19:31:15.847757] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-07T19:31:16.515784] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T19:31:16.647722] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-07T19:31:16.893270] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-07T19:31:17.447738] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-07T19:31:18.247738] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-07T19:31:18.272171] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T19:31:18.803826] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-07T19:31:19.047721] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-07T19:31:19.394255] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-07T19:31:19.394990] [INFO ] [REMOTE ] HYBX: Full fetch complete (728 records). [2025-10-07T19:31:19.395080] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-07T19:31:19.602131] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-07T19:31:19.602347] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:31:19.602419] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:31:19.602495] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-07T19:31:19.602563] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-07T19:31:19.602600] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-07T19:31:19.602663] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-07T19:31:19.602748] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYBX took 31.4s. Estimated remaining: 3h 2m 21s. Rate: 7.1 symbols/min [2025-10-07T19:31:19.778155] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:31:19.815050] [DEBUG] [LOCAL ] HZO: Loaded 29152 existing records from primary storage. [2025-10-07T19:31:19.815412] [INFO ] [MAIN ] HZO: Loaded 29152 existing records. [2025-10-07T19:31:19.852952] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-07T19:31:20.008826] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:31:20.009098] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-07T19:31:20.009188] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-07T19:31:20.009429] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-07T19:31:20.009488] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-07T19:31:20.367372] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:31:20.555084] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T19:31:20.647690] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-07T19:31:21.447724] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-07T19:31:21.718947] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T19:31:22.220719] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T19:31:22.223381] [INFO ] [REMOTE ] HYI: Full fetch complete (13906 records). [2025-10-07T19:31:22.223596] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-07T19:31:22.255906] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-07T19:31:22.640412] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-07T19:31:22.640505] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-07T19:31:22.641026] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-07T19:31:22.641099] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-07T19:31:22.641833] [DEBUG] [LOCAL ] HYI: Trimmed 13906 records to 9882 (keeping 200 days of data) [2025-10-07T19:31:22.714763] [DEBUG] [LOCAL ] HYI: Primary data saved (9882 records). [2025-10-07T19:31:22.714954] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-07T19:31:22.715072] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYI took 27.3s. Estimated remaining: 3h 2m 6s. Rate: 7.1 symbols/min [2025-10-07T19:31:22.927788] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:31:22.936724] [DEBUG] [LOCAL ] IAE: Loaded 6005 existing records from primary storage. [2025-10-07T19:31:22.936963] [INFO ] [MAIN ] IAE: Loaded 6005 existing records. [2025-10-07T19:31:23.054384] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-07T19:31:23.157146] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:31:23.157407] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-07T19:31:23.157463] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-07T19:31:23.157726] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-07T19:31:23.157806] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-07T19:31:23.542265] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:31:23.647962] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T19:31:23.847716] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-07T19:31:24.229767] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-07T19:31:24.647709] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-07T19:31:25.174885] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-07T19:31:25.447715] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-07T19:31:25.729527] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T19:31:26.007994] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T19:31:26.247765] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-07T19:31:26.943995] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T19:31:27.047710] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-07T19:31:27.528328] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-07T19:31:27.847702] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-07T19:31:28.647751] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-07T19:31:29.138542] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T19:31:29.267685] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T19:31:29.447732] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-07T19:31:30.247754] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-07T19:31:30.791046] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T19:31:30.837258] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T19:31:31.047688] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-07T19:31:31.847744] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-07T19:31:32.367002] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T19:31:32.398239] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T19:31:32.647711] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-07T19:31:33.447758] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-07T19:31:33.994761] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-07T19:31:34.050147] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T19:31:34.247731] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-07T19:31:35.047776] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-07T19:31:35.788708] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T19:31:35.847734] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-07T19:31:36.566486] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T19:31:36.568707] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T19:31:36.647679] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-07T19:31:37.447751] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-07T19:31:37.989861] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T19:31:38.247760] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-07T19:31:38.695938] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-07T19:31:39.047757] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-07T19:31:39.565372] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T19:31:39.568208] [INFO ] [REMOTE ] HYT: Full fetch complete (47779 records). [2025-10-07T19:31:39.568301] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-07T19:31:39.853826] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-07T19:31:39.948744] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-07T19:31:39.948925] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-07T19:31:39.949687] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-07T19:31:39.949750] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-07T19:31:39.951209] [DEBUG] [LOCAL ] HYT: Trimmed 47779 records to 33699 (keeping 200 days of data) [2025-10-07T19:31:40.152844] [DEBUG] [LOCAL ] HYT: Primary data saved (33699 records). [2025-10-07T19:31:40.152983] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-07T19:31:40.153116] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYT took 43.2s. Estimated remaining: 3h 2m 9s. Rate: 7.1 symbols/min [2025-10-07T19:31:40.200711] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T19:31:40.581748] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T19:31:40.647602] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-07T19:31:41.325068] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T19:31:41.447742] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-07T19:31:41.912635] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T19:31:41.913466] [INFO ] [REMOTE ] HYTR: Full fetch complete (4584 records). [2025-10-07T19:31:41.913534] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-07T19:31:42.253958] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-07T19:31:42.287306] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-07T19:31:42.287400] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-07T19:31:42.287573] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-07T19:31:42.287616] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-07T19:31:42.288055] [DEBUG] [LOCAL ] HYTR: Trimmed 4584 records to 3134 (keeping 200 days of data) [2025-10-07T19:31:42.309658] [DEBUG] [LOCAL ] HYTR: Primary data saved (3134 records). [2025-10-07T19:31:42.309796] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-07T19:31:42.309891] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYTR took 29.2s. Estimated remaining: 3h 1m 53s. Rate: 7.1 symbols/min [2025-10-07T19:31:43.047709] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-07T19:31:43.720598] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T19:31:43.771896] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T19:31:43.847708] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-07T19:31:44.647760] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-07T19:31:45.072737] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T19:31:45.258817] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T19:31:45.447698] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-07T19:31:46.247774] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-07T19:31:46.617892] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-07T19:31:46.902705] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-07T19:31:47.047696] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-07T19:31:47.834566] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T19:31:47.847608] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-07T19:31:48.593273] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T19:31:48.647680] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-07T19:31:49.220638] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T19:31:49.221722] [INFO ] [REMOTE ] IAE: Full fetch complete (8748 records). [2025-10-07T19:31:49.221799] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-07T19:31:49.456785] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-07T19:31:49.600142] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-07T19:31:49.600227] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-07T19:31:49.600508] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-07T19:31:49.600634] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-07T19:31:49.601118] [DEBUG] [LOCAL ] IAE: Trimmed 8748 records to 6054 (keeping 200 days of data) [2025-10-07T19:31:49.637104] [DEBUG] [LOCAL ] IAE: Primary data saved (6054 records). [2025-10-07T19:31:49.637252] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-07T19:31:49.637422] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. IAE took 26.9s. Estimated remaining: 3h 1m 43s. Rate: 7.1 symbols/min [2025-10-07T19:31:50.351441] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T19:31:50.353739] [INFO ] [REMOTE ] HZO: Full fetch complete (41068 records). [2025-10-07T19:31:50.353845] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-07T19:31:50.756277] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-07T19:31:50.756490] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-07T19:31:50.757174] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-07T19:31:50.757244] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-07T19:31:50.758874] [DEBUG] [LOCAL ] HZO: Trimmed 41068 records to 29133 (keeping 200 days of data) [2025-10-07T19:31:50.943385] [DEBUG] [LOCAL ] HZO: Primary data saved (29133 records). [2025-10-07T19:31:50.943551] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-07T19:31:50.943703] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 31.3s. Estimated remaining: 3h 1m 26s. Rate: 7.1 symbols/min [2025-10-07T19:31:51.533483] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:31:51.583365] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:31:51.670172] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:31:51.690883] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:31:51.778410] [DEBUG] [LOCAL ] IBP: Loaded 28785 existing records from primary storage. [2025-10-07T19:31:51.793982] [INFO ] [MAIN ] IBP: Loaded 28785 existing records. [2025-10-07T19:31:51.812919] [DEBUG] [LOCAL ] IAG: Loaded 53456 existing records from primary storage. [2025-10-07T19:31:51.861432] [INFO ] [MAIN ] IAG: Loaded 53456 existing records. [2025-10-07T19:31:51.900844] [DEBUG] [LOCAL ] IBN: Loaded 52865 existing records from primary storage. [2025-10-07T19:31:51.963154] [INFO ] [MAIN ] IBN: Loaded 52865 existing records. [2025-10-07T19:31:52.048793] [DEBUG] [LOCAL ] IBM: Loaded 53631 existing records from primary storage. [2025-10-07T19:31:52.107188] [INFO ] [MAIN ] IBM: Loaded 53631 existing records. [2025-10-07T19:31:52.276283] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:31:52.321983] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-07T19:31:52.395274] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-07T19:31:52.468692] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:31:52.512211] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-07T19:31:52.517954] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-07T19:31:52.519040] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-07T19:31:52.519141] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-07T19:31:52.528036] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:31:52.549751] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-07T19:31:52.550056] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-07T19:31:52.559631] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-07T19:31:52.619136] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-07T19:31:52.757559] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:31:52.752970] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-07T19:31:52.815131] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-07T19:31:52.835235] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-07T19:31:52.820836] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-07T19:31:52.864187] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-07T19:31:52.864431] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-07T19:31:53.723757] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:31:53.816614] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-07T19:31:53.849626] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:31:53.877141] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-07T19:31:53.997489] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:31:54.008059] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-07T19:31:54.061189] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:31:54.061468] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-07T19:31:55.069827] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T19:31:55.075698] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-07T19:31:55.761122] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T19:31:55.772707] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-07T19:31:55.818043] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T19:31:55.830087] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-07T19:31:56.190956] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T19:31:56.196329] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-07T19:31:56.275466] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-07T19:31:56.647692] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-07T19:31:57.428615] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T19:31:57.447619] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-07T19:31:57.596561] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T19:31:57.654226] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T19:31:58.247731] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-07T19:31:58.852375] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-07T19:31:58.926368] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T19:31:59.047673] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-07T19:31:59.847661] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-07T19:31:59.970593] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T19:32:00.334904] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T19:32:00.647706] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-07T19:32:01.447742] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-07T19:32:02.169973] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-07T19:32:02.247629] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-07T19:32:02.615418] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T19:32:02.679102] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T19:32:03.047703] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-07T19:32:03.847689] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-07T19:32:04.460793] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-07T19:32:04.647755] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-07T19:32:04.996893] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T19:32:05.436791] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T19:32:05.448790] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-07T19:32:05.571047] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T19:32:06.247679] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-07T19:32:07.047729] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-07T19:32:07.619449] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-07T19:32:07.792612] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-07T19:32:07.847710] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-07T19:32:08.647673] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-07T19:32:08.928033] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T19:32:09.447609] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-07T19:32:09.596721] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T19:32:10.113442] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T19:32:10.247674] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-07T19:32:11.047638] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-07T19:32:11.333741] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T19:32:11.489073] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T19:32:11.847739] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-07T19:32:12.647717] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-07T19:32:13.052525] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T19:32:13.086167] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T19:32:13.088446] [INFO ] [REMOTE ] IBP: Full fetch complete (41181 records). [2025-10-07T19:32:13.088536] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-07T19:32:13.452824] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-07T19:32:13.549577] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-07T19:32:13.549732] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-07T19:32:13.550565] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-07T19:32:13.550675] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-07T19:32:13.551947] [DEBUG] [LOCAL ] IBP: Trimmed 41181 records to 28806 (keeping 200 days of data) [2025-10-07T19:32:13.753746] [DEBUG] [LOCAL ] IBP: Primary data saved (28806 records). [2025-10-07T19:32:13.753908] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-07T19:32:13.754000] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IBP took 22.8s. Estimated remaining: 3h 1m 35s. Rate: 7.1 symbols/min [2025-10-07T19:32:13.965710] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:32:14.003533] [DEBUG] [LOCAL ] IBTA: Loaded 37411 existing records from primary storage. [2025-10-07T19:32:14.003951] [INFO ] [MAIN ] IBTA: Loaded 37411 existing records. [2025-10-07T19:32:14.222092] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:32:14.222356] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-07T19:32:14.222407] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-07T19:32:14.222637] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-07T19:32:14.222736] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-07T19:32:14.259553] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-07T19:32:14.700406] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:32:14.713106] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-07T19:32:15.047747] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-07T19:32:15.269372] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T19:32:15.847767] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-07T19:32:16.376823] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T19:32:16.647632] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-07T19:32:16.742670] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-07T19:32:17.447691] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-07T19:32:17.590241] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T19:32:17.789752] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T19:32:18.247680] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-07T19:32:19.047742] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-07T19:32:19.847688] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-07T19:32:19.984339] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-07T19:32:20.168111] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T19:32:20.647705] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-07T19:32:20.822174] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T19:32:20.866617] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T19:32:21.447696] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-07T19:32:22.247699] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-07T19:32:23.053566] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-07T19:32:23.070457] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-07T19:32:23.306517] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-07T19:32:23.594034] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T19:32:23.847721] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-07T19:32:24.495844] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T19:32:24.647686] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-07T19:32:25.447749] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-07T19:32:25.744843] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T19:32:26.113254] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T19:32:26.247823] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-07T19:32:26.814409] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T19:32:27.047704] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-07T19:32:27.660027] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T19:32:27.847732] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-07T19:32:28.535228] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T19:32:28.538877] [INFO ] [REMOTE ] IBN: Full fetch complete (76316 records). [2025-10-07T19:32:28.538997] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-07T19:32:28.652735] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-07T19:32:28.926115] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-07T19:32:28.926195] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-07T19:32:28.927100] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-07T19:32:28.927166] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-07T19:32:28.928624] [DEBUG] [LOCAL ] IBN: Trimmed 76316 records to 52857 (keeping 200 days of data) [2025-10-07T19:32:29.251471] [DEBUG] [LOCAL ] IBN: Primary data saved (52857 records). [2025-10-07T19:32:29.251612] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-07T19:32:29.251726] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 38.3s. Estimated remaining: 3h 1m 35s. Rate: 7.1 symbols/min [2025-10-07T19:32:29.415585] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:32:29.447762] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-07T19:32:29.470722] [DEBUG] [LOCAL ] ICE: Loaded 53010 existing records from primary storage. [2025-10-07T19:32:29.471049] [INFO ] [MAIN ] ICE: Loaded 53010 existing records. [2025-10-07T19:32:29.645881] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:32:29.646096] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-07T19:32:29.646143] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-07T19:32:29.646409] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-07T19:32:29.646466] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-07T19:32:30.004026] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:32:30.015534] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T19:32:30.179761] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-07T19:32:30.183293] [INFO ] [REMOTE ] IBM: Full fetch complete (77621 records). [2025-10-07T19:32:30.183398] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-07T19:32:30.252811] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-07T19:32:30.580719] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-07T19:32:30.580809] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-07T19:32:30.581775] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-07T19:32:30.581840] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-07T19:32:30.584305] [DEBUG] [LOCAL ] IBM: Trimmed 77621 records to 53631 (keeping 200 days of data) [2025-10-07T19:32:30.932743] [DEBUG] [LOCAL ] IBM: Primary data saved (53631 records). [2025-10-07T19:32:30.932898] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-07T19:32:30.933028] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBM took 40.0s. Estimated remaining: 3h 1m 18s. Rate: 7.1 symbols/min [2025-10-07T19:32:31.052746] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-07T19:32:31.109060] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:32:31.144804] [DEBUG] [LOCAL ] ICL: Loaded 38331 existing records from primary storage. [2025-10-07T19:32:31.145121] [INFO ] [MAIN ] ICL: Loaded 38331 existing records. [2025-10-07T19:32:31.325978] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:32:31.326407] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-07T19:32:31.326470] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-07T19:32:31.337918] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-07T19:32:31.353383] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-07T19:32:31.456027] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T19:32:31.722872] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:32:31.847741] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-07T19:32:32.141973] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T19:32:32.206043] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T19:32:32.647720] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-07T19:32:33.289747] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T19:32:33.447724] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-07T19:32:34.247676] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-07T19:32:34.460978] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T19:32:35.047691] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-07T19:32:35.656036] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-07T19:32:35.659945] [INFO ] [REMOTE ] IAG: Full fetch complete (77271 records). [2025-10-07T19:32:35.660071] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-07T19:32:35.851043] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-07T19:32:36.077738] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-07T19:32:36.077970] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-07T19:32:36.079010] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-07T19:32:36.079228] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-07T19:32:36.104891] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T19:32:36.105102] [DEBUG] [LOCAL ] IAG: Trimmed 77271 records to 53461 (keeping 200 days of data) [2025-10-07T19:32:36.432490] [DEBUG] [LOCAL ] IAG: Primary data saved (53461 records). [2025-10-07T19:32:36.432680] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-07T19:32:36.433621] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IAG took 45.5s. Estimated remaining: 3h 1m 6s. Rate: 7.1 symbols/min [2025-10-07T19:32:36.616227] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:32:36.652870] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-07T19:32:36.654880] [DEBUG] [LOCAL ] IDA: Loaded 32463 existing records from primary storage. [2025-10-07T19:32:36.655211] [INFO ] [MAIN ] IDA: Loaded 32463 existing records. [2025-10-07T19:32:36.840793] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:32:36.841179] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-07T19:32:36.841239] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-07T19:32:36.841832] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-07T19:32:36.841891] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-07T19:32:37.205428] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-07T19:32:37.281811] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:32:37.283843] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T19:32:37.447603] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-07T19:32:38.214373] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T19:32:38.247686] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-07T19:32:38.683495] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T19:32:39.047696] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-07T19:32:39.482690] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T19:32:39.485694] [INFO ] [REMOTE ] IBTA: Full fetch complete (50911 records). [2025-10-07T19:32:39.485792] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-07T19:32:39.852736] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-07T19:32:39.953414] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-07T19:32:39.953501] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-07T19:32:39.954382] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-07T19:32:39.954475] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-07T19:32:39.955781] [DEBUG] [LOCAL ] IBTA: Trimmed 50911 records to 37273 (keeping 200 days of data) [2025-10-07T19:32:40.190432] [DEBUG] [LOCAL ] IBTA: Primary data saved (37273 records). [2025-10-07T19:32:40.190705] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-07T19:32:40.190889] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBTA took 26.4s. Estimated remaining: 3h 0m 52s. Rate: 7.1 symbols/min [2025-10-07T19:32:40.362494] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:32:40.376536] [DEBUG] [LOCAL ] IDE: Loaded 8817 existing records from primary storage. [2025-10-07T19:32:40.376834] [INFO ] [MAIN ] IDE: Loaded 8817 existing records. [2025-10-07T19:32:40.616697] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:32:40.630176] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-07T19:32:40.630091] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T19:32:40.630374] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-07T19:32:40.638386] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-07T19:32:40.638458] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-07T19:32:40.652915] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-07T19:32:41.092528] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:32:41.447693] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-07T19:32:41.714957] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T19:32:42.255015] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-07T19:32:42.260862] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T19:32:42.468194] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T19:32:43.030765] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T19:32:43.047598] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-07T19:32:43.814217] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T19:32:43.847625] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-07T19:32:44.647747] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-07T19:32:45.447760] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-07T19:32:45.752141] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T19:32:45.830389] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T19:32:45.968597] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-07T19:32:46.247676] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-07T19:32:47.047619] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-07T19:32:47.428051] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T19:32:47.847697] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-07T19:32:48.447020] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T19:32:48.647717] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-07T19:32:49.050292] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T19:32:49.447688] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-07T19:32:50.153380] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T19:32:50.247625] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-07T19:32:51.047721] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-07T19:32:51.093111] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T19:32:51.670960] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T19:32:51.844680] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T19:32:51.852689] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-07T19:32:52.647746] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-07T19:32:53.447687] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-07T19:32:53.704418] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T19:32:54.179477] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:32:54.247712] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-07T19:32:54.687585] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T19:32:54.963255] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-07T19:32:55.047631] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-07T19:32:55.847714] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-07T19:32:56.656772] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-07T19:32:56.659549] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T19:32:56.816546] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T19:32:57.447719] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-07T19:32:58.078198] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T19:32:58.247769] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-07T19:32:58.812518] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T19:32:58.958443] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T19:32:59.047671] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-07T19:32:59.817636] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T19:32:59.847602] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-07T19:33:00.647731] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-07T19:33:00.764276] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T19:33:01.447731] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-07T19:33:01.951008] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T19:33:01.954875] [INFO ] [REMOTE ] ICL: Full fetch complete (55912 records). [2025-10-07T19:33:01.955173] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-07T19:33:02.252774] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-07T19:33:02.347912] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-07T19:33:02.348013] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-07T19:33:02.348814] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-07T19:33:02.348885] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-07T19:33:02.351006] [DEBUG] [LOCAL ] ICL: Trimmed 55912 records to 38342 (keeping 200 days of data) [2025-10-07T19:33:02.576111] [DEBUG] [LOCAL ] ICL: Primary data saved (38342 records). [2025-10-07T19:33:02.576277] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-07T19:33:02.576388] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. ICL took 31.6s. Estimated remaining: 3h 1m 0s. Rate: 7.1 symbols/min [2025-10-07T19:33:02.750750] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:33:02.770395] [DEBUG] [LOCAL ] IDT: Loaded 18050 existing records from primary storage. [2025-10-07T19:33:02.770702] [INFO ] [MAIN ] IDT: Loaded 18050 existing records. [2025-10-07T19:33:02.997639] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:33:02.998053] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-07T19:33:02.998214] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-07T19:33:02.998500] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-07T19:33:02.998568] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-07T19:33:03.054209] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-07T19:33:03.129318] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T19:33:03.407238] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:33:03.440060] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-07T19:33:03.847669] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-07T19:33:04.373980] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-07T19:33:04.647636] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-07T19:33:04.876019] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T19:33:05.447729] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-07T19:33:06.247702] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-07T19:33:06.259028] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T19:33:06.261140] [INFO ] [REMOTE ] IDE: Full fetch complete (12550 records). [2025-10-07T19:33:06.261235] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-07T19:33:06.697477] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T19:33:06.706422] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-07T19:33:06.718053] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-07T19:33:06.718999] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-07T19:33:06.719121] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-07T19:33:06.720968] [DEBUG] [LOCAL ] IDE: Trimmed 12550 records to 8835 (keeping 200 days of data) [2025-10-07T19:33:06.785547] [DEBUG] [LOCAL ] IDE: Primary data saved (8835 records). [2025-10-07T19:33:06.785783] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-07T19:33:06.785923] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. IDE took 26.6s. Estimated remaining: 3h 0m 47s. Rate: 7.1 symbols/min [2025-10-07T19:33:06.974550] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:33:07.026688] [DEBUG] [LOCAL ] IEX: Loaded 38346 existing records from primary storage. [2025-10-07T19:33:07.027137] [INFO ] [MAIN ] IEX: Loaded 38346 existing records. [2025-10-07T19:33:07.052913] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-07T19:33:07.230498] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:33:07.230864] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-07T19:33:07.230920] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-07T19:33:07.231415] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-07T19:33:07.231483] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-07T19:33:07.655874] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:33:07.660572] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T19:33:07.847745] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-07T19:33:08.647746] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-07T19:33:09.002094] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T19:33:09.040573] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T19:33:09.416863] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T19:33:09.447602] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-07T19:33:10.247689] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-07T19:33:10.345896] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T19:33:11.047745] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-07T19:33:11.214887] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T19:33:11.847707] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-07T19:33:12.111593] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T19:33:12.647708] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-07T19:33:13.286628] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T19:33:13.447750] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-07T19:33:14.247708] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-07T19:33:14.340346] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-07T19:33:14.344344] [INFO ] [REMOTE ] ICE: Full fetch complete (76757 records). [2025-10-07T19:33:14.344495] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-07T19:33:14.554862] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T19:33:14.787194] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-07T19:33:14.787451] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-07T19:33:14.788903] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-07T19:33:14.788991] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-07T19:33:14.791150] [DEBUG] [LOCAL ] ICE: Trimmed 76757 records to 53011 (keeping 200 days of data) [2025-10-07T19:33:15.049598] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-07T19:33:15.189444] [DEBUG] [LOCAL ] ICE: Primary data saved (53011 records). [2025-10-07T19:33:15.189683] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-07T19:33:15.189842] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICE took 45.9s. Estimated remaining: 3h 0m 38s. Rate: 7.1 symbols/min [2025-10-07T19:33:15.399442] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:33:15.458033] [DEBUG] [LOCAL ] IFF: Loaded 51017 existing records from primary storage. [2025-10-07T19:33:15.458483] [INFO ] [MAIN ] IFF: Loaded 51017 existing records. [2025-10-07T19:33:15.659596] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:33:15.671847] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-07T19:33:15.672027] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-07T19:33:15.673934] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-07T19:33:15.673853] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T19:33:15.674074] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-07T19:33:15.860092] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-07T19:33:16.146253] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:33:16.599232] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T19:33:16.647718] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-07T19:33:17.209326] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T19:33:17.212286] [INFO ] [REMOTE ] IDA: Full fetch complete (44957 records). [2025-10-07T19:33:17.212452] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-07T19:33:17.452762] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-07T19:33:17.623234] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-07T19:33:17.623357] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-07T19:33:17.624620] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-07T19:33:17.624714] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-07T19:33:17.626248] [DEBUG] [LOCAL ] IDA: Trimmed 44957 records to 32522 (keeping 200 days of data) [2025-10-07T19:33:17.864543] [DEBUG] [LOCAL ] IDA: Primary data saved (32522 records). [2025-10-07T19:33:17.864781] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-07T19:33:17.864899] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDA took 41.4s. Estimated remaining: 3h 0m 23s. Rate: 7.1 symbols/min [2025-10-07T19:33:18.052226] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:33:18.088427] [DEBUG] [LOCAL ] IFN: Loaded 18369 existing records from primary storage. [2025-10-07T19:33:18.089001] [INFO ] [MAIN ] IFN: Loaded 18369 existing records. [2025-10-07T19:33:18.251573] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-07T19:33:18.300810] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:33:18.301418] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-07T19:33:18.301665] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-07T19:33:18.301997] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-07T19:33:18.302117] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-07T19:33:18.442287] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T19:33:18.726457] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:33:19.047685] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-07T19:33:19.307186] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T19:33:19.363773] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T19:33:19.847742] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-07T19:33:20.560966] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T19:33:20.631999] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T19:33:20.647605] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-07T19:33:21.447719] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-07T19:33:21.904490] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T19:33:22.247661] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-07T19:33:22.567212] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T19:33:23.047757] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-07T19:33:23.655678] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T19:33:23.847735] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-07T19:33:24.221743] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T19:33:24.647736] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-07T19:33:25.452871] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-07T19:33:25.467085] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:33:25.516564] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T19:33:26.247668] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-07T19:33:26.624484] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T19:33:26.873331] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T19:33:27.047737] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-07T19:33:27.847727] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-07T19:33:28.404521] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-07T19:33:28.647692] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-07T19:33:28.853590] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T19:33:29.447737] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-07T19:33:30.024834] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T19:33:30.178799] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T19:33:30.247723] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-07T19:33:31.047732] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-07T19:33:31.847723] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-07T19:33:32.093188] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T19:33:32.125897] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-07T19:33:32.647761] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-07T19:33:32.918606] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T19:33:33.447750] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-07T19:33:33.973299] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T19:33:33.976357] [INFO ] [REMOTE ] IDT: Full fetch complete (23313 records). [2025-10-07T19:33:33.976460] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-07T19:33:34.252823] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-07T19:33:34.364945] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-07T19:33:34.365137] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-07T19:33:34.366162] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-07T19:33:34.366333] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-07T19:33:34.367227] [DEBUG] [LOCAL ] IDT: Trimmed 23313 records to 18116 (keeping 200 days of data) [2025-10-07T19:33:34.468931] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T19:33:34.513780] [DEBUG] [LOCAL ] IDT: Primary data saved (18116 records). [2025-10-07T19:33:34.514029] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-07T19:33:34.514141] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDT took 31.9s. Estimated remaining: 3h 0m 24s. Rate: 7.1 symbols/min [2025-10-07T19:33:34.691357] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:33:34.716611] [DEBUG] [LOCAL ] IFS: Loaded 22985 existing records from primary storage. [2025-10-07T19:33:34.717053] [INFO ] [MAIN ] IFS: Loaded 22985 existing records. [2025-10-07T19:33:34.916345] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:33:34.916704] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-07T19:33:34.916768] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-07T19:33:34.917072] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-07T19:33:34.917132] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-07T19:33:35.052791] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-07T19:33:35.299164] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:33:35.783063] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T19:33:35.845707] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T19:33:35.850889] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-07T19:33:36.647748] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-07T19:33:37.447666] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-07T19:33:37.540530] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T19:33:37.594752] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T19:33:38.247697] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-07T19:33:38.495565] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T19:33:39.047734] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-07T19:33:39.723985] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T19:33:39.847698] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-07T19:33:40.400734] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T19:33:40.403707] [INFO ] [REMOTE ] IEX: Full fetch complete (53436 records). [2025-10-07T19:33:40.403852] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-07T19:33:40.652790] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-07T19:33:40.820339] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-07T19:33:40.820502] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-07T19:33:40.821569] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-07T19:33:40.821817] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-07T19:33:40.824042] [DEBUG] [LOCAL ] IEX: Trimmed 53436 records to 38343 (keeping 200 days of data) [2025-10-07T19:33:40.943080] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T19:33:41.117104] [DEBUG] [LOCAL ] IEX: Primary data saved (38343 records). [2025-10-07T19:33:41.117377] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-07T19:33:41.117499] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IEX took 34.3s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-07T19:33:41.303418] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:33:41.316629] [DEBUG] [LOCAL ] IGA: Loaded 9908 existing records from primary storage. [2025-10-07T19:33:41.317039] [INFO ] [MAIN ] IGA: Loaded 9908 existing records. [2025-10-07T19:33:41.452825] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-07T19:33:41.510610] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:33:41.511119] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-07T19:33:41.511171] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-07T19:33:41.511517] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-07T19:33:41.511577] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-07T19:33:41.903992] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:33:42.247699] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-07T19:33:42.319260] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T19:33:42.430119] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T19:33:42.433092] [INFO ] [REMOTE ] IFN: Full fetch complete (29068 records). [2025-10-07T19:33:42.433280] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-07T19:33:42.860230] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-07T19:33:42.860392] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-07T19:33:42.861194] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-07T19:33:42.861263] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-07T19:33:42.862309] [DEBUG] [LOCAL ] IFN: Trimmed 29068 records to 18399 (keeping 200 days of data) [2025-10-07T19:33:42.984602] [DEBUG] [LOCAL ] IFN: Primary data saved (18399 records). [2025-10-07T19:33:42.984846] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-07T19:33:42.984962] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IFN took 25.1s. Estimated remaining: 2h 59m 57s. Rate: 7.1 symbols/min [2025-10-07T19:33:43.053282] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-07T19:33:43.177715] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:33:43.200713] [DEBUG] [LOCAL ] IGD: Loaded 19180 existing records from primary storage. [2025-10-07T19:33:43.201143] [INFO ] [MAIN ] IGD: Loaded 19180 existing records. [2025-10-07T19:33:43.328844] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T19:33:43.423079] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:33:43.423467] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-07T19:33:43.423528] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-07T19:33:43.423776] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-07T19:33:43.423835] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-07T19:33:43.786676] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:33:43.847748] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-07T19:33:44.647730] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-07T19:33:44.793302] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T19:33:45.031372] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T19:33:45.447680] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-07T19:33:45.942820] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T19:33:46.247661] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-07T19:33:46.646804] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T19:33:47.047692] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-07T19:33:47.847714] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-07T19:33:48.071002] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T19:33:48.253146] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-07T19:33:48.647751] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-07T19:33:48.968479] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T19:33:49.447780] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-07T19:33:50.247701] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-07T19:33:50.433107] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T19:33:50.583036] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T19:33:50.905825] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T19:33:51.047701] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-07T19:33:51.837198] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T19:33:51.847631] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-07T19:33:52.547876] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-07T19:33:52.647725] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-07T19:33:53.447725] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-07T19:33:54.247718] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-07T19:33:54.250105] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T19:33:54.254529] [INFO ] [REMOTE ] IFF: Full fetch complete (73133 records). [2025-10-07T19:33:54.254762] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-07T19:33:54.639515] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T19:33:54.707534] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-07T19:33:54.707686] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-07T19:33:54.709016] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-07T19:33:54.709089] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-07T19:33:54.711097] [DEBUG] [LOCAL ] IFF: Trimmed 73133 records to 51041 (keeping 200 days of data) [2025-10-07T19:33:55.048612] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-07T19:33:55.061548] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T19:33:55.088545] [DEBUG] [LOCAL ] IFF: Primary data saved (51041 records). [2025-10-07T19:33:55.088725] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-07T19:33:55.088850] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFF took 39.9s. Estimated remaining: 2h 59m 53s. Rate: 7.1 symbols/min [2025-10-07T19:33:55.264578] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:33:55.273088] [DEBUG] [LOCAL ] IGI: Loaded 3684 existing records from primary storage. [2025-10-07T19:33:55.273382] [INFO ] [MAIN ] IGI: Loaded 3684 existing records. [2025-10-07T19:33:55.463717] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:33:55.464049] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-07T19:33:55.464145] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-07T19:33:55.464525] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-07T19:33:55.464625] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-07T19:33:55.836215] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:33:55.847599] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-07T19:33:56.122710] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T19:33:56.616473] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T19:33:56.647717] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-07T19:33:57.104835] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-07T19:33:57.447677] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-07T19:33:57.760076] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-07T19:33:58.247692] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-07T19:33:59.047682] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-07T19:33:59.196455] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T19:33:59.637533] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T19:33:59.847700] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-07T19:34:00.647726] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-07T19:34:00.982359] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T19:34:01.447770] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-07T19:34:01.713081] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T19:34:02.247759] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-07T19:34:02.289871] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T19:34:02.834225] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T19:34:03.047729] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-07T19:34:03.847677] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-07T19:34:04.018500] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T19:34:04.647621] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-07T19:34:04.938188] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T19:34:05.228079] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-07T19:34:05.447690] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-07T19:34:05.906024] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-07T19:34:06.247724] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-07T19:34:06.839266] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T19:34:07.047731] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-07T19:34:07.847631] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-07T19:34:08.075223] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T19:34:08.532676] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-07T19:34:08.647715] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-07T19:34:09.294435] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-07T19:34:09.447702] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-07T19:34:10.059444] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T19:34:10.247723] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-07T19:34:10.985802] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T19:34:11.047689] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-07T19:34:11.847674] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-07T19:34:11.867618] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T19:34:12.423689] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T19:34:12.647673] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-07T19:34:13.446960] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T19:34:13.452765] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-07T19:34:14.118580] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T19:34:14.119562] [INFO ] [REMOTE ] IGI: Full fetch complete (5322 records). [2025-10-07T19:34:14.119633] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-07T19:34:14.258023] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-07T19:34:14.496496] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-07T19:34:14.496599] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-07T19:34:14.496807] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-07T19:34:14.496871] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-07T19:34:14.497382] [DEBUG] [LOCAL ] IGI: Trimmed 5322 records to 3734 (keeping 200 days of data) [2025-10-07T19:34:14.521051] [DEBUG] [LOCAL ] IGI: Primary data saved (3734 records). [2025-10-07T19:34:14.521210] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-07T19:34:14.521319] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IGI took 19.4s. Estimated remaining: 2h 59m 58s. Rate: 7.1 symbols/min [2025-10-07T19:34:14.696768] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:34:14.726546] [DEBUG] [LOCAL ] IGR: Loaded 30365 existing records from primary storage. [2025-10-07T19:34:14.726855] [INFO ] [MAIN ] IGR: Loaded 30365 existing records. [2025-10-07T19:34:14.902669] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:34:14.903010] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-07T19:34:14.903060] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-07T19:34:14.903347] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-07T19:34:14.903406] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-07T19:34:15.052278] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-07T19:34:15.215030] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T19:34:15.279152] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:34:15.847616] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-07T19:34:16.143954] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T19:34:16.647718] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-07T19:34:17.368294] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T19:34:17.369730] [INFO ] [REMOTE ] IGA: Full fetch complete (13817 records). [2025-10-07T19:34:17.369839] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-07T19:34:17.448852] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-07T19:34:17.760502] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T19:34:17.777245] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-07T19:34:17.778191] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-07T19:34:17.778748] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-07T19:34:17.778813] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-07T19:34:17.779416] [DEBUG] [LOCAL ] IGA: Trimmed 13817 records to 9969 (keeping 200 days of data) [2025-10-07T19:34:17.841437] [DEBUG] [LOCAL ] IGA: Primary data saved (9969 records). [2025-10-07T19:34:17.841588] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-07T19:34:17.841696] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IGA took 36.7s. Estimated remaining: 2h 59m 43s. Rate: 7.1 symbols/min [2025-10-07T19:34:18.011144] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:34:18.017540] [DEBUG] [LOCAL ] IH: Loaded 2883 existing records from primary storage. [2025-10-07T19:34:18.017737] [INFO ] [MAIN ] IH: Loaded 2883 existing records. [2025-10-07T19:34:18.202106] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:34:18.202402] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-07T19:34:18.202451] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-07T19:34:18.202631] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-07T19:34:18.202717] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-07T19:34:18.255774] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-07T19:34:18.560270] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:34:18.587261] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T19:34:19.047727] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-07T19:34:19.250878] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T19:34:19.252700] [INFO ] [REMOTE ] IGD: Full fetch complete (29796 records). [2025-10-07T19:34:19.252771] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-07T19:34:19.655951] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-07T19:34:19.656032] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-07T19:34:19.656566] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-07T19:34:19.656605] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-07T19:34:19.657990] [DEBUG] [LOCAL ] IGD: Trimmed 29796 records to 19232 (keeping 200 days of data) [2025-10-07T19:34:19.771797] [DEBUG] [LOCAL ] IGD: Primary data saved (19232 records). [2025-10-07T19:34:19.771967] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-07T19:34:19.772094] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGD took 36.8s. Estimated remaining: 2h 59m 27s. Rate: 7.1 symbols/min [2025-10-07T19:34:19.852930] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-07T19:34:19.974033] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:34:19.984232] [DEBUG] [LOCAL ] IHD: Loaded 6945 existing records from primary storage. [2025-10-07T19:34:19.984493] [INFO ] [MAIN ] IHD: Loaded 6945 existing records. [2025-10-07T19:34:20.210475] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:34:20.210756] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-07T19:34:20.210812] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-07T19:34:20.211018] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-07T19:34:20.211076] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-07T19:34:20.607600] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:34:20.611128] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T19:34:20.614284] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T19:34:20.647608] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-07T19:34:21.447738] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-07T19:34:21.685363] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T19:34:22.247709] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-07T19:34:22.680456] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T19:34:22.733706] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T19:34:23.047716] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-07T19:34:23.847714] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-07T19:34:23.879351] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T19:34:23.953429] [DEBUG] [REMOTE ] IFS: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-07T19:34:23.953794] [WARN ] [REMOTE ] IFS: No data returned for month 2025-09 [2025-10-07T19:34:23.953908] [FATAL] [REMOTE ] IFS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:34:23.954017] [FATAL] [MAIN ] IFS: Failed to fetch primary data. [2025-10-07T19:34:23.954087] [WARN ] [MAIN ] IFS: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:34:23.954158] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-07T19:34:23.954226] [DEBUG] [LOCAL ] IFS: No primary data file found to delete. [2025-10-07T19:34:23.954263] [INFO ] [LOCAL ] IFS: Starting deletion of derivative data. [2025-10-07T19:34:23.954488] [DEBUG] [LOCAL ] IFS: Deleted derivative data file. [2025-10-07T19:34:23.954587] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IFS took 49.4s. Estimated remaining: 2h 59m 14s. Rate: 7.1 symbols/min [2025-10-07T19:34:24.124682] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:34:24.148419] [DEBUG] [LOCAL ] IHG: Loaded 24338 existing records from primary storage. [2025-10-07T19:34:24.148774] [INFO ] [MAIN ] IHG: Loaded 24338 existing records. [2025-10-07T19:34:24.322247] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:34:24.322474] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-07T19:34:24.322530] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-07T19:34:24.322825] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-07T19:34:24.322883] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-07T19:34:24.651826] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-07T19:34:24.676384] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:34:25.448899] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-07T19:34:25.452710] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T19:34:26.247770] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-07T19:34:26.709389] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T19:34:26.723965] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T19:34:27.047735] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-07T19:34:27.847716] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-07T19:34:28.099473] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T19:34:28.462102] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T19:34:28.647742] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-07T19:34:29.447736] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-07T19:34:29.911234] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T19:34:30.040437] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T19:34:30.247707] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-07T19:34:31.047749] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-07T19:34:31.486289] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T19:34:31.847739] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-07T19:34:31.886562] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-07T19:34:32.647726] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-07T19:34:33.084522] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T19:34:33.375060] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T19:34:33.447712] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-07T19:34:34.091399] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T19:34:34.247716] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-07T19:34:34.696907] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-07T19:34:35.047738] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-07T19:34:35.479126] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-07T19:34:35.847674] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-07T19:34:36.647754] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-07T19:34:37.243790] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T19:34:37.403215] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T19:34:37.447621] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-07T19:34:38.062806] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T19:34:38.247697] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-07T19:34:38.668606] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-07T19:34:39.047691] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-07T19:34:39.847634] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-07T19:34:40.360799] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T19:34:40.601625] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T19:34:40.647613] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-07T19:34:41.264612] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T19:34:41.447718] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-07T19:34:42.247688] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-07T19:34:42.862238] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T19:34:43.047627] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-07T19:34:43.356812] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T19:34:43.505899] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-07T19:34:43.847738] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-07T19:34:44.327890] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-07T19:34:44.647702] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-07T19:34:45.447742] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-07T19:34:45.857936] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-07T19:34:46.193205] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T19:34:46.194360] [INFO ] [REMOTE ] IHD: Full fetch complete (11818 records). [2025-10-07T19:34:46.194432] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-07T19:34:46.256442] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-07T19:34:46.565085] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-07T19:34:46.565165] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-07T19:34:46.565439] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-07T19:34:46.565481] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-07T19:34:46.566023] [DEBUG] [LOCAL ] IHD: Trimmed 11818 records to 7017 (keeping 200 days of data) [2025-10-07T19:34:46.614789] [DEBUG] [LOCAL ] IHD: Primary data saved (7017 records). [2025-10-07T19:34:46.614955] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-07T19:34:46.615046] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IHD took 26.8s. Estimated remaining: 2h 59m 22s. Rate: 7.1 symbols/min [2025-10-07T19:34:46.787819] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:34:46.831283] [DEBUG] [LOCAL ] IHS: Loaded 38705 existing records from primary storage. [2025-10-07T19:34:46.831603] [INFO ] [MAIN ] IHS: Loaded 38705 existing records. [2025-10-07T19:34:47.016879] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:34:47.018322] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-07T19:34:47.018382] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-07T19:34:47.019125] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-07T19:34:47.019184] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-07T19:34:47.053724] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-07T19:34:47.376228] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:34:47.452427] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T19:34:47.581871] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T19:34:47.582629] [INFO ] [REMOTE ] IH: Full fetch complete (4957 records). [2025-10-07T19:34:47.582740] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-07T19:34:47.854343] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-07T19:34:47.937490] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-07T19:34:47.937563] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-07T19:34:47.937734] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-07T19:34:47.937795] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-07T19:34:47.938152] [DEBUG] [LOCAL ] IH: Trimmed 4957 records to 2861 (keeping 200 days of data) [2025-10-07T19:34:47.954885] [DEBUG] [LOCAL ] IH: Primary data saved (2861 records). [2025-10-07T19:34:47.954948] [INFO ] [MAIN ] IH: Full history saved. [2025-10-07T19:34:47.955025] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IH took 30.1s. Estimated remaining: 2h 59m 5s. Rate: 7.1 symbols/min [2025-10-07T19:34:48.129018] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:34:48.138052] [DEBUG] [LOCAL ] IIF: Loaded 5697 existing records from primary storage. [2025-10-07T19:34:48.138231] [INFO ] [MAIN ] IIF: Loaded 5697 existing records. [2025-10-07T19:34:48.313430] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:34:48.313689] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-07T19:34:48.313755] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-07T19:34:48.313916] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-07T19:34:48.313973] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-07T19:34:48.649231] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-07T19:34:48.672182] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:34:49.447752] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-07T19:34:49.560587] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T19:34:50.208314] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T19:34:50.247686] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-07T19:34:50.759090] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T19:34:51.047753] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-07T19:34:51.423222] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T19:34:51.847686] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-07T19:34:52.191277] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T19:34:52.647638] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-07T19:34:52.872195] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T19:34:52.874169] [INFO ] [REMOTE ] IHG: Full fetch complete (33829 records). [2025-10-07T19:34:52.874296] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-07T19:34:53.263803] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-07T19:34:53.263886] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-07T19:34:53.264450] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-07T19:34:53.264491] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-07T19:34:53.265294] [DEBUG] [LOCAL ] IHG: Trimmed 33829 records to 24318 (keeping 200 days of data) [2025-10-07T19:34:53.425627] [DEBUG] [LOCAL ] IHG: Primary data saved (24318 records). [2025-10-07T19:34:53.425797] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-07T19:34:53.425910] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IHG took 29.5s. Estimated remaining: 2h 58m 53s. Rate: 7.1 symbols/min [2025-10-07T19:34:53.455508] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-07T19:34:53.602058] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:34:53.619575] [DEBUG] [LOCAL ] IIIN: Loaded 16204 existing records from primary storage. [2025-10-07T19:34:53.619881] [INFO ] [MAIN ] IIIN: Loaded 16204 existing records. [2025-10-07T19:34:53.804968] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:34:53.805256] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-07T19:34:53.805362] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-07T19:34:53.805721] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-07T19:34:53.805785] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-07T19:34:54.200100] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:34:54.224437] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T19:34:54.247601] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-07T19:34:54.489795] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T19:34:55.047721] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-07T19:34:55.440129] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-07T19:34:55.847746] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-07T19:34:55.957040] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T19:34:56.647751] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-07T19:34:56.896208] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T19:34:57.447773] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-07T19:34:57.998218] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T19:34:58.247697] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-07T19:34:58.505935] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T19:34:59.047757] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-07T19:34:59.184940] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T19:34:59.187143] [INFO ] [REMOTE ] IGR: Full fetch complete (45488 records). [2025-10-07T19:34:59.187261] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-07T19:34:59.565199] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-07T19:34:59.565277] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-07T19:34:59.565929] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-07T19:34:59.565993] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-07T19:34:59.566909] [DEBUG] [LOCAL ] IGR: Trimmed 45488 records to 30409 (keeping 200 days of data) [2025-10-07T19:34:59.752472] [DEBUG] [LOCAL ] IGR: Primary data saved (30409 records). [2025-10-07T19:34:59.752614] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-07T19:34:59.752731] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IGR took 45.2s. Estimated remaining: 2h 58m 42s. Rate: 7.1 symbols/min [2025-10-07T19:34:59.852895] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-07T19:34:59.929600] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:34:59.947575] [DEBUG] [LOCAL ] IIM: Loaded 15908 existing records from primary storage. [2025-10-07T19:34:59.947847] [INFO ] [MAIN ] IIM: Loaded 15908 existing records. [2025-10-07T19:35:00.126082] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:35:00.126580] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-07T19:35:00.132873] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-07T19:35:00.141744] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-07T19:35:00.142740] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T19:35:00.142257] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-07T19:35:00.515203] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:35:00.647666] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-07T19:35:01.223778] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T19:35:01.447693] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-07T19:35:02.247716] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-07T19:35:02.309206] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T19:35:02.793483] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T19:35:03.053775] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-07T19:35:03.073236] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T19:35:03.847695] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-07T19:35:04.093675] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T19:35:04.647769] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-07T19:35:04.892564] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T19:35:05.447746] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-07T19:35:05.718736] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T19:35:06.247733] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-07T19:35:06.592066] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T19:35:06.933373] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-07T19:35:07.047726] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-07T19:35:07.847674] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-07T19:35:07.916730] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T19:35:08.647714] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-07T19:35:08.911551] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T19:35:09.435687] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T19:35:09.447621] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-07T19:35:10.048911] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T19:35:10.247731] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-07T19:35:11.047672] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-07T19:35:11.365001] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T19:35:11.847750] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-07T19:35:12.554337] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T19:35:12.647718] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-07T19:35:12.815072] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-07T19:35:13.098347] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T19:35:13.447754] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-07T19:35:14.247746] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-07T19:35:14.933268] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T19:35:15.047620] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-07T19:35:15.186976] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T19:35:15.847677] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-07T19:35:16.388721] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T19:35:16.647719] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-07T19:35:16.671912] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T19:35:17.447757] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-07T19:35:17.698639] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T19:35:18.247710] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-07T19:35:18.474224] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T19:35:18.846682] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T19:35:19.047698] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-07T19:35:19.606615] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T19:35:19.847738] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-07T19:35:20.647690] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-07T19:35:21.259202] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T19:35:21.395753] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T19:35:21.447601] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-07T19:35:22.247668] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-07T19:35:22.494231] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T19:35:23.047762] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-07T19:35:23.321405] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T19:35:23.530931] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T19:35:23.532329] [INFO ] [REMOTE ] IIF: Full fetch complete (9225 records). [2025-10-07T19:35:23.532403] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-07T19:35:23.858894] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-07T19:35:23.909684] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-07T19:35:23.909882] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-07T19:35:23.910163] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-07T19:35:23.910208] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-07T19:35:23.910811] [DEBUG] [LOCAL ] IIF: Trimmed 9225 records to 5685 (keeping 200 days of data) [2025-10-07T19:35:23.948278] [DEBUG] [LOCAL ] IIF: Primary data saved (5685 records). [2025-10-07T19:35:23.948439] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-07T19:35:23.948555] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IIF took 36.0s. Estimated remaining: 2h 58m 52s. Rate: 7.1 symbols/min [2025-10-07T19:35:24.118008] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:35:24.158320] [DEBUG] [LOCAL ] IIPR: Loaded 29626 existing records from primary storage. [2025-10-07T19:35:24.158740] [INFO ] [MAIN ] IIPR: Loaded 29626 existing records. [2025-10-07T19:35:24.333689] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:35:24.334051] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-07T19:35:24.334128] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-07T19:35:24.334496] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-07T19:35:24.334553] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-07T19:35:24.652748] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-07T19:35:24.692048] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:35:24.764461] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T19:35:25.447759] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-07T19:35:25.637134] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T19:35:26.241415] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T19:35:26.247589] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-07T19:35:26.960918] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T19:35:26.962669] [INFO ] [REMOTE ] IIIN: Full fetch complete (24767 records). [2025-10-07T19:35:26.962757] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-07T19:35:27.052768] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-07T19:35:27.356888] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-07T19:35:27.357023] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-07T19:35:27.358091] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-07T19:35:27.358171] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-07T19:35:27.359063] [DEBUG] [LOCAL ] IIIN: Trimmed 24767 records to 16171 (keeping 200 days of data) [2025-10-07T19:35:27.469519] [DEBUG] [LOCAL ] IIIN: Primary data saved (16171 records). [2025-10-07T19:35:27.469757] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-07T19:35:27.469877] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIIN took 34.0s. Estimated remaining: 2h 58m 38s. Rate: 7.1 symbols/min [2025-10-07T19:35:27.645097] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:35:27.696984] [DEBUG] [LOCAL ] IMAX: Loaded 42878 existing records from primary storage. [2025-10-07T19:35:27.697514] [INFO ] [MAIN ] IMAX: Loaded 42878 existing records. [2025-10-07T19:35:27.852863] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-07T19:35:27.898191] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:35:27.898710] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-07T19:35:27.898794] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-07T19:35:27.899057] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-07T19:35:27.899119] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-07T19:35:28.287015] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:35:28.565001] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T19:35:28.647607] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-07T19:35:29.161345] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T19:35:29.163774] [INFO ] [REMOTE ] IHS: Full fetch complete (51547 records). [2025-10-07T19:35:29.163868] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-07T19:35:29.453766] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-07T19:35:29.545512] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-07T19:35:29.545606] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-07T19:35:29.546356] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-07T19:35:29.546411] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-07T19:35:29.547570] [DEBUG] [LOCAL ] IHS: Trimmed 51547 records to 38502 (keeping 200 days of data) [2025-10-07T19:35:29.768186] [DEBUG] [LOCAL ] IHS: Primary data saved (38502 records). [2025-10-07T19:35:29.768335] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-07T19:35:29.768420] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 43.2s. Estimated remaining: 2h 58m 22s. Rate: 7.1 symbols/min [2025-10-07T19:35:29.938316] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:35:29.993243] [DEBUG] [LOCAL ] INFA: Loaded 49450 existing records from primary storage. [2025-10-07T19:35:29.993592] [INFO ] [MAIN ] INFA: Loaded 49450 existing records. [2025-10-07T19:35:30.179578] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:35:30.179951] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-07T19:35:30.180053] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-07T19:35:30.187368] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-07T19:35:30.200491] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-07T19:35:30.234191] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T19:35:30.257954] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-07T19:35:30.574725] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:35:30.865538] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T19:35:30.949782] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-07T19:35:31.047692] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-07T19:35:31.847709] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-07T19:35:32.016316] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T19:35:32.018833] [INFO ] [REMOTE ] IIM: Full fetch complete (25440 records). [2025-10-07T19:35:32.018918] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-07T19:35:32.407808] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-07T19:35:32.407898] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-07T19:35:32.408412] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-07T19:35:32.408452] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-07T19:35:32.409123] [DEBUG] [LOCAL ] IIM: Trimmed 25440 records to 15838 (keeping 200 days of data) [2025-10-07T19:35:32.520909] [DEBUG] [LOCAL ] IIM: Primary data saved (15838 records). [2025-10-07T19:35:32.521069] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-07T19:35:32.521155] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIM took 32.8s. Estimated remaining: 2h 58m 7s. Rate: 7.1 symbols/min [2025-10-07T19:35:32.663264] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-07T19:35:32.696478] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:35:32.763162] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-07T19:35:32.763526] [INFO ] [MAIN ] INFY: Loaded 53596 existing records. [2025-10-07T19:35:32.947131] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:35:32.947486] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-07T19:35:32.947544] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-07T19:35:32.947855] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-07T19:35:32.947914] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-07T19:35:33.311113] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:35:33.336900] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T19:35:33.447706] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-07T19:35:34.247629] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-07T19:35:34.447545] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T19:35:35.047738] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-07T19:35:35.204728] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T19:35:35.459155] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T19:35:35.847673] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-07T19:35:36.647686] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-07T19:35:36.737353] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T19:35:37.447704] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-07T19:35:37.657396] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T19:35:38.170563] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T19:35:38.247614] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-07T19:35:39.047626] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-07T19:35:39.108957] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T19:35:39.805786] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T19:35:39.847628] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-07T19:35:40.647669] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-07T19:35:40.678926] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:35:41.447616] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-07T19:35:41.487202] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T19:35:41.936537] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T19:35:42.247678] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-07T19:35:43.047624] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-07T19:35:43.379178] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-07T19:35:43.418478] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T19:35:43.847698] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-07T19:35:44.411051] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T19:35:44.647704] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-07T19:35:45.447747] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-07T19:35:45.739845] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T19:35:46.211366] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T19:35:46.247743] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-07T19:35:46.672004] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T19:35:47.047685] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-07T19:35:47.847692] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-07T19:35:47.920405] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T19:35:48.066303] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-07T19:35:48.647694] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-07T19:35:49.299762] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T19:35:49.447681] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-07T19:35:50.247752] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-07T19:35:50.497422] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T19:35:50.575620] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T19:35:51.047730] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-07T19:35:51.436252] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-07T19:35:51.847675] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-07T19:35:52.652803] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-07T19:35:52.670330] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T19:35:53.447708] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-07T19:35:53.794857] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T19:35:54.100904] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T19:35:54.247601] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-07T19:35:54.912817] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T19:35:55.047716] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-07T19:35:55.604760] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T19:35:55.607369] [INFO ] [REMOTE ] IIPR: Full fetch complete (44845 records). [2025-10-07T19:35:55.607478] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-07T19:35:55.853941] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-07T19:35:55.987218] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-07T19:35:55.987339] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-07T19:35:55.988073] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-07T19:35:55.988138] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-07T19:35:55.989158] [DEBUG] [LOCAL ] IIPR: Trimmed 44845 records to 29578 (keeping 200 days of data) [2025-10-07T19:35:56.178422] [DEBUG] [LOCAL ] IIPR: Primary data saved (29578 records). [2025-10-07T19:35:56.178560] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-07T19:35:56.178684] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIPR took 32.2s. Estimated remaining: 2h 58m 16s. Rate: 7.1 symbols/min [2025-10-07T19:35:56.344295] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:35:56.392605] [DEBUG] [LOCAL ] ING: Loaded 50693 existing records from primary storage. [2025-10-07T19:35:56.393048] [INFO ] [MAIN ] ING: Loaded 50693 existing records. [2025-10-07T19:35:56.576386] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:35:56.576901] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-07T19:35:56.577130] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-07T19:35:56.577538] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-07T19:35:56.577601] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-07T19:35:56.651167] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-07T19:35:56.849037] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T19:35:57.009611] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:35:57.433627] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T19:35:57.447587] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-07T19:35:58.247687] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-07T19:35:58.638180] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T19:35:58.977222] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:35:59.047728] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-07T19:35:59.500441] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T19:35:59.847681] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-07T19:36:00.647664] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-07T19:36:01.160721] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-07T19:36:01.447714] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-07T19:36:01.505760] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T19:36:02.244906] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T19:36:02.254110] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-07T19:36:03.047757] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-07T19:36:03.157619] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-07T19:36:03.161270] [INFO ] [REMOTE ] INFY: Full fetch complete (77546 records). [2025-10-07T19:36:03.161413] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-07T19:36:03.559249] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-07T19:36:03.559348] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-07T19:36:03.560300] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-07T19:36:03.560371] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-07T19:36:03.561917] [DEBUG] [LOCAL ] INFY: Trimmed 77546 records to 53595 (keeping 200 days of data) [2025-10-07T19:36:03.813184] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T19:36:03.851133] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-07T19:36:03.946439] [DEBUG] [LOCAL ] INFY: Primary data saved (53595 records). [2025-10-07T19:36:03.946582] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-07T19:36:03.946724] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. INFY took 31.4s. Estimated remaining: 2h 58m 7s. Rate: 7.1 symbols/min [2025-10-07T19:36:04.169016] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:36:04.199093] [DEBUG] [LOCAL ] INGM: Loaded 28691 existing records from primary storage. [2025-10-07T19:36:04.199465] [INFO ] [MAIN ] INGM: Loaded 28691 existing records. [2025-10-07T19:36:04.400976] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:36:04.401222] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-07T19:36:04.401273] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-07T19:36:04.402358] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-07T19:36:04.402422] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-07T19:36:04.515966] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T19:36:04.559048] [INFO ] [REMOTE ] INFA: Full fetch complete (71168 records). [2025-10-07T19:36:04.564586] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-07T19:36:04.655396] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-07T19:36:05.055822] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:36:05.212628] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-07T19:36:05.212763] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-07T19:36:05.213615] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-07T19:36:05.213693] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-07T19:36:05.215582] [DEBUG] [LOCAL ] INFA: Trimmed 71168 records to 49429 (keeping 200 days of data) [2025-10-07T19:36:05.449207] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-07T19:36:05.530623] [DEBUG] [LOCAL ] INFA: Primary data saved (49429 records). [2025-10-07T19:36:05.530804] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-07T19:36:05.530940] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. INFA took 35.8s. Estimated remaining: 2h 57m 51s. Rate: 7.1 symbols/min [2025-10-07T19:36:05.699184] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:36:05.727802] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T19:36:05.769092] [DEBUG] [LOCAL ] INGR: Loaded 33586 existing records from primary storage. [2025-10-07T19:36:05.769436] [INFO ] [MAIN ] INGR: Loaded 33586 existing records. [2025-10-07T19:36:05.945107] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:36:05.945419] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-07T19:36:05.945476] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-07T19:36:05.946807] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-07T19:36:05.946869] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-07T19:36:06.248893] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-07T19:36:06.348953] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:36:06.389875] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T19:36:06.898087] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T19:36:07.047783] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-07T19:36:07.627258] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T19:36:07.847682] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-07T19:36:08.198637] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T19:36:08.647740] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-07T19:36:09.447639] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-07T19:36:09.709024] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T19:36:09.979464] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T19:36:09.982474] [INFO ] [REMOTE ] IMAX: Full fetch complete (59991 records). [2025-10-07T19:36:09.982580] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-07T19:36:10.253344] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-07T19:36:10.373445] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-07T19:36:10.373540] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-07T19:36:10.374391] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-07T19:36:10.374464] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-07T19:36:10.375882] [DEBUG] [LOCAL ] IMAX: Trimmed 59991 records to 42871 (keeping 200 days of data) [2025-10-07T19:36:10.638880] [DEBUG] [LOCAL ] IMAX: Primary data saved (42871 records). [2025-10-07T19:36:10.639008] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-07T19:36:10.639089] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. IMAX took 43.2s. Estimated remaining: 2h 57m 39s. Rate: 7.1 symbols/min [2025-10-07T19:36:10.809606] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:36:10.846261] [DEBUG] [LOCAL ] INN: Loaded 41760 existing records from primary storage. [2025-10-07T19:36:10.846608] [INFO ] [MAIN ] INN: Loaded 41760 existing records. [2025-10-07T19:36:11.048354] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-07T19:36:11.050837] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T19:36:11.031034] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:36:11.057781] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-07T19:36:11.058365] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-07T19:36:11.059886] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-07T19:36:11.059947] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-07T19:36:11.409976] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:36:11.847627] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-07T19:36:12.137402] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T19:36:12.210844] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T19:36:12.647694] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-07T19:36:13.267864] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T19:36:13.447699] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-07T19:36:13.708006] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T19:36:14.247740] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-07T19:36:14.566225] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T19:36:15.047613] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-07T19:36:15.508311] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T19:36:15.847728] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-07T19:36:16.070149] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T19:36:16.647704] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-07T19:36:17.356472] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:36:17.447606] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-07T19:36:17.590978] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-07T19:36:18.247678] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-07T19:36:18.762576] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T19:36:19.047614] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-07T19:36:19.482153] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T19:36:19.847711] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-07T19:36:20.647624] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-07T19:36:20.771390] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T19:36:20.827497] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T19:36:21.447691] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-07T19:36:21.719868] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T19:36:22.247757] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-07T19:36:22.878195] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T19:36:23.047733] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-07T19:36:23.847690] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-07T19:36:23.902333] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T19:36:24.254961] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T19:36:24.647750] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-07T19:36:25.210906] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T19:36:25.447705] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-07T19:36:26.247745] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-07T19:36:26.448060] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T19:36:26.620915] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T19:36:27.047691] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-07T19:36:27.533097] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T19:36:27.847673] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-07T19:36:28.238419] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T19:36:28.647753] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-07T19:36:29.134498] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T19:36:29.447697] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-07T19:36:30.231600] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T19:36:30.247593] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-07T19:36:30.603918] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T19:36:31.047695] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-07T19:36:31.806262] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T19:36:31.847683] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-07T19:36:32.647624] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-07T19:36:32.921454] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T19:36:33.201549] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T19:36:33.447746] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-07T19:36:34.163609] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T19:36:34.247734] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-07T19:36:34.904424] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T19:36:35.047679] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-07T19:36:35.579905] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T19:36:35.582597] [INFO ] [REMOTE ] INN: Full fetch complete (57872 records). [2025-10-07T19:36:35.582715] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-07T19:36:35.852921] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-07T19:36:36.024895] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-07T19:36:36.025025] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-07T19:36:36.026091] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-07T19:36:36.026737] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-07T19:36:36.028968] [DEBUG] [LOCAL ] INN: Trimmed 57872 records to 41813 (keeping 200 days of data) [2025-10-07T19:36:36.309665] [DEBUG] [LOCAL ] INN: Primary data saved (41813 records). [2025-10-07T19:36:36.309863] [INFO ] [MAIN ] INN: Full history saved. [2025-10-07T19:36:36.309978] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INN took 25.7s. Estimated remaining: 2h 57m 50s. Rate: 7.1 symbols/min [2025-10-07T19:36:36.499839] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:36:36.500363] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-07T19:36:36.500503] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-07T19:36:36.500712] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-07T19:36:36.500908] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-07T19:36:36.501067] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-07T19:36:36.501213] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-07T19:36:36.628337] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T19:36:36.651098] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-07T19:36:36.900733] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:36:37.447705] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-07T19:36:37.552422] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T19:36:37.648293] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:36:37.648550] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-07T19:36:37.648664] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:36:37.648741] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-07T19:36:37.648782] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:36:37.648823] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-07T19:36:37.648882] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-07T19:36:37.648919] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-07T19:36:37.648958] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-07T19:36:37.649005] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INR took 1.3s. Estimated remaining: 2h 57m 33s. Rate: 7.1 symbols/min [2025-10-07T19:36:37.872610] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:36:37.888757] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T19:36:37.936230] [DEBUG] [LOCAL ] INSP: Loaded 37461 existing records from primary storage. [2025-10-07T19:36:37.936568] [INFO ] [MAIN ] INSP: Loaded 37461 existing records. [2025-10-07T19:36:38.162568] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:36:38.162809] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-07T19:36:38.162869] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-07T19:36:38.163918] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-07T19:36:38.163979] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-07T19:36:38.253394] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-07T19:36:38.642392] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:36:39.047681] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-07T19:36:39.456912] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T19:36:39.459371] [INFO ] [REMOTE ] INGM: Full fetch complete (42321 records). [2025-10-07T19:36:39.459463] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-07T19:36:39.826343] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-07T19:36:39.826442] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-07T19:36:39.827130] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-07T19:36:39.827197] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-07T19:36:39.828174] [DEBUG] [LOCAL ] INGM: Trimmed 42321 records to 28689 (keeping 200 days of data) [2025-10-07T19:36:39.881564] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-07T19:36:40.008664] [DEBUG] [LOCAL ] INGM: Primary data saved (28689 records). [2025-10-07T19:36:40.008814] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-07T19:36:40.008898] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGM took 36.1s. Estimated remaining: 2h 57m 18s. Rate: 7.1 symbols/min [2025-10-07T19:36:40.176552] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:36:40.212396] [DEBUG] [LOCAL ] INSW: Loaded 39789 existing records from primary storage. [2025-10-07T19:36:40.212722] [INFO ] [MAIN ] INSW: Loaded 39789 existing records. [2025-10-07T19:36:40.394316] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:36:40.394825] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-07T19:36:40.394991] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-07T19:36:40.396825] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-07T19:36:40.396891] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-07T19:36:40.558216] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T19:36:40.653113] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-07T19:36:40.786090] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:36:41.362045] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T19:36:41.366023] [INFO ] [REMOTE ] ING: Full fetch complete (73610 records). [2025-10-07T19:36:41.366147] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-07T19:36:41.452890] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-07T19:36:41.766242] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-07T19:36:41.766326] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-07T19:36:41.767214] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-07T19:36:41.767298] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-07T19:36:41.768818] [DEBUG] [LOCAL ] ING: Trimmed 73610 records to 50705 (keeping 200 days of data) [2025-10-07T19:36:42.090579] [DEBUG] [LOCAL ] ING: Primary data saved (50705 records). [2025-10-07T19:36:42.090779] [INFO ] [MAIN ] ING: Full history saved. [2025-10-07T19:36:42.090894] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. ING took 45.9s. Estimated remaining: 2h 57m 2s. Rate: 7.1 symbols/min [2025-10-07T19:36:42.208120] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T19:36:42.253976] [INFO ] [REMOTE ] INGR: Full fetch complete (50494 records). [2025-10-07T19:36:42.253710] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-07T19:36:42.262411] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-07T19:36:42.289570] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:36:42.679895] [DEBUG] [LOCAL ] INVH: Loaded 53152 existing records from primary storage. [2025-10-07T19:36:42.694249] [INFO ] [MAIN ] INVH: Loaded 53152 existing records. [2025-10-07T19:36:42.827806] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-07T19:36:42.837924] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-07T19:36:42.839189] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-07T19:36:42.839321] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-07T19:36:42.899899] [DEBUG] [LOCAL ] INGR: Trimmed 50494 records to 33657 (keeping 200 days of data) [2025-10-07T19:36:42.927236] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:36:42.927582] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-07T19:36:42.927635] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-07T19:36:42.983393] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-07T19:36:42.993323] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-07T19:36:43.427833] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T19:36:43.482929] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:36:43.485410] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-07T19:36:43.609909] [DEBUG] [LOCAL ] INGR: Primary data saved (33657 records). [2025-10-07T19:36:43.610065] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-07T19:36:43.610156] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INGR took 38.1s. Estimated remaining: 2h 56m 46s. Rate: 7.1 symbols/min [2025-10-07T19:36:43.780806] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:36:43.801276] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T19:36:43.835242] [DEBUG] [LOCAL ] INVX: Loaded 29134 existing records from primary storage. [2025-10-07T19:36:43.835574] [INFO ] [MAIN ] INVX: Loaded 29134 existing records. [2025-10-07T19:36:43.856151] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-07T19:36:44.043672] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:36:44.044055] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-07T19:36:44.044121] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-07T19:36:44.045275] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-07T19:36:44.045344] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-07T19:36:44.437820] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:36:44.647720] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-07T19:36:45.033322] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T19:36:45.447757] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-07T19:36:45.668326] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T19:36:45.992874] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T19:36:46.247715] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-07T19:36:47.057106] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-07T19:36:47.063577] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:36:47.598050] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T19:36:47.847728] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-07T19:36:48.478970] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T19:36:48.647737] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-07T19:36:49.176959] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T19:36:49.447718] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-07T19:36:49.626857] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T19:36:50.247750] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-07T19:36:50.889864] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T19:36:51.047685] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-07T19:36:51.577448] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-07T19:36:51.847680] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-07T19:36:52.647760] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-07T19:36:52.848976] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T19:36:52.901004] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T19:36:53.447732] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-07T19:36:54.205146] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T19:36:54.247618] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-07T19:36:54.825283] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T19:36:55.047671] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-07T19:36:55.847675] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-07T19:36:55.877242] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T19:36:56.348982] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T19:36:56.647688] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-07T19:36:57.287716] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T19:36:57.447692] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-07T19:36:58.247712] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-07T19:36:58.484168] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T19:36:59.047697] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-07T19:36:59.242922] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T19:36:59.454387] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T19:36:59.847669] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-07T19:37:00.628857] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T19:37:00.647598] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-07T19:37:01.447730] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-07T19:37:01.478940] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T19:37:02.227299] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T19:37:02.247614] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-07T19:37:02.909256] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T19:37:03.047690] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-07T19:37:03.807414] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T19:37:03.847607] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-07T19:37:04.647722] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-07T19:37:04.940335] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T19:37:05.326088] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T19:37:05.447603] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-07T19:37:05.860239] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T19:37:05.863297] [INFO ] [REMOTE ] INSP: Full fetch complete (53216 records). [2025-10-07T19:37:05.863385] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-07T19:37:06.235951] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-07T19:37:06.236030] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-07T19:37:06.236758] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-07T19:37:06.236822] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-07T19:37:06.237894] [DEBUG] [LOCAL ] INSP: Trimmed 53216 records to 37565 (keeping 200 days of data) [2025-10-07T19:37:06.289470] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-07T19:37:06.473187] [DEBUG] [LOCAL ] INSP: Primary data saved (37565 records). [2025-10-07T19:37:06.473602] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-07T19:37:06.473745] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 28.8s. Estimated remaining: 2h 56m 54s. Rate: 7.1 symbols/min [2025-10-07T19:37:06.643040] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:37:06.693597] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-07T19:37:06.693942] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-07T19:37:06.880104] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:37:06.880905] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-07T19:37:06.881048] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-07T19:37:06.889827] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-07T19:37:06.889934] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-07T19:37:06.976330] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T19:37:07.062487] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-07T19:37:07.332304] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:37:07.637825] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T19:37:07.847638] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-07T19:37:08.162622] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T19:37:08.165381] [INFO ] [REMOTE ] INSW: Full fetch complete (60326 records). [2025-10-07T19:37:08.165515] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-07T19:37:08.579056] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-07T19:37:08.579176] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-07T19:37:08.580701] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-07T19:37:08.580807] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-07T19:37:08.582989] [DEBUG] [LOCAL ] INSW: Trimmed 60326 records to 39831 (keeping 200 days of data) [2025-10-07T19:37:08.649130] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-07T19:37:08.849200] [DEBUG] [LOCAL ] INSW: Primary data saved (39831 records). [2025-10-07T19:37:08.849417] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-07T19:37:08.849550] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSW took 28.8s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-07T19:37:09.030415] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:37:09.092760] [DEBUG] [LOCAL ] IOT: Loaded 53471 existing records from primary storage. [2025-10-07T19:37:09.093253] [INFO ] [MAIN ] IOT: Loaded 53471 existing records. [2025-10-07T19:37:09.282413] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:37:09.283203] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-07T19:37:09.283287] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-07T19:37:09.284376] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-07T19:37:09.284441] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-07T19:37:09.474494] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-07T19:37:09.635636] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T19:37:09.750132] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:37:09.888965] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T19:37:10.247729] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-07T19:37:11.047739] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-07T19:37:11.847734] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-07T19:37:12.150499] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T19:37:12.271279] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-10-07T19:37:12.647702] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-07T19:37:12.907427] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T19:37:13.152214] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T19:37:13.447688] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-07T19:37:14.055170] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T19:37:14.247706] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-07T19:37:15.047700] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-07T19:37:15.214356] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T19:37:15.847629] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-07T19:37:16.017854] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T19:37:16.647692] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-07T19:37:17.447727] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-07T19:37:17.573610] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T19:37:17.616967] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-07T19:37:17.894616] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T19:37:17.898298] [INFO ] [REMOTE ] INVH: Full fetch complete (76744 records). [2025-10-07T19:37:17.898472] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-07T19:37:18.265991] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-07T19:37:18.294812] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-07T19:37:18.296065] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-07T19:37:18.297408] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-07T19:37:18.297622] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-07T19:37:18.299697] [DEBUG] [LOCAL ] INVH: Trimmed 76744 records to 53160 (keeping 200 days of data) [2025-10-07T19:37:18.634386] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-07T19:37:18.664639] [DEBUG] [LOCAL ] INVH: Primary data saved (53160 records). [2025-10-07T19:37:18.664846] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-07T19:37:18.665001] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INVH took 36.6s. Estimated remaining: 2h 56m 32s. Rate: 7.1 symbols/min [2025-10-07T19:37:19.047729] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-07T19:37:19.847681] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-07T19:37:20.177626] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T19:37:20.647706] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-07T19:37:20.895548] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-07T19:37:21.447638] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-07T19:37:21.786690] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T19:37:21.808002] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T19:37:21.810460] [INFO ] [REMOTE ] INVX: Full fetch complete (43834 records). [2025-10-07T19:37:21.810692] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-07T19:37:22.183832] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-07T19:37:22.183939] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-07T19:37:22.184783] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-07T19:37:22.184866] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-07T19:37:22.186088] [DEBUG] [LOCAL ] INVX: Trimmed 43834 records to 29163 (keeping 200 days of data) [2025-10-07T19:37:22.276473] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-07T19:37:22.374895] [DEBUG] [LOCAL ] INVX: Primary data saved (29163 records). [2025-10-07T19:37:22.375066] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-07T19:37:22.375206] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 38.8s. Estimated remaining: 2h 56m 18s. Rate: 7.1 symbols/min [2025-10-07T19:37:23.726687] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T19:37:23.738595] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-07T19:37:24.219752] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-07T19:37:24.232386] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-07T19:37:25.571824] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T19:37:25.583300] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-07T19:37:26.896833] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-07T19:37:26.908955] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-07T19:37:27.512192] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T19:37:27.523226] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-07T19:37:29.489269] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T19:37:29.501341] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-07T19:37:29.662171] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-07T19:37:29.673862] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-07T19:37:31.356150] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T19:37:31.368802] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-07T19:37:31.746245] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-07T19:37:31.757365] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-07T19:37:33.336625] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-07T19:37:33.348366] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-07T19:37:34.597410] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-07T19:37:34.610278] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-07T19:37:35.250847] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-07T19:37:35.255909] [INFO ] [REMOTE ] IOT: Full fetch complete (77385 records). [2025-10-07T19:37:35.256159] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-07T19:37:35.673338] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-07T19:37:35.673504] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-07T19:37:35.674986] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-07T19:37:35.675085] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-07T19:37:35.677266] [DEBUG] [LOCAL ] IOT: Trimmed 77385 records to 53472 (keeping 200 days of data) [2025-10-07T19:37:36.037039] [DEBUG] [LOCAL ] IOT: Primary data saved (53472 records). [2025-10-07T19:37:36.037384] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-07T19:37:36.037533] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. IOT took 27.2s. Estimated remaining: 2h 56m 15s. Rate: 7.1 symbols/min [2025-10-07T19:37:37.389220] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-10-07T19:37:37.402669] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-07T19:37:40.157349] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-07T19:37:40.170383] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-07T19:37:42.721183] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-07T19:37:42.725297] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-07T19:37:42.725458] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-07T19:37:43.163201] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-07T19:37:43.163291] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-07T19:37:43.164275] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-07T19:37:43.164345] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-07T19:37:43.165907] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-07T19:37:43.486941] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-07T19:37:43.487117] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-07T19:37:43.487268] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 37.0s. Estimated remaining: 2h 56m 6s. Rate: 7.1 symbols/min [2025-10-07T19:37:44.106563] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:37:44.202413] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:37:44.222337] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:37:44.287069] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:37:44.299133] [DEBUG] [LOCAL ] IQI: Loaded 18004 existing records from primary storage. [2025-10-07T19:37:44.299523] [INFO ] [MAIN ] IQI: Loaded 18004 existing records. [2025-10-07T19:37:44.425835] [DEBUG] [LOCAL ] IPI: Loaded 21499 existing records from primary storage. [2025-10-07T19:37:44.435801] [INFO ] [MAIN ] IPI: Loaded 21499 existing records. [2025-10-07T19:37:44.696312] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:37:44.709416] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-10-07T19:37:44.740148] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-07T19:37:44.745459] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-07T19:37:44.751010] [INFO ] [MAIN ] IP: Loaded 53313 existing records. [2025-10-07T19:37:44.792049] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-07T19:37:44.780366] [DEBUG] [LOCAL ] IPG: Loaded 53329 existing records from primary storage. [2025-10-07T19:37:44.803151] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-07T19:37:44.835278] [INFO ] [MAIN ] IPG: Loaded 53329 existing records. [2025-10-07T19:37:44.947965] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:37:45.042222] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-07T19:37:45.091418] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-07T19:37:45.202546] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-07T19:37:45.242083] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-07T19:37:45.572710] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:37:45.669782] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-07T19:37:45.684163] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:37:45.724302] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-07T19:37:45.744042] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-07T19:37:45.738635] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-07T19:37:45.801446] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-07T19:37:45.765988] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-07T19:37:45.867889] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-07T19:37:45.868180] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-07T19:37:46.032121] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:37:46.149303] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-07T19:37:46.660075] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:37:46.735032] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-07T19:37:46.953184] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:37:46.975175] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-07T19:37:46.991529] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:37:46.993220] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-07T19:37:47.274708] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T19:37:47.280197] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-07T19:37:47.760793] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T19:37:47.766100] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-07T19:37:48.233250] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T19:37:48.238179] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-07T19:37:48.759854] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T19:37:48.788002] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-07T19:37:48.789623] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T19:37:48.803290] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-07T19:37:48.817145] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T19:37:48.822203] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-07T19:37:49.279890] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T19:37:49.285461] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-07T19:37:49.924232] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T19:37:49.928881] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-07T19:37:50.004103] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-07T19:37:50.013876] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-07T19:37:50.193834] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T19:37:50.205777] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-07T19:37:50.719307] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T19:37:50.732272] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-07T19:37:50.751694] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T19:37:50.774123] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T19:37:50.780602] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-07T19:37:50.781338] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-07T19:37:51.719290] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-07T19:37:51.724076] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-07T19:37:51.811740] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T19:37:51.817695] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-07T19:37:52.036322] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T19:37:52.047877] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-07T19:37:52.567248] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T19:37:52.579376] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-07T19:37:52.726698] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T19:37:52.732813] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-07T19:37:53.023063] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T19:37:53.029781] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-07T19:37:53.402548] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T19:37:53.416693] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-07T19:37:53.725393] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-07T19:37:53.731932] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-07T19:37:53.791140] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T19:37:53.795963] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-07T19:37:54.609600] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T19:37:54.621453] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-07T19:37:54.729687] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T19:37:54.805400] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T19:37:55.047636] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-07T19:37:55.229223] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T19:37:55.847608] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-07T19:37:56.026728] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T19:37:56.359430] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T19:37:56.647765] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-07T19:37:57.447739] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-07T19:37:57.567948] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T19:37:57.608827] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T19:37:58.085868] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-07T19:37:58.247716] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-07T19:37:59.047749] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-07T19:37:59.847702] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-07T19:37:59.956795] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T19:38:00.006749] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T19:38:00.009097] [INFO ] [REMOTE ] IPI: Full fetch complete (29568 records). [2025-10-07T19:38:00.009180] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-07T19:38:00.418836] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-07T19:38:00.418974] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-07T19:38:00.419824] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-07T19:38:00.419892] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-07T19:38:00.421144] [DEBUG] [LOCAL ] IPI: Trimmed 29568 records to 21533 (keeping 200 days of data) [2025-10-07T19:38:00.560368] [DEBUG] [LOCAL ] IPI: Primary data saved (21533 records). [2025-10-07T19:38:00.560560] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-07T19:38:00.560715] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 17.1s. Estimated remaining: 2h 56m 7s. Rate: 7.1 symbols/min [2025-10-07T19:38:00.651807] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-07T19:38:00.652524] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-07T19:38:00.676307] [INFO ] [REMOTE ] IQI: Full fetch complete (26824 records). [2025-10-07T19:38:00.680216] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-07T19:38:00.885354] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:38:00.925408] [DEBUG] [LOCAL ] IQV: No existing data file found in primary storage. [2025-10-07T19:38:00.925670] [WARN ] [MAIN ] IQV: No existing data found, performing full refresh instead. [2025-10-07T19:38:00.926722] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-07T19:38:00.941887] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-07T19:38:00.957781] [DEBUG] [LOCAL ] IQV: No primary data file found to delete. [2025-10-07T19:38:00.983942] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-07T19:38:01.410268] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-07T19:38:01.435878] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-07T19:38:01.463807] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-07T19:38:01.453376] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-07T19:38:01.475213] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-07T19:38:01.558695] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:38:01.559026] [DEBUG] [LOCAL ] IQI: Trimmed 26824 records to 18006 (keeping 200 days of data) [2025-10-07T19:38:01.669574] [DEBUG] [LOCAL ] IQI: Primary data saved (18006 records). [2025-10-07T19:38:01.669762] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-07T19:38:01.669858] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IQI took 18.2s. Estimated remaining: 2h 55m 50s. Rate: 7.1 symbols/min [2025-10-07T19:38:01.839543] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:38:01.889509] [DEBUG] [LOCAL ] IR: Loaded 52726 existing records from primary storage. [2025-10-07T19:38:01.889887] [INFO ] [MAIN ] IR: Loaded 52726 existing records. [2025-10-07T19:38:02.075285] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:38:02.075567] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-07T19:38:02.075618] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-07T19:38:02.076076] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-07T19:38:02.076165] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-07T19:38:02.248715] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-07T19:38:02.436042] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:38:02.560163] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T19:38:03.047695] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-07T19:38:03.272714] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T19:38:03.847708] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-07T19:38:04.059916] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T19:38:04.621316] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T19:38:04.647612] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-07T19:38:05.447698] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-07T19:38:05.798295] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-07T19:38:06.247709] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-07T19:38:06.393468] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T19:38:07.047697] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-07T19:38:07.160702] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T19:38:07.685473] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T19:38:07.847741] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-07T19:38:08.647705] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-07T19:38:08.712626] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T19:38:09.447747] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-07T19:38:09.720856] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T19:38:10.250270] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-07T19:38:10.253509] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T19:38:11.047754] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-07T19:38:11.067621] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T19:38:11.071346] [INFO ] [REMOTE ] IPG: Full fetch complete (77253 records). [2025-10-07T19:38:11.071493] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-07T19:38:11.464099] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-07T19:38:11.464231] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-07T19:38:11.465198] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-07T19:38:11.465264] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-07T19:38:11.466901] [DEBUG] [LOCAL ] IPG: Trimmed 77253 records to 53330 (keeping 200 days of data) [2025-10-07T19:38:11.798214] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-10-07T19:38:11.798341] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-07T19:38:11.798435] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IPG took 28.3s. Estimated remaining: 2h 55m 44s. Rate: 7.1 symbols/min [2025-10-07T19:38:11.861165] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-07T19:38:11.970611] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:38:12.004020] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T19:38:12.058293] [DEBUG] [LOCAL ] IRM: Loaded 49285 existing records from primary storage. [2025-10-07T19:38:12.058615] [INFO ] [MAIN ] IRM: Loaded 49285 existing records. [2025-10-07T19:38:12.231857] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:38:12.232076] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-07T19:38:12.232124] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-07T19:38:12.232369] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-07T19:38:12.232437] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-07T19:38:12.583580] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:38:12.647596] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-07T19:38:12.744915] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T19:38:13.447593] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-07T19:38:13.556047] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T19:38:14.247726] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-07T19:38:14.468814] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T19:38:15.047615] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-07T19:38:15.136433] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-07T19:38:15.140357] [INFO ] [REMOTE ] IP: Full fetch complete (77137 records). [2025-10-07T19:38:15.140522] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-07T19:38:15.534893] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-07T19:38:15.535075] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-07T19:38:15.536088] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-07T19:38:15.536175] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-07T19:38:15.537747] [DEBUG] [LOCAL ] IP: Trimmed 77137 records to 53319 (keeping 200 days of data) [2025-10-07T19:38:15.664077] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T19:38:15.860056] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-07T19:38:15.907384] [DEBUG] [LOCAL ] IP: Primary data saved (53319 records). [2025-10-07T19:38:15.907522] [INFO ] [MAIN ] IP: Full history saved. [2025-10-07T19:38:15.907609] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 32.4s. Estimated remaining: 2h 55m 30s. Rate: 7.1 symbols/min [2025-10-07T19:38:16.077433] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:38:16.100874] [DEBUG] [LOCAL ] IRS: Loaded 22173 existing records from primary storage. [2025-10-07T19:38:16.101108] [INFO ] [MAIN ] IRS: Loaded 22173 existing records. [2025-10-07T19:38:16.274911] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:38:16.275128] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-07T19:38:16.275186] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-07T19:38:16.275370] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-07T19:38:16.275427] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-07T19:38:16.624582] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:38:16.647590] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-07T19:38:16.807913] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-07T19:38:17.455466] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-07T19:38:17.460261] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T19:38:17.785821] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T19:38:18.247731] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-07T19:38:19.047711] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-07T19:38:19.164179] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T19:38:19.847699] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-07T19:38:19.940479] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T19:38:20.308873] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T19:38:20.647623] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-07T19:38:21.447737] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-07T19:38:21.664079] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T19:38:21.680319] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T19:38:22.247743] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-07T19:38:23.047728] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-07T19:38:23.218592] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T19:38:23.847687] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-07T19:38:24.044086] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T19:38:24.181110] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-07T19:38:24.647736] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-07T19:38:25.339808] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T19:38:25.447607] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-07T19:38:25.691131] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T19:38:26.247686] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-07T19:38:26.959547] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T19:38:27.047669] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-07T19:38:27.847746] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-07T19:38:28.017787] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T19:38:28.647762] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-07T19:38:28.787078] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T19:38:28.834051] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-07T19:38:29.447701] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-07T19:38:30.247671] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-07T19:38:30.391565] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T19:38:31.047733] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-07T19:38:31.313968] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T19:38:31.430606] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T19:38:31.847734] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-07T19:38:32.647757] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-07T19:38:32.791508] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T19:38:32.943859] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T19:38:33.447739] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-07T19:38:33.936839] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T19:38:33.940542] [INFO ] [REMOTE ] IR: Full fetch complete (76226 records). [2025-10-07T19:38:33.940677] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-07T19:38:34.252793] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-07T19:38:34.340545] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-07T19:38:34.340627] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-07T19:38:34.341576] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-07T19:38:34.341629] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-07T19:38:34.343158] [DEBUG] [LOCAL ] IR: Trimmed 76226 records to 52740 (keeping 200 days of data) [2025-10-07T19:38:34.671749] [DEBUG] [LOCAL ] IR: Primary data saved (52740 records). [2025-10-07T19:38:34.671980] [INFO ] [MAIN ] IR: Full history saved. [2025-10-07T19:38:34.672084] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IR took 33.0s. Estimated remaining: 2h 55m 33s. Rate: 7.1 symbols/min [2025-10-07T19:38:34.845846] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:38:34.893108] [DEBUG] [LOCAL ] IRT: Loaded 50382 existing records from primary storage. [2025-10-07T19:38:34.893461] [INFO ] [MAIN ] IRT: Loaded 50382 existing records. [2025-10-07T19:38:35.051910] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-07T19:38:35.074460] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:38:35.076103] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-07T19:38:35.076196] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-07T19:38:35.076558] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-07T19:38:35.076699] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-07T19:38:35.429818] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T19:38:35.509158] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:38:35.847612] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-07T19:38:35.978019] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T19:38:36.196172] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T19:38:36.647743] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-07T19:38:37.447853] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-07T19:38:37.450888] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T19:38:38.136868] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T19:38:38.247763] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-07T19:38:39.047681] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-07T19:38:39.194567] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T19:38:39.536703] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T19:38:39.847694] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-07T19:38:40.647724] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-07T19:38:40.772695] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T19:38:41.119731] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T19:38:41.121998] [INFO ] [REMOTE ] IRS: Full fetch complete (32332 records). [2025-10-07T19:38:41.122256] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-07T19:38:41.454995] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-07T19:38:41.495170] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-07T19:38:41.495268] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-07T19:38:41.495930] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-07T19:38:41.496000] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-07T19:38:41.497106] [DEBUG] [LOCAL ] IRS: Trimmed 32332 records to 22364 (keeping 200 days of data) [2025-10-07T19:38:41.636550] [DEBUG] [LOCAL ] IRS: Primary data saved (22364 records). [2025-10-07T19:38:41.636734] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-07T19:38:41.636840] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IRS took 25.7s. Estimated remaining: 2h 55m 23s. Rate: 7.1 symbols/min [2025-10-07T19:38:41.810168] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:38:41.828520] [DEBUG] [LOCAL ] ISD: Loaded 15726 existing records from primary storage. [2025-10-07T19:38:41.828843] [INFO ] [MAIN ] ISD: Loaded 15726 existing records. [2025-10-07T19:38:42.033395] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:38:42.033860] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-07T19:38:42.033962] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-07T19:38:42.034376] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-07T19:38:42.034438] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-07T19:38:42.256224] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-07T19:38:42.427309] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T19:38:42.454766] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:38:43.047624] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-07T19:38:43.210497] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T19:38:43.856612] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-07T19:38:43.862264] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T19:38:44.647691] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-07T19:38:44.739889] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T19:38:44.845835] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T19:38:45.447730] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-07T19:38:46.238984] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T19:38:46.244828] [INFO ] [REMOTE ] IRM: Full fetch complete (72333 records). [2025-10-07T19:38:46.245051] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-07T19:38:46.252921] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-07T19:38:46.783195] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-07T19:38:46.783371] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-07T19:38:46.784489] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-07T19:38:46.784695] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-07T19:38:46.786535] [DEBUG] [LOCAL ] IRM: Trimmed 72333 records to 49283 (keeping 200 days of data) [2025-10-07T19:38:46.940986] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T19:38:47.051857] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-07T19:38:47.150095] [DEBUG] [LOCAL ] IRM: Primary data saved (49283 records). [2025-10-07T19:38:47.150258] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-07T19:38:47.150349] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRM took 35.4s. Estimated remaining: 2h 55m 11s. Rate: 7.1 symbols/min [2025-10-07T19:38:47.326813] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:38:47.368046] [DEBUG] [LOCAL ] IT: Loaded 42187 existing records from primary storage. [2025-10-07T19:38:47.368424] [INFO ] [MAIN ] IT: Loaded 42187 existing records. [2025-10-07T19:38:47.570233] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T19:38:47.576089] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:38:47.581081] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-07T19:38:47.581437] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-07T19:38:47.581799] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-07T19:38:47.581859] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-07T19:38:47.852770] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-07T19:38:47.963734] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:38:48.647712] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-07T19:38:48.712039] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T19:38:49.128969] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T19:38:49.132489] [INFO ] [REMOTE ] IQV: Full fetch complete (72187 records). [2025-10-07T19:38:49.132630] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-07T19:38:49.452842] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-07T19:38:49.544101] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-07T19:38:49.544184] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-07T19:38:49.545216] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-07T19:38:49.545305] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-07T19:38:49.546820] [DEBUG] [LOCAL ] IQV: Trimmed 72187 records to 50087 (keeping 200 days of data) [2025-10-07T19:38:49.846542] [DEBUG] [LOCAL ] IQV: Primary data saved (50087 records). [2025-10-07T19:38:49.846697] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-07T19:38:49.846789] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IQV took 49.3s. Estimated remaining: 2h 54m 57s. Rate: 7.1 symbols/min [2025-10-07T19:38:50.014934] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:38:50.052992] [DEBUG] [LOCAL ] ITGR: Loaded 31364 existing records from primary storage. [2025-10-07T19:38:50.053284] [INFO ] [MAIN ] ITGR: Loaded 31364 existing records. [2025-10-07T19:38:50.168458] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T19:38:50.275489] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-07T19:38:50.281043] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:38:50.281311] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-07T19:38:50.282250] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-07T19:38:50.282563] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-07T19:38:50.282625] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-07T19:38:50.651606] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:38:51.047709] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-07T19:38:51.137485] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T19:38:51.339375] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T19:38:51.847714] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-07T19:38:52.117720] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T19:38:52.647763] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-07T19:38:52.905751] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T19:38:53.447690] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-07T19:38:53.625429] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T19:38:54.247712] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-07T19:38:54.797344] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T19:38:55.047765] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-07T19:38:55.326874] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T19:38:55.847731] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-07T19:38:56.194590] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T19:38:56.647724] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-07T19:38:57.076788] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T19:38:57.447635] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-07T19:38:57.768681] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T19:38:58.247747] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-07T19:38:58.634570] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T19:38:59.047734] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-07T19:38:59.810421] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T19:38:59.847637] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-07T19:39:00.013867] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T19:39:00.647745] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-07T19:39:01.377552] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:39:01.447621] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-07T19:39:01.630541] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T19:39:02.247668] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-07T19:39:03.026010] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T19:39:03.047710] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-07T19:39:03.139489] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T19:39:03.847698] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-07T19:39:04.647656] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-07T19:39:04.752435] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T19:39:04.752897] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T19:39:05.447753] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-07T19:39:06.245306] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T19:39:06.254722] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-07T19:39:07.047718] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-07T19:39:07.216374] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T19:39:07.684339] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T19:39:07.718932] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T19:39:07.721011] [INFO ] [REMOTE ] ISD: Full fetch complete (24112 records). [2025-10-07T19:39:07.721277] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-07T19:39:07.859199] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-07T19:39:08.089013] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-07T19:39:08.089103] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-07T19:39:08.089847] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-07T19:39:08.089915] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-07T19:39:08.090675] [DEBUG] [LOCAL ] ISD: Trimmed 24112 records to 15796 (keeping 200 days of data) [2025-10-07T19:39:08.186018] [DEBUG] [LOCAL ] ISD: Primary data saved (15796 records). [2025-10-07T19:39:08.186169] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-07T19:39:08.186271] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. ISD took 26.5s. Estimated remaining: 2h 54m 59s. Rate: 7.1 symbols/min [2025-10-07T19:39:08.361098] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:39:08.397155] [DEBUG] [LOCAL ] ITT: Loaded 32662 existing records from primary storage. [2025-10-07T19:39:08.397534] [INFO ] [MAIN ] ITT: Loaded 32662 existing records. [2025-10-07T19:39:08.592990] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:39:08.593236] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-07T19:39:08.593284] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-07T19:39:08.593576] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-07T19:39:08.593634] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-07T19:39:08.656952] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-07T19:39:08.957009] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:39:09.447761] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-07T19:39:09.631243] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T19:39:09.952564] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T19:39:10.247727] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-07T19:39:10.987475] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T19:39:11.047672] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-07T19:39:11.401360] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T19:39:11.847748] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-07T19:39:12.396872] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T19:39:12.647752] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-07T19:39:13.447674] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-07T19:39:13.681331] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T19:39:14.046344] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T19:39:14.247707] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-07T19:39:14.747365] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T19:39:15.024552] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-07T19:39:15.047611] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-07T19:39:15.847690] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-07T19:39:16.359097] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T19:39:16.647739] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-07T19:39:17.334763] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T19:39:17.338215] [INFO ] [REMOTE ] IRT: Full fetch complete (72724 records). [2025-10-07T19:39:17.338461] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-07T19:39:17.452765] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-07T19:39:17.735561] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-07T19:39:17.735686] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-07T19:39:17.736613] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-07T19:39:17.736702] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-07T19:39:17.738348] [DEBUG] [LOCAL ] IRT: Trimmed 72724 records to 50400 (keeping 200 days of data) [2025-10-07T19:39:17.838825] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T19:39:17.848824] [INFO ] [REMOTE ] ITGR: Full fetch complete (42165 records). [2025-10-07T19:39:17.850107] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-07T19:39:18.257195] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-07T19:39:18.483454] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-07T19:39:18.487986] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-07T19:39:18.490907] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-07T19:39:18.494512] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-07T19:39:18.494603] [DEBUG] [LOCAL ] IRT: Primary data saved (50400 records). [2025-10-07T19:39:18.494882] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-07T19:39:18.494980] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IRT took 43.8s. Estimated remaining: 2h 54m 53s. Rate: 7.1 symbols/min [2025-10-07T19:39:18.584880] [DEBUG] [LOCAL ] ITGR: Trimmed 42165 records to 31277 (keeping 200 days of data) [2025-10-07T19:39:18.755790] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:39:18.883150] [DEBUG] [LOCAL ] ITUB: Loaded 53317 existing records from primary storage. [2025-10-07T19:39:18.890940] [INFO ] [MAIN ] ITUB: Loaded 53317 existing records. [2025-10-07T19:39:18.966113] [DEBUG] [LOCAL ] ITGR: Primary data saved (31277 records). [2025-10-07T19:39:18.978318] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-07T19:39:18.978485] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ITGR took 29.1s. Estimated remaining: 2h 54m 36s. Rate: 7.1 symbols/min [2025-10-07T19:39:19.194623] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:39:19.205428] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-07T19:39:19.215870] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-07T19:39:19.234160] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-07T19:39:19.246552] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-07T19:39:19.265734] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:39:19.561366] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-07T19:39:19.605632] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-07T19:39:19.699893] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:39:19.704476] [DEBUG] [LOCAL ] ITW: Loaded 45700 existing records from primary storage. [2025-10-07T19:39:19.705181] [INFO ] [MAIN ] ITW: Loaded 45700 existing records. [2025-10-07T19:39:19.863897] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-07T19:39:19.911816] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:39:19.913860] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T19:39:19.920790] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-07T19:39:19.921855] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-07T19:39:19.922456] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-07T19:39:19.922519] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-07T19:39:20.265596] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:39:20.647741] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-07T19:39:21.439504] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T19:39:21.450063] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-07T19:39:21.511925] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T19:39:22.080574] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T19:39:22.247743] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-07T19:39:23.047714] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-07T19:39:23.305158] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T19:39:23.847704] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-07T19:39:23.970112] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T19:39:24.647706] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-07T19:39:24.723136] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T19:39:25.447681] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-07T19:39:25.485105] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T19:39:26.222451] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T19:39:26.247604] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-07T19:39:27.047694] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-07T19:39:27.223435] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-07T19:39:27.226577] [INFO ] [REMOTE ] IT: Full fetch complete (56588 records). [2025-10-07T19:39:27.226718] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-07T19:39:27.605838] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-07T19:39:27.605920] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-07T19:39:27.606686] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-07T19:39:27.606751] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-07T19:39:27.608896] [DEBUG] [LOCAL ] IT: Trimmed 56588 records to 42202 (keeping 200 days of data) [2025-10-07T19:39:27.849506] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-07T19:39:27.896998] [DEBUG] [LOCAL ] IT: Primary data saved (42202 records). [2025-10-07T19:39:27.913305] [INFO ] [MAIN ] IT: Full history saved. [2025-10-07T19:39:27.915229] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T19:39:27.915570] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. IT took 40.8s. Estimated remaining: 2h 54m 28s. Rate: 7.1 symbols/min [2025-10-07T19:39:28.116299] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:39:28.143193] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T19:39:28.198969] [DEBUG] [LOCAL ] IVR: Loaded 47998 existing records from primary storage. [2025-10-07T19:39:28.199401] [INFO ] [MAIN ] IVR: Loaded 47998 existing records. [2025-10-07T19:39:28.394145] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:39:28.394767] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-07T19:39:28.394846] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-07T19:39:28.395179] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-07T19:39:28.395240] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-07T19:39:28.652987] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-07T19:39:28.783248] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:39:29.055023] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T19:39:29.447727] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-07T19:39:30.140590] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T19:39:30.247697] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-07T19:39:31.047682] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-07T19:39:31.188037] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T19:39:31.847617] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-07T19:39:32.115004] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T19:39:32.180479] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T19:39:32.647698] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-07T19:39:33.447765] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-07T19:39:33.493290] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T19:39:34.247670] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-07T19:39:34.299085] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T19:39:35.047693] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-07T19:39:35.178494] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:39:35.529163] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T19:39:35.847728] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-07T19:39:36.653448] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-07T19:39:36.666584] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T19:39:37.144854] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T19:39:37.447733] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-07T19:39:37.977598] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T19:39:38.247742] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-07T19:39:38.949407] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T19:39:39.047757] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-07T19:39:39.847698] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-07T19:39:39.943036] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T19:39:40.310068] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T19:39:40.647741] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-07T19:39:41.447639] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-07T19:39:41.482770] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T19:39:42.247612] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-07T19:39:42.389836] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T19:39:42.402253] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T19:39:42.405037] [INFO ] [REMOTE ] ITT: Full fetch complete (47015 records). [2025-10-07T19:39:42.405169] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-07T19:39:42.770425] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-07T19:39:42.770517] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-07T19:39:42.771230] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-07T19:39:42.771295] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-07T19:39:42.772319] [DEBUG] [LOCAL ] ITT: Trimmed 47015 records to 32663 (keeping 200 days of data) [2025-10-07T19:39:42.982036] [DEBUG] [LOCAL ] ITT: Primary data saved (32663 records). [2025-10-07T19:39:42.982188] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-07T19:39:42.982275] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITT took 34.8s. Estimated remaining: 2h 54m 26s. Rate: 7.1 symbols/min [2025-10-07T19:39:43.052764] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-07T19:39:43.157198] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:39:43.187094] [DEBUG] [LOCAL ] IVT: Loaded 30780 existing records from primary storage. [2025-10-07T19:39:43.187412] [INFO ] [MAIN ] IVT: Loaded 30780 existing records. [2025-10-07T19:39:43.361240] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:39:43.361490] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-07T19:39:43.361549] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-07T19:39:43.361810] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-07T19:39:43.361885] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-07T19:39:43.716624] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:39:43.759985] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T19:39:43.847597] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-07T19:39:44.647681] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-07T19:39:44.674136] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T19:39:45.156528] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T19:39:45.447680] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-07T19:39:46.247708] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-07T19:39:46.416283] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T19:39:46.480963] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T19:39:47.047701] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-07T19:39:47.650211] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T19:39:47.847675] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-07T19:39:48.578151] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T19:39:48.582027] [INFO ] [REMOTE ] ITUB: Full fetch complete (77161 records). [2025-10-07T19:39:48.582195] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-07T19:39:48.652796] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-07T19:39:48.981040] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-07T19:39:48.981200] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-07T19:39:48.982163] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-07T19:39:48.982227] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-07T19:39:48.983825] [DEBUG] [LOCAL ] ITUB: Trimmed 77161 records to 53315 (keeping 200 days of data) [2025-10-07T19:39:49.090502] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T19:39:49.324571] [DEBUG] [LOCAL ] ITUB: Primary data saved (53315 records). [2025-10-07T19:39:49.324740] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-07T19:39:49.324850] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITUB took 30.8s. Estimated remaining: 2h 54m 16s. Rate: 7.1 symbols/min [2025-10-07T19:39:49.461724] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-07T19:39:49.493022] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:39:49.542555] [DEBUG] [LOCAL ] IVZ: Loaded 53132 existing records from primary storage. [2025-10-07T19:39:49.542901] [INFO ] [MAIN ] IVZ: Loaded 53132 existing records. [2025-10-07T19:39:49.720238] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:39:49.720471] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-07T19:39:49.720519] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-07T19:39:49.720797] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-07T19:39:49.720860] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-07T19:39:50.063104] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:39:50.247605] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-07T19:39:50.608258] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T19:39:50.893898] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T19:39:51.047749] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-07T19:39:51.656107] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T19:39:51.847695] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-07T19:39:52.466142] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T19:39:52.647685] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-07T19:39:53.449513] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-07T19:39:53.452083] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T19:39:54.247634] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-07T19:39:54.328274] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T19:39:54.676025] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T19:39:55.047684] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-07T19:39:55.847701] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-07T19:39:55.924436] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T19:39:56.267892] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T19:39:56.647718] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-07T19:39:57.123851] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-07T19:39:57.447720] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-07T19:39:58.247718] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-07T19:39:58.445962] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T19:39:59.047619] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-07T19:39:59.274267] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T19:39:59.437784] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T19:39:59.847708] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-07T19:40:00.603362] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T19:40:00.647626] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-07T19:40:00.826325] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T19:40:01.447752] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-07T19:40:02.064168] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T19:40:02.068829] [INFO ] [REMOTE ] ITW: Full fetch complete (66421 records). [2025-10-07T19:40:02.069117] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-07T19:40:02.250402] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-07T19:40:02.470196] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-07T19:40:02.470306] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-07T19:40:02.471271] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-07T19:40:02.471395] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-07T19:40:02.472974] [DEBUG] [LOCAL ] ITW: Trimmed 66421 records to 45729 (keeping 200 days of data) [2025-10-07T19:40:02.779566] [DEBUG] [LOCAL ] ITW: Primary data saved (45729 records). [2025-10-07T19:40:02.779830] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-07T19:40:02.779965] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITW took 43.8s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-07T19:40:02.974323] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:03.006629] [DEBUG] [LOCAL ] IX: Loaded 22330 existing records from primary storage. [2025-10-07T19:40:03.007382] [INFO ] [MAIN ] IX: Loaded 22330 existing records. [2025-10-07T19:40:03.060201] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-07T19:40:03.231765] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:40:03.232208] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-07T19:40:03.232281] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-07T19:40:03.232613] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-07T19:40:03.232724] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-07T19:40:03.379120] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T19:40:03.667277] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:03.847610] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-07T19:40:04.109759] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T19:40:04.327407] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-07T19:40:04.647718] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-07T19:40:04.656053] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T19:40:05.447711] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-07T19:40:06.202338] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T19:40:06.247620] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-07T19:40:06.572909] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T19:40:07.001342] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T19:40:07.047710] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-07T19:40:07.847671] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-07T19:40:08.300226] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T19:40:08.647714] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-07T19:40:09.447625] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-07T19:40:09.939144] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-07T19:40:09.971120] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T19:40:10.247676] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-07T19:40:10.346589] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-07T19:40:11.047685] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-07T19:40:11.115244] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T19:40:11.847697] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-07T19:40:12.649941] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-07T19:40:12.654325] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T19:40:12.659102] [INFO ] [REMOTE ] IVR: Full fetch complete (69230 records). [2025-10-07T19:40:12.659271] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-07T19:40:13.066791] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-07T19:40:13.066879] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-07T19:40:13.067796] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-07T19:40:13.067862] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-07T19:40:13.069747] [DEBUG] [LOCAL ] IVR: Trimmed 69230 records to 48059 (keeping 200 days of data) [2025-10-07T19:40:13.368681] [DEBUG] [LOCAL ] IVR: Primary data saved (48059 records). [2025-10-07T19:40:13.368870] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-07T19:40:13.368961] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. IVR took 45.4s. Estimated remaining: 2h 54m 6s. Rate: 7.1 symbols/min [2025-10-07T19:40:13.454526] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-07T19:40:13.577515] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:13.623777] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T19:40:13.671339] [DEBUG] [LOCAL ] J: Loaded 40186 existing records from primary storage. [2025-10-07T19:40:13.671835] [INFO ] [MAIN ] J: Loaded 40186 existing records. [2025-10-07T19:40:13.811756] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T19:40:13.874173] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:40:13.874429] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-07T19:40:13.874480] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-07T19:40:13.874851] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-07T19:40:13.874916] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-07T19:40:14.223870] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:14.247635] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-07T19:40:14.654079] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T19:40:14.656718] [INFO ] [REMOTE ] IVT: Full fetch complete (45610 records). [2025-10-07T19:40:14.656803] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-07T19:40:15.048691] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-07T19:40:15.081668] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-07T19:40:15.081763] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-07T19:40:15.082523] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-07T19:40:15.082570] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-07T19:40:15.084033] [DEBUG] [LOCAL ] IVT: Trimmed 45610 records to 30888 (keeping 200 days of data) [2025-10-07T19:40:15.276283] [DEBUG] [LOCAL ] IVT: Primary data saved (30888 records). [2025-10-07T19:40:15.276435] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-07T19:40:15.276561] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVT took 32.3s. Estimated remaining: 2h 53m 51s. Rate: 7.1 symbols/min [2025-10-07T19:40:15.443778] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:15.484294] [DEBUG] [LOCAL ] JBGS: Loaded 42393 existing records from primary storage. [2025-10-07T19:40:15.484564] [INFO ] [MAIN ] JBGS: Loaded 42393 existing records. [2025-10-07T19:40:15.661575] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:40:15.661879] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-07T19:40:15.662110] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-07T19:40:15.662456] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-07T19:40:15.662543] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-07T19:40:15.851181] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-07T19:40:16.079281] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:16.106849] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T19:40:16.383280] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T19:40:16.647724] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-07T19:40:17.447725] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-07T19:40:17.640261] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T19:40:17.855472] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-07T19:40:18.247702] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-07T19:40:18.701625] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T19:40:19.047726] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-07T19:40:19.227684] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T19:40:19.847727] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-07T19:40:20.465797] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T19:40:20.647695] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-07T19:40:21.447708] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-07T19:40:21.707421] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T19:40:21.924990] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T19:40:22.131461] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T19:40:22.133335] [INFO ] [REMOTE ] IX: Full fetch complete (27561 records). [2025-10-07T19:40:22.133430] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-07T19:40:22.252863] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-07T19:40:22.534594] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-07T19:40:22.534732] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-07T19:40:22.535804] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-07T19:40:22.535871] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-07T19:40:22.536796] [DEBUG] [LOCAL ] IX: Trimmed 27561 records to 22307 (keeping 200 days of data) [2025-10-07T19:40:22.685419] [DEBUG] [LOCAL ] IX: Primary data saved (22307 records). [2025-10-07T19:40:22.685676] [INFO ] [MAIN ] IX: Full history saved. [2025-10-07T19:40:22.685836] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IX took 19.9s. Estimated remaining: 2h 53m 41s. Rate: 7.1 symbols/min [2025-10-07T19:40:22.882815] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:22.934966] [DEBUG] [LOCAL ] JBI: Loaded 43384 existing records from primary storage. [2025-10-07T19:40:22.935467] [INFO ] [MAIN ] JBI: Loaded 43384 existing records. [2025-10-07T19:40:23.049137] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-07T19:40:23.137324] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:40:23.137623] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-07T19:40:23.137712] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-07T19:40:23.138011] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-07T19:40:23.138074] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-07T19:40:23.523078] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:23.847703] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-07T19:40:24.290536] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T19:40:24.647611] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-07T19:40:25.133866] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-07T19:40:25.369121] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T19:40:25.447612] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-07T19:40:26.217843] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T19:40:26.221743] [INFO ] [REMOTE ] IVZ: Full fetch complete (76813 records). [2025-10-07T19:40:26.221908] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-07T19:40:26.253831] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-07T19:40:26.631091] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-07T19:40:26.631216] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-07T19:40:26.632227] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-07T19:40:26.632296] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-07T19:40:26.633991] [DEBUG] [LOCAL ] IVZ: Trimmed 76813 records to 53132 (keeping 200 days of data) [2025-10-07T19:40:26.981568] [DEBUG] [LOCAL ] IVZ: Primary data saved (53132 records). [2025-10-07T19:40:26.981949] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-07T19:40:26.982045] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVZ took 37.7s. Estimated remaining: 2h 53m 28s. Rate: 7.1 symbols/min [2025-10-07T19:40:27.047717] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-07T19:40:27.188445] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:27.185170] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T19:40:27.243116] [DEBUG] [LOCAL ] JBL: Loaded 48400 existing records from primary storage. [2025-10-07T19:40:27.243454] [INFO ] [MAIN ] JBL: Loaded 48400 existing records. [2025-10-07T19:40:27.423105] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:40:27.423348] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-07T19:40:27.423400] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-07T19:40:27.423730] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-07T19:40:27.423792] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-07T19:40:27.779859] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:27.847598] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-07T19:40:27.882888] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T19:40:28.647727] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-07T19:40:28.725737] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T19:40:29.452803] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-07T19:40:29.459441] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T19:40:30.247715] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-07T19:40:30.293300] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T19:40:31.053097] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-07T19:40:31.086627] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T19:40:31.847672] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-07T19:40:32.101412] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T19:40:32.656118] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-07T19:40:32.657917] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T19:40:32.796974] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T19:40:33.447735] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-07T19:40:34.247683] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-07T19:40:34.304164] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T19:40:34.933842] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T19:40:35.047604] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-07T19:40:35.847704] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-07T19:40:35.990575] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T19:40:36.584395] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T19:40:36.647613] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-07T19:40:37.455849] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-07T19:40:37.475471] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T19:40:38.247640] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-07T19:40:38.458326] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T19:40:39.039607] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T19:40:39.049596] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-07T19:40:39.792019] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T19:40:39.847603] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-07T19:40:40.097681] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T19:40:40.647714] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-07T19:40:41.259561] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T19:40:41.447736] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-07T19:40:42.247736] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-07T19:40:42.449709] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T19:40:42.992885] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T19:40:43.047618] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-07T19:40:43.330398] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T19:40:43.847744] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-07T19:40:44.335743] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T19:40:44.338848] [INFO ] [REMOTE ] J: Full fetch complete (59167 records). [2025-10-07T19:40:44.338985] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-07T19:40:44.652774] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-07T19:40:44.727428] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-07T19:40:44.727510] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-07T19:40:44.728324] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-07T19:40:44.728403] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-07T19:40:44.729747] [DEBUG] [LOCAL ] J: Trimmed 59167 records to 40213 (keeping 200 days of data) [2025-10-07T19:40:44.988412] [DEBUG] [LOCAL ] J: Primary data saved (40213 records). [2025-10-07T19:40:44.988545] [INFO ] [MAIN ] J: Full history saved. [2025-10-07T19:40:44.988626] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. J took 31.6s. Estimated remaining: 2h 53m 30s. Rate: 7.1 symbols/min [2025-10-07T19:40:45.170278] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:45.200963] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T19:40:45.229387] [DEBUG] [LOCAL ] JBND: Loaded 26300 existing records from primary storage. [2025-10-07T19:40:45.229672] [INFO ] [MAIN ] JBND: Loaded 26300 existing records. [2025-10-07T19:40:45.405802] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:40:45.406069] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-07T19:40:45.406120] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-07T19:40:45.406425] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-07T19:40:45.406485] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-07T19:40:45.459862] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-07T19:40:45.770451] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:45.829789] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T19:40:46.247693] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-07T19:40:46.940256] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T19:40:47.047759] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-07T19:40:47.684690] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T19:40:47.847691] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-07T19:40:48.643519] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T19:40:48.653403] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-07T19:40:48.887553] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T19:40:49.447742] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-07T19:40:50.236257] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T19:40:50.247596] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-07T19:40:51.047687] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-07T19:40:51.092052] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T19:40:51.230851] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T19:40:51.233604] [INFO ] [REMOTE ] JBGS: Full fetch complete (59450 records). [2025-10-07T19:40:51.233873] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-07T19:40:51.611514] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-07T19:40:51.611621] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-07T19:40:51.612537] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-07T19:40:51.612589] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-07T19:40:51.613898] [DEBUG] [LOCAL ] JBGS: Trimmed 59450 records to 42319 (keeping 200 days of data) [2025-10-07T19:40:51.847743] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-07T19:40:51.880611] [DEBUG] [LOCAL ] JBGS: Primary data saved (42319 records). [2025-10-07T19:40:51.880776] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-07T19:40:51.880867] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. JBGS took 36.6s. Estimated remaining: 2h 53m 20s. Rate: 7.1 symbols/min [2025-10-07T19:40:52.047104] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:52.047270] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-07T19:40:52.047334] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-07T19:40:52.047456] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-07T19:40:52.047545] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-07T19:40:52.047609] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-07T19:40:52.047675] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-07T19:40:52.399227] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:52.492134] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T19:40:52.647608] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-07T19:40:52.857639] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:40:52.858025] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-07T19:40:52.858115] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:40:52.858163] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-07T19:40:52.858222] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:40:52.858296] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-07T19:40:52.858403] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-07T19:40:52.858460] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-07T19:40:52.858506] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-07T19:40:52.858557] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBS took 1.0s. Estimated remaining: 2h 53m 4s. Rate: 7.1 symbols/min [2025-10-07T19:40:53.037636] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:53.037953] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-07T19:40:53.038002] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-07T19:40:53.038134] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-07T19:40:53.038179] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-07T19:40:53.038223] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-07T19:40:53.038256] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-07T19:40:53.410194] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:53.447694] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-07T19:40:53.605451] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T19:40:53.650411] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:40:53.650822] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-07T19:40:53.650948] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:40:53.650999] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-07T19:40:53.651063] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:40:53.651136] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-07T19:40:53.651217] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-07T19:40:53.651275] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-07T19:40:53.651353] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-07T19:40:53.651453] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBTM took 0.8s. Estimated remaining: 2h 52m 47s. Rate: 7.1 symbols/min [2025-10-07T19:40:53.845893] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:53.855839] [DEBUG] [LOCAL ] JCE: Loaded 6968 existing records from primary storage. [2025-10-07T19:40:53.856044] [INFO ] [MAIN ] JCE: Loaded 6968 existing records. [2025-10-07T19:40:54.030158] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:40:54.030378] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-07T19:40:54.030426] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-07T19:40:54.030930] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-07T19:40:54.030990] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-07T19:40:54.252877] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-07T19:40:54.382313] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:55.047748] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-07T19:40:55.605266] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T19:40:55.608307] [INFO ] [REMOTE ] JBI: Full fetch complete (64240 records). [2025-10-07T19:40:55.608422] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-07T19:40:55.854181] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-07T19:40:56.000513] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-07T19:40:56.000603] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-07T19:40:56.001537] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-07T19:40:56.001607] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-07T19:40:56.003927] [DEBUG] [LOCAL ] JBI: Trimmed 64240 records to 43410 (keeping 200 days of data) [2025-10-07T19:40:56.260555] [DEBUG] [LOCAL ] JBI: Primary data saved (43410 records). [2025-10-07T19:40:56.260727] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-07T19:40:56.260827] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBI took 33.6s. Estimated remaining: 2h 52m 32s. Rate: 7.1 symbols/min [2025-10-07T19:40:56.427875] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:40:56.482079] [DEBUG] [LOCAL ] JCI: Loaded 53538 existing records from primary storage. [2025-10-07T19:40:56.482409] [INFO ] [MAIN ] JCI: Loaded 53538 existing records. [2025-10-07T19:40:56.587470] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-07T19:40:56.650106] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-07T19:40:56.679611] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:40:56.679984] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-07T19:40:56.680140] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-07T19:40:56.680511] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-07T19:40:56.680606] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-07T19:40:57.049180] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:40:57.083430] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T19:40:57.447707] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-07T19:40:57.758389] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T19:40:58.163752] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T19:40:58.247678] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-07T19:40:59.047755] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-07T19:40:59.236684] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T19:40:59.847695] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-07T19:41:00.647704] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-07T19:41:01.114293] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T19:41:01.155607] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-07T19:41:01.174856] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-07T19:41:01.447715] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-07T19:41:02.048942] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T19:41:02.247767] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-07T19:41:03.047723] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-07T19:41:03.847627] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-07T19:41:03.882048] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T19:41:04.131606] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T19:41:04.647688] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-07T19:41:05.205108] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T19:41:05.447629] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-07T19:41:05.612062] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T19:41:06.140153] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T19:41:06.247688] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-07T19:41:06.984180] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T19:41:07.047628] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-07T19:41:07.847678] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-07T19:41:08.464052] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T19:41:08.647724] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-07T19:41:08.889788] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T19:41:09.447633] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-07T19:41:09.688900] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T19:41:10.247766] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-07T19:41:11.047708] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-07T19:41:11.091445] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-07T19:41:11.220369] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-07T19:41:11.223975] [INFO ] [REMOTE ] JBL: Full fetch complete (70432 records). [2025-10-07T19:41:11.224111] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-07T19:41:11.608198] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-07T19:41:11.608299] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-07T19:41:11.609289] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-07T19:41:11.609373] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-07T19:41:11.611004] [DEBUG] [LOCAL ] JBL: Trimmed 70432 records to 48387 (keeping 200 days of data) [2025-10-07T19:41:11.847693] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-07T19:41:11.930157] [DEBUG] [LOCAL ] JBL: Primary data saved (48387 records). [2025-10-07T19:41:11.930316] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-07T19:41:11.930447] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBL took 44.9s. Estimated remaining: 2h 52m 32s. Rate: 7.1 symbols/min [2025-10-07T19:41:12.103937] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:41:12.149255] [DEBUG] [LOCAL ] JEF: Loaded 50035 existing records from primary storage. [2025-10-07T19:41:12.149582] [INFO ] [MAIN ] JEF: Loaded 50035 existing records. [2025-10-07T19:41:12.333969] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T19:41:12.353116] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:41:12.353767] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-07T19:41:12.353822] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-07T19:41:12.354153] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-07T19:41:12.354213] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-07T19:41:12.652874] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-07T19:41:12.714755] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:41:13.447689] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-07T19:41:13.491552] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T19:41:13.493016] [INFO ] [REMOTE ] JCE: Full fetch complete (9592 records). [2025-10-07T19:41:13.493089] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-07T19:41:13.821542] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-07T19:41:13.952506] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-07T19:41:13.952589] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-07T19:41:13.952838] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-07T19:41:13.952902] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-07T19:41:13.953342] [DEBUG] [LOCAL ] JCE: Trimmed 9592 records to 7029 (keeping 200 days of data) [2025-10-07T19:41:13.997878] [DEBUG] [LOCAL ] JCE: Primary data saved (7029 records). [2025-10-07T19:41:13.998021] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-07T19:41:13.998125] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JCE took 20.3s. Estimated remaining: 2h 52m 16s. Rate: 7.1 symbols/min [2025-10-07T19:41:14.165697] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:41:14.208273] [DEBUG] [LOCAL ] JELD: Loaded 46068 existing records from primary storage. [2025-10-07T19:41:14.208612] [INFO ] [MAIN ] JELD: Loaded 46068 existing records. [2025-10-07T19:41:14.252984] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-07T19:41:14.396484] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:41:14.396849] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-07T19:41:14.397016] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-07T19:41:14.397389] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-07T19:41:14.397506] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-07T19:41:14.672060] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T19:41:14.779556] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:41:15.047678] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-07T19:41:15.847675] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-07T19:41:16.084180] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T19:41:16.635172] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T19:41:16.647588] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-07T19:41:16.755065] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-07T19:41:17.447710] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-07T19:41:18.247718] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-07T19:41:18.360760] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T19:41:18.884016] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T19:41:19.047676] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-07T19:41:19.466393] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T19:41:19.847676] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-07T19:41:20.648347] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T19:41:20.648424] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-07T19:41:21.447677] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-07T19:41:21.590139] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T19:41:22.035282] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T19:41:22.247767] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-07T19:41:23.047714] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-07T19:41:23.203132] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T19:41:23.245543] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T19:41:23.847743] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-07T19:41:24.125617] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T19:41:24.647713] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-07T19:41:25.447666] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-07T19:41:25.655472] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T19:41:26.231635] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T19:41:26.247598] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-07T19:41:26.845141] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T19:41:27.047716] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-07T19:41:27.847698] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-07T19:41:27.984832] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T19:41:28.647690] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-07T19:41:28.964852] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T19:41:28.967864] [INFO ] [REMOTE ] JBND: Full fetch complete (34675 records). [2025-10-07T19:41:28.967960] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-07T19:41:29.331029] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-07T19:41:29.430007] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-07T19:41:29.430149] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-07T19:41:29.430988] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-07T19:41:29.431054] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-07T19:41:29.432330] [DEBUG] [LOCAL ] JBND: Trimmed 34675 records to 26404 (keeping 200 days of data) [2025-10-07T19:41:29.491304] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-07T19:41:29.623153] [DEBUG] [LOCAL ] JBND: Primary data saved (26404 records). [2025-10-07T19:41:29.623354] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-07T19:41:29.623482] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBND took 44.6s. Estimated remaining: 2h 52m 16s. Rate: 7.1 symbols/min [2025-10-07T19:41:29.806701] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:41:29.821178] [DEBUG] [LOCAL ] JEQ: Loaded 8651 existing records from primary storage. [2025-10-07T19:41:29.821504] [INFO ] [MAIN ] JEQ: Loaded 8651 existing records. [2025-10-07T19:41:30.018737] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:41:30.019613] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-07T19:41:30.019806] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-07T19:41:30.020263] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-07T19:41:30.035937] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-07T19:41:30.134292] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T19:41:30.252964] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-07T19:41:30.466773] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:41:31.047634] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-07T19:41:31.475011] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T19:41:31.794637] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T19:41:31.847702] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-07T19:41:32.360371] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T19:41:32.510172] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-07T19:41:32.647629] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-07T19:41:33.215305] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T19:41:33.447766] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-07T19:41:34.247737] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-07T19:41:35.047724] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-07T19:41:35.134125] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T19:41:35.382697] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T19:41:35.847700] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-07T19:41:36.486260] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T19:41:36.647686] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-07T19:41:36.930705] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T19:41:37.442614] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T19:41:37.447587] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-07T19:41:38.244932] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T19:41:38.247665] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-07T19:41:39.047752] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-07T19:41:39.785837] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T19:41:39.847713] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-07T19:41:40.567424] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T19:41:40.647680] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-07T19:41:40.892347] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T19:41:41.447691] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-07T19:41:42.247631] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-07T19:41:42.282863] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T19:41:42.829531] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T19:41:43.056049] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-07T19:41:43.076079] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T19:41:43.847695] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-07T19:41:44.469567] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T19:41:44.627196] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T19:41:44.631525] [INFO ] [REMOTE ] JCI: Full fetch complete (77409 records). [2025-10-07T19:41:44.631729] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-07T19:41:44.655056] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-07T19:41:45.058666] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-07T19:41:45.058815] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-07T19:41:45.060407] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-07T19:41:45.060495] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-07T19:41:45.062729] [DEBUG] [LOCAL ] JCI: Trimmed 77409 records to 53538 (keeping 200 days of data) [2025-10-07T19:41:45.447750] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-07T19:41:45.448124] [DEBUG] [LOCAL ] JCI: Primary data saved (53538 records). [2025-10-07T19:41:45.449479] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-07T19:41:45.449620] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCI took 49.2s. Estimated remaining: 2h 52m 15s. Rate: 7.1 symbols/min [2025-10-07T19:41:45.659864] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:41:45.660990] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T19:41:45.704128] [DEBUG] [LOCAL ] JFR: Loaded 30926 existing records from primary storage. [2025-10-07T19:41:45.704564] [INFO ] [MAIN ] JFR: Loaded 30926 existing records. [2025-10-07T19:41:45.896409] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:41:45.896739] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-07T19:41:45.896801] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-07T19:41:45.897124] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-07T19:41:45.897184] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-07T19:41:46.254897] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:41:46.255027] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-07T19:41:46.852305] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T19:41:46.856052] [INFO ] [REMOTE ] JELD: Full fetch complete (64168 records). [2025-10-07T19:41:46.856186] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-07T19:41:47.058509] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-07T19:41:47.274513] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-07T19:41:47.274624] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-07T19:41:47.275941] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-07T19:41:47.276015] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-07T19:41:47.277980] [DEBUG] [LOCAL ] JELD: Trimmed 64168 records to 46120 (keeping 200 days of data) [2025-10-07T19:41:47.578445] [DEBUG] [LOCAL ] JELD: Primary data saved (46120 records). [2025-10-07T19:41:47.578664] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-07T19:41:47.578800] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JELD took 33.6s. Estimated remaining: 2h 51m 60s. Rate: 7.1 symbols/min [2025-10-07T19:41:47.793502] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:41:47.808469] [DEBUG] [LOCAL ] JGH: Loaded 11239 existing records from primary storage. [2025-10-07T19:41:47.808876] [INFO ] [MAIN ] JGH: Loaded 11239 existing records. [2025-10-07T19:41:47.853218] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-07T19:41:48.044040] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T19:41:48.049812] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:41:48.060792] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-07T19:41:48.061192] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-07T19:41:48.061583] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-07T19:41:48.061661] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-07T19:41:48.421227] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:41:48.612267] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T19:41:48.647667] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-07T19:41:48.766988] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T19:41:49.447770] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-07T19:41:50.247636] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-07T19:41:50.280802] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T19:41:50.396717] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T19:41:50.865371] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T19:41:50.866769] [INFO ] [REMOTE ] JEQ: Full fetch complete (11885 records). [2025-10-07T19:41:50.866928] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-07T19:41:51.059160] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-07T19:41:51.244307] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-07T19:41:51.244391] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-07T19:41:51.244795] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-07T19:41:51.244860] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-07T19:41:51.245331] [DEBUG] [LOCAL ] JEQ: Trimmed 11885 records to 8664 (keeping 200 days of data) [2025-10-07T19:41:51.297069] [DEBUG] [LOCAL ] JEQ: Primary data saved (8664 records). [2025-10-07T19:41:51.297211] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-07T19:41:51.297334] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JEQ took 21.7s. Estimated remaining: 2h 51m 46s. Rate: 7.1 symbols/min [2025-10-07T19:41:51.470491] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:41:51.519032] [DEBUG] [LOCAL ] JHG: Loaded 47585 existing records from primary storage. [2025-10-07T19:41:51.519353] [INFO ] [MAIN ] JHG: Loaded 47585 existing records. [2025-10-07T19:41:51.694298] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:41:51.694629] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-07T19:41:51.694715] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-07T19:41:51.694961] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-07T19:41:51.695019] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-07T19:41:51.867562] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-07T19:41:52.033677] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T19:41:52.065186] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:41:52.647733] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-07T19:41:53.327036] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-07T19:41:53.383359] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T19:41:53.447748] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-07T19:41:54.194911] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T19:41:54.247670] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-07T19:41:55.047683] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-07T19:41:55.062072] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T19:41:55.847672] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-07T19:41:56.325763] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T19:41:56.647719] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-07T19:41:56.765119] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-07T19:41:57.447708] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-07T19:41:58.235920] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T19:41:58.247597] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-07T19:41:58.281198] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-07T19:41:59.047685] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-07T19:41:59.818474] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T19:41:59.819255] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T19:41:59.847610] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-07T19:42:00.647704] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-07T19:42:00.928157] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T19:42:01.447687] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-07T19:42:02.247709] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-07T19:42:02.931407] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-07T19:42:03.022822] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T19:42:03.047699] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-07T19:42:03.154457] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T19:42:03.847713] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-07T19:42:04.647750] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-07T19:42:05.003383] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T19:42:05.060387] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T19:42:05.447733] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-07T19:42:06.020465] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T19:42:06.024258] [INFO ] [REMOTE ] JEF: Full fetch complete (73005 records). [2025-10-07T19:42:06.024366] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-07T19:42:06.256088] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-07T19:42:06.430618] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-07T19:42:06.430735] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-07T19:42:06.431806] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-07T19:42:06.431879] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-07T19:42:06.433349] [DEBUG] [LOCAL ] JEF: Trimmed 73005 records to 50041 (keeping 200 days of data) [2025-10-07T19:42:06.674978] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T19:42:06.771710] [DEBUG] [LOCAL ] JEF: Primary data saved (50041 records). [2025-10-07T19:42:06.771857] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-07T19:42:06.771941] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEF took 54.8s. Estimated remaining: 2h 51m 45s. Rate: 7.1 symbols/min [2025-10-07T19:42:06.965305] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:42:06.972280] [DEBUG] [LOCAL ] JHI: Loaded 3628 existing records from primary storage. [2025-10-07T19:42:06.972468] [INFO ] [MAIN ] JHI: Loaded 3628 existing records. [2025-10-07T19:42:07.056104] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-07T19:42:07.163808] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:42:07.164139] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-07T19:42:07.164266] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-07T19:42:07.164563] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-07T19:42:07.164622] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-07T19:42:07.266509] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T19:42:07.295548] [INFO ] [REMOTE ] JGH: Full fetch complete (15171 records). [2025-10-07T19:42:07.314463] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-07T19:42:07.684822] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:42:07.856225] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-07T19:42:07.884099] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-07T19:42:07.884163] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-07T19:42:07.884478] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-07T19:42:07.884518] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-07T19:42:07.885200] [DEBUG] [LOCAL ] JGH: Trimmed 15171 records to 11315 (keeping 200 days of data) [2025-10-07T19:42:07.955776] [DEBUG] [LOCAL ] JGH: Primary data saved (11315 records). [2025-10-07T19:42:07.955921] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-07T19:42:07.956022] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JGH took 20.4s. Estimated remaining: 2h 51m 29s. Rate: 7.1 symbols/min [2025-10-07T19:42:08.123141] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:42:08.128955] [DEBUG] [LOCAL ] JHS: Loaded 2874 existing records from primary storage. [2025-10-07T19:42:08.129116] [INFO ] [MAIN ] JHS: Loaded 2874 existing records. [2025-10-07T19:42:08.308529] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:42:08.308919] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-07T19:42:08.308974] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-07T19:42:08.309171] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-07T19:42:08.309227] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-07T19:42:08.497528] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T19:42:08.524194] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T19:42:08.654716] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-07T19:42:08.695746] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:42:09.447695] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-07T19:42:10.043316] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T19:42:10.247699] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-07T19:42:11.047697] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-07T19:42:11.450341] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T19:42:11.523413] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T19:42:11.665535] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T19:42:11.847680] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-07T19:42:12.647719] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-07T19:42:13.302054] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T19:42:13.447696] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-07T19:42:14.009406] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T19:42:14.250391] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-07T19:42:14.258109] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T19:42:14.663602] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-07T19:42:15.047694] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-07T19:42:15.613321] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-07T19:42:15.847630] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-07T19:42:16.647678] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-07T19:42:17.115160] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T19:42:17.372625] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T19:42:17.447575] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-07T19:42:18.247720] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-07T19:42:18.723255] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-07T19:42:18.853455] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T19:42:18.856369] [INFO ] [REMOTE ] JFR: Full fetch complete (48392 records). [2025-10-07T19:42:18.856474] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-07T19:42:19.054432] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-07T19:42:19.258041] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-07T19:42:19.258139] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-07T19:42:19.258907] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-07T19:42:19.258973] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-07T19:42:19.260105] [DEBUG] [LOCAL ] JFR: Trimmed 48392 records to 31002 (keeping 200 days of data) [2025-10-07T19:42:19.458458] [DEBUG] [LOCAL ] JFR: Primary data saved (31002 records). [2025-10-07T19:42:19.458674] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-07T19:42:19.458823] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JFR took 34.0s. Estimated remaining: 2h 51m 24s. Rate: 7.1 symbols/min [2025-10-07T19:42:19.635701] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:42:19.689841] [DEBUG] [LOCAL ] JHX: Loaded 52726 existing records from primary storage. [2025-10-07T19:42:19.690188] [INFO ] [MAIN ] JHX: Loaded 52726 existing records. [2025-10-07T19:42:19.851926] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-07T19:42:19.875789] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:42:19.876118] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-07T19:42:19.876182] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-07T19:42:19.876473] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-07T19:42:19.876532] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-07T19:42:20.229921] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:42:20.362668] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-07T19:42:20.647757] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-07T19:42:20.732929] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T19:42:21.133978] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-07T19:42:21.447711] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-07T19:42:22.247689] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-07T19:42:22.864514] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T19:42:22.877461] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T19:42:23.047704] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-07T19:42:23.608020] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-07T19:42:23.847725] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-07T19:42:24.374163] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T19:42:24.647741] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-07T19:42:25.447638] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-07T19:42:25.996931] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-07T19:42:26.247709] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-07T19:42:26.297500] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T19:42:26.842790] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-07T19:42:27.047744] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-07T19:42:27.515261] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-07T19:42:27.847688] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-07T19:42:28.333530] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T19:42:28.647706] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-07T19:42:29.447735] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-07T19:42:29.745076] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T19:42:29.748935] [INFO ] [REMOTE ] JHG: Full fetch complete (68261 records). [2025-10-07T19:42:29.749120] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-07T19:42:30.132872] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-07T19:42:30.158034] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-07T19:42:30.158122] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-07T19:42:30.159013] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-07T19:42:30.159079] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-07T19:42:30.160549] [DEBUG] [LOCAL ] JHG: Trimmed 68261 records to 47590 (keeping 200 days of data) [2025-10-07T19:42:30.250967] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-07T19:42:30.455548] [DEBUG] [LOCAL ] JHG: Primary data saved (47590 records). [2025-10-07T19:42:30.455723] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-07T19:42:30.455819] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JHG took 39.2s. Estimated remaining: 2h 51m 18s. Rate: 7.1 symbols/min [2025-10-07T19:42:30.626002] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:42:30.645332] [DEBUG] [LOCAL ] JILL: Loaded 16449 existing records from primary storage. [2025-10-07T19:42:30.645728] [INFO ] [MAIN ] JILL: Loaded 16449 existing records. [2025-10-07T19:42:30.748941] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-07T19:42:30.827098] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:42:30.827345] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-07T19:42:30.827407] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-07T19:42:30.827679] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-07T19:42:30.827755] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-07T19:42:31.057339] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-07T19:42:31.178221] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:42:31.602305] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-07T19:42:31.847718] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-07T19:42:32.647755] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-07T19:42:33.068316] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-07T19:42:33.157057] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T19:42:33.158046] [INFO ] [REMOTE ] JHS: Full fetch complete (4456 records). [2025-10-07T19:42:33.158118] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-07T19:42:33.452883] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-07T19:42:33.509766] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-07T19:42:33.509863] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-07T19:42:33.510045] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-07T19:42:33.510113] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-07T19:42:33.510492] [DEBUG] [LOCAL ] JHS: Trimmed 4456 records to 2876 (keeping 200 days of data) [2025-10-07T19:42:33.529317] [DEBUG] [LOCAL ] JHS: Primary data saved (2876 records). [2025-10-07T19:42:33.529389] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-07T19:42:33.529467] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHS took 25.6s. Estimated remaining: 2h 51m 4s. Rate: 7.1 symbols/min [2025-10-07T19:42:33.692349] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:42:33.732954] [DEBUG] [LOCAL ] JKS: Loaded 40026 existing records from primary storage. [2025-10-07T19:42:33.733266] [INFO ] [MAIN ] JKS: Loaded 40026 existing records. [2025-10-07T19:42:33.908676] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:42:33.908911] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-07T19:42:33.908961] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-07T19:42:33.909189] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-07T19:42:33.909247] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-07T19:42:34.252851] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-07T19:42:34.259357] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:42:34.773471] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T19:42:34.960426] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-07T19:42:35.047764] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-07T19:42:35.847672] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-07T19:42:35.873507] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T19:42:36.634682] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T19:42:36.647600] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-07T19:42:37.447758] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-07T19:42:37.898045] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T19:42:38.215371] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T19:42:38.247732] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-07T19:42:39.047635] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-07T19:42:39.276585] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-07T19:42:39.847700] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-07T19:42:40.510245] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T19:42:40.647696] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-07T19:42:40.908510] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T19:42:41.264330] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-07T19:42:41.447727] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-07T19:42:42.247700] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-07T19:42:42.309538] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T19:42:43.047756] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-07T19:42:43.847627] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-07T19:42:43.879404] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T19:42:44.534174] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T19:42:44.535233] [INFO ] [REMOTE ] JHI: Full fetch complete (5315 records). [2025-10-07T19:42:44.535308] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-07T19:42:44.652411] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-07T19:42:44.958223] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-07T19:42:44.958345] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-07T19:42:44.958635] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-07T19:42:44.958755] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-07T19:42:44.970495] [DEBUG] [LOCAL ] JHI: Trimmed 5315 records to 3696 (keeping 200 days of data) [2025-10-07T19:42:44.992351] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T19:42:45.027434] [DEBUG] [LOCAL ] JHI: Primary data saved (3696 records). [2025-10-07T19:42:45.027583] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-07T19:42:45.027717] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHI took 38.3s. Estimated remaining: 2h 50m 59s. Rate: 7.1 symbols/min [2025-10-07T19:42:45.196255] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:42:45.230248] [DEBUG] [LOCAL ] JLL: Loaded 31429 existing records from primary storage. [2025-10-07T19:42:45.230577] [INFO ] [MAIN ] JLL: Loaded 31429 existing records. [2025-10-07T19:42:45.408087] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:42:45.408630] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-07T19:42:45.408715] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-07T19:42:45.409053] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-07T19:42:45.409110] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-07T19:42:45.452974] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-07T19:42:45.761737] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:42:46.057717] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T19:42:46.247745] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-07T19:42:47.047759] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-07T19:42:47.181760] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:42:47.418413] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T19:42:47.847728] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-07T19:42:47.995321] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T19:42:48.647733] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-07T19:42:48.793505] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T19:42:49.210681] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T19:42:49.447721] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-07T19:42:50.247796] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-07T19:42:50.721470] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T19:42:51.047728] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-07T19:42:51.277563] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T19:42:51.847677] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-07T19:42:52.415724] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T19:42:52.647629] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-07T19:42:52.675606] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T19:42:52.677539] [INFO ] [REMOTE ] JILL: Full fetch complete (22652 records). [2025-10-07T19:42:52.677735] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-07T19:42:53.099141] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-07T19:42:53.099278] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-07T19:42:53.100315] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-07T19:42:53.100386] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-07T19:42:53.101379] [DEBUG] [LOCAL ] JILL: Trimmed 22652 records to 16381 (keeping 200 days of data) [2025-10-07T19:42:53.217194] [DEBUG] [LOCAL ] JILL: Primary data saved (16381 records). [2025-10-07T19:42:53.217439] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-07T19:42:53.217557] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JILL took 22.8s. Estimated remaining: 2h 50m 50s. Rate: 7.1 symbols/min [2025-10-07T19:42:53.447773] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-07T19:42:54.016983] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T19:42:54.247740] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-07T19:42:55.036675] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T19:42:55.047586] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-07T19:42:55.762491] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T19:42:55.847609] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-07T19:42:56.647723] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-07T19:42:56.737696] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T19:42:56.809949] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T19:42:57.447688] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-07T19:42:58.002246] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T19:42:58.247762] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-07T19:42:58.776589] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-07T19:42:59.047737] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-07T19:42:59.847707] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-07T19:42:59.905129] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T19:43:00.478297] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T19:43:00.647611] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-07T19:43:01.227738] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T19:43:01.447698] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-07T19:43:01.809007] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T19:43:02.247736] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-07T19:43:03.047702] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-07T19:43:03.594324] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T19:43:03.764370] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-07T19:43:03.847730] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-07T19:43:04.182618] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T19:43:04.647705] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-07T19:43:04.923930] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T19:43:04.925907] [INFO ] [REMOTE ] JLL: Full fetch complete (44717 records). [2025-10-07T19:43:04.925987] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-07T19:43:05.331061] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-07T19:43:05.331225] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-07T19:43:05.331969] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-07T19:43:05.332034] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-07T19:43:05.333220] [DEBUG] [LOCAL ] JLL: Trimmed 44717 records to 31486 (keeping 200 days of data) [2025-10-07T19:43:05.447720] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-07T19:43:05.536969] [DEBUG] [LOCAL ] JLL: Primary data saved (31486 records). [2025-10-07T19:43:05.537149] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-07T19:43:05.537254] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JLL took 20.5s. Estimated remaining: 2h 50m 46s. Rate: 7.1 symbols/min [2025-10-07T19:43:06.691184] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T19:43:06.702611] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-07T19:43:07.166476] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T19:43:07.176035] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-07T19:43:08.545575] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T19:43:08.553877] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-07T19:43:09.055924] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-07T19:43:09.061014] [INFO ] [REMOTE ] JHX: Full fetch complete (59619 records). [2025-10-07T19:43:09.061213] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-07T19:43:09.489939] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-07T19:43:09.490029] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-07T19:43:09.490899] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-07T19:43:09.490967] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-07T19:43:09.493549] [DEBUG] [LOCAL ] JHX: Trimmed 59619 records to 52906 (keeping 200 days of data) [2025-10-07T19:43:09.821850] [DEBUG] [LOCAL ] JHX: Primary data saved (52906 records). [2025-10-07T19:43:09.822029] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-07T19:43:09.822143] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 50.4s. Estimated remaining: 2h 50m 33s. Rate: 7.1 symbols/min [2025-10-07T19:43:10.167259] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T19:43:10.177032] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-07T19:43:11.732557] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T19:43:11.735449] [INFO ] [REMOTE ] JKS: Full fetch complete (58789 records). [2025-10-07T19:43:11.735546] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-07T19:43:12.142346] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-07T19:43:12.142432] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-07T19:43:12.143276] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-07T19:43:12.143342] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-07T19:43:12.144578] [DEBUG] [LOCAL ] JKS: Trimmed 58789 records to 39913 (keeping 200 days of data) [2025-10-07T19:43:12.395350] [DEBUG] [LOCAL ] JKS: Primary data saved (39913 records). [2025-10-07T19:43:12.395523] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-07T19:43:12.395626] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 38.9s. Estimated remaining: 2h 50m 18s. Rate: 7.1 symbols/min [2025-10-07T19:43:13.083381] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:43:13.082524] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:43:13.086839] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:43:13.087145] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-07T19:43:13.050897] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:43:13.087248] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-07T19:43:13.087400] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-07T19:43:13.087498] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-07T19:43:13.087929] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-07T19:43:13.087982] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-07T19:43:13.159212] [DEBUG] [LOCAL ] JLS: Loaded 4143 existing records from primary storage. [2025-10-07T19:43:13.170953] [INFO ] [MAIN ] JLS: Loaded 4143 existing records. [2025-10-07T19:43:13.636459] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:43:13.637402] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-07T19:43:13.644204] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-07T19:43:13.654733] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-07T19:43:13.638857] [DEBUG] [LOCAL ] JMIA: Loaded 50758 existing records from primary storage. [2025-10-07T19:43:13.666017] [INFO ] [MAIN ] JMIA: Loaded 50758 existing records. [2025-10-07T19:43:13.660609] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-07T19:43:13.741030] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:43:13.778122] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-07T19:43:13.794241] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-07T19:43:13.873450] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-07T19:43:14.271367] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:43:14.315784] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-07T19:43:14.372746] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-07T19:43:14.426632] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-07T19:43:14.434905] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:43:14.444351] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-07T19:43:14.444526] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-07T19:43:14.455999] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-07T19:43:14.493785] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-07T19:43:14.563806] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-07T19:43:14.563696] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T19:43:14.697899] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:43:14.737635] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-07T19:43:14.762737] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-07T19:43:15.231995] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-07T19:43:15.292179] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-07T19:43:15.290243] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:43:15.336937] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:43:15.338895] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-07T19:43:15.328704] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-07T19:43:15.401223] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T19:43:15.403118] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-07T19:43:15.833444] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-07T19:43:15.834552] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-07T19:43:15.979325] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-07T19:43:15.980922] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-07T19:43:16.174298] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-07T19:43:16.545809] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T19:43:16.647667] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-07T19:43:16.996245] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T19:43:17.272201] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T19:43:17.447736] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-07T19:43:17.601076] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-07T19:43:17.891473] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-07T19:43:18.247743] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-07T19:43:19.047733] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-07T19:43:19.543395] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-07T19:43:19.847711] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-07T19:43:20.309422] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-07T19:43:20.416489] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-07T19:43:20.647735] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-07T19:43:21.447716] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-07T19:43:22.247720] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-07T19:43:22.348427] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T19:43:22.926029] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T19:43:23.047731] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-07T19:43:23.487184] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-07T19:43:23.847772] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-07T19:43:24.647743] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-07T19:43:24.943778] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-07T19:43:25.116930] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T19:43:25.447671] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-07T19:43:25.854999] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T19:43:26.247706] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-07T19:43:27.047708] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-07T19:43:27.310102] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T19:43:27.615918] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T19:43:27.847713] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-07T19:43:28.251012] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T19:43:28.394367] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-07T19:43:28.647736] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-07T19:43:29.447742] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-07T19:43:29.907356] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-07T19:43:30.247722] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-07T19:43:30.406841] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-07T19:43:31.047754] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-07T19:43:31.847720] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-07T19:43:32.409585] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T19:43:32.448115] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-07T19:43:32.647673] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-07T19:43:32.789718] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T19:43:33.225318] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-07T19:43:33.447712] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-07T19:43:34.247766] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-07T19:43:34.651400] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-07T19:43:34.949262] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T19:43:35.047747] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-07T19:43:35.847703] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-07T19:43:36.507513] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T19:43:36.508571] [INFO ] [REMOTE ] JMM: Full fetch complete (2315 records). [2025-10-07T19:43:36.508761] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-07T19:43:36.666126] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-07T19:43:36.705282] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-07T19:43:36.705806] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:43:36.705963] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:43:36.706252] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-07T19:43:36.706445] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-07T19:43:36.706619] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-07T19:43:36.706882] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-07T19:43:36.707001] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 24.3s. Estimated remaining: 2h 50m 27s. Rate: 7.1 symbols/min [2025-10-07T19:43:36.865616] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T19:43:36.938747] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:43:37.010267] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-10-07T19:43:37.010788] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-10-07T19:43:37.199756] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:43:37.200387] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-07T19:43:37.200543] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-07T19:43:37.200868] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-07T19:43:37.200928] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-07T19:43:37.311367] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T19:43:37.455995] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-07T19:43:37.590457] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:43:38.083156] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T19:43:38.084261] [INFO ] [REMOTE ] JLS: Full fetch complete (5811 records). [2025-10-07T19:43:38.084337] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-07T19:43:38.271244] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-07T19:43:38.471213] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-07T19:43:38.471313] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-07T19:43:38.471708] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-07T19:43:38.471776] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-07T19:43:38.472405] [DEBUG] [LOCAL ] JLS: Trimmed 5811 records to 4146 (keeping 200 days of data) [2025-10-07T19:43:38.500701] [DEBUG] [LOCAL ] JLS: Primary data saved (4146 records). [2025-10-07T19:43:38.500815] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-07T19:43:38.500920] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JLS took 26.1s. Estimated remaining: 2h 50m 11s. Rate: 7.1 symbols/min [2025-10-07T19:43:38.691064] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:43:38.724499] [DEBUG] [LOCAL ] JOE: Loaded 24003 existing records from primary storage. [2025-10-07T19:43:38.724899] [INFO ] [MAIN ] JOE: Loaded 24003 existing records. [2025-10-07T19:43:38.954261] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:43:38.954680] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-07T19:43:38.954758] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-07T19:43:38.955078] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-07T19:43:38.955147] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-07T19:43:39.052940] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-07T19:43:39.407093] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:43:39.847706] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-07T19:43:40.438849] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-07T19:43:40.647632] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-07T19:43:41.044419] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T19:43:41.446093] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-07T19:43:41.456815] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-07T19:43:42.247729] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-07T19:43:43.040959] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-07T19:43:43.052546] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-07T19:43:43.502763] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T19:43:43.847708] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-07T19:43:44.305900] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T19:43:44.451067] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-07T19:43:44.647717] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-07T19:43:45.447735] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-07T19:43:45.626105] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T19:43:46.247709] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-07T19:43:46.932529] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-07T19:43:47.047735] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-07T19:43:47.857259] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-07T19:43:47.865361] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-07T19:43:47.976139] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T19:43:47.980566] [INFO ] [REMOTE ] JMIA: Full fetch complete (73279 records). [2025-10-07T19:43:47.980827] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-07T19:43:48.452185] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-07T19:43:48.452301] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-07T19:43:48.453538] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-07T19:43:48.453607] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-07T19:43:48.455699] [DEBUG] [LOCAL ] JMIA: Trimmed 73279 records to 50814 (keeping 200 days of data) [2025-10-07T19:43:48.648585] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-07T19:43:48.709762] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-07T19:43:48.814216] [DEBUG] [LOCAL ] JMIA: Primary data saved (50814 records). [2025-10-07T19:43:48.814469] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-07T19:43:48.814596] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 36.4s. Estimated remaining: 2h 50m 5s. Rate: 7.1 symbols/min [2025-10-07T19:43:49.005990] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:43:49.017144] [DEBUG] [LOCAL ] JOF: Loaded 6919 existing records from primary storage. [2025-10-07T19:43:49.017466] [INFO ] [MAIN ] JOF: Loaded 6919 existing records. [2025-10-07T19:43:49.219150] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:43:49.219607] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-07T19:43:49.219730] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-07T19:43:49.220094] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-07T19:43:49.220166] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-07T19:43:49.453438] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-07T19:43:49.547376] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-07T19:43:49.667547] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:43:50.247698] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-07T19:43:50.781099] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T19:43:50.969953] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-07T19:43:51.047712] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-07T19:43:51.847747] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-07T19:43:52.261090] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-07T19:43:52.265937] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-07T19:43:52.266180] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-07T19:43:52.602616] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T19:43:52.652734] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-07T19:43:52.740285] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-07T19:43:52.740413] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-07T19:43:52.741758] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-07T19:43:52.741957] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-07T19:43:52.744616] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-10-07T19:43:53.145999] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-07T19:43:53.146209] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-07T19:43:53.146318] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JNJ took 40.7s. Estimated remaining: 2h 49m 52s. Rate: 7.1 symbols/min [2025-10-07T19:43:53.347600] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-07T19:43:53.346835] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:43:53.393731] [DEBUG] [LOCAL ] JPC: Loaded 37181 existing records from primary storage. [2025-10-07T19:43:53.394198] [INFO ] [MAIN ] JPC: Loaded 37181 existing records. [2025-10-07T19:43:53.452837] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-07T19:43:53.592427] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:43:53.592842] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-07T19:43:53.593059] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-07T19:43:53.606384] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-07T19:43:53.623826] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-07T19:43:53.702116] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-07T19:43:54.039944] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:43:54.247727] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-07T19:43:54.732584] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T19:43:55.047721] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-07T19:43:55.635523] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T19:43:55.847712] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-07T19:43:56.371377] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-07T19:43:56.647719] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-07T19:43:57.382529] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T19:43:57.443795] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T19:43:57.449730] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-07T19:43:58.247712] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-07T19:43:59.047757] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-07T19:43:59.402723] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T19:43:59.847715] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-07T19:44:00.016241] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-07T19:44:00.431359] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T19:44:00.647717] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-07T19:44:01.010076] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T19:44:01.447705] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-07T19:44:02.247729] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-07T19:44:02.519423] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T19:44:02.786345] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-07T19:44:03.047714] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-07T19:44:03.631430] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T19:44:03.847699] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-07T19:44:04.647674] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-07T19:44:04.697439] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T19:44:04.788000] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-07T19:44:05.447741] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-07T19:44:05.792235] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T19:44:06.178810] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T19:44:06.247682] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-07T19:44:07.047727] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-07T19:44:07.847765] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-07T19:44:08.426170] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T19:44:08.542007] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T19:44:08.647629] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-07T19:44:08.766195] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-07T19:44:09.447749] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-07T19:44:09.734159] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T19:44:10.094277] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-07T19:44:10.247662] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-07T19:44:11.047730] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-07T19:44:11.666568] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T19:44:11.847702] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-07T19:44:12.647692] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-07T19:44:12.707778] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-07T19:44:12.795567] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T19:44:12.798178] [INFO ] [REMOTE ] JOE: Full fetch complete (35893 records). [2025-10-07T19:44:12.798361] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-07T19:44:13.235709] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-07T19:44:13.235895] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-07T19:44:13.236869] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-07T19:44:13.236935] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-07T19:44:13.238435] [DEBUG] [LOCAL ] JOE: Trimmed 35893 records to 23982 (keeping 200 days of data) [2025-10-07T19:44:13.421719] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T19:44:13.432718] [DEBUG] [LOCAL ] JOE: Primary data saved (23982 records). [2025-10-07T19:44:13.432989] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-07T19:44:13.433119] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOE took 34.9s. Estimated remaining: 2h 49m 56s. Rate: 7.1 symbols/min [2025-10-07T19:44:13.455435] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-07T19:44:13.618281] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:44:13.686419] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-07T19:44:13.686897] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-07T19:44:13.886097] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:44:13.886622] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-07T19:44:13.886712] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-07T19:44:13.887361] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-07T19:44:13.887435] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-07T19:44:14.250483] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-07T19:44:14.270529] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:44:15.047765] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-07T19:44:15.491834] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-07T19:44:15.605125] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T19:44:15.803034] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-07T19:44:15.847671] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-07T19:44:16.647767] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-07T19:44:17.343184] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T19:44:17.344440] [INFO ] [REMOTE ] JOF: Full fetch complete (9500 records). [2025-10-07T19:44:17.344517] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-07T19:44:17.455375] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-07T19:44:17.753999] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-07T19:44:17.754166] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-07T19:44:17.754453] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-07T19:44:17.754497] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-07T19:44:17.755010] [DEBUG] [LOCAL ] JOF: Trimmed 9500 records to 6917 (keeping 200 days of data) [2025-10-07T19:44:17.799458] [DEBUG] [LOCAL ] JOF: Primary data saved (6917 records). [2025-10-07T19:44:17.799622] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-07T19:44:17.799784] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOF took 29.0s. Estimated remaining: 2h 49m 43s. Rate: 7.1 symbols/min [2025-10-07T19:44:17.977236] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:44:18.012424] [DEBUG] [LOCAL ] JQC: Loaded 34608 existing records from primary storage. [2025-10-07T19:44:18.012791] [INFO ] [MAIN ] JQC: Loaded 34608 existing records. [2025-10-07T19:44:18.205432] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:44:18.205774] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-07T19:44:18.205860] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-07T19:44:18.206183] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-07T19:44:18.206260] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-07T19:44:18.250519] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-07T19:44:18.537408] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-07T19:44:18.576179] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-07T19:44:18.598845] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-07T19:44:18.604061] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:44:18.998097] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-07T19:44:18.998208] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-07T19:44:18.999250] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-07T19:44:18.999321] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-07T19:44:19.001044] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53801 (keeping 200 days of data) [2025-10-07T19:44:19.057263] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-07T19:44:19.339889] [DEBUG] [LOCAL ] JOBY: Primary data saved (53801 records). [2025-10-07T19:44:19.340039] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-07T19:44:19.340124] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOBY took 42.6s. Estimated remaining: 2h 49m 28s. Rate: 7.1 symbols/min [2025-10-07T19:44:19.534199] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:44:19.567216] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T19:44:19.613468] [DEBUG] [LOCAL ] JRI: Loaded 15023 existing records from primary storage. [2025-10-07T19:44:19.613894] [INFO ] [MAIN ] JRI: Loaded 15023 existing records. [2025-10-07T19:44:19.691252] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-07T19:44:19.819834] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:44:19.820339] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-07T19:44:19.820561] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-07T19:44:19.820945] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-07T19:44:19.821140] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-07T19:44:19.851830] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-07T19:44:19.937908] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T19:44:20.204791] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:44:20.647694] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-07T19:44:21.218411] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T19:44:21.447724] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-07T19:44:21.976227] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T19:44:22.247679] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-07T19:44:23.047624] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-07T19:44:23.310697] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T19:44:23.473364] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T19:44:23.847638] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-07T19:44:23.992957] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T19:44:24.647735] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-07T19:44:25.447756] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-07T19:44:25.911595] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-07T19:44:26.052830] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T19:44:26.121470] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-07T19:44:26.247767] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-07T19:44:27.047766] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-07T19:44:27.530421] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T19:44:27.533425] [INFO ] [REMOTE ] JPC: Full fetch complete (55480 records). [2025-10-07T19:44:27.533548] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-07T19:44:27.852708] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-07T19:44:27.918298] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-07T19:44:27.918373] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-07T19:44:27.919177] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-07T19:44:27.919255] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-07T19:44:27.920395] [DEBUG] [LOCAL ] JPC: Trimmed 55480 records to 37176 (keeping 200 days of data) [2025-10-07T19:44:28.140743] [DEBUG] [LOCAL ] JPC: Primary data saved (37176 records). [2025-10-07T19:44:28.140882] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-07T19:44:28.140967] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JPC took 35.0s. Estimated remaining: 2h 49m 19s. Rate: 7.1 symbols/min [2025-10-07T19:44:28.320209] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:44:28.334395] [DEBUG] [LOCAL ] JRS: Loaded 11438 existing records from primary storage. [2025-10-07T19:44:28.334593] [INFO ] [MAIN ] JRS: Loaded 11438 existing records. [2025-10-07T19:44:28.513963] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:44:28.514435] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-07T19:44:28.514678] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-07T19:44:28.522162] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-07T19:44:28.534172] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-07T19:44:28.556334] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T19:44:28.652694] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-07T19:44:28.913878] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T19:44:28.918932] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:44:29.447690] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-07T19:44:29.673277] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T19:44:30.247756] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-07T19:44:31.047692] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-07T19:44:31.154578] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T19:44:31.843815] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T19:44:31.847594] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-07T19:44:31.927712] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-07T19:44:32.477597] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T19:44:32.647599] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-07T19:44:33.412600] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T19:44:33.447599] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-07T19:44:33.946164] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-07T19:44:34.247759] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-07T19:44:35.038064] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T19:44:35.047631] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-07T19:44:35.824612] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T19:44:35.847697] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-07T19:44:36.647752] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-07T19:44:37.447680] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-07T19:44:37.773675] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T19:44:38.247628] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-07T19:44:38.298944] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-07T19:44:38.318959] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T19:44:39.047737] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-07T19:44:39.778206] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:44:39.847704] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-07T19:44:40.029296] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T19:44:40.647735] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-07T19:44:41.231143] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T19:44:41.447609] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-07T19:44:41.608151] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T19:44:42.247716] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-07T19:44:42.423279] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T19:44:43.047718] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-07T19:44:43.847732] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-07T19:44:44.393303] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T19:44:44.410222] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T19:44:44.620082] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-07T19:44:44.647617] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-07T19:44:45.447754] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-07T19:44:45.810390] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T19:44:45.813377] [INFO ] [REMOTE ] JQC: Full fetch complete (49514 records). [2025-10-07T19:44:45.813477] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-07T19:44:46.194954] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-07T19:44:46.195061] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-07T19:44:46.196092] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-07T19:44:46.196161] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-07T19:44:46.197679] [DEBUG] [LOCAL ] JQC: Trimmed 49514 records to 34440 (keeping 200 days of data) [2025-10-07T19:44:46.252821] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-07T19:44:46.422143] [DEBUG] [LOCAL ] JQC: Primary data saved (34440 records). [2025-10-07T19:44:46.422347] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-07T19:44:46.422483] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JQC took 28.6s. Estimated remaining: 2h 49m 21s. Rate: 7.1 symbols/min [2025-10-07T19:44:46.603840] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:44:46.651740] [DEBUG] [LOCAL ] JXN: Loaded 45324 existing records from primary storage. [2025-10-07T19:44:46.652149] [INFO ] [MAIN ] JXN: Loaded 45324 existing records. [2025-10-07T19:44:46.843704] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:44:46.843992] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-07T19:44:46.844046] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-07T19:44:46.845253] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-07T19:44:46.845316] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-07T19:44:47.059206] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-07T19:44:47.243467] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T19:44:47.250031] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:44:47.661071] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-07T19:44:47.847705] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-07T19:44:47.925548] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T19:44:48.647698] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-07T19:44:49.447718] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-07T19:44:49.466933] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T19:44:49.469636] [INFO ] [REMOTE ] JRS: Full fetch complete (16361 records). [2025-10-07T19:44:49.469757] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-07T19:44:49.838277] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-07T19:44:49.838363] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-07T19:44:49.838799] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-07T19:44:49.838865] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-07T19:44:49.839364] [DEBUG] [LOCAL ] JRS: Trimmed 16361 records to 11483 (keeping 200 days of data) [2025-10-07T19:44:49.909558] [DEBUG] [LOCAL ] JRS: Primary data saved (11483 records). [2025-10-07T19:44:49.909730] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-07T19:44:49.909844] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JRS took 21.8s. Estimated remaining: 2h 49m 8s. Rate: 7.1 symbols/min [2025-10-07T19:44:50.078738] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:44:50.127327] [DEBUG] [LOCAL ] K: Loaded 50092 existing records from primary storage. [2025-10-07T19:44:50.128211] [INFO ] [MAIN ] K: Loaded 50092 existing records. [2025-10-07T19:44:50.253243] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-07T19:44:50.313441] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:44:50.314064] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-07T19:44:50.314165] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-07T19:44:50.315968] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-07T19:44:50.316078] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-07T19:44:50.479067] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-07T19:44:50.678385] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T19:44:50.812222] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:44:51.047706] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-07T19:44:51.716516] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T19:44:51.847688] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-07T19:44:52.647712] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-07T19:44:53.376633] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-07T19:44:53.411825] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T19:44:53.442274] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T19:44:53.447602] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-07T19:44:54.247712] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-07T19:44:55.047729] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-07T19:44:55.129704] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T19:44:55.847636] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-07T19:44:55.962192] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T19:44:56.067930] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T19:44:56.647717] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-07T19:44:57.447681] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-07T19:44:58.127150] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-07T19:44:58.247620] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-07T19:44:58.295962] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T19:44:58.645865] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T19:44:59.047732] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-07T19:44:59.209009] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T19:44:59.210870] [INFO ] [REMOTE ] JRI: Full fetch complete (23312 records). [2025-10-07T19:44:59.210973] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-07T19:44:59.584866] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-07T19:44:59.584938] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-07T19:44:59.585465] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-07T19:44:59.585509] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-07T19:44:59.586271] [DEBUG] [LOCAL ] JRI: Trimmed 23312 records to 15101 (keeping 200 days of data) [2025-10-07T19:44:59.677098] [DEBUG] [LOCAL ] JRI: Primary data saved (15101 records). [2025-10-07T19:44:59.677246] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-07T19:44:59.677380] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRI took 40.3s. Estimated remaining: 2h 49m 0s. Rate: 7.1 symbols/min [2025-10-07T19:44:59.845200] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:44:59.847694] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-07T19:44:59.859800] [DEBUG] [LOCAL ] KAI: Loaded 13299 existing records from primary storage. [2025-10-07T19:44:59.860042] [INFO ] [MAIN ] KAI: Loaded 13299 existing records. [2025-10-07T19:45:00.034525] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:45:00.034809] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-07T19:45:00.034858] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-07T19:45:00.035678] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-07T19:45:00.035738] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-07T19:45:00.402623] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:45:00.635428] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T19:45:00.647602] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-07T19:45:01.447737] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-07T19:45:02.164279] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T19:45:02.185429] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-07T19:45:02.191392] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-07T19:45:02.191598] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-07T19:45:02.260693] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-07T19:45:02.634148] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-07T19:45:02.634236] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-07T19:45:02.635215] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-07T19:45:02.635280] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-07T19:45:02.639105] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-10-07T19:45:02.995048] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-07T19:45:02.995203] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-07T19:45:02.995291] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JPM took 49.6s. Estimated remaining: 2h 48m 47s. Rate: 7.1 symbols/min [2025-10-07T19:45:03.059206] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-07T19:45:03.191838] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:45:03.234147] [DEBUG] [LOCAL ] KAR: Loaded 40093 existing records from primary storage. [2025-10-07T19:45:03.234525] [INFO ] [MAIN ] KAR: Loaded 40093 existing records. [2025-10-07T19:45:03.352151] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T19:45:03.425587] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:45:03.426072] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-07T19:45:03.426185] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-07T19:45:03.435541] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-07T19:45:03.441065] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-07T19:45:03.540937] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-07T19:45:03.806559] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:45:03.847597] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-07T19:45:04.647702] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-07T19:45:04.954805] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T19:45:05.289112] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T19:45:05.447742] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-07T19:45:05.873745] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T19:45:06.247695] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-07T19:45:06.363599] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T19:45:07.047748] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-07T19:45:07.759038] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T19:45:07.847608] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-07T19:45:08.469464] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T19:45:08.647628] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-07T19:45:09.447751] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-07T19:45:09.740135] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T19:45:10.247636] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-07T19:45:10.373417] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:45:10.840445] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-07T19:45:11.047699] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-07T19:45:11.501010] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T19:45:11.847681] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-07T19:45:12.385083] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T19:45:12.647684] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-07T19:45:12.841546] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T19:45:13.447691] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-07T19:45:14.087525] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T19:45:14.247679] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-07T19:45:15.048958] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-07T19:45:15.051432] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T19:45:15.648229] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T19:45:15.847617] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-07T19:45:16.085088] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T19:45:16.647725] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-07T19:45:17.447632] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-07T19:45:17.806258] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T19:45:18.041589] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T19:45:18.247760] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-07T19:45:18.523292] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T19:45:18.526890] [INFO ] [REMOTE ] JXN: Full fetch complete (65202 records). [2025-10-07T19:45:18.527446] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-07T19:45:18.953327] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-07T19:45:18.953459] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-07T19:45:18.954565] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-07T19:45:18.954635] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-07T19:45:18.956525] [DEBUG] [LOCAL ] JXN: Trimmed 65202 records to 45206 (keeping 200 days of data) [2025-10-07T19:45:19.053986] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-07T19:45:19.272333] [DEBUG] [LOCAL ] JXN: Primary data saved (45206 records). [2025-10-07T19:45:19.272500] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-07T19:45:19.272598] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 32.8s. Estimated remaining: 2h 48m 46s. Rate: 7.1 symbols/min [2025-10-07T19:45:19.407273] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T19:45:19.460418] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:45:19.487282] [DEBUG] [LOCAL ] KB: Loaded 23697 existing records from primary storage. [2025-10-07T19:45:19.487619] [INFO ] [MAIN ] KB: Loaded 23697 existing records. [2025-10-07T19:45:19.664067] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:45:19.664326] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-07T19:45:19.664377] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-07T19:45:19.665221] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-07T19:45:19.665283] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-07T19:45:19.856610] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-07T19:45:20.035556] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:45:20.487245] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T19:45:20.647764] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-07T19:45:21.447712] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-07T19:45:21.682306] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T19:45:22.150251] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T19:45:22.247751] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-07T19:45:22.516860] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T19:45:23.047709] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-07T19:45:23.664452] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T19:45:23.847705] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-07T19:45:23.992621] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T19:45:24.647729] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-07T19:45:25.143506] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-07T19:45:25.447742] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-07T19:45:25.576256] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T19:45:26.247738] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-07T19:45:27.047627] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-07T19:45:27.264082] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-07T19:45:27.286187] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T19:45:27.546729] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-07T19:45:27.847724] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-07T19:45:28.617831] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T19:45:28.647607] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-07T19:45:29.447745] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-07T19:45:29.477944] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T19:45:30.247687] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-07T19:45:30.709129] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T19:45:30.713181] [INFO ] [REMOTE ] KAR: Full fetch complete (56855 records). [2025-10-07T19:45:30.713331] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-07T19:45:31.052882] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-07T19:45:31.126310] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-07T19:45:31.126417] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-07T19:45:31.127283] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-07T19:45:31.127537] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-07T19:45:31.131383] [DEBUG] [LOCAL ] KAR: Trimmed 56855 records to 40083 (keeping 200 days of data) [2025-10-07T19:45:31.368601] [DEBUG] [LOCAL ] KAR: Primary data saved (40083 records). [2025-10-07T19:45:31.368790] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-07T19:45:31.368958] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAR took 28.4s. Estimated remaining: 2h 48m 42s. Rate: 7.1 symbols/min [2025-10-07T19:45:31.536274] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:45:31.565501] [DEBUG] [LOCAL ] KBDC: Loaded 21396 existing records from primary storage. [2025-10-07T19:45:31.565880] [INFO ] [MAIN ] KBDC: Loaded 21396 existing records. [2025-10-07T19:45:31.756516] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:45:31.757344] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T19:45:31.761354] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-07T19:45:31.761459] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-07T19:45:31.762028] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-07T19:45:31.761983] [INFO ] [REMOTE ] K: Full fetch complete (72142 records). [2025-10-07T19:45:31.762170] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-07T19:45:31.762258] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-07T19:45:31.862246] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-07T19:45:32.089175] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T19:45:32.516042] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:45:32.552466] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-07T19:45:32.552537] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-07T19:45:32.553458] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-07T19:45:32.553523] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-07T19:45:32.554953] [DEBUG] [LOCAL ] K: Trimmed 72142 records to 50101 (keeping 200 days of data) [2025-10-07T19:45:32.656111] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-07T19:45:32.787241] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T19:45:32.789853] [INFO ] [REMOTE ] KAI: Full fetch complete (18850 records). [2025-10-07T19:45:32.790465] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-07T19:45:33.187392] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-07T19:45:33.187498] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-07T19:45:33.188322] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-07T19:45:33.188680] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-07T19:45:33.191925] [DEBUG] [LOCAL ] KAI: Trimmed 18850 records to 13296 (keeping 200 days of data) [2025-10-07T19:45:33.349207] [DEBUG] [LOCAL ] KAI: Primary data saved (13296 records). [2025-10-07T19:45:33.349931] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-07T19:45:33.350363] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. KAI took 33.7s. Estimated remaining: 2h 48m 27s. Rate: 7.1 symbols/min [2025-10-07T19:45:33.447614] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T19:45:33.453157] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-07T19:45:33.485181] [DEBUG] [LOCAL ] K: Primary data saved (50101 records). [2025-10-07T19:45:33.519685] [INFO ] [MAIN ] K: Full history saved. [2025-10-07T19:45:33.533734] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. K took 43.6s. Estimated remaining: 2h 48m 10s. Rate: 7.1 symbols/min [2025-10-07T19:45:33.616405] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:45:33.726359] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:45:33.763059] [DEBUG] [LOCAL ] KBH: Loaded 48885 existing records from primary storage. [2025-10-07T19:45:33.763411] [INFO ] [MAIN ] KBH: Loaded 48885 existing records. [2025-10-07T19:45:33.973447] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:45:33.973801] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-07T19:45:33.973885] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-07T19:45:33.974903] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-07T19:45:33.974994] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-07T19:45:33.974836] [DEBUG] [LOCAL ] KBR: Loaded 47939 existing records from primary storage. [2025-10-07T19:45:34.053461] [INFO ] [MAIN ] KBR: Loaded 47939 existing records. [2025-10-07T19:45:34.250993] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-07T19:45:34.408084] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:45:34.444936] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-07T19:45:34.445085] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-07T19:45:34.465525] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-07T19:45:34.465589] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-07T19:45:34.651988] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:45:34.922577] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:45:34.938788] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T19:45:35.047682] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-07T19:45:35.390143] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T19:45:35.847633] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-07T19:45:36.199283] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T19:45:36.647743] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-07T19:45:37.447752] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-07T19:45:37.481746] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T19:45:37.608300] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T19:45:38.247738] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-07T19:45:38.988132] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T19:45:39.047750] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-07T19:45:39.464917] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-07T19:45:39.847682] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-07T19:45:40.647636] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-07T19:45:40.722438] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T19:45:41.447675] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-07T19:45:41.491723] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T19:45:41.895393] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T19:45:42.247753] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-07T19:45:43.047730] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-07T19:45:43.582406] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T19:45:43.847710] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-07T19:45:44.634270] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T19:45:44.647597] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-07T19:45:45.150098] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (3.70 seconds). [2025-10-07T19:45:45.447745] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-07T19:45:45.969037] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-07T19:45:46.247674] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-07T19:45:46.301883] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T19:45:47.047762] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-07T19:45:47.205989] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T19:45:47.501041] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T19:45:47.847633] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-07T19:45:48.191984] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T19:45:48.647699] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-07T19:45:49.414872] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T19:45:49.450570] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-07T19:45:49.456916] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T19:45:50.247677] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-07T19:45:50.461497] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T19:45:51.047688] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-07T19:45:51.315557] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-07T19:45:51.317841] [INFO ] [REMOTE ] KB: Full fetch complete (33903 records). [2025-10-07T19:45:51.317960] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-07T19:45:51.753238] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-07T19:45:51.753339] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-07T19:45:51.753999] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-07T19:45:51.754066] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-07T19:45:51.755012] [DEBUG] [LOCAL ] KB: Trimmed 33903 records to 23640 (keeping 200 days of data) [2025-10-07T19:45:51.847936] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-07T19:45:51.909889] [DEBUG] [LOCAL ] KB: Primary data saved (23640 records). [2025-10-07T19:45:51.910034] [INFO ] [MAIN ] KB: Full history saved. [2025-10-07T19:45:51.910122] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 32.6s. Estimated remaining: 2h 48m 11s. Rate: 7.1 symbols/min [2025-10-07T19:45:52.074863] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:45:52.124178] [DEBUG] [LOCAL ] KD: Loaded 52335 existing records from primary storage. [2025-10-07T19:45:52.124549] [INFO ] [MAIN ] KD: Loaded 52335 existing records. [2025-10-07T19:45:52.306517] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:45:52.306784] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-07T19:45:52.306837] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-07T19:45:52.307582] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-07T19:45:52.307674] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-07T19:45:52.654923] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-07T19:45:52.678461] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:45:52.723193] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T19:45:53.447667] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-07T19:45:53.669203] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T19:45:54.247687] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-07T19:45:54.320093] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-07T19:45:54.830889] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T19:45:55.047726] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-07T19:45:55.244128] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T19:45:55.847705] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-07T19:45:56.578675] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:45:56.647624] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-07T19:45:57.447749] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-07T19:45:57.524604] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T19:45:58.247789] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-07T19:45:58.343448] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T19:45:58.393998] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T19:45:59.047703] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-07T19:45:59.847746] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-07T19:46:00.099027] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T19:46:00.616877] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T19:46:00.647635] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-07T19:46:01.447628] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-07T19:46:01.741802] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T19:46:02.177185] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:46:02.247754] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-07T19:46:03.047699] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-07T19:46:03.257049] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T19:46:03.384843] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T19:46:03.387390] [INFO ] [REMOTE ] KBDC: Full fetch complete (29321 records). [2025-10-07T19:46:03.387502] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-07T19:46:03.768375] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-07T19:46:03.768462] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-07T19:46:03.769049] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-07T19:46:03.769117] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-07T19:46:03.770069] [DEBUG] [LOCAL ] KBDC: Trimmed 29321 records to 21539 (keeping 200 days of data) [2025-10-07T19:46:03.861407] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-07T19:46:03.909461] [DEBUG] [LOCAL ] KBDC: Primary data saved (21539 records). [2025-10-07T19:46:03.909603] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-07T19:46:03.909709] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 32.5s. Estimated remaining: 2h 48m 6s. Rate: 7.1 symbols/min [2025-10-07T19:46:04.077952] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:46:04.084286] [DEBUG] [LOCAL ] KEN: Loaded 4690 existing records from primary storage. [2025-10-07T19:46:04.084497] [INFO ] [MAIN ] KEN: Loaded 4690 existing records. [2025-10-07T19:46:04.268220] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:46:04.268546] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-07T19:46:04.268596] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-07T19:46:04.269145] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-07T19:46:04.269391] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-07T19:46:04.634257] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:46:04.647604] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-07T19:46:04.920261] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T19:46:05.131475] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T19:46:05.447674] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-07T19:46:05.790822] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T19:46:06.247755] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-07T19:46:07.047758] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-07T19:46:07.176189] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T19:46:07.646552] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-07T19:46:07.738773] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T19:46:07.847622] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-07T19:46:08.647746] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-07T19:46:09.401920] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T19:46:09.405268] [INFO ] [REMOTE ] KBR: Full fetch complete (69854 records). [2025-10-07T19:46:09.405407] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-07T19:46:09.459371] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-07T19:46:09.803597] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-07T19:46:09.803756] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-07T19:46:09.804684] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-07T19:46:09.804751] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-07T19:46:09.806391] [DEBUG] [LOCAL ] KBR: Trimmed 69854 records to 47906 (keeping 200 days of data) [2025-10-07T19:46:10.108841] [DEBUG] [LOCAL ] KBR: Primary data saved (47906 records). [2025-10-07T19:46:10.108983] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-07T19:46:10.109066] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBR took 36.6s. Estimated remaining: 2h 47m 56s. Rate: 7.1 symbols/min [2025-10-07T19:46:10.259898] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-07T19:46:10.286965] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:46:10.318243] [DEBUG] [LOCAL ] KEP: Loaded 31302 existing records from primary storage. [2025-10-07T19:46:10.318545] [INFO ] [MAIN ] KEP: Loaded 31302 existing records. [2025-10-07T19:46:10.512467] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:46:10.512881] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-07T19:46:10.512987] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-07T19:46:10.514162] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-07T19:46:10.514227] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-07T19:46:10.693124] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-07T19:46:10.846711] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T19:46:10.935505] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:46:11.046319] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T19:46:11.049147] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-07T19:46:11.051160] [INFO ] [REMOTE ] KBH: Full fetch complete (70789 records). [2025-10-07T19:46:11.051279] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-07T19:46:11.440018] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-07T19:46:11.440102] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-07T19:46:11.441028] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-07T19:46:11.441115] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-07T19:46:11.442521] [DEBUG] [LOCAL ] KBH: Trimmed 70789 records to 48893 (keeping 200 days of data) [2025-10-07T19:46:11.746417] [DEBUG] [LOCAL ] KBH: Primary data saved (48893 records). [2025-10-07T19:46:11.746565] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-07T19:46:11.746671] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBH took 38.4s. Estimated remaining: 2h 47m 40s. Rate: 7.1 symbols/min [2025-10-07T19:46:11.852834] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-07T19:46:11.920974] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:46:11.958705] [DEBUG] [LOCAL ] KEX: Loaded 38317 existing records from primary storage. [2025-10-07T19:46:11.959010] [INFO ] [MAIN ] KEX: Loaded 38317 existing records. [2025-10-07T19:46:12.154689] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:46:12.154990] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-07T19:46:12.155046] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-07T19:46:12.156410] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-07T19:46:12.156490] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-07T19:46:12.526433] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:46:12.647781] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-07T19:46:13.040263] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T19:46:13.325057] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T19:46:13.447626] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-07T19:46:13.786819] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T19:46:14.247630] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-07T19:46:14.524042] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T19:46:14.808522] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-07T19:46:15.047716] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-07T19:46:15.795679] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-07T19:46:15.847631] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-07T19:46:16.510701] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-07T19:46:16.647676] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-07T19:46:17.447761] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-07T19:46:17.988833] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T19:46:18.247703] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-07T19:46:18.452079] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T19:46:19.047750] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-07T19:46:19.847747] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-07T19:46:20.012270] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T19:46:20.456053] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T19:46:20.477736] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T19:46:20.647723] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-07T19:46:21.447611] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-07T19:46:21.677713] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-07T19:46:22.247727] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-07T19:46:22.869930] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T19:46:22.919284] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T19:46:23.047625] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-07T19:46:23.847770] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-07T19:46:24.647687] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-07T19:46:24.827950] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T19:46:24.856976] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T19:46:25.447732] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-07T19:46:26.041093] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T19:46:26.247690] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-07T19:46:26.756699] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T19:46:27.047727] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-07T19:46:27.743211] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T19:46:27.847638] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-07T19:46:28.638867] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T19:46:28.649279] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-07T19:46:29.326728] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T19:46:29.447603] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-07T19:46:30.181168] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T19:46:30.247609] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-07T19:46:30.441717] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T19:46:31.047731] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-07T19:46:31.628973] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T19:46:31.763346] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T19:46:31.847627] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-07T19:46:32.647678] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-07T19:46:33.201067] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T19:46:33.230825] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T19:46:33.447735] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-07T19:46:34.247770] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-07T19:46:34.795013] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T19:46:34.795804] [INFO ] [REMOTE ] KEN: Full fetch complete (5936 records). [2025-10-07T19:46:34.795874] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-07T19:46:34.962187] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T19:46:35.059543] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-07T19:46:35.204697] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-07T19:46:35.204838] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-07T19:46:35.205097] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-07T19:46:35.205180] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-07T19:46:35.205763] [DEBUG] [LOCAL ] KEN: Trimmed 5936 records to 4674 (keeping 200 days of data) [2025-10-07T19:46:35.239784] [DEBUG] [LOCAL ] KEN: Primary data saved (4674 records). [2025-10-07T19:46:35.239898] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-07T19:46:35.239991] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KEN took 31.3s. Estimated remaining: 2h 47m 47s. Rate: 7.1 symbols/min [2025-10-07T19:46:35.442862] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:46:35.443086] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-07T19:46:35.443157] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-07T19:46:35.443313] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-07T19:46:35.443371] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-07T19:46:35.443447] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-07T19:46:35.443493] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-07T19:46:35.861009] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-07T19:46:35.869384] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:46:36.488360] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T19:46:36.647682] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-07T19:46:37.408025] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T19:46:37.447621] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-07T19:46:38.247628] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-07T19:46:38.362316] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T19:46:38.718103] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T19:46:38.720843] [INFO ] [REMOTE ] KEP: Full fetch complete (41889 records). [2025-10-07T19:46:38.720951] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-07T19:46:39.052840] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-07T19:46:39.163427] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-07T19:46:39.163511] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-07T19:46:39.164264] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-07T19:46:39.164334] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-07T19:46:39.165389] [DEBUG] [LOCAL ] KEP: Trimmed 41889 records to 31291 (keeping 200 days of data) [2025-10-07T19:46:39.356416] [DEBUG] [LOCAL ] KEP: Primary data saved (31291 records). [2025-10-07T19:46:39.356572] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-07T19:46:39.356685] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KEP took 29.2s. Estimated remaining: 2h 47m 34s. Rate: 7.1 symbols/min [2025-10-07T19:46:39.539566] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:46:39.587246] [DEBUG] [LOCAL ] KEYS: Loaded 43173 existing records from primary storage. [2025-10-07T19:46:39.587613] [INFO ] [MAIN ] KEYS: Loaded 43173 existing records. [2025-10-07T19:46:39.779555] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:46:39.780037] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-07T19:46:39.780162] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-07T19:46:39.781590] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-07T19:46:39.781691] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-07T19:46:39.850178] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-07T19:46:39.996451] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T19:46:40.204752] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:46:40.647638] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-07T19:46:40.970574] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T19:46:41.447628] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-07T19:46:41.542410] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T19:46:42.247626] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-07T19:46:42.292794] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T19:46:42.634688] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T19:46:42.637697] [INFO ] [REMOTE ] KEX: Full fetch complete (55867 records). [2025-10-07T19:46:42.637797] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-07T19:46:43.006075] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-07T19:46:43.006165] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-07T19:46:43.006983] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-07T19:46:43.007049] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-07T19:46:43.008408] [DEBUG] [LOCAL ] KEX: Trimmed 55867 records to 38453 (keeping 200 days of data) [2025-10-07T19:46:43.059558] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-07T19:46:43.244594] [DEBUG] [LOCAL ] KEX: Primary data saved (38453 records). [2025-10-07T19:46:43.244783] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-07T19:46:43.244876] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEX took 31.5s. Estimated remaining: 2h 47m 21s. Rate: 7.1 symbols/min [2025-10-07T19:46:43.413886] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:46:43.418412] [DEBUG] [LOCAL ] KF: Loaded 2381 existing records from primary storage. [2025-10-07T19:46:43.418596] [INFO ] [MAIN ] KF: Loaded 2381 existing records. [2025-10-07T19:46:43.594274] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:46:43.594716] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-07T19:46:43.594854] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-07T19:46:43.595154] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-07T19:46:43.595214] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-07T19:46:43.779966] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T19:46:43.850568] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-07T19:46:43.861493] [INFO ] [REMOTE ] KD: Full fetch complete (75700 records). [2025-10-07T19:46:43.888757] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-07T19:46:44.067245] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:46:44.475415] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-07T19:46:44.475533] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-07T19:46:44.476788] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-07T19:46:44.476958] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-07T19:46:44.502554] [DEBUG] [LOCAL ] KD: Trimmed 75700 records to 52329 (keeping 200 days of data) [2025-10-07T19:46:44.504022] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T19:46:44.684223] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-07T19:46:44.824840] [DEBUG] [LOCAL ] KD: Primary data saved (52329 records). [2025-10-07T19:46:44.824994] [INFO ] [MAIN ] KD: Full history saved. [2025-10-07T19:46:44.825083] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KD took 52.9s. Estimated remaining: 2h 47m 6s. Rate: 7.1 symbols/min [2025-10-07T19:46:44.989241] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:46:45.008430] [DEBUG] [LOCAL ] KFRC: Loaded 19767 existing records from primary storage. [2025-10-07T19:46:45.008722] [INFO ] [MAIN ] KFRC: Loaded 19767 existing records. [2025-10-07T19:46:45.189080] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:46:45.189322] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-07T19:46:45.189376] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-07T19:46:45.190259] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-07T19:46:45.190338] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-07T19:46:45.451605] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-07T19:46:45.571550] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:46:45.600861] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T19:46:45.874784] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-07T19:46:46.247638] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-07T19:46:46.301857] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:46:47.047635] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-07T19:46:47.213626] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T19:46:47.602707] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T19:46:47.847689] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-07T19:46:48.647696] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-07T19:46:48.741962] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T19:46:49.083907] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-07T19:46:49.447683] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-07T19:46:50.247686] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-07T19:46:50.917531] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T19:46:51.047620] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-07T19:46:51.847766] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-07T19:46:52.067845] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T19:46:52.647618] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-07T19:46:52.764257] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T19:46:52.763948] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T19:46:53.447690] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-07T19:46:54.247729] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-07T19:46:54.509538] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T19:46:55.047681] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-07T19:46:55.136997] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T19:46:55.225052] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T19:46:55.847676] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-07T19:46:56.647771] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-07T19:46:56.956860] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-07T19:46:57.282681] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-07T19:46:57.310219] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T19:46:57.447632] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-07T19:46:57.956932] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-07T19:46:58.247680] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-07T19:46:59.047769] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-07T19:46:59.616067] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T19:46:59.847705] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-07T19:46:59.976350] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T19:47:00.647631] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-07T19:47:01.022695] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T19:47:01.447717] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-07T19:47:01.988336] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T19:47:02.050930] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-07T19:47:02.247783] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-07T19:47:03.047719] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-07T19:47:03.847705] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-07T19:47:04.081295] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-07T19:47:04.129582] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T19:47:04.294410] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T19:47:04.647708] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-07T19:47:05.447761] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-07T19:47:06.259283] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-07T19:47:06.264984] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T19:47:06.740509] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-07T19:47:07.047749] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-07T19:47:07.129162] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T19:47:07.847624] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-07T19:47:07.996575] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T19:47:08.647681] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-07T19:47:09.209341] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T19:47:09.447730] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-07T19:47:09.702128] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T19:47:10.247747] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-07T19:47:10.807070] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T19:47:11.046871] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T19:47:11.055945] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-07T19:47:11.847727] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-07T19:47:12.300872] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T19:47:12.540752] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T19:47:12.543944] [INFO ] [REMOTE ] KEYS: Full fetch complete (62721 records). [2025-10-07T19:47:12.544093] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-07T19:47:12.652728] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-07T19:47:12.945421] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-07T19:47:12.945606] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-07T19:47:12.946541] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-07T19:47:12.946600] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-07T19:47:12.948237] [DEBUG] [LOCAL ] KEYS: Trimmed 62721 records to 43149 (keeping 200 days of data) [2025-10-07T19:47:13.214314] [DEBUG] [LOCAL ] KEYS: Primary data saved (43149 records). [2025-10-07T19:47:13.214477] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-07T19:47:13.214570] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEYS took 33.9s. Estimated remaining: 2h 47m 17s. Rate: 7.1 symbols/min [2025-10-07T19:47:13.388957] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:47:13.398162] [DEBUG] [LOCAL ] KFS: Loaded 8470 existing records from primary storage. [2025-10-07T19:47:13.398331] [INFO ] [MAIN ] KFS: Loaded 8470 existing records. [2025-10-07T19:47:13.459670] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-07T19:47:13.587274] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:47:13.587692] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-07T19:47:13.587753] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-07T19:47:13.588478] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-07T19:47:13.588540] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-07T19:47:13.962083] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T19:47:13.968711] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:47:13.987757] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T19:47:13.988560] [INFO ] [REMOTE ] KF: Full fetch complete (3583 records). [2025-10-07T19:47:13.988627] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-07T19:47:14.256677] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-07T19:47:14.341737] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-07T19:47:14.341822] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-07T19:47:14.341960] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-07T19:47:14.342001] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-07T19:47:14.342350] [DEBUG] [LOCAL ] KF: Trimmed 3583 records to 2377 (keeping 200 days of data) [2025-10-07T19:47:14.356738] [DEBUG] [LOCAL ] KF: Primary data saved (2377 records). [2025-10-07T19:47:14.356798] [INFO ] [MAIN ] KF: Full history saved. [2025-10-07T19:47:14.356865] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 31.1s. Estimated remaining: 2h 47m 2s. Rate: 7.1 symbols/min [2025-10-07T19:47:14.527113] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:47:14.556117] [DEBUG] [LOCAL ] KFY: Loaded 30008 existing records from primary storage. [2025-10-07T19:47:14.556399] [INFO ] [MAIN ] KFY: Loaded 30008 existing records. [2025-10-07T19:47:14.729665] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:47:14.729934] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-07T19:47:14.729990] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-07T19:47:14.731224] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-07T19:47:14.731288] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-07T19:47:15.052398] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-07T19:47:15.083565] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:47:15.389870] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T19:47:15.393762] [INFO ] [REMOTE ] KFRC: Full fetch complete (25963 records). [2025-10-07T19:47:15.393854] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-07T19:47:15.758187] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-07T19:47:15.758287] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-07T19:47:15.758848] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-07T19:47:15.758911] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-07T19:47:15.760121] [DEBUG] [LOCAL ] KFRC: Trimmed 25963 records to 19897 (keeping 200 days of data) [2025-10-07T19:47:15.849880] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-07T19:47:15.887295] [DEBUG] [LOCAL ] KFRC: Primary data saved (19897 records). [2025-10-07T19:47:15.887433] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-07T19:47:15.887516] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KFRC took 31.1s. Estimated remaining: 2h 46m 46s. Rate: 7.1 symbols/min [2025-10-07T19:47:16.052122] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:47:16.102288] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-07T19:47:16.102620] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-07T19:47:16.281777] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:47:16.282026] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-07T19:47:16.282074] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-07T19:47:16.283740] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-07T19:47:16.283799] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-07T19:47:16.633213] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:47:16.647681] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-07T19:47:16.782857] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T19:47:16.795757] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-07T19:47:16.795976] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-07T19:47:16.995854] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T19:47:16.996819] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:47:16.996897] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:47:16.996973] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-07T19:47:16.997052] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-07T19:47:16.997093] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-07T19:47:16.997162] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-07T19:47:16.997261] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEY took 41.8s. Estimated remaining: 2h 46m 30s. Rate: 7.1 symbols/min [2025-10-07T19:47:17.173058] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:47:17.223493] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T19:47:17.245631] [DEBUG] [LOCAL ] KGS: Loaded 45788 existing records from primary storage. [2025-10-07T19:47:17.246025] [INFO ] [MAIN ] KGS: Loaded 45788 existing records. [2025-10-07T19:47:17.432292] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:47:17.432709] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-07T19:47:17.432770] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-07T19:47:17.434101] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-07T19:47:17.434163] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-07T19:47:17.455238] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-07T19:47:17.801004] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:47:18.247721] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-07T19:47:18.412307] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T19:47:18.765331] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T19:47:18.837543] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-07T19:47:19.047626] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-07T19:47:19.847753] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-07T19:47:20.528893] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T19:47:20.647630] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-07T19:47:20.814918] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T19:47:21.447618] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-07T19:47:21.816156] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T19:47:22.186485] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-07T19:47:22.247733] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-07T19:47:23.047697] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-07T19:47:23.778127] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T19:47:23.847628] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-07T19:47:24.476708] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T19:47:24.647684] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-07T19:47:25.300840] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T19:47:25.447709] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-07T19:47:25.701548] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T19:47:26.174885] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T19:47:26.247679] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-07T19:47:26.973695] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T19:47:27.047802] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-07T19:47:27.847763] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-07T19:47:27.916111] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T19:47:28.647743] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-07T19:47:29.436004] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T19:47:29.447590] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-07T19:47:30.247633] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-07T19:47:30.355636] [DEBUG] [REMOTE ] KFY: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-07T19:47:30.356041] [WARN ] [REMOTE ] KFY: No data returned for month 2025-04 [2025-10-07T19:47:30.356132] [FATAL] [REMOTE ] KFY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:47:30.356216] [FATAL] [MAIN ] KFY: Failed to fetch primary data. [2025-10-07T19:47:30.356282] [WARN ] [MAIN ] KFY: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:47:30.356353] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-07T19:47:30.356429] [DEBUG] [LOCAL ] KFY: No primary data file found to delete. [2025-10-07T19:47:30.356464] [INFO ] [LOCAL ] KFY: Starting deletion of derivative data. [2025-10-07T19:47:30.356845] [DEBUG] [LOCAL ] KFY: Deleted derivative data file. [2025-10-07T19:47:30.356935] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFY took 16.0s. Estimated remaining: 2h 46m 27s. Rate: 7.1 symbols/min [2025-10-07T19:47:30.540720] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:47:30.577370] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-07T19:47:30.632715] [DEBUG] [LOCAL ] KIM: Loaded 53032 existing records from primary storage. [2025-10-07T19:47:30.633102] [INFO ] [MAIN ] KIM: Loaded 53032 existing records. [2025-10-07T19:47:30.823432] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:47:30.823865] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-07T19:47:30.823926] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-07T19:47:30.825328] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-07T19:47:30.825388] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-07T19:47:31.049054] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-07T19:47:31.144084] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T19:47:31.226139] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:47:31.847693] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-07T19:47:32.647744] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-07T19:47:33.286055] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-07T19:47:33.414347] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T19:47:33.447603] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-07T19:47:34.247734] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-07T19:47:34.334103] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T19:47:35.050377] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-07T19:47:35.063606] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T19:47:35.847739] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-07T19:47:35.897237] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T19:47:36.456440] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-07T19:47:36.647702] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-07T19:47:37.313555] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T19:47:37.447625] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-07T19:47:37.626258] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T19:47:38.247667] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-07T19:47:38.732001] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T19:47:39.017486] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T19:47:39.047709] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-07T19:47:39.730173] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T19:47:39.731475] [INFO ] [REMOTE ] KFS: Full fetch complete (10683 records). [2025-10-07T19:47:39.731550] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-07T19:47:39.852750] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-07T19:47:40.110239] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-07T19:47:40.110358] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-07T19:47:40.110638] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-07T19:47:40.110719] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-07T19:47:40.111167] [DEBUG] [LOCAL ] KFS: Trimmed 10683 records to 8525 (keeping 200 days of data) [2025-10-07T19:47:40.161744] [DEBUG] [LOCAL ] KFS: Primary data saved (8525 records). [2025-10-07T19:47:40.161889] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-07T19:47:40.162004] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFS took 26.9s. Estimated remaining: 2h 46m 20s. Rate: 7.1 symbols/min [2025-10-07T19:47:40.328259] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:47:40.348928] [DEBUG] [LOCAL ] KIO: Loaded 21360 existing records from primary storage. [2025-10-07T19:47:40.349186] [INFO ] [MAIN ] KIO: Loaded 21360 existing records. [2025-10-07T19:47:40.522388] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:47:40.522633] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-07T19:47:40.522739] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-07T19:47:40.523466] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-07T19:47:40.523525] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-07T19:47:40.660118] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-07T19:47:40.883886] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:47:41.447727] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-07T19:47:41.600724] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T19:47:42.074755] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T19:47:42.247734] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-07T19:47:43.047723] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-07T19:47:43.556327] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-07T19:47:43.847774] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-07T19:47:43.905019] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T19:47:44.648343] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-07T19:47:44.652031] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T19:47:45.447687] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-07T19:47:45.615633] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T19:47:45.929509] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T19:47:46.247709] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-07T19:47:47.047714] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-07T19:47:47.299241] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T19:47:47.847752] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-07T19:47:48.447627] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-07T19:47:48.647704] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-07T19:47:48.740202] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T19:47:49.447628] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-07T19:47:49.573597] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T19:47:50.247732] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-07T19:47:50.892965] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-07T19:47:50.909804] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T19:47:50.914823] [INFO ] [REMOTE ] KGS: Full fetch complete (66374 records). [2025-10-07T19:47:50.914967] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-07T19:47:51.052803] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-07T19:47:51.343848] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-07T19:47:51.343984] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-07T19:47:51.345096] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-07T19:47:51.345165] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-07T19:47:51.349613] [DEBUG] [LOCAL ] KGS: Trimmed 66374 records to 45896 (keeping 200 days of data) [2025-10-07T19:47:51.652769] [DEBUG] [LOCAL ] KGS: Primary data saved (45896 records). [2025-10-07T19:47:51.653019] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-07T19:47:51.653117] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGS took 34.7s. Estimated remaining: 2h 46m 14s. Rate: 7.1 symbols/min [2025-10-07T19:47:51.839140] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T19:47:51.849689] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-07T19:47:51.921914] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:47:51.976094] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-10-07T19:47:51.976448] [INFO ] [MAIN ] KKR: Loaded 53502 existing records. [2025-10-07T19:47:52.157231] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:47:52.157488] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-07T19:47:52.157537] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-07T19:47:52.159188] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-07T19:47:52.159248] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-07T19:47:52.524047] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:47:52.647745] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-07T19:47:52.976528] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T19:47:53.051090] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-07T19:47:53.055615] [INFO ] [REMOTE ] KGC: Full fetch complete (77700 records). [2025-10-07T19:47:53.055852] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-07T19:47:53.451680] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-07T19:47:53.494614] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-07T19:47:53.494744] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-07T19:47:53.496073] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-07T19:47:53.496249] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-07T19:47:53.498683] [DEBUG] [LOCAL ] KGC: Trimmed 77700 records to 53699 (keeping 200 days of data) [2025-10-07T19:47:53.858918] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-07T19:47:53.859118] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-07T19:47:53.859272] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 38.0s. Estimated remaining: 2h 45m 60s. Rate: 7.1 symbols/min [2025-10-07T19:47:54.042021] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:47:54.051169] [DEBUG] [LOCAL ] KKRS: Loaded 5713 existing records from primary storage. [2025-10-07T19:47:54.051457] [INFO ] [MAIN ] KKRS: Loaded 5713 existing records. [2025-10-07T19:47:54.235487] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:47:54.235829] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-07T19:47:54.235900] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-07T19:47:54.236301] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-07T19:47:54.236390] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-07T19:47:54.272188] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-07T19:47:54.646758] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:47:54.744272] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-07T19:47:55.047636] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-07T19:47:55.242388] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T19:47:55.425967] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T19:47:55.847670] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-07T19:47:55.947584] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-07T19:47:56.647750] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-07T19:47:57.447710] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-07T19:47:57.666081] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T19:47:57.749443] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-07T19:47:58.017529] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T19:47:58.247761] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-07T19:47:59.047743] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-07T19:47:59.674279] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T19:47:59.847683] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-07T19:48:00.074826] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T19:48:00.647732] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-07T19:48:00.743972] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T19:48:01.447746] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-07T19:48:01.713114] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T19:48:02.247742] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-07T19:48:02.988534] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-07T19:48:03.047697] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-07T19:48:03.165988] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T19:48:03.768901] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T19:48:03.847698] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-07T19:48:04.488016] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T19:48:04.647752] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-07T19:48:05.447756] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-07T19:48:06.247709] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-07T19:48:06.279047] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T19:48:06.283127] [INFO ] [REMOTE ] KIM: Full fetch complete (76836 records). [2025-10-07T19:48:06.283305] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-07T19:48:06.683477] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-07T19:48:06.683604] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-07T19:48:06.685091] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-07T19:48:06.685166] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-07T19:48:06.687348] [DEBUG] [LOCAL ] KIM: Trimmed 76836 records to 53026 (keeping 200 days of data) [2025-10-07T19:48:07.047803] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-07T19:48:07.065844] [DEBUG] [LOCAL ] KIM: Primary data saved (53026 records). [2025-10-07T19:48:07.066034] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-07T19:48:07.066163] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIM took 36.7s. Estimated remaining: 2h 45m 56s. Rate: 7.1 symbols/min [2025-10-07T19:48:07.248285] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:48:07.248555] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-07T19:48:07.248614] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-07T19:48:07.248770] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-07T19:48:07.248821] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-07T19:48:07.248865] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-07T19:48:07.248938] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-07T19:48:07.435503] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T19:48:07.719409] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:48:07.729976] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-07T19:48:07.733300] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-07T19:48:07.847732] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-07T19:48:08.449922] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T19:48:08.647770] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-07T19:48:09.211391] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T19:48:09.447742] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-07T19:48:09.638867] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:48:09.639323] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-07T19:48:09.639434] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:48:09.639486] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-07T19:48:09.639546] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:48:09.639624] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-07T19:48:09.639736] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-07T19:48:09.639784] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-07T19:48:09.639855] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-07T19:48:09.639935] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KKRT took 2.6s. Estimated remaining: 2h 45m 42s. Rate: 7.1 symbols/min [2025-10-07T19:48:09.898115] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:48:09.898434] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-07T19:48:09.898493] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-07T19:48:09.898619] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-07T19:48:09.898697] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-07T19:48:09.898757] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-07T19:48:09.898793] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-07T19:48:10.252393] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-07T19:48:10.283763] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:48:10.834202] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T19:48:10.835302] [INFO ] [REMOTE ] KKRS: Full fetch complete (7770 records). [2025-10-07T19:48:10.835419] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-07T19:48:11.055269] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-07T19:48:11.230676] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-07T19:48:11.230808] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-07T19:48:11.231180] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-07T19:48:11.231238] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-07T19:48:11.231979] [DEBUG] [LOCAL ] KKRS: Trimmed 7770 records to 5718 (keeping 200 days of data) [2025-10-07T19:48:11.272254] [DEBUG] [LOCAL ] KKRS: Primary data saved (5718 records). [2025-10-07T19:48:11.272461] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-07T19:48:11.272574] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKRS took 17.4s. Estimated remaining: 2h 45m 27s. Rate: 7.1 symbols/min [2025-10-07T19:48:11.455110] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:48:11.495528] [DEBUG] [LOCAL ] KLC: Loaded 36821 existing records from primary storage. [2025-10-07T19:48:11.496007] [INFO ] [MAIN ] KLC: Loaded 36821 existing records. [2025-10-07T19:48:11.699963] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:48:11.700665] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-07T19:48:11.700735] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-07T19:48:11.701120] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-07T19:48:11.701190] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-07T19:48:11.856613] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-07T19:48:12.108477] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:48:12.647763] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-07T19:48:12.846712] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:48:12.847187] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-07T19:48:12.847288] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:48:12.847481] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-07T19:48:12.847550] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:48:12.847625] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-07T19:48:12.847750] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-07T19:48:12.847799] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-07T19:48:12.847859] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-07T19:48:12.847976] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KLAR took 3.2s. Estimated remaining: 2h 45m 11s. Rate: 7.1 symbols/min [2025-10-07T19:48:12.985440] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T19:48:13.055263] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:48:13.093625] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-07T19:48:13.149813] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-07T19:48:13.150250] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-07T19:48:13.328028] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:48:13.328235] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-07T19:48:13.328282] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-07T19:48:13.328521] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-07T19:48:13.328578] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-07T19:48:13.452878] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-07T19:48:13.716422] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:48:14.247716] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-07T19:48:14.973221] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T19:48:15.047742] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-07T19:48:15.847637] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-07T19:48:16.182027] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T19:48:16.336063] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T19:48:16.647764] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-07T19:48:16.792829] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T19:48:17.447757] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-07T19:48:18.247757] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-07T19:48:18.985341] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-07T19:48:19.047714] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-07T19:48:19.108840] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T19:48:19.446787] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T19:48:19.847680] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-07T19:48:20.647693] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-07T19:48:21.149524] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-07T19:48:21.256878] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T19:48:21.447672] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-07T19:48:21.761352] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T19:48:22.247741] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-07T19:48:23.047746] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-07T19:48:23.427184] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T19:48:23.847676] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-07T19:48:24.133981] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T19:48:24.167109] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T19:48:24.647738] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-07T19:48:25.326298] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:48:25.447728] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-07T19:48:26.247692] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-07T19:48:26.595390] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T19:48:26.953362] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T19:48:26.955556] [INFO ] [REMOTE ] KIO: Full fetch complete (31448 records). [2025-10-07T19:48:26.955664] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-07T19:48:27.048590] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-07T19:48:27.356054] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-07T19:48:27.356269] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-07T19:48:27.357069] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-07T19:48:27.357204] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-07T19:48:27.358638] [DEBUG] [LOCAL ] KIO: Trimmed 31448 records to 21383 (keeping 200 days of data) [2025-10-07T19:48:27.539605] [DEBUG] [LOCAL ] KIO: Primary data saved (21383 records). [2025-10-07T19:48:27.540111] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-07T19:48:27.540453] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KIO took 47.4s. Estimated remaining: 2h 45m 9s. Rate: 7.1 symbols/min [2025-10-07T19:48:27.543090] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-07T19:48:27.847730] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-07T19:48:28.521381] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T19:48:28.647700] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-07T19:48:29.447703] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-07T19:48:29.831766] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T19:48:29.863982] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T19:48:30.247726] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-07T19:48:30.984407] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T19:48:31.047711] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-07T19:48:31.555693] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T19:48:31.847697] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-07T19:48:32.647750] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-07T19:48:32.955159] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T19:48:33.213056] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T19:48:33.447667] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-07T19:48:34.247631] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-07T19:48:34.501696] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T19:48:34.854606] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T19:48:35.047619] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-07T19:48:35.847625] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-07T19:48:36.105279] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T19:48:36.435862] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T19:48:36.439173] [INFO ] [REMOTE ] KLC: Full fetch complete (50694 records). [2025-10-07T19:48:36.439312] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-07T19:48:36.652905] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-07T19:48:36.862360] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-07T19:48:36.862473] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-07T19:48:36.863767] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-07T19:48:36.863844] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-07T19:48:36.865497] [DEBUG] [LOCAL ] KLC: Trimmed 50694 records to 36880 (keeping 200 days of data) [2025-10-07T19:48:37.112456] [DEBUG] [LOCAL ] KLC: Primary data saved (36880 records). [2025-10-07T19:48:37.112700] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-07T19:48:37.112827] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KLC took 25.8s. Estimated remaining: 2h 45m 2s. Rate: 7.1 symbols/min [2025-10-07T19:48:37.563403] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T19:48:37.575942] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-07T19:48:38.429812] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T19:48:38.441776] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-07T19:48:39.189786] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T19:48:39.201714] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-07T19:48:40.203485] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-07T19:48:40.207757] [INFO ] [REMOTE ] KKR: Full fetch complete (77452 records). [2025-10-07T19:48:40.207933] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-07T19:48:40.621345] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-07T19:48:40.621435] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-07T19:48:40.622459] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-07T19:48:40.622573] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-07T19:48:40.624283] [DEBUG] [LOCAL ] KKR: Trimmed 77452 records to 53502 (keeping 200 days of data) [2025-10-07T19:48:40.974599] [DEBUG] [LOCAL ] KKR: Primary data saved (53502 records). [2025-10-07T19:48:40.974770] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-07T19:48:40.974861] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KKR took 49.3s. Estimated remaining: 2h 44m 49s. Rate: 7.1 symbols/min [2025-10-07T19:48:41.151708] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T19:48:41.163169] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-07T19:48:42.893748] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T19:48:42.897429] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-07T19:48:42.897559] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-07T19:48:43.296275] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-07T19:48:43.296358] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-07T19:48:43.297368] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-07T19:48:43.297437] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-07T19:48:43.298982] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-10-07T19:48:43.640669] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-07T19:48:43.640820] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-07T19:48:43.640908] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KMI took 30.8s. Estimated remaining: 2h 44m 35s. Rate: 7.1 symbols/min [2025-10-07T19:48:44.366495] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:48:44.305760] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:48:44.400751] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:48:44.404428] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:48:44.417454] [DEBUG] [LOCAL ] KMPB: Loaded 3809 existing records from primary storage. [2025-10-07T19:48:44.417895] [INFO ] [MAIN ] KMPB: Loaded 3809 existing records. [2025-10-07T19:48:44.643600] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:48:44.658569] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-07T19:48:44.669777] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-07T19:48:44.672589] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-07T19:48:44.672473] [DEBUG] [LOCAL ] KMX: Loaded 53182 existing records from primary storage. [2025-10-07T19:48:44.686218] [INFO ] [MAIN ] KMX: Loaded 53182 existing records. [2025-10-07T19:48:44.685761] [DEBUG] [LOCAL ] KMPR: Loaded 39148 existing records from primary storage. [2025-10-07T19:48:44.686056] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-07T19:48:44.687150] [INFO ] [MAIN ] KMPR: Loaded 39148 existing records. [2025-10-07T19:48:44.687005] [DEBUG] [LOCAL ] KMT: Loaded 43054 existing records from primary storage. [2025-10-07T19:48:44.752818] [INFO ] [MAIN ] KMT: Loaded 43054 existing records. [2025-10-07T19:48:45.353925] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:48:45.408526] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:48:45.427402] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-07T19:48:45.444715] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-07T19:48:45.453419] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-07T19:48:45.462365] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-07T19:48:45.481139] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-07T19:48:45.486448] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-07T19:48:45.502951] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-07T19:48:45.519704] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-07T19:48:45.514246] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:48:45.631326] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-07T19:48:45.666560] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-07T19:48:45.707260] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-07T19:48:45.748502] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-07T19:48:45.955320] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:48:46.003253] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-07T19:48:46.657708] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:48:46.693879] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:48:46.719957] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-07T19:48:46.724571] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-07T19:48:46.824538] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:48:46.826494] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-07T19:48:46.827945] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-07T19:48:46.829999] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-07T19:48:47.260271] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T19:48:47.261692] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-07T19:48:47.694864] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-07T19:48:47.696977] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-07T19:48:48.180759] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T19:48:48.186812] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-07T19:48:48.244840] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T19:48:48.246943] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-07T19:48:48.341430] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T19:48:48.350467] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-07T19:48:48.490476] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T19:48:48.647628] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-07T19:48:48.719402] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-07T19:48:49.448150] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-07T19:48:49.450716] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T19:48:49.777395] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T19:48:49.913241] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T19:48:49.953076] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T19:48:50.247713] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-07T19:48:51.047717] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-07T19:48:51.367353] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T19:48:51.847767] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-07T19:48:52.535360] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T19:48:52.592549] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T19:48:52.647709] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-07T19:48:53.447712] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-07T19:48:54.185012] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T19:48:54.247756] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-07T19:48:54.878097] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T19:48:55.047768] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-07T19:48:55.806467] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T19:48:55.847658] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-07T19:48:56.647707] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-07T19:48:56.882386] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T19:48:56.959254] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T19:48:57.447728] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-07T19:48:58.230591] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T19:48:58.247595] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-07T19:48:59.047731] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-07T19:48:59.330027] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T19:48:59.822677] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T19:48:59.847624] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-07T19:49:00.454902] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T19:49:00.647762] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-07T19:49:01.144783] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-07T19:49:01.279363] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T19:49:01.447762] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-07T19:49:02.247741] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-07T19:49:03.047686] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-07T19:49:03.318672] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T19:49:03.620085] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T19:49:03.716231] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T19:49:03.847764] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-07T19:49:04.442876] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-07T19:49:04.647713] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-07T19:49:05.447748] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-07T19:49:06.090901] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T19:49:06.247790] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-07T19:49:06.907963] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T19:49:06.908982] [INFO ] [REMOTE ] KMPB: Full fetch complete (5140 records). [2025-10-07T19:49:06.909059] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-07T19:49:07.051714] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-07T19:49:07.324822] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-07T19:49:07.325000] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-07T19:49:07.325336] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-07T19:49:07.325420] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-07T19:49:07.326153] [DEBUG] [LOCAL ] KMPB: Trimmed 5140 records to 3812 (keeping 200 days of data) [2025-10-07T19:49:07.436854] [DEBUG] [LOCAL ] KMPB: Primary data saved (3812 records). [2025-10-07T19:49:07.437677] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-07T19:49:07.440407] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 23.8s. Estimated remaining: 2h 44m 41s. Rate: 7.1 symbols/min [2025-10-07T19:49:07.440177] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T19:49:07.640617] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:49:07.688484] [DEBUG] [LOCAL ] KN: Loaded 38615 existing records from primary storage. [2025-10-07T19:49:07.688929] [INFO ] [MAIN ] KN: Loaded 38615 existing records. [2025-10-07T19:49:07.852270] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-07T19:49:07.872229] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:49:07.873283] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-07T19:49:07.873344] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-07T19:49:07.873608] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-07T19:49:07.873694] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-07T19:49:08.228025] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:49:08.647756] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-07T19:49:08.705836] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T19:49:09.447700] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-07T19:49:09.551229] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T19:49:10.222611] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T19:49:10.247631] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-07T19:49:10.669581] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T19:49:11.047757] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-07T19:49:11.847610] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-07T19:49:12.111148] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T19:49:12.493925] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T19:49:12.647702] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-07T19:49:13.262040] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T19:49:13.265514] [INFO ] [REMOTE ] KMPR: Full fetch complete (51918 records). [2025-10-07T19:49:13.265725] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-07T19:49:13.452933] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-07T19:49:13.682217] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-07T19:49:13.682363] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-07T19:49:13.683513] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-07T19:49:13.683580] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-07T19:49:13.685083] [DEBUG] [LOCAL ] KMPR: Trimmed 51918 records to 39271 (keeping 200 days of data) [2025-10-07T19:49:13.956702] [DEBUG] [LOCAL ] KMPR: Primary data saved (39271 records). [2025-10-07T19:49:13.956911] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-07T19:49:13.957019] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMPR took 30.3s. Estimated remaining: 2h 44m 31s. Rate: 7.1 symbols/min [2025-10-07T19:49:14.174884] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:49:14.221427] [DEBUG] [LOCAL ] KNF: Loaded 36090 existing records from primary storage. [2025-10-07T19:49:14.222094] [INFO ] [MAIN ] KNF: Loaded 36090 existing records. [2025-10-07T19:49:14.259236] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-07T19:49:14.428766] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:49:14.429184] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-07T19:49:14.429266] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-07T19:49:14.430027] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-07T19:49:14.430099] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-07T19:49:14.808755] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:49:14.849877] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-07T19:49:15.047634] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-07T19:49:15.092141] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T19:49:15.748339] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T19:49:15.847727] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-07T19:49:15.962097] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-07T19:49:16.647761] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-07T19:49:17.383584] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T19:49:17.447751] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-07T19:49:18.081432] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T19:49:18.247751] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-07T19:49:18.767185] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T19:49:18.770182] [INFO ] [REMOTE ] KMT: Full fetch complete (62078 records). [2025-10-07T19:49:18.770290] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-07T19:49:19.052900] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-07T19:49:19.159247] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-07T19:49:19.159378] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-07T19:49:19.160582] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-07T19:49:19.160709] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-07T19:49:19.162717] [DEBUG] [LOCAL ] KMT: Trimmed 62078 records to 43017 (keeping 200 days of data) [2025-10-07T19:49:19.459260] [DEBUG] [LOCAL ] KMT: Primary data saved (43017 records). [2025-10-07T19:49:19.459452] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-07T19:49:19.460902] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 35.8s. Estimated remaining: 2h 44m 20s. Rate: 7.1 symbols/min [2025-10-07T19:49:19.635412] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:49:19.650737] [DEBUG] [LOCAL ] KNOP: Loaded 10558 existing records from primary storage. [2025-10-07T19:49:19.651054] [INFO ] [MAIN ] KNOP: Loaded 10558 existing records. [2025-10-07T19:49:19.841479] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:49:19.841781] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-07T19:49:19.841838] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-07T19:49:19.842070] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-07T19:49:19.842128] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-07T19:49:19.874092] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-07T19:49:20.221066] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-07T19:49:20.255627] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:49:20.262155] [INFO ] [REMOTE ] KMX: Full fetch complete (76099 records). [2025-10-07T19:49:20.262421] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-07T19:49:20.449519] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T19:49:20.650746] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-07T19:49:20.759580] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-07T19:49:20.759739] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-07T19:49:20.760998] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-07T19:49:20.761071] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-07T19:49:20.766356] [DEBUG] [LOCAL ] KMX: Trimmed 76099 records to 53191 (keeping 200 days of data) [2025-10-07T19:49:21.119253] [DEBUG] [LOCAL ] KMX: Primary data saved (53191 records). [2025-10-07T19:49:21.119502] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-07T19:49:21.119667] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMX took 37.5s. Estimated remaining: 2h 44m 5s. Rate: 7.1 symbols/min [2025-10-07T19:49:21.304549] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:49:21.325583] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T19:49:21.350381] [DEBUG] [LOCAL ] KNSL: Loaded 18380 existing records from primary storage. [2025-10-07T19:49:21.350763] [INFO ] [MAIN ] KNSL: Loaded 18380 existing records. [2025-10-07T19:49:21.449597] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-07T19:49:21.538377] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:49:21.538700] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-07T19:49:21.538767] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-07T19:49:21.539021] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-07T19:49:21.539093] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-07T19:49:21.727083] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T19:49:21.936911] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:49:22.247715] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-07T19:49:22.735179] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T19:49:23.047677] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-07T19:49:23.305970] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T19:49:23.847705] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-07T19:49:24.613094] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T19:49:24.614311] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T19:49:24.647606] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-07T19:49:25.447733] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-07T19:49:26.247628] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-07T19:49:26.279317] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T19:49:26.557972] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T19:49:27.032196] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T19:49:27.047612] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-07T19:49:27.831112] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T19:49:27.847626] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-07T19:49:28.638331] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T19:49:28.647611] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-07T19:49:29.447766] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-07T19:49:29.483488] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-07T19:49:30.247733] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-07T19:49:30.811296] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T19:49:31.003084] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T19:49:31.047618] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-07T19:49:31.837571] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T19:49:31.847598] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-07T19:49:31.958178] [DEBUG] [REMOTE ] KNOP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-07T19:49:31.958683] [WARN ] [REMOTE ] KNOP: No data returned for month 2025-07 [2025-10-07T19:49:31.958818] [FATAL] [REMOTE ] KNOP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:49:31.958924] [FATAL] [MAIN ] KNOP: Failed to fetch primary data. [2025-10-07T19:49:31.958991] [WARN ] [MAIN ] KNOP: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:49:31.959071] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-07T19:49:31.959146] [DEBUG] [LOCAL ] KNOP: No primary data file found to delete. [2025-10-07T19:49:31.959187] [INFO ] [LOCAL ] KNOP: Starting deletion of derivative data. [2025-10-07T19:49:31.959516] [DEBUG] [LOCAL ] KNOP: Deleted derivative data file. [2025-10-07T19:49:31.959618] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KNOP took 12.5s. Estimated remaining: 2h 43m 59s. Rate: 7.1 symbols/min [2025-10-07T19:49:32.145507] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:49:32.212165] [DEBUG] [LOCAL ] KNTK: Loaded 46402 existing records from primary storage. [2025-10-07T19:49:32.212803] [INFO ] [MAIN ] KNTK: Loaded 46402 existing records. [2025-10-07T19:49:32.413429] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:49:32.413902] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-07T19:49:32.413966] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-07T19:49:32.414480] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-07T19:49:32.414543] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-07T19:49:32.652947] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-07T19:49:32.809098] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:49:33.447692] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-07T19:49:34.138315] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T19:49:34.247600] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-07T19:49:34.952790] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T19:49:35.047706] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-07T19:49:35.629533] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T19:49:35.847680] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-07T19:49:35.904190] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T19:49:36.647687] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-07T19:49:37.285683] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T19:49:37.447738] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-07T19:49:38.065960] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T19:49:38.247769] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-07T19:49:38.820609] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T19:49:39.047696] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-07T19:49:39.285392] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T19:49:39.847749] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-07T19:49:40.287236] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-07T19:49:40.647697] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-07T19:49:41.226027] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T19:49:41.447754] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-07T19:49:42.124408] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T19:49:42.247741] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-07T19:49:42.759393] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T19:49:42.762434] [INFO ] [REMOTE ] KN: Full fetch complete (56648 records). [2025-10-07T19:49:42.762587] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-07T19:49:43.054206] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-07T19:49:43.150344] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-07T19:49:43.150430] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-07T19:49:43.151295] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-07T19:49:43.151359] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-07T19:49:43.152487] [DEBUG] [LOCAL ] KN: Trimmed 56648 records to 38610 (keeping 200 days of data) [2025-10-07T19:49:43.385066] [DEBUG] [LOCAL ] KN: Primary data saved (38610 records). [2025-10-07T19:49:43.385217] [INFO ] [MAIN ] KN: Full history saved. [2025-10-07T19:49:43.385318] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 35.9s. Estimated remaining: 2h 43m 53s. Rate: 7.1 symbols/min [2025-10-07T19:49:43.580024] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:49:43.638256] [DEBUG] [LOCAL ] KNX: Loaded 52594 existing records from primary storage. [2025-10-07T19:49:43.638870] [INFO ] [MAIN ] KNX: Loaded 52594 existing records. [2025-10-07T19:49:43.791520] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T19:49:43.848065] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-07T19:49:43.882851] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:49:43.883382] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-07T19:49:43.883462] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-07T19:49:43.883849] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-07T19:49:43.883910] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-07T19:49:44.272562] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:49:44.293732] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T19:49:44.647702] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-07T19:49:45.400318] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T19:49:45.447616] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-07T19:49:45.619036] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T19:49:46.247722] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-07T19:49:46.891183] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T19:49:47.047765] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-07T19:49:47.491967] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T19:49:47.495399] [INFO ] [REMOTE ] KNF: Full fetch complete (50927 records). [2025-10-07T19:49:47.495538] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-07T19:49:47.849938] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-07T19:49:47.898181] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-07T19:49:47.898362] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-07T19:49:47.899436] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-07T19:49:47.899508] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-07T19:49:47.902340] [DEBUG] [LOCAL ] KNF: Trimmed 50927 records to 36138 (keeping 200 days of data) [2025-10-07T19:49:48.148595] [DEBUG] [LOCAL ] KNF: Primary data saved (36138 records). [2025-10-07T19:49:48.148848] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-07T19:49:48.149010] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNF took 34.2s. Estimated remaining: 2h 43m 41s. Rate: 7.1 symbols/min [2025-10-07T19:49:48.336218] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:49:48.336895] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-07T19:49:48.336980] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-07T19:49:48.337187] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-07T19:49:48.337244] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-07T19:49:48.337289] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-07T19:49:48.337348] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-07T19:49:48.652374] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-07T19:49:48.735663] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:49:48.768676] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T19:49:48.967259] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T19:49:49.447714] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-07T19:49:50.247703] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-07T19:49:50.391922] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T19:49:51.047746] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-07T19:49:51.080734] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T19:49:51.143762] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T19:49:51.847735] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-07T19:49:52.647730] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-07T19:49:52.690632] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T19:49:52.794267] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T19:49:53.447728] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-07T19:49:54.240139] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T19:49:54.250541] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-07T19:49:55.047767] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-07T19:49:55.847636] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-07T19:49:55.983429] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T19:49:56.125852] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-07T19:49:56.160882] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T19:49:56.647747] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-07T19:49:57.450182] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-07T19:49:57.452879] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T19:49:58.247723] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-07T19:49:58.363734] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T19:49:58.365540] [INFO ] [REMOTE ] KNSL: Full fetch complete (26861 records). [2025-10-07T19:49:58.365615] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-07T19:49:58.572985] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-07T19:49:58.776339] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-07T19:49:58.776428] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-07T19:49:58.777204] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-07T19:49:58.777277] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-07T19:49:58.778305] [DEBUG] [LOCAL ] KNSL: Trimmed 26861 records to 18443 (keeping 200 days of data) [2025-10-07T19:49:58.905979] [DEBUG] [LOCAL ] KNSL: Primary data saved (18443 records). [2025-10-07T19:49:58.906138] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-07T19:49:58.906224] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNSL took 37.8s. Estimated remaining: 2h 43m 35s. Rate: 7.1 symbols/min [2025-10-07T19:49:59.053683] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-07T19:49:59.079964] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:49:59.125933] [DEBUG] [LOCAL ] KODK: Loaded 43356 existing records from primary storage. [2025-10-07T19:49:59.126359] [INFO ] [MAIN ] KODK: Loaded 43356 existing records. [2025-10-07T19:49:59.298850] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:49:59.299092] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-07T19:49:59.299204] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-07T19:49:59.299458] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-07T19:49:59.299516] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-07T19:49:59.651968] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:49:59.847681] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-07T19:50:00.647754] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-07T19:50:00.737124] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-07T19:50:00.966544] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T19:50:01.447753] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-07T19:50:01.630428] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T19:50:02.031976] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T19:50:02.247735] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-07T19:50:03.003959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T19:50:03.047734] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-07T19:50:03.847746] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-07T19:50:03.968707] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T19:50:04.647759] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-07T19:50:05.023609] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T19:50:05.447682] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-07T19:50:06.247797] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-07T19:50:06.284072] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T19:50:06.356417] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-07T19:50:06.896885] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T19:50:07.047687] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-07T19:50:07.847627] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-07T19:50:07.879416] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T19:50:08.608497] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T19:50:08.647724] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-07T19:50:09.447770] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-07T19:50:10.247724] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-07T19:50:10.380772] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-07T19:50:10.540678] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T19:50:11.037980] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T19:50:11.048029] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-07T19:50:11.847713] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-07T19:50:12.186191] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T19:50:12.647693] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-07T19:50:13.244517] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T19:50:13.349267] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-07T19:50:13.447681] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-07T19:50:14.155488] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T19:50:14.159279] [INFO ] [REMOTE ] KNTK: Full fetch complete (64942 records). [2025-10-07T19:50:14.159401] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-07T19:50:14.252818] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-07T19:50:14.564068] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-07T19:50:14.564147] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-07T19:50:14.565007] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-07T19:50:14.565072] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-07T19:50:14.568932] [DEBUG] [LOCAL ] KNTK: Trimmed 64942 records to 46489 (keeping 200 days of data) [2025-10-07T19:50:14.851206] [DEBUG] [LOCAL ] KNTK: Primary data saved (46489 records). [2025-10-07T19:50:14.851344] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-07T19:50:14.851442] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNTK took 42.9s. Estimated remaining: 2h 43m 34s. Rate: 7.1 symbols/min [2025-10-07T19:50:15.016265] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:50:15.043258] [DEBUG] [LOCAL ] KOF: Loaded 26489 existing records from primary storage. [2025-10-07T19:50:15.043545] [INFO ] [MAIN ] KOF: Loaded 26489 existing records. [2025-10-07T19:50:15.074568] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-07T19:50:15.227759] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:50:15.228045] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-07T19:50:15.228119] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-07T19:50:15.228415] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-07T19:50:15.228489] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-07T19:50:15.580507] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:50:15.847602] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-07T19:50:16.033865] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T19:50:16.152675] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-07T19:50:16.647622] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-07T19:50:16.823544] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T19:50:16.868234] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T19:50:17.447677] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-07T19:50:18.247634] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-07T19:50:18.276974] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T19:50:18.280486] [INFO ] [REMOTE ] KNX: Full fetch complete (75891 records). [2025-10-07T19:50:18.280607] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-07T19:50:18.669880] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-07T19:50:18.669985] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-07T19:50:18.671039] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-07T19:50:18.671136] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-07T19:50:18.672923] [DEBUG] [LOCAL ] KNX: Trimmed 75891 records to 52597 (keeping 200 days of data) [2025-10-07T19:50:18.995420] [DEBUG] [LOCAL ] KNX: Primary data saved (52597 records). [2025-10-07T19:50:18.995573] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-07T19:50:18.995685] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNX took 35.6s. Estimated remaining: 2h 43m 21s. Rate: 7.1 symbols/min [2025-10-07T19:50:19.057711] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-07T19:50:19.163816] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:50:19.187532] [DEBUG] [LOCAL ] KOP: Loaded 17533 existing records from primary storage. [2025-10-07T19:50:19.187988] [INFO ] [MAIN ] KOP: Loaded 17533 existing records. [2025-10-07T19:50:19.362232] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:50:19.362444] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-07T19:50:19.362491] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-07T19:50:19.362799] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-07T19:50:19.362858] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-07T19:50:19.714588] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:50:19.847609] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-07T19:50:19.885959] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-07T19:50:19.995190] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T19:50:20.427773] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T19:50:20.647628] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-07T19:50:20.929038] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T19:50:21.447694] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-07T19:50:22.247691] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-07T19:50:22.415006] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T19:50:23.047604] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-07T19:50:23.240860] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T19:50:23.439491] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-07T19:50:23.847683] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-07T19:50:24.035081] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T19:50:24.647734] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-07T19:50:25.447626] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-07T19:50:25.510693] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T19:50:25.692004] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T19:50:26.247672] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-07T19:50:27.047710] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-07T19:50:27.094712] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T19:50:27.847677] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-07T19:50:28.076437] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-07T19:50:28.185957] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T19:50:28.647684] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-07T19:50:29.296909] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T19:50:29.447675] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-07T19:50:30.247699] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-07T19:50:30.460017] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T19:50:31.053618] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-07T19:50:31.060935] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-07T19:50:31.794181] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T19:50:31.799175] [INFO ] [REMOTE ] KODK: Full fetch complete (63346 records). [2025-10-07T19:50:31.799415] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-07T19:50:31.857220] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-07T19:50:32.121911] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T19:50:32.220979] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-07T19:50:32.221070] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-07T19:50:32.221917] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-07T19:50:32.221982] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-07T19:50:32.223263] [DEBUG] [LOCAL ] KODK: Trimmed 63346 records to 43411 (keeping 200 days of data) [2025-10-07T19:50:32.471557] [DEBUG] [LOCAL ] KODK: Primary data saved (43411 records). [2025-10-07T19:50:32.471733] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-07T19:50:32.471861] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KODK took 33.6s. Estimated remaining: 2h 43m 17s. Rate: 7.1 symbols/min [2025-10-07T19:50:32.657257] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-07T19:50:32.691499] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:50:32.696276] [DEBUG] [LOCAL ] KORE: Loaded 2056 existing records from primary storage. [2025-10-07T19:50:32.696483] [INFO ] [MAIN ] KORE: Loaded 2056 existing records. [2025-10-07T19:50:32.902903] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:50:32.903237] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-07T19:50:32.903302] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-07T19:50:32.903547] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-07T19:50:32.903621] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-07T19:50:33.281475] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:50:33.447747] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-07T19:50:34.158572] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T19:50:34.247764] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-07T19:50:34.378086] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-07T19:50:34.381907] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-07T19:50:34.382063] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-07T19:50:34.593791] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T19:50:34.606361] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:50:34.607174] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:50:34.607258] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-07T19:50:34.608083] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T19:50:34.612868] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-07T19:50:34.613305] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-07T19:50:34.613396] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-07T19:50:34.613486] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KO took 46.5s. Estimated remaining: 2h 43m 3s. Rate: 7.1 symbols/min [2025-10-07T19:50:34.778595] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:50:34.831147] [DEBUG] [LOCAL ] KOS: Loaded 53056 existing records from primary storage. [2025-10-07T19:50:34.831511] [INFO ] [MAIN ] KOS: Loaded 53056 existing records. [2025-10-07T19:50:35.023312] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:50:35.023862] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-07T19:50:35.023952] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-07T19:50:35.024516] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-07T19:50:35.024756] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-07T19:50:35.050238] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-07T19:50:35.234627] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T19:50:35.448242] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:50:35.847686] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-07T19:50:36.011914] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T19:50:36.647690] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-07T19:50:36.950093] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T19:50:37.447696] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-07T19:50:37.600465] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T19:50:38.247731] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-07T19:50:38.694194] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T19:50:39.047732] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-07T19:50:39.847690] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-07T19:50:39.940907] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T19:50:39.967243] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T19:50:40.647738] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-07T19:50:40.708757] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T19:50:40.711136] [INFO ] [REMOTE ] KOF: Full fetch complete (37586 records). [2025-10-07T19:50:40.711214] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-07T19:50:41.074201] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-07T19:50:41.074280] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-07T19:50:41.074896] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-07T19:50:41.074960] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-07T19:50:41.075797] [DEBUG] [LOCAL ] KOF: Trimmed 37586 records to 26511 (keeping 200 days of data) [2025-10-07T19:50:41.243394] [DEBUG] [LOCAL ] KOF: Primary data saved (26511 records). [2025-10-07T19:50:41.243526] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-07T19:50:41.243608] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KOF took 26.4s. Estimated remaining: 2h 42m 53s. Rate: 7.1 symbols/min [2025-10-07T19:50:41.411069] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:50:41.447709] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-07T19:50:41.465243] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-07T19:50:41.465603] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-07T19:50:41.646413] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:50:41.646884] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-07T19:50:41.652291] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-07T19:50:41.658448] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-07T19:50:41.658875] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T19:50:41.658921] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-07T19:50:42.020532] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:50:42.247696] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-07T19:50:42.576410] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T19:50:43.047741] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-07T19:50:43.847673] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-07T19:50:44.140337] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T19:50:44.532942] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-07T19:50:44.647674] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-07T19:50:45.447729] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-07T19:50:45.517083] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T19:50:45.519705] [INFO ] [REMOTE ] KOP: Full fetch complete (25601 records). [2025-10-07T19:50:45.519825] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-07T19:50:45.938267] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T19:50:45.934679] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-07T19:50:45.939934] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-07T19:50:45.940574] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-07T19:50:45.940681] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-07T19:50:45.941581] [DEBUG] [LOCAL ] KOP: Trimmed 25601 records to 17540 (keeping 200 days of data) [2025-10-07T19:50:46.054080] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-07T19:50:46.093101] [DEBUG] [LOCAL ] KOP: Primary data saved (17540 records). [2025-10-07T19:50:46.093253] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-07T19:50:46.093343] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 27.1s. Estimated remaining: 2h 42m 41s. Rate: 7.1 symbols/min [2025-10-07T19:50:46.254797] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-07T19:50:46.257690] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:50:46.303116] [DEBUG] [LOCAL ] KRC: Loaded 48309 existing records from primary storage. [2025-10-07T19:50:46.303475] [INFO ] [MAIN ] KRC: Loaded 48309 existing records. [2025-10-07T19:50:46.477823] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:50:46.478114] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-07T19:50:46.478175] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-07T19:50:46.478437] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-07T19:50:46.478496] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-07T19:50:46.834570] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:50:47.047685] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-07T19:50:47.594016] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T19:50:47.847698] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-07T19:50:48.272610] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-07T19:50:48.613764] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T19:50:48.647662] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-07T19:50:49.447720] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-07T19:50:50.215735] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T19:50:50.247665] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-07T19:50:50.828309] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T19:50:51.047676] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-07T19:50:51.562962] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T19:50:51.847706] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-07T19:50:52.303133] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-07T19:50:52.658062] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-07T19:50:52.663967] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:50:53.447807] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-07T19:50:54.247743] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-07T19:50:54.473474] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T19:50:54.688612] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-07T19:50:55.047732] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-07T19:50:55.100007] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T19:50:55.847746] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-07T19:50:56.647748] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-07T19:50:56.816278] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T19:50:57.000585] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-07T19:50:57.447688] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-07T19:50:57.530865] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T19:50:57.925488] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-07T19:50:58.247709] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-07T19:50:59.047719] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-07T19:50:59.476565] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T19:50:59.847699] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-07T19:51:00.178701] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-07T19:51:00.647734] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-07T19:51:01.319065] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T19:51:01.447681] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-07T19:51:02.247779] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-07T19:51:02.836313] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-07T19:51:02.966631] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T19:51:03.006154] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T19:51:03.047676] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-07T19:51:03.847737] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-07T19:51:04.628504] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T19:51:04.647606] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-07T19:51:05.384600] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T19:51:05.447722] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-07T19:51:06.248298] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-07T19:51:06.251406] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T19:51:06.771060] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T19:51:06.771958] [INFO ] [REMOTE ] KORE: Full fetch complete (5672 records). [2025-10-07T19:51:06.772029] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-07T19:51:07.055170] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-07T19:51:07.148051] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-07T19:51:07.148218] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-07T19:51:07.148417] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-07T19:51:07.148563] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-07T19:51:07.149347] [DEBUG] [LOCAL ] KORE: Trimmed 5672 records to 2093 (keeping 200 days of data) [2025-10-07T19:51:07.161989] [DEBUG] [LOCAL ] KORE: Primary data saved (2093 records). [2025-10-07T19:51:07.162101] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-07T19:51:07.162236] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KORE took 34.7s. Estimated remaining: 2h 42m 45s. Rate: 7.1 symbols/min [2025-10-07T19:51:07.380179] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:51:07.382865] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T19:51:07.451438] [DEBUG] [LOCAL ] KREF: Loaded 37672 existing records from primary storage. [2025-10-07T19:51:07.451841] [INFO ] [MAIN ] KREF: Loaded 37672 existing records. [2025-10-07T19:51:07.639694] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:51:07.639954] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-07T19:51:07.640001] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-07T19:51:07.640225] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-07T19:51:07.640284] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-07T19:51:07.859627] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-07T19:51:08.025541] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:51:08.647692] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-07T19:51:09.087818] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T19:51:09.447771] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-07T19:51:09.695999] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T19:51:10.247719] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-07T19:51:10.579449] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T19:51:10.955966] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T19:51:11.047737] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-07T19:51:11.728283] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T19:51:11.731898] [INFO ] [REMOTE ] KRC: Full fetch complete (69948 records). [2025-10-07T19:51:11.732141] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-07T19:51:11.852881] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-07T19:51:12.134814] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-07T19:51:12.134893] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-07T19:51:12.135790] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-07T19:51:12.135854] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-07T19:51:12.137262] [DEBUG] [LOCAL ] KRC: Trimmed 69948 records to 48364 (keeping 200 days of data) [2025-10-07T19:51:12.441037] [DEBUG] [LOCAL ] KRC: Primary data saved (48364 records). [2025-10-07T19:51:12.441223] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-07T19:51:12.441392] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KRC took 26.3s. Estimated remaining: 2h 42m 33s. Rate: 7.1 symbols/min [2025-10-07T19:51:12.613700] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:51:12.658213] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-07T19:51:12.661423] [DEBUG] [LOCAL ] KRG: Loaded 49220 existing records from primary storage. [2025-10-07T19:51:12.661773] [INFO ] [MAIN ] KRG: Loaded 49220 existing records. [2025-10-07T19:51:12.843511] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:51:12.843952] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-07T19:51:12.844077] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-07T19:51:12.844470] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-07T19:51:12.844530] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-07T19:51:13.026149] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T19:51:13.250840] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:51:13.272811] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T19:51:13.447611] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-07T19:51:14.213559] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T19:51:14.247695] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-07T19:51:15.032143] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T19:51:15.047624] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-07T19:51:15.505686] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T19:51:15.847738] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-07T19:51:16.402422] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T19:51:16.647697] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-07T19:51:17.447631] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-07T19:51:17.787091] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T19:51:18.248062] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-07T19:51:18.266330] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:51:18.706807] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T19:51:19.047753] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-07T19:51:19.847706] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-07T19:51:20.036412] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T19:51:20.479686] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T19:51:20.647681] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-07T19:51:21.452830] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-07T19:51:21.468124] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T19:51:22.210355] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T19:51:22.247609] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-07T19:51:23.047622] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-07T19:51:23.069853] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T19:51:23.073890] [INFO ] [REMOTE ] KOS: Full fetch complete (76874 records). [2025-10-07T19:51:23.074011] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-07T19:51:23.558748] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-07T19:51:23.558852] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-07T19:51:23.560138] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-07T19:51:23.560211] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-07T19:51:23.562099] [DEBUG] [LOCAL ] KOS: Trimmed 76874 records to 53067 (keeping 200 days of data) [2025-10-07T19:51:23.802305] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T19:51:23.875049] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-07T19:51:23.925138] [DEBUG] [LOCAL ] KOS: Primary data saved (53067 records). [2025-10-07T19:51:23.925321] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-07T19:51:23.925416] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KOS took 49.3s. Estimated remaining: 2h 42m 27s. Rate: 7.1 symbols/min [2025-10-07T19:51:24.093159] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:51:24.093413] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-07T19:51:24.093471] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-07T19:51:24.093589] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-07T19:51:24.093633] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-07T19:51:24.093723] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-07T19:51:24.093764] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-07T19:51:24.450243] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:51:24.647694] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-07T19:51:25.174601] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:51:25.175007] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-07T19:51:25.175094] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:51:25.175144] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-07T19:51:25.175179] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:51:25.175263] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-07T19:51:25.175346] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-07T19:51:25.175385] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-07T19:51:25.175425] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-07T19:51:25.175475] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KRMN took 1.2s. Estimated remaining: 2h 42m 12s. Rate: 7.1 symbols/min [2025-10-07T19:51:25.346059] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:51:25.373970] [DEBUG] [LOCAL ] KRO: Loaded 26092 existing records from primary storage. [2025-10-07T19:51:25.374279] [INFO ] [MAIN ] KRO: Loaded 26092 existing records. [2025-10-07T19:51:25.448379] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-07T19:51:25.563048] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:51:25.563776] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-07T19:51:25.563841] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-07T19:51:25.564118] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-07T19:51:25.564176] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-07T19:51:25.889230] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T19:51:25.984195] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:51:26.019709] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-10-07T19:51:26.247701] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-07T19:51:26.893196] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T19:51:27.047633] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-07T19:51:27.366115] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T19:51:27.847739] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-07T19:51:28.586884] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T19:51:28.647612] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-07T19:51:29.069421] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-07T19:51:29.447688] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-07T19:51:29.935343] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T19:51:30.247745] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-07T19:51:30.554227] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T19:51:31.047671] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-07T19:51:31.667797] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T19:51:31.847701] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-07T19:51:32.566679] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T19:51:32.647718] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-07T19:51:33.412611] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T19:51:33.419714] [INFO ] [REMOTE ] KR: Full fetch complete (77679 records). [2025-10-07T19:51:33.419867] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-07T19:51:33.452835] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-07T19:51:33.738999] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T19:51:33.869715] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-07T19:51:33.869813] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-07T19:51:33.870827] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-07T19:51:33.870895] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-07T19:51:33.872577] [DEBUG] [LOCAL ] KR: Trimmed 77679 records to 53681 (keeping 200 days of data) [2025-10-07T19:51:34.221755] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-07T19:51:34.221977] [INFO ] [MAIN ] KR: Full history saved. [2025-10-07T19:51:34.222125] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KR took 53.0s. Estimated remaining: 2h 42m 4s. Rate: 7.1 symbols/min [2025-10-07T19:51:34.252935] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-07T19:51:34.400412] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:51:34.440440] [DEBUG] [LOCAL ] KRP: Loaded 36809 existing records from primary storage. [2025-10-07T19:51:34.440813] [INFO ] [MAIN ] KRP: Loaded 36809 existing records. [2025-10-07T19:51:34.613376] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:51:34.613686] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-07T19:51:34.613745] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-07T19:51:34.613979] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-07T19:51:34.614036] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-07T19:51:34.971785] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:51:35.047670] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-07T19:51:35.211899] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T19:51:35.491812] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T19:51:35.847693] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-07T19:51:36.102812] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T19:51:36.107232] [INFO ] [REMOTE ] KREF: Full fetch complete (52761 records). [2025-10-07T19:51:36.107349] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-07T19:51:36.486088] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-07T19:51:36.486175] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-07T19:51:36.486936] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-07T19:51:36.487000] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-07T19:51:36.492431] [DEBUG] [LOCAL ] KREF: Trimmed 52761 records to 37782 (keeping 200 days of data) [2025-10-07T19:51:36.666328] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-07T19:51:36.732626] [DEBUG] [LOCAL ] KREF: Primary data saved (37782 records). [2025-10-07T19:51:36.732814] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-07T19:51:36.732971] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KREF took 29.6s. Estimated remaining: 2h 41m 50s. Rate: 7.1 symbols/min [2025-10-07T19:51:36.902268] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:51:36.953105] [DEBUG] [LOCAL ] KSS: Loaded 53600 existing records from primary storage. [2025-10-07T19:51:36.953472] [INFO ] [MAIN ] KSS: Loaded 53600 existing records. [2025-10-07T19:51:37.156493] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T19:51:37.179208] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:51:37.179804] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-07T19:51:37.179861] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-07T19:51:37.180189] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-07T19:51:37.180246] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-07T19:51:37.460335] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-07T19:51:37.613065] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:51:38.047364] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T19:51:38.247731] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-07T19:51:38.811222] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T19:51:39.047684] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-07T19:51:39.662120] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T19:51:39.847711] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-07T19:51:40.194897] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T19:51:40.647736] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-07T19:51:41.248241] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T19:51:41.447700] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-07T19:51:42.250945] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-07T19:51:42.256737] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T19:51:42.724638] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T19:51:43.047734] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-07T19:51:43.847728] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-07T19:51:44.234297] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T19:51:44.399847] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-07T19:51:44.647625] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-07T19:51:45.326714] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:51:45.447615] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-07T19:51:45.838774] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T19:51:46.247692] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-07T19:51:47.047736] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-07T19:51:47.394064] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T19:51:47.748385] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T19:51:47.753154] [INFO ] [REMOTE ] KRG: Full fetch complete (71146 records). [2025-10-07T19:51:47.753335] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-07T19:51:47.852806] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-07T19:51:48.147881] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-07T19:51:48.148003] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-07T19:51:48.149063] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-07T19:51:48.149135] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-07T19:51:48.150822] [DEBUG] [LOCAL ] KRG: Trimmed 71146 records to 49208 (keeping 200 days of data) [2025-10-07T19:51:48.533141] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T19:51:48.565225] [DEBUG] [LOCAL ] KRG: Primary data saved (49208 records). [2025-10-07T19:51:48.565459] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-07T19:51:48.565634] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRG took 36.1s. Estimated remaining: 2h 41m 45s. Rate: 7.1 symbols/min [2025-10-07T19:51:48.656195] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-07T19:51:48.850524] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:51:48.906121] [DEBUG] [LOCAL ] KT: Loaded 45572 existing records from primary storage. [2025-10-07T19:51:48.906537] [INFO ] [MAIN ] KT: Loaded 45572 existing records. [2025-10-07T19:51:49.206917] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:51:49.207611] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-07T19:51:49.207719] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-07T19:51:49.207976] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-07T19:51:49.208034] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-07T19:51:49.345568] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T19:51:49.454775] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-07T19:51:49.613701] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:51:50.247750] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-07T19:51:50.532211] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-07T19:51:50.911413] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T19:51:51.047769] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-07T19:51:51.485593] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T19:51:51.847719] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-07T19:51:52.477477] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T19:51:52.647741] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-07T19:51:53.367664] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T19:51:53.447739] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-07T19:51:53.860350] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T19:51:54.247727] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-07T19:51:54.829081] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T19:51:55.047708] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-07T19:51:55.847731] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-07T19:51:56.044361] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T19:51:56.046707] [INFO ] [REMOTE ] KRO: Full fetch complete (34999 records). [2025-10-07T19:51:56.046816] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-07T19:51:56.430823] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-07T19:51:56.430939] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-07T19:51:56.431594] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-07T19:51:56.431780] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-07T19:51:56.432876] [DEBUG] [LOCAL ] KRO: Trimmed 34999 records to 26164 (keeping 200 days of data) [2025-10-07T19:51:56.462909] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-07T19:51:56.623280] [DEBUG] [LOCAL ] KRO: Primary data saved (26164 records). [2025-10-07T19:51:56.623427] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-07T19:51:56.623523] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRO took 31.4s. Estimated remaining: 2h 41m 36s. Rate: 7.1 symbols/min [2025-10-07T19:51:56.653913] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-07T19:51:56.807140] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:51:56.844138] [DEBUG] [LOCAL ] KTB: Loaded 40814 existing records from primary storage. [2025-10-07T19:51:56.844499] [INFO ] [MAIN ] KTB: Loaded 40814 existing records. [2025-10-07T19:51:57.028890] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:51:57.029159] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-07T19:51:57.029214] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-07T19:51:57.029614] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-07T19:51:57.029717] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-07T19:51:57.415136] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T19:51:57.420393] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:51:57.447603] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-07T19:51:58.247723] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-07T19:51:58.338204] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T19:51:58.773596] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T19:51:59.047755] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-07T19:51:59.847676] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-07T19:52:00.270752] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T19:52:00.275123] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T19:52:00.285868] [INFO ] [REMOTE ] KRP: Full fetch complete (54795 records). [2025-10-07T19:52:00.286445] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-07T19:52:00.654062] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-07T19:52:00.689471] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-07T19:52:00.689550] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-07T19:52:00.690384] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-07T19:52:00.690546] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-07T19:52:00.691902] [DEBUG] [LOCAL ] KRP: Trimmed 54795 records to 36699 (keeping 200 days of data) [2025-10-07T19:52:00.925968] [DEBUG] [LOCAL ] KRP: Primary data saved (36699 records). [2025-10-07T19:52:00.926147] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-07T19:52:00.926236] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 26.7s. Estimated remaining: 2h 41m 24s. Rate: 7.1 symbols/min [2025-10-07T19:52:01.094970] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:52:01.112670] [DEBUG] [LOCAL ] KTF: Loaded 12211 existing records from primary storage. [2025-10-07T19:52:01.112960] [INFO ] [MAIN ] KTF: Loaded 12211 existing records. [2025-10-07T19:52:01.313928] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:52:01.323398] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-07T19:52:01.335928] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-07T19:52:01.337416] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T19:52:01.344259] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-07T19:52:01.345105] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-07T19:52:01.454969] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-07T19:52:01.753502] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:52:02.247746] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-07T19:52:02.476047] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T19:52:02.625065] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T19:52:03.047773] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-07T19:52:03.847712] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-07T19:52:04.039535] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T19:52:04.315952] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-07T19:52:04.647701] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-07T19:52:05.042570] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T19:52:05.406959] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T19:52:05.447615] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-07T19:52:06.247709] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-07T19:52:07.022586] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T19:52:07.032142] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T19:52:07.047615] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-07T19:52:07.847629] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-07T19:52:08.010463] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T19:52:08.647733] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-07T19:52:09.300141] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T19:52:09.447624] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-07T19:52:10.247695] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-07T19:52:10.807672] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-07T19:52:10.977754] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:52:11.047702] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-07T19:52:11.597467] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T19:52:11.847673] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-07T19:52:12.544681] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T19:52:12.647720] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-07T19:52:13.373929] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:52:13.422691] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-07T19:52:13.447612] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-07T19:52:14.247717] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-07T19:52:15.013478] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T19:52:15.047681] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-07T19:52:15.548323] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-07T19:52:15.847732] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-07T19:52:16.039384] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T19:52:16.647712] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-07T19:52:17.394374] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T19:52:17.419552] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T19:52:17.447694] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-07T19:52:18.247673] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-07T19:52:18.267408] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T19:52:19.047707] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-07T19:52:19.847713] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-07T19:52:20.087589] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T19:52:20.588355] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T19:52:20.624845] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T19:52:20.647619] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-07T19:52:21.447695] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-07T19:52:22.110222] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T19:52:22.247796] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-07T19:52:22.957122] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T19:52:22.958853] [INFO ] [REMOTE ] KTF: Full fetch complete (17627 records). [2025-10-07T19:52:22.958994] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-07T19:52:23.048229] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-07T19:52:23.122310] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T19:52:23.424287] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-07T19:52:23.424401] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-07T19:52:23.425375] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-07T19:52:23.425444] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-07T19:52:23.426210] [DEBUG] [LOCAL ] KTF: Trimmed 17627 records to 12066 (keeping 200 days of data) [2025-10-07T19:52:23.507459] [DEBUG] [LOCAL ] KTF: Primary data saved (12066 records). [2025-10-07T19:52:23.507691] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-07T19:52:23.507815] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KTF took 22.6s. Estimated remaining: 2h 41m 29s. Rate: 7.1 symbols/min [2025-10-07T19:52:23.695469] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:52:23.695781] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-07T19:52:23.695841] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-07T19:52:23.695982] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-07T19:52:23.696027] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-07T19:52:23.696073] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-07T19:52:23.696110] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-07T19:52:23.856559] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-07T19:52:24.117264] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:52:24.426414] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T19:52:24.429559] [INFO ] [REMOTE ] KTB: Full fetch complete (57966 records). [2025-10-07T19:52:24.429742] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-07T19:52:24.656014] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-07T19:52:24.833072] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-07T19:52:24.833169] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-07T19:52:24.834375] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-07T19:52:24.834448] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-07T19:52:24.836299] [DEBUG] [LOCAL ] KTB: Trimmed 57966 records to 40697 (keeping 200 days of data) [2025-10-07T19:52:25.109612] [DEBUG] [LOCAL ] KTB: Primary data saved (40697 records). [2025-10-07T19:52:25.109830] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-07T19:52:25.109951] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KTB took 28.5s. Estimated remaining: 2h 41m 14s. Rate: 7.1 symbols/min [2025-10-07T19:52:25.297178] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:52:25.355440] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-07T19:52:25.355906] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-07T19:52:25.449031] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-07T19:52:25.545788] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:52:25.546287] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-07T19:52:25.546378] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-07T19:52:25.556761] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-07T19:52:25.562290] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-07T19:52:25.620848] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T19:52:25.959881] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:52:26.096291] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T19:52:26.247632] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-07T19:52:26.518442] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-07T19:52:26.522558] [INFO ] [REMOTE ] KSS: Full fetch complete (77631 records). [2025-10-07T19:52:26.522721] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-07T19:52:26.918845] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-07T19:52:26.918991] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-07T19:52:26.920013] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-07T19:52:26.920080] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-07T19:52:26.921638] [DEBUG] [LOCAL ] KSS: Trimmed 77631 records to 53600 (keeping 200 days of data) [2025-10-07T19:52:27.047818] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-07T19:52:27.261417] [DEBUG] [LOCAL ] KSS: Primary data saved (53600 records). [2025-10-07T19:52:27.261593] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-07T19:52:27.261747] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KSS took 50.5s. Estimated remaining: 2h 40m 60s. Rate: 7.1 symbols/min [2025-10-07T19:52:27.431522] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:52:27.478316] [DEBUG] [LOCAL ] KVYO: Loaded 50220 existing records from primary storage. [2025-10-07T19:52:27.478716] [INFO ] [MAIN ] KVYO: Loaded 50220 existing records. [2025-10-07T19:52:27.656402] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:52:27.656789] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-07T19:52:27.656900] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-07T19:52:27.657243] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-07T19:52:27.657301] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-07T19:52:27.847807] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-07T19:52:27.943810] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T19:52:28.075751] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:52:28.076596] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T19:52:28.647751] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-07T19:52:29.447706] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-07T19:52:29.734786] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T19:52:29.897661] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T19:52:30.240512] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T19:52:30.247628] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-07T19:52:31.047681] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-07T19:52:31.253116] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T19:52:31.847694] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-07T19:52:32.647699] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-07T19:52:32.724125] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T19:52:32.968669] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-07T19:52:33.201544] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T19:52:33.204859] [INFO ] [REMOTE ] KT: Full fetch complete (66535 records). [2025-10-07T19:52:33.205004] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-07T19:52:33.452807] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-07T19:52:33.612915] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-07T19:52:33.613011] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-07T19:52:33.614031] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-07T19:52:33.614099] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-07T19:52:33.615580] [DEBUG] [LOCAL ] KT: Trimmed 66535 records to 45597 (keeping 200 days of data) [2025-10-07T19:52:33.895808] [DEBUG] [LOCAL ] KT: Primary data saved (45597 records). [2025-10-07T19:52:33.895986] [INFO ] [MAIN ] KT: Full history saved. [2025-10-07T19:52:33.896095] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KT took 45.3s. Estimated remaining: 2h 40m 50s. Rate: 7.1 symbols/min [2025-10-07T19:52:34.001519] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-07T19:52:34.072799] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:52:34.111007] [DEBUG] [LOCAL ] KW: Loaded 40447 existing records from primary storage. [2025-10-07T19:52:34.111362] [INFO ] [MAIN ] KW: Loaded 40447 existing records. [2025-10-07T19:52:34.249962] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-07T19:52:34.286918] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:52:34.288159] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-07T19:52:34.288212] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-07T19:52:34.288448] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-07T19:52:34.288511] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-07T19:52:34.634703] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:52:34.781558] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-07T19:52:35.047756] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-07T19:52:35.465802] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-07T19:52:35.847703] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-07T19:52:36.647730] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-07T19:52:37.247066] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T19:52:37.447718] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-07T19:52:37.923487] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T19:52:38.247725] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-07T19:52:38.789348] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T19:52:39.047624] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-07T19:52:39.847719] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-07T19:52:40.017958] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T19:52:40.464533] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T19:52:40.530122] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T19:52:40.647750] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-07T19:52:41.447761] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-07T19:52:41.632692] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T19:52:42.247752] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-07T19:52:42.970124] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T19:52:43.047704] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-07T19:52:43.201345] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T19:52:43.202819] [INFO ] [REMOTE ] KUKE: Full fetch complete (8706 records). [2025-10-07T19:52:43.202894] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-07T19:52:43.396632] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T19:52:43.396958] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T19:52:43.397029] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T19:52:43.397081] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-07T19:52:43.397170] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-07T19:52:43.397226] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-07T19:52:43.397286] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-07T19:52:43.397427] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KUKE took 19.9s. Estimated remaining: 2h 40m 42s. Rate: 7.1 symbols/min [2025-10-07T19:52:43.573154] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:52:43.591898] [DEBUG] [LOCAL ] KWR: Loaded 16322 existing records from primary storage. [2025-10-07T19:52:43.592165] [INFO ] [MAIN ] KWR: Loaded 16322 existing records. [2025-10-07T19:52:43.767472] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:52:43.767763] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-07T19:52:43.767826] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-07T19:52:43.768084] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-07T19:52:43.768141] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-07T19:52:43.856579] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-07T19:52:44.134376] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:52:44.655845] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-07T19:52:44.680576] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:52:45.165453] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T19:52:45.447714] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-07T19:52:45.669675] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T19:52:46.247686] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-07T19:52:47.018402] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T19:52:47.047603] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-07T19:52:47.847697] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-07T19:52:48.073417] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T19:52:48.647635] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-07T19:52:48.749208] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T19:52:48.853951] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T19:52:49.447692] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-07T19:52:50.247718] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-07T19:52:50.452566] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T19:52:50.866274] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T19:52:51.047678] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-07T19:52:51.213258] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T19:52:51.847687] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-07T19:52:52.647682] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-07T19:52:52.835804] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T19:52:52.921810] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T19:52:53.447732] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-07T19:52:54.252823] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-07T19:52:54.269928] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T19:52:54.507893] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T19:52:55.047698] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-07T19:52:55.847715] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-07T19:52:56.019585] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T19:52:56.179076] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T19:52:56.647704] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-07T19:52:57.145122] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T19:52:57.447722] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-07T19:52:58.060630] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T19:52:58.247631] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-07T19:52:58.435788] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T19:52:59.047732] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-07T19:52:59.525998] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T19:52:59.847713] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-07T19:53:00.647673] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-07T19:53:00.856590] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-07T19:53:00.968223] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T19:53:01.447722] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-07T19:53:01.986633] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T19:53:02.247717] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-07T19:53:02.473875] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T19:53:03.047726] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-07T19:53:03.681693] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T19:53:03.699728] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T19:53:03.847700] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-07T19:53:04.647705] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-07T19:53:05.257811] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T19:53:05.447721] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-07T19:53:06.247630] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-07T19:53:06.490276] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T19:53:06.888366] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T19:53:07.047677] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-07T19:53:07.847664] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-07T19:53:07.954852] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T19:53:08.647709] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-07T19:53:08.678592] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T19:53:08.680005] [INFO ] [REMOTE ] KWR: Full fetch complete (23938 records). [2025-10-07T19:53:08.680094] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-07T19:53:09.050398] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-07T19:53:09.050484] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-07T19:53:09.051006] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-07T19:53:09.051068] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-07T19:53:09.051708] [DEBUG] [LOCAL ] KWR: Trimmed 23938 records to 16316 (keeping 200 days of data) [2025-10-07T19:53:09.157616] [DEBUG] [LOCAL ] KWR: Primary data saved (16316 records). [2025-10-07T19:53:09.157791] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-07T19:53:09.157877] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KWR took 25.8s. Estimated remaining: 2h 40m 50s. Rate: 7.1 symbols/min [2025-10-07T19:53:09.330028] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:53:09.363434] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-07T19:53:09.399838] [DEBUG] [LOCAL ] KYN: Loaded 29937 existing records from primary storage. [2025-10-07T19:53:09.400148] [INFO ] [MAIN ] KYN: Loaded 29937 existing records. [2025-10-07T19:53:09.452751] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-07T19:53:09.597968] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:53:09.598219] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-07T19:53:09.598282] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-07T19:53:09.598564] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-07T19:53:09.598623] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-07T19:53:10.064629] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:53:10.090485] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T19:53:10.247688] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-07T19:53:11.047727] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-07T19:53:11.103105] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-07T19:53:11.106632] [INFO ] [REMOTE ] KVYO: Full fetch complete (71739 records). [2025-10-07T19:53:11.106776] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-07T19:53:11.500772] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-07T19:53:11.500918] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-07T19:53:11.501858] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-07T19:53:11.501924] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-07T19:53:11.503319] [DEBUG] [LOCAL ] KVYO: Trimmed 71739 records to 50334 (keeping 200 days of data) [2025-10-07T19:53:11.801188] [DEBUG] [LOCAL ] KVYO: Primary data saved (50334 records). [2025-10-07T19:53:11.801345] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-07T19:53:11.801434] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KVYO took 44.5s. Estimated remaining: 2h 40m 36s. Rate: 7.1 symbols/min [2025-10-07T19:53:11.865444] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-07T19:53:11.985404] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:53:12.027298] [DEBUG] [LOCAL ] L: Loaded 41113 existing records from primary storage. [2025-10-07T19:53:12.027864] [INFO ] [MAIN ] L: Loaded 41113 existing records. [2025-10-07T19:53:12.151079] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T19:53:12.242593] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:53:12.243019] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-07T19:53:12.243074] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-07T19:53:12.243410] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-07T19:53:12.243471] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-07T19:53:12.349860] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-07T19:53:12.373520] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-07T19:53:12.383954] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-07T19:53:12.655291] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-07T19:53:12.952935] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:53:13.082236] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-07T19:53:13.082437] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-07T19:53:13.083545] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-07T19:53:13.083614] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-07T19:53:13.085311] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 53667 (keeping 200 days of data) [2025-10-07T19:53:13.192368] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T19:53:13.205523] [INFO ] [REMOTE ] KW: Full fetch complete (57079 records). [2025-10-07T19:53:13.206261] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-07T19:53:13.457383] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-07T19:53:13.720872] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-07T19:53:13.732738] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-07T19:53:13.734838] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-07T19:53:13.734946] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-07T19:53:13.767472] [DEBUG] [LOCAL ] KW: Trimmed 57079 records to 40422 (keeping 200 days of data) [2025-10-07T19:53:13.916889] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T19:53:14.218540] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-07T19:53:14.218880] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-07T19:53:14.219034] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KVUE took 49.1s. Estimated remaining: 2h 40m 22s. Rate: 7.1 symbols/min [2025-10-07T19:53:14.214782] [DEBUG] [LOCAL ] KW: Primary data saved (40422 records). [2025-10-07T19:53:14.219507] [INFO ] [MAIN ] KW: Full history saved. [2025-10-07T19:53:14.224876] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KW took 40.3s. Estimated remaining: 2h 40m 6s. Rate: 7.1 symbols/min [2025-10-07T19:53:14.263399] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-07T19:53:14.601310] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:53:14.603812] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:53:14.635934] [DEBUG] [LOCAL ] LAD: Loaded 23599 existing records from primary storage. [2025-10-07T19:53:14.636330] [INFO ] [MAIN ] LAD: Loaded 23599 existing records. [2025-10-07T19:53:14.897047] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:53:14.897703] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-07T19:53:14.900259] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-07T19:53:14.900088] [DEBUG] [LOCAL ] LAC: Loaded 52414 existing records from primary storage. [2025-10-07T19:53:14.900940] [INFO ] [MAIN ] LAC: Loaded 52414 existing records. [2025-10-07T19:53:14.901024] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-07T19:53:14.901168] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-07T19:53:15.253092] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:53:15.269377] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-07T19:53:15.274754] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-07T19:53:15.328821] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-07T19:53:15.374369] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-07T19:53:15.495459] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-07T19:53:15.560976] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-07T19:53:15.720970] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:53:15.854238] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-07T19:53:15.882703] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:53:16.076090] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:53:16.647714] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-07T19:53:17.093287] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T19:53:17.121223] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T19:53:17.447720] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-07T19:53:18.247633] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-07T19:53:18.329281] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T19:53:18.625436] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T19:53:19.047627] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-07T19:53:19.480041] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-07T19:53:19.847708] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-07T19:53:20.612805] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T19:53:20.647611] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-07T19:53:20.939413] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T19:53:21.447700] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-07T19:53:22.159454] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T19:53:22.247675] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-07T19:53:23.051874] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-07T19:53:23.057909] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T19:53:23.724046] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T19:53:23.847626] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-07T19:53:24.464595] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T19:53:24.647680] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-07T19:53:25.244606] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T19:53:25.447698] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-07T19:53:25.959316] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T19:53:26.247721] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-07T19:53:26.725767] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T19:53:27.047746] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-07T19:53:27.719803] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T19:53:27.847604] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-07T19:53:28.279041] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T19:53:28.647696] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-07T19:53:29.455430] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-07T19:53:29.482729] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T19:53:29.976778] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-07T19:53:30.247742] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-07T19:53:31.047724] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-07T19:53:31.294197] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T19:53:31.741672] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T19:53:31.847627] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-07T19:53:32.117472] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T19:53:32.647706] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-07T19:53:33.330405] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T19:53:33.447621] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-07T19:53:33.677383] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T19:53:34.247747] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-07T19:53:34.858326] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T19:53:34.861338] [INFO ] [REMOTE ] L: Full fetch complete (59470 records). [2025-10-07T19:53:34.861471] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-07T19:53:35.056260] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-07T19:53:35.256930] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-07T19:53:35.257136] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-07T19:53:35.258123] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-07T19:53:35.258207] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-07T19:53:35.278909] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T19:53:35.285788] [DEBUG] [LOCAL ] L: Trimmed 59470 records to 41121 (keeping 200 days of data) [2025-10-07T19:53:35.544614] [DEBUG] [LOCAL ] L: Primary data saved (41121 records). [2025-10-07T19:53:35.544790] [INFO ] [MAIN ] L: Full history saved. [2025-10-07T19:53:35.544873] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. L took 23.7s. Estimated remaining: 2h 40m 9s. Rate: 7.1 symbols/min [2025-10-07T19:53:35.711132] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:53:35.749428] [DEBUG] [LOCAL ] LADR: Loaded 39037 existing records from primary storage. [2025-10-07T19:53:35.749813] [INFO ] [MAIN ] LADR: Loaded 39037 existing records. [2025-10-07T19:53:35.853817] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-07T19:53:35.944743] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:53:35.945161] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-07T19:53:35.945226] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-07T19:53:35.946008] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-07T19:53:35.946070] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-07T19:53:36.333214] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:53:36.647722] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-07T19:53:37.065441] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T19:53:37.154442] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T19:53:37.447753] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-07T19:53:37.660778] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T19:53:38.247712] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-07T19:53:39.047757] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-07T19:53:39.486965] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T19:53:39.722696] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T19:53:39.847713] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-07T19:53:40.485098] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T19:53:40.647737] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-07T19:53:41.290351] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T19:53:41.447631] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-07T19:53:41.833368] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T19:53:42.247731] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-07T19:53:42.571880] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T19:53:43.039112] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T19:53:43.041330] [INFO ] [REMOTE ] KYN: Full fetch complete (44420 records). [2025-10-07T19:53:43.041461] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-07T19:53:43.054587] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-07T19:53:43.439522] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-07T19:53:43.439680] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-07T19:53:43.440556] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-07T19:53:43.440627] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-07T19:53:43.441942] [DEBUG] [LOCAL ] KYN: Trimmed 44420 records to 29972 (keeping 200 days of data) [2025-10-07T19:53:43.643333] [DEBUG] [LOCAL ] KYN: Primary data saved (29972 records). [2025-10-07T19:53:43.643511] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-07T19:53:43.643606] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. KYN took 34.5s. Estimated remaining: 2h 40m 0s. Rate: 7.1 symbols/min [2025-10-07T19:53:43.813363] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:53:43.818753] [DEBUG] [LOCAL ] LANV: Loaded 2796 existing records from primary storage. [2025-10-07T19:53:43.818961] [INFO ] [MAIN ] LANV: Loaded 2796 existing records. [2025-10-07T19:53:43.853015] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-07T19:53:44.012506] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:53:44.012860] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-07T19:53:44.012940] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-07T19:53:44.013139] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-07T19:53:44.013207] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-07T19:53:44.393587] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:53:44.417692] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T19:53:44.647689] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-07T19:53:45.438742] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T19:53:45.448105] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-07T19:53:45.505250] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T19:53:46.247679] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-07T19:53:47.047775] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-07T19:53:47.331334] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T19:53:47.696373] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T19:53:47.847670] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-07T19:53:48.193136] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T19:53:48.195344] [INFO ] [REMOTE ] LAD: Full fetch complete (35425 records). [2025-10-07T19:53:48.195428] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-07T19:53:48.584746] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-07T19:53:48.584869] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-07T19:53:48.585635] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-07T19:53:48.585724] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-07T19:53:48.586576] [DEBUG] [LOCAL ] LAD: Trimmed 35425 records to 23615 (keeping 200 days of data) [2025-10-07T19:53:48.657574] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-07T19:53:48.777679] [DEBUG] [LOCAL ] LAD: Primary data saved (23615 records). [2025-10-07T19:53:48.777977] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-07T19:53:48.778133] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LAD took 34.5s. Estimated remaining: 2h 39m 49s. Rate: 7.1 symbols/min [2025-10-07T19:53:49.012676] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:53:49.012997] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-07T19:53:49.013208] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-07T19:53:49.013401] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-07T19:53:49.013688] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-07T19:53:49.013832] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-07T19:53:49.013905] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-07T19:53:49.231517] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T19:53:49.442491] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T19:53:49.447722] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-07T19:53:49.590662] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:53:50.247679] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-07T19:53:50.825230] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-07T19:53:51.047615] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-07T19:53:51.386920] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T19:53:51.519816] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-07T19:53:51.847701] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-07T19:53:52.047954] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T19:53:52.048326] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-07T19:53:52.048420] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:53:52.048467] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-07T19:53:52.048502] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:53:52.048574] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-07T19:53:52.048660] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-07T19:53:52.048722] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-07T19:53:52.048767] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-07T19:53:52.048835] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LAR took 3.3s. Estimated remaining: 2h 39m 36s. Rate: 7.1 symbols/min [2025-10-07T19:53:52.214495] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:53:52.231097] [DEBUG] [LOCAL ] LAW: Loaded 14213 existing records from primary storage. [2025-10-07T19:53:52.231315] [INFO ] [MAIN ] LAW: Loaded 14213 existing records. [2025-10-07T19:53:52.403761] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:53:52.404009] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-07T19:53:52.404059] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-07T19:53:52.404242] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-07T19:53:52.404297] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-07T19:53:52.652845] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-07T19:53:52.759423] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:53:53.447751] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-07T19:53:53.917845] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T19:53:54.247620] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-07T19:53:54.286085] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T19:53:55.047739] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-07T19:53:55.847639] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-07T19:53:56.045125] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T19:53:56.196399] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-07T19:53:56.231103] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T19:53:56.647691] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-07T19:53:57.426067] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T19:53:57.447705] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-07T19:53:58.247735] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-07T19:53:59.047632] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-07T19:53:59.143537] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T19:53:59.423435] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T19:53:59.847690] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-07T19:54:00.260382] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T19:54:00.281745] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-07T19:54:00.647735] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-07T19:54:01.447699] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-07T19:54:01.463838] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T19:54:02.247711] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-07T19:54:02.996165] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-07T19:54:03.021530] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T19:54:03.047611] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-07T19:54:03.847697] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-07T19:54:04.046041] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T19:54:04.278245] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-07T19:54:04.647702] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-07T19:54:05.130910] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-07T19:54:05.447683] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-07T19:54:06.247708] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-07T19:54:07.047729] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-07T19:54:07.388707] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T19:54:07.605615] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T19:54:07.643782] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T19:54:07.648113] [INFO ] [REMOTE ] LADR: Full fetch complete (55563 records). [2025-10-07T19:54:07.648263] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-07T19:54:07.854475] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-07T19:54:08.053701] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-07T19:54:08.053793] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-07T19:54:08.054569] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-07T19:54:08.054612] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-07T19:54:08.055908] [DEBUG] [LOCAL ] LADR: Trimmed 55563 records to 39140 (keeping 200 days of data) [2025-10-07T19:54:08.312471] [DEBUG] [LOCAL ] LADR: Primary data saved (39140 records). [2025-10-07T19:54:08.312638] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-07T19:54:08.312764] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LADR took 32.8s. Estimated remaining: 2h 39m 34s. Rate: 7.1 symbols/min [2025-10-07T19:54:08.647717] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-07T19:54:09.285961] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-07T19:54:09.447712] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-07T19:54:10.239210] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-07T19:54:10.243006] [INFO ] [REMOTE ] LAC: Full fetch complete (75996 records). [2025-10-07T19:54:10.243139] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-07T19:54:10.275281] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-07T19:54:10.555239] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T19:54:10.654308] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-07T19:54:10.654406] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-07T19:54:10.655353] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-07T19:54:10.655418] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-07T19:54:10.657182] [DEBUG] [LOCAL ] LAC: Trimmed 75996 records to 52426 (keeping 200 days of data) [2025-10-07T19:54:10.883238] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T19:54:10.884883] [INFO ] [REMOTE ] LANV: Full fetch complete (4415 records). [2025-10-07T19:54:10.885520] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-07T19:54:11.048587] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-07T19:54:11.327682] [DEBUG] [LOCAL ] LAC: Primary data saved (52426 records). [2025-10-07T19:54:11.333738] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-07T19:54:11.333838] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-07T19:54:11.333916] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-07T19:54:11.334066] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAC took 57.1s. Estimated remaining: 2h 39m 21s. Rate: 7.1 symbols/min [2025-10-07T19:54:11.334550] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-07T19:54:11.334778] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-07T19:54:11.335186] [DEBUG] [LOCAL ] LANV: Trimmed 4415 records to 2798 (keeping 200 days of data) [2025-10-07T19:54:11.351865] [DEBUG] [LOCAL ] LANV: Primary data saved (2798 records). [2025-10-07T19:54:11.351946] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-07T19:54:11.352018] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LANV took 27.7s. Estimated remaining: 2h 39m 5s. Rate: 7.1 symbols/min [2025-10-07T19:54:12.024307] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T19:54:12.028113] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-07T19:54:13.034192] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T19:54:13.038001] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-07T19:54:13.977497] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T19:54:13.981734] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-07T19:54:14.945009] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T19:54:14.946690] [INFO ] [REMOTE ] LAW: Full fetch complete (20744 records). [2025-10-07T19:54:14.946776] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-07T19:54:15.303358] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-07T19:54:15.303440] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-07T19:54:15.303889] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-07T19:54:15.303952] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-07T19:54:15.304495] [DEBUG] [LOCAL ] LAW: Trimmed 20744 records to 14260 (keeping 200 days of data) [2025-10-07T19:54:15.386601] [DEBUG] [LOCAL ] LAW: Primary data saved (14260 records). [2025-10-07T19:54:15.386779] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-07T19:54:15.386871] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LAW took 23.3s. Estimated remaining: 2h 38m 52s. Rate: 7.1 symbols/min [2025-10-07T19:54:15.975597] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:54:15.978733] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:54:16.073180] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:54:16.092718] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:54:16.157823] [DEBUG] [LOCAL ] LC: Loaded 47861 existing records from primary storage. [2025-10-07T19:54:16.158959] [INFO ] [MAIN ] LC: Loaded 47861 existing records. [2025-10-07T19:54:16.200855] [DEBUG] [LOCAL ] LAZ: Loaded 44824 existing records from primary storage. [2025-10-07T19:54:16.217485] [INFO ] [MAIN ] LAZ: Loaded 44824 existing records. [2025-10-07T19:54:16.360197] [DEBUG] [LOCAL ] LB: Loaded 37793 existing records from primary storage. [2025-10-07T19:54:16.405880] [INFO ] [MAIN ] LB: Loaded 37793 existing records. [2025-10-07T19:54:16.639380] [DEBUG] [LOCAL ] LBRT: Loaded 52930 existing records from primary storage. [2025-10-07T19:54:16.661829] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:54:16.693892] [INFO ] [MAIN ] LBRT: Loaded 52930 existing records. [2025-10-07T19:54:16.751617] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-07T19:54:16.758077] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-07T19:54:16.757863] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:54:16.792087] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-07T19:54:16.797375] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-07T19:54:16.839858] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-07T19:54:16.826091] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-07T19:54:16.993161] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-07T19:54:17.055109] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:54:17.037463] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-07T19:54:17.101813] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-07T19:54:17.210549] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:54:17.204611] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-07T19:54:17.289060] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-07T19:54:17.311027] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-07T19:54:17.317899] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-07T19:54:17.318039] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-07T19:54:17.350238] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-07T19:54:17.355746] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-07T19:54:18.030614] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:54:18.103009] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-07T19:54:18.318588] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:54:18.360353] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-07T19:54:18.502909] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:54:18.513556] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-07T19:54:18.577549] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:54:18.577958] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-07T19:54:19.923876] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T19:54:19.933114] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-07T19:54:20.027404] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T19:54:20.038476] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-07T19:54:20.062615] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T19:54:20.071605] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-07T19:54:20.104284] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-07T19:54:20.114545] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-07T19:54:21.275532] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T19:54:21.285057] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-07T19:54:21.375769] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T19:54:21.447736] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-07T19:54:21.557690] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T19:54:21.650765] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T19:54:22.247744] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-07T19:54:22.807044] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T19:54:23.047732] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-07T19:54:23.170600] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T19:54:23.649117] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T19:54:23.847711] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-07T19:54:24.248568] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T19:54:24.647666] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-07T19:54:25.447733] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-07T19:54:25.655153] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T19:54:26.248021] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-07T19:54:26.250604] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T19:54:27.044306] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T19:54:27.054529] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-07T19:54:27.853701] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-07T19:54:27.872410] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T19:54:28.647625] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-07T19:54:28.669258] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T19:54:29.447636] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-07T19:54:29.498561] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T19:54:30.247758] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-07T19:54:30.440431] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T19:54:30.906491] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T19:54:31.047705] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-07T19:54:31.847705] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T19:54:31.847798] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-07T19:54:32.288100] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T19:54:32.647687] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-07T19:54:33.447702] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-07T19:54:33.720637] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T19:54:34.220475] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T19:54:34.247603] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-07T19:54:34.353320] [DEBUG] [REMOTE ] LC: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-07T19:54:34.353697] [WARN ] [REMOTE ] LC: No data returned for month 2025-07 [2025-10-07T19:54:34.353791] [FATAL] [REMOTE ] LC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T19:54:34.353874] [FATAL] [MAIN ] LC: Failed to fetch primary data. [2025-10-07T19:54:34.353911] [WARN ] [MAIN ] LC: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T19:54:34.353977] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-07T19:54:34.354044] [DEBUG] [LOCAL ] LC: No primary data file found to delete. [2025-10-07T19:54:34.354089] [INFO ] [LOCAL ] LC: Starting deletion of derivative data. [2025-10-07T19:54:34.354373] [DEBUG] [LOCAL ] LC: Deleted derivative data file. [2025-10-07T19:54:34.354464] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LC took 19.0s. Estimated remaining: 2h 38m 54s. Rate: 7.1 symbols/min [2025-10-07T19:54:34.531156] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:54:34.565347] [DEBUG] [LOCAL ] LCII: Loaded 27789 existing records from primary storage. [2025-10-07T19:54:34.565722] [INFO ] [MAIN ] LCII: Loaded 27789 existing records. [2025-10-07T19:54:34.753994] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:54:34.754344] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-07T19:54:34.754418] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-07T19:54:34.754729] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-07T19:54:34.754786] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-07T19:54:35.051220] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-07T19:54:35.133342] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:54:35.160064] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T19:54:35.847692] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-07T19:54:36.647676] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-07T19:54:36.728480] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T19:54:37.364385] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T19:54:37.447747] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-07T19:54:37.805949] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T19:54:38.247724] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-07T19:54:39.047627] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-07T19:54:39.202502] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T19:54:39.371495] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T19:54:39.847736] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-07T19:54:40.639971] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T19:54:40.649453] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-07T19:54:40.987175] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T19:54:41.447742] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-07T19:54:42.193344] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T19:54:42.247767] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-07T19:54:42.795225] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T19:54:43.047749] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-07T19:54:43.847751] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-07T19:54:43.928117] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T19:54:44.647753] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-07T19:54:44.953171] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T19:54:44.989029] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T19:54:45.447731] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-07T19:54:46.057157] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T19:54:46.247714] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-07T19:54:47.047690] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-07T19:54:47.181497] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T19:54:47.502614] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T19:54:47.505638] [INFO ] [REMOTE ] LB: Full fetch complete (55959 records). [2025-10-07T19:54:47.505783] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-07T19:54:47.857979] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-07T19:54:47.919194] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-07T19:54:47.919361] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-07T19:54:47.920769] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-07T19:54:47.920846] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-07T19:54:47.922711] [DEBUG] [LOCAL ] LB: Trimmed 55959 records to 37759 (keeping 200 days of data) [2025-10-07T19:54:48.180528] [DEBUG] [LOCAL ] LB: Primary data saved (37759 records). [2025-10-07T19:54:48.180767] [INFO ] [MAIN ] LB: Full history saved. [2025-10-07T19:54:48.180916] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LB took 32.8s. Estimated remaining: 2h 38m 50s. Rate: 7.1 symbols/min [2025-10-07T19:54:48.374830] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:54:48.425585] [DEBUG] [LOCAL ] LDI: Loaded 44307 existing records from primary storage. [2025-10-07T19:54:48.426096] [INFO ] [MAIN ] LDI: Loaded 44307 existing records. [2025-10-07T19:54:48.638841] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:54:48.639389] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-07T19:54:48.639516] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-07T19:54:48.640098] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-07T19:54:48.640241] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-07T19:54:48.654056] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-07T19:54:48.782232] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T19:54:49.069200] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:54:49.463112] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-07T19:54:49.473830] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T19:54:49.860399] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T19:54:50.247743] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-07T19:54:50.747737] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-07T19:54:51.047751] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-07T19:54:51.742011] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T19:54:51.847703] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-07T19:54:52.638090] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T19:54:52.643782] [INFO ] [REMOTE ] LBRT: Full fetch complete (76585 records). [2025-10-07T19:54:52.644012] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-07T19:54:52.652774] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-07T19:54:53.087255] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-07T19:54:53.088088] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-07T19:54:53.089752] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-07T19:54:53.090889] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-07T19:54:53.090775] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T19:54:53.099257] [DEBUG] [LOCAL ] LBRT: Trimmed 76585 records to 52933 (keeping 200 days of data) [2025-10-07T19:54:53.448098] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-07T19:54:53.470405] [DEBUG] [LOCAL ] LBRT: Primary data saved (52933 records). [2025-10-07T19:54:53.470668] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-07T19:54:53.470863] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LBRT took 38.1s. Estimated remaining: 2h 38m 39s. Rate: 7.1 symbols/min [2025-10-07T19:54:53.646380] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:54:53.696999] [DEBUG] [LOCAL ] LDOS: Loaded 45514 existing records from primary storage. [2025-10-07T19:54:53.697404] [INFO ] [MAIN ] LDOS: Loaded 45514 existing records. [2025-10-07T19:54:53.884887] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:54:53.885348] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-07T19:54:53.885407] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-07T19:54:53.885831] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-07T19:54:53.885893] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-07T19:54:54.239405] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T19:54:54.278760] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-07T19:54:54.316267] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:54:54.636582] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T19:54:54.639667] [INFO ] [REMOTE ] LAZ: Full fetch complete (65861 records). [2025-10-07T19:54:54.639786] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-07T19:54:55.039134] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-07T19:54:55.039249] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-07T19:54:55.041568] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-07T19:54:55.041664] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-07T19:54:55.043796] [DEBUG] [LOCAL ] LAZ: Trimmed 65861 records to 44783 (keeping 200 days of data) [2025-10-07T19:54:55.047751] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-07T19:54:55.352845] [DEBUG] [LOCAL ] LAZ: Primary data saved (44783 records). [2025-10-07T19:54:55.353014] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-07T19:54:55.353101] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LAZ took 40.0s. Estimated remaining: 2h 38m 24s. Rate: 7.1 symbols/min [2025-10-07T19:54:55.522601] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:54:55.538820] [DEBUG] [LOCAL ] LDP: Loaded 12935 existing records from primary storage. [2025-10-07T19:54:55.539340] [INFO ] [MAIN ] LDP: Loaded 12935 existing records. [2025-10-07T19:54:55.724842] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:54:55.725239] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-07T19:54:55.731579] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-07T19:54:55.742672] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-07T19:54:55.742742] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-07T19:54:55.743479] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T19:54:55.853927] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-07T19:54:56.112016] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:54:56.445639] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T19:54:56.647724] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-07T19:54:57.447692] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-07T19:54:57.621452] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T19:54:57.864231] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T19:54:58.247698] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-07T19:54:58.898665] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T19:54:59.047628] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-07T19:54:59.284854] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T19:54:59.730584] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T19:54:59.847712] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-07T19:55:00.647724] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-07T19:55:00.810688] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T19:55:01.447718] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-07T19:55:01.694399] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T19:55:01.697257] [INFO ] [REMOTE ] LCII: Full fetch complete (39187 records). [2025-10-07T19:55:01.697495] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-07T19:55:02.111555] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-07T19:55:02.111684] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-07T19:55:02.112543] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-07T19:55:02.112619] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-07T19:55:02.113827] [DEBUG] [LOCAL ] LCII: Trimmed 39187 records to 27755 (keeping 200 days of data) [2025-10-07T19:55:02.247739] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-07T19:55:02.321541] [DEBUG] [LOCAL ] LCII: Primary data saved (27755 records). [2025-10-07T19:55:02.321750] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-07T19:55:02.321868] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LCII took 28.0s. Estimated remaining: 2h 38m 15s. Rate: 7.1 symbols/min [2025-10-07T19:55:02.501506] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:55:02.548451] [DEBUG] [LOCAL ] LEA: Loaded 41699 existing records from primary storage. [2025-10-07T19:55:02.548864] [INFO ] [MAIN ] LEA: Loaded 41699 existing records. [2025-10-07T19:55:02.742601] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:55:02.742984] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-07T19:55:02.743038] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-07T19:55:02.743286] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-07T19:55:02.743347] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-07T19:55:03.058091] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-07T19:55:03.171092] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:55:03.175971] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T19:55:03.754422] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T19:55:03.847609] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-07T19:55:03.981425] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T19:55:04.647677] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-07T19:55:05.296479] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T19:55:05.447712] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-07T19:55:06.039350] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-07T19:55:06.247686] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-07T19:55:06.947899] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T19:55:07.047611] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-07T19:55:07.847729] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-07T19:55:08.033248] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T19:55:08.647632] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-07T19:55:08.742291] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T19:55:08.812252] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T19:55:09.447688] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-07T19:55:10.000200] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T19:55:10.031703] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-07T19:55:10.247687] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-07T19:55:11.047748] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-07T19:55:11.732298] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T19:55:11.847609] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-07T19:55:12.647766] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-07T19:55:12.908543] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T19:55:13.358760] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T19:55:13.447613] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-07T19:55:13.558873] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T19:55:14.247758] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-07T19:55:15.048266] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T19:55:15.048340] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-07T19:55:15.551207] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T19:55:15.847762] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-07T19:55:16.539090] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T19:55:16.647754] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-07T19:55:17.447730] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-07T19:55:17.497604] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T19:55:18.047418] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-07T19:55:18.247738] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-07T19:55:18.973878] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T19:55:19.047600] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-07T19:55:19.847736] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-07T19:55:20.374220] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-07T19:55:20.377807] [INFO ] [REMOTE ] LDI: Full fetch complete (60950 records). [2025-10-07T19:55:20.377925] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-07T19:55:20.576583] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:55:20.657851] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-07T19:55:20.795158] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-07T19:55:20.795249] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-07T19:55:20.796162] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-07T19:55:20.796228] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-07T19:55:20.797534] [DEBUG] [LOCAL ] LDI: Trimmed 60950 records to 44391 (keeping 200 days of data) [2025-10-07T19:55:21.056154] [DEBUG] [LOCAL ] LDI: Primary data saved (44391 records). [2025-10-07T19:55:21.056324] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-07T19:55:21.056484] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LDI took 32.9s. Estimated remaining: 2h 38m 15s. Rate: 7.1 symbols/min [2025-10-07T19:55:21.224011] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:55:21.270676] [DEBUG] [LOCAL ] LEG: Loaded 50198 existing records from primary storage. [2025-10-07T19:55:21.271053] [INFO ] [MAIN ] LEG: Loaded 50198 existing records. [2025-10-07T19:55:21.448972] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:55:21.449140] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-07T19:55:21.449734] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-07T19:55:21.449876] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-07T19:55:21.451087] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-07T19:55:21.451205] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-07T19:55:21.661617] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T19:55:21.744522] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T19:55:21.857492] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:55:22.247721] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-07T19:55:22.995720] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T19:55:23.047607] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-07T19:55:23.066947] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T19:55:23.847749] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-07T19:55:24.604265] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T19:55:24.647618] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-07T19:55:25.163445] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T19:55:25.447637] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-07T19:55:26.093196] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T19:55:26.247620] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-07T19:55:26.270725] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T19:55:27.047718] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-07T19:55:27.847617] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-07T19:55:27.909852] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T19:55:28.643561] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T19:55:28.652456] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-07T19:55:29.141584] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T19:55:29.439993] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T19:55:29.441407] [INFO ] [REMOTE ] LDP: Full fetch complete (19272 records). [2025-10-07T19:55:29.441485] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-07T19:55:29.453422] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-07T19:55:29.819348] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-07T19:55:29.819439] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-07T19:55:29.819938] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-07T19:55:29.820002] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-07T19:55:29.820594] [DEBUG] [LOCAL ] LDP: Trimmed 19272 records to 12973 (keeping 200 days of data) [2025-10-07T19:55:29.901217] [DEBUG] [LOCAL ] LDP: Primary data saved (12973 records). [2025-10-07T19:55:29.901402] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-07T19:55:29.901506] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDP took 34.5s. Estimated remaining: 2h 38m 7s. Rate: 7.1 symbols/min [2025-10-07T19:55:30.066820] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:55:30.126781] [DEBUG] [LOCAL ] LEN: Loaded 53172 existing records from primary storage. [2025-10-07T19:55:30.127148] [INFO ] [MAIN ] LEN: Loaded 53172 existing records. [2025-10-07T19:55:30.262300] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-07T19:55:30.303245] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:55:30.303847] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-07T19:55:30.303980] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-07T19:55:30.306016] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-07T19:55:30.306078] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-07T19:55:30.666960] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:55:31.047622] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-07T19:55:31.083484] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:55:31.847623] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-07T19:55:32.035207] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T19:55:32.647693] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-07T19:55:32.817006] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T19:55:33.447728] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-07T19:55:33.554687] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T19:55:34.029957] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T19:55:34.033396] [INFO ] [REMOTE ] LEA: Full fetch complete (60788 records). [2025-10-07T19:55:34.033586] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-07T19:55:34.257046] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-07T19:55:34.468802] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-07T19:55:34.468885] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-07T19:55:34.469745] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-07T19:55:34.469812] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-07T19:55:34.471245] [DEBUG] [LOCAL ] LEA: Trimmed 60788 records to 41646 (keeping 200 days of data) [2025-10-07T19:55:34.736692] [DEBUG] [LOCAL ] LEA: Primary data saved (41646 records). [2025-10-07T19:55:34.736845] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-07T19:55:34.736931] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LEA took 32.4s. Estimated remaining: 2h 37m 56s. Rate: 7.1 symbols/min [2025-10-07T19:55:34.912510] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:55:34.950784] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T19:55:34.972379] [DEBUG] [LOCAL ] LEO: Loaded 16913 existing records from primary storage. [2025-10-07T19:55:34.973154] [INFO ] [MAIN ] LEO: Loaded 16913 existing records. [2025-10-07T19:55:35.052902] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-07T19:55:35.152684] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:55:35.152970] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-07T19:55:35.153074] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-07T19:55:35.153829] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-07T19:55:35.153890] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-07T19:55:35.534984] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:55:35.847720] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-07T19:55:36.003730] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T19:55:36.647683] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-07T19:55:36.931453] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-07T19:55:37.447759] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-07T19:55:37.530270] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T19:55:38.218689] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T19:55:38.221877] [INFO ] [REMOTE ] LDOS: Full fetch complete (67500 records). [2025-10-07T19:55:38.221995] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-07T19:55:38.247679] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-07T19:55:38.410423] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-07T19:55:38.625035] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-07T19:55:38.625124] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-07T19:55:38.626025] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-07T19:55:38.626090] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-07T19:55:38.627543] [DEBUG] [LOCAL ] LDOS: Trimmed 67500 records to 45428 (keeping 200 days of data) [2025-10-07T19:55:38.919148] [DEBUG] [LOCAL ] LDOS: Primary data saved (45428 records). [2025-10-07T19:55:38.919417] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-07T19:55:38.919512] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDOS took 45.4s. Estimated remaining: 2h 37m 43s. Rate: 7.1 symbols/min [2025-10-07T19:55:39.055335] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-07T19:55:39.086744] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:55:39.136515] [DEBUG] [LOCAL ] LEVI: Loaded 51645 existing records from primary storage. [2025-10-07T19:55:39.136890] [INFO ] [MAIN ] LEVI: Loaded 51645 existing records. [2025-10-07T19:55:39.310120] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:55:39.310382] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-07T19:55:39.310434] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-07T19:55:39.312333] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-07T19:55:39.312395] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-07T19:55:39.675302] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:55:39.847688] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-07T19:55:39.968393] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T19:55:40.020137] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T19:55:40.647726] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-07T19:55:41.447618] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-07T19:55:41.506365] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T19:55:41.807865] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T19:55:42.247700] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-07T19:55:43.047626] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-07T19:55:43.234102] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T19:55:43.383010] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T19:55:43.847730] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-07T19:55:44.549381] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T19:55:44.647727] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-07T19:55:45.447674] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-07T19:55:45.586813] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T19:55:46.249974] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-07T19:55:46.252701] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T19:55:46.657999] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T19:55:47.047737] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-07T19:55:47.847710] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-07T19:55:47.931512] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T19:55:48.647637] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-07T19:55:48.770536] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T19:55:49.291910] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T19:55:49.447712] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-07T19:55:49.479807] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T19:55:50.247696] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-07T19:55:51.047712] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-07T19:55:51.307732] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T19:55:51.847729] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-07T19:55:52.006810] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T19:55:52.647622] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-07T19:55:52.874909] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T19:55:53.243015] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T19:55:53.447723] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-07T19:55:54.226946] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T19:55:54.247688] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-07T19:55:55.047740] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-07T19:55:55.260970] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T19:55:55.722561] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T19:55:55.726050] [INFO ] [REMOTE ] LEG: Full fetch complete (73054 records). [2025-10-07T19:55:55.726208] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-07T19:55:55.852858] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-07T19:55:56.170797] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T19:55:56.175321] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-07T19:55:56.180284] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-07T19:55:56.182991] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-07T19:55:56.183672] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-07T19:55:56.185667] [DEBUG] [LOCAL ] LEG: Trimmed 73054 records to 50216 (keeping 200 days of data) [2025-10-07T19:55:56.519151] [DEBUG] [LOCAL ] LEG: Primary data saved (50216 records). [2025-10-07T19:55:56.519351] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-07T19:55:56.519458] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEG took 35.5s. Estimated remaining: 2h 37m 43s. Rate: 7.1 symbols/min [2025-10-07T19:55:56.656135] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-07T19:55:56.687964] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:55:56.707285] [DEBUG] [LOCAL ] LFT: Loaded 18421 existing records from primary storage. [2025-10-07T19:55:56.707607] [INFO ] [MAIN ] LFT: Loaded 18421 existing records. [2025-10-07T19:55:56.884621] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:55:56.884962] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-07T19:55:56.885014] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-07T19:55:56.885845] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-07T19:55:56.885908] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-07T19:55:57.314060] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:55:57.447722] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-07T19:55:57.646413] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T19:55:57.826777] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T19:55:58.247741] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-07T19:55:59.058986] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-07T19:55:59.083131] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T19:55:59.332760] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T19:55:59.847725] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-07T19:56:00.647690] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-07T19:56:01.164482] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-07T19:56:01.227417] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T19:56:01.447628] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-07T19:56:01.800108] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T19:56:02.247680] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-07T19:56:03.047625] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-07T19:56:03.220311] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T19:56:03.799532] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-07T19:56:03.847605] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-07T19:56:04.047023] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T19:56:04.647726] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-07T19:56:05.447702] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-07T19:56:05.892496] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-07T19:56:05.896180] [INFO ] [REMOTE ] LEN: Full fetch complete (77046 records). [2025-10-07T19:56:05.896350] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-07T19:56:06.251073] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-07T19:56:06.297892] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-07T19:56:06.299522] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-07T19:56:06.307434] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T19:56:06.308995] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-07T19:56:06.312856] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-07T19:56:06.374845] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T19:56:06.385440] [DEBUG] [LOCAL ] LEN: Trimmed 77046 records to 53171 (keeping 200 days of data) [2025-10-07T19:56:06.733434] [DEBUG] [LOCAL ] LEN: Primary data saved (53171 records). [2025-10-07T19:56:06.733609] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-07T19:56:06.735303] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEN took 36.8s. Estimated remaining: 2h 37m 36s. Rate: 7.1 symbols/min [2025-10-07T19:56:06.904128] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:56:06.916603] [DEBUG] [LOCAL ] LGI: Loaded 9902 existing records from primary storage. [2025-10-07T19:56:06.916886] [INFO ] [MAIN ] LGI: Loaded 9902 existing records. [2025-10-07T19:56:07.053765] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-07T19:56:07.097603] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:56:07.098238] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-07T19:56:07.098350] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-07T19:56:07.098962] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-07T19:56:07.099056] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-07T19:56:07.202296] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T19:56:07.220176] [INFO ] [REMOTE ] LEO: Full fetch complete (26705 records). [2025-10-07T19:56:07.244733] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-07T19:56:07.714247] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:56:07.853804] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-07T19:56:07.856812] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-07T19:56:07.856921] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-07T19:56:07.857589] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-07T19:56:07.857822] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-07T19:56:07.858871] [DEBUG] [LOCAL ] LEO: Trimmed 26705 records to 16872 (keeping 200 days of data) [2025-10-07T19:56:07.958180] [DEBUG] [LOCAL ] LEO: Primary data saved (16872 records). [2025-10-07T19:56:07.958369] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-07T19:56:07.958506] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 33.2s. Estimated remaining: 2h 37m 21s. Rate: 7.1 symbols/min [2025-10-07T19:56:08.130036] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:56:08.167176] [DEBUG] [LOCAL ] LH: Loaded 37790 existing records from primary storage. [2025-10-07T19:56:08.167520] [INFO ] [MAIN ] LH: Loaded 37790 existing records. [2025-10-07T19:56:08.340797] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:56:08.341090] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-07T19:56:08.341139] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-07T19:56:08.342588] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-07T19:56:08.342686] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-07T19:56:08.648278] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-07T19:56:08.725290] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:56:08.735995] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T19:56:08.865706] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T19:56:09.447716] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-07T19:56:09.471079] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-07T19:56:10.247708] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-07T19:56:11.007870] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T19:56:11.016611] [INFO ] [REMOTE ] LEVI: Full fetch complete (74528 records). [2025-10-07T19:56:11.016766] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-07T19:56:11.052956] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-07T19:56:11.149863] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T19:56:11.429180] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-07T19:56:11.429279] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-07T19:56:11.430277] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-07T19:56:11.430347] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-07T19:56:11.431952] [DEBUG] [LOCAL ] LEVI: Trimmed 74528 records to 51650 (keeping 200 days of data) [2025-10-07T19:56:11.748682] [DEBUG] [LOCAL ] LEVI: Primary data saved (51650 records). [2025-10-07T19:56:11.748844] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-07T19:56:11.748927] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEVI took 32.8s. Estimated remaining: 2h 37m 9s. Rate: 7.1 symbols/min [2025-10-07T19:56:11.852766] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-07T19:56:11.928437] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:56:11.972843] [DEBUG] [LOCAL ] LHX: Loaded 48609 existing records from primary storage. [2025-10-07T19:56:11.973229] [INFO ] [MAIN ] LHX: Loaded 48609 existing records. [2025-10-07T19:56:12.150485] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:56:12.150850] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-07T19:56:12.150911] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-07T19:56:12.152990] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-07T19:56:12.153054] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-07T19:56:12.514337] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:56:12.648217] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-07T19:56:12.648129] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T19:56:12.928481] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T19:56:13.399145] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T19:56:13.447668] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-07T19:56:14.247721] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-07T19:56:14.532707] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T19:56:15.047868] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-07T19:56:15.545535] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T19:56:15.847693] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-07T19:56:16.257455] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T19:56:16.647673] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-07T19:56:16.895077] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T19:56:17.447703] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-07T19:56:18.200425] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T19:56:18.247596] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-07T19:56:18.258874] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T19:56:19.047674] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-07T19:56:19.855171] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-07T19:56:19.860935] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T19:56:19.910808] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T19:56:20.651170] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-07T19:56:20.653420] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T19:56:21.447607] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-07T19:56:21.750205] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T19:56:22.247685] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-07T19:56:23.047702] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-07T19:56:23.138710] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T19:56:23.170513] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T19:56:23.847745] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-07T19:56:24.647740] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-07T19:56:24.785548] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T19:56:24.815822] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T19:56:25.435763] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T19:56:25.447612] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-07T19:56:26.247751] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-07T19:56:26.439364] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T19:56:27.047674] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-07T19:56:27.749486] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-07T19:56:27.847699] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-07T19:56:27.987751] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T19:56:28.647732] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-07T19:56:29.450476] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-07T19:56:29.452273] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T19:56:29.474801] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T19:56:29.477438] [INFO ] [REMOTE ] LFT: Full fetch complete (24052 records). [2025-10-07T19:56:29.477701] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-07T19:56:29.917048] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-07T19:56:29.917223] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-07T19:56:29.918116] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-07T19:56:29.918217] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-07T19:56:29.919449] [DEBUG] [LOCAL ] LFT: Trimmed 24052 records to 18415 (keeping 200 days of data) [2025-10-07T19:56:30.043666] [DEBUG] [LOCAL ] LFT: Primary data saved (18415 records). [2025-10-07T19:56:30.043904] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-07T19:56:30.044068] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LFT took 33.5s. Estimated remaining: 2h 37m 9s. Rate: 7.1 symbols/min [2025-10-07T19:56:30.157225] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T19:56:30.170386] [INFO ] [REMOTE ] LGI: Full fetch complete (14293 records). [2025-10-07T19:56:30.208500] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-07T19:56:30.240574] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:56:30.252866] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-07T19:56:30.578070] [DEBUG] [LOCAL ] LII: Loaded 28022 existing records from primary storage. [2025-10-07T19:56:30.584119] [INFO ] [MAIN ] LII: Loaded 28022 existing records. [2025-10-07T19:56:30.783109] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-07T19:56:30.798671] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-07T19:56:30.809801] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-07T19:56:30.823258] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-07T19:56:30.868996] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:56:30.869105] [DEBUG] [LOCAL ] LGI: Trimmed 14293 records to 9857 (keeping 200 days of data) [2025-10-07T19:56:30.869458] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-07T19:56:30.869852] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-07T19:56:30.870189] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-07T19:56:30.870251] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-07T19:56:31.049145] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-07T19:56:31.253298] [DEBUG] [LOCAL ] LGI: Primary data saved (9857 records). [2025-10-07T19:56:31.274064] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-07T19:56:31.309386] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LGI took 24.6s. Estimated remaining: 2h 36m 54s. Rate: 7.1 symbols/min [2025-10-07T19:56:31.368955] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:56:31.510357] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:56:31.555472] [DEBUG] [LOCAL ] LION: Loaded 44843 existing records from primary storage. [2025-10-07T19:56:31.555832] [INFO ] [MAIN ] LION: Loaded 44843 existing records. [2025-10-07T19:56:31.734904] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:56:31.735244] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-07T19:56:31.735296] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-07T19:56:31.736980] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-07T19:56:31.737042] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-07T19:56:31.861425] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-07T19:56:32.063957] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T19:56:32.131703] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:56:32.474610] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T19:56:32.647615] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-07T19:56:33.192966] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T19:56:33.447758] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-07T19:56:34.233922] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T19:56:34.247613] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-07T19:56:34.800738] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T19:56:35.047745] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-07T19:56:35.576578] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T19:56:35.847672] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-07T19:56:36.076796] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T19:56:36.647785] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-07T19:56:37.184107] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T19:56:37.447718] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-07T19:56:37.744384] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T19:56:38.247732] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-07T19:56:38.392734] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T19:56:38.395920] [INFO ] [REMOTE ] LH: Full fetch complete (55024 records). [2025-10-07T19:56:38.396068] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-07T19:56:38.806547] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-07T19:56:38.806736] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-07T19:56:38.807963] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-07T19:56:38.808034] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-07T19:56:38.809902] [DEBUG] [LOCAL ] LH: Trimmed 55024 records to 37744 (keeping 200 days of data) [2025-10-07T19:56:39.055736] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-07T19:56:39.082542] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T19:56:39.120943] [DEBUG] [LOCAL ] LH: Primary data saved (37744 records). [2025-10-07T19:56:39.121187] [INFO ] [MAIN ] LH: Full history saved. [2025-10-07T19:56:39.121332] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LH took 31.2s. Estimated remaining: 2h 36m 45s. Rate: 7.1 symbols/min [2025-10-07T19:56:39.300318] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:56:39.307089] [DEBUG] [LOCAL ] LITB: Loaded 4278 existing records from primary storage. [2025-10-07T19:56:39.307324] [INFO ] [MAIN ] LITB: Loaded 4278 existing records. [2025-10-07T19:56:39.494455] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:56:39.494964] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-07T19:56:39.495016] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-07T19:56:39.495346] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-07T19:56:39.495406] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-07T19:56:39.852858] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-07T19:56:39.901759] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:56:40.647731] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-07T19:56:40.768832] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T19:56:41.225401] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T19:56:41.225280] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T19:56:41.447739] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-07T19:56:42.247728] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-07T19:56:42.464102] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-07T19:56:43.047692] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-07T19:56:43.526398] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T19:56:43.685202] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T19:56:43.847715] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-07T19:56:44.647694] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-07T19:56:45.226583] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T19:56:45.253302] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T19:56:45.447698] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-07T19:56:46.247717] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-07T19:56:46.793777] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T19:56:46.948422] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T19:56:47.047669] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-07T19:56:47.847749] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-07T19:56:48.548050] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T19:56:48.614826] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-07T19:56:48.647602] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-07T19:56:49.110637] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-07T19:56:49.447684] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-07T19:56:50.247723] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-07T19:56:50.761677] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T19:56:51.047703] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-07T19:56:51.847739] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-07T19:56:52.101768] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T19:56:52.167030] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T19:56:52.647740] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-07T19:56:52.945840] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-07T19:56:53.447611] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-07T19:56:53.617769] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T19:56:53.882174] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-07T19:56:54.247742] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-07T19:56:54.688325] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T19:56:55.047636] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-07T19:56:55.747943] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-07T19:56:55.847623] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-07T19:56:56.349871] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T19:56:56.350780] [INFO ] [REMOTE ] LITB: Full fetch complete (5648 records). [2025-10-07T19:56:56.350849] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-07T19:56:56.652821] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-07T19:56:56.717722] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-07T19:56:56.717820] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-07T19:56:56.718003] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-07T19:56:56.718045] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-07T19:56:56.718436] [DEBUG] [LOCAL ] LITB: Trimmed 5648 records to 4268 (keeping 200 days of data) [2025-10-07T19:56:56.743200] [DEBUG] [LOCAL ] LITB: Primary data saved (4268 records). [2025-10-07T19:56:56.743293] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-07T19:56:56.743371] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LITB took 17.6s. Estimated remaining: 2h 36m 45s. Rate: 7.1 symbols/min [2025-10-07T19:56:56.907435] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:56:56.959687] [DEBUG] [LOCAL ] LLY: Loaded 53304 existing records from primary storage. [2025-10-07T19:56:56.960070] [INFO ] [MAIN ] LLY: Loaded 53304 existing records. [2025-10-07T19:56:57.131923] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:56:57.132170] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-07T19:56:57.132218] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-07T19:56:57.132440] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-07T19:56:57.132497] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-07T19:56:57.456976] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-07T19:56:57.488095] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:56:58.247674] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-07T19:56:58.397103] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T19:56:58.894827] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T19:56:59.047713] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-07T19:56:59.847729] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-07T19:57:00.556705] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-07T19:57:00.647813] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-07T19:57:00.647738] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T19:57:01.141620] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-07T19:57:01.447690] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-07T19:57:02.247730] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-07T19:57:03.047744] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-07T19:57:03.130994] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-07T19:57:03.349194] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T19:57:03.847638] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-07T19:57:03.943676] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T19:57:04.308908] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T19:57:04.647744] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-07T19:57:05.447782] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-07T19:57:06.229523] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T19:57:06.247591] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-07T19:57:06.311716] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-07T19:57:07.047683] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-07T19:57:07.359930] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T19:57:07.543003] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T19:57:07.546371] [INFO ] [REMOTE ] LION: Full fetch complete (55842 records). [2025-10-07T19:57:07.546471] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-07T19:57:07.854721] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-07T19:57:08.014353] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-07T19:57:08.020575] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-07T19:57:08.021663] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-07T19:57:08.021750] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-07T19:57:08.023311] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T19:57:08.026591] [INFO ] [REMOTE ] LII: Full fetch complete (41516 records). [2025-10-07T19:57:08.026717] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-07T19:57:08.026942] [DEBUG] [LOCAL ] LION: Trimmed 55842 records to 45160 (keeping 200 days of data) [2025-10-07T19:57:08.534139] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-07T19:57:08.534553] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-07T19:57:08.535900] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-07T19:57:08.535991] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-07T19:57:08.539336] [DEBUG] [LOCAL ] LII: Trimmed 41516 records to 28025 (keeping 200 days of data) [2025-10-07T19:57:08.648344] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-07T19:57:08.844885] [DEBUG] [LOCAL ] LII: Primary data saved (28025 records). [2025-10-07T19:57:08.845852] [INFO ] [MAIN ] LII: Full history saved. [2025-10-07T19:57:08.846267] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 38.8s. Estimated remaining: 2h 36m 40s. Rate: 7.1 symbols/min [2025-10-07T19:57:09.059628] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:57:09.059721] [DEBUG] [LOCAL ] LION: Primary data saved (45160 records). [2025-10-07T19:57:09.059968] [INFO ] [MAIN ] LION: Full history saved. [2025-10-07T19:57:09.060391] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LION took 37.7s. Estimated remaining: 2h 36m 24s. Rate: 7.1 symbols/min [2025-10-07T19:57:09.230149] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:57:09.273211] [DEBUG] [LOCAL ] LMND: Loaded 51936 existing records from primary storage. [2025-10-07T19:57:09.273698] [INFO ] [MAIN ] LMND: Loaded 51936 existing records. [2025-10-07T19:57:09.518740] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:57:09.520625] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-07T19:57:09.520744] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-07T19:57:09.521759] [DEBUG] [LOCAL ] LMT: Loaded 49826 existing records from primary storage. [2025-10-07T19:57:09.522227] [INFO ] [MAIN ] LMT: Loaded 49826 existing records. [2025-10-07T19:57:09.553479] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-07T19:57:09.602226] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-07T19:57:09.828584] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:57:09.852494] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-07T19:57:09.852614] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-07T19:57:09.885577] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-07T19:57:09.921089] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-07T19:57:10.314887] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:57:10.340404] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-07T19:57:10.483758] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:57:10.484138] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-07T19:57:10.513379] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T19:57:10.553614] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-07T19:57:11.047727] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-07T19:57:11.847718] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-07T19:57:12.427560] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T19:57:12.520902] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T19:57:12.558386] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-07T19:57:12.647600] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-07T19:57:13.447753] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-07T19:57:14.257042] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-07T19:57:14.263697] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-07T19:57:14.705459] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-07T19:57:15.047706] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-07T19:57:15.115635] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T19:57:15.118831] [INFO ] [REMOTE ] LHX: Full fetch complete (70653 records). [2025-10-07T19:57:15.118942] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-07T19:57:15.539254] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-07T19:57:15.539359] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-07T19:57:15.540316] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-07T19:57:15.540390] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-07T19:57:15.541932] [DEBUG] [LOCAL ] LHX: Trimmed 70653 records to 48596 (keeping 200 days of data) [2025-10-07T19:57:15.850752] [DEBUG] [LOCAL ] LHX: Primary data saved (48596 records). [2025-10-07T19:57:15.850874] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-07T19:57:15.851138] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-07T19:57:15.851277] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LHX took 1m 4s. Estimated remaining: 2h 36m 14s. Rate: 7.1 symbols/min [2025-10-07T19:57:16.030804] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:57:16.065098] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T19:57:16.116419] [DEBUG] [LOCAL ] LNC: Loaded 51637 existing records from primary storage. [2025-10-07T19:57:16.116863] [INFO ] [MAIN ] LNC: Loaded 51637 existing records. [2025-10-07T19:57:16.288982] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:57:16.289319] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-07T19:57:16.289367] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-07T19:57:16.290966] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-07T19:57:16.291025] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-07T19:57:16.635466] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:57:16.647601] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-07T19:57:17.447682] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-07T19:57:17.755199] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-07T19:57:17.931622] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-07T19:57:18.247714] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-07T19:57:18.339172] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T19:57:19.047726] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-07T19:57:19.351203] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-07T19:57:19.847704] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-07T19:57:20.647796] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-07T19:57:20.743411] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-07T19:57:20.826107] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T19:57:21.447751] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-07T19:57:22.062491] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-07T19:57:22.200049] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T19:57:22.247632] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-07T19:57:23.047736] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-07T19:57:23.081304] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T19:57:23.847759] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-07T19:57:24.221464] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T19:57:24.647624] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-07T19:57:24.843565] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T19:57:25.447726] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-07T19:57:26.247674] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-07T19:57:26.518341] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-07T19:57:26.563750] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T19:57:27.047769] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-07T19:57:27.387929] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T19:57:27.551401] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T19:57:27.847699] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-07T19:57:28.647693] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-07T19:57:29.220420] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-07T19:57:29.447636] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-07T19:57:30.247635] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-07T19:57:30.362859] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T19:57:30.407934] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-07T19:57:31.047715] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-07T19:57:31.354871] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T19:57:31.847639] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-07T19:57:32.093564] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T19:57:32.647713] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-07T19:57:32.780220] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T19:57:33.447691] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-07T19:57:34.072597] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-07T19:57:34.247708] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-07T19:57:35.052066] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-07T19:57:35.075536] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T19:57:35.203904] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-07T19:57:35.847725] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-07T19:57:35.894950] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T19:57:36.647691] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-07T19:57:37.182608] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-07T19:57:37.447730] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-07T19:57:37.558388] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T19:57:37.767321] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-07T19:57:37.771000] [INFO ] [REMOTE ] LLY: Full fetch complete (77274 records). [2025-10-07T19:57:37.771134] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-07T19:57:38.190577] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-07T19:57:38.190711] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-07T19:57:38.192250] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-07T19:57:38.192321] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-07T19:57:38.194337] [DEBUG] [LOCAL ] LLY: Trimmed 77274 records to 53301 (keeping 200 days of data) [2025-10-07T19:57:38.254700] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-07T19:57:38.581168] [DEBUG] [LOCAL ] LLY: Primary data saved (53301 records). [2025-10-07T19:57:38.581370] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-07T19:57:38.581477] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LLY took 41.8s. Estimated remaining: 2h 36m 18s. Rate: 7.1 symbols/min [2025-10-07T19:57:38.761297] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:57:38.788341] [DEBUG] [LOCAL ] LND: Loaded 4946 existing records from primary storage. [2025-10-07T19:57:38.805074] [INFO ] [MAIN ] LND: Loaded 4946 existing records. [2025-10-07T19:57:38.842168] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-07T19:57:39.026214] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:57:39.026498] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-07T19:57:39.026551] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-07T19:57:39.026895] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-07T19:57:39.026957] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-07T19:57:39.058123] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-07T19:57:39.428250] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:57:39.847734] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-07T19:57:39.998712] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T19:57:40.647697] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-07T19:57:40.675896] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-07T19:57:41.174786] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T19:57:41.447720] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-07T19:57:42.247732] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-07T19:57:42.329112] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T19:57:43.047692] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-07T19:57:43.546219] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-07T19:57:43.549525] [INFO ] [REMOTE ] LMT: Full fetch complete (72419 records). [2025-10-07T19:57:43.549639] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-07T19:57:43.852874] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-07T19:57:43.945951] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-07T19:57:43.946042] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-07T19:57:43.947151] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-07T19:57:43.947234] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-07T19:57:43.949050] [DEBUG] [LOCAL ] LMT: Trimmed 72419 records to 49815 (keeping 200 days of data) [2025-10-07T19:57:44.059078] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-07T19:57:44.070685] [INFO ] [REMOTE ] LMND: Full fetch complete (75319 records). [2025-10-07T19:57:44.072972] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-07T19:57:44.552572] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-07T19:57:44.653543] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-07T19:57:44.674636] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-07T19:57:44.675866] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-07T19:57:44.678189] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-07T19:57:44.678989] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-07T19:57:44.690305] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T19:57:44.694962] [DEBUG] [LOCAL ] LMND: Trimmed 75319 records to 51976 (keeping 200 days of data) [2025-10-07T19:57:44.695388] [INFO ] [REMOTE ] LNC: Full fetch complete (74370 records). [2025-10-07T19:57:44.696182] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-07T19:57:45.281763] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-07T19:57:45.282514] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-07T19:57:45.283988] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-07T19:57:45.284354] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-07T19:57:45.291370] [DEBUG] [LOCAL ] LNC: Trimmed 74370 records to 51640 (keeping 200 days of data) [2025-10-07T19:57:45.406496] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T19:57:45.422331] [DEBUG] [LOCAL ] LMT: Primary data saved (49815 records). [2025-10-07T19:57:45.423449] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-07T19:57:45.423615] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMT took 36.4s. Estimated remaining: 2h 36m 9s. Rate: 7.1 symbols/min [2025-10-07T19:57:45.447803] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-07T19:57:45.706061] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:57:45.896167] [DEBUG] [LOCAL ] LNG: Loaded 51321 existing records from primary storage. [2025-10-07T19:57:45.898721] [INFO ] [MAIN ] LNG: Loaded 51321 existing records. [2025-10-07T19:57:46.108839] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:57:46.140052] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-07T19:57:46.148320] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-07T19:57:46.167602] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-07T19:57:46.168788] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-07T19:57:46.303031] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T19:57:46.327130] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-07T19:57:46.388920] [DEBUG] [LOCAL ] LMND: Primary data saved (51976 records). [2025-10-07T19:57:46.397191] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-07T19:57:46.450380] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMND took 37.6s. Estimated remaining: 2h 35m 54s. Rate: 7.1 symbols/min [2025-10-07T19:57:46.632387] [DEBUG] [LOCAL ] LNC: Primary data saved (51640 records). [2025-10-07T19:57:46.654031] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-07T19:57:46.670726] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LNC took 30.8s. Estimated remaining: 2h 35m 38s. Rate: 7.1 symbols/min [2025-10-07T19:57:46.869324] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:57:46.922076] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:57:47.037715] [DEBUG] [LOCAL ] LNN: Loaded 11248 existing records from primary storage. [2025-10-07T19:57:47.037277] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:57:47.038102] [INFO ] [MAIN ] LNN: Loaded 11248 existing records. [2025-10-07T19:57:47.052826] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-07T19:57:47.137497] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T19:57:47.248595] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:57:47.248921] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-07T19:57:47.248973] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-07T19:57:47.249559] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-07T19:57:47.249618] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-07T19:57:47.361754] [DEBUG] [LOCAL ] LOAR: Loaded 42004 existing records from primary storage. [2025-10-07T19:57:47.377903] [INFO ] [MAIN ] LOAR: Loaded 42004 existing records. [2025-10-07T19:57:47.752069] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:57:47.770766] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-07T19:57:47.776452] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-07T19:57:47.801602] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-07T19:57:47.803802] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-07T19:57:47.808077] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:57:47.849806] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-07T19:57:48.154116] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:57:48.507055] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-07T19:57:48.647597] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-07T19:57:48.921518] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T19:57:48.999223] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-07T19:57:49.447744] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-07T19:57:50.043284] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-07T19:57:50.247696] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-07T19:57:50.675204] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T19:57:51.047678] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-07T19:57:51.847686] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-07T19:57:52.520535] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T19:57:52.647700] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-07T19:57:53.228365] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T19:57:53.447619] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-07T19:57:53.563101] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T19:57:54.035393] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T19:57:54.036432] [INFO ] [REMOTE ] LND: Full fetch complete (8262 records). [2025-10-07T19:57:54.036503] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-07T19:57:54.252802] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-07T19:57:54.403274] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-07T19:57:54.403380] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-07T19:57:54.403621] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-07T19:57:54.403707] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-07T19:57:54.404308] [DEBUG] [LOCAL ] LND: Trimmed 8262 records to 4946 (keeping 200 days of data) [2025-10-07T19:57:54.432974] [DEBUG] [LOCAL ] LND: Primary data saved (4946 records). [2025-10-07T19:57:54.433130] [INFO ] [MAIN ] LND: Full history saved. [2025-10-07T19:57:54.433220] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LND took 15.9s. Estimated remaining: 2h 35m 29s. Rate: 7.1 symbols/min [2025-10-07T19:57:54.607727] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:57:54.638669] [DEBUG] [LOCAL ] LOB: Loaded 27291 existing records from primary storage. [2025-10-07T19:57:54.639062] [INFO ] [MAIN ] LOB: Loaded 27291 existing records. [2025-10-07T19:57:54.822305] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:57:54.822585] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-07T19:57:54.822636] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-07T19:57:54.824038] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-07T19:57:54.824100] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-07T19:57:55.052910] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-07T19:57:55.209353] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:57:55.603125] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T19:57:55.847690] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-07T19:57:56.624133] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T19:57:56.647612] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-07T19:57:56.873739] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T19:57:57.447730] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-07T19:57:57.565979] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T19:57:58.247726] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-07T19:57:58.423122] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-07T19:57:59.047703] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-07T19:57:59.094202] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-07T19:57:59.847667] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-07T19:58:00.177824] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T19:58:00.647749] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-07T19:58:00.690684] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-07T19:58:01.447748] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-07T19:58:01.727832] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T19:58:02.247678] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-07T19:58:02.431929] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T19:58:03.047733] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-07T19:58:03.343849] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T19:58:03.847705] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-07T19:58:04.651831] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-07T19:58:04.655704] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T19:58:04.897836] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T19:58:05.447741] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-07T19:58:05.789828] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T19:58:06.247724] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-07T19:58:06.759048] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T19:58:07.047669] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-07T19:58:07.847678] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-07T19:58:08.130837] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T19:58:08.537298] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T19:58:08.647632] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-07T19:58:09.409931] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T19:58:09.447635] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-07T19:58:10.042542] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T19:58:10.247716] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-07T19:58:10.542198] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T19:58:11.047693] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-07T19:58:11.847766] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-07T19:58:12.055409] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T19:58:12.647677] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-07T19:58:12.745798] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T19:58:12.792199] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T19:58:13.447616] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-07T19:58:13.600528] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T19:58:14.247739] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-07T19:58:14.982979] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T19:58:15.047610] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-07T19:58:15.296892] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T19:58:15.847724] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-07T19:58:16.599543] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T19:58:16.635983] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T19:58:16.647608] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-07T19:58:17.421510] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T19:58:17.447599] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-07T19:58:18.219710] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T19:58:18.220952] [INFO ] [REMOTE ] LNN: Full fetch complete (15634 records). [2025-10-07T19:58:18.221023] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-07T19:58:18.252791] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-07T19:58:18.582986] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-07T19:58:18.583063] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-07T19:58:18.583403] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-07T19:58:18.583442] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-07T19:58:18.583962] [DEBUG] [LOCAL ] LNN: Trimmed 15634 records to 11291 (keeping 200 days of data) [2025-10-07T19:58:18.657752] [DEBUG] [LOCAL ] LNN: Primary data saved (11291 records). [2025-10-07T19:58:18.657888] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-07T19:58:18.657988] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LNN took 32.2s. Estimated remaining: 2h 35m 34s. Rate: 7.1 symbols/min [2025-10-07T19:58:18.823828] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:58:18.829994] [DEBUG] [LOCAL ] LOCL: Loaded 3628 existing records from primary storage. [2025-10-07T19:58:18.830198] [INFO ] [MAIN ] LOCL: Loaded 3628 existing records. [2025-10-07T19:58:19.003442] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:58:19.003661] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-07T19:58:19.003724] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-07T19:58:19.003910] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-07T19:58:19.003966] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-07T19:58:19.057227] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-07T19:58:19.358858] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:58:19.826080] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T19:58:19.847603] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-07T19:58:20.324560] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T19:58:20.647718] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-07T19:58:21.262430] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T19:58:21.447634] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-07T19:58:21.844527] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T19:58:22.247691] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-07T19:58:22.884626] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T19:58:23.047704] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-07T19:58:23.474373] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-07T19:58:23.847618] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-07T19:58:24.275996] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T19:58:24.647742] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-07T19:58:25.113680] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T19:58:25.117104] [INFO ] [REMOTE ] LOAR: Full fetch complete (56217 records). [2025-10-07T19:58:25.117214] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-07T19:58:25.460010] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-07T19:58:25.517153] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-07T19:58:25.517250] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-07T19:58:25.518145] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-07T19:58:25.518214] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-07T19:58:25.522096] [DEBUG] [LOCAL ] LOAR: Trimmed 56217 records to 42065 (keeping 200 days of data) [2025-10-07T19:58:25.777900] [DEBUG] [LOCAL ] LOAR: Primary data saved (42065 records). [2025-10-07T19:58:25.778054] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-07T19:58:25.778156] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LOAR took 39.1s. Estimated remaining: 2h 35m 25s. Rate: 7.1 symbols/min [2025-10-07T19:58:25.975141] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:58:26.017110] [DEBUG] [LOCAL ] LOMA: Loaded 32055 existing records from primary storage. [2025-10-07T19:58:26.017512] [INFO ] [MAIN ] LOMA: Loaded 32055 existing records. [2025-10-07T19:58:26.223623] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:58:26.223920] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-07T19:58:26.223976] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-07T19:58:26.224474] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-07T19:58:26.224535] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-07T19:58:26.267201] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-07T19:58:26.580476] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T19:58:26.594816] [INFO ] [REMOTE ] LOB: Full fetch complete (38019 records). [2025-10-07T19:58:26.625819] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-07T19:58:26.632137] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-07T19:58:26.672709] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:58:26.947997] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-07T19:58:27.056517] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-07T19:58:27.308273] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-07T19:58:27.308403] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-07T19:58:27.309692] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-07T19:58:27.309784] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-07T19:58:27.311360] [DEBUG] [LOCAL ] LOB: Trimmed 38019 records to 27203 (keeping 200 days of data) [2025-10-07T19:58:27.535846] [DEBUG] [LOCAL ] LOB: Primary data saved (27203 records). [2025-10-07T19:58:27.536012] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-07T19:58:27.536134] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOB took 33.1s. Estimated remaining: 2h 35m 10s. Rate: 7.1 symbols/min [2025-10-07T19:58:27.752101] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:58:27.812747] [DEBUG] [LOCAL ] LOW: Loaded 52956 existing records from primary storage. [2025-10-07T19:58:27.813261] [INFO ] [MAIN ] LOW: Loaded 52956 existing records. [2025-10-07T19:58:27.852792] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-07T19:58:28.026558] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:58:28.026901] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-07T19:58:28.026966] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-07T19:58:28.028117] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-07T19:58:28.028176] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-07T19:58:28.313775] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T19:58:28.400165] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:58:28.491805] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T19:58:28.647706] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-07T19:58:29.447725] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-07T19:58:29.918500] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T19:58:30.247625] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-07T19:58:30.342128] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T19:58:31.047691] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-07T19:58:31.856746] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-07T19:58:31.860169] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T19:58:31.876398] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T19:58:32.647748] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-07T19:58:33.447759] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-07T19:58:33.466238] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T19:58:33.469814] [INFO ] [REMOTE ] LNG: Full fetch complete (74628 records). [2025-10-07T19:58:33.469954] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-07T19:58:33.876974] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-07T19:58:33.877080] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-07T19:58:33.878184] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-07T19:58:33.878297] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-07T19:58:33.880021] [DEBUG] [LOCAL ] LNG: Trimmed 74628 records to 51300 (keeping 200 days of data) [2025-10-07T19:58:33.982284] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-07T19:58:34.247877] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-07T19:58:34.253159] [DEBUG] [LOCAL ] LNG: Primary data saved (51300 records). [2025-10-07T19:58:34.253377] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-07T19:58:34.254696] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 48.8s. Estimated remaining: 2h 35m 1s. Rate: 7.1 symbols/min [2025-10-07T19:58:34.428231] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:58:34.462356] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T19:58:34.505966] [DEBUG] [LOCAL ] LPG: Loaded 39788 existing records from primary storage. [2025-10-07T19:58:34.506296] [INFO ] [MAIN ] LPG: Loaded 39788 existing records. [2025-10-07T19:58:34.688906] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:58:34.689161] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-07T19:58:34.689223] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-07T19:58:34.689674] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-07T19:58:34.689735] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-07T19:58:34.770078] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-07T19:58:35.049568] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-07T19:58:35.074548] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:58:35.847637] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-07T19:58:36.659013] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-07T19:58:36.667596] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T19:58:37.334411] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-07T19:58:37.370902] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T19:58:37.447706] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-07T19:58:38.247681] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-07T19:58:39.047624] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-07T19:58:39.322870] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T19:58:39.576947] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-07T19:58:39.847692] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-07T19:58:39.899293] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T19:58:40.647703] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-07T19:58:41.447713] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-07T19:58:41.758630] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T19:58:41.826998] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-07T19:58:42.124057] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T19:58:42.247682] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-07T19:58:42.776273] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T19:58:42.777072] [INFO ] [REMOTE ] LOCL: Full fetch complete (4539 records). [2025-10-07T19:58:42.777146] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-07T19:58:43.053127] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-07T19:58:43.137388] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-07T19:58:43.137476] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-07T19:58:43.137617] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-07T19:58:43.137685] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-07T19:58:43.138132] [DEBUG] [LOCAL ] LOCL: Trimmed 4539 records to 3633 (keeping 200 days of data) [2025-10-07T19:58:43.158067] [DEBUG] [LOCAL ] LOCL: Primary data saved (3633 records). [2025-10-07T19:58:43.158134] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-07T19:58:43.158202] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOCL took 24.5s. Estimated remaining: 2h 34m 53s. Rate: 7.1 symbols/min [2025-10-07T19:58:43.323275] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:58:43.350312] [DEBUG] [LOCAL ] LPL: Loaded 26953 existing records from primary storage. [2025-10-07T19:58:43.350585] [INFO ] [MAIN ] LPL: Loaded 26953 existing records. [2025-10-07T19:58:43.523086] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:58:43.523315] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-07T19:58:43.523362] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-07T19:58:43.523683] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-07T19:58:43.523742] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-07T19:58:43.870297] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-07T19:58:43.875527] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:58:44.647610] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-07T19:58:45.055513] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T19:58:45.115326] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T19:58:45.447732] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-07T19:58:46.170849] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T19:58:46.247610] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-07T19:58:46.286104] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-07T19:58:47.047715] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-07T19:58:47.299715] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T19:58:47.847615] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-07T19:58:48.309684] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T19:58:48.647681] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-07T19:58:49.291960] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T19:58:49.447703] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-07T19:58:50.247713] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-07T19:58:50.424543] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T19:58:50.797038] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T19:58:51.047692] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-07T19:58:51.293986] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T19:58:51.847689] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-07T19:58:52.647668] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-07T19:58:53.014724] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T19:58:53.447772] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-07T19:58:53.503719] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T19:58:53.630836] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T19:58:54.247626] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-07T19:58:54.532887] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T19:58:55.047694] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-07T19:58:55.761066] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T19:58:55.847611] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-07T19:58:56.002591] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T19:58:56.647718] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-07T19:58:57.375625] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T19:58:57.401773] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T19:58:57.447698] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-07T19:58:58.247726] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-07T19:58:58.974439] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:58:59.047609] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-07T19:58:59.370066] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T19:58:59.847737] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-07T19:59:00.647769] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-07T19:59:01.143097] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-07T19:59:01.243706] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T19:59:01.447745] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-07T19:59:02.234971] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T19:59:02.247596] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-07T19:59:02.531858] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T19:59:03.047712] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-07T19:59:03.435670] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T19:59:03.847703] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-07T19:59:04.144872] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T19:59:04.647743] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-07T19:59:05.447635] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-07T19:59:05.906218] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-07T19:59:05.932267] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T19:59:06.247718] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-07T19:59:06.912170] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T19:59:07.047724] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-07T19:59:07.847716] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-07T19:59:08.061386] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-07T19:59:08.064924] [INFO ] [REMOTE ] LOW: Full fetch complete (76521 records). [2025-10-07T19:59:08.065035] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-07T19:59:08.377681] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T19:59:08.393957] [INFO ] [REMOTE ] LPG: Full fetch complete (59419 records). [2025-10-07T19:59:08.422275] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-07T19:59:08.582991] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-07T19:59:08.583155] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-07T19:59:08.584476] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-07T19:59:08.589943] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-07T19:59:08.659789] [DEBUG] [LOCAL ] LOW: Trimmed 76521 records to 52967 (keeping 200 days of data) [2025-10-07T19:59:08.659937] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-07T19:59:09.015141] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-07T19:59:09.015383] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-07T19:59:09.016341] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-07T19:59:09.070270] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-07T19:59:09.125899] [DEBUG] [LOCAL ] LPG: Trimmed 59419 records to 39729 (keeping 200 days of data) [2025-10-07T19:59:09.259961] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T19:59:09.382564] [DEBUG] [LOCAL ] LOW: Primary data saved (52967 records). [2025-10-07T19:59:09.383792] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-07T19:59:09.384157] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOW took 41.8s. Estimated remaining: 2h 34m 59s. Rate: 7.1 symbols/min [2025-10-07T19:59:09.450820] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-07T19:59:09.656846] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:59:09.696006] [DEBUG] [LOCAL ] LPG: Primary data saved (39729 records). [2025-10-07T19:59:09.696280] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-07T19:59:09.696403] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPG took 35.4s. Estimated remaining: 2h 34m 44s. Rate: 7.1 symbols/min [2025-10-07T19:59:09.855669] [DEBUG] [LOCAL ] LPX: Loaded 39722 existing records from primary storage. [2025-10-07T19:59:09.871500] [INFO ] [MAIN ] LPX: Loaded 39722 existing records. [2025-10-07T19:59:09.998359] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:59:10.052195] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T19:59:10.133946] [INFO ] [REMOTE ] LOMA: Full fetch complete (47776 records). [2025-10-07T19:59:10.134253] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-07T19:59:10.133766] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:59:10.135234] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-07T19:59:10.135339] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-07T19:59:10.147724] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-07T19:59:10.157216] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-07T19:59:10.392523] [DEBUG] [LOCAL ] LRN: Loaded 39757 existing records from primary storage. [2025-10-07T19:59:10.429346] [INFO ] [MAIN ] LRN: Loaded 39757 existing records. [2025-10-07T19:59:11.146768] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:59:11.175754] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-07T19:59:11.176634] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-07T19:59:11.155736] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:59:11.177192] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-07T19:59:11.193433] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-07T19:59:11.193624] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-07T19:59:11.238150] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-07T19:59:11.248622] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-07T19:59:11.264365] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-07T19:59:11.272428] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-07T19:59:11.300372] [DEBUG] [LOCAL ] LOMA: Trimmed 47776 records to 32169 (keeping 200 days of data) [2025-10-07T19:59:11.428207] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-07T19:59:11.594966] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-07T19:59:11.774781] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:59:11.800619] [DEBUG] [LOCAL ] LOMA: Primary data saved (32169 records). [2025-10-07T19:59:11.800871] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-07T19:59:11.800992] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LOMA took 46.0s. Estimated remaining: 2h 34m 30s. Rate: 7.1 symbols/min [2025-10-07T19:59:11.864610] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-07T19:59:11.985550] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:59:12.031859] [DEBUG] [LOCAL ] LSPD: Loaded 42804 existing records from primary storage. [2025-10-07T19:59:12.032238] [INFO ] [MAIN ] LSPD: Loaded 42804 existing records. [2025-10-07T19:59:12.211237] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:59:12.211619] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-07T19:59:12.211708] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-07T19:59:12.212123] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-07T19:59:12.212182] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-07T19:59:12.583568] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:59:12.647635] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-07T19:59:12.794324] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T19:59:13.155311] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T19:59:13.158132] [INFO ] [REMOTE ] LPL: Full fetch complete (35946 records). [2025-10-07T19:59:13.158222] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-07T19:59:13.452158] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-07T19:59:13.566041] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-07T19:59:13.566523] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-07T19:59:13.567951] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T19:59:13.568776] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-07T19:59:13.576967] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-07T19:59:13.577917] [DEBUG] [LOCAL ] LPL: Trimmed 35946 records to 27148 (keeping 200 days of data) [2025-10-07T19:59:13.735397] [DEBUG] [LOCAL ] LPL: Primary data saved (27148 records). [2025-10-07T19:59:13.735563] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-07T19:59:13.735686] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LPL took 30.6s. Estimated remaining: 2h 34m 16s. Rate: 7.1 symbols/min [2025-10-07T19:59:13.910345] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:59:13.941853] [DEBUG] [LOCAL ] LTC: Loaded 30240 existing records from primary storage. [2025-10-07T19:59:13.942264] [INFO ] [MAIN ] LTC: Loaded 30240 existing records. [2025-10-07T19:59:14.124484] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:59:14.146812] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-07T19:59:14.146929] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-07T19:59:14.147617] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-07T19:59:14.147713] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-07T19:59:14.148555] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T19:59:14.252891] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-07T19:59:14.559597] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:59:15.057869] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-07T19:59:15.063546] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T19:59:15.847634] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-07T19:59:15.993380] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T19:59:16.391909] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T19:59:16.647694] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-07T19:59:17.305539] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T19:59:17.424803] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T19:59:17.447628] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-07T19:59:18.247727] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-07T19:59:18.725782] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T19:59:19.047780] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-07T19:59:19.717875] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T19:59:19.847745] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-07T19:59:20.299193] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T19:59:20.647726] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-07T19:59:20.931404] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T19:59:21.447706] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-07T19:59:21.562064] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T19:59:22.247701] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-07T19:59:22.930320] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T19:59:23.047723] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-07T19:59:23.543914] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T19:59:23.847688] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-07T19:59:24.647679] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-07T19:59:24.692175] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T19:59:25.164497] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-07T19:59:25.447723] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-07T19:59:25.923369] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T19:59:26.247710] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-07T19:59:26.809608] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T19:59:27.047704] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-07T19:59:27.778270] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T19:59:27.847610] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-07T19:59:28.647874] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-07T19:59:28.694158] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T19:59:29.313923] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T19:59:29.447610] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-07T19:59:30.247637] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-07T19:59:30.333459] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T19:59:30.922691] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T19:59:31.047630] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-07T19:59:31.481704] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T19:59:31.847679] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-07T19:59:32.532947] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T19:59:32.647611] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-07T19:59:33.093171] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T19:59:33.447718] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-07T19:59:34.178753] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T19:59:34.247715] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-07T19:59:34.957734] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T19:59:35.047635] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-07T19:59:35.726287] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T19:59:35.847695] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-07T19:59:36.011972] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T19:59:36.647729] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-07T19:59:37.343131] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T19:59:37.447630] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-07T19:59:38.002092] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T19:59:38.247686] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-07T19:59:38.982192] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T19:59:39.047671] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-07T19:59:39.849126] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-07T19:59:39.851843] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T19:59:40.091507] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T19:59:40.094482] [INFO ] [REMOTE ] LPX: Full fetch complete (58823 records). [2025-10-07T19:59:40.094578] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-07T19:59:40.478268] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-07T19:59:40.478379] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-07T19:59:40.479322] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-07T19:59:40.479389] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-07T19:59:40.483165] [DEBUG] [LOCAL ] LPX: Trimmed 58823 records to 39780 (keeping 200 days of data) [2025-10-07T19:59:40.659415] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-07T19:59:40.730155] [DEBUG] [LOCAL ] LPX: Primary data saved (39780 records). [2025-10-07T19:59:40.730314] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-07T19:59:40.730418] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPX took 31.3s. Estimated remaining: 2h 34m 24s. Rate: 7.1 symbols/min [2025-10-07T19:59:40.903076] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:59:40.951126] [DEBUG] [LOCAL ] LTH: Loaded 51720 existing records from primary storage. [2025-10-07T19:59:40.951471] [INFO ] [MAIN ] LTH: Loaded 51720 existing records. [2025-10-07T19:59:41.144019] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:59:41.145141] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T19:59:41.148360] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-07T19:59:41.148677] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-07T19:59:41.149059] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-07T19:59:41.149171] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-07T19:59:41.148987] [INFO ] [REMOTE ] LTC: Full fetch complete (43509 records). [2025-10-07T19:59:41.191512] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-07T19:59:41.464388] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-07T19:59:41.837408] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:59:41.924811] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-07T19:59:41.924931] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-07T19:59:41.925890] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-07T19:59:41.925957] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-07T19:59:41.927197] [DEBUG] [LOCAL ] LTC: Trimmed 43509 records to 30225 (keeping 200 days of data) [2025-10-07T19:59:42.118629] [DEBUG] [LOCAL ] LTC: Primary data saved (30225 records). [2025-10-07T19:59:42.118798] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-07T19:59:42.118914] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LTC took 28.4s. Estimated remaining: 2h 34m 9s. Rate: 7.1 symbols/min [2025-10-07T19:59:42.249789] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-07T19:59:42.295204] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T19:59:42.321259] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T19:59:42.365353] [DEBUG] [LOCAL ] LTM: Loaded 37442 existing records from primary storage. [2025-10-07T19:59:42.365708] [INFO ] [MAIN ] LTM: Loaded 37442 existing records. [2025-10-07T19:59:42.545756] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T19:59:42.546007] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-07T19:59:42.546056] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-07T19:59:42.546360] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-07T19:59:42.546418] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-07T19:59:42.906204] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T19:59:43.047705] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-07T19:59:43.139299] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T19:59:43.817511] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T19:59:43.847601] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-07T19:59:44.109561] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T19:59:44.647696] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-07T19:59:45.225389] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T19:59:45.447691] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-07T19:59:45.954639] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T19:59:45.957294] [INFO ] [REMOTE ] LRN: Full fetch complete (58495 records). [2025-10-07T19:59:45.957420] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-07T19:59:46.253285] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-07T19:59:46.351562] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-07T19:59:46.351705] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-07T19:59:46.352587] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-07T19:59:46.352633] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-07T19:59:46.354125] [DEBUG] [LOCAL ] LRN: Trimmed 58495 records to 39718 (keeping 200 days of data) [2025-10-07T19:59:46.595707] [DEBUG] [LOCAL ] LRN: Primary data saved (39718 records). [2025-10-07T19:59:46.596688] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-07T19:59:46.596819] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LRN took 36.9s. Estimated remaining: 2h 33m 57s. Rate: 7.1 symbols/min [2025-10-07T19:59:47.047713] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-07T19:59:47.099312] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T19:59:47.155079] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T19:59:47.847706] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-07T19:59:48.506471] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T19:59:48.647619] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-07T19:59:48.685074] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T19:59:49.447879] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-07T19:59:50.087506] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T19:59:50.247730] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-07T19:59:50.284914] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-07T19:59:51.047723] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-07T19:59:51.762190] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T19:59:51.847682] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-07T19:59:52.275045] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T19:59:52.647748] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-07T19:59:53.415432] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T19:59:53.447600] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-07T19:59:53.925821] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T19:59:53.929215] [INFO ] [REMOTE ] LSPD: Full fetch complete (61756 records). [2025-10-07T19:59:53.929390] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-07T19:59:54.252806] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-07T19:59:54.324502] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-07T19:59:54.324607] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-07T19:59:54.325628] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-07T19:59:54.325716] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-07T19:59:54.327142] [DEBUG] [LOCAL ] LSPD: Trimmed 61756 records to 42822 (keeping 200 days of data) [2025-10-07T19:59:54.594700] [DEBUG] [LOCAL ] LSPD: Primary data saved (42822 records). [2025-10-07T19:59:54.595074] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-07T19:59:54.595232] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LSPD took 42.8s. Estimated remaining: 2h 33m 48s. Rate: 7.1 symbols/min [2025-10-07T19:59:55.199556] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T19:59:55.211121] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-07T19:59:55.270972] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T19:59:55.847757] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-07T19:59:57.184404] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T19:59:57.195525] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-07T19:59:57.248100] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T19:59:57.447617] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-07T19:59:58.875775] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T19:59:58.887048] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-07T19:59:58.982449] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T19:59:59.047622] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-07T20:00:00.638699] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T20:00:00.647970] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-07T20:00:00.741812] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T20:00:00.753439] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-07T20:00:02.540718] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T20:00:02.551602] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-07T20:00:02.803261] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T20:00:02.814387] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-07T20:00:04.205670] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-07T20:00:04.208925] [INFO ] [REMOTE ] LTM: Full fetch complete (48745 records). [2025-10-07T20:00:04.209028] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-07T20:00:04.587592] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-07T20:00:04.587746] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-07T20:00:04.588505] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-07T20:00:04.588662] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-07T20:00:04.589976] [DEBUG] [LOCAL ] LTM: Trimmed 48745 records to 37710 (keeping 200 days of data) [2025-10-07T20:00:04.823551] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T20:00:04.852246] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-07T20:00:04.869733] [DEBUG] [LOCAL ] LTM: Primary data saved (37710 records). [2025-10-07T20:00:04.869881] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-07T20:00:04.869974] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTM took 22.8s. Estimated remaining: 2h 33m 41s. Rate: 7.1 symbols/min [2025-10-07T20:00:06.487440] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T20:00:06.492540] [INFO ] [REMOTE ] LTH: Full fetch complete (74325 records). [2025-10-07T20:00:06.492773] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-07T20:00:06.895164] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-07T20:00:06.895538] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-07T20:00:06.896756] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-07T20:00:06.896822] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-07T20:00:06.898775] [DEBUG] [LOCAL ] LTH: Trimmed 74325 records to 51727 (keeping 200 days of data) [2025-10-07T20:00:07.217155] [DEBUG] [LOCAL ] LTH: Primary data saved (51727 records). [2025-10-07T20:00:07.217314] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-07T20:00:07.217422] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 26.5s. Estimated remaining: 2h 33m 28s. Rate: 7.1 symbols/min [2025-10-07T20:00:07.772420] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:07.934248] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:08.012457] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:07.994789] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:08.078311] [DEBUG] [LOCAL ] LUCK: Loaded 24535 existing records from primary storage. [2025-10-07T20:00:08.077866] [DEBUG] [LOCAL ] LU: Loaded 48948 existing records from primary storage. [2025-10-07T20:00:08.079220] [INFO ] [MAIN ] LU: Loaded 48948 existing records. [2025-10-07T20:00:08.084726] [INFO ] [MAIN ] LUCK: Loaded 24535 existing records. [2025-10-07T20:00:08.347329] [DEBUG] [LOCAL ] LUMN: Loaded 53638 existing records from primary storage. [2025-10-07T20:00:08.410859] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-07T20:00:08.404478] [INFO ] [MAIN ] LUMN: Loaded 53638 existing records. [2025-10-07T20:00:08.474938] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-07T20:00:08.480990] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:08.554345] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-07T20:00:08.648556] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:08.681348] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-07T20:00:08.648737] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-07T20:00:08.707234] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-07T20:00:08.752548] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-07T20:00:08.757910] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-07T20:00:08.717603] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-07T20:00:08.795766] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-07T20:00:09.085327] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:09.270485] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:09.265742] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-07T20:00:09.281082] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-07T20:00:09.320804] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-07T20:00:09.351516] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-07T20:00:09.341816] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-07T20:00:09.389914] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-07T20:00:09.356876] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-07T20:00:09.404526] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-07T20:00:10.212277] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:10.298093] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-07T20:00:10.354108] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:10.386690] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-07T20:00:10.715298] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:10.734215] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-07T20:00:10.738707] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:10.740129] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-07T20:00:11.878310] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T20:00:11.885470] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-07T20:00:12.047061] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T20:00:12.060953] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-07T20:00:12.687419] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-07T20:00:12.699394] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-07T20:00:12.793579] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-07T20:00:12.805338] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-07T20:00:12.942951] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T20:00:12.950904] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-07T20:00:13.695456] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T20:00:13.705893] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-07T20:00:14.236456] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T20:00:14.247576] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-07T20:00:14.309388] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T20:00:14.320783] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-07T20:00:14.520144] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T20:00:14.528776] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-07T20:00:15.332196] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T20:00:15.341878] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-07T20:00:15.452474] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:00:15.462295] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-07T20:00:15.748678] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T20:00:15.847790] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-07T20:00:16.000577] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T20:00:16.444385] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T20:00:16.647741] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-07T20:00:16.909965] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T20:00:17.453867] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-07T20:00:17.458005] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T20:00:17.591745] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T20:00:18.247733] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-07T20:00:19.047706] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-07T20:00:19.253941] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T20:00:19.847616] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-07T20:00:20.119573] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T20:00:20.647719] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-07T20:00:21.033530] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T20:00:21.061761] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T20:00:21.447711] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-07T20:00:22.247691] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-07T20:00:22.645356] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T20:00:22.725095] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-07T20:00:23.047672] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-07T20:00:23.847711] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-07T20:00:24.136379] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T20:00:24.647625] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-07T20:00:24.686992] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T20:00:24.836824] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T20:00:25.447685] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-07T20:00:26.247709] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-07T20:00:26.587852] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T20:00:26.952801] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T20:00:27.047635] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-07T20:00:27.319097] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T20:00:27.847711] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-07T20:00:28.647744] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-07T20:00:29.030337] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T20:00:29.447748] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-07T20:00:29.742662] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T20:00:29.744981] [INFO ] [REMOTE ] LUCK: Full fetch complete (40777 records). [2025-10-07T20:00:29.745191] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-07T20:00:29.906466] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-07T20:00:30.176516] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-07T20:00:30.176600] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-07T20:00:30.177778] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-07T20:00:30.177842] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-07T20:00:30.178705] [DEBUG] [LOCAL ] LUCK: Trimmed 40777 records to 24436 (keeping 200 days of data) [2025-10-07T20:00:30.269149] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-07T20:00:30.333381] [DEBUG] [LOCAL ] LUCK: Primary data saved (24436 records). [2025-10-07T20:00:30.333516] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-07T20:00:30.333613] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LUCK took 23.1s. Estimated remaining: 2h 33m 32s. Rate: 7.1 symbols/min [2025-10-07T20:00:30.519052] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:30.519296] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-07T20:00:30.519353] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-07T20:00:30.519485] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-07T20:00:30.519530] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-07T20:00:30.519572] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-07T20:00:30.519604] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-07T20:00:30.867377] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:31.047602] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-07T20:00:31.362026] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:00:31.362392] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-07T20:00:31.362492] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:00:31.362540] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-07T20:00:31.362575] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:00:31.362632] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-07T20:00:31.362789] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-07T20:00:31.362845] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-07T20:00:31.362906] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-07T20:00:31.363009] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LUXE took 1.0s. Estimated remaining: 2h 33m 17s. Rate: 7.1 symbols/min [2025-10-07T20:00:31.551134] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:31.594464] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-07T20:00:31.661031] [DEBUG] [LOCAL ] LVS: Loaded 53566 existing records from primary storage. [2025-10-07T20:00:31.661447] [INFO ] [MAIN ] LVS: Loaded 53566 existing records. [2025-10-07T20:00:31.851215] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-07T20:00:31.884034] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:31.885239] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-07T20:00:31.885401] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-07T20:00:31.885769] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-07T20:00:31.886140] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-07T20:00:32.128933] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-07T20:00:32.361072] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:32.647736] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-07T20:00:33.447696] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-07T20:00:33.823388] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T20:00:34.092899] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T20:00:34.247779] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-07T20:00:34.941623] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T20:00:35.047694] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-07T20:00:35.847726] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-07T20:00:36.414065] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-07T20:00:36.647671] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-07T20:00:36.916988] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-07T20:00:37.447697] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-07T20:00:37.554323] [DEBUG] [REMOTE ] LVS: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-07T20:00:37.554679] [WARN ] [REMOTE ] LVS: No data returned for month 2025-02 [2025-10-07T20:00:37.554774] [FATAL] [REMOTE ] LVS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:00:37.554857] [FATAL] [MAIN ] LVS: Failed to fetch primary data. [2025-10-07T20:00:37.554919] [WARN ] [MAIN ] LVS: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:00:37.554995] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-07T20:00:37.555077] [DEBUG] [LOCAL ] LVS: No primary data file found to delete. [2025-10-07T20:00:37.555135] [INFO ] [LOCAL ] LVS: Starting deletion of derivative data. [2025-10-07T20:00:37.555405] [DEBUG] [LOCAL ] LVS: Deleted derivative data file. [2025-10-07T20:00:37.555506] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LVS took 6.2s. Estimated remaining: 2h 33m 7s. Rate: 7.1 symbols/min [2025-10-07T20:00:37.730600] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:37.749512] [DEBUG] [LOCAL ] LVWR: Loaded 18041 existing records from primary storage. [2025-10-07T20:00:37.749824] [INFO ] [MAIN ] LVWR: Loaded 18041 existing records. [2025-10-07T20:00:37.941637] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:37.942041] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-07T20:00:37.942164] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-07T20:00:37.942390] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-07T20:00:37.942459] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-07T20:00:38.257832] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-07T20:00:38.249326] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-07T20:00:38.416355] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:38.670366] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-07T20:00:38.674533] [INFO ] [REMOTE ] LUMN: Full fetch complete (77636 records). [2025-10-07T20:00:38.674720] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-07T20:00:39.052805] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-07T20:00:39.155793] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-07T20:00:39.155898] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-07T20:00:39.157536] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-07T20:00:39.157608] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-07T20:00:39.159489] [DEBUG] [LOCAL ] LUMN: Trimmed 77636 records to 53642 (keeping 200 days of data) [2025-10-07T20:00:39.508131] [DEBUG] [LOCAL ] LUMN: Primary data saved (53642 records). [2025-10-07T20:00:39.508292] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-07T20:00:39.508382] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUMN took 32.3s. Estimated remaining: 2h 32m 53s. Rate: 7.1 symbols/min [2025-10-07T20:00:39.723918] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:39.781144] [DEBUG] [LOCAL ] LW: Loaded 51196 existing records from primary storage. [2025-10-07T20:00:39.781511] [INFO ] [MAIN ] LW: Loaded 51196 existing records. [2025-10-07T20:00:39.860457] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-07T20:00:40.001590] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:40.001933] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-07T20:00:40.002161] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-07T20:00:40.002693] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-07T20:00:40.002762] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-07T20:00:40.200766] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T20:00:40.433834] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:40.510088] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T20:00:40.647692] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-07T20:00:40.962409] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T20:00:41.298310] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-07T20:00:41.447697] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-07T20:00:42.247699] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-07T20:00:42.946294] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T20:00:42.949875] [INFO ] [REMOTE ] LU: Full fetch complete (70399 records). [2025-10-07T20:00:42.950003] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-07T20:00:43.049435] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-07T20:00:43.350533] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-07T20:00:43.350639] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-07T20:00:43.351761] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-07T20:00:43.351845] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-07T20:00:43.353427] [DEBUG] [LOCAL ] LU: Trimmed 70399 records to 48938 (keeping 200 days of data) [2025-10-07T20:00:43.643618] [DEBUG] [LOCAL ] LU: Primary data saved (48938 records). [2025-10-07T20:00:43.643799] [INFO ] [MAIN ] LU: Full history saved. [2025-10-07T20:00:43.643901] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LU took 36.4s. Estimated remaining: 2h 32m 41s. Rate: 7.1 symbols/min [2025-10-07T20:00:43.814924] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:43.837185] [DEBUG] [LOCAL ] LXFR: Loaded 16808 existing records from primary storage. [2025-10-07T20:00:43.837550] [INFO ] [MAIN ] LXFR: Loaded 16808 existing records. [2025-10-07T20:00:43.868813] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-07T20:00:44.030325] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:44.030689] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-07T20:00:44.030770] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-07T20:00:44.031047] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-07T20:00:44.031110] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-07T20:00:44.464766] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:44.468080] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-07T20:00:44.549679] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-07T20:00:44.647602] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-07T20:00:44.846560] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T20:00:45.447702] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-07T20:00:46.240960] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T20:00:46.247593] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-07T20:00:46.261578] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-07T20:00:46.267046] [INFO ] [REMOTE ] LUV: Full fetch complete (77729 records). [2025-10-07T20:00:46.267212] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-07T20:00:46.658225] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-07T20:00:46.658316] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-07T20:00:46.659353] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-07T20:00:46.659423] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-07T20:00:46.660990] [DEBUG] [LOCAL ] LUV: Trimmed 77729 records to 53689 (keeping 200 days of data) [2025-10-07T20:00:47.011496] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-07T20:00:47.011828] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-07T20:00:47.013403] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LUV took 39.7s. Estimated remaining: 2h 32m 28s. Rate: 7.1 symbols/min [2025-10-07T20:00:47.056184] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-07T20:00:47.185638] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:00:47.246266] [DEBUG] [LOCAL ] LXP: Loaded 50733 existing records from primary storage. [2025-10-07T20:00:47.246662] [INFO ] [MAIN ] LXP: Loaded 50733 existing records. [2025-10-07T20:00:47.361281] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T20:00:47.435919] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:00:47.436161] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-07T20:00:47.436216] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-07T20:00:47.436506] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-07T20:00:47.436563] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-07T20:00:47.783251] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:00:47.847606] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-07T20:00:48.647736] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-07T20:00:48.833503] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T20:00:49.155731] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T20:00:49.447704] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-07T20:00:49.612883] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T20:00:50.247715] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-07T20:00:50.814070] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-07T20:00:51.047606] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-07T20:00:51.085321] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T20:00:51.847633] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-07T20:00:52.647711] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-07T20:00:52.718802] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T20:00:52.904892] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T20:00:53.447702] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-07T20:00:54.040844] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T20:00:54.239674] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T20:00:54.249739] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-07T20:00:55.047667] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-07T20:00:55.387969] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T20:00:55.847743] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-07T20:00:56.647633] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-07T20:00:56.799705] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T20:00:57.275871] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T20:00:57.447750] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-07T20:00:58.247619] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-07T20:00:58.378159] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T20:00:58.569066] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T20:00:59.047758] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-07T20:00:59.622109] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T20:00:59.847738] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-07T20:01:00.505581] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T20:01:00.647695] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-07T20:01:00.986926] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T20:01:01.447767] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-07T20:01:02.247683] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-07T20:01:02.466293] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T20:01:02.498407] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T20:01:03.047692] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-07T20:01:03.847714] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-07T20:01:03.910030] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T20:01:04.647767] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-07T20:01:04.699071] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T20:01:04.917460] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T20:01:05.447777] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-07T20:01:06.247618] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-07T20:01:06.282697] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T20:01:06.533798] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T20:01:06.535321] [INFO ] [REMOTE ] LVWR: Full fetch complete (20266 records). [2025-10-07T20:01:06.535391] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-07T20:01:06.895311] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-07T20:01:06.895391] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-07T20:01:06.895911] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-07T20:01:06.895974] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-07T20:01:06.896548] [DEBUG] [LOCAL ] LVWR: Trimmed 20266 records to 18123 (keeping 200 days of data) [2025-10-07T20:01:06.997293] [DEBUG] [LOCAL ] LVWR: Primary data saved (18123 records). [2025-10-07T20:01:06.997479] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-07T20:01:06.997572] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVWR took 29.4s. Estimated remaining: 2h 32m 29s. Rate: 7.1 symbols/min [2025-10-07T20:01:07.052761] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-07T20:01:07.178336] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:01:07.212443] [DEBUG] [LOCAL ] LXU: Loaded 31804 existing records from primary storage. [2025-10-07T20:01:07.212847] [INFO ] [MAIN ] LXU: Loaded 31804 existing records. [2025-10-07T20:01:07.389298] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:01:07.389524] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-07T20:01:07.389572] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-07T20:01:07.389883] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-07T20:01:07.389942] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-07T20:01:07.738254] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:01:07.847682] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-07T20:01:08.278547] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-07T20:01:08.647765] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-07T20:01:09.132420] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T20:01:09.277454] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-07T20:01:09.447691] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-07T20:01:10.247742] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-07T20:01:10.587684] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T20:01:11.047705] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-07T20:01:11.185903] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T20:01:11.655715] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T20:01:11.847738] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-07T20:01:12.647726] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-07T20:01:12.711281] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T20:01:12.817583] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T20:01:13.447694] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-07T20:01:14.253517] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-07T20:01:14.260495] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T20:01:14.454430] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T20:01:15.047714] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-07T20:01:15.847682] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-07T20:01:16.197279] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T20:01:16.214618] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-07T20:01:16.220800] [INFO ] [REMOTE ] LW: Full fetch complete (74682 records). [2025-10-07T20:01:16.220978] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-07T20:01:16.614960] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-07T20:01:16.615071] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-07T20:01:16.616111] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-07T20:01:16.616178] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-07T20:01:16.618285] [DEBUG] [LOCAL ] LW: Trimmed 74682 records to 51208 (keeping 200 days of data) [2025-10-07T20:01:16.680464] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-07T20:01:16.944350] [DEBUG] [LOCAL ] LW: Primary data saved (51208 records). [2025-10-07T20:01:16.944497] [INFO ] [MAIN ] LW: Full history saved. [2025-10-07T20:01:16.944593] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LW took 37.4s. Estimated remaining: 2h 32m 22s. Rate: 7.1 symbols/min [2025-10-07T20:01:17.120410] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:01:17.137803] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T20:01:17.143571] [INFO ] [REMOTE ] LXP: Full fetch complete (72706 records). [2025-10-07T20:01:17.143745] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-07T20:01:17.418886] [DEBUG] [LOCAL ] LYB: Loaded 53609 existing records from primary storage. [2025-10-07T20:01:17.441605] [INFO ] [MAIN ] LYB: Loaded 53609 existing records. [2025-10-07T20:01:17.452855] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-07T20:01:17.658293] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T20:01:17.743264] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-07T20:01:17.759974] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-07T20:01:17.784531] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-07T20:01:17.784720] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-07T20:01:17.790821] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:01:17.791141] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-07T20:01:17.791193] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-07T20:01:17.791472] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-07T20:01:17.791626] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-07T20:01:17.856937] [DEBUG] [LOCAL ] LXP: Trimmed 72706 records to 50755 (keeping 200 days of data) [2025-10-07T20:01:18.253195] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-07T20:01:18.258122] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:01:18.473783] [DEBUG] [LOCAL ] LXP: Primary data saved (50755 records). [2025-10-07T20:01:18.473946] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-07T20:01:18.474036] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LXP took 31.5s. Estimated remaining: 2h 32m 8s. Rate: 7.1 symbols/min [2025-10-07T20:01:18.641553] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:01:18.695057] [DEBUG] [LOCAL ] LYG: Loaded 52778 existing records from primary storage. [2025-10-07T20:01:18.695426] [INFO ] [MAIN ] LYG: Loaded 52778 existing records. [2025-10-07T20:01:18.874993] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:01:18.882237] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-07T20:01:18.892685] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-07T20:01:18.893383] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-07T20:01:18.894125] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T20:01:18.893452] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-07T20:01:19.060910] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-07T20:01:19.258039] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:01:19.271970] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T20:01:19.847748] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-07T20:01:20.647808] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-07T20:01:20.941226] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T20:01:21.447714] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-07T20:01:21.568783] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T20:01:21.616933] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T20:01:22.247732] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-07T20:01:22.930234] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T20:01:23.047743] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-07T20:01:23.847637] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-07T20:01:23.920132] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T20:01:23.921559] [INFO ] [REMOTE ] LXFR: Full fetch complete (24932 records). [2025-10-07T20:01:23.921633] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-07T20:01:24.239558] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-07T20:01:24.338768] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-07T20:01:24.338856] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-07T20:01:24.339434] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-07T20:01:24.339496] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-07T20:01:24.340239] [DEBUG] [LOCAL ] LXFR: Trimmed 24932 records to 16763 (keeping 200 days of data) [2025-10-07T20:01:24.441954] [DEBUG] [LOCAL ] LXFR: Primary data saved (16763 records). [2025-10-07T20:01:24.442110] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-07T20:01:24.442208] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXFR took 40.8s. Estimated remaining: 2h 31m 57s. Rate: 7.1 symbols/min [2025-10-07T20:01:24.604936] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:01:24.657055] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-07T20:01:24.660074] [DEBUG] [LOCAL ] LYV: Loaded 51102 existing records from primary storage. [2025-10-07T20:01:24.660509] [INFO ] [MAIN ] LYV: Loaded 51102 existing records. [2025-10-07T20:01:24.833261] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:01:24.833518] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-07T20:01:24.833567] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-07T20:01:24.833955] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-07T20:01:24.834013] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-07T20:01:25.192849] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:01:25.456739] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-07T20:01:25.490407] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T20:01:26.234785] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T20:01:26.247629] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-07T20:01:27.047751] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-07T20:01:27.190439] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T20:01:27.531384] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T20:01:27.847748] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-07T20:01:28.652876] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-07T20:01:28.672532] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T20:01:29.447722] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-07T20:01:29.566588] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T20:01:29.638284] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T20:01:30.247711] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-07T20:01:31.047731] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-07T20:01:31.324292] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T20:01:31.652698] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T20:01:31.847694] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-07T20:01:32.467724] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T20:01:32.647618] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-07T20:01:33.094423] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T20:01:33.447785] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-07T20:01:34.247635] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-07T20:01:34.280563] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T20:01:35.047680] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-07T20:01:35.418716] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T20:01:35.847717] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-07T20:01:36.080017] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T20:01:36.569202] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T20:01:36.647703] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-07T20:01:37.447698] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-07T20:01:37.895703] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T20:01:38.247673] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-07T20:01:38.608678] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T20:01:39.047711] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-07T20:01:39.142581] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T20:01:39.589424] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T20:01:39.591689] [INFO ] [REMOTE ] LXU: Full fetch complete (45089 records). [2025-10-07T20:01:39.591771] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-07T20:01:39.852774] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-07T20:01:39.971402] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-07T20:01:39.971529] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-07T20:01:39.973187] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-07T20:01:39.973316] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-07T20:01:39.975121] [DEBUG] [LOCAL ] LXU: Trimmed 45089 records to 31840 (keeping 200 days of data) [2025-10-07T20:01:40.193187] [DEBUG] [LOCAL ] LXU: Primary data saved (31840 records). [2025-10-07T20:01:40.193399] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-07T20:01:40.193591] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 33.2s. Estimated remaining: 2h 31m 55s. Rate: 7.1 symbols/min [2025-10-07T20:01:40.371500] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:01:40.409768] [DEBUG] [LOCAL ] LZB: Loaded 35277 existing records from primary storage. [2025-10-07T20:01:40.410141] [INFO ] [MAIN ] LZB: Loaded 35277 existing records. [2025-10-07T20:01:40.593685] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:01:40.594018] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-07T20:01:40.594075] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-07T20:01:40.594400] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-07T20:01:40.594462] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-07T20:01:40.659171] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-07T20:01:40.986303] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:01:41.020151] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T20:01:41.447629] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-07T20:01:41.630952] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T20:01:42.143006] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T20:01:42.247669] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-07T20:01:43.047679] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-07T20:01:43.390854] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T20:01:43.847704] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-07T20:01:43.894098] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T20:01:44.097537] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T20:01:44.647742] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-07T20:01:45.447718] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-07T20:01:45.980948] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-07T20:01:46.247719] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-07T20:01:46.420526] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T20:01:47.047761] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-07T20:01:47.847673] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-07T20:01:47.990836] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T20:01:48.002237] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-07T20:01:48.647629] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-07T20:01:48.973058] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T20:01:49.447624] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-07T20:01:49.492269] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T20:01:50.062190] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T20:01:50.247746] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-07T20:01:51.047730] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-07T20:01:51.292132] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T20:01:51.847697] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-07T20:01:51.998834] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T20:01:52.647775] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-07T20:01:52.797048] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T20:01:53.447781] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-07T20:01:53.475552] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T20:01:53.479230] [INFO ] [REMOTE ] LYB: Full fetch complete (77461 records). [2025-10-07T20:01:53.479388] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-07T20:01:53.881185] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-07T20:01:53.881306] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-07T20:01:53.882403] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-07T20:01:53.882478] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-07T20:01:53.884162] [DEBUG] [LOCAL ] LYB: Trimmed 77461 records to 53611 (keeping 200 days of data) [2025-10-07T20:01:54.138790] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T20:01:54.247706] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-07T20:01:54.266720] [DEBUG] [LOCAL ] LYB: Primary data saved (53611 records). [2025-10-07T20:01:54.266847] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-07T20:01:54.266928] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LYB took 37.3s. Estimated remaining: 2h 31m 51s. Rate: 7.1 symbols/min [2025-10-07T20:01:54.441852] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:01:54.457482] [DEBUG] [LOCAL ] LZM: Loaded 14218 existing records from primary storage. [2025-10-07T20:01:54.457779] [INFO ] [MAIN ] LZM: Loaded 14218 existing records. [2025-10-07T20:01:54.639523] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:01:54.639818] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-07T20:01:54.639875] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-07T20:01:54.640162] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-07T20:01:54.640220] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-07T20:01:55.020474] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:01:55.047596] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-07T20:01:55.198905] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T20:01:55.487286] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-07T20:01:55.847782] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-07T20:01:55.868711] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T20:01:55.872389] [INFO ] [REMOTE ] LYG: Full fetch complete (76063 records). [2025-10-07T20:01:55.872531] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-07T20:01:56.283260] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-07T20:01:56.283354] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-07T20:01:56.284428] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-07T20:01:56.284496] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-07T20:01:56.286677] [DEBUG] [LOCAL ] LYG: Trimmed 76063 records to 52778 (keeping 200 days of data) [2025-10-07T20:01:56.602191] [DEBUG] [LOCAL ] LYG: Primary data saved (52778 records). [2025-10-07T20:01:56.602349] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-07T20:01:56.602448] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 38.1s. Estimated remaining: 2h 31m 38s. Rate: 7.1 symbols/min [2025-10-07T20:01:56.659916] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-07T20:01:56.781983] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:01:56.837623] [DEBUG] [LOCAL ] M: Loaded 53539 existing records from primary storage. [2025-10-07T20:01:56.838033] [INFO ] [MAIN ] M: Loaded 53539 existing records. [2025-10-07T20:01:57.036093] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:01:57.036344] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-07T20:01:57.036398] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-07T20:01:57.036902] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-07T20:01:57.036968] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-07T20:01:57.417821] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:01:57.428688] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T20:01:57.433680] [INFO ] [REMOTE ] LYV: Full fetch complete (73776 records). [2025-10-07T20:01:57.433859] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-07T20:01:57.455956] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-07T20:01:57.744289] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T20:01:57.842162] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-07T20:01:57.842254] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-07T20:01:57.843262] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-07T20:01:57.843328] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-07T20:01:57.846631] [DEBUG] [LOCAL ] LYV: Trimmed 73776 records to 51110 (keeping 200 days of data) [2025-10-07T20:01:58.160335] [DEBUG] [LOCAL ] LYV: Primary data saved (51110 records). [2025-10-07T20:01:58.160487] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-07T20:01:58.160572] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYV took 33.7s. Estimated remaining: 2h 31m 24s. Rate: 7.1 symbols/min [2025-10-07T20:01:58.252726] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-07T20:01:58.335564] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:01:58.391475] [DEBUG] [LOCAL ] MA: Loaded 52507 existing records from primary storage. [2025-10-07T20:01:58.391886] [INFO ] [MAIN ] MA: Loaded 52507 existing records. [2025-10-07T20:01:58.574700] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:01:58.574934] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-07T20:01:58.574984] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-07T20:01:58.575281] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-07T20:01:58.575338] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-07T20:01:58.941161] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:01:59.025031] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T20:01:59.047671] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-07T20:01:59.082940] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T20:01:59.847684] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-07T20:02:00.647757] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-07T20:02:01.046230] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T20:02:01.211995] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-07T20:02:01.447733] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-07T20:02:01.568856] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:02:02.247684] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-07T20:02:03.047681] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-07T20:02:03.261684] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T20:02:03.847726] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-07T20:02:04.266435] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-07T20:02:04.502947] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T20:02:04.647675] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-07T20:02:05.447718] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-07T20:02:05.584532] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T20:02:06.247695] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-07T20:02:06.488038] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T20:02:06.547695] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:02:07.047674] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-07T20:02:07.633804] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T20:02:07.847687] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-07T20:02:08.647639] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-07T20:02:08.744373] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T20:02:08.804597] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T20:02:09.447715] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-07T20:02:10.143261] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T20:02:10.247693] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-07T20:02:11.047620] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-07T20:02:11.425832] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T20:02:11.847741] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-07T20:02:11.936916] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T20:02:12.571892] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T20:02:12.647738] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-07T20:02:13.447695] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-07T20:02:13.496921] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T20:02:13.764759] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T20:02:14.247735] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-07T20:02:14.394950] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T20:02:14.397572] [INFO ] [REMOTE ] LZB: Full fetch complete (50708 records). [2025-10-07T20:02:14.397711] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-07T20:02:14.830897] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-07T20:02:14.831049] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-07T20:02:14.831871] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-07T20:02:14.831934] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-07T20:02:14.833184] [DEBUG] [LOCAL ] LZB: Trimmed 50708 records to 35179 (keeping 200 days of data) [2025-10-07T20:02:15.047713] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-07T20:02:15.065948] [DEBUG] [LOCAL ] LZB: Primary data saved (35179 records). [2025-10-07T20:02:15.066583] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-07T20:02:15.066730] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZB took 34.9s. Estimated remaining: 2h 31m 22s. Rate: 7.1 symbols/min [2025-10-07T20:02:15.240426] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:02:15.290304] [DEBUG] [LOCAL ] MAA: Loaded 42633 existing records from primary storage. [2025-10-07T20:02:15.290667] [INFO ] [MAIN ] MAA: Loaded 42633 existing records. [2025-10-07T20:02:15.488969] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:02:15.489254] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-07T20:02:15.489312] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-07T20:02:15.489685] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-07T20:02:15.489743] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-07T20:02:15.835089] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:02:15.847595] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-07T20:02:16.146052] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-07T20:02:16.647693] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-07T20:02:17.262679] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-07T20:02:17.418761] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T20:02:17.447694] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-07T20:02:18.247732] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-07T20:02:18.554633] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-07T20:02:18.965731] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T20:02:19.047695] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-07T20:02:19.070318] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T20:02:19.847743] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-07T20:02:20.529738] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T20:02:20.647698] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-07T20:02:21.447702] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-07T20:02:21.810168] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T20:02:21.942471] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-07T20:02:22.255052] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-07T20:02:22.272799] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T20:02:23.047688] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-07T20:02:23.847719] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-07T20:02:24.170810] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T20:02:24.204038] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T20:02:24.647738] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-07T20:02:25.126411] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T20:02:25.447744] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-07T20:02:25.647763] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T20:02:25.649515] [INFO ] [REMOTE ] LZM: Full fetch complete (18772 records). [2025-10-07T20:02:25.649584] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-07T20:02:26.012838] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-07T20:02:26.012968] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-07T20:02:26.013381] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-07T20:02:26.013435] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-07T20:02:26.014048] [DEBUG] [LOCAL ] LZM: Trimmed 18772 records to 14267 (keeping 200 days of data) [2025-10-07T20:02:26.094931] [DEBUG] [LOCAL ] LZM: Primary data saved (14267 records). [2025-10-07T20:02:26.095074] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-07T20:02:26.095180] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 31.8s. Estimated remaining: 2h 31m 16s. Rate: 7.1 symbols/min [2025-10-07T20:02:26.252105] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-07T20:02:26.260501] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:02:26.307875] [DEBUG] [LOCAL ] MAC: Loaded 49621 existing records from primary storage. [2025-10-07T20:02:26.308201] [INFO ] [MAIN ] MAC: Loaded 49621 existing records. [2025-10-07T20:02:26.489144] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:02:26.489441] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-07T20:02:26.489504] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-07T20:02:26.489815] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-07T20:02:26.489872] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-07T20:02:26.839709] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:02:27.047604] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-07T20:02:27.470870] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-07T20:02:27.847811] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-07T20:02:28.201970] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T20:02:28.546895] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T20:02:28.647633] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-07T20:02:29.447708] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-07T20:02:29.938450] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-07T20:02:30.009900] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T20:02:30.247714] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-07T20:02:30.531734] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T20:02:31.047695] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-07T20:02:31.734230] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T20:02:31.847841] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-07T20:02:32.647622] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-07T20:02:33.128530] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-07T20:02:33.314570] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T20:02:33.318617] [INFO ] [REMOTE ] M: Full fetch complete (77520 records). [2025-10-07T20:02:33.318839] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-07T20:02:33.460945] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-07T20:02:33.720821] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-07T20:02:33.720921] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-07T20:02:33.721909] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-07T20:02:33.721973] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-07T20:02:33.723546] [DEBUG] [LOCAL ] M: Trimmed 77520 records to 53539 (keeping 200 days of data) [2025-10-07T20:02:34.069157] [DEBUG] [LOCAL ] M: Primary data saved (53539 records). [2025-10-07T20:02:34.069316] [INFO ] [MAIN ] M: Full history saved. [2025-10-07T20:02:34.069507] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. M took 37.5s. Estimated remaining: 2h 31m 7s. Rate: 7.1 symbols/min [2025-10-07T20:02:34.244282] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:02:34.247621] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-07T20:02:34.280990] [DEBUG] [LOCAL ] MAGN: Loaded 35395 existing records from primary storage. [2025-10-07T20:02:34.281304] [INFO ] [MAIN ] MAGN: Loaded 35395 existing records. [2025-10-07T20:02:34.459677] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:02:34.459988] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-07T20:02:34.460202] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-07T20:02:34.470846] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-07T20:02:34.484536] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-07T20:02:34.558166] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T20:02:34.852751] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:02:35.047612] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-07T20:02:35.525102] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-07T20:02:35.847730] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-07T20:02:35.931637] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T20:02:35.999042] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T20:02:36.647700] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-07T20:02:37.447633] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-07T20:02:37.792887] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T20:02:37.824525] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-07T20:02:38.247733] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-07T20:02:38.930329] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T20:02:39.047754] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-07T20:02:39.150718] [DEBUG] [REMOTE ] MAC: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-07T20:02:39.151248] [WARN ] [REMOTE ] MAC: No data returned for month 2025-05 [2025-10-07T20:02:39.151338] [FATAL] [REMOTE ] MAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:02:39.151435] [FATAL] [MAIN ] MAC: Failed to fetch primary data. [2025-10-07T20:02:39.151472] [WARN ] [MAIN ] MAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:02:39.151568] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-07T20:02:39.151674] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-07T20:02:39.151732] [INFO ] [LOCAL ] MAC: Starting deletion of derivative data. [2025-10-07T20:02:39.152015] [DEBUG] [LOCAL ] MAC: Deleted derivative data file. [2025-10-07T20:02:39.152129] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MAC took 13.1s. Estimated remaining: 2h 30m 56s. Rate: 7.1 symbols/min [2025-10-07T20:02:39.330068] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:02:39.366231] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T20:02:39.412830] [DEBUG] [LOCAL ] MAIN: Loaded 41171 existing records from primary storage. [2025-10-07T20:02:39.413270] [INFO ] [MAIN ] MAIN: Loaded 41171 existing records. [2025-10-07T20:02:39.610550] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:02:39.610840] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-07T20:02:39.610890] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-07T20:02:39.611204] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-07T20:02:39.611260] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-07T20:02:39.852924] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-07T20:02:39.976406] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:02:40.647707] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-07T20:02:41.447759] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-07T20:02:41.821213] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-07T20:02:41.826330] [INFO ] [REMOTE ] MA: Full fetch complete (76258 records). [2025-10-07T20:02:41.826544] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-07T20:02:42.218004] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T20:02:42.253126] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-07T20:02:42.273940] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-07T20:02:42.274033] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-07T20:02:42.275045] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-07T20:02:42.275113] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-07T20:02:42.276764] [DEBUG] [LOCAL ] MA: Trimmed 76258 records to 52508 (keeping 200 days of data) [2025-10-07T20:02:42.633313] [DEBUG] [LOCAL ] MA: Primary data saved (52508 records). [2025-10-07T20:02:42.633488] [INFO ] [MAIN ] MA: Full history saved. [2025-10-07T20:02:42.634838] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MA took 44.5s. Estimated remaining: 2h 30m 43s. Rate: 7.1 symbols/min [2025-10-07T20:02:42.810519] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:02:42.860582] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T20:02:42.885713] [DEBUG] [LOCAL ] MAN: Loaded 43603 existing records from primary storage. [2025-10-07T20:02:42.886256] [INFO ] [MAIN ] MAN: Loaded 43603 existing records. [2025-10-07T20:02:43.047747] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-07T20:02:43.068245] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:02:43.069216] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-07T20:02:43.069306] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-07T20:02:43.069561] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-07T20:02:43.069620] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-07T20:02:43.445910] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:02:43.847726] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-07T20:02:43.882475] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T20:02:44.647620] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-07T20:02:44.756599] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T20:02:45.343467] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T20:02:45.447678] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-07T20:02:46.247614] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-07T20:02:46.328306] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T20:02:46.576093] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T20:02:47.047709] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-07T20:02:47.742334] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T20:02:47.847712] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-07T20:02:48.466298] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T20:02:48.647695] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-07T20:02:49.269473] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T20:02:49.447754] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-07T20:02:50.145671] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T20:02:50.148766] [INFO ] [REMOTE ] MAA: Full fetch complete (61228 records). [2025-10-07T20:02:50.148872] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-07T20:02:50.255974] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-07T20:02:50.582144] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-07T20:02:50.582251] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-07T20:02:50.583348] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-07T20:02:50.583418] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-07T20:02:50.584865] [DEBUG] [LOCAL ] MAA: Trimmed 61228 records to 42654 (keeping 200 days of data) [2025-10-07T20:02:50.884628] [DEBUG] [LOCAL ] MAA: Primary data saved (42654 records). [2025-10-07T20:02:50.884892] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-07T20:02:50.884995] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAA took 35.8s. Estimated remaining: 2h 30m 35s. Rate: 7.1 symbols/min [2025-10-07T20:02:51.055420] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-07T20:02:51.058836] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:02:51.089083] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T20:02:51.124837] [DEBUG] [LOCAL ] MANU: Loaded 26710 existing records from primary storage. [2025-10-07T20:02:51.125137] [INFO ] [MAIN ] MANU: Loaded 26710 existing records. [2025-10-07T20:02:51.304258] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:02:51.304499] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-07T20:02:51.304547] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-07T20:02:51.304816] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-07T20:02:51.304883] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-07T20:02:51.673993] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:02:51.696354] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T20:02:51.847681] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-07T20:02:52.647695] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-07T20:02:52.812976] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T20:02:53.447759] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-07T20:02:53.529863] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T20:02:53.722153] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T20:02:54.247740] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-07T20:02:55.047625] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-07T20:02:55.176083] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T20:02:55.323850] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T20:02:55.847742] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-07T20:02:56.232924] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T20:02:56.647756] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-07T20:02:57.205403] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T20:02:57.447725] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-07T20:02:58.189448] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T20:02:58.247685] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-07T20:02:58.889033] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T20:02:59.047713] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-07T20:02:59.777564] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T20:02:59.847694] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-07T20:03:00.647631] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-07T20:03:00.770032] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T20:03:01.447627] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-07T20:03:01.485632] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T20:03:01.822140] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T20:03:02.247730] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-07T20:03:02.957205] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T20:03:03.047710] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-07T20:03:03.278428] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-07T20:03:03.847708] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-07T20:03:04.643631] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T20:03:04.655720] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-07T20:03:05.447761] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-07T20:03:05.610734] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T20:03:05.695737] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T20:03:06.247770] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-07T20:03:06.813306] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T20:03:06.816990] [INFO ] [REMOTE ] MAN: Full fetch complete (62217 records). [2025-10-07T20:03:06.817166] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-07T20:03:07.054907] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-07T20:03:07.259009] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-07T20:03:07.259142] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-07T20:03:07.260891] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-07T20:03:07.260972] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-07T20:03:07.262981] [DEBUG] [LOCAL ] MAN: Trimmed 62217 records to 43640 (keeping 200 days of data) [2025-10-07T20:03:07.597884] [DEBUG] [LOCAL ] MAN: Primary data saved (43640 records). [2025-10-07T20:03:07.598083] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-07T20:03:07.598210] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAN took 25.0s. Estimated remaining: 2h 30m 33s. Rate: 7.1 symbols/min [2025-10-07T20:03:07.804082] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:03:07.840166] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T20:03:07.850323] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-07T20:03:07.909121] [DEBUG] [LOCAL ] MAS: Loaded 52301 existing records from primary storage. [2025-10-07T20:03:07.909461] [INFO ] [MAIN ] MAS: Loaded 52301 existing records. [2025-10-07T20:03:08.132975] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:03:08.133266] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-07T20:03:08.133332] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-07T20:03:08.133882] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-07T20:03:08.133946] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-07T20:03:08.535237] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T20:03:08.541155] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:03:08.647696] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-07T20:03:09.447708] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-07T20:03:09.567983] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T20:03:09.880761] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T20:03:10.247673] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-07T20:03:10.441549] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T20:03:11.047693] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-07T20:03:11.681579] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T20:03:11.847690] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-07T20:03:12.263308] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T20:03:12.647706] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-07T20:03:13.205272] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-07T20:03:13.447714] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-07T20:03:14.247900] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-07T20:03:14.546544] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-07T20:03:15.047637] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-07T20:03:15.146362] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T20:03:15.292190] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T20:03:15.847693] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-07T20:03:16.443718] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T20:03:16.647616] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-07T20:03:17.447632] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-07T20:03:17.638964] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T20:03:18.029587] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T20:03:18.034070] [INFO ] [REMOTE ] MAGN: Full fetch complete (51466 records). [2025-10-07T20:03:18.034281] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-07T20:03:18.252889] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-07T20:03:18.441478] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-07T20:03:18.441583] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-07T20:03:18.442491] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-07T20:03:18.442567] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-07T20:03:18.444331] [DEBUG] [LOCAL ] MAGN: Trimmed 51466 records to 35542 (keeping 200 days of data) [2025-10-07T20:03:18.664395] [DEBUG] [LOCAL ] MAGN: Primary data saved (35542 records). [2025-10-07T20:03:18.664562] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-07T20:03:18.664680] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAGN took 44.6s. Estimated remaining: 2h 30m 27s. Rate: 7.1 symbols/min [2025-10-07T20:03:18.848898] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:03:18.861048] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T20:03:18.904959] [DEBUG] [LOCAL ] MATV: Loaded 36253 existing records from primary storage. [2025-10-07T20:03:18.905285] [INFO ] [MAIN ] MATV: Loaded 36253 existing records. [2025-10-07T20:03:19.054103] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-07T20:03:19.101667] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:03:19.101924] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-07T20:03:19.101991] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-07T20:03:19.102284] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-07T20:03:19.102344] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-07T20:03:19.466315] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:03:19.847706] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-07T20:03:20.048703] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T20:03:20.051592] [INFO ] [REMOTE ] MAIN: Full fetch complete (59978 records). [2025-10-07T20:03:20.051720] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-07T20:03:20.462635] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-07T20:03:20.469488] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-07T20:03:20.470582] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-07T20:03:20.470924] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T20:03:20.471119] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-07T20:03:20.474033] [INFO ] [REMOTE ] MANU: Full fetch complete (38291 records). [2025-10-07T20:03:20.474376] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-07T20:03:20.474916] [DEBUG] [LOCAL ] MAIN: Trimmed 59978 records to 41241 (keeping 200 days of data) [2025-10-07T20:03:20.652457] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-07T20:03:21.064437] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-07T20:03:21.065061] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-07T20:03:21.068382] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-07T20:03:21.068835] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-07T20:03:21.075130] [DEBUG] [LOCAL ] MANU: Trimmed 38291 records to 26728 (keeping 200 days of data) [2025-10-07T20:03:21.375697] [DEBUG] [LOCAL ] MANU: Primary data saved (26728 records). [2025-10-07T20:03:21.376376] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-07T20:03:21.376760] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MANU took 30.5s. Estimated remaining: 2h 30m 14s. Rate: 7.1 symbols/min [2025-10-07T20:03:21.563819] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:03:21.599922] [DEBUG] [LOCAL ] MAIN: Primary data saved (41241 records). [2025-10-07T20:03:21.611305] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-07T20:03:21.611606] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAIN took 42.5s. Estimated remaining: 2h 29m 59s. Rate: 7.1 symbols/min [2025-10-07T20:03:21.735519] [DEBUG] [LOCAL ] MATX: Loaded 31425 existing records from primary storage. [2025-10-07T20:03:21.816982] [INFO ] [MAIN ] MATX: Loaded 31425 existing records. [2025-10-07T20:03:21.844463] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:03:21.888330] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T20:03:21.944392] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-07T20:03:22.060391] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:03:22.060852] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-07T20:03:22.060964] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-07T20:03:22.077205] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-07T20:03:22.090072] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-07T20:03:22.091044] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T20:03:22.130981] [DEBUG] [LOCAL ] MAX: Loaded 30772 existing records from primary storage. [2025-10-07T20:03:22.168769] [INFO ] [MAIN ] MAX: Loaded 30772 existing records. [2025-10-07T20:03:22.252963] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-07T20:03:22.582297] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:03:22.608913] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-07T20:03:22.622085] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-07T20:03:22.657009] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-07T20:03:22.657111] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-07T20:03:22.662719] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:03:23.052767] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-07T20:03:23.121172] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:03:23.662709] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T20:03:23.720374] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T20:03:23.847694] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-07T20:03:24.237184] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T20:03:24.647735] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-07T20:03:25.254419] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T20:03:25.447698] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-07T20:03:25.739185] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T20:03:26.247701] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-07T20:03:26.931892] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T20:03:27.047677] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-07T20:03:27.679241] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T20:03:27.847686] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-07T20:03:28.491329] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T20:03:28.647683] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-07T20:03:29.447713] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-07T20:03:29.491530] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T20:03:30.089037] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T20:03:30.247725] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-07T20:03:30.741308] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T20:03:31.047750] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-07T20:03:31.623200] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T20:03:31.847692] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-07T20:03:32.272807] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T20:03:32.647757] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-07T20:03:33.141910] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T20:03:33.447724] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-07T20:03:33.903770] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T20:03:34.247702] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-07T20:03:34.717825] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T20:03:35.047694] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-07T20:03:35.581176] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T20:03:35.847729] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-07T20:03:36.502817] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T20:03:36.647690] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-07T20:03:37.447709] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-07T20:03:37.720937] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T20:03:37.774131] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T20:03:38.247706] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-07T20:03:38.852909] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T20:03:39.047722] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-07T20:03:39.552508] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T20:03:39.847703] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-07T20:03:40.481323] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T20:03:40.647707] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-07T20:03:41.447679] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-07T20:03:41.570137] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:03:41.954560] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T20:03:42.247732] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-07T20:03:42.987408] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T20:03:43.009068] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T20:03:43.047594] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-07T20:03:43.847696] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-07T20:03:44.306959] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T20:03:44.647793] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-07T20:03:45.219493] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T20:03:45.223167] [INFO ] [REMOTE ] MAS: Full fetch complete (74896 records). [2025-10-07T20:03:45.223320] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-07T20:03:45.454384] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-07T20:03:45.647857] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-07T20:03:45.648001] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-07T20:03:45.649065] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-07T20:03:45.649195] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-07T20:03:45.650759] [DEBUG] [LOCAL ] MAS: Trimmed 74896 records to 52291 (keeping 200 days of data) [2025-10-07T20:03:45.888555] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-07T20:03:45.997988] [DEBUG] [LOCAL ] MAS: Primary data saved (52291 records). [2025-10-07T20:03:45.998138] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-07T20:03:45.998256] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAS took 38.4s. Estimated remaining: 2h 30m 3s. Rate: 7.1 symbols/min [2025-10-07T20:03:46.163148] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:03:46.203912] [DEBUG] [LOCAL ] MBC: Loaded 43410 existing records from primary storage. [2025-10-07T20:03:46.204215] [INFO ] [MAIN ] MBC: Loaded 43410 existing records. [2025-10-07T20:03:46.257561] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-07T20:03:46.381102] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:03:46.381292] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-07T20:03:46.381340] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-07T20:03:46.381564] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-07T20:03:46.381621] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-07T20:03:46.737735] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:03:46.906968] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T20:03:47.047625] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-07T20:03:47.716332] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T20:03:47.718693] [INFO ] [REMOTE ] MATV: Full fetch complete (52311 records). [2025-10-07T20:03:47.718780] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-07T20:03:47.854867] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-07T20:03:48.108989] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-07T20:03:48.109139] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-07T20:03:48.109975] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-07T20:03:48.110044] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-07T20:03:48.111248] [DEBUG] [LOCAL ] MATV: Trimmed 52311 records to 36117 (keeping 200 days of data) [2025-10-07T20:03:48.331697] [DEBUG] [LOCAL ] MATV: Primary data saved (36117 records). [2025-10-07T20:03:48.331875] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-07T20:03:48.331968] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MATV took 29.7s. Estimated remaining: 2h 29m 50s. Rate: 7.1 symbols/min [2025-10-07T20:03:48.453958] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T20:03:48.534016] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:03:48.559984] [DEBUG] [LOCAL ] MBI: Loaded 24233 existing records from primary storage. [2025-10-07T20:03:48.560297] [INFO ] [MAIN ] MBI: Loaded 24233 existing records. [2025-10-07T20:03:48.652845] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-07T20:03:48.742963] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:03:48.743206] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-07T20:03:48.743254] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-07T20:03:48.743687] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-07T20:03:48.743746] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-07T20:03:49.096952] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:03:49.127908] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T20:03:49.447678] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-07T20:03:50.017201] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T20:03:50.247623] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-07T20:03:50.688522] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T20:03:51.047691] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-07T20:03:51.497721] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T20:03:51.847700] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-07T20:03:52.489019] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T20:03:52.647710] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-07T20:03:52.703192] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T20:03:53.447698] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-07T20:03:54.190272] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T20:03:54.247621] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-07T20:03:54.580956] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T20:03:55.047755] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-07T20:03:55.726778] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T20:03:55.847610] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-07T20:03:56.312660] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T20:03:56.314762] [INFO ] [REMOTE ] MATX: Full fetch complete (42770 records). [2025-10-07T20:03:56.314836] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-07T20:03:56.652892] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-07T20:03:56.722874] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-07T20:03:56.722967] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-07T20:03:56.723949] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-07T20:03:56.724016] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-07T20:03:56.725091] [DEBUG] [LOCAL ] MATX: Trimmed 42770 records to 31417 (keeping 200 days of data) [2025-10-07T20:03:56.954277] [DEBUG] [LOCAL ] MATX: Primary data saved (31417 records). [2025-10-07T20:03:56.954461] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-07T20:03:56.954561] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATX took 35.6s. Estimated remaining: 2h 29m 41s. Rate: 7.1 symbols/min [2025-10-07T20:03:57.234097] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:03:57.303621] [DEBUG] [LOCAL ] MC: Loaded 44022 existing records from primary storage. [2025-10-07T20:03:57.304187] [INFO ] [MAIN ] MC: Loaded 44022 existing records. [2025-10-07T20:03:57.455311] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-07T20:03:57.582289] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:03:57.582733] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-07T20:03:57.582828] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-07T20:03:57.593504] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-07T20:03:57.614670] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-07T20:03:57.622326] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T20:03:58.046127] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:03:58.062937] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T20:03:58.065499] [INFO ] [REMOTE ] MAX: Full fetch complete (45414 records). [2025-10-07T20:03:58.065877] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-07T20:03:58.252723] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-07T20:03:58.441158] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-07T20:03:58.441244] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-07T20:03:58.442080] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-07T20:03:58.442144] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-07T20:03:58.443124] [DEBUG] [LOCAL ] MAX: Trimmed 45414 records to 30870 (keeping 200 days of data) [2025-10-07T20:03:58.564761] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T20:03:58.648732] [DEBUG] [LOCAL ] MAX: Primary data saved (30870 records). [2025-10-07T20:03:58.648880] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-07T20:03:58.648964] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAX took 37.0s. Estimated remaining: 2h 29m 28s. Rate: 7.1 symbols/min [2025-10-07T20:03:58.812489] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:03:58.826619] [DEBUG] [LOCAL ] MCB: Loaded 11254 existing records from primary storage. [2025-10-07T20:03:58.826867] [INFO ] [MAIN ] MCB: Loaded 11254 existing records. [2025-10-07T20:03:58.997741] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:03:58.998013] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-07T20:03:58.998068] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-07T20:03:58.998485] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-07T20:03:58.998543] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-07T20:03:59.058498] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-07T20:03:59.346828] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:03:59.778790] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T20:03:59.847610] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-07T20:04:00.584417] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T20:04:00.647678] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-07T20:04:01.130857] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T20:04:01.447679] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-07T20:04:02.104262] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T20:04:02.247757] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-07T20:04:02.765278] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T20:04:02.878132] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-07T20:04:03.047686] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-07T20:04:03.847707] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-07T20:04:03.955478] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T20:04:04.647627] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-07T20:04:05.110326] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T20:04:05.447700] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-07T20:04:06.222514] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T20:04:06.247608] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-07T20:04:06.624325] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T20:04:07.047744] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-07T20:04:07.847704] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-07T20:04:07.956558] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T20:04:08.600582] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T20:04:08.634244] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T20:04:08.647613] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-07T20:04:09.447747] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-07T20:04:10.259521] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-07T20:04:10.262441] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T20:04:11.047745] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-07T20:04:11.152116] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T20:04:11.190109] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T20:04:11.847715] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-07T20:04:12.249162] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T20:04:12.647689] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-07T20:04:13.357999] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T20:04:13.447688] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-07T20:04:14.083273] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T20:04:14.086750] [INFO ] [REMOTE ] MBC: Full fetch complete (63139 records). [2025-10-07T20:04:14.086866] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-07T20:04:14.269085] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-07T20:04:14.518630] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-07T20:04:14.518854] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-07T20:04:14.519789] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-07T20:04:14.519858] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-07T20:04:14.521172] [DEBUG] [LOCAL ] MBC: Trimmed 63139 records to 43468 (keeping 200 days of data) [2025-10-07T20:04:14.778007] [DEBUG] [LOCAL ] MBC: Primary data saved (43468 records). [2025-10-07T20:04:14.778141] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-07T20:04:14.778225] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MBC took 28.8s. Estimated remaining: 2h 29m 25s. Rate: 7.1 symbols/min [2025-10-07T20:04:14.898068] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T20:04:14.977109] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:04:14.977312] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-07T20:04:14.977539] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-07T20:04:14.977712] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-07T20:04:14.977893] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-07T20:04:14.978015] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-07T20:04:14.984249] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T20:04:14.984031] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-07T20:04:15.052705] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-07T20:04:15.337151] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:04:15.847695] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-07T20:04:16.588485] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T20:04:16.647613] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-07T20:04:16.933691] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T20:04:17.447638] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-07T20:04:18.247677] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-07T20:04:18.489147] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T20:04:18.521210] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T20:04:19.026447] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T20:04:19.028570] [INFO ] [REMOTE ] MBI: Full fetch complete (36602 records). [2025-10-07T20:04:19.028685] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-07T20:04:19.057556] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-07T20:04:19.427202] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-07T20:04:19.427284] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-07T20:04:19.428052] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-07T20:04:19.428118] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-07T20:04:19.429001] [DEBUG] [LOCAL ] MBI: Trimmed 36602 records to 24208 (keeping 200 days of data) [2025-10-07T20:04:19.562576] [DEBUG] [LOCAL ] MBI: Primary data saved (24208 records). [2025-10-07T20:04:19.562741] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-07T20:04:19.562846] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBI took 31.2s. Estimated remaining: 2h 29m 14s. Rate: 7.1 symbols/min [2025-10-07T20:04:19.735474] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:04:19.746182] [DEBUG] [LOCAL ] MCI: Loaded 6457 existing records from primary storage. [2025-10-07T20:04:19.746405] [INFO ] [MAIN ] MCI: Loaded 6457 existing records. [2025-10-07T20:04:19.857726] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-07T20:04:19.947699] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:04:19.947924] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-07T20:04:19.947982] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-07T20:04:19.948157] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-07T20:04:19.948214] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-07T20:04:20.310532] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:04:20.647735] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-07T20:04:20.960413] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:04:21.250607] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-07T20:04:21.447677] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-07T20:04:22.204062] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T20:04:22.247638] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-07T20:04:23.047689] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-07T20:04:23.069722] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T20:04:23.336239] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-07T20:04:23.847741] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-07T20:04:24.340999] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T20:04:24.358585] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-07T20:04:24.647782] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-07T20:04:25.326555] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T20:04:25.447639] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-07T20:04:26.247705] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-07T20:04:26.420727] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T20:04:26.997137] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T20:04:27.047665] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-07T20:04:27.847680] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-07T20:04:28.537733] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T20:04:28.557001] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-07T20:04:28.647664] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-07T20:04:29.447735] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-07T20:04:30.025343] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T20:04:30.028890] [INFO ] [REMOTE ] MC: Full fetch complete (62699 records). [2025-10-07T20:04:30.029013] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-07T20:04:30.252837] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-07T20:04:30.324001] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T20:04:30.429051] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-07T20:04:30.429132] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-07T20:04:30.430018] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-07T20:04:30.430081] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-07T20:04:30.433454] [DEBUG] [LOCAL ] MC: Trimmed 62699 records to 43973 (keeping 200 days of data) [2025-10-07T20:04:30.710926] [DEBUG] [LOCAL ] MC: Primary data saved (43973 records). [2025-10-07T20:04:30.711064] [INFO ] [MAIN ] MC: Full history saved. [2025-10-07T20:04:30.711179] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MC took 33.8s. Estimated remaining: 2h 29m 8s. Rate: 7.1 symbols/min [2025-10-07T20:04:30.881432] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:04:30.928457] [DEBUG] [LOCAL ] MCK: Loaded 39017 existing records from primary storage. [2025-10-07T20:04:30.928798] [INFO ] [MAIN ] MCK: Loaded 39017 existing records. [2025-10-07T20:04:31.052819] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-07T20:04:31.110912] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:04:31.111447] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-07T20:04:31.116503] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-07T20:04:31.118451] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-07T20:04:31.118234] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-07T20:04:31.118607] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-07T20:04:31.474263] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:04:31.847693] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-07T20:04:32.546943] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T20:04:32.548143] [INFO ] [REMOTE ] MCB: Full fetch complete (16376 records). [2025-10-07T20:04:32.548213] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-07T20:04:32.649859] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-07T20:04:32.912340] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-07T20:04:32.912428] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-07T20:04:32.912812] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-07T20:04:32.912920] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-07T20:04:32.913494] [DEBUG] [LOCAL ] MCB: Trimmed 16376 records to 11266 (keeping 200 days of data) [2025-10-07T20:04:32.987175] [DEBUG] [LOCAL ] MCB: Primary data saved (11266 records). [2025-10-07T20:04:32.987313] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-07T20:04:32.987453] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MCB took 34.3s. Estimated remaining: 2h 28m 54s. Rate: 7.1 symbols/min [2025-10-07T20:04:33.165363] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:04:33.175589] [DEBUG] [LOCAL ] MCN: Loaded 8160 existing records from primary storage. [2025-10-07T20:04:33.175854] [INFO ] [MAIN ] MCN: Loaded 8160 existing records. [2025-10-07T20:04:33.361407] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:04:33.362166] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-07T20:04:33.362342] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-07T20:04:33.362763] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-07T20:04:33.362833] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-07T20:04:33.459678] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-07T20:04:33.514550] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-07T20:04:33.669580] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-07T20:04:33.778940] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:04:34.247735] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-07T20:04:35.031715] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T20:04:35.047713] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-07T20:04:35.141421] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T20:04:35.817284] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T20:04:35.847604] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-07T20:04:36.636074] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T20:04:36.647590] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-07T20:04:37.392879] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T20:04:37.447729] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-07T20:04:38.247719] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-07T20:04:38.302990] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-07T20:04:39.047699] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-07T20:04:39.137552] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T20:04:39.847749] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-07T20:04:40.313214] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T20:04:40.647757] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-07T20:04:41.404152] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T20:04:41.447745] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-07T20:04:41.691342] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T20:04:42.246857] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T20:04:42.249226] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-07T20:04:42.761163] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-07T20:04:43.047762] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-07T20:04:43.847701] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-07T20:04:44.596158] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T20:04:44.647682] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-07T20:04:45.103917] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-07T20:04:45.439417] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T20:04:45.447589] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-07T20:04:46.242259] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T20:04:46.247599] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-07T20:04:46.907216] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:04:46.908336] [INFO ] [REMOTE ] MCN: Full fetch complete (11686 records). [2025-10-07T20:04:46.908424] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-07T20:04:47.053841] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-07T20:04:47.269035] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-07T20:04:47.269126] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-07T20:04:47.269415] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-07T20:04:47.269477] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-07T20:04:47.269968] [DEBUG] [LOCAL ] MCN: Trimmed 11686 records to 8124 (keeping 200 days of data) [2025-10-07T20:04:47.317674] [DEBUG] [LOCAL ] MCN: Primary data saved (8124 records). [2025-10-07T20:04:47.317790] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-07T20:04:47.317871] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCN took 14.3s. Estimated remaining: 2h 28m 51s. Rate: 7.1 symbols/min [2025-10-07T20:04:47.482408] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:04:47.523076] [DEBUG] [LOCAL ] MCO: Loaded 39195 existing records from primary storage. [2025-10-07T20:04:47.523384] [INFO ] [MAIN ] MCO: Loaded 39195 existing records. [2025-10-07T20:04:47.708584] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:04:47.708883] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-07T20:04:47.708956] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-07T20:04:47.709495] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-07T20:04:47.709571] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-07T20:04:47.854223] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-07T20:04:48.064894] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:04:48.647722] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-07T20:04:49.274675] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-07T20:04:49.447674] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-07T20:04:49.628192] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T20:04:49.709446] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T20:04:50.247718] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-07T20:04:51.047722] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-07T20:04:51.745225] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-07T20:04:51.782668] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-07T20:04:51.821953] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T20:04:51.847630] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-07T20:04:52.647711] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-07T20:04:53.447635] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-07T20:04:53.559739] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T20:04:54.053781] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T20:04:54.247717] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-07T20:04:54.556874] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T20:04:54.836022] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-07T20:04:55.047726] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-07T20:04:55.460935] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-07T20:04:55.847758] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-07T20:04:56.647719] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-07T20:04:57.447737] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-07T20:04:57.484783] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T20:04:58.247716] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-07T20:04:58.422673] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T20:04:59.047755] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-07T20:04:59.201901] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T20:04:59.726955] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:04:59.730614] [INFO ] [REMOTE ] MCD: Full fetch complete (77032 records). [2025-10-07T20:04:59.730776] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-07T20:04:59.847896] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-07T20:04:59.938833] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T20:04:59.940074] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:04:59.940336] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:04:59.940414] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-07T20:04:59.940604] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-07T20:04:59.940732] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-07T20:04:59.940829] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-07T20:04:59.941011] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCD took 45.2s. Estimated remaining: 2h 28m 46s. Rate: 7.1 symbols/min [2025-10-07T20:05:00.114103] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:05:00.143419] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T20:05:00.161280] [DEBUG] [LOCAL ] MCR: Loaded 8845 existing records from primary storage. [2025-10-07T20:05:00.161572] [INFO ] [MAIN ] MCR: Loaded 8845 existing records. [2025-10-07T20:05:00.335265] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:05:00.335517] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-07T20:05:00.335567] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-07T20:05:00.335787] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-07T20:05:00.335845] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-07T20:05:00.655122] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-07T20:05:00.687299] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:05:01.447706] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-07T20:05:01.779912] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T20:05:02.247625] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-07T20:05:02.311838] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T20:05:02.559545] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T20:05:03.047697] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-07T20:05:03.826799] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T20:05:03.847719] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-07T20:05:03.964843] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T20:05:04.647743] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-07T20:05:05.322548] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T20:05:05.338636] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T20:05:05.340311] [INFO ] [REMOTE ] MCI: Full fetch complete (10031 records). [2025-10-07T20:05:05.340385] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-07T20:05:05.452877] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-07T20:05:05.743827] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-07T20:05:05.743952] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-07T20:05:05.744330] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-07T20:05:05.744411] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-07T20:05:05.745417] [DEBUG] [LOCAL ] MCI: Trimmed 10031 records to 6479 (keeping 200 days of data) [2025-10-07T20:05:05.814603] [DEBUG] [LOCAL ] MCI: Primary data saved (6479 records). [2025-10-07T20:05:05.814843] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-07T20:05:05.814983] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCI took 46.3s. Estimated remaining: 2h 28m 35s. Rate: 7.1 symbols/min [2025-10-07T20:05:06.083378] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:05:06.120680] [DEBUG] [LOCAL ] MCS: Loaded 20959 existing records from primary storage. [2025-10-07T20:05:06.121124] [INFO ] [MAIN ] MCS: Loaded 20959 existing records. [2025-10-07T20:05:06.252880] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-07T20:05:06.343783] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T20:05:06.380231] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:05:06.380527] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-07T20:05:06.380585] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-07T20:05:06.380912] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-07T20:05:06.380977] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-07T20:05:06.777175] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:05:07.047683] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-07T20:05:07.784547] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T20:05:07.801895] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T20:05:07.847740] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-07T20:05:08.647701] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-07T20:05:09.404394] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T20:05:09.447615] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-07T20:05:09.773859] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T20:05:10.247694] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-07T20:05:10.669328] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T20:05:10.963317] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T20:05:11.047634] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-07T20:05:11.847669] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-07T20:05:12.643101] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T20:05:12.647590] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-07T20:05:12.748327] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T20:05:13.450175] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-07T20:05:13.453157] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T20:05:14.247689] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-07T20:05:14.822905] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T20:05:15.047627] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-07T20:05:15.104179] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T20:05:15.847694] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-07T20:05:16.264470] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T20:05:16.647703] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-07T20:05:17.394015] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T20:05:17.448678] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-07T20:05:17.451876] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T20:05:18.247623] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-07T20:05:18.316438] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T20:05:19.047706] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-07T20:05:19.424701] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T20:05:19.681006] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-07T20:05:19.847692] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-07T20:05:20.601554] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T20:05:20.602841] [INFO ] [REMOTE ] MCR: Full fetch complete (14105 records). [2025-10-07T20:05:20.602933] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-07T20:05:20.652775] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-07T20:05:20.982828] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-07T20:05:20.982911] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-07T20:05:20.983240] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-07T20:05:20.983279] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-07T20:05:20.983838] [DEBUG] [LOCAL ] MCR: Trimmed 14105 records to 8883 (keeping 200 days of data) [2025-10-07T20:05:21.035384] [DEBUG] [LOCAL ] MCR: Primary data saved (8883 records). [2025-10-07T20:05:21.035524] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-07T20:05:21.035611] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCR took 21.1s. Estimated remaining: 2h 28m 32s. Rate: 7.1 symbols/min [2025-10-07T20:05:21.240055] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:05:21.285209] [DEBUG] [LOCAL ] MCY: Loaded 24122 existing records from primary storage. [2025-10-07T20:05:21.285510] [INFO ] [MAIN ] MCY: Loaded 24122 existing records. [2025-10-07T20:05:21.452772] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-07T20:05:21.481918] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:05:21.482844] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-07T20:05:21.482898] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-07T20:05:21.483116] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-07T20:05:21.483248] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-07T20:05:21.840060] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:05:22.017542] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T20:05:22.247619] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-07T20:05:22.587073] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T20:05:23.047626] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-07T20:05:23.503155] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T20:05:23.847690] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-07T20:05:24.648487] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-07T20:05:24.649833] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T20:05:24.654334] [INFO ] [REMOTE ] MCO: Full fetch complete (57221 records). [2025-10-07T20:05:24.654512] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-07T20:05:25.046149] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T20:05:25.112880] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-07T20:05:25.113044] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-07T20:05:25.114387] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-07T20:05:25.114464] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-07T20:05:25.116361] [DEBUG] [LOCAL ] MCO: Trimmed 57221 records to 39193 (keeping 200 days of data) [2025-10-07T20:05:25.396086] [DEBUG] [LOCAL ] MCO: Primary data saved (39193 records). [2025-10-07T20:05:25.396301] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-07T20:05:25.396409] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCO took 38.1s. Estimated remaining: 2h 28m 20s. Rate: 7.1 symbols/min [2025-10-07T20:05:25.447680] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-07T20:05:26.238505] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T20:05:26.248353] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-07T20:05:26.946015] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T20:05:26.949517] [INFO ] [REMOTE ] MCK: Full fetch complete (57140 records). [2025-10-07T20:05:26.949630] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-07T20:05:27.047809] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-07T20:05:27.352608] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-07T20:05:27.352951] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-07T20:05:27.354020] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-07T20:05:27.354092] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-07T20:05:27.355674] [DEBUG] [LOCAL ] MCK: Trimmed 57140 records to 38963 (keeping 200 days of data) [2025-10-07T20:05:27.618492] [DEBUG] [LOCAL ] MCK: Primary data saved (38963 records). [2025-10-07T20:05:27.618688] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-07T20:05:27.618831] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCK took 56.9s. Estimated remaining: 2h 28m 7s. Rate: 7.1 symbols/min [2025-10-07T20:05:27.749288] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T20:05:27.847637] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-07T20:05:28.067153] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T20:05:28.647751] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-07T20:05:29.004264] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T20:05:29.447674] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-07T20:05:29.774416] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T20:05:30.247755] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-07T20:05:30.683874] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T20:05:31.047742] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-07T20:05:31.395688] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T20:05:31.847707] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-07T20:05:32.382316] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T20:05:32.511263] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-07T20:05:32.647734] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-07T20:05:33.447738] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-07T20:05:33.692861] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T20:05:34.247735] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-07T20:05:34.613742] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T20:05:34.615721] [INFO ] [REMOTE ] MCS: Full fetch complete (30570 records). [2025-10-07T20:05:34.615804] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-07T20:05:35.002820] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-07T20:05:35.002939] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-07T20:05:35.003557] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-07T20:05:35.003601] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-07T20:05:35.004346] [DEBUG] [LOCAL ] MCS: Trimmed 30570 records to 20960 (keeping 200 days of data) [2025-10-07T20:05:35.139097] [DEBUG] [LOCAL ] MCS: Primary data saved (20960 records). [2025-10-07T20:05:35.139231] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-07T20:05:35.139311] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCS took 29.3s. Estimated remaining: 2h 27m 58s. Rate: 7.1 symbols/min [2025-10-07T20:05:35.480411] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T20:05:35.486274] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-07T20:05:36.595637] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T20:05:36.601953] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-07T20:05:37.640839] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T20:05:37.645777] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-07T20:05:38.641002] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T20:05:38.643388] [INFO ] [REMOTE ] MCY: Full fetch complete (41359 records). [2025-10-07T20:05:38.643512] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-07T20:05:39.034827] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-07T20:05:39.034913] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-07T20:05:39.035598] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-07T20:05:39.035637] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-07T20:05:39.036611] [DEBUG] [LOCAL ] MCY: Trimmed 41359 records to 24059 (keeping 200 days of data) [2025-10-07T20:05:39.195588] [DEBUG] [LOCAL ] MCY: Primary data saved (24059 records). [2025-10-07T20:05:39.195776] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-07T20:05:39.195874] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCY took 18.2s. Estimated remaining: 2h 27m 46s. Rate: 7.1 symbols/min [2025-10-07T20:05:39.766006] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:05:39.901786] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:05:39.905483] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:05:39.852836] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:05:39.916796] [DEBUG] [LOCAL ] MDST: Loaded 5710 existing records from primary storage. [2025-10-07T20:05:39.917110] [INFO ] [MAIN ] MDST: Loaded 5710 existing records. [2025-10-07T20:05:40.170400] [DEBUG] [LOCAL ] MD: Loaded 38383 existing records from primary storage. [2025-10-07T20:05:40.168751] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:05:40.170963] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-07T20:05:40.171035] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-07T20:05:40.171265] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-07T20:05:40.171324] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-07T20:05:40.171450] [INFO ] [MAIN ] MD: Loaded 38383 existing records. [2025-10-07T20:05:40.360478] [DEBUG] [LOCAL ] MDU: Loaded 47982 existing records from primary storage. [2025-10-07T20:05:40.390211] [INFO ] [MAIN ] MDU: Loaded 47982 existing records. [2025-10-07T20:05:40.480502] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-07T20:05:40.555606] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-07T20:05:40.928342] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:05:41.024080] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-07T20:05:41.035479] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-07T20:05:41.045389] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-07T20:05:41.023799] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:05:41.045573] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-07T20:05:41.049583] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-07T20:05:41.115737] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-07T20:05:41.210138] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:05:41.207005] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:05:41.225157] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-07T20:05:41.225789] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-07T20:05:41.225614] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-07T20:05:41.236242] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-07T20:05:41.296335] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-07T20:05:41.386854] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-07T20:05:41.410201] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-07T20:05:42.103092] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T20:05:42.179070] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-07T20:05:42.210878] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:05:42.234189] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:05:42.234828] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-07T20:05:42.241343] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-07T20:05:42.318988] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:05:42.319374] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-07T20:05:42.863959] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T20:05:42.866001] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-07T20:05:43.396699] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T20:05:43.404810] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-07T20:05:43.468482] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T20:05:43.470505] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-07T20:05:43.879037] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T20:05:43.890094] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-07T20:05:44.028847] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T20:05:44.101621] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-07T20:05:44.647624] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-07T20:05:44.747083] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T20:05:45.219095] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T20:05:45.447603] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-07T20:05:45.791289] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T20:05:46.022058] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T20:05:46.247761] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-07T20:05:47.047754] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-07T20:05:47.847669] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-07T20:05:47.876199] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T20:05:48.473506] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T20:05:48.647692] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-07T20:05:48.781477] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T20:05:49.428888] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-07T20:05:49.447609] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-07T20:05:50.056824] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T20:05:50.247635] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-07T20:05:51.047745] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-07T20:05:51.804452] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T20:05:51.847607] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-07T20:05:52.147989] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T20:05:52.535270] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T20:05:52.536287] [INFO ] [REMOTE ] MDST: Full fetch complete (8562 records). [2025-10-07T20:05:52.536356] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-07T20:05:52.652804] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-07T20:05:52.918464] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-07T20:05:52.918570] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-07T20:05:52.918823] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-07T20:05:52.918888] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-07T20:05:52.919302] [DEBUG] [LOCAL ] MDST: Trimmed 8562 records to 5713 (keeping 200 days of data) [2025-10-07T20:05:52.954368] [DEBUG] [LOCAL ] MDST: Primary data saved (5713 records). [2025-10-07T20:05:52.954460] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-07T20:05:52.954548] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 13.8s. Estimated remaining: 2h 27m 42s. Rate: 7.1 symbols/min [2025-10-07T20:05:53.131604] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:05:53.141825] [DEBUG] [LOCAL ] MDV: Loaded 8498 existing records from primary storage. [2025-10-07T20:05:53.142051] [INFO ] [MAIN ] MDV: Loaded 8498 existing records. [2025-10-07T20:05:53.325141] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:05:53.325374] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-07T20:05:53.325430] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-07T20:05:53.325789] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-07T20:05:53.325850] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-07T20:05:53.452775] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-07T20:05:53.692975] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:05:54.247618] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-07T20:05:54.766749] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T20:05:54.864527] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-07T20:05:54.937842] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T20:05:55.047692] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-07T20:05:55.847685] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-07T20:05:56.479750] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T20:05:56.484458] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T20:05:56.647742] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-07T20:05:57.447729] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-07T20:05:58.161686] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T20:05:58.247772] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-07T20:05:59.043427] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T20:05:59.052983] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-07T20:05:59.835372] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T20:05:59.847603] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-07T20:06:00.647741] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-07T20:06:01.317086] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T20:06:01.324788] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-07T20:06:01.325984] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T20:06:01.447747] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-07T20:06:02.247727] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-07T20:06:02.880353] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T20:06:03.047734] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-07T20:06:03.847705] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-07T20:06:03.954137] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T20:06:04.490193] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T20:06:04.647744] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-07T20:06:05.025585] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T20:06:05.399143] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T20:06:05.447680] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-07T20:06:06.247675] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-07T20:06:06.262668] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T20:06:07.047705] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-07T20:06:07.412270] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T20:06:07.847766] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-07T20:06:08.626935] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T20:06:08.647704] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-07T20:06:08.688776] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T20:06:09.447683] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-07T20:06:10.090880] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T20:06:10.247711] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-07T20:06:10.702919] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-07T20:06:11.005662] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T20:06:11.047623] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-07T20:06:11.847705] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-07T20:06:12.421538] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T20:06:12.424792] [INFO ] [REMOTE ] MD: Full fetch complete (55243 records). [2025-10-07T20:06:12.424941] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-07T20:06:12.651584] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-07T20:06:12.645756] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T20:06:12.940730] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-07T20:06:12.940841] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-07T20:06:12.941884] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-07T20:06:12.941969] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-07T20:06:12.943317] [DEBUG] [LOCAL ] MD: Trimmed 55243 records to 38498 (keeping 200 days of data) [2025-10-07T20:06:13.176554] [DEBUG] [LOCAL ] MD: Primary data saved (38498 records). [2025-10-07T20:06:13.176730] [INFO ] [MAIN ] MD: Full history saved. [2025-10-07T20:06:13.176844] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MD took 34.0s. Estimated remaining: 2h 27m 42s. Rate: 7.1 symbols/min [2025-10-07T20:06:13.339941] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:06:13.356487] [DEBUG] [LOCAL ] MEC: Loaded 16235 existing records from primary storage. [2025-10-07T20:06:13.356761] [INFO ] [MAIN ] MEC: Loaded 16235 existing records. [2025-10-07T20:06:13.452906] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-07T20:06:13.545626] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:06:13.545941] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-07T20:06:13.545998] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-07T20:06:13.546848] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-07T20:06:13.546911] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-07T20:06:13.907638] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:06:14.247670] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-07T20:06:14.651381] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T20:06:14.716188] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T20:06:14.884509] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-07T20:06:15.047711] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-07T20:06:15.582705] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T20:06:15.583747] [INFO ] [REMOTE ] MDV: Full fetch complete (11731 records). [2025-10-07T20:06:15.583817] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-07T20:06:15.855714] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-07T20:06:15.939521] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-07T20:06:15.939673] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-07T20:06:15.940037] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-07T20:06:15.940081] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-07T20:06:15.940522] [DEBUG] [LOCAL ] MDV: Trimmed 11731 records to 8514 (keeping 200 days of data) [2025-10-07T20:06:15.994840] [DEBUG] [LOCAL ] MDV: Primary data saved (8514 records). [2025-10-07T20:06:15.994986] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-07T20:06:15.995095] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MDV took 23.0s. Estimated remaining: 2h 27m 30s. Rate: 7.1 symbols/min [2025-10-07T20:06:16.158579] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:06:16.179917] [DEBUG] [LOCAL ] MED: Loaded 21460 existing records from primary storage. [2025-10-07T20:06:16.180208] [INFO ] [MAIN ] MED: Loaded 21460 existing records. [2025-10-07T20:06:16.351108] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:06:16.351332] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-07T20:06:16.351379] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-07T20:06:16.351929] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-07T20:06:16.351988] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-07T20:06:16.648275] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-07T20:06:16.730540] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:06:16.958009] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T20:06:17.447690] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-07T20:06:18.247623] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-07T20:06:18.444663] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T20:06:18.445581] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T20:06:19.047729] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-07T20:06:19.661708] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T20:06:19.814485] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T20:06:19.847717] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-07T20:06:20.647752] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-07T20:06:21.062034] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T20:06:21.447689] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-07T20:06:22.247720] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-07T20:06:22.466102] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-07T20:06:22.469712] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-07T20:06:22.469836] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-07T20:06:22.871804] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-07T20:06:22.872121] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-07T20:06:22.873141] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-07T20:06:22.873207] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-07T20:06:22.874844] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-10-07T20:06:23.014594] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T20:06:23.037045] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T20:06:23.047600] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-07T20:06:23.276178] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-07T20:06:23.276330] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-07T20:06:23.276414] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 44.1s. Estimated remaining: 2h 27m 20s. Rate: 7.1 symbols/min [2025-10-07T20:06:23.443142] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:06:23.473010] [DEBUG] [LOCAL ] MEG: Loaded 31610 existing records from primary storage. [2025-10-07T20:06:23.473311] [INFO ] [MAIN ] MEG: Loaded 31610 existing records. [2025-10-07T20:06:23.647217] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:06:23.647491] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-07T20:06:23.647545] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-07T20:06:23.648522] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-07T20:06:23.648583] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-07T20:06:23.852954] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-07T20:06:24.001132] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:06:24.651350] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-07T20:06:24.657045] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T20:06:24.877784] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T20:06:25.447617] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-07T20:06:25.783698] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T20:06:26.247716] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-07T20:06:26.803406] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T20:06:27.047700] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-07T20:06:27.269691] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T20:06:27.847680] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-07T20:06:28.575067] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T20:06:28.647638] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-07T20:06:28.890310] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T20:06:29.447692] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-07T20:06:30.036833] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T20:06:30.247745] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-07T20:06:30.501082] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T20:06:31.047788] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-07T20:06:31.850910] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-07T20:06:31.867872] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T20:06:32.535391] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T20:06:32.647686] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-07T20:06:33.107353] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-07T20:06:33.447690] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-07T20:06:34.044552] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T20:06:34.247619] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-07T20:06:34.512120] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T20:06:35.047706] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-07T20:06:35.212013] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T20:06:35.847623] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-07T20:06:35.983320] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T20:06:36.482150] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:06:36.483498] [INFO ] [REMOTE ] MEC: Full fetch complete (22781 records). [2025-10-07T20:06:36.483571] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-07T20:06:36.656553] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-07T20:06:36.871091] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-07T20:06:36.871226] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-07T20:06:36.871916] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-07T20:06:36.872001] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-07T20:06:36.873179] [DEBUG] [LOCAL ] MEC: Trimmed 22781 records to 16219 (keeping 200 days of data) [2025-10-07T20:06:36.977998] [DEBUG] [LOCAL ] MEC: Primary data saved (16219 records). [2025-10-07T20:06:36.978151] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-07T20:06:36.978237] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MEC took 23.8s. Estimated remaining: 2h 27m 16s. Rate: 7.1 symbols/min [2025-10-07T20:06:37.144337] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:06:37.164949] [DEBUG] [LOCAL ] MEGI: Loaded 19965 existing records from primary storage. [2025-10-07T20:06:37.165215] [INFO ] [MAIN ] MEGI: Loaded 19965 existing records. [2025-10-07T20:06:37.338027] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:06:37.338308] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-07T20:06:37.338357] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-07T20:06:37.338930] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-07T20:06:37.339019] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-07T20:06:37.452814] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-07T20:06:37.690776] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:06:38.089141] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T20:06:38.247667] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-07T20:06:38.710927] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T20:06:39.047694] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-07T20:06:39.596259] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T20:06:39.847676] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-07T20:06:40.647703] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-07T20:06:40.675338] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T20:06:40.678808] [INFO ] [REMOTE ] MDU: Full fetch complete (70440 records). [2025-10-07T20:06:40.678924] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-07T20:06:41.106868] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-07T20:06:41.107151] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-07T20:06:41.108893] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-07T20:06:41.108991] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-07T20:06:41.129583] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T20:06:41.137031] [DEBUG] [LOCAL ] MDU: Trimmed 70440 records to 48006 (keeping 200 days of data) [2025-10-07T20:06:41.447689] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-07T20:06:41.457438] [DEBUG] [LOCAL ] MDU: Primary data saved (48006 records). [2025-10-07T20:06:41.457596] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-07T20:06:41.457708] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MDU took 1m 2s. Estimated remaining: 2h 27m 4s. Rate: 7.1 symbols/min [2025-10-07T20:06:41.627836] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:06:41.661194] [DEBUG] [LOCAL ] MEI: Loaded 31914 existing records from primary storage. [2025-10-07T20:06:41.661509] [INFO ] [MAIN ] MEI: Loaded 31914 existing records. [2025-10-07T20:06:41.844859] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:06:41.860723] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-07T20:06:41.861388] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-07T20:06:41.862224] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T20:06:41.868045] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-07T20:06:41.868744] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-07T20:06:42.216151] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:06:42.247619] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-07T20:06:42.622293] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T20:06:43.047625] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-07T20:06:43.285284] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T20:06:43.847691] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-07T20:06:44.468179] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T20:06:44.647633] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-07T20:06:44.970181] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T20:06:45.447633] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-07T20:06:45.759902] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T20:06:46.247762] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-07T20:06:46.848294] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T20:06:46.867208] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T20:06:47.047693] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-07T20:06:47.847760] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-07T20:06:48.246348] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T20:06:48.647683] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-07T20:06:49.245180] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T20:06:49.447633] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-07T20:06:49.662788] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T20:06:50.247729] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-07T20:06:50.306001] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T20:06:51.047676] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-07T20:06:51.211444] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T20:06:51.847678] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-07T20:06:52.055547] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T20:06:52.647735] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-07T20:06:52.864579] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T20:06:53.447724] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-07T20:06:53.601389] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T20:06:54.247632] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-07T20:06:54.557921] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T20:06:55.047715] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-07T20:06:55.408237] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T20:06:55.846356] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-07T20:06:55.848276] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-07T20:06:55.849789] [INFO ] [REMOTE ] MED: Full fetch complete (32437 records). [2025-10-07T20:06:55.849877] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-07T20:06:56.278020] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-07T20:06:56.278127] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-07T20:06:56.279011] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-07T20:06:56.279079] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-07T20:06:56.280237] [DEBUG] [LOCAL ] MED: Trimmed 32437 records to 21400 (keeping 200 days of data) [2025-10-07T20:06:56.416078] [DEBUG] [LOCAL ] MED: Primary data saved (21400 records). [2025-10-07T20:06:56.416261] [INFO ] [MAIN ] MED: Full history saved. [2025-10-07T20:06:56.416356] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MED took 40.4s. Estimated remaining: 2h 27m 1s. Rate: 7.1 symbols/min [2025-10-07T20:06:56.596157] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:06:56.652888] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-07T20:06:56.657509] [DEBUG] [LOCAL ] MET: Loaded 53321 existing records from primary storage. [2025-10-07T20:06:56.658104] [INFO ] [MAIN ] MET: Loaded 53321 existing records. [2025-10-07T20:06:56.848459] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:06:56.848811] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-07T20:06:56.848868] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-07T20:06:56.850023] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-07T20:06:56.850083] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-07T20:06:57.165610] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T20:06:57.228779] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:06:57.228950] [INFO ] [REMOTE ] MEG: Full fetch complete (47661 records). [2025-10-07T20:06:57.229539] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-07T20:06:57.452847] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-07T20:06:57.610974] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-07T20:06:57.611058] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-07T20:06:57.611947] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-07T20:06:57.612012] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-07T20:06:57.613723] [DEBUG] [LOCAL ] MEG: Trimmed 47661 records to 31522 (keeping 200 days of data) [2025-10-07T20:06:57.798288] [DEBUG] [LOCAL ] MEG: Primary data saved (31522 records). [2025-10-07T20:06:57.798426] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-07T20:06:57.798528] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MEG took 34.5s. Estimated remaining: 2h 26m 47s. Rate: 7.1 symbols/min [2025-10-07T20:06:57.982493] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T20:06:57.985040] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:06:58.035422] [DEBUG] [LOCAL ] MFA: Loaded 45559 existing records from primary storage. [2025-10-07T20:06:58.035794] [INFO ] [MAIN ] MFA: Loaded 45559 existing records. [2025-10-07T20:06:58.212352] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:06:58.212633] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-07T20:06:58.212717] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-07T20:06:58.212952] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-07T20:06:58.213009] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-07T20:06:58.254394] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-07T20:06:58.560267] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:06:59.047761] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-07T20:06:59.215665] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T20:06:59.847704] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-07T20:06:59.925519] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T20:07:00.647742] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-07T20:07:00.719748] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T20:07:01.447692] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-07T20:07:01.613723] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T20:07:01.732054] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-07T20:07:02.247716] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-07T20:07:02.627227] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T20:07:03.047715] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-07T20:07:03.599177] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T20:07:03.847680] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-07T20:07:04.600003] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T20:07:04.647686] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-07T20:07:05.447690] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-07T20:07:05.758161] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T20:07:06.244898] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T20:07:06.251917] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-07T20:07:06.283632] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T20:07:07.047693] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-07T20:07:07.477244] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T20:07:07.479714] [INFO ] [REMOTE ] MEGI: Full fetch complete (29999 records). [2025-10-07T20:07:07.479972] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-07T20:07:07.852787] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-07T20:07:07.865876] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-07T20:07:07.865985] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-07T20:07:07.866956] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-07T20:07:07.867152] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-07T20:07:07.868902] [DEBUG] [LOCAL ] MEGI: Trimmed 29999 records to 19956 (keeping 200 days of data) [2025-10-07T20:07:08.010300] [DEBUG] [LOCAL ] MEGI: Primary data saved (19956 records). [2025-10-07T20:07:08.010538] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-07T20:07:08.010800] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEGI took 31.0s. Estimated remaining: 2h 26m 40s. Rate: 7.1 symbols/min [2025-10-07T20:07:08.183801] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:07:08.191493] [DEBUG] [LOCAL ] MFAN: Loaded 4269 existing records from primary storage. [2025-10-07T20:07:08.191745] [INFO ] [MAIN ] MFAN: Loaded 4269 existing records. [2025-10-07T20:07:08.373402] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:07:08.373630] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-07T20:07:08.373716] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-07T20:07:08.373913] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-07T20:07:08.373971] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-07T20:07:08.651402] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-07T20:07:08.784620] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:07:08.853175] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T20:07:09.447622] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-07T20:07:09.569415] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T20:07:09.881094] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-07T20:07:09.925811] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-07T20:07:10.247624] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-07T20:07:10.788071] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-07T20:07:11.047728] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-07T20:07:11.847690] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-07T20:07:12.647687] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-07T20:07:12.823954] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T20:07:13.425497] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T20:07:13.447607] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-07T20:07:14.005806] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T20:07:14.247701] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-07T20:07:14.842132] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T20:07:15.047746] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-07T20:07:15.847629] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-07T20:07:16.012697] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T20:07:16.627168] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T20:07:16.647688] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-07T20:07:17.268242] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T20:07:17.447763] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-07T20:07:18.151252] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T20:07:18.247637] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-07T20:07:18.835212] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T20:07:18.838041] [INFO ] [REMOTE ] MEI: Full fetch complete (45568 records). [2025-10-07T20:07:18.838170] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-07T20:07:19.059242] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-07T20:07:19.356590] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-07T20:07:19.356756] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-07T20:07:19.358757] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-07T20:07:19.358832] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-07T20:07:19.363272] [DEBUG] [LOCAL ] MEI: Trimmed 45568 records to 31840 (keeping 200 days of data) [2025-10-07T20:07:19.586477] [DEBUG] [LOCAL ] MEI: Primary data saved (31840 records). [2025-10-07T20:07:19.587061] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-07T20:07:19.587202] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEI took 38.1s. Estimated remaining: 2h 26m 34s. Rate: 7.1 symbols/min [2025-10-07T20:07:19.792423] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:07:19.802036] [DEBUG] [LOCAL ] MFAO: Loaded 3886 existing records from primary storage. [2025-10-07T20:07:19.802340] [INFO ] [MAIN ] MFAO: Loaded 3886 existing records. [2025-10-07T20:07:19.856946] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-07T20:07:20.036061] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:07:20.036579] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-07T20:07:20.036744] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-07T20:07:20.037099] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-07T20:07:20.037185] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-07T20:07:20.098140] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T20:07:20.414803] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T20:07:20.522517] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:07:20.563863] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T20:07:20.647708] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-07T20:07:21.196018] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T20:07:21.447732] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-07T20:07:22.247720] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-07T20:07:22.833593] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T20:07:23.047694] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-07T20:07:23.111857] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T20:07:23.847740] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-07T20:07:24.647630] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-07T20:07:24.817836] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T20:07:25.233691] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T20:07:25.447637] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-07T20:07:25.567868] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T20:07:25.897985] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T20:07:26.247754] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-07T20:07:26.867077] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T20:07:27.047695] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-07T20:07:27.609556] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T20:07:27.847737] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-07T20:07:28.398388] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-07T20:07:28.647723] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-07T20:07:29.137484] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-07T20:07:29.447764] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-07T20:07:30.247737] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-07T20:07:30.724575] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:07:30.725853] [INFO ] [REMOTE ] MFAN: Full fetch complete (5763 records). [2025-10-07T20:07:30.725930] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-07T20:07:31.049029] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-07T20:07:31.089618] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T20:07:31.125348] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-07T20:07:31.125785] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-07T20:07:31.126073] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-07T20:07:31.126137] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-07T20:07:31.126293] [INFO ] [REMOTE ] MET: Full fetch complete (77126 records). [2025-10-07T20:07:31.127362] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-07T20:07:31.127537] [DEBUG] [LOCAL ] MFAN: Trimmed 5763 records to 4285 (keeping 200 days of data) [2025-10-07T20:07:31.264525] [DEBUG] [LOCAL ] MFAN: Primary data saved (4285 records). [2025-10-07T20:07:31.264924] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-07T20:07:31.265365] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MFAN took 23.3s. Estimated remaining: 2h 26m 28s. Rate: 7.1 symbols/min [2025-10-07T20:07:31.660031] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:07:31.745074] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-07T20:07:31.770919] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-07T20:07:31.771049] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-07T20:07:31.772245] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-07T20:07:31.772333] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-07T20:07:31.777024] [DEBUG] [LOCAL ] MET: Trimmed 77126 records to 53326 (keeping 200 days of data) [2025-10-07T20:07:31.862795] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-07T20:07:31.927095] [DEBUG] [LOCAL ] MFC: Loaded 51089 existing records from primary storage. [2025-10-07T20:07:31.928996] [INFO ] [MAIN ] MFC: Loaded 51089 existing records. [2025-10-07T20:07:32.127070] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:07:32.127969] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-07T20:07:32.128684] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-07T20:07:32.129377] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-07T20:07:32.129702] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-07T20:07:32.631178] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:07:32.651675] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-07T20:07:32.744820] [DEBUG] [LOCAL ] MET: Primary data saved (53326 records). [2025-10-07T20:07:32.744984] [INFO ] [MAIN ] MET: Full history saved. [2025-10-07T20:07:32.746321] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MET took 36.3s. Estimated remaining: 2h 26m 14s. Rate: 7.1 symbols/min [2025-10-07T20:07:32.910701] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:07:32.957716] [DEBUG] [LOCAL ] MFG: Loaded 49260 existing records from primary storage. [2025-10-07T20:07:32.958060] [INFO ] [MAIN ] MFG: Loaded 49260 existing records. [2025-10-07T20:07:33.141513] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T20:07:33.141291] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:07:33.144232] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-07T20:07:33.144299] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-07T20:07:33.144546] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-07T20:07:33.144604] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-07T20:07:33.449108] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-07T20:07:33.515453] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:07:33.576955] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T20:07:33.992703] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-07T20:07:34.247744] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-07T20:07:34.835694] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T20:07:35.047738] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-07T20:07:35.847749] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-07T20:07:36.647621] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-07T20:07:36.751319] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T20:07:37.224053] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T20:07:37.438222] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T20:07:37.441609] [INFO ] [REMOTE ] MFA: Full fetch complete (65309 records). [2025-10-07T20:07:37.441797] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-07T20:07:37.453553] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-07T20:07:37.830493] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-07T20:07:37.830602] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-07T20:07:37.831522] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-07T20:07:37.831582] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-07T20:07:37.832995] [DEBUG] [LOCAL ] MFA: Trimmed 65309 records to 45634 (keeping 200 days of data) [2025-10-07T20:07:38.086510] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T20:07:38.134594] [DEBUG] [LOCAL ] MFA: Primary data saved (45634 records). [2025-10-07T20:07:38.134762] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-07T20:07:38.134857] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFA took 40.3s. Estimated remaining: 2h 26m 3s. Rate: 7.1 symbols/min [2025-10-07T20:07:38.252774] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-07T20:07:38.305575] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:07:38.321485] [DEBUG] [LOCAL ] MFM: Loaded 14802 existing records from primary storage. [2025-10-07T20:07:38.321759] [INFO ] [MAIN ] MFM: Loaded 14802 existing records. [2025-10-07T20:07:38.504664] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:07:38.504956] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-07T20:07:38.505006] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-07T20:07:38.505207] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-07T20:07:38.505264] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-07T20:07:38.852083] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:07:39.047616] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-07T20:07:39.795876] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T20:07:39.827491] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T20:07:39.847601] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-07T20:07:40.647764] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-07T20:07:41.184280] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-07T20:07:41.448009] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T20:07:41.448091] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-07T20:07:42.092537] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-07T20:07:42.247706] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-07T20:07:43.047752] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-07T20:07:43.847228] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T20:07:43.849738] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-07T20:07:43.892892] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T20:07:44.324880] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-07T20:07:44.647686] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-07T20:07:45.440693] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T20:07:45.447598] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-07T20:07:46.235195] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T20:07:46.247604] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-07T20:07:47.047721] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-07T20:07:47.305504] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T20:07:47.847742] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-07T20:07:48.480087] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T20:07:48.645042] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T20:07:48.648399] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-07T20:07:49.208483] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T20:07:49.209727] [INFO ] [REMOTE ] MFAO: Full fetch complete (5375 records). [2025-10-07T20:07:49.209803] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-07T20:07:49.452986] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-07T20:07:49.623329] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-07T20:07:49.623497] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-07T20:07:49.623785] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-07T20:07:49.623866] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-07T20:07:49.624471] [DEBUG] [LOCAL ] MFAO: Trimmed 5375 records to 3908 (keeping 200 days of data) [2025-10-07T20:07:49.651163] [DEBUG] [LOCAL ] MFAO: Primary data saved (3908 records). [2025-10-07T20:07:49.651354] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-07T20:07:49.651508] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 30.1s. Estimated remaining: 2h 25m 57s. Rate: 7.1 symbols/min [2025-10-07T20:07:49.835890] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:07:49.836204] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-07T20:07:49.836263] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-07T20:07:49.836392] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-07T20:07:49.836436] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-07T20:07:49.836480] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-07T20:07:49.836515] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-07T20:07:50.202507] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:07:50.247714] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-07T20:07:50.805611] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T20:07:51.047739] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-07T20:07:51.464024] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-07T20:07:51.837952] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T20:07:51.847707] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-07T20:07:52.647698] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-07T20:07:52.775706] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T20:07:53.447712] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-07T20:07:54.247634] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-07T20:07:54.288193] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T20:07:54.477743] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T20:07:55.047688] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-07T20:07:55.847696] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-07T20:07:56.004452] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T20:07:56.179400] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-07T20:07:56.647714] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-07T20:07:56.780232] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T20:07:57.447706] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-07T20:07:57.685965] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-07T20:07:58.139990] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T20:07:58.247679] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-07T20:07:59.047684] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-07T20:07:59.293386] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-07T20:07:59.820330] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T20:07:59.847605] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-07T20:08:00.647692] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-07T20:08:01.447727] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-07T20:08:01.563527] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T20:08:01.958149] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T20:08:02.232511] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-07T20:08:02.247587] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-07T20:08:03.047636] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-07T20:08:03.172337] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T20:08:03.847737] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-07T20:08:04.647627] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-07T20:08:04.725832] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T20:08:04.776137] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T20:08:04.778278] [INFO ] [REMOTE ] MFM: Full fetch complete (19662 records). [2025-10-07T20:08:04.778506] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-07T20:08:04.978730] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-07T20:08:05.178394] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-07T20:08:05.178504] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-07T20:08:05.179148] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-07T20:08:05.179216] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-07T20:08:05.180262] [DEBUG] [LOCAL ] MFM: Trimmed 19662 records to 14786 (keeping 200 days of data) [2025-10-07T20:08:05.265673] [DEBUG] [LOCAL ] MFM: Primary data saved (14786 records). [2025-10-07T20:08:05.265860] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-07T20:08:05.265956] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFM took 27.1s. Estimated remaining: 2h 25m 54s. Rate: 7.1 symbols/min [2025-10-07T20:08:05.438785] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:08:05.447120] [DEBUG] [LOCAL ] MFSG: Loaded 5492 existing records from primary storage. [2025-10-07T20:08:05.447373] [INFO ] [MAIN ] MFSG: Loaded 5492 existing records. [2025-10-07T20:08:05.452853] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-07T20:08:05.628902] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:08:05.629158] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-07T20:08:05.629214] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-07T20:08:05.629484] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-07T20:08:05.629542] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-07T20:08:05.969960] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:08:06.247720] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-07T20:08:06.590742] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-07T20:08:07.047678] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-07T20:08:07.196800] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T20:08:07.847692] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-07T20:08:08.647707] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-07T20:08:08.818711] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T20:08:08.944801] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-07T20:08:09.105933] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T20:08:09.447714] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-07T20:08:10.247620] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-07T20:08:10.944761] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T20:08:10.948082] [INFO ] [REMOTE ] MFG: Full fetch complete (69104 records). [2025-10-07T20:08:10.948195] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-07T20:08:11.052725] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-07T20:08:11.325463] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-07T20:08:11.325545] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-07T20:08:11.326464] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-07T20:08:11.326530] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-07T20:08:11.327962] [DEBUG] [LOCAL ] MFG: Trimmed 69104 records to 49321 (keeping 200 days of data) [2025-10-07T20:08:11.553106] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-07T20:08:11.618145] [DEBUG] [LOCAL ] MFG: Primary data saved (49321 records). [2025-10-07T20:08:11.618299] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-07T20:08:11.618494] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFG took 38.9s. Estimated remaining: 2h 25m 44s. Rate: 7.1 symbols/min [2025-10-07T20:08:11.785117] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:08:11.798860] [DEBUG] [LOCAL ] MFSI: Loaded 11672 existing records from primary storage. [2025-10-07T20:08:11.799099] [INFO ] [MAIN ] MFSI: Loaded 11672 existing records. [2025-10-07T20:08:11.852835] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-07T20:08:11.979614] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:08:11.980027] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-07T20:08:11.980215] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-07T20:08:11.980568] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-07T20:08:11.980690] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-07T20:08:12.159999] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T20:08:12.377160] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-07T20:08:12.390052] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:08:12.647690] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-07T20:08:13.031640] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-07T20:08:13.447685] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-07T20:08:14.186978] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T20:08:14.247638] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-07T20:08:14.574514] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-07T20:08:15.047695] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-07T20:08:15.407942] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-07T20:08:15.847717] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-07T20:08:16.325552] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-07T20:08:16.647718] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-07T20:08:17.204276] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T20:08:17.447682] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-07T20:08:18.247684] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-07T20:08:18.841506] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T20:08:19.047703] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-07T20:08:19.165133] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:08:19.559845] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-07T20:08:19.847669] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-07T20:08:20.423636] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T20:08:20.647776] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-07T20:08:21.365286] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-07T20:08:21.447774] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-07T20:08:22.211461] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T20:08:22.247605] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-07T20:08:23.039881] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T20:08:23.047587] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-07T20:08:23.847727] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-07T20:08:23.954344] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T20:08:24.647680] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-07T20:08:25.268749] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T20:08:25.447678] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-07T20:08:25.493819] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-07T20:08:25.498189] [INFO ] [REMOTE ] MFC: Full fetch complete (74167 records). [2025-10-07T20:08:25.498332] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-07T20:08:25.889870] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-07T20:08:25.889974] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-07T20:08:25.891035] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-07T20:08:25.891103] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-07T20:08:25.892666] [DEBUG] [LOCAL ] MFC: Trimmed 74167 records to 51121 (keeping 200 days of data) [2025-10-07T20:08:26.079325] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T20:08:26.220100] [DEBUG] [LOCAL ] MFC: Primary data saved (51121 records). [2025-10-07T20:08:26.220266] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-07T20:08:26.220355] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFC took 55.0s. Estimated remaining: 2h 25m 41s. Rate: 7.1 symbols/min [2025-10-07T20:08:26.252875] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-07T20:08:26.395460] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:08:26.400729] [DEBUG] [LOCAL ] MFSV: Loaded 2634 existing records from primary storage. [2025-10-07T20:08:26.400934] [INFO ] [MAIN ] MFSV: Loaded 2634 existing records. [2025-10-07T20:08:26.576417] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:08:26.576830] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-07T20:08:26.576892] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-07T20:08:26.577080] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-07T20:08:26.577139] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-07T20:08:26.931880] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:08:27.047621] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-07T20:08:27.255964] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T20:08:27.847698] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-07T20:08:27.869441] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T20:08:28.647718] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-07T20:08:28.804808] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T20:08:28.951573] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-07T20:08:29.447717] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-07T20:08:30.205109] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T20:08:30.206907] [INFO ] [REMOTE ] MFSI: Full fetch complete (14019 records). [2025-10-07T20:08:30.207013] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-07T20:08:30.252820] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-07T20:08:30.598574] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-07T20:08:30.598711] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-07T20:08:30.599373] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-07T20:08:30.599422] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-07T20:08:30.600113] [DEBUG] [LOCAL ] MFSI: Trimmed 14019 records to 11719 (keeping 200 days of data) [2025-10-07T20:08:30.681388] [DEBUG] [LOCAL ] MFSI: Primary data saved (11719 records). [2025-10-07T20:08:30.681611] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-07T20:08:30.681751] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFSI took 19.1s. Estimated remaining: 2h 25m 29s. Rate: 7.1 symbols/min [2025-10-07T20:08:30.874220] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:08:30.895232] [DEBUG] [LOCAL ] MG: Loaded 16310 existing records from primary storage. [2025-10-07T20:08:30.895574] [INFO ] [MAIN ] MG: Loaded 16310 existing records. [2025-10-07T20:08:31.012891] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T20:08:31.062767] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-07T20:08:31.122715] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:08:31.123231] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-07T20:08:31.123289] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-07T20:08:31.123519] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-07T20:08:31.123580] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-07T20:08:31.549678] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:08:31.682288] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:08:31.683291] [INFO ] [REMOTE ] MFSB: Full fetch complete (1773 records). [2025-10-07T20:08:31.683364] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-07T20:08:31.857899] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-07T20:08:31.890357] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-07T20:08:31.891072] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:08:31.891206] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:08:31.891294] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-07T20:08:31.891400] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-07T20:08:31.891460] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-07T20:08:31.891583] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-07T20:08:31.891733] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFSB took 42.2s. Estimated remaining: 2h 25m 15s. Rate: 7.1 symbols/min [2025-10-07T20:08:32.084273] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:08:32.145581] [DEBUG] [LOCAL ] MGA: Loaded 50673 existing records from primary storage. [2025-10-07T20:08:32.146012] [INFO ] [MAIN ] MGA: Loaded 50673 existing records. [2025-10-07T20:08:32.322318] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:08:32.322555] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-07T20:08:32.322605] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-07T20:08:32.322844] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-07T20:08:32.322901] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-07T20:08:32.622029] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T20:08:32.652790] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-07T20:08:32.758550] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:08:33.414965] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T20:08:33.447600] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-07T20:08:34.216372] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T20:08:34.217464] [INFO ] [REMOTE ] MFSG: Full fetch complete (6266 records). [2025-10-07T20:08:34.217536] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-07T20:08:34.252926] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-07T20:08:34.584683] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-07T20:08:34.584775] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-07T20:08:34.584975] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-07T20:08:34.585016] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-07T20:08:34.585401] [DEBUG] [LOCAL ] MFSG: Trimmed 6266 records to 5506 (keeping 200 days of data) [2025-10-07T20:08:34.620504] [DEBUG] [LOCAL ] MFSG: Primary data saved (5506 records). [2025-10-07T20:08:34.620613] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-07T20:08:34.620725] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSG took 29.4s. Estimated remaining: 2h 25m 2s. Rate: 7.1 symbols/min [2025-10-07T20:08:34.783598] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:08:34.790984] [DEBUG] [LOCAL ] MGF: Loaded 4270 existing records from primary storage. [2025-10-07T20:08:34.791215] [INFO ] [MAIN ] MGF: Loaded 4270 existing records. [2025-10-07T20:08:34.968752] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:08:34.969245] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-07T20:08:34.969299] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-07T20:08:34.969617] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-07T20:08:34.969740] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-07T20:08:35.056169] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-07T20:08:35.316708] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:08:35.848181] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-07T20:08:35.853992] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T20:08:36.064137] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T20:08:36.452667] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T20:08:36.647690] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-07T20:08:37.447688] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-07T20:08:37.474496] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T20:08:38.247684] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-07T20:08:38.595197] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T20:08:39.047621] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-07T20:08:39.542973] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T20:08:39.847755] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-07T20:08:40.469750] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T20:08:40.647683] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-07T20:08:40.791380] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T20:08:41.049464] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-07T20:08:41.447692] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-07T20:08:42.247687] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-07T20:08:42.754165] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-07T20:08:43.047706] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-07T20:08:43.098901] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T20:08:43.683170] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T20:08:43.847619] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-07T20:08:44.427205] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T20:08:44.647687] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-07T20:08:45.447711] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-07T20:08:45.799291] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T20:08:45.870665] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-07T20:08:46.247635] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-07T20:08:46.807999] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-07T20:08:47.047690] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-07T20:08:47.847630] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-07T20:08:48.067507] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T20:08:48.404049] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T20:08:48.647663] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-07T20:08:49.048732] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-07T20:08:49.447680] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-07T20:08:50.092055] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T20:08:50.247716] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-07T20:08:51.047622] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-07T20:08:51.370113] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T20:08:51.501304] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T20:08:51.847732] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-07T20:08:52.647756] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-07T20:08:53.209715] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-07T20:08:53.447636] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-07T20:08:53.553880] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T20:08:54.247626] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-07T20:08:54.475972] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T20:08:54.814233] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T20:08:55.047698] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-07T20:08:55.847621] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-07T20:08:55.932450] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T20:08:56.198067] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-07T20:08:56.647691] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-07T20:08:57.289533] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-07T20:08:57.447620] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-07T20:08:58.247709] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-07T20:08:58.265672] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T20:08:58.851927] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-07T20:08:59.047698] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-07T20:08:59.618129] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T20:08:59.847698] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-07T20:09:00.647699] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-07T20:09:00.770391] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T20:09:01.447683] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-07T20:09:02.247625] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-07T20:09:02.544115] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T20:09:02.544955] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T20:09:02.560017] [INFO ] [REMOTE ] MG: Full fetch complete (23901 records). [2025-10-07T20:09:02.560194] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-07T20:09:02.933924] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-07T20:09:02.934025] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-07T20:09:02.934567] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-07T20:09:02.934629] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-07T20:09:02.935310] [DEBUG] [LOCAL ] MG: Trimmed 23901 records to 16268 (keeping 200 days of data) [2025-10-07T20:09:02.986188] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T20:09:03.009331] [INFO ] [REMOTE ] MFSV: Full fetch complete (3318 records). [2025-10-07T20:09:03.010395] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-07T20:09:03.053588] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-07T20:09:03.459115] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-07T20:09:03.458893] [DEBUG] [LOCAL ] MG: Primary data saved (16268 records). [2025-10-07T20:09:03.459305] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-07T20:09:03.459459] [INFO ] [MAIN ] MG: Full history saved. [2025-10-07T20:09:03.459716] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-07T20:09:03.459911] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MG took 32.8s. Estimated remaining: 2h 25m 9s. Rate: 7.1 symbols/min [2025-10-07T20:09:03.490613] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-07T20:09:03.539202] [DEBUG] [LOCAL ] MFSV: Trimmed 3318 records to 2650 (keeping 200 days of data) [2025-10-07T20:09:03.670665] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:09:03.670484] [DEBUG] [LOCAL ] MFSV: Primary data saved (2650 records). [2025-10-07T20:09:03.665437] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:03.672637] [INFO ] [REMOTE ] MGF: Full fetch complete (5935 records). [2025-10-07T20:09:03.672797] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-07T20:09:03.670864] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-07T20:09:03.672974] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MFSV took 37.5s. Estimated remaining: 2h 24m 55s. Rate: 7.1 symbols/min [2025-10-07T20:09:03.852417] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-07T20:09:04.117369] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:04.171893] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-07T20:09:04.178262] [INFO ] [MAIN ] MGM: Loaded 53607 existing records. [2025-10-07T20:09:04.331758] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-07T20:09:04.343254] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-07T20:09:04.364541] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-07T20:09:04.367910] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-07T20:09:04.368272] [DEBUG] [LOCAL ] MGR: Loaded 5620 existing records from primary storage. [2025-10-07T20:09:04.369055] [DEBUG] [LOCAL ] MGF: Trimmed 5935 records to 4308 (keeping 200 days of data) [2025-10-07T20:09:04.368844] [INFO ] [MAIN ] MGR: Loaded 5620 existing records. [2025-10-07T20:09:04.545424] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:09:04.571855] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-07T20:09:04.575537] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-07T20:09:04.588838] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-07T20:09:04.621682] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-07T20:09:04.703288] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:09:04.711436] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-07T20:09:04.711378] [DEBUG] [LOCAL ] MGF: Primary data saved (4308 records). [2025-10-07T20:09:04.723683] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-07T20:09:04.748690] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-07T20:09:04.748753] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-07T20:09:04.759228] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGF took 30.1s. Estimated remaining: 2h 24m 41s. Rate: 7.1 symbols/min [2025-10-07T20:09:04.759335] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-07T20:09:05.284288] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:05.479776] [DEBUG] [LOCAL ] MGRB: Loaded 4057 existing records from primary storage. [2025-10-07T20:09:05.513999] [INFO ] [MAIN ] MGRB: Loaded 4057 existing records. [2025-10-07T20:09:05.519725] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:05.592094] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-07T20:09:05.623105] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:05.639144] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-07T20:09:05.797763] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:09:05.798246] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-07T20:09:05.798358] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-07T20:09:05.798836] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-07T20:09:05.798930] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-07T20:09:05.929893] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-07T20:09:06.196276] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:06.247607] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-07T20:09:06.453426] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T20:09:07.035467] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T20:09:07.047603] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-07T20:09:07.344155] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T20:09:07.395614] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T20:09:07.847738] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-07T20:09:08.647694] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-07T20:09:09.212537] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T20:09:09.447629] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-07T20:09:09.919289] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-07T20:09:10.108831] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T20:09:10.247632] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-07T20:09:10.692154] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-07T20:09:11.047717] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-07T20:09:11.604219] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T20:09:11.847680] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-07T20:09:12.441994] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T20:09:12.647729] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-07T20:09:13.275281] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-07T20:09:13.447687] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-07T20:09:13.811995] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-07T20:09:14.247721] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-07T20:09:14.861858] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T20:09:15.047712] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-07T20:09:15.847689] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-07T20:09:16.647737] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-07T20:09:16.833176] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T20:09:17.274323] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T20:09:17.453375] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-07T20:09:17.477834] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T20:09:18.058110] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-07T20:09:18.247709] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-07T20:09:19.047735] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-07T20:09:19.675479] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T20:09:19.847612] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-07T20:09:20.078963] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T20:09:20.647684] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-07T20:09:21.235595] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T20:09:21.447680] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-07T20:09:21.574308] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T20:09:22.170810] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T20:09:22.247723] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-07T20:09:23.008398] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T20:09:23.047623] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-07T20:09:23.847711] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-07T20:09:24.265593] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-07T20:09:24.647683] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-07T20:09:24.804171] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T20:09:25.224105] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T20:09:25.447699] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-07T20:09:26.247738] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-07T20:09:26.740684] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T20:09:26.741457] [INFO ] [REMOTE ] MGRB: Full fetch complete (5940 records). [2025-10-07T20:09:26.741525] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-07T20:09:27.060129] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-07T20:09:27.102540] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-07T20:09:27.102707] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-07T20:09:27.103634] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-07T20:09:27.103726] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-07T20:09:27.104132] [DEBUG] [LOCAL ] MGRB: Trimmed 5940 records to 4054 (keeping 200 days of data) [2025-10-07T20:09:27.136288] [DEBUG] [LOCAL ] MGRB: Primary data saved (4054 records). [2025-10-07T20:09:27.136428] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-07T20:09:27.136581] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGRB took 22.4s. Estimated remaining: 2h 24m 43s. Rate: 7.1 symbols/min [2025-10-07T20:09:27.310234] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:27.315868] [DEBUG] [LOCAL ] MGRD: Loaded 2227 existing records from primary storage. [2025-10-07T20:09:27.316163] [INFO ] [MAIN ] MGRD: Loaded 2227 existing records. [2025-10-07T20:09:27.490968] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T20:09:27.543439] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:09:27.543690] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-07T20:09:27.543748] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-07T20:09:27.543879] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-07T20:09:27.543919] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-07T20:09:27.861731] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-07T20:09:27.910368] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:28.507361] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T20:09:28.647613] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-07T20:09:29.447672] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-07T20:09:29.661504] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T20:09:30.054431] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-07T20:09:30.180848] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T20:09:30.184373] [INFO ] [REMOTE ] MGA: Full fetch complete (73722 records). [2025-10-07T20:09:30.184488] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-07T20:09:30.252799] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-07T20:09:30.576507] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-07T20:09:30.576680] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-07T20:09:30.577677] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-07T20:09:30.577742] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-07T20:09:30.579363] [DEBUG] [LOCAL ] MGA: Trimmed 73722 records to 50687 (keeping 200 days of data) [2025-10-07T20:09:30.805373] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-07T20:09:30.905839] [DEBUG] [LOCAL ] MGA: Primary data saved (50687 records). [2025-10-07T20:09:30.905990] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-07T20:09:30.906100] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGA took 59.0s. Estimated remaining: 2h 24m 31s. Rate: 7.1 symbols/min [2025-10-07T20:09:31.052848] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-07T20:09:31.079355] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:31.090047] [DEBUG] [LOCAL ] MGRE: Loaded 6661 existing records from primary storage. [2025-10-07T20:09:31.090359] [INFO ] [MAIN ] MGRE: Loaded 6661 existing records. [2025-10-07T20:09:31.275466] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:09:31.275809] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-07T20:09:31.275881] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-07T20:09:31.276235] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-07T20:09:31.276296] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-07T20:09:31.582844] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-07T20:09:31.689020] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:31.847670] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-07T20:09:32.367953] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-07T20:09:32.647698] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-07T20:09:33.116141] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-07T20:09:33.447711] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-07T20:09:34.247738] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-07T20:09:34.701100] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-07T20:09:35.047633] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-07T20:09:35.306566] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T20:09:35.519374] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-07T20:09:35.847759] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-07T20:09:36.647712] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-07T20:09:37.317159] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T20:09:37.447620] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-07T20:09:37.854929] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T20:09:37.900280] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T20:09:38.247737] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-07T20:09:38.679533] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T20:09:39.047704] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-07T20:09:39.491725] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-07T20:09:39.847724] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-07T20:09:40.468634] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-07T20:09:40.647707] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-07T20:09:41.193294] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T20:09:41.194088] [INFO ] [REMOTE ] MGRD: Full fetch complete (3486 records). [2025-10-07T20:09:41.194184] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-07T20:09:41.452972] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-07T20:09:41.546849] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-07T20:09:41.546926] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-07T20:09:41.547050] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-07T20:09:41.547088] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-07T20:09:41.547456] [DEBUG] [LOCAL ] MGRD: Trimmed 3486 records to 2228 (keeping 200 days of data) [2025-10-07T20:09:41.561513] [DEBUG] [LOCAL ] MGRD: Primary data saved (2228 records). [2025-10-07T20:09:41.561577] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-07T20:09:41.561674] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGRD took 14.4s. Estimated remaining: 2h 24m 24s. Rate: 7.1 symbols/min [2025-10-07T20:09:41.731992] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:41.786362] [DEBUG] [LOCAL ] MGY: Loaded 52402 existing records from primary storage. [2025-10-07T20:09:41.786754] [INFO ] [MAIN ] MGY: Loaded 52402 existing records. [2025-10-07T20:09:41.957467] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:09:41.957741] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-07T20:09:41.957797] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-07T20:09:41.957997] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-07T20:09:41.958054] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-07T20:09:42.106545] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:09:42.133858] [INFO ] [REMOTE ] MGR: Full fetch complete (8070 records). [2025-10-07T20:09:42.179032] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-07T20:09:42.252779] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-07T20:09:42.501001] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:42.687941] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-07T20:09:42.688030] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-07T20:09:42.688239] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-07T20:09:42.688279] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-07T20:09:42.688724] [DEBUG] [LOCAL ] MGR: Trimmed 8070 records to 5603 (keeping 200 days of data) [2025-10-07T20:09:42.728415] [DEBUG] [LOCAL ] MGR: Primary data saved (5603 records). [2025-10-07T20:09:42.728577] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-07T20:09:42.728711] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGR took 39.0s. Estimated remaining: 2h 24m 10s. Rate: 7.1 symbols/min [2025-10-07T20:09:42.911876] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:42.912095] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-07T20:09:42.912150] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-07T20:09:42.912269] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-07T20:09:42.912403] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-07T20:09:42.912469] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-07T20:09:42.912513] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-07T20:09:43.019045] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T20:09:43.061077] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-07T20:09:43.309009] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:43.730088] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T20:09:43.847615] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-07T20:09:44.647750] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-07T20:09:45.447759] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-07T20:09:45.685393] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:09:45.705872] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-07T20:09:45.716599] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:09:45.731323] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-07T20:09:45.733162] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T20:09:45.732007] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:09:45.743736] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-07T20:09:45.744304] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-07T20:09:45.744378] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-07T20:09:45.744576] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-07T20:09:45.744684] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MH took 3.0s. Estimated remaining: 2h 23m 57s. Rate: 7.1 symbols/min [2025-10-07T20:09:45.924009] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:45.938350] [DEBUG] [LOCAL ] MHD: Loaded 12483 existing records from primary storage. [2025-10-07T20:09:45.938615] [INFO ] [MAIN ] MHD: Loaded 12483 existing records. [2025-10-07T20:09:46.142791] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:09:46.143149] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-07T20:09:46.143212] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-07T20:09:46.143477] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-07T20:09:46.143535] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-07T20:09:46.250554] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-07T20:09:46.548049] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T20:09:46.553272] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:46.687900] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-07T20:09:47.047694] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-07T20:09:47.733619] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T20:09:47.847675] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-07T20:09:48.647715] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-07T20:09:49.283075] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T20:09:49.447614] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-07T20:09:49.758445] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-07T20:09:50.247731] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-07T20:09:51.047665] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-07T20:09:51.175620] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T20:09:51.482798] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-07T20:09:51.847622] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-07T20:09:52.081371] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-07T20:09:52.087554] [INFO ] [REMOTE ] MGM: Full fetch complete (77604 records). [2025-10-07T20:09:52.087697] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-07T20:09:52.471799] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-07T20:09:52.471882] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-07T20:09:52.472871] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-07T20:09:52.472939] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-07T20:09:52.474688] [DEBUG] [LOCAL ] MGM: Trimmed 77604 records to 53607 (keeping 200 days of data) [2025-10-07T20:09:52.648390] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-07T20:09:52.799870] [DEBUG] [LOCAL ] MGM: Primary data saved (53607 records). [2025-10-07T20:09:52.800036] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-07T20:09:52.800148] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGM took 49.3s. Estimated remaining: 2h 23m 48s. Rate: 7.1 symbols/min [2025-10-07T20:09:52.975469] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:09:52.986424] [DEBUG] [LOCAL ] MHF: Loaded 8740 existing records from primary storage. [2025-10-07T20:09:52.986672] [INFO ] [MAIN ] MHF: Loaded 8740 existing records. [2025-10-07T20:09:53.166006] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:09:53.166345] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-07T20:09:53.166456] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-07T20:09:53.166816] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-07T20:09:53.166987] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-07T20:09:53.471801] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-07T20:09:53.484384] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T20:09:53.571809] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:09:53.713733] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T20:09:54.228161] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T20:09:54.247679] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-07T20:09:54.997720] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T20:09:55.047618] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-07T20:09:55.733462] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T20:09:55.847689] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-07T20:09:56.577220] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T20:09:56.647611] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-07T20:09:57.399373] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T20:09:57.447682] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-07T20:09:58.119427] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T20:09:58.247703] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-07T20:09:58.996090] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T20:09:59.047677] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-07T20:09:59.665284] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:09:59.666319] [INFO ] [REMOTE ] MGRE: Full fetch complete (9414 records). [2025-10-07T20:09:59.666392] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-07T20:09:59.853573] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-07T20:10:00.084682] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-07T20:10:00.084830] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-07T20:10:00.085243] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-07T20:10:00.085328] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-07T20:10:00.086440] [DEBUG] [LOCAL ] MGRE: Trimmed 9414 records to 6662 (keeping 200 days of data) [2025-10-07T20:10:00.140470] [DEBUG] [LOCAL ] MGRE: Primary data saved (6662 records). [2025-10-07T20:10:00.140715] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-07T20:10:00.140842] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGRE took 29.2s. Estimated remaining: 2h 23m 39s. Rate: 7.1 symbols/min [2025-10-07T20:10:00.317805] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:10:00.366212] [DEBUG] [LOCAL ] MHK: Loaded 42185 existing records from primary storage. [2025-10-07T20:10:00.366695] [INFO ] [MAIN ] MHK: Loaded 42185 existing records. [2025-10-07T20:10:00.549372] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:10:00.549726] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-07T20:10:00.549790] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-07T20:10:00.550156] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-07T20:10:00.550216] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-07T20:10:00.651208] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-07T20:10:00.954441] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T20:10:00.953306] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:10:01.447691] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-07T20:10:02.179288] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T20:10:02.247613] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-07T20:10:02.506431] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T20:10:02.954593] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T20:10:03.047744] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-07T20:10:03.832892] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T20:10:03.847598] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-07T20:10:04.647626] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-07T20:10:04.683995] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T20:10:05.447763] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-07T20:10:06.214484] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T20:10:06.247597] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-07T20:10:07.001021] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T20:10:07.047700] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-07T20:10:07.587912] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T20:10:07.847691] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-07T20:10:08.647635] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-07T20:10:08.697203] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T20:10:09.299258] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T20:10:09.447625] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-07T20:10:10.247622] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-07T20:10:10.275313] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T20:10:10.439289] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T20:10:11.047752] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-07T20:10:11.081751] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T20:10:11.847695] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-07T20:10:11.961908] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T20:10:11.962961] [INFO ] [REMOTE ] MHF: Full fetch complete (12576 records). [2025-10-07T20:10:11.963032] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-07T20:10:12.335342] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-07T20:10:12.335420] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-07T20:10:12.335728] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-07T20:10:12.335788] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-07T20:10:12.336237] [DEBUG] [LOCAL ] MHF: Trimmed 12576 records to 8672 (keeping 200 days of data) [2025-10-07T20:10:12.386062] [DEBUG] [LOCAL ] MHF: Primary data saved (8672 records). [2025-10-07T20:10:12.386172] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-07T20:10:12.386251] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MHF took 19.6s. Estimated remaining: 2h 23m 33s. Rate: 7.1 symbols/min [2025-10-07T20:10:12.560332] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:10:12.560558] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-07T20:10:12.560614] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-07T20:10:12.560760] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-07T20:10:12.560802] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-07T20:10:12.560842] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-07T20:10:12.560874] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-07T20:10:12.655016] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-07T20:10:12.909480] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:10:13.340074] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T20:10:13.447671] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-07T20:10:14.165504] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T20:10:14.247738] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-07T20:10:15.052809] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-07T20:10:15.090950] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T20:10:15.465886] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-07T20:10:15.847636] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-07T20:10:15.889180] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T20:10:16.647702] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-07T20:10:17.447638] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-07T20:10:17.563165] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T20:10:17.811227] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-07T20:10:18.247738] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-07T20:10:18.332580] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T20:10:19.047717] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-07T20:10:19.118227] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T20:10:19.847760] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-07T20:10:20.601789] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T20:10:20.605718] [INFO ] [REMOTE ] MGY: Full fetch complete (75703 records). [2025-10-07T20:10:20.605896] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-07T20:10:20.651913] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-07T20:10:20.884324] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T20:10:21.028431] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-07T20:10:21.028528] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-07T20:10:21.029630] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-07T20:10:21.029733] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-07T20:10:21.031297] [DEBUG] [LOCAL ] MGY: Trimmed 75703 records to 52395 (keeping 200 days of data) [2025-10-07T20:10:21.124349] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-07T20:10:21.362359] [DEBUG] [LOCAL ] MGY: Primary data saved (52395 records). [2025-10-07T20:10:21.362525] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-07T20:10:21.362630] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MGY took 39.8s. Estimated remaining: 2h 23m 25s. Rate: 7.1 symbols/min [2025-10-07T20:10:21.452867] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-07T20:10:21.538944] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:10:21.549146] [DEBUG] [LOCAL ] MHN: Loaded 7620 existing records from primary storage. [2025-10-07T20:10:21.549374] [INFO ] [MAIN ] MHN: Loaded 7620 existing records. [2025-10-07T20:10:21.744824] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:10:21.745076] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-07T20:10:21.745125] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-07T20:10:21.745299] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-07T20:10:21.745359] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-07T20:10:21.847974] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-07T20:10:22.096870] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:10:22.247677] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-07T20:10:23.004526] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T20:10:23.047626] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-07T20:10:23.847698] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-07T20:10:23.934318] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T20:10:24.647723] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-07T20:10:25.432335] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T20:10:25.447597] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-07T20:10:25.476561] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T20:10:26.237720] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T20:10:26.247598] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-07T20:10:27.047752] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-07T20:10:27.057548] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T20:10:27.481571] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-07T20:10:27.847690] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-07T20:10:28.647690] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-07T20:10:28.757449] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-07T20:10:29.447697] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-07T20:10:29.921897] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T20:10:30.054512] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T20:10:30.247729] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-07T20:10:31.042773] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T20:10:31.047587] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-07T20:10:31.847707] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-07T20:10:31.872364] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T20:10:32.198368] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-07T20:10:32.647695] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-07T20:10:33.447775] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-07T20:10:33.681155] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-07T20:10:34.247626] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-07T20:10:34.313874] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T20:10:34.563353] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-07T20:10:35.047698] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-07T20:10:35.663095] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T20:10:35.847706] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-07T20:10:36.628438] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-07T20:10:36.647602] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-07T20:10:37.447748] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-07T20:10:37.642674] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T20:10:38.068875] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T20:10:38.247725] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-07T20:10:39.017377] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T20:10:39.047694] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-07T20:10:39.762434] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-07T20:10:39.847607] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-07T20:10:40.596157] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T20:10:40.647610] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-07T20:10:41.302287] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:10:41.303328] [INFO ] [REMOTE ] MHN: Full fetch complete (11756 records). [2025-10-07T20:10:41.303398] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-07T20:10:41.453094] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-07T20:10:41.675248] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-07T20:10:41.675334] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-07T20:10:41.675612] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-07T20:10:41.675682] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-07T20:10:41.676209] [DEBUG] [LOCAL ] MHN: Trimmed 11756 records to 7657 (keeping 200 days of data) [2025-10-07T20:10:41.721966] [DEBUG] [LOCAL ] MHN: Primary data saved (7657 records). [2025-10-07T20:10:41.722103] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-07T20:10:41.722188] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHN took 20.4s. Estimated remaining: 2h 23m 26s. Rate: 7.1 symbols/min [2025-10-07T20:10:41.892323] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:10:41.919221] [DEBUG] [LOCAL ] MHO: Loaded 23801 existing records from primary storage. [2025-10-07T20:10:41.919476] [INFO ] [MAIN ] MHO: Loaded 23801 existing records. [2025-10-07T20:10:42.096138] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:10:42.096375] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-07T20:10:42.096424] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-07T20:10:42.096703] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-07T20:10:42.096763] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-07T20:10:42.252852] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-07T20:10:42.455355] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:10:43.052803] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-07T20:10:43.067289] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T20:10:43.386617] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T20:10:43.388247] [INFO ] [REMOTE ] MHD: Full fetch complete (18826 records). [2025-10-07T20:10:43.388328] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-07T20:10:43.758353] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-07T20:10:43.758444] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-07T20:10:43.758942] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-07T20:10:43.759006] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-07T20:10:43.759621] [DEBUG] [LOCAL ] MHD: Trimmed 18826 records to 12471 (keeping 200 days of data) [2025-10-07T20:10:43.841020] [DEBUG] [LOCAL ] MHD: Primary data saved (12471 records). [2025-10-07T20:10:43.841186] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-07T20:10:43.841279] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHD took 58.1s. Estimated remaining: 2h 23m 12s. Rate: 7.1 symbols/min [2025-10-07T20:10:43.852818] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-07T20:10:44.020405] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:10:44.020803] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-07T20:10:44.021012] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-07T20:10:44.021220] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-07T20:10:44.021287] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-07T20:10:44.021340] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-07T20:10:44.021405] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-07T20:10:44.186052] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T20:10:44.320219] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-07T20:10:44.396130] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:10:44.647692] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-07T20:10:44.843022] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:10:44.843358] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-07T20:10:44.843451] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:10:44.843498] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-07T20:10:44.843558] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:10:44.843631] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-07T20:10:44.843737] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-07T20:10:44.843779] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-07T20:10:44.843844] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-07T20:10:44.843916] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MIAX took 1.0s. Estimated remaining: 2h 22m 58s. Rate: 7.1 symbols/min [2025-10-07T20:10:45.017228] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:10:45.033904] [DEBUG] [LOCAL ] MIN: Loaded 13381 existing records from primary storage. [2025-10-07T20:10:45.034160] [INFO ] [MAIN ] MIN: Loaded 13381 existing records. [2025-10-07T20:10:45.214315] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:10:45.214558] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-07T20:10:45.214606] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-07T20:10:45.214820] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-07T20:10:45.214876] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-07T20:10:45.452788] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-07T20:10:45.577364] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:10:46.247730] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-07T20:10:47.047727] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-07T20:10:47.244621] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T20:10:47.244977] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T20:10:47.847690] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-07T20:10:48.407156] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T20:10:48.647715] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-07T20:10:49.258309] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T20:10:49.261460] [INFO ] [REMOTE ] MHK: Full fetch complete (60914 records). [2025-10-07T20:10:49.261589] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-07T20:10:49.453406] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-07T20:10:49.737687] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-07T20:10:49.737863] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-07T20:10:49.738893] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-07T20:10:49.738976] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-07T20:10:49.759161] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T20:10:49.759399] [DEBUG] [LOCAL ] MHK: Trimmed 60914 records to 42217 (keeping 200 days of data) [2025-10-07T20:10:49.871345] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T20:10:49.872875] [INFO ] [REMOTE ] MHLA: Full fetch complete (1525 records). [2025-10-07T20:10:49.873463] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-07T20:10:50.062155] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-07T20:10:50.063937] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:10:50.064974] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:10:50.065727] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-07T20:10:50.067139] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-07T20:10:50.069944] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-07T20:10:50.072386] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-07T20:10:50.073885] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MHLA took 37.7s. Estimated remaining: 2h 22m 47s. Rate: 7.1 symbols/min [2025-10-07T20:10:50.252164] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-07T20:10:50.379573] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:10:50.467426] [DEBUG] [LOCAL ] MIR: Loaded 51113 existing records from primary storage. [2025-10-07T20:10:50.469175] [INFO ] [MAIN ] MIR: Loaded 51113 existing records. [2025-10-07T20:10:50.566108] [DEBUG] [LOCAL ] MHK: Primary data saved (42217 records). [2025-10-07T20:10:50.578675] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-07T20:10:50.578799] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHK took 50.4s. Estimated remaining: 2h 22m 33s. Rate: 7.1 symbols/min [2025-10-07T20:10:50.673981] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:10:50.674237] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-07T20:10:50.674286] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-07T20:10:50.674527] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-07T20:10:50.674585] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-07T20:10:51.024089] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:10:51.047596] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-07T20:10:51.847757] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-07T20:10:51.892154] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T20:10:52.588506] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T20:10:52.647610] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-07T20:10:52.728377] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T20:10:53.344771] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-07T20:10:53.447632] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-07T20:10:54.247618] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-07T20:10:54.643407] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T20:10:55.005214] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-07T20:10:55.047601] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-07T20:10:55.842203] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T20:10:55.847596] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-07T20:10:56.647616] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-07T20:10:56.730534] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T20:10:57.447628] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-07T20:10:57.787548] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T20:10:58.247727] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-07T20:10:59.047784] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-07T20:10:59.918580] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T20:10:59.922737] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-07T20:11:00.637744] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-07T20:11:00.647599] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-07T20:11:01.379018] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-07T20:11:01.447603] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-07T20:11:02.264874] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T20:11:02.267933] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-07T20:11:03.090221] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T20:11:03.091892] [INFO ] [REMOTE ] MIN: Full fetch complete (17968 records). [2025-10-07T20:11:03.091964] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-07T20:11:03.352876] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (5.91 seconds). [2025-10-07T20:11:03.447530] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-07T20:11:03.505325] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-07T20:11:03.505416] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-07T20:11:03.505857] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-07T20:11:03.505920] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-07T20:11:03.506465] [DEBUG] [LOCAL ] MIN: Trimmed 17968 records to 13484 (keeping 200 days of data) [2025-10-07T20:11:03.588294] [DEBUG] [LOCAL ] MIN: Primary data saved (13484 records). [2025-10-07T20:11:03.588559] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-07T20:11:03.588695] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIN took 18.7s. Estimated remaining: 2h 22m 28s. Rate: 7.1 symbols/min [2025-10-07T20:11:04.197945] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (5.95 seconds). [2025-10-07T20:11:04.202880] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-07T20:11:04.922504] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T20:11:04.932250] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-07T20:11:05.485044] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T20:11:05.492055] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-07T20:11:06.582211] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T20:11:06.592927] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-07T20:11:06.710885] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T20:11:07.047771] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-07T20:11:08.183002] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T20:11:08.208436] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-07T20:11:08.209099] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T20:11:08.647629] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-07T20:11:09.855737] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T20:11:09.857585] [INFO ] [REMOTE ] MHO: Full fetch complete (37023 records). [2025-10-07T20:11:09.857690] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-07T20:11:10.185983] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T20:11:10.240063] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-07T20:11:10.285907] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-07T20:11:10.285990] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-07T20:11:10.286764] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-07T20:11:10.286830] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-07T20:11:10.287886] [DEBUG] [LOCAL ] MHO: Trimmed 37023 records to 23820 (keeping 200 days of data) [2025-10-07T20:11:10.436637] [DEBUG] [LOCAL ] MHO: Primary data saved (23820 records). [2025-10-07T20:11:10.436837] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-07T20:11:10.436963] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MHO took 28.7s. Estimated remaining: 2h 22m 18s. Rate: 7.1 symbols/min [2025-10-07T20:11:11.999800] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T20:11:12.010885] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-07T20:11:13.725972] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T20:11:13.737750] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-07T20:11:15.334302] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T20:11:15.345084] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-07T20:11:17.178852] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T20:11:17.190292] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-07T20:11:18.786726] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T20:11:18.790212] [INFO ] [REMOTE ] MIR: Full fetch complete (73524 records). [2025-10-07T20:11:18.790322] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-07T20:11:19.170123] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-07T20:11:19.170230] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-07T20:11:19.171223] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-07T20:11:19.171290] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-07T20:11:19.173751] [DEBUG] [LOCAL ] MIR: Trimmed 73524 records to 51128 (keeping 200 days of data) [2025-10-07T20:11:19.472948] [DEBUG] [LOCAL ] MIR: Primary data saved (51128 records). [2025-10-07T20:11:19.473099] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-07T20:11:19.473185] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MIR took 29.4s. Estimated remaining: 2h 22m 10s. Rate: 7.1 symbols/min [2025-10-07T20:11:20.127022] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:11:20.172587] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:11:20.235209] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:11:20.234134] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:11:20.236124] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-07T20:11:20.236203] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-07T20:11:20.236359] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-07T20:11:20.236506] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-07T20:11:20.236592] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-07T20:11:20.236684] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-07T20:11:20.328955] [DEBUG] [LOCAL ] MITP: Loaded 2376 existing records from primary storage. [2025-10-07T20:11:20.342732] [DEBUG] [LOCAL ] MIY: Loaded 6044 existing records from primary storage. [2025-10-07T20:11:20.348167] [INFO ] [MAIN ] MITP: Loaded 2376 existing records. [2025-10-07T20:11:20.353489] [INFO ] [MAIN ] MIY: Loaded 6044 existing records. [2025-10-07T20:11:20.527812] [DEBUG] [LOCAL ] MITT: Loaded 22783 existing records from primary storage. [2025-10-07T20:11:20.625805] [INFO ] [MAIN ] MITT: Loaded 22783 existing records. [2025-10-07T20:11:21.011049] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:11:21.064861] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-07T20:11:21.102376] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-07T20:11:21.078308] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:11:21.114522] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-07T20:11:21.114575] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-07T20:11:21.135042] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-07T20:11:21.177547] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-07T20:11:21.207477] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:11:21.207684] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-07T20:11:21.207849] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-07T20:11:21.218199] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:11:21.241810] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-07T20:11:21.213220] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-07T20:11:21.247096] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-07T20:11:21.334824] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-07T20:11:21.416509] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-07T20:11:21.736672] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-07T20:11:21.795342] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-07T20:11:22.048920] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:11:22.105524] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-07T20:11:22.169167] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:11:22.189820] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-07T20:11:22.300189] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-07T20:11:22.305592] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:11:22.306892] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-07T20:11:22.307147] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-07T20:11:22.694756] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-07T20:11:22.695943] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-07T20:11:22.747327] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-07T20:11:22.748555] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-07T20:11:22.903713] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T20:11:22.906319] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-07T20:11:23.125849] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T20:11:23.127157] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-07T20:11:23.219288] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T20:11:23.220924] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-07T20:11:23.459775] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T20:11:23.466368] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-07T20:11:23.498891] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T20:11:23.500700] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-07T20:11:23.570741] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-07T20:11:23.578545] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-07T20:11:23.847717] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-07T20:11:23.905948] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-07T20:11:24.246729] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-07T20:11:24.370273] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T20:11:24.647712] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-07T20:11:25.447625] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-07T20:11:25.664302] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T20:11:25.704807] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-07T20:11:26.247718] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-07T20:11:27.047763] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-07T20:11:27.404230] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-07T20:11:27.465583] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-07T20:11:27.847673] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-07T20:11:28.187827] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-07T20:11:28.647720] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-07T20:11:29.062142] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-07T20:11:29.447725] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-07T20:11:29.807101] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-07T20:11:30.247756] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-07T20:11:30.874256] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-07T20:11:31.047759] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-07T20:11:31.468962] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T20:11:31.469788] [INFO ] [REMOTE ] MITN: Full fetch complete (2354 records). [2025-10-07T20:11:31.469879] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-07T20:11:31.659884] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T20:11:31.660137] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:11:31.660189] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:11:31.660256] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-07T20:11:31.660325] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-07T20:11:31.660362] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-07T20:11:31.660403] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-07T20:11:31.660463] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITN took 12.2s. Estimated remaining: 2h 22m 5s. Rate: 7.1 symbols/min [2025-10-07T20:11:31.830025] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:11:31.862273] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-07T20:11:31.885607] [DEBUG] [LOCAL ] MKC: Loaded 52489 existing records from primary storage. [2025-10-07T20:11:31.886017] [INFO ] [MAIN ] MKC: Loaded 52489 existing records. [2025-10-07T20:11:32.061747] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:11:32.061997] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-07T20:11:32.062044] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-07T20:11:32.062287] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-07T20:11:32.062343] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-07T20:11:32.412185] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:11:32.527120] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T20:11:32.647700] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-07T20:11:33.447687] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-07T20:11:34.247739] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-07T20:11:34.279900] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T20:11:34.372842] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T20:11:34.980329] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T20:11:35.047623] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-07T20:11:35.847679] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-07T20:11:36.090754] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T20:11:36.440831] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T20:11:36.647675] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-07T20:11:37.447626] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-07T20:11:37.802933] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T20:11:38.247677] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-07T20:11:39.004264] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T20:11:39.047636] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-07T20:11:39.086636] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T20:11:39.847709] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-07T20:11:40.120568] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T20:11:40.592828] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T20:11:40.647612] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-07T20:11:41.292452] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-07T20:11:41.447690] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-07T20:11:42.121939] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T20:11:42.247632] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-07T20:11:42.973160] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T20:11:42.974267] [INFO ] [REMOTE ] MIY: Full fetch complete (8931 records). [2025-10-07T20:11:42.974339] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-07T20:11:43.052746] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-07T20:11:43.334411] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-07T20:11:43.334493] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-07T20:11:43.334756] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-07T20:11:43.334819] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-07T20:11:43.335237] [DEBUG] [LOCAL ] MIY: Trimmed 8931 records to 6055 (keeping 200 days of data) [2025-10-07T20:11:43.373784] [DEBUG] [LOCAL ] MIY: Primary data saved (6055 records). [2025-10-07T20:11:43.373920] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-07T20:11:43.374005] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MIY took 23.9s. Estimated remaining: 2h 21m 59s. Rate: 7.1 symbols/min [2025-10-07T20:11:43.544509] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:11:43.582957] [DEBUG] [LOCAL ] MKL: Loaded 34057 existing records from primary storage. [2025-10-07T20:11:43.583285] [INFO ] [MAIN ] MKL: Loaded 34057 existing records. [2025-10-07T20:11:43.698379] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T20:11:43.772867] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:11:43.773124] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-07T20:11:43.773183] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-07T20:11:43.773382] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-07T20:11:43.773440] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-07T20:11:43.852765] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-07T20:11:44.150960] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:11:44.647617] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-07T20:11:45.020288] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T20:11:45.447697] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-07T20:11:46.247627] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-07T20:11:46.311058] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T20:11:46.622215] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-07T20:11:46.637780] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T20:11:47.047858] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-07T20:11:47.847627] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-07T20:11:48.422683] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T20:11:48.647717] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-07T20:11:49.447671] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-07T20:11:49.774609] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T20:11:49.778037] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-07T20:11:49.794579] [INFO ] [REMOTE ] MITT: Full fetch complete (34701 records). [2025-10-07T20:11:49.794803] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-07T20:11:49.918206] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T20:11:50.197715] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-07T20:11:50.197824] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-07T20:11:50.198509] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-07T20:11:50.198554] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-07T20:11:50.199587] [DEBUG] [LOCAL ] MITT: Trimmed 34701 records to 22776 (keeping 200 days of data) [2025-10-07T20:11:50.252607] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-07T20:11:50.343524] [DEBUG] [LOCAL ] MITT: Primary data saved (22776 records). [2025-10-07T20:11:50.343704] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-07T20:11:50.343827] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MITT took 30.9s. Estimated remaining: 2h 21m 49s. Rate: 7.1 symbols/min [2025-10-07T20:11:50.510394] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:11:50.553951] [DEBUG] [LOCAL ] MLI: Loaded 43512 existing records from primary storage. [2025-10-07T20:11:50.554286] [INFO ] [MAIN ] MLI: Loaded 43512 existing records. [2025-10-07T20:11:50.735085] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:11:50.738123] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-07T20:11:50.738000] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-07T20:11:50.739409] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-07T20:11:50.739842] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-07T20:11:50.739900] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-07T20:11:51.056206] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-07T20:11:51.096964] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:11:51.847612] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-07T20:11:52.263913] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-07T20:11:52.492753] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T20:11:52.647697] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-07T20:11:53.447701] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-07T20:11:54.203027] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T20:11:54.247707] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-07T20:11:54.993364] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T20:11:55.047608] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-07T20:11:55.298269] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T20:11:55.847695] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-07T20:11:56.286703] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T20:11:56.287482] [INFO ] [REMOTE ] MITP: Full fetch complete (3331 records). [2025-10-07T20:11:56.287551] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-07T20:11:56.647843] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-07T20:11:56.653083] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-07T20:11:56.654276] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-07T20:11:56.654479] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-07T20:11:56.654570] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-07T20:11:56.655284] [DEBUG] [LOCAL ] MITP: Trimmed 3331 records to 2373 (keeping 200 days of data) [2025-10-07T20:11:56.705449] [DEBUG] [LOCAL ] MITP: Primary data saved (2373 records). [2025-10-07T20:11:56.705731] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-07T20:11:56.705859] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MITP took 37.2s. Estimated remaining: 2h 21m 39s. Rate: 7.1 symbols/min [2025-10-07T20:11:56.771631] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T20:11:56.892108] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:11:56.922822] [DEBUG] [LOCAL ] MLM: Loaded 29649 existing records from primary storage. [2025-10-07T20:11:56.923114] [INFO ] [MAIN ] MLM: Loaded 29649 existing records. [2025-10-07T20:11:57.099605] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:11:57.099871] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-07T20:11:57.099941] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-07T20:11:57.100181] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-07T20:11:57.100237] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-07T20:11:57.447906] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-07T20:11:57.447835] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:11:58.224871] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T20:11:58.247637] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-07T20:11:58.992978] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T20:11:59.047679] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-07T20:11:59.847704] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-07T20:11:59.981439] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T20:12:00.647718] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-07T20:12:00.694189] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T20:12:01.388240] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T20:12:01.447635] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-07T20:12:02.247687] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-07T20:12:02.446082] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T20:12:02.522425] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T20:12:03.047696] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-07T20:12:03.847752] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-07T20:12:03.907111] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T20:12:04.460033] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T20:12:04.647729] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-07T20:12:05.358130] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T20:12:05.447748] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-07T20:12:06.247717] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-07T20:12:06.395182] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T20:12:06.831387] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T20:12:07.047688] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-07T20:12:07.770157] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T20:12:07.847710] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-07T20:12:08.595371] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T20:12:08.647718] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-07T20:12:09.165238] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T20:12:09.447746] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-07T20:12:10.247723] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-07T20:12:10.340362] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T20:12:11.047719] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-07T20:12:11.134668] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T20:12:11.838972] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T20:12:11.848007] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-07T20:12:12.298321] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T20:12:12.647680] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-07T20:12:13.240382] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T20:12:13.447691] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-07T20:12:13.968854] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-07T20:12:14.247718] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-07T20:12:15.047622] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-07T20:12:15.140031] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T20:12:15.510930] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T20:12:15.513382] [INFO ] [REMOTE ] MKL: Full fetch complete (49715 records). [2025-10-07T20:12:15.513497] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-07T20:12:15.855760] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-07T20:12:15.900399] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-07T20:12:15.900481] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-07T20:12:15.901378] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-07T20:12:15.901444] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-07T20:12:15.902528] [DEBUG] [LOCAL ] MKL: Trimmed 49715 records to 34093 (keeping 200 days of data) [2025-10-07T20:12:16.115386] [DEBUG] [LOCAL ] MKL: Primary data saved (34093 records). [2025-10-07T20:12:16.115534] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-07T20:12:16.115620] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MKL took 32.7s. Estimated remaining: 2h 21m 39s. Rate: 7.1 symbols/min [2025-10-07T20:12:16.285122] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:12:16.313035] [DEBUG] [LOCAL ] MLNK: Loaded 25617 existing records from primary storage. [2025-10-07T20:12:16.313308] [INFO ] [MAIN ] MLNK: Loaded 25617 existing records. [2025-10-07T20:12:16.494155] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:12:16.494448] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-07T20:12:16.494579] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-07T20:12:16.501079] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-07T20:12:16.511872] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-07T20:12:16.576274] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T20:12:16.652808] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-07T20:12:16.878928] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:12:17.447627] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-07T20:12:17.484418] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T20:12:18.107008] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T20:12:18.247674] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-07T20:12:18.398231] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T20:12:19.047744] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-07T20:12:19.847677] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-07T20:12:19.932784] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T20:12:20.374003] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T20:12:20.647697] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-07T20:12:21.447628] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-07T20:12:21.483454] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T20:12:21.486948] [INFO ] [REMOTE ] MKC: Full fetch complete (75638 records). [2025-10-07T20:12:21.487060] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-07T20:12:21.877833] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-07T20:12:21.877942] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-07T20:12:21.878932] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-07T20:12:21.878996] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-07T20:12:21.880539] [DEBUG] [LOCAL ] MKC: Trimmed 75638 records to 52516 (keeping 200 days of data) [2025-10-07T20:12:22.126810] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T20:12:22.229469] [DEBUG] [LOCAL ] MKC: Primary data saved (52516 records). [2025-10-07T20:12:22.229613] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-07T20:12:22.229768] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKC took 50.6s. Estimated remaining: 2h 21m 29s. Rate: 7.1 symbols/min [2025-10-07T20:12:22.252941] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-07T20:12:22.398526] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:12:22.404008] [DEBUG] [LOCAL ] MLP: Loaded 2980 existing records from primary storage. [2025-10-07T20:12:22.404176] [INFO ] [MAIN ] MLP: Loaded 2980 existing records. [2025-10-07T20:12:22.559429] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T20:12:22.602508] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:12:22.602716] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-07T20:12:22.602772] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-07T20:12:22.602999] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-07T20:12:22.603055] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-07T20:12:22.981268] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:12:23.047596] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-07T20:12:23.480292] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T20:12:23.683853] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T20:12:23.847700] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-07T20:12:24.453089] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-07T20:12:24.647713] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-07T20:12:25.447687] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-07T20:12:25.892845] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T20:12:25.895304] [INFO ] [REMOTE ] MLM: Full fetch complete (45400 records). [2025-10-07T20:12:25.895451] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-07T20:12:26.000589] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T20:12:26.258605] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-07T20:12:26.276771] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-07T20:12:26.276876] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-07T20:12:26.277772] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-07T20:12:26.278009] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-07T20:12:26.280638] [DEBUG] [LOCAL ] MLM: Trimmed 45400 records to 29541 (keeping 200 days of data) [2025-10-07T20:12:26.474398] [DEBUG] [LOCAL ] MLM: Primary data saved (29541 records). [2025-10-07T20:12:26.474564] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-07T20:12:26.474674] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLM took 29.8s. Estimated remaining: 2h 21m 17s. Rate: 7.1 symbols/min [2025-10-07T20:12:26.648919] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:12:26.664974] [DEBUG] [LOCAL ] MLR: Loaded 12339 existing records from primary storage. [2025-10-07T20:12:26.665246] [INFO ] [MAIN ] MLR: Loaded 12339 existing records. [2025-10-07T20:12:26.843767] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:12:26.844046] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-07T20:12:26.844107] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-07T20:12:26.844368] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-07T20:12:26.844427] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-07T20:12:27.052942] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-07T20:12:27.201565] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:12:27.546748] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-07T20:12:27.555105] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T20:12:27.558100] [INFO ] [REMOTE ] MLI: Full fetch complete (63257 records). [2025-10-07T20:12:27.558249] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-07T20:12:27.852052] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-07T20:12:27.947114] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-07T20:12:27.947194] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-07T20:12:27.948121] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-07T20:12:27.948185] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-07T20:12:27.949724] [DEBUG] [LOCAL ] MLI: Trimmed 63257 records to 43511 (keeping 200 days of data) [2025-10-07T20:12:28.219015] [DEBUG] [LOCAL ] MLI: Primary data saved (43511 records). [2025-10-07T20:12:28.219159] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-07T20:12:28.219242] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLI took 37.9s. Estimated remaining: 2h 21m 4s. Rate: 7.1 symbols/min [2025-10-07T20:12:28.393588] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:12:28.450379] [DEBUG] [LOCAL ] MMC: Loaded 51842 existing records from primary storage. [2025-10-07T20:12:28.450766] [INFO ] [MAIN ] MMC: Loaded 51842 existing records. [2025-10-07T20:12:28.627741] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:12:28.628000] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-07T20:12:28.628063] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-07T20:12:28.628459] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-07T20:12:28.628554] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-07T20:12:28.658396] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-07T20:12:29.019465] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:12:29.034023] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-07T20:12:29.447639] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-07T20:12:29.598913] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T20:12:30.247639] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-07T20:12:30.504703] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T20:12:31.047732] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-07T20:12:31.847619] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-07T20:12:31.862761] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T20:12:32.039089] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T20:12:32.306440] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-07T20:12:32.647670] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-07T20:12:33.447787] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-07T20:12:34.086769] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T20:12:34.247710] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-07T20:12:34.335314] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T20:12:35.047718] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-07T20:12:35.421489] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T20:12:35.847753] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-07T20:12:36.399206] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-07T20:12:36.647636] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-07T20:12:36.689613] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T20:12:37.128900] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-07T20:12:37.447756] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-07T20:12:38.247758] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-07T20:12:39.047706] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-07T20:12:39.281639] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T20:12:39.459515] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T20:12:39.638195] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T20:12:39.847708] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-07T20:12:40.647693] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-07T20:12:41.447668] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-07T20:12:41.667284] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T20:12:41.748683] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T20:12:41.827165] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-07T20:12:42.247634] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-07T20:12:42.818845] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T20:12:43.047706] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-07T20:12:43.847713] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-07T20:12:44.395950] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T20:12:44.396803] [INFO ] [REMOTE ] MLP: Full fetch complete (4569 records). [2025-10-07T20:12:44.396873] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-07T20:12:44.652816] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-07T20:12:44.802595] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-07T20:12:44.803148] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-07T20:12:44.803588] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-07T20:12:44.803824] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-07T20:12:44.805103] [DEBUG] [LOCAL ] MLP: Trimmed 4569 records to 3010 (keeping 200 days of data) [2025-10-07T20:12:44.825090] [DEBUG] [LOCAL ] MLP: Primary data saved (3010 records). [2025-10-07T20:12:44.825247] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-07T20:12:44.825361] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLP took 22.6s. Estimated remaining: 2h 21m 1s. Rate: 7.1 symbols/min [2025-10-07T20:12:44.996572] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:12:45.040505] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T20:12:45.057098] [DEBUG] [LOCAL ] MMD: Loaded 11253 existing records from primary storage. [2025-10-07T20:12:45.057637] [INFO ] [MAIN ] MMD: Loaded 11253 existing records. [2025-10-07T20:12:45.231218] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:12:45.231439] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-07T20:12:45.231488] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-07T20:12:45.231724] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-07T20:12:45.231782] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-07T20:12:45.449217] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-07T20:12:45.595264] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:12:45.608747] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T20:12:46.247703] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-07T20:12:46.627355] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T20:12:47.047699] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-07T20:12:47.271348] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T20:12:47.847667] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-07T20:12:48.157584] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T20:12:48.314160] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T20:12:48.647692] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-07T20:12:49.447730] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-07T20:12:49.594796] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T20:12:50.247691] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-07T20:12:50.797134] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T20:12:51.003425] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T20:12:51.047611] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-07T20:12:51.847734] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-07T20:12:52.409138] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T20:12:52.647736] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-07T20:12:53.447625] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-07T20:12:53.634937] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T20:12:53.935845] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T20:12:53.938887] [INFO ] [REMOTE ] MLNK: Full fetch complete (36280 records). [2025-10-07T20:12:53.938984] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-07T20:12:54.250840] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-07T20:12:54.377597] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T20:12:54.398093] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-07T20:12:54.398238] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-07T20:12:54.399464] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-07T20:12:54.399548] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-07T20:12:54.400976] [DEBUG] [LOCAL ] MLNK: Trimmed 36280 records to 25703 (keeping 200 days of data) [2025-10-07T20:12:54.554506] [DEBUG] [LOCAL ] MLNK: Primary data saved (25703 records). [2025-10-07T20:12:54.554703] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-07T20:12:54.554818] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLNK took 38.4s. Estimated remaining: 2h 20m 54s. Rate: 7.1 symbols/min [2025-10-07T20:12:54.722262] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:12:54.738698] [DEBUG] [LOCAL ] MMI: Loaded 15201 existing records from primary storage. [2025-10-07T20:12:54.738957] [INFO ] [MAIN ] MMI: Loaded 15201 existing records. [2025-10-07T20:12:54.911915] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:12:54.912154] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-07T20:12:54.912204] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-07T20:12:54.912405] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-07T20:12:54.912491] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-07T20:12:55.054117] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-07T20:12:55.283614] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:12:55.847667] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-07T20:12:56.047490] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T20:12:56.178161] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T20:12:56.647758] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-07T20:12:56.669444] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-07T20:12:57.447725] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-07T20:12:57.564763] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T20:12:58.235522] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T20:12:58.247598] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-07T20:12:59.047719] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-07T20:12:59.158211] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T20:12:59.847633] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-07T20:12:59.962691] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T20:13:00.647620] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-07T20:13:00.712862] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-07T20:13:01.447701] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-07T20:13:01.661730] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T20:13:01.663086] [INFO ] [REMOTE ] MLR: Full fetch complete (18806 records). [2025-10-07T20:13:01.663159] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-07T20:13:02.040570] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-07T20:13:02.040694] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-07T20:13:02.041197] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-07T20:13:02.041261] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-07T20:13:02.041962] [DEBUG] [LOCAL ] MLR: Trimmed 18806 records to 12353 (keeping 200 days of data) [2025-10-07T20:13:02.125755] [DEBUG] [LOCAL ] MLR: Primary data saved (12353 records). [2025-10-07T20:13:02.125943] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-07T20:13:02.126035] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLR took 35.7s. Estimated remaining: 2h 20m 45s. Rate: 7.1 symbols/min [2025-10-07T20:13:02.252042] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-07T20:13:02.308537] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:02.308821] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-07T20:13:02.308921] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-07T20:13:02.309095] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-07T20:13:02.309147] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-07T20:13:02.309192] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-07T20:13:02.309226] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-07T20:13:02.424280] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T20:13:02.675814] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:13:03.047715] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-07T20:13:03.113697] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T20:13:03.847706] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-07T20:13:03.924140] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-07T20:13:04.647624] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-07T20:13:04.767121] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T20:13:05.447625] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-07T20:13:05.553638] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T20:13:05.651163] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:13:05.651538] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-07T20:13:05.651627] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:13:05.651766] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-07T20:13:05.651832] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:13:05.651901] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-07T20:13:05.651970] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-07T20:13:05.652006] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-07T20:13:05.652046] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-07T20:13:05.652094] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MMID took 3.5s. Estimated remaining: 2h 20m 33s. Rate: 7.1 symbols/min [2025-10-07T20:13:05.837270] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:05.837468] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-07T20:13:05.837525] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-07T20:13:05.837692] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-07T20:13:05.837763] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-07T20:13:05.837853] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-07T20:13:05.837936] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-07T20:13:06.216981] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:13:06.247626] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-07T20:13:07.047765] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-07T20:13:07.081489] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-07T20:13:07.495021] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-07T20:13:07.847678] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-07T20:13:08.288430] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-07T20:13:08.647682] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-07T20:13:09.156345] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-07T20:13:09.447627] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-07T20:13:10.247721] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-07T20:13:10.402867] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T20:13:11.047743] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-07T20:13:11.847626] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-07T20:13:11.858986] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T20:13:11.966400] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T20:13:12.647695] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-07T20:13:12.843264] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T20:13:13.447696] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-07T20:13:14.247625] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-07T20:13:14.348886] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T20:13:14.463791] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-07T20:13:15.047621] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-07T20:13:15.114540] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T20:13:15.847698] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-07T20:13:16.648913] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-07T20:13:16.651939] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T20:13:16.719829] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T20:13:16.723352] [INFO ] [REMOTE ] MMC: Full fetch complete (74753 records). [2025-10-07T20:13:16.723504] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-07T20:13:17.131088] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-07T20:13:17.131182] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-07T20:13:17.132164] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-07T20:13:17.132233] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-07T20:13:17.133872] [DEBUG] [LOCAL ] MMC: Trimmed 74753 records to 51858 (keeping 200 days of data) [2025-10-07T20:13:17.447723] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-07T20:13:17.467943] [DEBUG] [LOCAL ] MMC: Primary data saved (51858 records). [2025-10-07T20:13:17.468112] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-07T20:13:17.468200] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMC took 49.2s. Estimated remaining: 2h 20m 27s. Rate: 7.1 symbols/min [2025-10-07T20:13:17.642557] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:17.657958] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T20:13:17.707191] [DEBUG] [LOCAL ] MMM: Loaded 53158 existing records from primary storage. [2025-10-07T20:13:17.707572] [INFO ] [MAIN ] MMM: Loaded 53158 existing records. [2025-10-07T20:13:17.892906] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:13:17.893222] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-07T20:13:17.893286] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-07T20:13:17.893552] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-07T20:13:17.893612] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-07T20:13:18.243070] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:13:18.247603] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-07T20:13:18.407775] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T20:13:18.409099] [INFO ] [REMOTE ] MMD: Full fetch complete (17747 records). [2025-10-07T20:13:18.409175] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-07T20:13:18.774504] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-07T20:13:18.774585] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-07T20:13:18.774999] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-07T20:13:18.775062] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-07T20:13:18.775584] [DEBUG] [LOCAL ] MMD: Trimmed 17747 records to 11209 (keeping 200 days of data) [2025-10-07T20:13:18.847855] [DEBUG] [LOCAL ] MMD: Primary data saved (11209 records). [2025-10-07T20:13:18.848015] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-07T20:13:18.848103] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMD took 34.0s. Estimated remaining: 2h 20m 13s. Rate: 7.1 symbols/min [2025-10-07T20:13:19.018348] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:19.018566] [DEBUG] [LOCAL ] MMS: No existing data file found in primary storage. [2025-10-07T20:13:19.018633] [WARN ] [MAIN ] MMS: No existing data found, performing full refresh instead. [2025-10-07T20:13:19.018779] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-07T20:13:19.018822] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-07T20:13:19.018909] [DEBUG] [LOCAL ] MMS: No primary data file found to delete. [2025-10-07T20:13:19.018949] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-07T20:13:19.052895] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-07T20:13:19.380367] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:13:19.847630] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-07T20:13:19.965116] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T20:13:20.321935] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-07T20:13:20.647685] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-07T20:13:21.452836] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-07T20:13:21.471975] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T20:13:21.913150] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-07T20:13:22.247677] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-07T20:13:22.457061] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T20:13:23.047672] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-07T20:13:23.177428] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T20:13:23.179331] [INFO ] [REMOTE ] MMI: Full fetch complete (21425 records). [2025-10-07T20:13:23.179411] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-07T20:13:23.568021] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-07T20:13:23.568184] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-07T20:13:23.569285] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-07T20:13:23.569357] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-07T20:13:23.570399] [DEBUG] [LOCAL ] MMI: Trimmed 21425 records to 15268 (keeping 200 days of data) [2025-10-07T20:13:23.671878] [DEBUG] [LOCAL ] MMI: Primary data saved (15268 records). [2025-10-07T20:13:23.672079] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-07T20:13:23.672183] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMI took 29.1s. Estimated remaining: 2h 20m 2s. Rate: 7.1 symbols/min [2025-10-07T20:13:23.850886] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-07T20:13:23.850749] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:23.867212] [DEBUG] [LOCAL ] MMT: Loaded 10528 existing records from primary storage. [2025-10-07T20:13:23.867634] [INFO ] [MAIN ] MMT: Loaded 10528 existing records. [2025-10-07T20:13:24.113192] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:13:24.113563] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-07T20:13:24.113623] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-07T20:13:24.113977] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-07T20:13:24.114039] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-07T20:13:24.195037] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-07T20:13:24.505429] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:13:24.647729] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-07T20:13:24.888483] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T20:13:25.447723] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-07T20:13:25.505973] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T20:13:26.247715] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-07T20:13:27.045581] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T20:13:27.048911] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-07T20:13:27.248301] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T20:13:27.486560] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-07T20:13:27.847720] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-07T20:13:28.647731] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-07T20:13:29.447622] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-07T20:13:29.988812] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-07T20:13:30.126613] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T20:13:30.160549] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T20:13:30.247686] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-07T20:13:31.047778] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-07T20:13:31.753974] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T20:13:31.847841] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-07T20:13:32.190578] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-07T20:13:32.647733] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-07T20:13:33.147095] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-07T20:13:33.375936] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-07T20:13:33.447687] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-07T20:13:34.204234] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T20:13:34.247622] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-07T20:13:35.047713] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-07T20:13:35.847704] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-07T20:13:36.045553] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T20:13:36.605390] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T20:13:36.647692] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-07T20:13:36.814523] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T20:13:37.447693] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-07T20:13:38.158623] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T20:13:38.247707] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-07T20:13:38.620126] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-07T20:13:39.026120] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T20:13:39.047625] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-07T20:13:39.832862] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T20:13:39.847600] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-07T20:13:40.618010] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T20:13:40.647699] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-07T20:13:41.389284] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T20:13:41.447677] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-07T20:13:42.247705] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-07T20:13:42.494399] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T20:13:43.047704] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-07T20:13:43.620244] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T20:13:43.812664] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T20:13:43.847616] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-07T20:13:44.647678] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-07T20:13:45.056113] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T20:13:45.436897] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T20:13:45.447599] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-07T20:13:46.155007] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T20:13:46.156461] [INFO ] [REMOTE ] MMT: Full fetch complete (15956 records). [2025-10-07T20:13:46.156545] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-07T20:13:46.252965] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-07T20:13:46.550605] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-07T20:13:46.550741] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-07T20:13:46.551310] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-07T20:13:46.551368] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-07T20:13:46.552044] [DEBUG] [LOCAL ] MMT: Trimmed 15956 records to 10518 (keeping 200 days of data) [2025-10-07T20:13:46.627137] [DEBUG] [LOCAL ] MMT: Primary data saved (10518 records). [2025-10-07T20:13:46.627333] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-07T20:13:46.627469] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMT took 23.0s. Estimated remaining: 2h 20m 4s. Rate: 7.1 symbols/min [2025-10-07T20:13:46.809892] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:46.828580] [DEBUG] [LOCAL ] MMU: Loaded 16750 existing records from primary storage. [2025-10-07T20:13:46.828872] [INFO ] [MAIN ] MMU: Loaded 16750 existing records. [2025-10-07T20:13:47.001612] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:13:47.001885] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-07T20:13:47.001933] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-07T20:13:47.002234] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-07T20:13:47.002294] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-07T20:13:47.054572] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-07T20:13:47.369249] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:13:47.847635] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-07T20:13:48.126207] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T20:13:48.495680] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T20:13:48.617799] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T20:13:48.647637] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-07T20:13:49.089071] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T20:13:49.090067] [INFO ] [REMOTE ] MMKT: Full fetch complete (2117 records). [2025-10-07T20:13:49.090210] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-07T20:13:49.296792] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T20:13:49.297086] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:13:49.297162] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:13:49.297240] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-07T20:13:49.297314] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-07T20:13:49.297353] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-07T20:13:49.297424] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-07T20:13:49.297510] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMKT took 43.6s. Estimated remaining: 2h 19m 52s. Rate: 7.1 symbols/min [2025-10-07T20:13:49.456114] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-07T20:13:49.487090] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:49.518979] [DEBUG] [LOCAL ] MNR: Loaded 24503 existing records from primary storage. [2025-10-07T20:13:49.519391] [INFO ] [MAIN ] MNR: Loaded 24503 existing records. [2025-10-07T20:13:49.714202] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:13:49.714530] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-07T20:13:49.714585] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-07T20:13:49.714858] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-07T20:13:49.714917] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-07T20:13:50.112082] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:13:50.247710] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-07T20:13:50.867711] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T20:13:51.047720] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-07T20:13:51.486791] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T20:13:51.847709] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-07T20:13:52.459089] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T20:13:52.647728] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-07T20:13:52.859806] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T20:13:53.447741] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-07T20:13:54.247692] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-07T20:13:54.479588] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T20:13:54.778221] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-07T20:13:54.935411] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-07T20:13:55.047701] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-07T20:13:55.847715] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-07T20:13:56.647762] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-07T20:13:56.926350] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-07T20:13:57.021030] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-07T20:13:57.024523] [INFO ] [REMOTE ] MMS: Full fetch complete (51910 records). [2025-10-07T20:13:57.024681] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-07T20:13:57.423029] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-07T20:13:57.423137] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-07T20:13:57.424312] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-07T20:13:57.424379] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-07T20:13:57.427800] [DEBUG] [LOCAL ] MMS: Trimmed 51910 records to 34006 (keeping 200 days of data) [2025-10-07T20:13:57.494469] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-07T20:13:57.678820] [DEBUG] [LOCAL ] MMS: Primary data saved (34006 records). [2025-10-07T20:13:57.679015] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-07T20:13:57.679155] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMS took 38.8s. Estimated remaining: 2h 19m 43s. Rate: 7.1 symbols/min [2025-10-07T20:13:57.854668] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:57.898369] [DEBUG] [LOCAL ] MNSO: Loaded 44353 existing records from primary storage. [2025-10-07T20:13:57.898718] [INFO ] [MAIN ] MNSO: Loaded 44353 existing records. [2025-10-07T20:13:58.094479] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:13:58.094749] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-07T20:13:58.094806] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-07T20:13:58.095102] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-07T20:13:58.095161] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-07T20:13:58.252763] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-07T20:13:58.417335] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-07T20:13:58.497283] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:13:58.499101] [INFO ] [REMOTE ] MMM: Full fetch complete (77069 records). [2025-10-07T20:13:58.499404] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-07T20:13:58.704098] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T20:13:58.988704] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-07T20:13:58.988844] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-07T20:13:58.990321] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-07T20:13:58.990412] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-07T20:13:58.992706] [DEBUG] [LOCAL ] MMM: Trimmed 77069 records to 53140 (keeping 200 days of data) [2025-10-07T20:13:59.062275] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-07T20:13:59.398360] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T20:13:59.411222] [DEBUG] [LOCAL ] MMM: Primary data saved (53140 records). [2025-10-07T20:13:59.411448] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-07T20:13:59.411574] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMM took 41.9s. Estimated remaining: 2h 19m 30s. Rate: 7.1 symbols/min [2025-10-07T20:13:59.588185] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:13:59.588433] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-07T20:13:59.588490] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-07T20:13:59.588629] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-07T20:13:59.588712] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-07T20:13:59.588770] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-07T20:13:59.588807] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-07T20:13:59.857030] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-07T20:13:59.972400] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:14:00.647624] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-07T20:14:00.744552] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T20:14:01.162723] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T20:14:01.373044] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T20:14:01.447738] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-07T20:14:02.247740] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-07T20:14:02.745225] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T20:14:03.047704] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-07T20:14:03.847894] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-07T20:14:03.850961] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T20:14:04.076509] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:14:04.077003] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-07T20:14:04.077108] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:14:04.077158] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-07T20:14:04.077221] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:14:04.077326] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-07T20:14:04.077530] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-07T20:14:04.077594] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-07T20:14:04.077717] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-07T20:14:04.077797] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MNTN took 4.7s. Estimated remaining: 2h 19m 19s. Rate: 7.1 symbols/min [2025-10-07T20:14:04.272321] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:14:04.272702] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-07T20:14:04.272906] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-07T20:14:04.273130] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-07T20:14:04.273342] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-07T20:14:04.273450] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-07T20:14:04.273498] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-07T20:14:04.411987] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-07T20:14:04.652778] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-07T20:14:04.694613] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:14:05.447790] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-07T20:14:05.784815] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T20:14:06.247723] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-07T20:14:06.589896] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T20:14:07.047773] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-07T20:14:07.847733] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-07T20:14:08.499369] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-07T20:14:08.621882] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T20:14:08.647727] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-07T20:14:08.666452] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T20:14:09.447719] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-07T20:14:10.247710] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-07T20:14:10.432089] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T20:14:10.875536] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T20:14:11.047700] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-07T20:14:11.837870] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-07T20:14:11.849291] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-07T20:14:12.647728] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-07T20:14:12.769414] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-07T20:14:12.808720] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-07T20:14:13.447766] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-07T20:14:14.247721] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-07T20:14:14.296299] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T20:14:14.467380] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T20:14:15.047726] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-07T20:14:15.631911] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T20:14:15.777771] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T20:14:15.847717] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-07T20:14:16.647762] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-07T20:14:17.452887] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-07T20:14:17.474483] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T20:14:17.552870] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T20:14:17.554662] [INFO ] [REMOTE ] MMU: Full fetch complete (25474 records). [2025-10-07T20:14:17.554781] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-07T20:14:17.950662] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-07T20:14:17.950863] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-07T20:14:17.951842] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-07T20:14:17.951919] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-07T20:14:17.953179] [DEBUG] [LOCAL ] MMU: Trimmed 25474 records to 16773 (keeping 200 days of data) [2025-10-07T20:14:18.071633] [DEBUG] [LOCAL ] MMU: Primary data saved (16773 records). [2025-10-07T20:14:18.071881] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-07T20:14:18.072006] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MMU took 31.4s. Estimated remaining: 2h 19m 14s. Rate: 7.1 symbols/min [2025-10-07T20:14:18.252283] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-07T20:14:18.252147] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:14:18.307755] [DEBUG] [LOCAL ] MOD: Loaded 45092 existing records from primary storage. [2025-10-07T20:14:18.308193] [INFO ] [MAIN ] MOD: Loaded 45092 existing records. [2025-10-07T20:14:18.499779] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:14:18.500113] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-07T20:14:18.500174] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-07T20:14:18.500453] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-07T20:14:18.500513] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-07T20:14:18.887723] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:14:19.047764] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-07T20:14:19.752995] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T20:14:19.835724] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-07T20:14:19.847771] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-07T20:14:19.871316] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T20:14:20.647737] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-07T20:14:21.386132] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T20:14:21.447639] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-07T20:14:21.610336] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T20:14:21.612183] [INFO ] [REMOTE ] MNR: Full fetch complete (36586 records). [2025-10-07T20:14:21.612257] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-07T20:14:21.980427] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-07T20:14:21.980494] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-07T20:14:21.981164] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-07T20:14:21.981228] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-07T20:14:21.982911] [DEBUG] [LOCAL ] MNR: Trimmed 36586 records to 24441 (keeping 200 days of data) [2025-10-07T20:14:22.140303] [DEBUG] [LOCAL ] MNR: Primary data saved (24441 records). [2025-10-07T20:14:22.140458] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-07T20:14:22.140565] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNR took 32.8s. Estimated remaining: 2h 19m 3s. Rate: 7.1 symbols/min [2025-10-07T20:14:22.252808] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-07T20:14:22.311298] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:14:22.371412] [DEBUG] [LOCAL ] MODG: Loaded 51533 existing records from primary storage. [2025-10-07T20:14:22.371895] [INFO ] [MAIN ] MODG: Loaded 51533 existing records. [2025-10-07T20:14:22.576878] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:14:22.577208] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-07T20:14:22.577264] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-07T20:14:22.577751] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-07T20:14:22.577812] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-07T20:14:22.975513] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:14:23.047717] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-07T20:14:23.613250] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-07T20:14:23.847764] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-07T20:14:23.944924] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T20:14:24.383851] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T20:14:24.647744] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-07T20:14:25.447718] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-07T20:14:26.205841] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-07T20:14:26.247602] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-07T20:14:26.568429] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-07T20:14:26.794342] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T20:14:27.047683] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-07T20:14:27.847698] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-07T20:14:28.625330] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-07T20:14:28.647602] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-07T20:14:28.771993] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:14:29.447686] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-07T20:14:29.492084] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T20:14:30.247691] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-07T20:14:30.960075] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-07T20:14:31.047638] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-07T20:14:31.372600] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-07T20:14:31.788532] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-07T20:14:31.791699] [INFO ] [REMOTE ] MNSO: Full fetch complete (64302 records). [2025-10-07T20:14:31.791802] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-07T20:14:31.855194] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-07T20:14:32.183672] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-07T20:14:32.183783] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-07T20:14:32.184872] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-07T20:14:32.184943] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-07T20:14:32.186502] [DEBUG] [LOCAL ] MNSO: Trimmed 64302 records to 44345 (keeping 200 days of data) [2025-10-07T20:14:32.470215] [DEBUG] [LOCAL ] MNSO: Primary data saved (44345 records). [2025-10-07T20:14:32.470381] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-07T20:14:32.470473] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MNSO took 34.8s. Estimated remaining: 2h 18m 56s. Rate: 7.1 symbols/min [2025-10-07T20:14:32.648715] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-07T20:14:32.680246] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:14:32.723014] [DEBUG] [LOCAL ] MOH: Loaded 41935 existing records from primary storage. [2025-10-07T20:14:32.723366] [INFO ] [MAIN ] MOH: Loaded 41935 existing records. [2025-10-07T20:14:32.908410] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:14:32.908943] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-07T20:14:32.909100] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-07T20:14:32.909501] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-07T20:14:32.909661] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-07T20:14:33.304989] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-07T20:14:33.338891] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:14:33.447683] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-07T20:14:33.538920] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T20:14:34.247720] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-07T20:14:34.830329] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-07T20:14:35.052736] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-07T20:14:35.070672] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T20:14:35.687109] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T20:14:35.847697] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-07T20:14:36.647622] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-07T20:14:36.842812] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T20:14:37.230447] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T20:14:37.447693] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-07T20:14:38.247624] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-07T20:14:38.316593] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T20:14:38.652983] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T20:14:39.047681] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-07T20:14:39.847692] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-07T20:14:40.372425] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T20:14:40.647629] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-07T20:14:40.756276] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T20:14:41.307523] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T20:14:41.447637] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-07T20:14:42.247701] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-07T20:14:42.691140] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-07T20:14:42.694800] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-07T20:14:42.694903] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-07T20:14:42.932129] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T20:14:42.932910] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:14:42.932983] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:14:42.933121] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-07T20:14:42.933229] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-07T20:14:42.933286] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-07T20:14:42.933348] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-07T20:14:42.933431] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MO took 38.9s. Estimated remaining: 2h 18m 49s. Rate: 7.1 symbols/min [2025-10-07T20:14:43.052104] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-07T20:14:43.120217] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:14:43.172045] [DEBUG] [LOCAL ] MOS: Loaded 53499 existing records from primary storage. [2025-10-07T20:14:43.172396] [INFO ] [MAIN ] MOS: Loaded 53499 existing records. [2025-10-07T20:14:43.379502] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T20:14:43.378222] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:14:43.388119] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-07T20:14:43.388470] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-07T20:14:43.389134] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-07T20:14:43.389203] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-07T20:14:43.758953] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:14:43.847923] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-07T20:14:43.850615] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T20:14:44.647766] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-07T20:14:44.780082] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T20:14:45.447679] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-07T20:14:45.719163] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T20:14:45.807128] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T20:14:46.247752] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-07T20:14:47.047682] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-07T20:14:47.233731] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T20:14:47.819548] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T20:14:47.847605] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-07T20:14:48.582966] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T20:14:48.647740] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-07T20:14:48.969961] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T20:14:48.972873] [INFO ] [REMOTE ] MOD: Full fetch complete (66250 records). [2025-10-07T20:14:48.973027] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-07T20:14:49.362930] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-07T20:14:49.363063] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-07T20:14:49.364980] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-07T20:14:49.365056] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-07T20:14:49.367083] [DEBUG] [LOCAL ] MOD: Trimmed 66250 records to 45030 (keeping 200 days of data) [2025-10-07T20:14:49.459697] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-07T20:14:49.668568] [DEBUG] [LOCAL ] MOD: Primary data saved (45030 records). [2025-10-07T20:14:49.668801] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-07T20:14:49.668922] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MOD took 31.6s. Estimated remaining: 2h 18m 39s. Rate: 7.1 symbols/min [2025-10-07T20:14:49.852593] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:14:49.881029] [DEBUG] [LOCAL ] MOV: Loaded 21809 existing records from primary storage. [2025-10-07T20:14:49.881390] [INFO ] [MAIN ] MOV: Loaded 21809 existing records. [2025-10-07T20:14:50.078922] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:14:50.079377] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-07T20:14:50.079445] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-07T20:14:50.079789] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-07T20:14:50.079850] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-07T20:14:50.218678] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T20:14:50.261998] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-07T20:14:50.485177] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:14:51.047625] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-07T20:14:51.170389] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T20:14:51.847665] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-07T20:14:52.091250] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T20:14:52.647637] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-07T20:14:53.009485] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T20:14:53.049744] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T20:14:53.447747] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-07T20:14:54.247729] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-07T20:14:54.477262] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T20:14:55.047687] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-07T20:14:55.258585] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T20:14:55.300840] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T20:14:55.847708] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-07T20:14:56.647634] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-07T20:14:57.002262] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T20:14:57.447622] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-07T20:14:57.589073] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T20:14:57.655550] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-07T20:14:58.247694] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-07T20:14:59.047730] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-07T20:14:59.347615] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T20:14:59.752967] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T20:14:59.756023] [INFO ] [REMOTE ] MOH: Full fetch complete (58666 records). [2025-10-07T20:14:59.756142] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-07T20:14:59.848383] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-07T20:15:00.133330] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T20:15:00.189398] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-07T20:15:00.189496] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-07T20:15:00.190516] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-07T20:15:00.190586] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-07T20:15:00.192001] [DEBUG] [LOCAL ] MOH: Trimmed 58666 records to 42038 (keeping 200 days of data) [2025-10-07T20:15:00.454844] [DEBUG] [LOCAL ] MOH: Primary data saved (42038 records). [2025-10-07T20:15:00.454995] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-07T20:15:00.455081] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOH took 28.0s. Estimated remaining: 2h 18m 32s. Rate: 7.1 symbols/min [2025-10-07T20:15:00.625398] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:15:00.657041] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-07T20:15:00.684079] [DEBUG] [LOCAL ] MP: Loaded 53686 existing records from primary storage. [2025-10-07T20:15:00.684469] [INFO ] [MAIN ] MP: Loaded 53686 existing records. [2025-10-07T20:15:00.862009] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:15:00.862297] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-07T20:15:00.862350] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-07T20:15:00.862755] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-07T20:15:00.862815] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-07T20:15:01.267957] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:15:01.447731] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-07T20:15:01.762097] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T20:15:02.237247] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T20:15:02.247815] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-07T20:15:03.047687] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-07T20:15:03.351142] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T20:15:03.676196] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T20:15:03.847684] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-07T20:15:04.647726] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-07T20:15:04.675199] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T20:15:04.678617] [INFO ] [REMOTE ] MODG: Full fetch complete (74794 records). [2025-10-07T20:15:04.678752] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-07T20:15:05.128205] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-07T20:15:05.128308] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-07T20:15:05.129543] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-07T20:15:05.129618] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-07T20:15:05.131387] [DEBUG] [LOCAL ] MODG: Trimmed 74794 records to 51559 (keeping 200 days of data) [2025-10-07T20:15:05.449063] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-07T20:15:05.453620] [DEBUG] [LOCAL ] MODG: Primary data saved (51559 records). [2025-10-07T20:15:05.453815] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-07T20:15:05.453914] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MODG took 43.3s. Estimated remaining: 2h 18m 21s. Rate: 7.1 symbols/min [2025-10-07T20:15:05.628186] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:15:05.636248] [DEBUG] [LOCAL ] MPA: Loaded 5336 existing records from primary storage. [2025-10-07T20:15:05.636467] [INFO ] [MAIN ] MPA: Loaded 5336 existing records. [2025-10-07T20:15:05.820685] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:15:05.821043] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-07T20:15:05.821176] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-07T20:15:05.821505] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-07T20:15:05.821695] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-07T20:15:06.004296] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-07T20:15:06.239421] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:15:06.247600] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-07T20:15:06.493555] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T20:15:07.031602] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T20:15:07.042691] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T20:15:07.047587] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-07T20:15:07.529304] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T20:15:07.847675] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-07T20:15:08.647707] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-07T20:15:09.447620] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-07T20:15:09.678198] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T20:15:09.844671] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T20:15:10.231245] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T20:15:10.247638] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-07T20:15:10.844391] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T20:15:11.047730] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-07T20:15:11.791309] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-07T20:15:11.847611] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-07T20:15:12.550673] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T20:15:12.647729] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-07T20:15:13.447622] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-07T20:15:13.748403] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T20:15:14.081379] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T20:15:14.247694] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-07T20:15:15.047749] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-07T20:15:15.847636] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-07T20:15:16.144015] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T20:15:16.256577] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-07T20:15:16.543309] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T20:15:16.647805] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-07T20:15:17.447633] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-07T20:15:17.652745] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T20:15:18.006156] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T20:15:18.247750] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-07T20:15:19.047705] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-07T20:15:19.279815] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T20:15:19.409250] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-07T20:15:19.847692] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-07T20:15:20.647688] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-07T20:15:21.447667] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-07T20:15:21.553731] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T20:15:21.555411] [INFO ] [REMOTE ] MOV: Full fetch complete (30633 records). [2025-10-07T20:15:21.555486] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-07T20:15:21.982037] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-07T20:15:22.006621] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-07T20:15:22.007330] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-07T20:15:22.008366] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-07T20:15:22.008463] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-07T20:15:22.010058] [DEBUG] [LOCAL ] MOV: Trimmed 30633 records to 21858 (keeping 200 days of data) [2025-10-07T20:15:22.146694] [DEBUG] [LOCAL ] MOV: Primary data saved (21858 records). [2025-10-07T20:15:22.146861] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-07T20:15:22.146951] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOV took 32.5s. Estimated remaining: 2h 18m 19s. Rate: 7.1 symbols/min [2025-10-07T20:15:22.247950] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-07T20:15:22.322818] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:15:22.323022] [DEBUG] [LOCAL ] MPC: No existing data file found in primary storage. [2025-10-07T20:15:22.323079] [WARN ] [MAIN ] MPC: No existing data found, performing full refresh instead. [2025-10-07T20:15:22.323192] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-07T20:15:22.323238] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-07T20:15:22.323312] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-07T20:15:22.323363] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-07T20:15:22.677701] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:15:23.047713] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-07T20:15:23.472898] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T20:15:23.791745] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T20:15:23.793092] [INFO ] [REMOTE ] MPA: Full fetch complete (7209 records). [2025-10-07T20:15:23.793180] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-07T20:15:23.854565] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-07T20:15:24.225982] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-07T20:15:24.226099] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-07T20:15:24.226461] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-07T20:15:24.226614] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-07T20:15:24.227498] [DEBUG] [LOCAL ] MPA: Trimmed 7209 records to 5335 (keeping 200 days of data) [2025-10-07T20:15:24.318242] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-07T20:15:24.336581] [DEBUG] [LOCAL ] MPA: Primary data saved (5335 records). [2025-10-07T20:15:24.336804] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-07T20:15:24.336915] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MPA took 18.9s. Estimated remaining: 2h 18m 6s. Rate: 7.1 symbols/min [2025-10-07T20:15:24.547406] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:15:24.597336] [DEBUG] [LOCAL ] MPLX: Loaded 50717 existing records from primary storage. [2025-10-07T20:15:24.597760] [INFO ] [MAIN ] MPLX: Loaded 50717 existing records. [2025-10-07T20:15:24.660102] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-07T20:15:24.780211] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:15:24.780449] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-07T20:15:24.780503] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-07T20:15:24.780852] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-07T20:15:24.780910] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-07T20:15:25.135462] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:15:25.447678] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-07T20:15:26.247773] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-07T20:15:26.329636] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-07T20:15:26.562786] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T20:15:26.886969] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T20:15:27.047686] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-07T20:15:27.845596] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T20:15:27.848947] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-07T20:15:27.850520] [INFO ] [REMOTE ] MOS: Full fetch complete (77454 records). [2025-10-07T20:15:27.850613] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-07T20:15:28.291727] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-07T20:15:28.291854] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-07T20:15:28.292891] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-07T20:15:28.292960] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-07T20:15:28.294609] [DEBUG] [LOCAL ] MOS: Trimmed 77454 records to 53501 (keeping 200 days of data) [2025-10-07T20:15:28.577578] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T20:15:28.657010] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-07T20:15:28.685399] [DEBUG] [LOCAL ] MOS: Primary data saved (53501 records). [2025-10-07T20:15:28.685577] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-07T20:15:28.685713] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MOS took 45.8s. Estimated remaining: 2h 17m 55s. Rate: 7.1 symbols/min [2025-10-07T20:15:28.860317] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:15:28.867966] [DEBUG] [LOCAL ] MPV: Loaded 4901 existing records from primary storage. [2025-10-07T20:15:28.868170] [INFO ] [MAIN ] MPV: Loaded 4901 existing records. [2025-10-07T20:15:29.043868] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:15:29.044112] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-07T20:15:29.044242] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-07T20:15:29.044449] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-07T20:15:29.044558] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-07T20:15:29.416886] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:15:29.447637] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-07T20:15:30.030152] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-07T20:15:30.099311] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T20:15:30.100165] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T20:15:30.247684] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-07T20:15:31.047765] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-07T20:15:31.847703] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-07T20:15:32.647633] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-07T20:15:32.800663] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-07T20:15:32.838431] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T20:15:33.112766] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T20:15:33.321478] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-07T20:15:33.447710] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-07T20:15:34.247718] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-07T20:15:35.047676] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-07T20:15:35.678924] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T20:15:35.847718] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-07T20:15:36.212871] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-07T20:15:36.647623] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-07T20:15:36.914122] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T20:15:37.447622] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-07T20:15:37.480219] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T20:15:38.247757] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-07T20:15:38.958010] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T20:15:39.047623] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-07T20:15:39.217040] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T20:15:39.289359] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-07T20:15:39.801928] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T20:15:39.847694] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-07T20:15:40.454448] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T20:15:40.647756] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-07T20:15:41.447729] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-07T20:15:42.126123] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-07T20:15:42.247757] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-07T20:15:42.447735] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T20:15:42.978885] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T20:15:43.047627] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-07T20:15:43.847690] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-07T20:15:44.647724] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-07T20:15:45.447668] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-07T20:15:45.515786] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T20:15:45.737931] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-07T20:15:46.011063] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-07T20:15:46.081796] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T20:15:46.247626] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-07T20:15:47.047719] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-07T20:15:47.675361] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T20:15:47.847670] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-07T20:15:48.082880] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T20:15:48.440465] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T20:15:48.647720] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-07T20:15:49.447729] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-07T20:15:50.029737] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:15:50.030957] [INFO ] [REMOTE ] MPV: Full fetch complete (7953 records). [2025-10-07T20:15:50.031030] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-07T20:15:50.252454] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-07T20:15:50.435887] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-07T20:15:50.435994] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-07T20:15:50.436223] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-07T20:15:50.436382] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-07T20:15:50.437108] [DEBUG] [LOCAL ] MPV: Trimmed 7953 records to 4894 (keeping 200 days of data) [2025-10-07T20:15:50.489247] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T20:15:50.507615] [DEBUG] [LOCAL ] MPV: Primary data saved (4894 records). [2025-10-07T20:15:50.507792] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-07T20:15:50.507911] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPV took 21.8s. Estimated remaining: 2h 17m 56s. Rate: 7.1 symbols/min [2025-10-07T20:15:50.672676] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:15:50.723580] [DEBUG] [LOCAL ] MPW: Loaded 53493 existing records from primary storage. [2025-10-07T20:15:50.723962] [INFO ] [MAIN ] MPW: Loaded 53493 existing records. [2025-10-07T20:15:50.904202] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:15:50.904461] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-07T20:15:50.904509] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-07T20:15:50.904849] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-07T20:15:50.904907] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-07T20:15:51.059862] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-07T20:15:51.255526] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:15:51.847627] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-07T20:15:52.171946] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T20:15:52.647625] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-07T20:15:53.447739] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-07T20:15:53.531683] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T20:15:53.569570] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-07T20:15:53.573485] [INFO ] [REMOTE ] MP: Full fetch complete (77377 records). [2025-10-07T20:15:53.573719] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-07T20:15:54.016517] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-07T20:15:54.016617] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-07T20:15:54.017784] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-07T20:15:54.017856] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-07T20:15:54.021861] [DEBUG] [LOCAL ] MP: Trimmed 77377 records to 53690 (keeping 200 days of data) [2025-10-07T20:15:54.256177] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-07T20:15:54.453923] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T20:15:54.471510] [DEBUG] [LOCAL ] MP: Primary data saved (53690 records). [2025-10-07T20:15:54.471970] [INFO ] [MAIN ] MP: Full history saved. [2025-10-07T20:15:54.472144] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MP took 54.0s. Estimated remaining: 2h 17m 44s. Rate: 7.1 symbols/min [2025-10-07T20:15:54.656547] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:15:54.663880] [DEBUG] [LOCAL ] MPX: Loaded 4038 existing records from primary storage. [2025-10-07T20:15:54.664128] [INFO ] [MAIN ] MPX: Loaded 4038 existing records. [2025-10-07T20:15:54.837869] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:15:54.838117] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-07T20:15:54.838165] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-07T20:15:54.838368] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-07T20:15:54.838424] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-07T20:15:55.052992] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-07T20:15:55.206079] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:15:55.405085] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T20:15:55.847738] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-07T20:15:55.986602] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T20:15:56.647621] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-07T20:15:56.847598] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T20:15:57.431345] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T20:15:57.447625] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-07T20:15:58.242816] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T20:15:58.246356] [INFO ] [REMOTE ] MPLX: Full fetch complete (74065 records). [2025-10-07T20:15:58.246479] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-07T20:15:58.258988] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-07T20:15:58.676061] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-07T20:15:58.676167] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-07T20:15:58.677482] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-07T20:15:58.677601] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-07T20:15:58.679497] [DEBUG] [LOCAL ] MPLX: Trimmed 74065 records to 50718 (keeping 200 days of data) [2025-10-07T20:15:59.004133] [DEBUG] [LOCAL ] MPLX: Primary data saved (50718 records). [2025-10-07T20:15:59.004390] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-07T20:15:59.004519] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPLX took 34.7s. Estimated remaining: 2h 17m 33s. Rate: 7.1 symbols/min [2025-10-07T20:15:59.068410] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-07T20:15:59.183136] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:15:59.216155] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T20:15:59.230281] [DEBUG] [LOCAL ] MQT: Loaded 8681 existing records from primary storage. [2025-10-07T20:15:59.230470] [INFO ] [MAIN ] MQT: Loaded 8681 existing records. [2025-10-07T20:15:59.403182] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:15:59.403408] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-07T20:15:59.403456] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-07T20:15:59.403670] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-07T20:15:59.403728] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-07T20:15:59.754780] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:15:59.827498] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T20:15:59.847602] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-07T20:15:59.990425] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-07T20:15:59.996621] [INFO ] [REMOTE ] MPC: Full fetch complete (75806 records). [2025-10-07T20:15:59.996753] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-07T20:16:00.381055] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-07T20:16:00.381213] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-07T20:16:00.382307] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-07T20:16:00.382429] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-07T20:16:00.388845] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-07T20:16:00.391998] [DEBUG] [LOCAL ] MPC: Trimmed 75806 records to 52072 (keeping 200 days of data) [2025-10-07T20:16:00.647733] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-07T20:16:00.730167] [DEBUG] [LOCAL ] MPC: Primary data saved (52072 records). [2025-10-07T20:16:00.730357] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-07T20:16:00.730476] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPC took 38.6s. Estimated remaining: 2h 17m 20s. Rate: 7.1 symbols/min [2025-10-07T20:16:00.896969] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:16:00.916946] [DEBUG] [LOCAL ] MQY: Loaded 16950 existing records from primary storage. [2025-10-07T20:16:00.917206] [INFO ] [MAIN ] MQY: Loaded 16950 existing records. [2025-10-07T20:16:01.091459] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:16:01.091725] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-07T20:16:01.091783] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-07T20:16:01.092021] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-07T20:16:01.092080] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-07T20:16:01.444431] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:16:01.447602] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-07T20:16:01.554884] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T20:16:02.247728] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-07T20:16:02.738480] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T20:16:03.047778] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-07T20:16:03.132495] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T20:16:03.847686] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-07T20:16:04.313210] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T20:16:04.582492] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T20:16:04.647698] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-07T20:16:05.447624] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-07T20:16:05.839220] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T20:16:06.247715] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-07T20:16:06.267697] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T20:16:07.047700] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-07T20:16:07.418415] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T20:16:07.781167] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T20:16:07.847721] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-07T20:16:08.607287] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T20:16:08.647726] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-07T20:16:09.336631] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T20:16:09.447752] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-07T20:16:10.175042] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T20:16:10.247718] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-07T20:16:11.047708] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-07T20:16:11.169606] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T20:16:11.847727] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-07T20:16:12.214822] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T20:16:12.225207] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T20:16:12.226190] [INFO ] [REMOTE ] MPX: Full fetch complete (6654 records). [2025-10-07T20:16:12.226273] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-07T20:16:12.226755] [FATAL] [VALIDATOR ] MPX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:16:12.226839] [FATAL] [MAIN ] MPX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:16:12.226881] [WARN ] [MAIN ] MPX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:16:12.226958] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-07T20:16:12.227070] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-07T20:16:12.227125] [INFO ] [LOCAL ] MPX: Starting deletion of derivative data. [2025-10-07T20:16:12.227497] [DEBUG] [LOCAL ] MPX: Deleted derivative data file. [2025-10-07T20:16:12.227602] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPX took 17.8s. Estimated remaining: 2h 17m 13s. Rate: 7.1 symbols/min [2025-10-07T20:16:12.418700] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:16:12.468564] [DEBUG] [LOCAL ] MRC: Loaded 37156 existing records from primary storage. [2025-10-07T20:16:12.468939] [INFO ] [MAIN ] MRC: Loaded 37156 existing records. [2025-10-07T20:16:12.653890] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-07T20:16:12.660592] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:16:12.661940] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-07T20:16:12.661992] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-07T20:16:12.662341] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-07T20:16:12.662402] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-07T20:16:13.059097] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:16:13.447741] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-07T20:16:13.798139] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T20:16:14.247745] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-07T20:16:15.047733] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-07T20:16:15.523335] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T20:16:15.562228] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T20:16:15.847679] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-07T20:16:16.099530] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T20:16:16.647694] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-07T20:16:17.447622] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-07T20:16:17.707470] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T20:16:17.997459] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-07T20:16:18.247696] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-07T20:16:18.786937] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T20:16:19.047638] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-07T20:16:19.202030] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T20:16:19.847626] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-07T20:16:20.647769] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-07T20:16:20.899525] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T20:16:21.093208] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-07T20:16:21.447623] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-07T20:16:21.567915] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T20:16:22.247739] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-07T20:16:22.993620] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T20:16:23.047629] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-07T20:16:23.122068] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T20:16:23.847689] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-07T20:16:24.555538] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T20:16:24.647709] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-07T20:16:25.447746] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-07T20:16:25.725699] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T20:16:25.815852] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T20:16:26.247718] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-07T20:16:26.983954] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T20:16:27.047610] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-07T20:16:27.847686] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-07T20:16:28.455913] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-07T20:16:28.548186] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T20:16:28.570678] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T20:16:28.647614] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-07T20:16:29.447723] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-07T20:16:30.247721] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-07T20:16:30.644924] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T20:16:30.782391] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-07T20:16:30.970035] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T20:16:31.047604] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-07T20:16:31.847693] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-07T20:16:32.647628] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-07T20:16:32.712743] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T20:16:32.742025] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T20:16:33.447615] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-07T20:16:33.807827] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T20:16:34.247706] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-07T20:16:34.690803] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T20:16:35.047677] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-07T20:16:35.175967] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-07T20:16:35.847738] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-07T20:16:36.647747] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-07T20:16:37.181479] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-07T20:16:37.228637] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T20:16:37.447624] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-07T20:16:37.500695] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-07T20:16:37.929130] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:16:37.933777] [INFO ] [REMOTE ] MPW: Full fetch complete (77122 records). [2025-10-07T20:16:37.933956] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-07T20:16:37.935217] [FATAL] [VALIDATOR ] MPW: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:16:37.935333] [FATAL] [MAIN ] MPW: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:16:37.935417] [WARN ] [MAIN ] MPW: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:16:37.935508] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-07T20:16:37.935635] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-07T20:16:37.935731] [INFO ] [LOCAL ] MPW: Starting deletion of derivative data. [2025-10-07T20:16:37.935929] [DEBUG] [LOCAL ] MPW: Deleted derivative data file. [2025-10-07T20:16:37.936043] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPW took 47.4s. Estimated remaining: 2h 17m 17s. Rate: 7.1 symbols/min [2025-10-07T20:16:38.103681] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:16:38.103877] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-07T20:16:38.103915] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-07T20:16:38.104023] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-07T20:16:38.104065] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-07T20:16:38.104106] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-07T20:16:38.104138] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-07T20:16:38.254928] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-07T20:16:38.462332] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:16:39.047715] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-07T20:16:39.132937] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T20:16:39.135295] [INFO ] [REMOTE ] MRC: Full fetch complete (54595 records). [2025-10-07T20:16:39.135387] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-07T20:16:39.136240] [FATAL] [VALIDATOR ] MRC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:16:39.136353] [FATAL] [MAIN ] MRC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:16:39.136435] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:16:39.136522] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-07T20:16:39.136634] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-07T20:16:39.136749] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-07T20:16:39.136979] [DEBUG] [LOCAL ] MRC: Deleted derivative data file. [2025-10-07T20:16:39.137077] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MRC took 26.9s. Estimated remaining: 2h 17m 3s. Rate: 7.1 symbols/min [2025-10-07T20:16:39.765471] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T20:16:39.766583] [INFO ] [REMOTE ] MQT: Full fetch complete (13361 records). [2025-10-07T20:16:39.766689] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-07T20:16:39.854984] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-07T20:16:40.159291] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-07T20:16:40.159399] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-07T20:16:40.159857] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-07T20:16:40.159923] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-07T20:16:40.160480] [DEBUG] [LOCAL ] MQT: Trimmed 13361 records to 8668 (keeping 200 days of data) [2025-10-07T20:16:40.215004] [DEBUG] [LOCAL ] MQT: Primary data saved (8668 records). [2025-10-07T20:16:40.215182] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-07T20:16:40.215280] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQT took 41.2s. Estimated remaining: 2h 16m 50s. Rate: 7.1 symbols/min [2025-10-07T20:16:40.647617] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-07T20:16:40.882993] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T20:16:40.885202] [INFO ] [REMOTE ] MQY: Full fetch complete (27113 records). [2025-10-07T20:16:40.885310] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-07T20:16:41.256026] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-07T20:16:41.256112] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-07T20:16:41.256725] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-07T20:16:41.256787] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-07T20:16:41.257484] [DEBUG] [LOCAL ] MQY: Trimmed 27113 records to 16958 (keeping 200 days of data) [2025-10-07T20:16:41.368601] [DEBUG] [LOCAL ] MQY: Primary data saved (16958 records). [2025-10-07T20:16:41.368804] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-07T20:16:41.368902] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MQY took 40.6s. Estimated remaining: 2h 16m 36s. Rate: 7.1 symbols/min [2025-10-07T20:16:43.000490] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-07T20:16:43.011373] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-07T20:16:45.450315] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-07T20:16:45.460788] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-07T20:16:47.798025] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-07T20:16:47.808181] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-07T20:16:50.167695] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-07T20:16:50.184439] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-07T20:16:52.278097] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-07T20:16:52.289189] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-07T20:16:54.740827] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-07T20:16:54.752940] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-07T20:16:57.080659] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-07T20:16:57.092130] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-07T20:16:59.625040] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-07T20:16:59.636790] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-07T20:17:02.073230] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-07T20:17:02.084730] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-07T20:17:04.576455] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-07T20:17:04.588075] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-07T20:17:05.353109] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T20:17:05.356205] [INFO ] [REMOTE ] MRK: Full fetch complete (77467 records). [2025-10-07T20:17:05.356346] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-07T20:17:05.357221] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:17:05.357311] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:17:05.357354] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:17:05.357419] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-07T20:17:05.357511] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-07T20:17:05.357549] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-07T20:17:05.357589] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-07T20:17:05.357669] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRK took 27.4s. Estimated remaining: 2h 16m 39s. Rate: 7.1 symbols/min [2025-10-07T20:17:05.982193] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:06.055242] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:06.058997] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:06.075850] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-07T20:17:06.076796] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-07T20:17:06.077092] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-07T20:17:06.077183] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-07T20:17:06.074222] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-07T20:17:06.078184] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:06.078488] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-07T20:17:06.078674] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-07T20:17:06.078861] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-07T20:17:06.079097] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-07T20:17:06.085558] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-07T20:17:06.133185] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-07T20:17:06.133327] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-07T20:17:06.287826] [DEBUG] [LOCAL ] MSB: Loaded 7857 existing records from primary storage. [2025-10-07T20:17:06.329772] [INFO ] [MAIN ] MSB: Loaded 7857 existing records. [2025-10-07T20:17:06.329474] [DEBUG] [LOCAL ] MSA: Loaded 18886 existing records from primary storage. [2025-10-07T20:17:06.348554] [INFO ] [MAIN ] MSA: Loaded 18886 existing records. [2025-10-07T20:17:07.010130] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:17:07.082346] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-07T20:17:07.115989] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-07T20:17:07.121436] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:17:07.141872] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-10-07T20:17:07.143904] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-07T20:17:07.141838] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-07T20:17:07.158322] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:07.187825] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-07T20:17:07.210511] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-07T20:17:07.272278] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-07T20:17:07.332892] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:07.293718] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-07T20:17:07.337271] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-07T20:17:07.593544] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:17:07.647203] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-07T20:17:07.658308] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:17:07.695068] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-07T20:17:07.700329] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:17:07.706015] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-07T20:17:07.735160] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-07T20:17:07.740203] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-07T20:17:07.780939] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-07T20:17:07.790756] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MRP took 2.4s. Estimated remaining: 2h 16m 26s. Rate: 7.1 symbols/min [2025-10-07T20:17:07.810754] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:07.879312] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-07T20:17:08.155323] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:08.172880] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-07T20:17:08.177057] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-07T20:17:08.176954] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:08.177315] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-07T20:17:08.177765] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-07T20:17:08.177831] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-07T20:17:08.177869] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-07T20:17:08.177632] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-07T20:17:08.545942] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:08.546299] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-07T20:17:08.997449] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-07T20:17:08.999399] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-07T20:17:09.208470] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T20:17:09.212461] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-07T20:17:09.355410] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T20:17:09.356955] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-07T20:17:09.398368] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-07T20:17:09.409615] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-07T20:17:09.907637] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-07T20:17:09.909147] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-07T20:17:10.221263] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T20:17:10.225333] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-07T20:17:10.234913] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T20:17:10.238294] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-07T20:17:10.726881] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T20:17:10.728682] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-07T20:17:10.976900] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T20:17:10.979968] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-07T20:17:11.166312] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-07T20:17:11.170040] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-07T20:17:11.312622] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T20:17:11.313814] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-07T20:17:11.506164] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T20:17:11.517966] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-07T20:17:11.629754] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T20:17:11.634052] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-07T20:17:11.804385] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-07T20:17:11.805625] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-07T20:17:12.308396] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-07T20:17:12.309449] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-07T20:17:12.427756] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T20:17:12.431999] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-07T20:17:12.438833] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T20:17:12.441504] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-07T20:17:12.787113] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-07T20:17:12.788120] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-07T20:17:13.346017] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T20:17:13.348479] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-07T20:17:13.531776] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T20:17:13.533323] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-07T20:17:13.577200] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-07T20:17:13.587500] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-07T20:17:13.806422] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T20:17:13.812480] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-07T20:17:14.085244] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T20:17:14.086372] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-07T20:17:14.249515] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T20:17:14.251783] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-07T20:17:14.608206] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-07T20:17:14.609550] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-07T20:17:14.930370] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-07T20:17:14.931335] [INFO ] [REMOTE ] MSC: Full fetch complete (2536 records). [2025-10-07T20:17:14.931412] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-07T20:17:14.932109] [FATAL] [VALIDATOR ] MSC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:17:14.932203] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:17:14.932249] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:17:14.932301] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-07T20:17:14.932384] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-07T20:17:14.932496] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-07T20:17:14.932582] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-07T20:17:14.932702] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MSC took 7.1s. Estimated remaining: 2h 16m 17s. Rate: 7.1 symbols/min [2025-10-07T20:17:15.130177] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:15.152189] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-07T20:17:15.152019] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T20:17:15.153437] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T20:17:15.161331] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-07T20:17:15.162113] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-07T20:17:15.162458] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-07T20:17:15.161838] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-07T20:17:15.163611] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-07T20:17:15.164342] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-07T20:17:15.164435] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-07T20:17:15.573773] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:15.574178] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-07T20:17:15.632986] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-07T20:17:15.847697] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-07T20:17:16.123560] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T20:17:16.216871] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T20:17:16.647751] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-07T20:17:17.132913] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T20:17:17.447912] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-07T20:17:17.863671] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T20:17:18.173218] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-07T20:17:18.247753] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-07T20:17:18.970283] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T20:17:19.047710] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-07T20:17:19.847674] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-07T20:17:20.156329] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T20:17:20.477526] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-07T20:17:20.647735] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-07T20:17:21.447669] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-07T20:17:21.512669] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T20:17:22.247614] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-07T20:17:22.646937] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T20:17:22.670703] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T20:17:23.047681] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-07T20:17:23.847624] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-07T20:17:23.879005] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T20:17:24.410158] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T20:17:24.411565] [INFO ] [REMOTE ] MSA: Full fetch complete (25840 records). [2025-10-07T20:17:24.411669] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-07T20:17:24.412134] [FATAL] [VALIDATOR ] MSA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:17:24.412218] [FATAL] [MAIN ] MSA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:17:24.412262] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:17:24.412302] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-07T20:17:24.412363] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-07T20:17:24.412398] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-07T20:17:24.412607] [DEBUG] [LOCAL ] MSA: Deleted derivative data file. [2025-10-07T20:17:24.412736] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MSA took 19.1s. Estimated remaining: 2h 16m 9s. Rate: 7.1 symbols/min [2025-10-07T20:17:24.581304] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:24.581524] [DEBUG] [LOCAL ] MSD: No existing data file found in primary storage. [2025-10-07T20:17:24.581569] [WARN ] [MAIN ] MSD: No existing data found, performing full refresh instead. [2025-10-07T20:17:24.581703] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-07T20:17:24.581755] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-07T20:17:24.581800] [DEBUG] [LOCAL ] MSD: No primary data file found to delete. [2025-10-07T20:17:24.581832] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-07T20:17:24.652800] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-07T20:17:24.929310] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:25.361617] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-07T20:17:25.447597] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-07T20:17:25.593270] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T20:17:26.247695] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-07T20:17:26.710222] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T20:17:26.711266] [INFO ] [REMOTE ] MSB: Full fetch complete (12963 records). [2025-10-07T20:17:26.711339] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-07T20:17:26.711819] [FATAL] [VALIDATOR ] MSB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:17:26.711906] [FATAL] [MAIN ] MSB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:17:26.711948] [WARN ] [MAIN ] MSB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:17:26.711985] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-07T20:17:26.712068] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-07T20:17:26.712126] [INFO ] [LOCAL ] MSB: Starting deletion of derivative data. [2025-10-07T20:17:26.712322] [DEBUG] [LOCAL ] MSB: Deleted derivative data file. [2025-10-07T20:17:26.712412] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MSB took 21.4s. Estimated remaining: 2h 15m 56s. Rate: 7.1 symbols/min [2025-10-07T20:17:26.874926] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:26.921945] [DEBUG] [LOCAL ] MSDL: Loaded 38321 existing records from primary storage. [2025-10-07T20:17:26.922290] [INFO ] [MAIN ] MSDL: Loaded 38321 existing records. [2025-10-07T20:17:27.061095] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-07T20:17:27.100772] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:17:27.100937] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-07T20:17:27.100984] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-07T20:17:27.101223] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-07T20:17:27.101282] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-07T20:17:27.450848] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:27.538472] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-07T20:17:27.847728] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-07T20:17:28.593353] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T20:17:28.647606] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-07T20:17:28.754499] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T20:17:29.447725] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-07T20:17:30.121605] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T20:17:30.247602] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-07T20:17:30.515687] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T20:17:31.047695] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-07T20:17:31.714037] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T20:17:31.847695] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-07T20:17:32.647709] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-07T20:17:32.792149] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T20:17:33.257006] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-07T20:17:33.447691] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-07T20:17:34.033599] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T20:17:34.247686] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-07T20:17:34.518495] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T20:17:34.658852] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-07T20:17:34.662129] [INFO ] [REMOTE ] MS: Full fetch complete (77328 records). [2025-10-07T20:17:34.662268] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-07T20:17:34.663235] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:17:34.663349] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:17:34.663419] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:17:34.663497] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-07T20:17:34.663599] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-07T20:17:34.663687] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-07T20:17:34.663752] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-07T20:17:34.663820] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MS took 29.3s. Estimated remaining: 2h 15m 48s. Rate: 7.1 symbols/min [2025-10-07T20:17:34.835279] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:34.865764] [DEBUG] [LOCAL ] MSGE: Loaded 26923 existing records from primary storage. [2025-10-07T20:17:34.866080] [INFO ] [MAIN ] MSGE: Loaded 26923 existing records. [2025-10-07T20:17:35.052948] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:17:35.053593] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-07T20:17:35.053105] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-07T20:17:35.053758] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-07T20:17:35.054884] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-07T20:17:35.054953] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-07T20:17:35.414984] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:35.847605] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-07T20:17:36.158027] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-07T20:17:36.647715] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-07T20:17:37.447638] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-07T20:17:37.558758] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-07T20:17:37.697118] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T20:17:38.247697] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-07T20:17:38.945876] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T20:17:39.047718] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-07T20:17:39.318917] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T20:17:39.847679] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-07T20:17:40.310694] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T20:17:40.647721] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-07T20:17:41.447631] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-07T20:17:41.490602] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T20:17:42.114237] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T20:17:42.247709] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-07T20:17:43.047706] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-07T20:17:43.142527] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T20:17:43.341931] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T20:17:43.847707] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-07T20:17:44.338422] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T20:17:44.647763] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-07T20:17:45.447750] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-07T20:17:45.490127] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T20:17:46.106994] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T20:17:46.247625] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-07T20:17:46.829610] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:17:46.831831] [INFO ] [REMOTE ] MSCI: Full fetch complete (50291 records). [2025-10-07T20:17:46.831916] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-07T20:17:46.832550] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:17:46.832632] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:17:46.832717] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:17:46.832761] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-07T20:17:46.832827] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-07T20:17:46.832861] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-07T20:17:46.832901] [DEBUG] [LOCAL ] MSCI: No derivative data file found to delete. [2025-10-07T20:17:46.832956] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSCI took 31.9s. Estimated remaining: 2h 15m 42s. Rate: 7.1 symbols/min [2025-10-07T20:17:47.004212] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:17:47.022892] [DEBUG] [LOCAL ] MSGS: Loaded 17394 existing records from primary storage. [2025-10-07T20:17:47.023144] [INFO ] [MAIN ] MSGS: Loaded 17394 existing records. [2025-10-07T20:17:47.056672] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-07T20:17:47.223908] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:17:47.232488] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-07T20:17:47.232584] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-07T20:17:47.234235] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T20:17:47.234285] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-07T20:17:47.234465] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-07T20:17:47.593537] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:17:47.847683] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-07T20:17:48.531506] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T20:17:48.647704] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-07T20:17:48.691503] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T20:17:49.447687] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-07T20:17:49.917630] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-07T20:17:50.247625] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-07T20:17:50.394436] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T20:17:51.047700] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-07T20:17:51.467280] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T20:17:51.847705] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-07T20:17:52.545330] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T20:17:52.647709] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-07T20:17:52.746743] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T20:17:53.447698] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-07T20:17:53.862214] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T20:17:54.247709] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-07T20:17:54.560840] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T20:17:55.047701] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-07T20:17:55.600332] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T20:17:55.847742] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-07T20:17:56.355710] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T20:17:56.647748] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-07T20:17:57.447687] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-07T20:17:57.748219] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T20:17:57.788636] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T20:17:58.247687] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-07T20:17:58.478027] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T20:17:59.047688] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-07T20:17:59.847627] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-07T20:17:59.893020] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T20:18:00.192769] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T20:18:00.647686] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-07T20:18:00.936935] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T20:18:01.447750] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-07T20:18:02.062438] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T20:18:02.065158] [INFO ] [REMOTE ] MSDL: Full fetch complete (54922 records). [2025-10-07T20:18:02.065262] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-07T20:18:02.065894] [FATAL] [VALIDATOR ] MSDL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:18:02.065982] [FATAL] [MAIN ] MSDL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:18:02.066026] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:18:02.066093] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-07T20:18:02.066162] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-07T20:18:02.066197] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-07T20:18:02.066388] [DEBUG] [LOCAL ] MSDL: Deleted derivative data file. [2025-10-07T20:18:02.066512] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSDL took 35.4s. Estimated remaining: 2h 15m 38s. Rate: 7.1 symbols/min [2025-10-07T20:18:02.155266] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T20:18:02.257738] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-07T20:18:02.261035] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:02.261378] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-07T20:18:02.262402] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-07T20:18:02.262529] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-07T20:18:02.262573] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-07T20:18:02.262618] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-07T20:18:02.262678] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-07T20:18:02.617717] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:03.047713] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-07T20:18:03.250707] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T20:18:03.252959] [INFO ] [REMOTE ] MSD: Full fetch complete (22697 records). [2025-10-07T20:18:03.253040] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-07T20:18:03.716603] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T20:18:03.716723] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-07T20:18:03.716871] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-07T20:18:03.719473] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-07T20:18:03.719747] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-07T20:18:03.719971] [INFO ] [REMOTE ] MSGE: Full fetch complete (40039 records). [2025-10-07T20:18:03.720237] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-07T20:18:03.721089] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:18:03.721191] [DEBUG] [LOCAL ] MSD: Trimmed 22697 records to 16021 (keeping 200 days of data) [2025-10-07T20:18:03.721389] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:18:03.721820] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:18:03.722194] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-07T20:18:03.722311] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-07T20:18:03.722359] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-07T20:18:03.722680] [DEBUG] [LOCAL ] MSGE: Deleted derivative data file. [2025-10-07T20:18:03.722800] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSGE took 29.1s. Estimated remaining: 2h 15m 25s. Rate: 7.1 symbols/min [2025-10-07T20:18:03.866672] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-07T20:18:03.986907] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:03.987809] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-07T20:18:03.988154] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-07T20:18:03.990783] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-07T20:18:03.991426] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-07T20:18:03.992132] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-07T20:18:03.992855] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-07T20:18:04.381288] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:04.384688] [DEBUG] [LOCAL ] MSD: Primary data saved (16021 records). [2025-10-07T20:18:04.385050] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-07T20:18:04.385232] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSD took 40.0s. Estimated remaining: 2h 15m 11s. Rate: 7.1 symbols/min [2025-10-07T20:18:04.558669] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:04.596381] [DEBUG] [LOCAL ] MSM: Loaded 35586 existing records from primary storage. [2025-10-07T20:18:04.596715] [INFO ] [MAIN ] MSM: Loaded 35586 existing records. [2025-10-07T20:18:04.658100] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-07T20:18:04.783865] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:18:04.784294] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-07T20:18:04.784350] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-07T20:18:04.784987] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-07T20:18:04.785047] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-07T20:18:05.130635] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T20:18:05.172472] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:05.447722] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-07T20:18:06.247638] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-07T20:18:06.388888] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T20:18:06.545324] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:18:06.545782] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-07T20:18:06.545876] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:18:06.545924] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-07T20:18:06.545957] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:18:06.546028] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-07T20:18:06.546099] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-07T20:18:06.546134] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-07T20:18:06.546173] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-07T20:18:06.546221] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSIF took 2.8s. Estimated remaining: 2h 14m 58s. Rate: 7.1 symbols/min [2025-10-07T20:18:06.722935] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:06.735470] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T20:18:06.791349] [DEBUG] [LOCAL ] MT: Loaded 50558 existing records from primary storage. [2025-10-07T20:18:06.791766] [INFO ] [MAIN ] MT: Loaded 50558 existing records. [2025-10-07T20:18:06.971050] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:18:06.971324] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-07T20:18:06.971376] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-07T20:18:06.971718] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-07T20:18:06.971779] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-07T20:18:07.052748] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-07T20:18:07.338173] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:07.847745] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-07T20:18:08.647738] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-07T20:18:08.836543] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T20:18:09.447729] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-07T20:18:09.649639] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T20:18:09.803851] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T20:18:10.247690] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-07T20:18:10.774802] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T20:18:11.047731] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-07T20:18:11.433530] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T20:18:11.847804] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-07T20:18:12.647671] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-07T20:18:12.824208] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T20:18:13.411451] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T20:18:13.447604] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-07T20:18:13.720691] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T20:18:14.247725] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-07T20:18:15.024981] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T20:18:15.047628] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-07T20:18:15.847711] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-07T20:18:15.909367] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T20:18:16.647704] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-07T20:18:16.803434] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T20:18:17.180477] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T20:18:17.447720] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-07T20:18:18.039172] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T20:18:18.041078] [INFO ] [REMOTE ] MSGS: Full fetch complete (23159 records). [2025-10-07T20:18:18.041220] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-07T20:18:18.041880] [FATAL] [VALIDATOR ] MSGS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:18:18.042478] [FATAL] [MAIN ] MSGS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:18:18.042606] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:18:18.042740] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-07T20:18:18.042840] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-07T20:18:18.042901] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-07T20:18:18.043091] [DEBUG] [LOCAL ] MSGS: Deleted derivative data file. [2025-10-07T20:18:18.043231] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSGS took 31.2s. Estimated remaining: 2h 14m 52s. Rate: 7.1 symbols/min [2025-10-07T20:18:18.219397] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:18.249454] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-07T20:18:18.253308] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T20:18:18.298240] [DEBUG] [LOCAL ] MTAL: Loaded 36676 existing records from primary storage. [2025-10-07T20:18:18.298680] [INFO ] [MAIN ] MTAL: Loaded 36676 existing records. [2025-10-07T20:18:18.550691] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:18:18.550933] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-10-07T20:18:18.550982] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-07T20:18:18.551321] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-10-07T20:18:18.551381] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-10-07T20:18:18.949894] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:19.047661] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-10-07T20:18:19.847680] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-07T20:18:20.057332] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T20:18:20.189267] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T20:18:20.647720] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-10-07T20:18:21.447701] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-07T20:18:21.803840] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T20:18:21.921317] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T20:18:22.247716] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-07T20:18:23.047717] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-10-07T20:18:23.181978] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T20:18:23.847701] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-07T20:18:24.153369] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T20:18:24.390964] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T20:18:24.647721] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-10-07T20:18:25.349499] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T20:18:25.447698] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-07T20:18:26.153213] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T20:18:26.247667] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-10-07T20:18:26.749281] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T20:18:27.047690] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-07T20:18:27.745523] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T20:18:27.847710] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-07T20:18:28.647630] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-10-07T20:18:28.915476] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T20:18:29.447777] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-07T20:18:29.672220] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T20:18:30.139200] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T20:18:30.247749] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-07T20:18:30.771419] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T20:18:31.047753] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-07T20:18:31.847717] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-10-07T20:18:31.897171] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T20:18:32.647705] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-07T20:18:33.022507] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T20:18:33.080691] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T20:18:33.447684] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-10-07T20:18:34.247699] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-07T20:18:34.396047] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T20:18:34.639960] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T20:18:35.047770] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-07T20:18:35.847613] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-07T20:18:36.046459] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T20:18:36.459387] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T20:18:36.647766] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-07T20:18:37.447762] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-10-07T20:18:37.565807] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T20:18:38.247745] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-07T20:18:38.444472] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T20:18:38.906670] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T20:18:39.047709] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-10-07T20:18:39.847740] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-07T20:18:39.971982] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T20:18:40.515738] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T20:18:40.531556] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:18:40.534612] [INFO ] [REMOTE ] MT: Full fetch complete (73145 records). [2025-10-07T20:18:40.534796] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-07T20:18:40.535792] [FATAL] [VALIDATOR ] MT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:18:40.535885] [FATAL] [MAIN ] MT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:18:40.535934] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:18:40.536022] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-07T20:18:40.536109] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-07T20:18:40.536168] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-07T20:18:40.536611] [DEBUG] [LOCAL ] MT: Deleted derivative data file. [2025-10-07T20:18:40.536769] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MT took 34.0s. Estimated remaining: 2h 14m 53s. Rate: 7.1 symbols/min [2025-10-07T20:18:40.652734] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-07T20:18:40.710929] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:40.711154] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-07T20:18:40.711200] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-07T20:18:40.711315] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-07T20:18:40.711393] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-07T20:18:40.711463] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-07T20:18:40.711511] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-07T20:18:41.075777] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:41.447705] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-07T20:18:42.247636] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-07T20:18:42.503101] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T20:18:43.047753] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-10. [2025-10-07T20:18:43.372280] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T20:18:43.521409] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T20:18:43.847684] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-07T20:18:43.918236] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T20:18:43.923234] [INFO ] [REMOTE ] MTAL: Full fetch complete (47842 records). [2025-10-07T20:18:43.923353] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-10-07T20:18:43.924094] [FATAL] [VALIDATOR ] MTAL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:18:43.924187] [FATAL] [MAIN ] MTAL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:18:43.924230] [WARN ] [MAIN ] MTAL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:18:43.924269] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-07T20:18:43.924330] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-07T20:18:43.924366] [INFO ] [LOCAL ] MTAL: Starting deletion of derivative data. [2025-10-07T20:18:43.924676] [DEBUG] [LOCAL ] MTAL: Deleted derivative data file. [2025-10-07T20:18:43.924774] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MTAL took 25.9s. Estimated remaining: 2h 14m 41s. Rate: 7.1 symbols/min [2025-10-07T20:18:44.092499] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:44.092769] [DEBUG] [LOCAL ] MTD: No existing data file found in primary storage. [2025-10-07T20:18:44.092825] [WARN ] [MAIN ] MTD: No existing data found, performing full refresh instead. [2025-10-07T20:18:44.092942] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-07T20:18:44.092983] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-07T20:18:44.093025] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-07T20:18:44.093056] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-07T20:18:44.471231] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:18:44.478632] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:44.479718] [INFO ] [REMOTE ] MSM: Full fetch complete (51810 records). [2025-10-07T20:18:44.479860] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-07T20:18:44.480613] [FATAL] [VALIDATOR ] MSM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:18:44.480735] [FATAL] [MAIN ] MSM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:18:44.480817] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:18:44.480913] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-07T20:18:44.481001] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-07T20:18:44.481038] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-07T20:18:44.481198] [DEBUG] [LOCAL ] MSM: Deleted derivative data file. [2025-10-07T20:18:44.481294] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MSM took 40.1s. Estimated remaining: 2h 14m 28s. Rate: 7.1 symbols/min [2025-10-07T20:18:44.650929] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-07T20:18:44.650841] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:44.708710] [DEBUG] [LOCAL ] MTDR: Loaded 51594 existing records from primary storage. [2025-10-07T20:18:44.709110] [INFO ] [MAIN ] MTDR: Loaded 51594 existing records. [2025-10-07T20:18:44.893294] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:18:44.893549] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-07T20:18:44.893670] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-07T20:18:44.894186] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-07T20:18:44.894244] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-07T20:18:45.242401] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:45.447672] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-07T20:18:46.025697] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T20:18:46.247723] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-07T20:18:46.902968] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T20:18:47.047694] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-07T20:18:47.484577] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T20:18:47.615722] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:18:47.621922] [INFO ] [REMOTE ] MSI: Full fetch complete (57842 records). [2025-10-07T20:18:47.622191] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-07T20:18:47.623069] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:18:47.623166] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:18:47.623210] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:18:47.623263] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-07T20:18:47.623350] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-07T20:18:47.623387] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-07T20:18:47.623428] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-07T20:18:47.623500] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MSI took 45.6s. Estimated remaining: 2h 14m 16s. Rate: 7.1 symbols/min [2025-10-07T20:18:47.796218] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:18:47.848949] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-07T20:18:47.851047] [DEBUG] [LOCAL ] MTG: Loaded 51229 existing records from primary storage. [2025-10-07T20:18:47.851489] [INFO ] [MAIN ] MTG: Loaded 51229 existing records. [2025-10-07T20:18:48.032915] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:18:48.033180] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-07T20:18:48.033234] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-07T20:18:48.033630] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-07T20:18:48.033725] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-07T20:18:48.389667] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:18:48.647689] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-07T20:18:49.447755] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-07T20:18:49.597748] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T20:18:50.247707] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-07T20:18:50.417148] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T20:18:50.454559] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T20:18:51.047699] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-07T20:18:51.847717] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-07T20:18:52.062311] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T20:18:52.168737] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T20:18:52.647704] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-07T20:18:53.447626] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-07T20:18:53.487863] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T20:18:54.247734] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-07T20:18:54.387082] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T20:18:55.047743] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-07T20:18:55.205735] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T20:18:55.847790] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-07T20:18:56.000180] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T20:18:56.647677] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-07T20:18:56.918504] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T20:18:56.946623] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-07T20:18:57.447745] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-07T20:18:58.225244] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T20:18:58.247612] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-07T20:18:59.015660] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T20:18:59.047639] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-07T20:18:59.847728] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-07T20:19:00.199546] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T20:19:00.647635] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-07T20:19:01.114037] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-07T20:19:01.447626] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-07T20:19:01.758211] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T20:19:01.791859] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T20:19:02.247681] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-07T20:19:03.047636] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-07T20:19:03.410476] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T20:19:03.561546] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T20:19:03.847740] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-07T20:19:04.647720] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-07T20:19:04.867023] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T20:19:05.447725] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-07T20:19:05.604876] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T20:19:06.145207] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T20:19:06.247703] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-07T20:19:06.543958] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T20:19:07.047750] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-07T20:19:07.847628] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-07T20:19:08.154628] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-07T20:19:08.585672] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T20:19:08.647617] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-07T20:19:08.975573] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T20:19:09.447700] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-07T20:19:10.247737] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-07T20:19:10.417872] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T20:19:10.483250] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T20:19:11.047722] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-07T20:19:11.847620] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-07T20:19:12.074948] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T20:19:12.647711] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-07T20:19:12.799481] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T20:19:13.447696] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-07T20:19:13.731986] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T20:19:14.076999] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T20:19:14.247685] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-07T20:19:14.979376] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T20:19:15.047606] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-07T20:19:15.691217] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T20:19:15.693872] [INFO ] [REMOTE ] MTB: Full fetch complete (67666 records). [2025-10-07T20:19:15.693975] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-07T20:19:15.694968] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:19:15.695062] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:19:15.695107] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:19:15.695158] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-07T20:19:15.695274] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-07T20:19:15.695330] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-07T20:19:15.695374] [DEBUG] [LOCAL ] MTB: No derivative data file found to delete. [2025-10-07T20:19:15.695458] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTB took 35.2s. Estimated remaining: 2h 14m 20s. Rate: 7.1 symbols/min [2025-10-07T20:19:15.848965] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-07T20:19:15.867862] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:19:15.914680] [DEBUG] [LOCAL ] MTH: Loaded 43591 existing records from primary storage. [2025-10-07T20:19:15.914996] [INFO ] [MAIN ] MTH: Loaded 43591 existing records. [2025-10-07T20:19:16.165755] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:19:16.168134] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T20:19:16.168404] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-07T20:19:16.178555] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-07T20:19:16.179319] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-07T20:19:16.179414] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-07T20:19:16.570763] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:19:16.647669] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-07T20:19:17.447752] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-07T20:19:17.773611] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T20:19:18.190296] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T20:19:18.247625] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-07T20:19:18.323335] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T20:19:18.574594] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-07T20:19:18.577745] [INFO ] [REMOTE ] MTG: Full fetch complete (73673 records). [2025-10-07T20:19:18.577898] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-07T20:19:18.578796] [FATAL] [VALIDATOR ] MTG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:19:18.578891] [FATAL] [MAIN ] MTG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:19:18.578935] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:19:18.578974] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-07T20:19:18.579037] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-07T20:19:18.579073] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-07T20:19:18.579225] [DEBUG] [LOCAL ] MTG: Deleted derivative data file. [2025-10-07T20:19:18.579325] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTG took 31.0s. Estimated remaining: 2h 14m 8s. Rate: 7.1 symbols/min [2025-10-07T20:19:18.745604] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:19:18.787218] [DEBUG] [LOCAL ] MTN: Loaded 39160 existing records from primary storage. [2025-10-07T20:19:18.787590] [INFO ] [MAIN ] MTN: Loaded 39160 existing records. [2025-10-07T20:19:18.965308] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:19:18.965549] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-07T20:19:18.965595] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-07T20:19:18.966565] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-07T20:19:18.966624] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-07T20:19:19.052761] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-07T20:19:19.332947] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:19:19.847712] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-07T20:19:20.647738] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-07T20:19:20.878350] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T20:19:21.447671] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-07T20:19:21.620765] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T20:19:22.133885] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T20:19:22.135261] [INFO ] [REMOTE ] MTD: Full fetch complete (21046 records). [2025-10-07T20:19:22.135331] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-07T20:19:22.136021] [FATAL] [VALIDATOR ] MTD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:19:22.136148] [FATAL] [MAIN ] MTD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:19:22.136202] [WARN ] [MAIN ] MTD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:19:22.136242] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-07T20:19:22.136303] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-07T20:19:22.136338] [INFO ] [LOCAL ] MTD: Starting deletion of derivative data. [2025-10-07T20:19:22.136376] [DEBUG] [LOCAL ] MTD: No derivative data file found to delete. [2025-10-07T20:19:22.136444] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTD took 38.2s. Estimated remaining: 2h 13m 57s. Rate: 7.1 symbols/min [2025-10-07T20:19:22.247925] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-07T20:19:22.329923] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:19:22.330334] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-07T20:19:22.330541] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-07T20:19:22.330765] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-07T20:19:22.330837] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-07T20:19:22.330971] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-07T20:19:22.331124] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-07T20:19:22.456422] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T20:19:22.768512] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:19:22.830276] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:19:22.833369] [INFO ] [REMOTE ] MTDR: Full fetch complete (73308 records). [2025-10-07T20:19:22.833540] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-07T20:19:22.836753] [FATAL] [VALIDATOR ] MTDR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:19:22.836859] [FATAL] [MAIN ] MTDR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:19:22.836903] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:19:22.836944] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-07T20:19:22.837015] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-07T20:19:22.837090] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-07T20:19:22.837283] [DEBUG] [LOCAL ] MTDR: Deleted derivative data file. [2025-10-07T20:19:22.837386] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTDR took 38.4s. Estimated remaining: 2h 13m 43s. Rate: 7.1 symbols/min [2025-10-07T20:19:23.009281] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:19:23.028347] [DEBUG] [LOCAL ] MTRN: Loaded 18041 existing records from primary storage. [2025-10-07T20:19:23.028635] [INFO ] [MAIN ] MTRN: Loaded 18041 existing records. [2025-10-07T20:19:23.057602] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-07T20:19:23.213288] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:19:23.213548] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-07T20:19:23.213607] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-07T20:19:23.214154] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-10-07T20:19:23.214250] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-07T20:19:23.568269] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:19:23.847704] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-07T20:19:24.647635] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-07T20:19:24.822184] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T20:19:24.975710] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-07T20:19:25.208086] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-07T20:19:25.447707] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-07T20:19:26.247690] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-07T20:19:27.047737] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-07T20:19:27.284324] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T20:19:27.847709] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-07T20:19:27.977826] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T20:19:28.034593] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T20:19:28.647690] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-07T20:19:29.437062] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T20:19:29.450180] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-07T20:19:30.080315] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T20:19:30.247626] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-07T20:19:30.319923] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T20:19:31.047737] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-07T20:19:31.847679] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-07T20:19:31.919354] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T20:19:32.628619] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T20:19:32.647605] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-07T20:19:32.747084] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T20:19:33.447703] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-07T20:19:34.247705] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-07T20:19:34.388569] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T20:19:34.536858] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T20:19:35.047732] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-07T20:19:35.822574] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T20:19:35.847614] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-07T20:19:36.249331] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T20:19:36.647690] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-07T20:19:37.254294] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T20:19:37.447733] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-07T20:19:37.866790] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T20:19:38.247707] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-07T20:19:38.748313] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T20:19:39.047700] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-07T20:19:39.847684] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-07T20:19:39.937862] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T20:19:40.077181] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T20:19:40.647750] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-07T20:19:41.153858] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T20:19:41.447671] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-07T20:19:41.930518] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-07T20:19:42.247675] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-07T20:19:42.358562] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T20:19:43.047633] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-07T20:19:43.372807] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T20:19:43.508991] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-07T20:19:43.847724] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-07T20:19:44.647710] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-07T20:19:45.065840] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-07T20:19:45.084588] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-07T20:19:45.447720] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-07T20:19:46.247708] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-07T20:19:47.056191] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-07T20:19:47.074369] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T20:19:47.126802] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T20:19:47.847716] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-07T20:19:48.647749] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-07T20:19:48.874336] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-07T20:19:48.917981] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T20:19:49.198130] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T20:19:49.202193] [INFO ] [REMOTE ] MTN: Full fetch complete (56134 records). [2025-10-07T20:19:49.202482] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-07T20:19:49.203760] [FATAL] [VALIDATOR ] MTN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:19:49.203913] [FATAL] [MAIN ] MTN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:19:49.203995] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:19:49.204102] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-07T20:19:49.204203] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-07T20:19:49.204265] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-07T20:19:49.204703] [DEBUG] [LOCAL ] MTN: Deleted derivative data file. [2025-10-07T20:19:49.204857] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTN took 30.6s. Estimated remaining: 2h 13m 47s. Rate: 7.1 symbols/min [2025-10-07T20:19:49.392700] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:19:49.425875] [DEBUG] [LOCAL ] MTUS: Loaded 28073 existing records from primary storage. [2025-10-07T20:19:49.426315] [INFO ] [MAIN ] MTUS: Loaded 28073 existing records. [2025-10-07T20:19:49.452931] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-07T20:19:49.623723] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:19:49.624046] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-07T20:19:49.624100] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-07T20:19:49.624797] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-07T20:19:49.624860] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-07T20:19:49.997671] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:19:50.031214] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:19:50.032807] [INFO ] [REMOTE ] MTRN: Full fetch complete (23655 records). [2025-10-07T20:19:50.032880] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-07T20:19:50.033350] [FATAL] [VALIDATOR ] MTRN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:19:50.033434] [FATAL] [MAIN ] MTRN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:19:50.033477] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:19:50.033517] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-07T20:19:50.033579] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-07T20:19:50.033614] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-07T20:19:50.033830] [DEBUG] [LOCAL ] MTRN: Deleted derivative data file. [2025-10-07T20:19:50.033931] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTRN took 27.2s. Estimated remaining: 2h 13m 33s. Rate: 7.1 symbols/min [2025-10-07T20:19:50.208003] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:19:50.235314] [DEBUG] [LOCAL ] MTW: Loaded 26466 existing records from primary storage. [2025-10-07T20:19:50.235677] [INFO ] [MAIN ] MTW: Loaded 26466 existing records. [2025-10-07T20:19:50.255370] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-07T20:19:50.414168] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:19:50.414401] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-07T20:19:50.414451] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-07T20:19:50.415112] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-07T20:19:50.415172] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-07T20:19:50.756407] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:19:50.852980] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-07T20:19:51.047744] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-07T20:19:51.847722] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-07T20:19:52.318137] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T20:19:52.647729] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-07T20:19:52.775083] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T20:19:53.447764] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-07T20:19:54.041134] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T20:19:54.051869] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T20:19:54.056345] [INFO ] [REMOTE ] MTH: Full fetch complete (63002 records). [2025-10-07T20:19:54.056543] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-07T20:19:54.057701] [FATAL] [VALIDATOR ] MTH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:19:54.057798] [FATAL] [MAIN ] MTH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:19:54.057852] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:19:54.057936] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-07T20:19:54.058013] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-07T20:19:54.058054] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-07T20:19:54.058320] [DEBUG] [LOCAL ] MTH: Deleted derivative data file. [2025-10-07T20:19:54.058439] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTH took 38.4s. Estimated remaining: 2h 13m 22s. Rate: 7.1 symbols/min [2025-10-07T20:19:54.241372] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:19:54.247736] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-07T20:19:54.269595] [DEBUG] [LOCAL ] MTX: Loaded 22651 existing records from primary storage. [2025-10-07T20:19:54.269985] [INFO ] [MAIN ] MTX: Loaded 22651 existing records. [2025-10-07T20:19:54.457606] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:19:54.457976] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-07T20:19:54.458046] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-07T20:19:54.458751] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-07T20:19:54.458815] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-07T20:19:54.845306] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:19:55.047724] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-07T20:19:55.696168] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T20:19:55.847749] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-07T20:19:55.905930] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T20:19:56.647731] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-07T20:19:57.088121] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T20:19:57.369111] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T20:19:57.447684] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-07T20:19:58.247742] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-07T20:19:58.674713] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T20:19:58.905588] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T20:19:59.047737] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-07T20:19:59.847684] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-07T20:20:00.331632] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T20:20:00.647725] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-07T20:20:01.350480] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T20:20:01.447680] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-07T20:20:02.247714] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-07T20:20:03.047782] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-07T20:20:03.169889] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:20:03.473814] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-10-07T20:20:03.847727] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-07T20:20:04.140995] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T20:20:04.141859] [INFO ] [REMOTE ] MTR: Full fetch complete (2495 records). [2025-10-07T20:20:04.141952] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-07T20:20:04.142420] [FATAL] [VALIDATOR ] MTR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:20:04.142517] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:20:04.142562] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:20:04.142632] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-07T20:20:04.142785] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-07T20:20:04.142845] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-07T20:20:04.142891] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-07T20:20:04.142969] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTR took 42.0s. Estimated remaining: 2h 13m 14s. Rate: 7.1 symbols/min [2025-10-07T20:20:04.375213] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:20:04.377393] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-07T20:20:04.444053] [DEBUG] [LOCAL ] MTZ: Loaded 43058 existing records from primary storage. [2025-10-07T20:20:04.444529] [INFO ] [MAIN ] MTZ: Loaded 43058 existing records. [2025-10-07T20:20:04.652233] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-07T20:20:04.652162] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:20:04.654420] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-07T20:20:04.654530] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-07T20:20:04.655903] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-07T20:20:04.655976] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-07T20:20:05.003329] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T20:20:05.100746] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:20:05.447769] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-07T20:20:05.986393] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T20:20:06.247706] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-07T20:20:06.597313] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T20:20:07.047719] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-07T20:20:07.231583] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T20:20:07.847691] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-07T20:20:08.647689] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-07T20:20:08.813696] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T20:20:09.282724] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T20:20:09.447689] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-07T20:20:10.112060] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T20:20:10.247683] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-07T20:20:10.605181] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T20:20:11.047632] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-07T20:20:11.710840] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T20:20:11.847706] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-07T20:20:12.390021] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T20:20:12.647743] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-07T20:20:13.251424] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T20:20:13.447772] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-07T20:20:14.120574] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T20:20:14.247742] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-07T20:20:14.679404] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T20:20:15.047718] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-07T20:20:15.795816] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T20:20:15.847695] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-07T20:20:16.647637] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-07T20:20:16.727018] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T20:20:17.447634] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-07T20:20:17.789892] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-07T20:20:17.979571] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T20:20:18.247709] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-07T20:20:18.682209] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T20:20:18.728967] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:20:18.731711] [INFO ] [REMOTE ] MTUS: Full fetch complete (41823 records). [2025-10-07T20:20:18.731978] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-07T20:20:18.732941] [FATAL] [VALIDATOR ] MTUS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:20:18.733039] [FATAL] [MAIN ] MTUS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:20:18.733086] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:20:18.733134] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-07T20:20:18.733205] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-07T20:20:18.733243] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-07T20:20:18.733502] [DEBUG] [LOCAL ] MTUS: Deleted derivative data file. [2025-10-07T20:20:18.733614] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTUS took 29.5s. Estimated remaining: 2h 13m 10s. Rate: 7.1 symbols/min [2025-10-07T20:20:18.915686] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:20:18.933869] [DEBUG] [LOCAL ] MUA: Loaded 11964 existing records from primary storage. [2025-10-07T20:20:18.934193] [INFO ] [MAIN ] MUA: Loaded 11964 existing records. [2025-10-07T20:20:19.052874] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-07T20:20:19.126058] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:20:19.126389] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-07T20:20:19.126443] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-07T20:20:19.126922] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-07T20:20:19.127015] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-07T20:20:19.494876] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:20:19.847707] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-07T20:20:20.533128] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T20:20:20.647669] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-07T20:20:20.799083] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T20:20:21.447735] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-07T20:20:22.100153] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T20:20:22.247725] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-07T20:20:23.047688] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-07T20:20:23.178503] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T20:20:23.217321] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T20:20:23.730068] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T20:20:23.847730] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-07T20:20:24.647755] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-07T20:20:24.888362] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T20:20:25.447765] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-07T20:20:26.024180] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:20:26.025989] [INFO ] [REMOTE ] MTW: Full fetch complete (38177 records). [2025-10-07T20:20:26.026070] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-07T20:20:26.026554] [FATAL] [VALIDATOR ] MTW: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:20:26.026675] [FATAL] [MAIN ] MTW: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:20:26.026779] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:20:26.026874] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-07T20:20:26.026977] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-07T20:20:26.027034] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-07T20:20:26.027226] [DEBUG] [LOCAL ] MTW: Deleted derivative data file. [2025-10-07T20:20:26.027348] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTW took 36.0s. Estimated remaining: 2h 13m 1s. Rate: 7.1 symbols/min [2025-10-07T20:20:26.201040] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:20:26.222637] [DEBUG] [LOCAL ] MUC: Loaded 20520 existing records from primary storage. [2025-10-07T20:20:26.222945] [INFO ] [MAIN ] MUC: Loaded 20520 existing records. [2025-10-07T20:20:26.254347] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-07T20:20:26.408749] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:20:26.409075] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-07T20:20:26.409132] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-07T20:20:26.409821] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-07T20:20:26.409897] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-07T20:20:26.820048] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:20:26.824637] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-07T20:20:27.057688] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-07T20:20:27.060041] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T20:20:27.847708] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-07T20:20:28.389805] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T20:20:28.391674] [INFO ] [REMOTE ] MTX: Full fetch complete (31127 records). [2025-10-07T20:20:28.391791] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-07T20:20:28.392456] [FATAL] [VALIDATOR ] MTX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:20:28.392557] [FATAL] [MAIN ] MTX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:20:28.392604] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:20:28.392722] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-07T20:20:28.392826] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-07T20:20:28.392888] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-07T20:20:28.393073] [DEBUG] [LOCAL ] MTX: Deleted derivative data file. [2025-10-07T20:20:28.393176] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTX took 34.3s. Estimated remaining: 2h 12m 48s. Rate: 7.1 symbols/min [2025-10-07T20:20:28.579841] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:20:28.594907] [DEBUG] [LOCAL ] MUE: Loaded 11982 existing records from primary storage. [2025-10-07T20:20:28.595327] [INFO ] [MAIN ] MUE: Loaded 11982 existing records. [2025-10-07T20:20:28.654308] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-07T20:20:28.801459] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:20:28.801849] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-07T20:20:28.801974] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-07T20:20:28.802606] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-07T20:20:28.802830] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-07T20:20:28.994464] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T20:20:29.235604] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:20:29.447742] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-07T20:20:29.812679] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T20:20:30.247726] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-07T20:20:31.005052] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T20:20:31.047674] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-07T20:20:31.283222] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T20:20:31.847744] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-07T20:20:32.542636] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T20:20:32.647758] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-07T20:20:32.888022] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T20:20:33.447761] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-07T20:20:34.247627] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-07T20:20:34.319170] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T20:20:34.491776] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T20:20:35.047623] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-07T20:20:35.156121] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T20:20:35.847693] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-07T20:20:36.647695] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-07T20:20:36.702079] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T20:20:36.869569] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T20:20:37.447680] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-07T20:20:37.853774] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T20:20:38.247633] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-07T20:20:38.585145] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T20:20:39.047634] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-07T20:20:39.192229] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-07T20:20:39.847672] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-07T20:20:40.206150] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T20:20:40.647720] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-07T20:20:40.856311] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T20:20:41.447675] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-07T20:20:42.247622] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-07T20:20:42.361093] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T20:20:42.584263] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T20:20:43.051938] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T20:20:43.049720] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-07T20:20:43.847623] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-07T20:20:44.202167] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T20:20:44.647628] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-07T20:20:44.800363] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-07T20:20:45.447736] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-07T20:20:45.869839] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T20:20:46.177471] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T20:20:46.178951] [INFO ] [REMOTE ] MUA: Full fetch complete (18754 records). [2025-10-07T20:20:46.179049] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-07T20:20:46.253020] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-07T20:20:46.589210] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-07T20:20:46.589312] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-07T20:20:46.589821] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-07T20:20:46.589886] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-07T20:20:46.590484] [DEBUG] [LOCAL ] MUA: Trimmed 18754 records to 11831 (keeping 200 days of data) [2025-10-07T20:20:46.667491] [DEBUG] [LOCAL ] MUA: Primary data saved (11831 records). [2025-10-07T20:20:46.667711] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-07T20:20:46.667822] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MUA took 27.9s. Estimated remaining: 2h 12m 46s. Rate: 7.1 symbols/min [2025-10-07T20:20:46.831632] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:20:46.885494] [DEBUG] [LOCAL ] MUFG: Loaded 52522 existing records from primary storage. [2025-10-07T20:20:46.885890] [INFO ] [MAIN ] MUFG: Loaded 52522 existing records. [2025-10-07T20:20:47.055255] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-07T20:20:47.061203] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:20:47.061434] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-07T20:20:47.061484] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-07T20:20:47.062504] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-07T20:20:47.062564] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-07T20:20:47.343812] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T20:20:47.422431] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:20:47.847737] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-07T20:20:48.397151] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T20:20:48.647776] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-07T20:20:48.778204] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T20:20:49.447667] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-07T20:20:50.010542] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T20:20:50.100255] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T20:20:50.247738] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-07T20:20:51.047701] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-07T20:20:51.291281] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T20:20:51.292971] [INFO ] [REMOTE ] MUC: Full fetch complete (30132 records). [2025-10-07T20:20:51.293100] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-07T20:20:51.678598] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-07T20:20:51.678791] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-07T20:20:51.679444] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-07T20:20:51.679491] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-07T20:20:51.680510] [DEBUG] [LOCAL ] MUC: Trimmed 30132 records to 20533 (keeping 200 days of data) [2025-10-07T20:20:51.822663] [DEBUG] [LOCAL ] MUC: Primary data saved (20533 records). [2025-10-07T20:20:51.822780] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-07T20:20:51.822865] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUC took 25.8s. Estimated remaining: 2h 12m 36s. Rate: 7.1 symbols/min [2025-10-07T20:20:51.853053] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-07T20:20:51.990476] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:20:52.004821] [DEBUG] [LOCAL ] MUJ: Loaded 13605 existing records from primary storage. [2025-10-07T20:20:52.005077] [INFO ] [MAIN ] MUJ: Loaded 13605 existing records. [2025-10-07T20:20:52.182888] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:20:52.183225] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-07T20:20:52.183281] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-07T20:20:52.183857] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-07T20:20:52.183919] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-07T20:20:52.556756] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:20:52.647670] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-07T20:20:52.895262] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T20:20:53.447615] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-07T20:20:53.756077] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T20:20:53.834460] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T20:20:54.247718] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-07T20:20:55.047619] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-07T20:20:55.191925] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T20:20:55.401923] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T20:20:55.847696] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-07T20:20:56.021459] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T20:20:56.647629] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-07T20:20:56.710115] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T20:20:56.712767] [INFO ] [REMOTE ] MTZ: Full fetch complete (63065 records). [2025-10-07T20:20:56.712861] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-07T20:20:56.713637] [FATAL] [VALIDATOR ] MTZ: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:20:56.713742] [FATAL] [MAIN ] MTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:20:56.713785] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:20:56.713825] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-07T20:20:56.713890] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-07T20:20:56.713924] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-07T20:20:56.714133] [DEBUG] [LOCAL ] MTZ: Deleted derivative data file. [2025-10-07T20:20:56.714234] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MTZ took 52.6s. Estimated remaining: 2h 12m 25s. Rate: 7.1 symbols/min [2025-10-07T20:20:56.880935] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:20:56.932471] [DEBUG] [LOCAL ] MUR: Loaded 52925 existing records from primary storage. [2025-10-07T20:20:56.932840] [INFO ] [MAIN ] MUR: Loaded 52925 existing records. [2025-10-07T20:20:57.134812] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:20:57.135076] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-07T20:20:57.135133] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-07T20:20:57.136412] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-07T20:20:57.136474] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-07T20:20:57.456485] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-07T20:20:57.501837] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:20:58.247696] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-07T20:20:58.477613] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T20:20:58.646358] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-07T20:20:59.047713] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-07T20:20:59.711262] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T20:20:59.847669] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-07T20:21:00.647781] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-07T20:21:01.375769] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-07T20:21:01.455485] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-07T20:21:01.461813] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T20:21:01.900899] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T20:21:02.165248] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T20:21:02.247752] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-07T20:21:03.047703] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-07T20:21:03.804149] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T20:21:03.805349] [INFO ] [REMOTE ] MUE: Full fetch complete (15966 records). [2025-10-07T20:21:03.805422] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-07T20:21:03.849572] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-07T20:21:04.185003] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-07T20:21:04.185132] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-07T20:21:04.185501] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-07T20:21:04.185632] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-07T20:21:04.186325] [DEBUG] [LOCAL ] MUE: Trimmed 15966 records to 11979 (keeping 200 days of data) [2025-10-07T20:21:04.279938] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T20:21:04.305502] [DEBUG] [LOCAL ] MUE: Primary data saved (11979 records). [2025-10-07T20:21:04.305625] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-07T20:21:04.305737] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 35.9s. Estimated remaining: 2h 12m 16s. Rate: 7.1 symbols/min [2025-10-07T20:21:04.504894] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:21:04.527992] [DEBUG] [LOCAL ] MUSA: Loaded 24719 existing records from primary storage. [2025-10-07T20:21:04.528257] [INFO ] [MAIN ] MUSA: Loaded 24719 existing records. [2025-10-07T20:21:04.652709] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-07T20:21:04.704934] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:21:04.705572] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-07T20:21:04.705708] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-07T20:21:04.713536] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-07T20:21:04.714559] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T20:21:04.717162] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-07T20:21:05.072170] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:21:05.447729] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-07T20:21:06.247685] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-07T20:21:06.382181] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T20:21:06.701055] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T20:21:07.047750] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-07T20:21:07.439140] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T20:21:07.847681] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-07T20:21:08.025476] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T20:21:08.647708] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-07T20:21:09.447704] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-07T20:21:09.792314] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-07T20:21:10.247664] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-07T20:21:10.346010] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T20:21:10.735219] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T20:21:11.047737] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-07T20:21:11.847709] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-07T20:21:12.023709] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T20:21:12.292148] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T20:21:12.647637] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-07T20:21:13.182720] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T20:21:13.447692] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-07T20:21:14.247616] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-07T20:21:14.518158] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-07T20:21:14.737843] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T20:21:15.047739] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-07T20:21:15.847676] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-07T20:21:16.164689] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T20:21:16.341451] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-07T20:21:16.647624] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-07T20:21:16.996075] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T20:21:17.447669] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-07T20:21:18.247734] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-07T20:21:18.482076] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T20:21:18.980243] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T20:21:19.047663] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-07T20:21:19.326139] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T20:21:19.847707] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-07T20:21:20.373869] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-07T20:21:20.647731] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-07T20:21:21.447697] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-07T20:21:21.471745] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T20:21:21.984201] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-07T20:21:22.247744] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-07T20:21:22.891047] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T20:21:23.047733] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-07T20:21:23.847685] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-07T20:21:24.079707] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T20:21:24.140031] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T20:21:24.647701] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-07T20:21:25.447704] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-07T20:21:25.556287] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T20:21:25.558392] [INFO ] [REMOTE ] MUJ: Full fetch complete (20292 records). [2025-10-07T20:21:25.558584] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-07T20:21:25.748433] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T20:21:26.014520] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-07T20:21:26.014700] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-07T20:21:26.015272] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-07T20:21:26.015335] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-07T20:21:26.016417] [DEBUG] [LOCAL ] MUJ: Trimmed 20292 records to 13668 (keeping 200 days of data) [2025-10-07T20:21:26.120124] [DEBUG] [LOCAL ] MUJ: Primary data saved (13668 records). [2025-10-07T20:21:26.120323] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-07T20:21:26.120468] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUJ took 34.3s. Estimated remaining: 2h 12m 16s. Rate: 7.1 symbols/min [2025-10-07T20:21:26.252806] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-07T20:21:26.308406] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:21:26.308687] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-07T20:21:26.308757] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-07T20:21:26.308916] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-07T20:21:26.308981] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-07T20:21:26.309040] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-07T20:21:26.309087] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-07T20:21:26.685307] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:21:27.047740] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-07T20:21:27.442737] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-07T20:21:27.492724] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-07T20:21:27.847630] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-07T20:21:28.292175] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T20:21:28.647756] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-07T20:21:28.993315] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:21:28.993687] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-07T20:21:28.993813] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:21:28.993936] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-07T20:21:28.994019] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:21:28.994140] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-07T20:21:28.994224] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-07T20:21:28.994265] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-07T20:21:28.994322] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-07T20:21:28.994395] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUSE took 2.9s. Estimated remaining: 2h 12m 4s. Rate: 7.1 symbols/min [2025-10-07T20:21:29.163158] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:21:29.204608] [DEBUG] [LOCAL ] MUX: Loaded 42939 existing records from primary storage. [2025-10-07T20:21:29.204963] [INFO ] [MAIN ] MUX: Loaded 42939 existing records. [2025-10-07T20:21:29.380418] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:21:29.380666] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-07T20:21:29.380739] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-07T20:21:29.381704] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-10-07T20:21:29.381770] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-07T20:21:29.455725] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-07T20:21:29.746126] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:21:29.845158] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T20:21:30.247723] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-07T20:21:30.702269] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T20:21:31.047695] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-07T20:21:31.719133] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T20:21:31.722536] [INFO ] [REMOTE ] MUFG: Full fetch complete (75195 records). [2025-10-07T20:21:31.722718] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-07T20:21:31.723523] [FATAL] [VALIDATOR ] MUFG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:21:31.723632] [FATAL] [MAIN ] MUFG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:21:31.723739] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:21:31.723831] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-07T20:21:31.723914] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-07T20:21:31.723954] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-07T20:21:31.724167] [DEBUG] [LOCAL ] MUFG: Deleted derivative data file. [2025-10-07T20:21:31.724282] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUFG took 45.1s. Estimated remaining: 2h 11m 52s. Rate: 7.1 symbols/min [2025-10-07T20:21:31.860632] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-07T20:21:31.894777] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:21:31.909270] [DEBUG] [LOCAL ] MVF: Loaded 13103 existing records from primary storage. [2025-10-07T20:21:31.909633] [INFO ] [MAIN ] MVF: Loaded 13103 existing records. [2025-10-07T20:21:32.094035] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:21:32.094427] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-07T20:21:32.094587] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-07T20:21:32.095229] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-07T20:21:32.095294] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-07T20:21:32.478953] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-07T20:21:32.493149] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:21:32.647670] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-07T20:21:33.183732] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T20:21:33.447708] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-07T20:21:33.836830] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T20:21:33.916051] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T20:21:33.919745] [INFO ] [REMOTE ] MUR: Full fetch complete (76160 records). [2025-10-07T20:21:33.919864] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-07T20:21:33.920583] [FATAL] [VALIDATOR ] MUR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:21:33.920710] [FATAL] [MAIN ] MUR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:21:33.920785] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:21:33.920880] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-07T20:21:33.920985] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-07T20:21:33.921035] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-07T20:21:33.921197] [DEBUG] [LOCAL ] MUR: Deleted derivative data file. [2025-10-07T20:21:33.921301] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUR took 37.2s. Estimated remaining: 2h 11m 40s. Rate: 7.1 symbols/min [2025-10-07T20:21:34.090763] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:21:34.103869] [DEBUG] [LOCAL ] MVO: Loaded 8813 existing records from primary storage. [2025-10-07T20:21:34.104086] [INFO ] [MAIN ] MVO: Loaded 8813 existing records. [2025-10-07T20:21:34.252732] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-07T20:21:34.292565] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:21:34.292798] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-07T20:21:34.292855] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-07T20:21:34.293240] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-07T20:21:34.293301] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-07T20:21:34.653879] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:21:35.047729] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-07T20:21:35.497924] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-07T20:21:35.499497] [INFO ] [REMOTE ] MUSA: Full fetch complete (34982 records). [2025-10-07T20:21:35.499580] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-07T20:21:35.500098] [FATAL] [VALIDATOR ] MUSA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:21:35.500185] [FATAL] [MAIN ] MUSA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:21:35.500229] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:21:35.500267] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-07T20:21:35.500370] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-07T20:21:35.500427] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-07T20:21:35.500615] [DEBUG] [LOCAL ] MUSA: Deleted derivative data file. [2025-10-07T20:21:35.500743] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUSA took 31.2s. Estimated remaining: 2h 11m 27s. Rate: 7.1 symbols/min [2025-10-07T20:21:35.675160] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:21:35.686962] [DEBUG] [LOCAL ] MVT: Loaded 10263 existing records from primary storage. [2025-10-07T20:21:35.687238] [INFO ] [MAIN ] MVT: Loaded 10263 existing records. [2025-10-07T20:21:35.851159] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-07T20:21:35.876796] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:21:35.878555] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-07T20:21:35.878759] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-07T20:21:35.895800] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-07T20:21:35.900146] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T20:21:35.898447] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-07T20:21:36.277066] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:21:36.647731] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-07T20:21:37.000704] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T20:21:37.447731] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-07T20:21:37.767834] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T20:21:38.247752] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-07T20:21:38.591979] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T20:21:39.047629] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-07T20:21:39.104913] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-07T20:21:39.678386] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T20:21:39.847598] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-07T20:21:40.558051] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T20:21:40.647680] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-07T20:21:41.447678] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-07T20:21:41.588393] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T20:21:42.247730] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-07T20:21:42.541350] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T20:21:42.905161] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-07T20:21:43.047694] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-07T20:21:43.847688] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-07T20:21:43.940292] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T20:21:44.647755] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-07T20:21:45.426681] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T20:21:45.442253] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T20:21:45.447585] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-07T20:21:46.247634] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-07T20:21:46.325373] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T20:21:47.047619] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-07T20:21:47.105011] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T20:21:47.847718] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-07T20:21:48.088408] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T20:21:48.647628] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-07T20:21:48.805595] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T20:21:49.447698] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-07T20:21:50.247674] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-07T20:21:50.391574] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T20:21:50.451348] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T20:21:51.047676] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-07T20:21:51.186131] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T20:21:51.847681] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-07T20:21:52.658091] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-07T20:21:52.663868] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T20:21:52.799616] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-07T20:21:53.447673] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-07T20:21:53.467298] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T20:21:54.233594] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T20:21:54.234961] [INFO ] [REMOTE ] MVT: Full fetch complete (14415 records). [2025-10-07T20:21:54.235060] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-07T20:21:54.252727] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-07T20:21:54.604682] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-07T20:21:54.604775] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-07T20:21:54.605162] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-07T20:21:54.605203] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-07T20:21:54.605709] [DEBUG] [LOCAL ] MVT: Trimmed 14415 records to 10279 (keeping 200 days of data) [2025-10-07T20:21:54.670907] [DEBUG] [LOCAL ] MVT: Primary data saved (10279 records). [2025-10-07T20:21:54.671052] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-07T20:21:54.671137] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MVT took 19.2s. Estimated remaining: 2h 11m 25s. Rate: 7.1 symbols/min [2025-10-07T20:21:54.833932] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:21:54.879948] [DEBUG] [LOCAL ] MWA: Loaded 46357 existing records from primary storage. [2025-10-07T20:21:54.880278] [INFO ] [MAIN ] MWA: Loaded 46357 existing records. [2025-10-07T20:21:55.058583] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-07T20:21:55.065861] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:21:55.067006] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-07T20:21:55.067063] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-07T20:21:55.068234] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-07T20:21:55.068305] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-07T20:21:55.392753] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T20:21:55.492368] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:21:55.847695] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-07T20:21:56.647633] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-07T20:21:56.780408] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T20:21:56.929069] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T20:21:57.447618] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-07T20:21:57.818117] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T20:21:58.253366] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-07T20:21:58.255050] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T20:21:59.047675] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-07T20:21:59.847705] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-07T20:21:59.966289] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T20:22:00.014906] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T20:22:00.647768] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-07T20:22:00.731934] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T20:22:01.447702] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-07T20:22:02.247712] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-07T20:22:02.301477] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T20:22:02.568026] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-07T20:22:02.569074] [INFO ] [REMOTE ] MVO: Full fetch complete (14344 records). [2025-10-07T20:22:02.569161] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-07T20:22:02.569609] [FATAL] [VALIDATOR ] MVO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:22:02.569730] [FATAL] [MAIN ] MVO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:22:02.569802] [WARN ] [MAIN ] MVO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:22:02.569874] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-07T20:22:02.569942] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-07T20:22:02.569976] [INFO ] [LOCAL ] MVO: Starting deletion of derivative data. [2025-10-07T20:22:02.570209] [DEBUG] [LOCAL ] MVO: Deleted derivative data file. [2025-10-07T20:22:02.570308] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MVO took 28.6s. Estimated remaining: 2h 11m 16s. Rate: 7.1 symbols/min [2025-10-07T20:22:03.047668] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-07T20:22:03.227132] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T20:22:03.847686] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-07T20:22:04.653762] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-07T20:22:04.656348] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T20:22:05.447613] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-07T20:22:05.635744] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T20:22:05.656692] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T20:22:06.247702] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-07T20:22:07.047685] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-07T20:22:07.202745] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T20:22:07.847726] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-07T20:22:08.111840] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T20:22:08.163389] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T20:22:08.647698] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-07T20:22:09.452805] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-07T20:22:09.471141] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T20:22:10.248976] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-07T20:22:10.254342] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T20:22:10.432169] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T20:22:11.047730] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-07T20:22:11.847772] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-07T20:22:12.232546] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-07T20:22:12.254286] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T20:22:12.647751] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-07T20:22:13.409207] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T20:22:13.412275] [INFO ] [REMOTE ] MUX: Full fetch complete (59364 records). [2025-10-07T20:22:13.412377] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-07T20:22:13.413436] [FATAL] [VALIDATOR ] MUX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:22:13.413523] [FATAL] [MAIN ] MUX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:22:13.413565] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:22:13.413634] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-07T20:22:13.413740] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-07T20:22:13.413780] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-07T20:22:13.413960] [DEBUG] [LOCAL ] MUX: Deleted derivative data file. [2025-10-07T20:22:13.414058] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MUX took 44.4s. Estimated remaining: 2h 11m 10s. Rate: 7.1 symbols/min [2025-10-07T20:22:13.447690] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-07T20:22:13.672927] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T20:22:14.080266] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:22:14.081794] [INFO ] [REMOTE ] MVF: Full fetch complete (18839 records). [2025-10-07T20:22:14.081865] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-07T20:22:14.255321] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-07T20:22:14.463930] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-07T20:22:14.464020] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-07T20:22:14.464422] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-07T20:22:14.464462] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-07T20:22:14.465028] [DEBUG] [LOCAL ] MVF: Trimmed 18839 records to 13069 (keeping 200 days of data) [2025-10-07T20:22:14.544710] [DEBUG] [LOCAL ] MVF: Primary data saved (13069 records). [2025-10-07T20:22:14.544861] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-07T20:22:14.544948] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVF took 42.8s. Estimated remaining: 2h 10m 56s. Rate: 7.1 symbols/min [2025-10-07T20:22:16.038172] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T20:22:16.048327] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-07T20:22:17.844943] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T20:22:17.856193] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-07T20:22:19.532891] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T20:22:19.543159] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-07T20:22:21.302082] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T20:22:21.311438] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-07T20:22:21.966058] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:22:21.969135] [INFO ] [REMOTE ] MWA: Full fetch complete (67356 records). [2025-10-07T20:22:21.969303] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-07T20:22:21.970327] [FATAL] [VALIDATOR ] MWA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:22:21.970452] [FATAL] [MAIN ] MWA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:22:21.970520] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:22:21.970626] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-07T20:22:21.970771] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-07T20:22:21.970851] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-07T20:22:21.971131] [DEBUG] [LOCAL ] MWA: Deleted derivative data file. [2025-10-07T20:22:21.971238] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MWA took 27.3s. Estimated remaining: 2h 10m 47s. Rate: 7.1 symbols/min [2025-10-07T20:22:22.613175] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:22:22.706723] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:22:22.700210] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:22:22.726233] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:22:22.726920] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-07T20:22:22.728222] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-07T20:22:22.728781] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-07T20:22:22.729399] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-07T20:22:22.729560] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-07T20:22:22.729621] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-07T20:22:22.839764] [DEBUG] [LOCAL ] MXF: Loaded 5678 existing records from primary storage. [2025-10-07T20:22:22.872050] [DEBUG] [LOCAL ] MYD: Loaded 13443 existing records from primary storage. [2025-10-07T20:22:22.872922] [INFO ] [MAIN ] MXF: Loaded 5678 existing records. [2025-10-07T20:22:22.886768] [DEBUG] [LOCAL ] MX: Loaded 22461 existing records from primary storage. [2025-10-07T20:22:22.892349] [INFO ] [MAIN ] MYD: Loaded 13443 existing records. [2025-10-07T20:22:22.917757] [INFO ] [MAIN ] MX: Loaded 22461 existing records. [2025-10-07T20:22:23.533937] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:22:23.585069] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-07T20:22:23.621072] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-07T20:22:23.628227] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:22:23.652975] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-07T20:22:23.652795] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-07T20:22:23.663679] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-07T20:22:23.712230] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:22:23.682982] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-07T20:22:23.776525] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-07T20:22:23.776260] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-07T20:22:23.808338] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-07T20:22:23.825059] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-07T20:22:23.884047] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:22:23.926493] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-07T20:22:23.926637] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-07T20:22:23.969048] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-07T20:22:24.783304] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T20:22:24.838804] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:22:24.866099] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-07T20:22:24.867468] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-07T20:22:24.912263] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:22:24.956851] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-07T20:22:24.979696] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:22:24.980053] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-07T20:22:25.494324] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T20:22:25.495617] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-07T20:22:25.912472] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T20:22:25.915082] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-07T20:22:25.938098] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-07T20:22:25.943035] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-07T20:22:26.046318] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T20:22:26.047426] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-07T20:22:26.063252] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T20:22:26.067904] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-07T20:22:26.549351] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-07T20:22:26.550409] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-07T20:22:26.706433] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T20:22:26.783243] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T20:22:26.883047] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T20:22:27.047695] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-07T20:22:27.177552] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-07T20:22:27.806278] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T20:22:27.847620] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-07T20:22:28.647696] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-07T20:22:29.162145] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T20:22:29.447680] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-07T20:22:29.736485] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T20:22:29.915003] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T20:22:30.247782] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-07T20:22:31.047696] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-07T20:22:31.546911] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T20:22:31.745905] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T20:22:31.847714] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-07T20:22:32.647782] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-07T20:22:33.140193] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T20:22:33.447676] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-07T20:22:33.748250] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:22:34.009158] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T20:22:34.247682] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-07T20:22:35.047630] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-07T20:22:35.130002] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T20:22:35.847705] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-07T20:22:36.024888] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T20:22:36.515783] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-07T20:22:36.647736] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-07T20:22:37.447637] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-07T20:22:37.518479] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T20:22:38.247631] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-07T20:22:38.336415] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T20:22:39.047730] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-07T20:22:39.152898] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-07T20:22:39.847620] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-07T20:22:39.917514] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T20:22:40.647664] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-07T20:22:40.882045] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T20:22:41.137481] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T20:22:41.447729] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-07T20:22:42.247702] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-07T20:22:42.349232] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T20:22:42.821133] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-07T20:22:43.047720] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-07T20:22:43.813425] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T20:22:43.847668] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-07T20:22:44.641714] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T20:22:44.647598] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-07T20:22:45.269330] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T20:22:45.447683] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-07T20:22:46.012902] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T20:22:46.247690] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-07T20:22:46.852968] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T20:22:47.047765] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-07T20:22:47.847786] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-07T20:22:47.951281] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-07T20:22:48.286916] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-07T20:22:48.647693] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-07T20:22:49.447771] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-07T20:22:50.054565] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T20:22:50.247694] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-07T20:22:50.334402] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T20:22:50.335818] [INFO ] [REMOTE ] MYD: Full fetch complete (20680 records). [2025-10-07T20:22:50.335905] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-07T20:22:50.707424] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-07T20:22:50.707549] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-07T20:22:50.708072] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-07T20:22:50.708136] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-07T20:22:50.708741] [DEBUG] [LOCAL ] MYD: Trimmed 20680 records to 13349 (keeping 200 days of data) [2025-10-07T20:22:50.775445] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T20:22:50.777924] [INFO ] [REMOTE ] MXF: Full fetch complete (10145 records). [2025-10-07T20:22:50.778330] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-07T20:22:51.049406] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-07T20:22:51.187941] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-07T20:22:51.188325] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-07T20:22:51.189026] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-07T20:22:51.189411] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-07T20:22:51.191399] [DEBUG] [LOCAL ] MXF: Trimmed 10145 records to 5662 (keeping 200 days of data) [2025-10-07T20:22:51.224984] [DEBUG] [LOCAL ] MYD: Primary data saved (13349 records). [2025-10-07T20:22:51.226179] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-07T20:22:51.226889] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MYD took 29.2s. Estimated remaining: 2h 10m 52s. Rate: 7.1 symbols/min [2025-10-07T20:22:51.398498] [DEBUG] [LOCAL ] MXF: Primary data saved (5662 records). [2025-10-07T20:22:51.418471] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-07T20:22:51.418365] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:22:51.419147] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MXF took 29.4s. Estimated remaining: 2h 10m 39s. Rate: 7.1 symbols/min [2025-10-07T20:22:51.623675] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:22:51.625958] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:22:51.627243] [DEBUG] [LOCAL ] MYE: Loaded 24450 existing records from primary storage. [2025-10-07T20:22:51.628575] [INFO ] [REMOTE ] MXE: Full fetch complete (2643 records). [2025-10-07T20:22:51.629298] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-07T20:22:51.628997] [INFO ] [MAIN ] MYE: Loaded 24450 existing records. [2025-10-07T20:22:51.851587] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-07T20:22:51.921068] [DEBUG] [LOCAL ] MYI: Loaded 19192 existing records from primary storage. [2025-10-07T20:22:51.945628] [INFO ] [MAIN ] MYI: Loaded 19192 existing records. [2025-10-07T20:22:51.952967] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T20:22:51.958723] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:22:51.990712] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:22:52.019828] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-07T20:22:52.059321] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-07T20:22:52.085757] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-07T20:22:52.145776] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:22:52.146107] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-07T20:22:52.146331] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MXE took 30.2s. Estimated remaining: 2h 10m 25s. Rate: 7.1 symbols/min [2025-10-07T20:22:52.207301] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-07T20:22:52.240339] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-07T20:22:52.285366] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:22:52.285621] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-07T20:22:52.285724] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-07T20:22:52.295548] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-07T20:22:52.295606] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-07T20:22:52.300958] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-07T20:22:52.307512] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-07T20:22:52.639383] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:22:52.974394] [DEBUG] [LOCAL ] MYN: Loaded 9928 existing records from primary storage. [2025-10-07T20:22:52.991474] [INFO ] [MAIN ] MYN: Loaded 9928 existing records. [2025-10-07T20:22:53.542698] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:22:53.599833] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-07T20:22:53.599473] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:22:53.612249] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-07T20:22:53.717358] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:22:53.718414] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-07T20:22:53.718530] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-07T20:22:53.719102] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-07T20:22:53.719269] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-07T20:22:54.075995] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:22:54.247695] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-07T20:23:04.948272] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (10.70 seconds). [2025-10-07T20:23:04.953127] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-07T20:23:06.506148] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (14.65 seconds). [2025-10-07T20:23:06.512049] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-07T20:23:06.580220] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (12.98 seconds). [2025-10-07T20:23:06.586908] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-07T20:23:06.799253] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T20:23:06.801161] [INFO ] [REMOTE ] MX: Full fetch complete (31610 records). [2025-10-07T20:23:06.801318] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-07T20:23:06.802108] [FATAL] [VALIDATOR ] MX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:23:06.802203] [FATAL] [MAIN ] MX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:23:06.802276] [WARN ] [MAIN ] MX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:23:06.802350] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-07T20:23:06.802423] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-07T20:23:06.802461] [INFO ] [LOCAL ] MX: Starting deletion of derivative data. [2025-10-07T20:23:06.802682] [DEBUG] [LOCAL ] MX: Deleted derivative data file. [2025-10-07T20:23:06.802787] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MX took 44.8s. Estimated remaining: 2h 10m 21s. Rate: 7.1 symbols/min [2025-10-07T20:23:06.956975] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (13.34 seconds). [2025-10-07T20:23:06.979211] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-07T20:23:07.049628] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:23:07.090711] [DEBUG] [LOCAL ] NABL: Loaded 39223 existing records from primary storage. [2025-10-07T20:23:07.091095] [INFO ] [MAIN ] NABL: Loaded 39223 existing records. [2025-10-07T20:23:07.272130] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:23:07.272378] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-07T20:23:07.272426] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-07T20:23:07.272765] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-07T20:23:07.272823] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-07T20:23:07.622231] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:23:07.622581] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-07T20:23:07.963710] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-10-07T20:23:07.967162] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-07T20:23:08.033507] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T20:23:08.038624] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-07T20:23:08.431333] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T20:23:08.436676] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-07T20:23:09.058233] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T20:23:09.061424] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-07T20:23:09.428474] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T20:23:09.438223] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-07T20:23:09.451532] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T20:23:09.456856] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-07T20:23:09.742349] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T20:23:09.747523] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-07T20:23:09.843390] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-07T20:23:09.846548] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-07T20:23:10.654190] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T20:23:10.659241] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-07T20:23:10.811486] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T20:23:10.814316] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-07T20:23:10.989329] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T20:23:10.997851] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-07T20:23:11.063894] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T20:23:11.072379] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-07T20:23:11.483871] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T20:23:11.486529] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-07T20:23:12.012481] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T20:23:12.018693] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-07T20:23:12.333152] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T20:23:12.340076] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-07T20:23:12.433888] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T20:23:12.437155] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-07T20:23:12.521949] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T20:23:12.532832] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-07T20:23:13.107016] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T20:23:13.110897] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-07T20:23:13.305715] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T20:23:13.447609] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-07T20:23:13.477339] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T20:23:14.006930] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T20:23:14.228863] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T20:23:14.247593] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-07T20:23:14.848463] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T20:23:15.047712] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-07T20:23:15.847697] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-07T20:23:15.990589] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T20:23:16.276546] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T20:23:16.647708] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-07T20:23:16.783025] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T20:23:17.447701] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-07T20:23:18.247747] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-07T20:23:18.397714] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T20:23:18.701300] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T20:23:18.928805] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-07T20:23:19.047699] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-07T20:23:19.847695] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-07T20:23:20.371791] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T20:23:20.517906] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T20:23:20.519067] [INFO ] [REMOTE ] MYN: Full fetch complete (15318 records). [2025-10-07T20:23:20.519136] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-07T20:23:20.657331] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-07T20:23:20.883291] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-07T20:23:20.883383] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-07T20:23:20.883785] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-07T20:23:20.883847] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-07T20:23:20.884323] [DEBUG] [LOCAL ] MYN: Trimmed 15318 records to 9982 (keeping 200 days of data) [2025-10-07T20:23:20.945847] [DEBUG] [LOCAL ] MYN: Primary data saved (9982 records). [2025-10-07T20:23:20.945982] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-07T20:23:20.946067] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYN took 28.8s. Estimated remaining: 2h 10m 16s. Rate: 7.1 symbols/min [2025-10-07T20:23:21.111166] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:23:21.137595] [DEBUG] [LOCAL ] NAC: Loaded 24781 existing records from primary storage. [2025-10-07T20:23:21.137895] [INFO ] [MAIN ] NAC: Loaded 24781 existing records. [2025-10-07T20:23:21.309666] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:23:21.309894] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-07T20:23:21.309942] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-07T20:23:21.310152] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-07T20:23:21.310208] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-07T20:23:21.452750] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-07T20:23:21.668049] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:23:22.247625] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-07T20:23:22.428758] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T20:23:22.680009] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T20:23:23.047762] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-07T20:23:23.262995] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T20:23:23.847715] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-07T20:23:24.611882] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T20:23:24.647618] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-07T20:23:25.291677] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T20:23:25.447618] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-07T20:23:25.864147] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T20:23:26.247615] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-07T20:23:26.612105] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T20:23:27.047687] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-07T20:23:27.571565] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T20:23:27.573283] [INFO ] [REMOTE ] MYE: Full fetch complete (36184 records). [2025-10-07T20:23:27.573357] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-07T20:23:27.573864] [FATAL] [VALIDATOR ] MYE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:23:27.573948] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:23:27.573993] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:23:27.574032] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-07T20:23:27.574104] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-07T20:23:27.574172] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-07T20:23:27.574392] [DEBUG] [LOCAL ] MYE: Deleted derivative data file. [2025-10-07T20:23:27.574504] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYE took 36.3s. Estimated remaining: 2h 10m 6s. Rate: 7.1 symbols/min [2025-10-07T20:23:27.746467] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:23:27.759865] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T20:23:27.798604] [DEBUG] [LOCAL ] NAD: Loaded 33873 existing records from primary storage. [2025-10-07T20:23:27.798945] [INFO ] [MAIN ] NAD: Loaded 33873 existing records. [2025-10-07T20:23:27.853011] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-07T20:23:27.996028] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:23:27.996282] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-07T20:23:27.996332] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-07T20:23:27.996699] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-07T20:23:27.996764] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-07T20:23:28.363945] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:23:28.647620] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-07T20:23:28.865318] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T20:23:28.867001] [INFO ] [REMOTE ] MYI: Full fetch complete (29179 records). [2025-10-07T20:23:28.867090] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-07T20:23:29.238846] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-07T20:23:29.238945] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-07T20:23:29.239698] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-07T20:23:29.239763] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-07T20:23:29.240445] [DEBUG] [LOCAL ] MYI: Trimmed 29179 records to 19076 (keeping 200 days of data) [2025-10-07T20:23:29.361756] [DEBUG] [LOCAL ] MYI: Primary data saved (19076 records). [2025-10-07T20:23:29.361948] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-07T20:23:29.362056] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYI took 37.9s. Estimated remaining: 2h 9m 54s. Rate: 7.1 symbols/min [2025-10-07T20:23:29.452899] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-07T20:23:29.537304] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:23:29.548913] [DEBUG] [LOCAL ] NAN: Loaded 8534 existing records from primary storage. [2025-10-07T20:23:29.549144] [INFO ] [MAIN ] NAN: Loaded 8534 existing records. [2025-10-07T20:23:29.746782] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:23:29.747046] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-07T20:23:29.747095] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-07T20:23:29.747340] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-07T20:23:29.747397] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-07T20:23:30.096999] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:23:30.247637] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-07T20:23:30.280924] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T20:23:30.751462] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T20:23:31.047632] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-07T20:23:31.398730] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T20:23:31.847705] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-07T20:23:32.450343] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T20:23:32.647713] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-07T20:23:33.388379] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T20:23:33.447709] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-07T20:23:33.839363] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T20:23:34.247691] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-07T20:23:34.841224] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-07T20:23:35.047717] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-07T20:23:35.705521] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T20:23:35.847632] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-07T20:23:36.544511] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T20:23:36.647727] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-07T20:23:36.789029] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-07T20:23:37.259683] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-07T20:23:37.447618] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-07T20:23:38.247698] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-07T20:23:38.359476] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T20:23:38.903801] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:23:38.906365] [INFO ] [REMOTE ] NABL: Full fetch complete (56574 records). [2025-10-07T20:23:38.906497] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-07T20:23:38.907312] [FATAL] [VALIDATOR ] NABL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:23:38.907477] [FATAL] [MAIN ] NABL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:23:38.907533] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:23:38.907581] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-07T20:23:38.907685] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-07T20:23:38.907758] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-07T20:23:38.908047] [DEBUG] [LOCAL ] NABL: Deleted derivative data file. [2025-10-07T20:23:38.908145] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. NABL took 32.1s. Estimated remaining: 2h 9m 46s. Rate: 7.1 symbols/min [2025-10-07T20:23:39.057130] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-07T20:23:39.086019] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:23:39.136435] [DEBUG] [LOCAL ] NAT: Loaded 49148 existing records from primary storage. [2025-10-07T20:23:39.136830] [INFO ] [MAIN ] NAT: Loaded 49148 existing records. [2025-10-07T20:23:39.319255] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:23:39.319515] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-07T20:23:39.319565] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-07T20:23:39.319995] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-07T20:23:39.320054] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-07T20:23:39.691167] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:23:39.847722] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-07T20:23:40.430560] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T20:23:40.647752] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-07T20:23:41.447639] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-07T20:23:41.546766] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T20:23:41.565901] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:23:42.247758] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-07T20:23:42.975133] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T20:23:43.047630] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-07T20:23:43.231137] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T20:23:43.847690] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-07T20:23:44.319985] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-07T20:23:44.449442] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-07T20:23:44.647681] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-07T20:23:45.447706] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-07T20:23:45.828042] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T20:23:46.247698] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-07T20:23:46.932956] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T20:23:47.047687] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-07T20:23:47.817290] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T20:23:47.847605] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-07T20:23:48.231695] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T20:23:48.647695] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-07T20:23:49.447790] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-07T20:23:49.574774] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T20:23:50.132099] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T20:23:50.247717] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-07T20:23:51.048324] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-07T20:23:51.049913] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T20:23:51.058328] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T20:23:51.847755] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-07T20:23:52.647621] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-07T20:23:52.986729] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T20:23:53.055090] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T20:23:53.447716] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-07T20:23:53.700709] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T20:23:53.702728] [INFO ] [REMOTE ] NAC: Full fetch complete (36002 records). [2025-10-07T20:23:53.702820] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-07T20:23:54.078012] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-07T20:23:54.078108] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-07T20:23:54.078800] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-07T20:23:54.078867] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-07T20:23:54.079908] [DEBUG] [LOCAL ] NAC: Trimmed 36002 records to 24598 (keeping 200 days of data) [2025-10-07T20:23:54.237523] [DEBUG] [LOCAL ] NAC: Primary data saved (24598 records). [2025-10-07T20:23:54.237707] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-07T20:23:54.237811] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAC took 33.3s. Estimated remaining: 2h 9m 42s. Rate: 7.1 symbols/min [2025-10-07T20:23:54.252805] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-07T20:23:54.409521] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:23:54.440607] [DEBUG] [LOCAL ] NATL: Loaded 32488 existing records from primary storage. [2025-10-07T20:23:54.440969] [INFO ] [MAIN ] NATL: Loaded 32488 existing records. [2025-10-07T20:23:54.620797] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:23:54.621347] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-07T20:23:54.621483] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-07T20:23:54.621853] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-10-07T20:23:54.621912] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-07T20:23:54.943050] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T20:23:55.027782] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:23:55.047620] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-07T20:23:55.847699] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-07T20:23:55.882544] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T20:23:56.144200] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T20:23:56.647683] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-07T20:23:57.037663] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T20:23:57.040373] [INFO ] [REMOTE ] NAD: Full fetch complete (49525 records). [2025-10-07T20:23:57.040497] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-07T20:23:57.433987] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-07T20:23:57.434089] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-07T20:23:57.434900] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-07T20:23:57.434964] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-07T20:23:57.436005] [DEBUG] [LOCAL ] NAD: Trimmed 49525 records to 33873 (keeping 200 days of data) [2025-10-07T20:23:57.495986] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-07T20:23:57.659898] [DEBUG] [LOCAL ] NAD: Primary data saved (33873 records). [2025-10-07T20:23:57.660098] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-07T20:23:57.660219] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAD took 30.1s. Estimated remaining: 2h 9m 30s. Rate: 7.1 symbols/min [2025-10-07T20:23:57.849419] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:23:57.857565] [DEBUG] [LOCAL ] NAZ: Loaded 2663 existing records from primary storage. [2025-10-07T20:23:57.858050] [INFO ] [MAIN ] NAZ: Loaded 2663 existing records. [2025-10-07T20:23:58.037556] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:23:58.037804] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-07T20:23:58.037854] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-07T20:23:58.038085] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-07T20:23:58.038143] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-07T20:23:58.266759] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-07T20:23:58.399008] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:23:58.434459] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T20:23:58.622463] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T20:23:59.047684] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-07T20:23:59.480404] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T20:23:59.832968] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T20:23:59.847595] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-07T20:24:00.594495] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T20:24:00.647680] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-07T20:24:01.447698] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-07T20:24:02.151050] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T20:24:02.247686] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-07T20:24:02.350195] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T20:24:03.047750] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-07T20:24:03.847689] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-07T20:24:04.005577] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T20:24:04.412198] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T20:24:04.647741] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-07T20:24:05.100117] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T20:24:05.447692] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-07T20:24:06.247726] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-07T20:24:06.312382] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T20:24:06.673218] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-07T20:24:07.047726] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-07T20:24:07.368687] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T20:24:07.847744] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-07T20:24:08.564605] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T20:24:08.566199] [INFO ] [REMOTE ] NAN: Full fetch complete (13649 records). [2025-10-07T20:24:08.566342] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-07T20:24:08.652779] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-07T20:24:08.959197] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-07T20:24:08.959502] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-07T20:24:08.959877] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-07T20:24:08.970681] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-07T20:24:08.989751] [DEBUG] [LOCAL ] NAN: Trimmed 13649 records to 8456 (keeping 200 days of data) [2025-10-07T20:24:08.991868] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T20:24:09.056266] [DEBUG] [LOCAL ] NAN: Primary data saved (8456 records). [2025-10-07T20:24:09.056415] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-07T20:24:09.056514] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAN took 39.7s. Estimated remaining: 2h 9m 24s. Rate: 7.1 symbols/min [2025-10-07T20:24:09.165351] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-07T20:24:09.231432] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:24:09.244451] [DEBUG] [LOCAL ] NBB: Loaded 9119 existing records from primary storage. [2025-10-07T20:24:09.244717] [INFO ] [MAIN ] NBB: Loaded 9119 existing records. [2025-10-07T20:24:09.417626] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:24:09.417893] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-07T20:24:09.417966] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-07T20:24:09.418161] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-07T20:24:09.418219] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-07T20:24:09.452898] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-07T20:24:09.781537] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:24:10.247751] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-07T20:24:10.993518] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T20:24:11.019931] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T20:24:11.047722] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-07T20:24:11.732388] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T20:24:11.847734] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-07T20:24:12.647671] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-07T20:24:13.322778] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T20:24:13.447635] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-07T20:24:13.749971] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T20:24:14.247685] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-07T20:24:15.047711] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-07T20:24:15.587124] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T20:24:15.652699] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-07T20:24:15.850681] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-07T20:24:15.852387] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-07T20:24:16.515143] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:24:16.518870] [INFO ] [REMOTE ] NAT: Full fetch complete (71713 records). [2025-10-07T20:24:16.519056] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-07T20:24:16.520121] [FATAL] [VALIDATOR ] NAT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:24:16.520238] [FATAL] [MAIN ] NAT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:24:16.520313] [WARN ] [MAIN ] NAT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:24:16.520405] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-07T20:24:16.520519] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-07T20:24:16.520576] [INFO ] [LOCAL ] NAT: Starting deletion of derivative data. [2025-10-07T20:24:16.520824] [DEBUG] [LOCAL ] NAT: Deleted derivative data file. [2025-10-07T20:24:16.520980] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAT took 37.6s. Estimated remaining: 2h 9m 15s. Rate: 7.1 symbols/min [2025-10-07T20:24:16.652800] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-07T20:24:16.708177] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:24:16.735847] [DEBUG] [LOCAL ] NBHC: Loaded 23384 existing records from primary storage. [2025-10-07T20:24:16.736135] [INFO ] [MAIN ] NBHC: Loaded 23384 existing records. [2025-10-07T20:24:16.923085] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:24:16.923335] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-07T20:24:16.923416] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-07T20:24:16.923723] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-07T20:24:16.923786] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-07T20:24:17.219142] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T20:24:17.299605] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:24:17.447707] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-07T20:24:18.247774] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-07T20:24:18.945578] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-07T20:24:18.977684] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T20:24:19.047608] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-07T20:24:19.847713] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-07T20:24:20.650026] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-07T20:24:20.667047] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T20:24:20.962789] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T20:24:21.164839] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T20:24:21.165675] [INFO ] [REMOTE ] NAZ: Full fetch complete (4355 records). [2025-10-07T20:24:21.165745] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-07T20:24:21.452835] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-07T20:24:21.533051] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-07T20:24:21.533170] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-07T20:24:21.533351] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-07T20:24:21.533394] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-07T20:24:21.534054] [DEBUG] [LOCAL ] NAZ: Trimmed 4355 records to 2646 (keeping 200 days of data) [2025-10-07T20:24:21.552109] [DEBUG] [LOCAL ] NAZ: Primary data saved (2646 records). [2025-10-07T20:24:21.552220] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-07T20:24:21.552306] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NAZ took 23.9s. Estimated remaining: 2h 9m 4s. Rate: 7.1 symbols/min [2025-10-07T20:24:21.737432] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:24:21.778752] [DEBUG] [LOCAL ] NBR: Loaded 34410 existing records from primary storage. [2025-10-07T20:24:21.779203] [INFO ] [MAIN ] NBR: Loaded 34410 existing records. [2025-10-07T20:24:21.979996] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:24:21.980440] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-07T20:24:21.980515] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-07T20:24:21.980788] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-07T20:24:21.980847] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-07T20:24:22.260050] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-07T20:24:22.403952] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:24:22.994603] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T20:24:23.047630] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-07T20:24:23.217024] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T20:24:23.544938] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T20:24:23.547411] [INFO ] [REMOTE ] NATL: Full fetch complete (45208 records). [2025-10-07T20:24:23.547555] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-07T20:24:23.548432] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:24:23.548532] [FATAL] [MAIN ] NATL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:24:23.548576] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:24:23.548622] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-07T20:24:23.548737] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-07T20:24:23.548792] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-07T20:24:23.549044] [DEBUG] [LOCAL ] NATL: Deleted derivative data file. [2025-10-07T20:24:23.549150] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NATL took 29.3s. Estimated remaining: 2h 8m 52s. Rate: 7.1 symbols/min [2025-10-07T20:24:23.724269] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:24:23.753754] [DEBUG] [LOCAL ] NBXG: Loaded 22167 existing records from primary storage. [2025-10-07T20:24:23.754148] [INFO ] [MAIN ] NBXG: Loaded 22167 existing records. [2025-10-07T20:24:23.852681] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-07T20:24:23.934966] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:24:23.935183] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-07T20:24:23.935230] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-07T20:24:23.935489] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-10-07T20:24:23.935546] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-07T20:24:24.291889] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:24:24.647615] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-07T20:24:25.038244] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T20:24:25.447628] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-07T20:24:25.491763] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T20:24:26.247765] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-07T20:24:27.047708] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-07T20:24:27.088220] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T20:24:27.100729] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T20:24:27.847753] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-07T20:24:28.181196] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T20:24:28.647727] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-07T20:24:29.264503] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T20:24:29.447632] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-07T20:24:29.862191] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T20:24:30.135885] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T20:24:30.247687] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-07T20:24:31.047630] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-07T20:24:31.121125] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T20:24:31.847756] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-07T20:24:32.554435] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T20:24:32.647702] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-07T20:24:33.122268] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T20:24:33.447711] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-07T20:24:34.157091] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T20:24:34.181234] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T20:24:34.247730] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-07T20:24:35.047744] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-07T20:24:35.733284] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T20:24:35.847620] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-07T20:24:35.858001] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-07T20:24:36.647621] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-07T20:24:37.026745] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T20:24:37.447665] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-07T20:24:37.553694] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T20:24:38.247618] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-07T20:24:38.627985] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T20:24:39.047605] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-07T20:24:39.278713] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-07T20:24:39.847708] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-07T20:24:40.399422] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T20:24:40.647710] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-07T20:24:41.340006] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T20:24:41.373503] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T20:24:41.375069] [INFO ] [REMOTE ] NBB: Full fetch complete (13815 records). [2025-10-07T20:24:41.375148] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-07T20:24:41.452824] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-07T20:24:41.771049] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-07T20:24:41.771185] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-07T20:24:41.771763] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-07T20:24:41.771832] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-07T20:24:41.772527] [DEBUG] [LOCAL ] NBB: Trimmed 13815 records to 9141 (keeping 200 days of data) [2025-10-07T20:24:41.842994] [DEBUG] [LOCAL ] NBB: Primary data saved (9141 records). [2025-10-07T20:24:41.843210] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-07T20:24:41.843371] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBB took 32.8s. Estimated remaining: 2h 8m 49s. Rate: 7.1 symbols/min [2025-10-07T20:24:42.023546] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:24:42.029363] [DEBUG] [LOCAL ] NC: Loaded 1932 existing records from primary storage. [2025-10-07T20:24:42.029568] [INFO ] [MAIN ] NC: Loaded 1932 existing records. [2025-10-07T20:24:42.214694] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:24:42.215042] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-07T20:24:42.215098] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-07T20:24:42.215324] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-07T20:24:42.215385] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-07T20:24:42.252954] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-07T20:24:42.609482] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:24:43.053991] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-07T20:24:43.074515] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T20:24:43.547354] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T20:24:43.847767] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-07T20:24:44.292026] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T20:24:44.647672] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-07T20:24:44.749392] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T20:24:45.447770] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-07T20:24:45.956484] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T20:24:46.090769] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T20:24:46.247686] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-07T20:24:47.047762] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-07T20:24:47.574533] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T20:24:47.577703] [INFO ] [REMOTE ] NBHC: Full fetch complete (32329 records). [2025-10-07T20:24:47.577788] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-07T20:24:47.578323] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:24:47.578405] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:24:47.578447] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:24:47.578486] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-07T20:24:47.578554] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-07T20:24:47.578739] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-07T20:24:47.579015] [DEBUG] [LOCAL ] NBHC: Deleted derivative data file. [2025-10-07T20:24:47.579106] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBHC took 31.1s. Estimated remaining: 2h 8m 39s. Rate: 7.1 symbols/min [2025-10-07T20:24:47.791835] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T20:24:47.795963] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:24:47.814763] [DEBUG] [LOCAL ] NCA: Loaded 10104 existing records from primary storage. [2025-10-07T20:24:47.815029] [INFO ] [MAIN ] NCA: Loaded 10104 existing records. [2025-10-07T20:24:47.852978] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-07T20:24:48.014349] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:24:48.014593] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-07T20:24:48.014705] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-07T20:24:48.015097] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-07T20:24:48.015178] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-07T20:24:48.383200] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:24:48.647696] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-07T20:24:49.347831] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T20:24:49.447609] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-07T20:24:49.823946] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T20:24:50.247693] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-07T20:24:50.690124] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T20:24:51.047713] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-07T20:24:51.113071] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T20:24:51.847611] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-07T20:24:52.234930] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T20:24:52.647699] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-07T20:24:53.447709] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-07T20:24:53.499918] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T20:24:54.121426] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T20:24:54.247611] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-07T20:24:54.344592] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T20:24:55.047764] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-07T20:24:55.847618] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-07T20:24:55.874270] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T20:24:55.925869] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T20:24:56.471959] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-07T20:24:56.647681] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-07T20:24:57.447688] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-07T20:24:58.247770] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T20:24:58.247603] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-07T20:24:58.274088] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T20:24:59.047719] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-07T20:24:59.344141] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:24:59.645377] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T20:24:59.847781] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-07T20:25:00.647701] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-07T20:25:00.733472] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T20:25:01.447735] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-07T20:25:02.247737] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-07T20:25:02.364108] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:25:02.423237] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T20:25:03.047705] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-07T20:25:03.535911] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T20:25:03.847630] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-07T20:25:04.004121] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-07T20:25:04.647614] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-07T20:25:04.997174] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T20:25:05.447707] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-07T20:25:05.651979] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T20:25:06.029693] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:25:06.032594] [INFO ] [REMOTE ] NBR: Full fetch complete (49257 records). [2025-10-07T20:25:06.032785] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-07T20:25:06.033735] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:25:06.033844] [FATAL] [MAIN ] NBR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:25:06.033916] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:25:06.033998] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-07T20:25:06.034075] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-07T20:25:06.034152] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-07T20:25:06.034338] [DEBUG] [LOCAL ] NBR: Deleted derivative data file. [2025-10-07T20:25:06.034436] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBR took 44.5s. Estimated remaining: 2h 8m 37s. Rate: 7.1 symbols/min [2025-10-07T20:25:06.212977] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:25:06.235955] [DEBUG] [LOCAL ] NCDL: Loaded 21643 existing records from primary storage. [2025-10-07T20:25:06.236233] [INFO ] [MAIN ] NCDL: Loaded 21643 existing records. [2025-10-07T20:25:06.256505] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-07T20:25:06.422890] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:25:06.423205] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-07T20:25:06.423277] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-07T20:25:06.423523] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-07T20:25:06.423583] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-07T20:25:06.775228] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:25:06.939526] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T20:25:07.047742] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-07T20:25:07.682118] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T20:25:07.847685] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-07T20:25:08.647627] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-07T20:25:08.812330] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T20:25:09.447708] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-07T20:25:10.092174] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T20:25:10.092053] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T20:25:10.247681] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-07T20:25:10.909841] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T20:25:11.047717] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-07T20:25:11.847723] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-07T20:25:11.859196] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T20:25:11.860426] [INFO ] [REMOTE ] NCA: Full fetch complete (15346 records). [2025-10-07T20:25:11.860524] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-07T20:25:12.221236] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-07T20:25:12.221353] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-07T20:25:12.221736] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-07T20:25:12.221799] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-07T20:25:12.222420] [DEBUG] [LOCAL ] NCA: Trimmed 15346 records to 10064 (keeping 200 days of data) [2025-10-07T20:25:12.286555] [DEBUG] [LOCAL ] NCA: Primary data saved (10064 records). [2025-10-07T20:25:12.286739] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-07T20:25:12.286836] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NCA took 24.7s. Estimated remaining: 2h 8m 27s. Rate: 7.1 symbols/min [2025-10-07T20:25:12.452546] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:25:12.452806] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-07T20:25:12.452899] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-07T20:25:12.453016] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-07T20:25:12.453058] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-07T20:25:12.453099] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-07T20:25:12.453132] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-07T20:25:12.652805] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-07T20:25:12.812043] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:25:12.864178] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T20:25:12.865957] [INFO ] [REMOTE ] NBXG: Full fetch complete (32742 records). [2025-10-07T20:25:12.866032] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-07T20:25:12.866504] [FATAL] [VALIDATOR ] NBXG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:25:12.866593] [FATAL] [MAIN ] NBXG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:25:12.866666] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:25:12.866757] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-07T20:25:12.866849] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-07T20:25:12.866893] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-07T20:25:12.867141] [DEBUG] [LOCAL ] NBXG: Deleted derivative data file. [2025-10-07T20:25:12.867232] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NBXG took 49.3s. Estimated remaining: 2h 8m 14s. Rate: 7.1 symbols/min [2025-10-07T20:25:13.032682] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:25:13.049294] [DEBUG] [LOCAL ] NCV: Loaded 13835 existing records from primary storage. [2025-10-07T20:25:13.049561] [INFO ] [MAIN ] NCV: Loaded 13835 existing records. [2025-10-07T20:25:13.224303] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:25:13.224545] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-07T20:25:13.224634] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-07T20:25:13.224908] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-07T20:25:13.224968] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-07T20:25:13.452806] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-07T20:25:13.578407] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:25:14.021928] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T20:25:14.065572] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T20:25:14.247718] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-07T20:25:15.047758] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-07T20:25:15.847689] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-07T20:25:16.341817] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T20:25:16.489533] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-07T20:25:16.647670] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-07T20:25:17.016343] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T20:25:17.447753] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-07T20:25:17.883538] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T20:25:18.247696] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-07T20:25:18.764905] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T20:25:19.021272] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T20:25:19.047607] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-07T20:25:19.847699] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-07T20:25:20.340330] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T20:25:20.413887] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T20:25:20.647731] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-07T20:25:21.447701] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-07T20:25:21.833094] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T20:25:21.888323] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T20:25:21.889068] [INFO ] [REMOTE ] NC: Full fetch complete (2716 records). [2025-10-07T20:25:21.889137] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-07T20:25:21.890050] [FATAL] [VALIDATOR ] NC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:25:21.890143] [FATAL] [MAIN ] NC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:25:21.890220] [WARN ] [MAIN ] NC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:25:21.890282] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-07T20:25:21.890374] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-07T20:25:21.890430] [INFO ] [LOCAL ] NC: Starting deletion of derivative data. [2025-10-07T20:25:21.890593] [DEBUG] [LOCAL ] NC: Deleted derivative data file. [2025-10-07T20:25:21.890730] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NC took 40.0s. Estimated remaining: 2h 8m 6s. Rate: 7.1 symbols/min [2025-10-07T20:25:22.058352] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:25:22.072983] [DEBUG] [LOCAL ] NCZ: Loaded 12075 existing records from primary storage. [2025-10-07T20:25:22.073209] [INFO ] [MAIN ] NCZ: Loaded 12075 existing records. [2025-10-07T20:25:22.244945] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:25:22.245145] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-07T20:25:22.245196] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-07T20:25:22.245446] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-07T20:25:22.245502] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-07T20:25:22.256217] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-07T20:25:22.597963] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:25:23.047716] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-07T20:25:23.480180] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-07T20:25:23.847679] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-07T20:25:24.307173] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T20:25:24.647762] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-07T20:25:25.100891] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T20:25:25.447760] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-07T20:25:26.247668] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-07T20:25:26.553218] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T20:25:26.819924] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-07T20:25:27.047694] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-07T20:25:27.081189] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T20:25:27.847757] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-07T20:25:28.412947] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T20:25:28.647676] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-07T20:25:28.839680] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-07T20:25:29.447721] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-07T20:25:30.247712] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-07T20:25:30.514132] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T20:25:30.783491] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-07T20:25:30.929471] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T20:25:31.047678] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-07T20:25:31.847697] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-07T20:25:32.647721] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-07T20:25:32.982369] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T20:25:33.387177] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-07T20:25:33.407220] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-07T20:25:33.447600] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-07T20:25:34.247627] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-07T20:25:34.547972] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:25:35.047728] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-07T20:25:35.521158] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T20:25:35.776757] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T20:25:35.847737] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-07T20:25:36.647681] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-07T20:25:37.447638] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-07T20:25:37.592321] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T20:25:37.965659] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T20:25:37.967587] [INFO ] [REMOTE ] NCDL: Full fetch complete (32722 records). [2025-10-07T20:25:37.967690] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-07T20:25:37.968243] [FATAL] [VALIDATOR ] NCDL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:25:37.968329] [FATAL] [MAIN ] NCDL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:25:37.968373] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:25:37.968413] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-07T20:25:37.968486] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-07T20:25:37.968567] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-07T20:25:37.968955] [DEBUG] [LOCAL ] NCDL: Deleted derivative data file. [2025-10-07T20:25:37.969137] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCDL took 31.9s. Estimated remaining: 2h 8m 2s. Rate: 7.1 symbols/min [2025-10-07T20:25:38.143525] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:25:38.161136] [DEBUG] [LOCAL ] NDMO: Loaded 17000 existing records from primary storage. [2025-10-07T20:25:38.161389] [INFO ] [MAIN ] NDMO: Loaded 17000 existing records. [2025-10-07T20:25:38.261229] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-07T20:25:38.305550] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-07T20:25:38.386613] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:25:38.386881] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-07T20:25:38.386928] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-07T20:25:38.387163] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-07T20:25:38.387220] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-07T20:25:38.737412] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:25:39.047715] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-07T20:25:39.298036] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T20:25:39.847711] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-07T20:25:40.647628] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-07T20:25:40.714700] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T20:25:41.353710] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-07T20:25:41.447671] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-07T20:25:41.942510] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T20:25:42.247694] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-07T20:25:43.047625] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-07T20:25:43.191771] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T20:25:43.656626] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-07T20:25:43.819339] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T20:25:43.847613] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-07T20:25:44.647631] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-07T20:25:44.884168] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T20:25:45.447693] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-07T20:25:45.482289] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T20:25:45.484011] [INFO ] [REMOTE ] NCZ: Full fetch complete (21306 records). [2025-10-07T20:25:45.484104] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-07T20:25:45.878052] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-07T20:25:45.878145] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-07T20:25:45.878601] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-07T20:25:45.878663] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-07T20:25:45.879229] [DEBUG] [LOCAL ] NCZ: Trimmed 21306 records to 12108 (keeping 200 days of data) [2025-10-07T20:25:45.957267] [DEBUG] [LOCAL ] NCZ: Primary data saved (12108 records). [2025-10-07T20:25:45.957418] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-07T20:25:45.957530] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCZ took 24.1s. Estimated remaining: 2h 7m 53s. Rate: 7.1 symbols/min [2025-10-07T20:25:46.136539] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:25:46.191060] [DEBUG] [LOCAL ] NE: Loaded 52386 existing records from primary storage. [2025-10-07T20:25:46.191478] [INFO ] [MAIN ] NE: Loaded 52386 existing records. [2025-10-07T20:25:46.260480] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-07T20:25:46.387916] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:25:46.388178] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-07T20:25:46.388227] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-07T20:25:46.388569] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-07T20:25:46.388625] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-07T20:25:46.515293] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T20:25:46.804391] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:25:47.047629] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-07T20:25:47.401967] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T20:25:47.847759] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-07T20:25:48.647743] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-07T20:25:49.438817] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T20:25:49.448868] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-07T20:25:49.553594] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-07T20:25:49.583041] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T20:25:50.247729] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-07T20:25:50.329639] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T20:25:51.047715] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-07T20:25:51.847688] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-07T20:25:52.605943] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-07T20:25:52.647617] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-07T20:25:52.951548] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:25:53.020838] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-07T20:25:53.447685] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-07T20:25:54.247698] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-07T20:25:54.563917] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T20:25:54.729323] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-07T20:25:55.047742] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-07T20:25:55.764579] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T20:25:55.847760] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-07T20:25:55.975957] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T20:25:56.647727] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-07T20:25:57.447709] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-07T20:25:57.793710] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T20:25:57.834745] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-07T20:25:58.161821] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T20:25:58.165363] [INFO ] [REMOTE ] NCLH: Full fetch complete (77420 records). [2025-10-07T20:25:58.165541] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-07T20:25:58.166420] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:25:58.166520] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:25:58.166588] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:25:58.166678] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-07T20:25:58.166811] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-07T20:25:58.166884] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-07T20:25:58.166941] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-07T20:25:58.167015] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCLH took 45.9s. Estimated remaining: 2h 7m 47s. Rate: 7.1 symbols/min [2025-10-07T20:25:58.252828] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-07T20:25:58.348327] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:25:58.391291] [DEBUG] [LOCAL ] NEA: Loaded 35486 existing records from primary storage. [2025-10-07T20:25:58.391592] [INFO ] [MAIN ] NEA: Loaded 35486 existing records. [2025-10-07T20:25:58.564015] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:25:58.564235] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-07T20:25:58.564282] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-07T20:25:58.564687] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-07T20:25:58.564744] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-07T20:25:58.910404] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:25:59.047625] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-07T20:25:59.194790] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T20:25:59.196690] [INFO ] [REMOTE ] NCV: Full fetch complete (22506 records). [2025-10-07T20:25:59.196790] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-07T20:25:59.588142] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-07T20:25:59.588248] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-07T20:25:59.588877] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-07T20:25:59.588943] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-07T20:25:59.589535] [DEBUG] [LOCAL ] NCV: Trimmed 22506 records to 13857 (keeping 200 days of data) [2025-10-07T20:25:59.677536] [DEBUG] [LOCAL ] NCV: Primary data saved (13857 records). [2025-10-07T20:25:59.677707] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-07T20:25:59.677807] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCV took 46.8s. Estimated remaining: 2h 7m 35s. Rate: 7.1 symbols/min [2025-10-07T20:25:59.846233] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:25:59.846444] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-07T20:25:59.846501] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-07T20:25:59.846625] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-07T20:25:59.846705] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-07T20:25:59.846813] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-07T20:25:59.846864] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-07T20:25:59.857959] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-07T20:26:00.219974] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:26:00.647689] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-07T20:26:00.999239] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-07T20:26:01.226992] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T20:26:01.447711] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-07T20:26:02.247711] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-07T20:26:02.691112] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T20:26:03.032229] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T20:26:03.047606] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-07T20:26:03.078849] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T20:26:03.847720] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-07T20:26:04.565487] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T20:26:04.647708] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-07T20:26:05.382886] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T20:26:05.384534] [INFO ] [REMOTE ] NDMO: Full fetch complete (24225 records). [2025-10-07T20:26:05.384614] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-07T20:26:05.385187] [FATAL] [VALIDATOR ] NDMO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:26:05.385280] [FATAL] [MAIN ] NDMO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:26:05.385330] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:26:05.385406] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-07T20:26:05.385480] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-07T20:26:05.385525] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-07T20:26:05.385821] [DEBUG] [LOCAL ] NDMO: Deleted derivative data file. [2025-10-07T20:26:05.385931] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NDMO took 27.4s. Estimated remaining: 2h 7m 24s. Rate: 7.1 symbols/min [2025-10-07T20:26:05.457958] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-07T20:26:05.562499] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:26:05.562805] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-07T20:26:05.562892] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-07T20:26:05.562977] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-07T20:26:05.563014] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-07T20:26:05.563054] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-07T20:26:05.563087] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-07T20:26:05.939848] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:26:05.970305] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-07T20:26:06.247718] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-07T20:26:07.043080] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T20:26:07.049826] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-07T20:26:07.847701] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-07T20:26:07.987579] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T20:26:08.647699] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-07T20:26:09.354772] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-07T20:26:09.447634] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-07T20:26:09.519138] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T20:26:10.247747] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-07T20:26:10.656543] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-07T20:26:11.047678] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-07T20:26:11.445493] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-07T20:26:11.847746] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-07T20:26:12.201313] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T20:26:12.647739] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-07T20:26:13.052020] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-07T20:26:13.447735] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-07T20:26:14.059463] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-07T20:26:14.090182] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T20:26:14.247680] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-07T20:26:15.047696] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-07T20:26:15.545922] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-07T20:26:15.604599] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T20:26:15.847772] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-07T20:26:16.647680] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-07T20:26:17.010340] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-07T20:26:17.072939] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T20:26:17.447736] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-07T20:26:18.247621] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-07T20:26:18.855009] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-07T20:26:19.047715] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-07T20:26:19.260238] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T20:26:19.847682] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-07T20:26:20.607191] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T20:26:20.651059] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-07T20:26:20.656610] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-07T20:26:21.325620] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T20:26:21.328870] [INFO ] [REMOTE ] NE: Full fetch complete (75175 records). [2025-10-07T20:26:21.329028] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-07T20:26:21.329927] [FATAL] [VALIDATOR ] NE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:26:21.330020] [FATAL] [MAIN ] NE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:26:21.330087] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:26:21.330157] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-07T20:26:21.330227] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-07T20:26:21.330295] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-07T20:26:21.330580] [DEBUG] [LOCAL ] NE: Deleted derivative data file. [2025-10-07T20:26:21.330728] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NE took 35.4s. Estimated remaining: 2h 7m 21s. Rate: 7.1 symbols/min [2025-10-07T20:26:21.452938] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-07T20:26:21.502524] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:26:21.558703] [DEBUG] [LOCAL ] NET: Loaded 52971 existing records from primary storage. [2025-10-07T20:26:21.559081] [INFO ] [MAIN ] NET: Loaded 52971 existing records. [2025-10-07T20:26:21.743718] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:26:21.743931] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-07T20:26:21.743980] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-07T20:26:21.744434] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-07T20:26:21.744493] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-07T20:26:22.117755] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:26:22.150242] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-07T20:26:22.247632] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-07T20:26:23.027255] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T20:26:23.047615] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-07T20:26:23.847720] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-07T20:26:24.466368] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T20:26:24.468135] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-07T20:26:24.481073] [INFO ] [REMOTE ] NEA: Full fetch complete (51817 records). [2025-10-07T20:26:24.481842] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-07T20:26:24.651303] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-07T20:26:24.856519] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-07T20:26:24.856602] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-07T20:26:24.857426] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-07T20:26:24.857513] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-07T20:26:24.858780] [DEBUG] [LOCAL ] NEA: Trimmed 51817 records to 35491 (keeping 200 days of data) [2025-10-07T20:26:25.079282] [DEBUG] [LOCAL ] NEA: Primary data saved (35491 records). [2025-10-07T20:26:25.079482] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-07T20:26:25.079574] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NEA took 26.9s. Estimated remaining: 2h 7m 9s. Rate: 7.1 symbols/min [2025-10-07T20:26:25.254769] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:26:25.267116] [DEBUG] [LOCAL ] NEU: Loaded 8396 existing records from primary storage. [2025-10-07T20:26:25.267393] [INFO ] [MAIN ] NEU: Loaded 8396 existing records. [2025-10-07T20:26:25.444256] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:26:25.444591] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-07T20:26:25.444668] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-07T20:26:25.444983] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-07T20:26:25.445041] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-07T20:26:25.475789] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-07T20:26:25.797120] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:26:26.117812] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-07T20:26:26.247604] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-07T20:26:26.982084] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-07T20:26:27.047603] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-07T20:26:27.839625] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-07T20:26:27.850323] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-07T20:26:28.589983] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-07T20:26:28.646536] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-07T20:26:28.657083] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-07T20:26:29.389465] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-07T20:26:29.447691] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-07T20:26:30.247699] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-07T20:26:30.798474] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-07T20:26:31.047709] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-07T20:26:31.356480] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T20:26:31.820844] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T20:26:31.847713] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-07T20:26:32.417787] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-07T20:26:32.647686] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-07T20:26:32.704912] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T20:26:33.447728] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-07T20:26:34.232933] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T20:26:34.247589] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-07T20:26:35.047628] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-07T20:26:35.194608] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T20:26:35.403855] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-07T20:26:35.847682] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-07T20:26:36.627879] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T20:26:36.647594] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-07T20:26:37.434882] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-07T20:26:37.447779] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-07T20:26:37.796511] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T20:26:38.247692] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-07T20:26:39.047688] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-07T20:26:39.837848] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-07T20:26:39.849502] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-07T20:26:39.906360] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T20:26:40.647713] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-07T20:26:40.729951] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-07T20:26:41.447725] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-07T20:26:42.097068] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-07T20:26:42.247622] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-07T20:26:42.731942] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-07T20:26:43.047696] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-07T20:26:43.799409] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-07T20:26:43.847606] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-07T20:26:44.647718] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-07T20:26:44.754307] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-07T20:26:45.294536] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-07T20:26:45.314556] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-07T20:26:45.447624] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-07T20:26:46.219447] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-07T20:26:46.247620] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-07T20:26:47.027564] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T20:26:47.030694] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-10-07T20:26:47.030819] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-07T20:26:47.031747] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:26:47.031868] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:26:47.031912] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:26:47.031960] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-07T20:26:47.032035] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-07T20:26:47.032090] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-07T20:26:47.032133] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-07T20:26:47.032195] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEE took 47.4s. Estimated remaining: 2h 7m 9s. Rate: 7.1 symbols/min [2025-10-07T20:26:47.053070] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-07T20:26:47.210782] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:26:47.217308] [DEBUG] [LOCAL ] NEXA: Loaded 4445 existing records from primary storage. [2025-10-07T20:26:47.217615] [INFO ] [MAIN ] NEXA: Loaded 4445 existing records. [2025-10-07T20:26:47.398265] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:26:47.398611] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-07T20:26:47.398735] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-07T20:26:47.399087] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-07T20:26:47.399146] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-07T20:26:47.764009] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:26:47.771898] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T20:26:47.805161] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-07T20:26:47.847662] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-07T20:26:48.647733] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-07T20:26:48.830676] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-07T20:26:49.179763] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T20:26:49.180933] [INFO ] [REMOTE ] NEU: Full fetch complete (10554 records). [2025-10-07T20:26:49.181020] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-07T20:26:49.181491] [FATAL] [VALIDATOR ] NEU: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:26:49.181593] [FATAL] [MAIN ] NEU: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:26:49.181639] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:26:49.181750] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-07T20:26:49.181838] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-07T20:26:49.181890] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-07T20:26:49.182262] [DEBUG] [LOCAL ] NEU: Deleted derivative data file. [2025-10-07T20:26:49.182359] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEU took 24.1s. Estimated remaining: 2h 6m 57s. Rate: 7.1 symbols/min [2025-10-07T20:26:49.362495] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:26:49.402230] [DEBUG] [LOCAL ] NFG: Loaded 38439 existing records from primary storage. [2025-10-07T20:26:49.402555] [INFO ] [MAIN ] NFG: Loaded 38439 existing records. [2025-10-07T20:26:49.454775] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-07T20:26:49.591470] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:26:49.591729] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-07T20:26:49.591784] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-07T20:26:49.592174] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-07T20:26:49.592231] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-07T20:26:49.944014] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:26:50.247668] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-07T20:26:50.397243] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T20:26:51.047685] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-07T20:26:51.579433] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T20:26:51.730121] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:26:51.733364] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-10-07T20:26:51.733509] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-07T20:26:51.734458] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:26:51.734563] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:26:51.734676] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:26:51.734804] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-07T20:26:51.734888] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-07T20:26:51.734926] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-07T20:26:51.734970] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-07T20:26:51.735032] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEM took 46.3s. Estimated remaining: 2h 6m 45s. Rate: 7.1 symbols/min [2025-10-07T20:26:51.852715] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-07T20:26:51.931782] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:26:51.955608] [DEBUG] [LOCAL ] NFJ: Loaded 20410 existing records from primary storage. [2025-10-07T20:26:51.955915] [INFO ] [MAIN ] NFJ: Loaded 20410 existing records. [2025-10-07T20:26:52.128425] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:26:52.128698] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-07T20:26:52.128758] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-07T20:26:52.129033] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-07T20:26:52.129089] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-07T20:26:52.470577] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:26:52.647601] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-07T20:26:53.447695] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-07T20:26:53.922411] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T20:26:54.195702] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-07T20:26:54.247697] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-07T20:26:54.839943] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T20:26:54.843523] [INFO ] [REMOTE ] NET: Full fetch complete (76412 records). [2025-10-07T20:26:54.843705] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-07T20:26:54.844584] [FATAL] [VALIDATOR ] NET: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:26:54.844710] [FATAL] [MAIN ] NET: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:26:54.844786] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:26:54.844862] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-07T20:26:54.844934] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-07T20:26:54.844971] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-07T20:26:54.845135] [DEBUG] [LOCAL ] NET: Deleted derivative data file. [2025-10-07T20:26:54.845233] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NET took 33.5s. Estimated remaining: 2h 6m 33s. Rate: 7.1 symbols/min [2025-10-07T20:26:55.014340] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:26:55.059205] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-07T20:26:55.061369] [DEBUG] [LOCAL ] NGG: Loaded 46308 existing records from primary storage. [2025-10-07T20:26:55.061993] [INFO ] [MAIN ] NGG: Loaded 46308 existing records. [2025-10-07T20:26:55.248494] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:26:55.248819] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-07T20:26:55.248951] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-07T20:26:55.249379] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-07T20:26:55.249490] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-07T20:26:55.376924] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T20:26:55.659556] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:26:55.847691] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-07T20:26:56.106358] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T20:26:56.647748] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-07T20:26:57.447671] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-07T20:26:57.596760] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T20:26:57.645116] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T20:26:58.185698] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-07T20:26:58.247633] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-07T20:26:59.047760] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-07T20:26:59.716914] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T20:26:59.847723] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-07T20:27:00.092910] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T20:27:00.482767] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-07T20:27:00.647705] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-07T20:27:01.447738] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-07T20:27:02.150798] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T20:27:02.247702] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-07T20:27:02.493812] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T20:27:03.047624] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-07T20:27:03.429238] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T20:27:03.847696] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-07T20:27:04.563119] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T20:27:04.647704] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-07T20:27:04.730360] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T20:27:05.447684] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-07T20:27:06.187261] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T20:27:06.247732] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-07T20:27:06.384599] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T20:27:07.047764] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-07T20:27:07.417805] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T20:27:07.847736] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-07T20:27:08.647726] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-07T20:27:08.992637] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T20:27:09.062054] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T20:27:09.328866] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-07T20:27:09.447724] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-07T20:27:10.247717] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-07T20:27:10.594624] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T20:27:11.047708] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-07T20:27:11.847827] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-07T20:27:11.920582] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T20:27:11.976540] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T20:27:12.647667] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-07T20:27:12.656803] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T20:27:13.447707] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-07T20:27:13.752537] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T20:27:14.247745] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-07T20:27:15.047632] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-07T20:27:15.271574] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T20:27:15.511997] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T20:27:15.512992] [INFO ] [REMOTE ] NEXA: Full fetch complete (7581 records). [2025-10-07T20:27:15.513079] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-07T20:27:15.513685] [FATAL] [VALIDATOR ] NEXA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:27:15.513769] [FATAL] [MAIN ] NEXA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:27:15.513811] [WARN ] [MAIN ] NEXA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:27:15.513872] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-07T20:27:15.513957] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-07T20:27:15.513994] [INFO ] [LOCAL ] NEXA: Starting deletion of derivative data. [2025-10-07T20:27:15.514157] [DEBUG] [LOCAL ] NEXA: Deleted derivative data file. [2025-10-07T20:27:15.514277] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NEXA took 28.5s. Estimated remaining: 2h 6m 32s. Rate: 7.1 symbols/min [2025-10-07T20:27:15.687684] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:27:15.723531] [DEBUG] [LOCAL ] NGL: Loaded 30046 existing records from primary storage. [2025-10-07T20:27:15.723868] [INFO ] [MAIN ] NGL: Loaded 30046 existing records. [2025-10-07T20:27:15.847676] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-07T20:27:15.901067] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:27:15.902308] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-07T20:27:15.902622] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-07T20:27:15.903057] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-07T20:27:15.903116] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-07T20:27:16.281553] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:27:16.283485] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T20:27:16.647742] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-07T20:27:17.447737] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-07T20:27:17.745195] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T20:27:17.745742] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T20:27:18.247715] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-07T20:27:18.645869] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T20:27:19.047739] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-07T20:27:19.847712] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-07T20:27:20.175426] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T20:27:20.251396] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T20:27:20.647699] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-07T20:27:21.072519] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T20:27:21.447734] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-07T20:27:21.644945] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T20:27:21.646825] [INFO ] [REMOTE ] NFJ: Full fetch complete (30477 records). [2025-10-07T20:27:21.646897] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-07T20:27:22.073454] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-07T20:27:22.073601] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-07T20:27:22.074841] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-07T20:27:22.074914] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-07T20:27:22.076898] [DEBUG] [LOCAL ] NFJ: Trimmed 30477 records to 20463 (keeping 200 days of data) [2025-10-07T20:27:22.234766] [DEBUG] [LOCAL ] NFJ: Primary data saved (20463 records). [2025-10-07T20:27:22.234995] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-07T20:27:22.235150] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NFJ took 30.5s. Estimated remaining: 2h 6m 23s. Rate: 7.1 symbols/min [2025-10-07T20:27:22.252894] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-07T20:27:22.433895] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:27:22.450450] [DEBUG] [LOCAL ] NGS: Loaded 11418 existing records from primary storage. [2025-10-07T20:27:22.450843] [INFO ] [MAIN ] NGS: Loaded 11418 existing records. [2025-10-07T20:27:22.601264] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T20:27:22.738723] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:27:22.739082] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-07T20:27:22.739142] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-07T20:27:22.739400] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-07T20:27:22.739465] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-07T20:27:23.052914] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-07T20:27:23.134717] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:27:23.847632] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-07T20:27:23.997199] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T20:27:24.451527] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T20:27:24.647678] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-07T20:27:24.761937] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-07T20:27:25.447693] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-07T20:27:25.920825] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-07T20:27:26.247699] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-07T20:27:26.681285] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T20:27:27.047711] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-07T20:27:27.847678] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-07T20:27:27.985290] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T20:27:28.033974] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-07T20:27:28.647760] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-07T20:27:29.447631] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-07T20:27:29.491182] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T20:27:30.247610] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-07T20:27:30.247536] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T20:27:30.856033] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T20:27:30.859113] [INFO ] [REMOTE ] NGG: Full fetch complete (66018 records). [2025-10-07T20:27:30.859246] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-07T20:27:30.860543] [FATAL] [VALIDATOR ] NGG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:27:30.860662] [FATAL] [MAIN ] NGG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:27:30.860723] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:27:30.860794] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-07T20:27:30.860865] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-07T20:27:30.860902] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-07T20:27:30.861091] [DEBUG] [LOCAL ] NGG: Deleted derivative data file. [2025-10-07T20:27:30.861189] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NGG took 36.0s. Estimated remaining: 2h 6m 14s. Rate: 7.1 symbols/min [2025-10-07T20:27:31.038524] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:27:31.056800] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-07T20:27:31.061430] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T20:27:31.092045] [DEBUG] [LOCAL ] NGVC: Loaded 22455 existing records from primary storage. [2025-10-07T20:27:31.092445] [INFO ] [MAIN ] NGVC: Loaded 22455 existing records. [2025-10-07T20:27:31.279847] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:27:31.280180] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-07T20:27:31.280235] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-07T20:27:31.280600] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-07T20:27:31.280702] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-07T20:27:31.666959] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:27:31.847729] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-07T20:27:32.647729] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-07T20:27:32.704882] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T20:27:33.336837] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T20:27:33.447732] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-07T20:27:33.758388] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T20:27:34.020534] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:27:34.023227] [INFO ] [REMOTE ] NFG: Full fetch complete (56634 records). [2025-10-07T20:27:34.023330] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-07T20:27:34.024933] [FATAL] [VALIDATOR ] NFG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:27:34.025025] [FATAL] [MAIN ] NFG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:27:34.025075] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:27:34.025120] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-07T20:27:34.025180] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-07T20:27:34.025216] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-07T20:27:34.025356] [DEBUG] [LOCAL ] NFG: Deleted derivative data file. [2025-10-07T20:27:34.025455] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NFG took 44.8s. Estimated remaining: 2h 6m 3s. Rate: 7.1 symbols/min [2025-10-07T20:27:34.205732] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:27:34.233667] [DEBUG] [LOCAL ] NGVT: Loaded 24179 existing records from primary storage. [2025-10-07T20:27:34.233990] [INFO ] [MAIN ] NGVT: Loaded 24179 existing records. [2025-10-07T20:27:34.253836] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-07T20:27:34.428110] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:27:34.428418] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-07T20:27:34.428480] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-07T20:27:34.428727] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-07T20:27:34.428785] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-07T20:27:34.776284] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:27:35.047690] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-07T20:27:35.205804] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T20:27:35.847740] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-07T20:27:36.115562] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T20:27:36.647680] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-07T20:27:36.908975] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T20:27:37.447697] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-07T20:27:38.127791] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T20:27:38.247667] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-07T20:27:38.577037] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T20:27:39.047698] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-07T20:27:39.369084] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T20:27:39.847673] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-07T20:27:40.036045] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-07T20:27:40.647692] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-07T20:27:41.065202] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-07T20:27:41.134324] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T20:27:41.136073] [INFO ] [REMOTE ] NGL: Full fetch complete (41103 records). [2025-10-07T20:27:41.136159] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-07T20:27:41.136921] [FATAL] [VALIDATOR ] NGL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:27:41.137006] [FATAL] [MAIN ] NGL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:27:41.137049] [WARN ] [MAIN ] NGL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:27:41.137089] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-07T20:27:41.137148] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-07T20:27:41.137183] [INFO ] [LOCAL ] NGL: Starting deletion of derivative data. [2025-10-07T20:27:41.137349] [DEBUG] [LOCAL ] NGL: Deleted derivative data file. [2025-10-07T20:27:41.137439] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NGL took 25.6s. Estimated remaining: 2h 5m 53s. Rate: 7.1 symbols/min [2025-10-07T20:27:41.303911] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:27:41.325483] [DEBUG] [LOCAL ] NHI: Loaded 21832 existing records from primary storage. [2025-10-07T20:27:41.325771] [INFO ] [MAIN ] NHI: Loaded 21832 existing records. [2025-10-07T20:27:41.461143] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-07T20:27:41.501115] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:27:41.501296] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-07T20:27:41.501344] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-07T20:27:41.501529] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-07T20:27:41.501585] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-07T20:27:41.861136] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:27:42.247672] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-07T20:27:42.501021] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T20:27:43.047678] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-07T20:27:43.660870] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T20:27:43.728388] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-07T20:27:43.847638] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-07T20:27:44.647688] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-07T20:27:44.976968] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T20:27:45.447717] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-07T20:27:45.906097] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T20:27:46.247618] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-07T20:27:46.548471] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T20:27:47.047691] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-07T20:27:47.164345] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T20:27:47.847677] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-07T20:27:48.427400] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T20:27:48.647747] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-07T20:27:49.207531] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T20:27:49.447620] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-07T20:27:49.824603] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T20:27:50.247755] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-07T20:27:50.746835] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T20:27:50.747432] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T20:27:50.753555] [INFO ] [REMOTE ] NGS: Full fetch complete (17130 records). [2025-10-07T20:27:50.754410] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-07T20:27:50.754982] [FATAL] [VALIDATOR ] NGS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:27:50.755072] [FATAL] [MAIN ] NGS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:27:50.755146] [WARN ] [MAIN ] NGS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:27:50.755220] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-07T20:27:50.755289] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-07T20:27:50.755326] [INFO ] [LOCAL ] NGS: Starting deletion of derivative data. [2025-10-07T20:27:50.755501] [DEBUG] [LOCAL ] NGS: Deleted derivative data file. [2025-10-07T20:27:50.755602] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGS took 28.5s. Estimated remaining: 2h 5m 46s. Rate: 7.1 symbols/min [2025-10-07T20:27:51.047749] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-07T20:27:51.847731] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-07T20:27:52.243275] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T20:27:52.647680] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-07T20:27:53.063688] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-07T20:27:53.447769] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-07T20:27:53.896226] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T20:27:54.247762] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-07T20:27:54.485322] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T20:27:55.047689] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-07T20:27:55.605730] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T20:27:55.847739] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-07T20:27:56.323122] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T20:27:56.647725] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-07T20:27:56.861180] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T20:27:57.447678] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-07T20:27:57.889129] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T20:27:58.247697] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-07T20:27:58.705027] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-07T20:27:59.047762] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-07T20:27:59.469156] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-07T20:27:59.847670] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-07T20:28:00.441686] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T20:28:00.647627] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-07T20:28:01.165442] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T20:28:01.447686] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-07T20:28:01.664103] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T20:28:02.247740] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-07T20:28:02.723156] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T20:28:03.047771] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-07T20:28:03.453728] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T20:28:03.847737] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-07T20:28:04.393220] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T20:28:04.647736] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-07T20:28:05.097160] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T20:28:05.237580] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T20:28:05.239196] [INFO ] [REMOTE ] NGVC: Full fetch complete (30432 records). [2025-10-07T20:28:05.239273] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-07T20:28:05.240697] [FATAL] [VALIDATOR ] NGVC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:28:05.240775] [FATAL] [MAIN ] NGVC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:28:05.240813] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:28:05.240856] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-07T20:28:05.240915] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-07T20:28:05.240949] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-07T20:28:05.241146] [DEBUG] [LOCAL ] NGVC: Deleted derivative data file. [2025-10-07T20:28:05.241243] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGVC took 34.4s. Estimated remaining: 2h 5m 41s. Rate: 7.1 symbols/min [2025-10-07T20:28:05.447730] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-07T20:28:06.247788] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-07T20:28:06.385422] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-07T20:28:07.047724] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-07T20:28:07.404634] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T20:28:07.847709] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-07T20:28:08.209517] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T20:28:08.373582] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T20:28:08.375327] [INFO ] [REMOTE ] NGVT: Full fetch complete (34370 records). [2025-10-07T20:28:08.375411] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-07T20:28:08.375923] [FATAL] [VALIDATOR ] NGVT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:28:08.376008] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:28:08.376052] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:28:08.376091] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-07T20:28:08.376151] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-07T20:28:08.376186] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-07T20:28:08.376341] [DEBUG] [LOCAL ] NGVT: Deleted derivative data file. [2025-10-07T20:28:08.376436] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGVT took 34.4s. Estimated remaining: 2h 5m 29s. Rate: 7.1 symbols/min [2025-10-07T20:28:08.647764] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-07T20:28:09.626367] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T20:28:09.631222] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-07T20:28:10.088985] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T20:28:10.090730] [INFO ] [REMOTE ] NHI: Full fetch complete (31336 records). [2025-10-07T20:28:10.090819] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-07T20:28:10.091451] [FATAL] [VALIDATOR ] NHI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:28:10.091542] [FATAL] [MAIN ] NHI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:28:10.091608] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:28:10.091703] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-07T20:28:10.091775] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-07T20:28:10.091812] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-07T20:28:10.091992] [DEBUG] [LOCAL ] NHI: Deleted derivative data file. [2025-10-07T20:28:10.092088] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NHI took 29.0s. Estimated remaining: 2h 5m 17s. Rate: 7.1 symbols/min [2025-10-07T20:28:10.697203] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:10.695331] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:10.816213] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:10.821789] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-07T20:28:10.836120] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-07T20:28:10.839772] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:10.842893] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-07T20:28:10.843058] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-07T20:28:10.844001] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-07T20:28:10.849250] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-07T20:28:10.848427] [DEBUG] [LOCAL ] NIC: Loaded 8872 existing records from primary storage. [2025-10-07T20:28:10.866588] [DEBUG] [LOCAL ] NIE: Loaded 11940 existing records from primary storage. [2025-10-07T20:28:10.884714] [INFO ] [MAIN ] NIC: Loaded 8872 existing records. [2025-10-07T20:28:10.890439] [INFO ] [MAIN ] NIE: Loaded 11940 existing records. [2025-10-07T20:28:10.911388] [DEBUG] [LOCAL ] NIM: Loaded 4024 existing records from primary storage. [2025-10-07T20:28:10.964530] [INFO ] [MAIN ] NIM: Loaded 4024 existing records. [2025-10-07T20:28:11.685780] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:28:11.717110] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-07T20:28:11.716639] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:28:11.720845] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-07T20:28:11.724894] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-07T20:28:11.720956] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-07T20:28:11.769755] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:28:11.754701] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-07T20:28:11.802506] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-07T20:28:11.775570] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-07T20:28:11.766561] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-07T20:28:11.866492] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-07T20:28:11.857968] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:11.877164] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-07T20:28:11.899349] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-07T20:28:11.920756] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-07T20:28:11.960580] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-07T20:28:12.819052] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:12.855201] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-07T20:28:12.914499] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:12.920468] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-07T20:28:12.920086] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:12.921398] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-07T20:28:13.987331] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T20:28:13.999835] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-07T20:28:14.005809] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T20:28:14.019321] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T20:28:14.030431] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T20:28:14.247709] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-07T20:28:15.047711] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-07T20:28:15.179057] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T20:28:15.847717] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-07T20:28:15.888330] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T20:28:15.904867] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-07T20:28:16.557433] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-07T20:28:16.647680] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-07T20:28:17.447716] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-07T20:28:17.540460] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T20:28:18.171007] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T20:28:18.247666] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-07T20:28:19.047631] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-07T20:28:19.738731] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T20:28:19.775102] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T20:28:19.847698] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-07T20:28:20.647689] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-07T20:28:21.447698] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-07T20:28:21.546765] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T20:28:21.752560] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T20:28:22.247608] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-07T20:28:22.554101] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T20:28:23.047693] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-07T20:28:23.847731] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-07T20:28:23.951096] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T20:28:24.191746] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T20:28:24.647689] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-07T20:28:24.675803] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T20:28:25.447625] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-07T20:28:25.663547] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T20:28:26.247681] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-07T20:28:27.047628] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-07T20:28:27.110786] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T20:28:27.373434] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T20:28:27.847670] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-07T20:28:27.966829] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-07T20:28:28.647688] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-07T20:28:29.447636] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-07T20:28:29.470191] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T20:28:29.626013] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T20:28:30.247626] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-07T20:28:30.386413] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T20:28:31.047752] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-07T20:28:31.294124] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T20:28:31.541949] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-07T20:28:31.847721] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-07T20:28:32.647720] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-07T20:28:33.447750] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-07T20:28:33.710785] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T20:28:33.861131] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T20:28:34.158236] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T20:28:34.247630] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-07T20:28:35.047679] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-07T20:28:35.214390] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T20:28:35.643152] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T20:28:35.847677] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-07T20:28:36.547230] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-07T20:28:36.647639] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-07T20:28:37.447625] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-07T20:28:37.520430] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T20:28:38.148474] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T20:28:38.247692] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-07T20:28:39.047628] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-07T20:28:39.122473] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T20:28:39.847752] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-07T20:28:39.913831] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T20:28:39.915739] [INFO ] [REMOTE ] NIE: Full fetch complete (16664 records). [2025-10-07T20:28:39.915884] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-07T20:28:40.290830] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-07T20:28:40.291037] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-07T20:28:40.291449] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-07T20:28:40.291493] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-07T20:28:40.292052] [DEBUG] [LOCAL ] NIE: Trimmed 16664 records to 11930 (keeping 200 days of data) [2025-10-07T20:28:40.371080] [DEBUG] [LOCAL ] NIE: Primary data saved (11930 records). [2025-10-07T20:28:40.371249] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-07T20:28:40.371377] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NIE took 30.3s. Estimated remaining: 2h 5m 21s. Rate: 7.1 symbols/min [2025-10-07T20:28:40.550587] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:40.578536] [DEBUG] [LOCAL ] NINE: Loaded 28140 existing records from primary storage. [2025-10-07T20:28:40.578857] [INFO ] [MAIN ] NINE: Loaded 28140 existing records. [2025-10-07T20:28:40.652748] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-07T20:28:40.758597] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:28:40.758833] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-07T20:28:40.758884] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-07T20:28:40.759203] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-07T20:28:40.759262] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-07T20:28:41.148555] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:41.282912] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T20:28:41.447622] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-07T20:28:41.836802] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T20:28:41.919907] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T20:28:41.921062] [INFO ] [REMOTE ] NIC: Full fetch complete (12283 records). [2025-10-07T20:28:41.921134] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-07T20:28:41.921517] [FATAL] [VALIDATOR ] NIC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:28:41.921603] [FATAL] [MAIN ] NIC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:28:41.921804] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:28:41.921880] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-07T20:28:41.921959] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-07T20:28:41.922032] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-07T20:28:41.922245] [DEBUG] [LOCAL ] NIC: Deleted derivative data file. [2025-10-07T20:28:41.922334] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NIC took 31.8s. Estimated remaining: 2h 5m 9s. Rate: 7.1 symbols/min [2025-10-07T20:28:42.114627] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:42.176857] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-07T20:28:42.177362] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-07T20:28:42.252785] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-07T20:28:42.474460] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:28:42.474841] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-07T20:28:42.474918] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-07T20:28:42.475373] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-07T20:28:42.475450] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-07T20:28:42.994129] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:43.047741] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-07T20:28:43.621238] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T20:28:43.660458] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T20:28:43.847726] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-07T20:28:44.647698] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-07T20:28:45.447726] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-07T20:28:45.839683] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T20:28:45.963911] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T20:28:45.964768] [INFO ] [REMOTE ] NIM: Full fetch complete (6646 records). [2025-10-07T20:28:45.964837] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-07T20:28:46.249952] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-07T20:28:46.332116] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-07T20:28:46.332207] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-07T20:28:46.332414] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-07T20:28:46.332454] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-07T20:28:46.333036] [DEBUG] [LOCAL ] NIM: Trimmed 6646 records to 3982 (keeping 200 days of data) [2025-10-07T20:28:46.359406] [DEBUG] [LOCAL ] NIM: Primary data saved (3982 records). [2025-10-07T20:28:46.359509] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-07T20:28:46.359592] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NIM took 36.2s. Estimated remaining: 2h 4m 58s. Rate: 7.1 symbols/min [2025-10-07T20:28:46.540948] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:46.541173] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-07T20:28:46.541216] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-07T20:28:46.541330] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-07T20:28:46.541389] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-07T20:28:46.541465] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-07T20:28:46.541524] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-07T20:28:46.906596] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:47.030368] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-07T20:28:47.049450] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-07T20:28:47.053171] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-07T20:28:47.057704] [INFO ] [REMOTE ] NI: Full fetch complete (76879 records). [2025-10-07T20:28:47.057968] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-07T20:28:47.059397] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:28:47.059529] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:28:47.059594] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:28:47.059696] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-07T20:28:47.059788] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-07T20:28:47.059829] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-07T20:28:47.059869] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-07T20:28:47.059944] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 37.0s. Estimated remaining: 2h 4m 45s. Rate: 7.1 symbols/min [2025-10-07T20:28:47.249132] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:47.293946] [DEBUG] [LOCAL ] NJR: Loaded 38271 existing records from primary storage. [2025-10-07T20:28:47.294384] [INFO ] [MAIN ] NJR: Loaded 38271 existing records. [2025-10-07T20:28:47.489893] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:28:47.490275] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-07T20:28:47.490336] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-07T20:28:47.490690] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-07T20:28:47.490749] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-07T20:28:47.850726] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-07T20:28:47.874815] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:48.647822] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-07T20:28:48.939537] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T20:28:49.447716] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-07T20:28:49.893724] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T20:28:50.247684] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-07T20:28:50.449390] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-07T20:28:50.556538] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:28:50.556966] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-07T20:28:50.557140] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:28:50.557226] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-07T20:28:50.557305] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:28:50.557394] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-07T20:28:50.557506] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-07T20:28:50.557580] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-07T20:28:50.557784] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-07T20:28:50.558019] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIQ took 4.2s. Estimated remaining: 2h 4m 34s. Rate: 7.1 symbols/min [2025-10-07T20:28:50.728828] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:28:50.729081] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-07T20:28:50.729126] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-07T20:28:50.729234] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-07T20:28:50.729300] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-07T20:28:50.729378] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-07T20:28:50.729423] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-07T20:28:51.026680] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T20:28:51.049247] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-07T20:28:51.116975] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:28:51.847756] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-07T20:28:52.647753] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-07T20:28:53.447628] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-07T20:28:53.712032] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-07T20:28:54.112935] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T20:28:54.247685] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-07T20:28:54.601921] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-07T20:28:54.769151] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T20:28:55.047755] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-07T20:28:55.697850] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T20:28:55.847685] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-07T20:28:56.647725] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-07T20:28:57.447634] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-07T20:28:57.681537] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-07T20:28:58.250684] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-07T20:28:58.256562] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T20:28:58.593685] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-07T20:28:59.026855] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T20:28:59.047707] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-07T20:28:59.847720] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-07T20:29:00.647728] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-07T20:29:00.785034] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-07T20:29:01.097201] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-07T20:29:01.447702] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-07T20:29:01.551622] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T20:29:02.247735] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-07T20:29:03.048424] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-07T20:29:03.050609] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T20:29:03.289869] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-07T20:29:03.547456] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T20:29:03.847772] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-07T20:29:04.647632] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-07T20:29:05.369157] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-07T20:29:05.447598] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-07T20:29:06.144203] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-07T20:29:06.247734] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-07T20:29:06.329995] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T20:29:07.047704] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-07T20:29:07.545831] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T20:29:07.847695] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-07T20:29:08.227170] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-07T20:29:08.647727] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-07T20:29:09.202814] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T20:29:09.447680] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-07T20:29:09.744246] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-07T20:29:09.889775] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T20:29:10.247629] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-07T20:29:10.261181] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T20:29:10.262978] [INFO ] [REMOTE ] NINE: Full fetch complete (43376 records). [2025-10-07T20:29:10.263064] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-07T20:29:10.263632] [FATAL] [VALIDATOR ] NINE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:29:10.263738] [FATAL] [MAIN ] NINE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:29:10.263787] [WARN ] [MAIN ] NINE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:29:10.263860] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-07T20:29:10.263973] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-07T20:29:10.264031] [INFO ] [LOCAL ] NINE: Starting deletion of derivative data. [2025-10-07T20:29:10.264209] [DEBUG] [LOCAL ] NINE: Deleted derivative data file. [2025-10-07T20:29:10.264318] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NINE took 29.9s. Estimated remaining: 2h 4m 32s. Rate: 7.1 symbols/min [2025-10-07T20:29:10.435888] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:29:10.451786] [DEBUG] [LOCAL ] NKX: Loaded 13646 existing records from primary storage. [2025-10-07T20:29:10.452036] [INFO ] [MAIN ] NKX: Loaded 13646 existing records. [2025-10-07T20:29:10.632201] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:29:10.632395] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-07T20:29:10.632445] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-07T20:29:10.632751] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-07T20:29:10.632819] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-07T20:29:10.992991] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:29:11.047617] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-07T20:29:11.847675] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-07T20:29:12.092018] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T20:29:12.647731] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-07T20:29:13.447713] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-07T20:29:13.710211] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-07T20:29:14.247971] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-07T20:29:14.250826] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T20:29:14.568039] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-07T20:29:14.608728] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T20:29:15.047691] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-07T20:29:15.847637] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-07T20:29:16.003393] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T20:29:16.647679] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-07T20:29:16.832630] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-07T20:29:17.447632] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-07T20:29:17.512381] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T20:29:17.667084] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T20:29:18.247762] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-07T20:29:18.874744] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:29:18.878587] [INFO ] [REMOTE ] NJR: Full fetch complete (54484 records). [2025-10-07T20:29:18.878800] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-07T20:29:18.879629] [FATAL] [VALIDATOR ] NJR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:29:18.879742] [FATAL] [MAIN ] NJR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:29:18.879787] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:29:18.879830] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-07T20:29:18.879895] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-07T20:29:18.879932] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-07T20:29:18.880099] [DEBUG] [LOCAL ] NJR: Deleted derivative data file. [2025-10-07T20:29:18.880219] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NJR took 31.8s. Estimated remaining: 2h 4m 24s. Rate: 7.1 symbols/min [2025-10-07T20:29:19.046954] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:29:19.047182] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-07T20:29:19.047220] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-07T20:29:19.047332] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-07T20:29:19.047373] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-07T20:29:19.047413] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-07T20:29:19.047448] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-07T20:29:19.058687] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-07T20:29:19.402821] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:29:19.847703] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-07T20:29:20.269771] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-07T20:29:20.591637] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-07T20:29:20.647604] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-07T20:29:21.165742] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-07T20:29:21.442997] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-07T20:29:21.453717] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-07T20:29:22.247723] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-07T20:29:22.349624] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T20:29:23.047707] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-07T20:29:23.798749] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T20:29:23.847613] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-07T20:29:24.559639] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-07T20:29:24.647714] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-07T20:29:24.733731] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-07T20:29:25.447727] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-07T20:29:25.924770] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:29:25.928585] [INFO ] [REMOTE ] NIO: Full fetch complete (77584 records). [2025-10-07T20:29:25.928884] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-07T20:29:25.930173] [FATAL] [VALIDATOR ] NIO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:29:25.930306] [FATAL] [MAIN ] NIO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:29:25.930359] [WARN ] [MAIN ] NIO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:29:25.930437] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-07T20:29:25.930523] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-07T20:29:25.930596] [INFO ] [LOCAL ] NIO: Starting deletion of derivative data. [2025-10-07T20:29:25.930948] [DEBUG] [LOCAL ] NIO: Deleted derivative data file. [2025-10-07T20:29:25.931119] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NIO took 44.0s. Estimated remaining: 2h 4m 14s. Rate: 7.1 symbols/min [2025-10-07T20:29:26.128966] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:29:26.144237] [DEBUG] [LOCAL ] NLOP: Loaded 11756 existing records from primary storage. [2025-10-07T20:29:26.144574] [INFO ] [MAIN ] NLOP: Loaded 11756 existing records. [2025-10-07T20:29:26.248898] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-07T20:29:26.336486] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:29:26.336836] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-07T20:29:26.336900] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-07T20:29:26.337195] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-07T20:29:26.337253] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-07T20:29:26.705145] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:29:27.047629] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-07T20:29:27.107914] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-07T20:29:27.219131] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-07T20:29:27.698477] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T20:29:27.847679] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-07T20:29:28.587531] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-07T20:29:28.647608] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-07T20:29:29.350172] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T20:29:29.447706] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-07T20:29:30.250270] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-07T20:29:30.252507] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T20:29:31.047703] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-07T20:29:31.135908] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T20:29:31.847732] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-07T20:29:32.647693] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-07T20:29:33.033346] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T20:29:33.131329] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-07T20:29:33.447626] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-07T20:29:33.646800] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-07T20:29:34.247724] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-07T20:29:34.260977] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T20:29:34.896170] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:29:34.901525] [INFO ] [REMOTE ] NKE: Full fetch complete (76807 records). [2025-10-07T20:29:34.901808] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-07T20:29:34.903278] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:29:34.903469] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:29:34.903524] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:29:34.903582] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-07T20:29:34.903704] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-07T20:29:34.903778] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-07T20:29:34.903855] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-07T20:29:34.903954] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NKE took 44.3s. Estimated remaining: 2h 4m 6s. Rate: 7.1 symbols/min [2025-10-07T20:29:35.052852] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-07T20:29:35.123824] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:29:35.181070] [DEBUG] [LOCAL ] NLY: Loaded 53575 existing records from primary storage. [2025-10-07T20:29:35.181452] [INFO ] [MAIN ] NLY: Loaded 53575 existing records. [2025-10-07T20:29:35.371897] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:29:35.372157] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-07T20:29:35.372254] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-07T20:29:35.372715] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-07T20:29:35.372774] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-07T20:29:35.725958] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:29:35.823163] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T20:29:35.847674] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-07T20:29:36.647624] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-07T20:29:36.924863] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-07T20:29:36.925938] [INFO ] [REMOTE ] NL: Full fetch complete (6767 records). [2025-10-07T20:29:36.926081] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-07T20:29:36.936888] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T20:29:36.936552] [FATAL] [VALIDATOR ] NL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:29:36.941100] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:29:36.941413] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:29:36.941487] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-07T20:29:36.941556] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-07T20:29:36.941592] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-07T20:29:36.941631] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-07T20:29:36.941725] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NL took 18.1s. Estimated remaining: 2h 3m 54s. Rate: 7.1 symbols/min [2025-10-07T20:29:37.107219] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:29:37.121779] [DEBUG] [LOCAL ] NMAI: Loaded 12867 existing records from primary storage. [2025-10-07T20:29:37.122019] [INFO ] [MAIN ] NMAI: Loaded 12867 existing records. [2025-10-07T20:29:37.293791] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:29:37.293994] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-07T20:29:37.294041] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-07T20:29:37.294283] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-07T20:29:37.294339] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-07T20:29:37.447861] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-07T20:29:37.648319] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:29:38.247729] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-07T20:29:39.047674] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-07T20:29:39.357771] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T20:29:39.775179] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-07T20:29:39.847673] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-07T20:29:40.144843] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T20:29:40.647680] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-07T20:29:40.882287] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T20:29:41.447729] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-07T20:29:41.728725] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T20:29:42.247705] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-07T20:29:42.359689] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T20:29:43.047624] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-07T20:29:43.231377] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T20:29:43.847745] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-07T20:29:43.939090] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T20:29:44.647750] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-07T20:29:44.981202] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T20:29:45.447725] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-07T20:29:45.695489] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T20:29:46.247768] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-07T20:29:46.709540] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T20:29:47.047719] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-07T20:29:47.482709] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T20:29:47.847755] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-07T20:29:47.896287] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T20:29:47.898014] [INFO ] [REMOTE ] NKX: Full fetch complete (19430 records). [2025-10-07T20:29:47.898112] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-07T20:29:48.306557] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-07T20:29:48.306688] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-07T20:29:48.307429] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-07T20:29:48.307515] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-07T20:29:48.308395] [DEBUG] [LOCAL ] NKX: Trimmed 19430 records to 13597 (keeping 200 days of data) [2025-10-07T20:29:48.408033] [DEBUG] [LOCAL ] NKX: Primary data saved (13597 records). [2025-10-07T20:29:48.408247] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-07T20:29:48.408357] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NKX took 38.1s. Estimated remaining: 2h 3m 47s. Rate: 7.1 symbols/min [2025-10-07T20:29:48.601743] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:29:48.602140] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-07T20:29:48.602197] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-07T20:29:48.602376] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-07T20:29:48.602456] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-07T20:29:48.602524] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-07T20:29:48.602562] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-07T20:29:48.660085] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-07T20:29:48.740077] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-07T20:29:48.998977] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:29:49.447703] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-07T20:29:50.247748] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-07T20:29:50.303167] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T20:29:50.736733] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-07T20:29:51.047674] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-07T20:29:51.144826] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T20:29:51.551888] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:29:51.552227] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-07T20:29:51.552318] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:29:51.552365] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-07T20:29:51.552427] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:29:51.552523] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-07T20:29:51.552616] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-07T20:29:51.552741] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-07T20:29:51.552821] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-07T20:29:51.552878] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NMAX took 3.1s. Estimated remaining: 2h 3m 36s. Rate: 7.1 symbols/min [2025-10-07T20:29:51.750156] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:29:51.769787] [DEBUG] [LOCAL ] NMCO: Loaded 16847 existing records from primary storage. [2025-10-07T20:29:51.770057] [INFO ] [MAIN ] NMCO: Loaded 16847 existing records. [2025-10-07T20:29:51.852785] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-07T20:29:51.998470] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:29:51.998750] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-07T20:29:51.998812] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-07T20:29:51.999270] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-07T20:29:51.999338] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-07T20:29:52.395416] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:29:52.647630] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-07T20:29:52.950066] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T20:29:53.447700] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-07T20:29:54.247699] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-07T20:29:54.401743] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T20:29:54.508442] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T20:29:55.047722] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-07T20:29:55.115124] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T20:29:55.847719] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-07T20:29:56.080929] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T20:29:56.613617] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T20:29:56.647604] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-07T20:29:57.447630] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-07T20:29:57.705021] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T20:29:58.247684] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-07T20:29:58.647638] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T20:29:59.047710] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-07T20:29:59.847626] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-07T20:30:00.164688] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T20:30:00.331359] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T20:30:00.647683] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-07T20:30:00.863506] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T20:30:00.948634] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-07T20:30:00.949774] [INFO ] [REMOTE ] NLOP: Full fetch complete (17715 records). [2025-10-07T20:30:00.949867] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-07T20:30:00.950344] [FATAL] [VALIDATOR ] NLOP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:30:00.950429] [FATAL] [MAIN ] NLOP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:30:00.950558] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:30:00.950635] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-07T20:30:00.950742] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-07T20:30:00.950782] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-07T20:30:00.950964] [DEBUG] [LOCAL ] NLOP: Deleted derivative data file. [2025-10-07T20:30:00.951076] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NLOP took 35.0s. Estimated remaining: 2h 3m 28s. Rate: 7.1 symbols/min [2025-10-07T20:30:01.118559] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:30:01.130084] [DEBUG] [LOCAL ] NMG: Loaded 8586 existing records from primary storage. [2025-10-07T20:30:01.130323] [INFO ] [MAIN ] NMG: Loaded 8586 existing records. [2025-10-07T20:30:01.353015] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:30:01.353294] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-07T20:30:01.353346] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-07T20:30:01.353519] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-07T20:30:01.353576] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-07T20:30:01.452816] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-07T20:30:01.732692] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:30:02.247610] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-07T20:30:02.633786] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T20:30:03.047696] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-07T20:30:03.443358] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T20:30:03.847621] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-07T20:30:04.118999] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T20:30:04.647690] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-07T20:30:05.447723] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-07T20:30:05.996443] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T20:30:06.105004] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:30:06.108004] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-07T20:30:06.121217] [INFO ] [REMOTE ] NMAI: Full fetch complete (19825 records). [2025-10-07T20:30:06.121894] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-07T20:30:06.123219] [FATAL] [VALIDATOR ] NMAI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:30:06.123322] [FATAL] [MAIN ] NMAI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:30:06.123371] [WARN ] [MAIN ] NMAI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:30:06.123477] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-07T20:30:06.123585] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-07T20:30:06.123690] [INFO ] [LOCAL ] NMAI: Starting deletion of derivative data. [2025-10-07T20:30:06.123988] [DEBUG] [LOCAL ] NMAI: Deleted derivative data file. [2025-10-07T20:30:06.124134] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NMAI took 29.2s. Estimated remaining: 2h 3m 17s. Rate: 7.1 symbols/min [2025-10-07T20:30:06.252879] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-07T20:30:06.321179] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:30:06.332170] [DEBUG] [LOCAL ] NMI: Loaded 4055 existing records from primary storage. [2025-10-07T20:30:06.332460] [INFO ] [MAIN ] NMI: Loaded 4055 existing records. [2025-10-07T20:30:06.529544] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:30:06.529955] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-07T20:30:06.530073] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-07T20:30:06.530345] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-07T20:30:06.530416] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-07T20:30:06.922486] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:30:07.047770] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-07T20:30:07.485161] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T20:30:07.847665] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-07T20:30:08.211485] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T20:30:08.647719] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-07T20:30:08.679220] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-07T20:30:09.307370] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T20:30:09.447757] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-07T20:30:10.247762] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-07T20:30:11.047762] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-07T20:30:11.430550] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T20:30:11.760360] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-07T20:30:11.782107] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T20:30:11.847610] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-07T20:30:12.647721] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-07T20:30:12.845235] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-07T20:30:13.447613] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-07T20:30:13.825083] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T20:30:14.023254] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T20:30:14.247752] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-07T20:30:14.961857] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-07T20:30:15.047703] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-07T20:30:15.847669] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-07T20:30:15.881048] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-07T20:30:16.569699] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T20:30:16.647719] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-07T20:30:17.447751] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-07T20:30:18.247791] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-07T20:30:18.445815] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T20:30:18.467301] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T20:30:19.047749] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-07T20:30:19.165572] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:30:19.847671] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-07T20:30:20.165546] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T20:30:20.444500] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T20:30:20.647738] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-07T20:30:21.164181] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T20:30:21.167035] [INFO ] [REMOTE ] NMCO: Full fetch complete (23971 records). [2025-10-07T20:30:21.167134] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-07T20:30:21.167833] [FATAL] [VALIDATOR ] NMCO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:30:21.167921] [FATAL] [MAIN ] NMCO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:30:21.167965] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:30:21.168041] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-07T20:30:21.168155] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-07T20:30:21.168213] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-07T20:30:21.168374] [DEBUG] [LOCAL ] NMCO: Deleted derivative data file. [2025-10-07T20:30:21.168488] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMCO took 29.6s. Estimated remaining: 2h 3m 13s. Rate: 7.1 symbols/min [2025-10-07T20:30:21.339461] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:30:21.359369] [DEBUG] [LOCAL ] NMM: Loaded 14408 existing records from primary storage. [2025-10-07T20:30:21.359631] [INFO ] [MAIN ] NMM: Loaded 14408 existing records. [2025-10-07T20:30:21.456120] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-07T20:30:21.543240] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:30:21.543491] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-07T20:30:21.543571] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-07T20:30:21.543867] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-07T20:30:21.543927] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-07T20:30:21.905229] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:30:22.247720] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-07T20:30:22.958994] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T20:30:23.047712] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-07T20:30:23.664245] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-07T20:30:23.693293] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-07T20:30:23.847674] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-07T20:30:24.618024] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T20:30:24.647691] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-07T20:30:25.373079] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-07T20:30:25.447666] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-07T20:30:26.247634] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-07T20:30:26.623688] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T20:30:27.047055] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T20:30:27.049917] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-07T20:30:27.847633] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-07T20:30:27.890450] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T20:30:28.525012] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:30:28.525877] [INFO ] [REMOTE ] NMI: Full fetch complete (5993 records). [2025-10-07T20:30:28.525995] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-07T20:30:28.662546] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-07T20:30:28.903105] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-07T20:30:28.903189] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-07T20:30:28.903531] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-07T20:30:28.903619] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-07T20:30:28.904210] [DEBUG] [LOCAL ] NMI: Trimmed 5993 records to 4057 (keeping 200 days of data) [2025-10-07T20:30:28.933530] [DEBUG] [LOCAL ] NMI: Primary data saved (4057 records). [2025-10-07T20:30:28.933623] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-07T20:30:28.933738] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMI took 22.8s. Estimated remaining: 2h 3m 4s. Rate: 7.1 symbols/min [2025-10-07T20:30:29.140781] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:30:29.181350] [DEBUG] [LOCAL ] NMR: Loaded 35092 existing records from primary storage. [2025-10-07T20:30:29.181714] [INFO ] [MAIN ] NMR: Loaded 35092 existing records. [2025-10-07T20:30:29.361121] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:30:29.361394] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-07T20:30:29.361450] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-07T20:30:29.361772] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-07T20:30:29.361832] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-07T20:30:29.456724] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-07T20:30:29.720601] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:30:29.921536] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T20:30:30.247748] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-07T20:30:30.435414] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T20:30:31.047711] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-07T20:30:31.847826] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-07T20:30:32.334025] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-07T20:30:32.365635] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T20:30:32.647740] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-07T20:30:32.983618] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T20:30:33.447711] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-07T20:30:33.466629] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T20:30:34.247699] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-07T20:30:34.510408] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T20:30:35.047695] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-07T20:30:35.749977] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T20:30:35.847670] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-07T20:30:36.293953] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T20:30:36.647691] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-07T20:30:37.339371] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T20:30:37.447618] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-07T20:30:37.619971] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T20:30:38.247685] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-07T20:30:38.796463] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T20:30:38.798031] [INFO ] [REMOTE ] NMG: Full fetch complete (13450 records). [2025-10-07T20:30:38.798101] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-07T20:30:38.798627] [FATAL] [VALIDATOR ] NMG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:30:38.798727] [FATAL] [MAIN ] NMG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:30:38.798770] [WARN ] [MAIN ] NMG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:30:38.798821] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-07T20:30:38.798901] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-07T20:30:38.798939] [INFO ] [LOCAL ] NMG: Starting deletion of derivative data. [2025-10-07T20:30:38.799109] [DEBUG] [LOCAL ] NMG: Deleted derivative data file. [2025-10-07T20:30:38.799198] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMG took 37.8s. Estimated remaining: 2h 2m 56s. Rate: 7.1 symbols/min [2025-10-07T20:30:38.970706] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:30:38.991859] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T20:30:39.001702] [DEBUG] [LOCAL ] NMS: Loaded 2855 existing records from primary storage. [2025-10-07T20:30:39.002105] [INFO ] [MAIN ] NMS: Loaded 2855 existing records. [2025-10-07T20:30:39.052928] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-07T20:30:39.177701] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:30:39.177931] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-07T20:30:39.178042] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-07T20:30:39.178236] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-07T20:30:39.178291] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-07T20:30:39.529265] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:30:39.847637] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-07T20:30:40.647628] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-07T20:30:40.900693] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T20:30:41.215717] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-07T20:30:41.447667] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-07T20:30:42.025797] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:30:42.028947] [INFO ] [REMOTE ] NLY: Full fetch complete (77175 records). [2025-10-07T20:30:42.029074] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-07T20:30:42.031315] [FATAL] [VALIDATOR ] NLY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:30:42.031409] [FATAL] [MAIN ] NLY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:30:42.031453] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:30:42.031492] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-07T20:30:42.031555] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-07T20:30:42.031590] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-07T20:30:42.031799] [DEBUG] [LOCAL ] NLY: Deleted derivative data file. [2025-10-07T20:30:42.031894] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NLY took 1m 7s. Estimated remaining: 2h 2m 45s. Rate: 7.1 symbols/min [2025-10-07T20:30:42.200727] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:30:42.229057] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T20:30:42.231272] [DEBUG] [LOCAL ] NMT: Loaded 2867 existing records from primary storage. [2025-10-07T20:30:42.240926] [INFO ] [MAIN ] NMT: Loaded 2867 existing records. [2025-10-07T20:30:42.252753] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-07T20:30:42.418705] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:30:42.418987] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-07T20:30:42.419061] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-07T20:30:42.419256] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-07T20:30:42.419314] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-07T20:30:42.769661] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:30:42.830218] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T20:30:43.047700] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-07T20:30:43.847704] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-07T20:30:44.372337] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-07T20:30:44.610796] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T20:30:44.647630] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-07T20:30:45.447735] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-07T20:30:46.140387] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T20:30:46.140551] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-07T20:30:46.247600] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-07T20:30:46.980831] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-07T20:30:47.047628] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-07T20:30:47.684536] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T20:30:47.847628] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-07T20:30:48.472293] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T20:30:48.647710] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-07T20:30:49.447679] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-07T20:30:49.624460] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T20:30:50.247729] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-07T20:30:51.047615] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-07T20:30:51.145498] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T20:30:51.327963] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T20:30:51.438009] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-07T20:30:51.847727] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-07T20:30:52.558580] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T20:30:52.647624] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-07T20:30:53.425487] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T20:30:53.447625] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-07T20:30:54.247707] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-07T20:30:54.502700] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-07T20:30:54.879031] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T20:30:55.047717] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-07T20:30:55.712489] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T20:30:55.847706] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-07T20:30:56.335459] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T20:30:56.336868] [INFO ] [REMOTE ] NMM: Full fetch complete (21733 records). [2025-10-07T20:30:56.336938] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-07T20:30:56.337427] [FATAL] [VALIDATOR ] NMM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:30:56.337530] [FATAL] [MAIN ] NMM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:30:56.337583] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:30:56.337678] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-07T20:30:56.337758] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-07T20:30:56.337798] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-07T20:30:56.337944] [DEBUG] [LOCAL ] NMM: Deleted derivative data file. [2025-10-07T20:30:56.338034] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMM took 35.2s. Estimated remaining: 2h 2m 40s. Rate: 7.1 symbols/min [2025-10-07T20:30:56.507204] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:30:56.530562] [DEBUG] [LOCAL ] NMZ: Loaded 21640 existing records from primary storage. [2025-10-07T20:30:56.530919] [INFO ] [MAIN ] NMZ: Loaded 21640 existing records. [2025-10-07T20:30:56.652751] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-07T20:30:56.707294] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:30:56.707582] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-07T20:30:56.707636] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-07T20:30:56.707956] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-07T20:30:56.707998] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-07T20:30:57.061135] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:30:57.447698] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-07T20:30:58.035052] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T20:30:58.243886] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T20:30:58.250901] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-07T20:30:58.850632] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T20:30:59.047668] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-07T20:30:59.795085] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T20:30:59.847616] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-07T20:31:00.647681] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-07T20:31:01.403020] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T20:31:01.401907] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T20:31:01.447609] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-07T20:31:02.063879] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T20:31:02.247675] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-07T20:31:02.741015] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-07T20:31:03.047698] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-07T20:31:03.681791] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T20:31:03.847671] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-07T20:31:04.422545] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:31:04.425274] [INFO ] [REMOTE ] NMR: Full fetch complete (50548 records). [2025-10-07T20:31:04.425395] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-07T20:31:04.426190] [FATAL] [VALIDATOR ] NMR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:31:04.426301] [FATAL] [MAIN ] NMR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:31:04.426345] [WARN ] [MAIN ] NMR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:31:04.426385] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-07T20:31:04.426481] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-07T20:31:04.426566] [INFO ] [LOCAL ] NMR: Starting deletion of derivative data. [2025-10-07T20:31:04.426829] [DEBUG] [LOCAL ] NMR: Deleted derivative data file. [2025-10-07T20:31:04.426930] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMR took 35.5s. Estimated remaining: 2h 2m 31s. Rate: 7.1 symbols/min [2025-10-07T20:31:04.609276] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:31:04.623572] [DEBUG] [LOCAL ] NNI: Loaded 10305 existing records from primary storage. [2025-10-07T20:31:04.623904] [INFO ] [MAIN ] NNI: Loaded 10305 existing records. [2025-10-07T20:31:04.656118] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-07T20:31:04.816923] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:31:04.817156] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-07T20:31:04.817216] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-07T20:31:04.817392] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-07T20:31:04.817447] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-07T20:31:05.195377] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:31:05.373206] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T20:31:05.447619] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-07T20:31:05.923919] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:31:05.924786] [INFO ] [REMOTE ] NMS: Full fetch complete (4025 records). [2025-10-07T20:31:05.924866] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-07T20:31:06.252880] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-07T20:31:06.348012] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-07T20:31:06.348098] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-07T20:31:06.348278] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-07T20:31:06.348319] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-07T20:31:06.348706] [DEBUG] [LOCAL ] NMS: Trimmed 4025 records to 2824 (keeping 200 days of data) [2025-10-07T20:31:06.366147] [DEBUG] [LOCAL ] NMS: Primary data saved (2824 records). [2025-10-07T20:31:06.366219] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-07T20:31:06.366291] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMS took 27.6s. Estimated remaining: 2h 2m 19s. Rate: 7.1 symbols/min [2025-10-07T20:31:06.529272] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:31:06.596947] [DEBUG] [LOCAL ] NNN: Loaded 48402 existing records from primary storage. [2025-10-07T20:31:06.597581] [INFO ] [MAIN ] NNN: Loaded 48402 existing records. [2025-10-07T20:31:06.770272] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:31:06.770509] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-07T20:31:06.770557] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-07T20:31:06.770904] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-07T20:31:06.770965] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-07T20:31:07.052944] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-07T20:31:07.116255] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:31:07.639606] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T20:31:07.784084] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T20:31:07.847668] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-07T20:31:08.647677] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-07T20:31:09.447673] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-07T20:31:09.471193] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T20:31:09.568230] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T20:31:10.247707] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-07T20:31:11.047722] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-07T20:31:11.373627] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-07T20:31:11.446615] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T20:31:11.573159] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T20:31:11.573980] [INFO ] [REMOTE ] NMT: Full fetch complete (4085 records). [2025-10-07T20:31:11.574055] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-07T20:31:11.853018] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-07T20:31:11.950753] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-07T20:31:11.950843] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-07T20:31:11.950992] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-07T20:31:11.951033] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-07T20:31:11.951386] [DEBUG] [LOCAL ] NMT: Trimmed 4085 records to 2859 (keeping 200 days of data) [2025-10-07T20:31:11.970230] [DEBUG] [LOCAL ] NMT: Primary data saved (2859 records). [2025-10-07T20:31:11.970311] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-07T20:31:11.970420] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMT took 29.9s. Estimated remaining: 2h 2m 9s. Rate: 7.1 symbols/min [2025-10-07T20:31:12.145977] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:31:12.155836] [DEBUG] [LOCAL ] NNY: Loaded 5717 existing records from primary storage. [2025-10-07T20:31:12.156069] [INFO ] [MAIN ] NNY: Loaded 5717 existing records. [2025-10-07T20:31:12.331912] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:31:12.332160] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-07T20:31:12.332216] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-07T20:31:12.332429] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-07T20:31:12.332486] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-07T20:31:12.652758] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-07T20:31:12.690608] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:31:13.447671] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-07T20:31:13.688799] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T20:31:13.886121] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-07T20:31:13.971129] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-07T20:31:14.247742] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-07T20:31:15.047721] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-07T20:31:15.680577] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T20:31:15.847697] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-07T20:31:15.856603] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T20:31:16.647762] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-07T20:31:16.774184] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T20:31:17.447694] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-07T20:31:18.247681] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-07T20:31:18.488792] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T20:31:18.497971] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T20:31:19.047708] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-07T20:31:19.439260] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T20:31:19.847691] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-07T20:31:19.874666] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T20:31:20.647636] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-07T20:31:20.770302] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T20:31:21.352708] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T20:31:21.447704] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-07T20:31:22.247624] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-07T20:31:22.638434] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T20:31:22.851719] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T20:31:23.047687] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-07T20:31:23.847691] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-07T20:31:24.647677] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-07T20:31:24.827128] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T20:31:24.886127] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T20:31:25.447708] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-07T20:31:25.866448] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T20:31:26.042437] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T20:31:26.248044] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-07T20:31:27.047680] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-07T20:31:27.230125] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T20:31:27.847787] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-07T20:31:28.647703] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-07T20:31:28.668856] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T20:31:29.043848] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T20:31:29.447714] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-07T20:31:30.247675] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-07T20:31:30.395109] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T20:31:30.594366] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T20:31:31.047696] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-07T20:31:31.847706] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-07T20:31:31.989349] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T20:31:31.990559] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T20:31:32.577167] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T20:31:32.647701] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-07T20:31:33.447696] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-07T20:31:33.741784] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T20:31:34.247698] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-07T20:31:35.047689] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-07T20:31:35.096141] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T20:31:35.147219] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T20:31:35.561154] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T20:31:35.564498] [INFO ] [REMOTE ] NNI: Full fetch complete (12881 records). [2025-10-07T20:31:35.565208] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-07T20:31:35.566204] [FATAL] [VALIDATOR ] NNI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:31:35.566332] [FATAL] [MAIN ] NNI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:31:35.566402] [WARN ] [MAIN ] NNI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:31:35.566486] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-07T20:31:35.566578] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-07T20:31:35.566634] [INFO ] [LOCAL ] NNI: Starting deletion of derivative data. [2025-10-07T20:31:35.567262] [DEBUG] [LOCAL ] NNI: Deleted derivative data file. [2025-10-07T20:31:35.567744] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NNI took 31.1s. Estimated remaining: 2h 2m 9s. Rate: 7.1 symbols/min [2025-10-07T20:31:35.853145] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-07T20:31:35.853040] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:31:35.883262] [DEBUG] [LOCAL ] NOA: Loaded 16143 existing records from primary storage. [2025-10-07T20:31:35.883610] [INFO ] [MAIN ] NOA: Loaded 16143 existing records. [2025-10-07T20:31:36.094391] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:31:36.094725] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-07T20:31:36.094789] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-07T20:31:36.095065] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-07T20:31:36.095124] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-07T20:31:36.528731] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:31:36.647699] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-07T20:31:37.082720] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T20:31:37.447704] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-07T20:31:38.247620] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-07T20:31:38.399887] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T20:31:38.401704] [INFO ] [REMOTE ] NMZ: Full fetch complete (31725 records). [2025-10-07T20:31:38.401810] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-07T20:31:38.796212] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-07T20:31:38.796494] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-07T20:31:38.797245] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-07T20:31:38.864493] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-07T20:31:38.870480] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-07T20:31:38.881942] [DEBUG] [LOCAL ] NMZ: Trimmed 31725 records to 21641 (keeping 200 days of data) [2025-10-07T20:31:39.030685] [DEBUG] [LOCAL ] NMZ: Primary data saved (21641 records). [2025-10-07T20:31:39.030832] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-07T20:31:39.030938] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NMZ took 42.7s. Estimated remaining: 2h 1m 58s. Rate: 7.1 symbols/min [2025-10-07T20:31:39.052806] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-07T20:31:39.117199] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T20:31:39.214252] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:31:39.235207] [DEBUG] [LOCAL ] NOAH: Loaded 20440 existing records from primary storage. [2025-10-07T20:31:39.235465] [INFO ] [MAIN ] NOAH: Loaded 20440 existing records. [2025-10-07T20:31:39.407736] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:31:39.407986] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-07T20:31:39.408035] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-07T20:31:39.408245] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-07T20:31:39.408301] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-07T20:31:39.757632] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:31:39.847591] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-07T20:31:40.078519] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T20:31:40.647681] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-07T20:31:41.261492] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T20:31:41.262189] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T20:31:41.447687] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-07T20:31:42.247826] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-07T20:31:42.478138] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T20:31:43.047695] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-07T20:31:43.269919] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T20:31:43.847704] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-07T20:31:44.647685] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-07T20:31:44.903615] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T20:31:45.021910] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-07T20:31:45.278054] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:31:45.279989] [INFO ] [REMOTE ] NNY: Full fetch complete (8663 records). [2025-10-07T20:31:45.280273] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-07T20:31:45.452881] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-07T20:31:45.712953] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-07T20:31:45.713062] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-07T20:31:45.713404] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-07T20:31:45.713490] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-07T20:31:45.714309] [DEBUG] [LOCAL ] NNY: Trimmed 8663 records to 5632 (keeping 200 days of data) [2025-10-07T20:31:45.754286] [DEBUG] [LOCAL ] NNY: Primary data saved (5632 records). [2025-10-07T20:31:45.754474] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-07T20:31:45.754628] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNY took 33.8s. Estimated remaining: 2h 1m 49s. Rate: 7.1 symbols/min [2025-10-07T20:31:45.931563] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:31:45.931795] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-07T20:31:45.931881] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-07T20:31:45.931998] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-07T20:31:45.932041] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-07T20:31:45.932083] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-07T20:31:45.932118] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-07T20:31:46.252869] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-07T20:31:46.282674] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:31:46.718487] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T20:31:47.047720] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-07T20:31:47.847616] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-07T20:31:48.194310] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T20:31:48.647734] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-07T20:31:48.771906] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T20:31:48.934376] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-07T20:31:49.424046] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T20:31:49.426969] [INFO ] [REMOTE ] NNN: Full fetch complete (69985 records). [2025-10-07T20:31:49.427082] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-07T20:31:49.428062] [FATAL] [VALIDATOR ] NNN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:31:49.428154] [FATAL] [MAIN ] NNN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:31:49.428198] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:31:49.428271] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-07T20:31:49.428339] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-07T20:31:49.428375] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-07T20:31:49.428592] [DEBUG] [LOCAL ] NNN: Deleted derivative data file. [2025-10-07T20:31:49.428716] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NNN took 43.1s. Estimated remaining: 2h 1m 37s. Rate: 7.1 symbols/min [2025-10-07T20:31:49.457258] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-07T20:31:49.601263] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:31:49.649094] [DEBUG] [LOCAL ] NOG: Loaded 51233 existing records from primary storage. [2025-10-07T20:31:49.649480] [INFO ] [MAIN ] NOG: Loaded 51233 existing records. [2025-10-07T20:31:49.823181] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:31:49.823433] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-07T20:31:49.823482] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-07T20:31:49.823753] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-07T20:31:49.823811] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-07T20:31:50.170355] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:31:50.247635] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-07T20:31:50.519730] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T20:31:51.047635] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-07T20:31:51.847700] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-07T20:31:51.912161] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T20:31:52.647678] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-07T20:31:52.796251] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T20:31:53.012162] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-07T20:31:53.447714] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-07T20:31:53.960497] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T20:31:54.247722] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-07T20:31:54.605185] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T20:31:55.047715] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-07T20:31:55.847709] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-07T20:31:56.010015] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T20:31:56.647627] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-07T20:31:56.814190] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T20:31:57.101583] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T20:31:57.447715] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-07T20:31:58.247699] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-07T20:31:58.556857] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T20:31:58.663431] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T20:31:59.047712] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-07T20:31:59.847633] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-07T20:31:59.973966] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T20:32:00.006830] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T20:32:00.647765] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-07T20:32:01.447731] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-07T20:32:01.761560] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T20:32:02.247676] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-07T20:32:02.660298] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T20:32:02.662579] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T20:32:03.047638] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-07T20:32:03.847628] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-07T20:32:04.242125] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T20:32:04.647627] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-07T20:32:04.981438] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T20:32:05.072609] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-07T20:32:05.447726] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-07T20:32:05.922779] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T20:32:06.247690] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-07T20:32:07.047688] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-07T20:32:07.409524] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-07T20:32:07.593720] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T20:32:07.595305] [INFO ] [REMOTE ] NOAH: Full fetch complete (28052 records). [2025-10-07T20:32:07.595378] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-07T20:32:07.595972] [FATAL] [VALIDATOR ] NOAH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:32:07.596076] [FATAL] [MAIN ] NOAH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:32:07.596118] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:32:07.596156] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-07T20:32:07.596214] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-07T20:32:07.596251] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-07T20:32:07.596500] [DEBUG] [LOCAL ] NOAH: Deleted derivative data file. [2025-10-07T20:32:07.596609] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOAH took 28.6s. Estimated remaining: 2h 1m 35s. Rate: 7.1 symbols/min [2025-10-07T20:32:07.788833] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:32:07.821989] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T20:32:07.864016] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-07T20:32:07.890135] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-10-07T20:32:07.890529] [INFO ] [MAIN ] NOK: Loaded 53621 existing records. [2025-10-07T20:32:08.086088] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:32:08.086342] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-07T20:32:08.086398] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-07T20:32:08.086886] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-07T20:32:08.086946] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-07T20:32:08.492079] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:32:08.647740] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-07T20:32:09.447700] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-07T20:32:09.704191] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T20:32:09.833544] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T20:32:10.247748] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-07T20:32:11.047734] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-07T20:32:11.816580] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-07T20:32:11.847612] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-07T20:32:12.285211] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T20:32:12.330135] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T20:32:12.647699] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-07T20:32:13.447707] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-07T20:32:13.835210] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T20:32:14.057827] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-07T20:32:14.247696] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-07T20:32:14.742462] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T20:32:14.743911] [INFO ] [REMOTE ] NOA: Full fetch complete (22031 records). [2025-10-07T20:32:14.744047] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-07T20:32:14.744540] [FATAL] [VALIDATOR ] NOA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:32:14.744623] [FATAL] [MAIN ] NOA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:32:14.744700] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:32:14.744777] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-07T20:32:14.744856] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-07T20:32:14.744912] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-07T20:32:14.745365] [DEBUG] [LOCAL ] NOA: Deleted derivative data file. [2025-10-07T20:32:14.745456] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOA took 39.2s. Estimated remaining: 2h 1m 25s. Rate: 7.1 symbols/min [2025-10-07T20:32:14.917826] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:32:14.918003] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-07T20:32:14.918041] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-07T20:32:14.918168] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-07T20:32:14.918238] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-07T20:32:14.918298] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-07T20:32:14.918342] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-07T20:32:15.048116] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-07T20:32:15.301714] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:32:15.333849] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T20:32:15.847712] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-07T20:32:16.647632] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-07T20:32:16.946750] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T20:32:17.447731] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-07T20:32:17.838180] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T20:32:18.247712] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-07T20:32:18.707878] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-07T20:32:18.778097] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T20:32:18.918465] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T20:32:19.047762] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-07T20:32:19.538229] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-07T20:32:19.847692] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-07T20:32:20.647698] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-07T20:32:21.175769] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-07T20:32:21.447715] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-07T20:32:22.021512] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:32:22.024267] [INFO ] [REMOTE ] NOC: Full fetch complete (61324 records). [2025-10-07T20:32:22.024425] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-07T20:32:22.025710] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:32:22.025840] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:32:22.025913] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:32:22.025989] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-07T20:32:22.026061] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-07T20:32:22.026100] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-07T20:32:22.026142] [DEBUG] [LOCAL ] NOC: No derivative data file found to delete. [2025-10-07T20:32:22.026256] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOC took 36.3s. Estimated remaining: 2h 1m 16s. Rate: 7.1 symbols/min [2025-10-07T20:32:22.205997] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:32:22.239222] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-07T20:32:22.250295] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-07T20:32:22.293348] [DEBUG] [LOCAL ] NOMD: Loaded 41837 existing records from primary storage. [2025-10-07T20:32:22.293711] [INFO ] [MAIN ] NOMD: Loaded 41837 existing records. [2025-10-07T20:32:22.473213] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:32:22.473459] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-07T20:32:22.473507] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-07T20:32:22.474015] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-07T20:32:22.474073] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-07T20:32:22.810536] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-07T20:32:22.850254] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:32:23.047689] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-07T20:32:23.847708] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-07T20:32:24.635213] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T20:32:24.657192] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-07T20:32:24.662392] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T20:32:25.241746] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:32:25.245007] [INFO ] [REMOTE ] NOG: Full fetch complete (73556 records). [2025-10-07T20:32:25.245134] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-07T20:32:25.246480] [FATAL] [VALIDATOR ] NOG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:32:25.246569] [FATAL] [MAIN ] NOG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:32:25.246613] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:32:25.246679] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-07T20:32:25.246759] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-07T20:32:25.246794] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-07T20:32:25.246945] [DEBUG] [LOCAL ] NOG: Deleted derivative data file. [2025-10-07T20:32:25.247049] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOG took 35.8s. Estimated remaining: 2h 1m 5s. Rate: 7.1 symbols/min [2025-10-07T20:32:25.421258] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:32:25.447687] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-07T20:32:25.462026] [DEBUG] [LOCAL ] NOTE: Loaded 41406 existing records from primary storage. [2025-10-07T20:32:25.462421] [INFO ] [MAIN ] NOTE: Loaded 41406 existing records. [2025-10-07T20:32:25.653715] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:32:25.653932] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-07T20:32:25.653980] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-07T20:32:25.654309] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-07T20:32:25.654369] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-07T20:32:26.004059] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-07T20:32:26.013635] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:32:26.247678] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-07T20:32:27.047718] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-07T20:32:27.847838] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-07T20:32:28.272972] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-07T20:32:28.647762] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-07T20:32:29.141150] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T20:32:29.438436] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-07T20:32:29.450295] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-07T20:32:29.481825] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T20:32:30.247632] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-07T20:32:31.047627] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-07T20:32:31.414107] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-07T20:32:31.651823] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-07T20:32:31.847699] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-07T20:32:32.520289] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-07T20:32:32.647611] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-07T20:32:33.447677] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-07T20:32:33.823322] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-07T20:32:34.247741] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-07T20:32:34.817307] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-07T20:32:34.833685] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-07T20:32:35.006819] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T20:32:35.047687] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-07T20:32:35.847735] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-07T20:32:36.654781] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-07T20:32:36.669694] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T20:32:37.265256] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T20:32:37.447694] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-07T20:32:37.851558] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T20:32:37.872490] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T20:32:37.873208] [INFO ] [REMOTE ] NOM: Full fetch complete (1578 records). [2025-10-07T20:32:37.873301] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-07T20:32:38.049841] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-07T20:32:38.050065] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:32:38.050135] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:32:38.050211] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-07T20:32:38.050276] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-07T20:32:38.050311] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-07T20:32:38.050349] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-07T20:32:38.050405] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOM took 23.3s. Estimated remaining: 2h 0m 59s. Rate: 7.1 symbols/min [2025-10-07T20:32:38.216436] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:32:38.256033] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-07T20:32:38.283097] [DEBUG] [LOCAL ] NOV: Loaded 53178 existing records from primary storage. [2025-10-07T20:32:38.283480] [INFO ] [MAIN ] NOV: Loaded 53178 existing records. [2025-10-07T20:32:38.487548] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:32:38.487795] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-07T20:32:38.487855] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-07T20:32:38.488189] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-07T20:32:38.488247] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-07T20:32:38.922161] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:32:39.047619] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-07T20:32:39.847738] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-07T20:32:40.430462] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-07T20:32:40.538784] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T20:32:40.647702] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-07T20:32:41.447777] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-07T20:32:41.580131] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T20:32:42.247674] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-07T20:32:42.585143] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-07T20:32:43.047622] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-07T20:32:43.356442] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T20:32:43.847698] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-07T20:32:44.006596] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T20:32:44.647629] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-07T20:32:44.891724] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T20:32:45.447775] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-07T20:32:46.113045] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-07T20:32:46.234368] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T20:32:46.248160] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-07T20:32:46.952890] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T20:32:47.047632] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-07T20:32:47.468953] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T20:32:47.847701] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-07T20:32:48.647708] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-07T20:32:48.799988] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T20:32:49.447739] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-07T20:32:50.088304] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-07T20:32:50.247621] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-07T20:32:50.371932] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T20:32:50.690099] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T20:32:50.694481] [INFO ] [REMOTE ] NOK: Full fetch complete (77248 records). [2025-10-07T20:32:50.694612] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-07T20:32:50.695464] [FATAL] [VALIDATOR ] NOK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:32:50.695557] [FATAL] [MAIN ] NOK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:32:50.695600] [WARN ] [MAIN ] NOK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:32:50.695639] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-07T20:32:50.695761] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-07T20:32:50.695799] [INFO ] [LOCAL ] NOK: Starting deletion of derivative data. [2025-10-07T20:32:50.695955] [DEBUG] [LOCAL ] NOK: Deleted derivative data file. [2025-10-07T20:32:50.696060] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOK took 43.1s. Estimated remaining: 2h 0m 53s. Rate: 7.1 symbols/min [2025-10-07T20:32:50.866757] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:32:50.866973] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-07T20:32:50.867020] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-07T20:32:50.867128] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-07T20:32:50.867170] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-07T20:32:50.867211] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-07T20:32:50.867243] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-07T20:32:51.058262] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-07T20:32:51.272090] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:32:51.353356] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T20:32:51.847694] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-07T20:32:52.647629] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-07T20:32:52.837672] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T20:32:53.447726] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-07T20:32:53.696990] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T20:32:54.138815] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T20:32:54.141881] [INFO ] [REMOTE ] NOMD: Full fetch complete (59130 records). [2025-10-07T20:32:54.142003] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-07T20:32:54.145472] [FATAL] [VALIDATOR ] NOMD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:32:54.145624] [FATAL] [MAIN ] NOMD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:32:54.145732] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:32:54.145819] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-07T20:32:54.145925] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-07T20:32:54.145981] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-07T20:32:54.146175] [DEBUG] [LOCAL ] NOMD: Deleted derivative data file. [2025-10-07T20:32:54.146282] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOMD took 32.1s. Estimated remaining: 2h 0m 42s. Rate: 7.1 symbols/min [2025-10-07T20:32:54.247628] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-07T20:32:54.324955] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:32:54.325288] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-07T20:32:54.325363] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-07T20:32:54.325548] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-07T20:32:54.325633] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-07T20:32:54.325774] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-07T20:32:54.325922] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-07T20:32:54.592087] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T20:32:54.743476] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:32:55.047710] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-07T20:32:55.847756] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-07T20:32:56.174472] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:32:56.174839] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-07T20:32:56.174932] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:32:56.174979] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-07T20:32:56.175036] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:32:56.175110] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-07T20:32:56.175177] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-07T20:32:56.175213] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-07T20:32:56.175252] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-07T20:32:56.175317] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NP took 2.0s. Estimated remaining: 2h 0m 30s. Rate: 7.1 symbols/min [2025-10-07T20:32:56.342308] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:32:56.342496] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-07T20:32:56.342533] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-07T20:32:56.342668] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-07T20:32:56.342725] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-07T20:32:56.342770] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-07T20:32:56.342801] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-07T20:32:56.651543] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-07T20:32:56.708899] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:32:56.743485] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-07T20:32:56.927179] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T20:32:57.447627] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-07T20:32:58.247676] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-07T20:32:58.624544] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T20:32:58.905033] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T20:32:59.047727] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-07T20:32:59.847734] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-07T20:33:00.271538] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-07T20:33:00.459447] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T20:33:00.647687] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-07T20:33:01.443319] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T20:33:01.455753] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-07T20:33:01.820465] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:33:01.820820] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-07T20:33:01.820910] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:33:01.820984] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-07T20:33:01.821064] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:33:01.821153] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-07T20:33:01.821239] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-07T20:33:01.821290] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-07T20:33:01.821346] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-07T20:33:01.821412] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NPB took 5.6s. Estimated remaining: 2h 0m 20s. Rate: 7.1 symbols/min [2025-10-07T20:33:01.993812] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:33:02.015915] [DEBUG] [LOCAL ] NPCT: Loaded 16956 existing records from primary storage. [2025-10-07T20:33:02.016192] [INFO ] [MAIN ] NPCT: Loaded 16956 existing records. [2025-10-07T20:33:02.195795] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:33:02.196047] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-07T20:33:02.196123] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-07T20:33:02.196580] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-07T20:33:02.196684] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-07T20:33:02.260093] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-07T20:33:02.577463] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:33:02.712139] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-07T20:33:02.924255] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:33:02.927097] [INFO ] [REMOTE ] NOTE: Full fetch complete (62930 records). [2025-10-07T20:33:02.927281] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-07T20:33:02.928904] [FATAL] [VALIDATOR ] NOTE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:33:02.929011] [FATAL] [MAIN ] NOTE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:33:02.929069] [WARN ] [MAIN ] NOTE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:33:02.929151] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-07T20:33:02.929240] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-07T20:33:02.929287] [INFO ] [LOCAL ] NOTE: Starting deletion of derivative data. [2025-10-07T20:33:02.929476] [DEBUG] [LOCAL ] NOTE: Deleted derivative data file. [2025-10-07T20:33:02.929589] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOTE took 37.7s. Estimated remaining: 2h 0m 7s. Rate: 7.1 symbols/min [2025-10-07T20:33:03.052773] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-07T20:33:03.117046] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:33:03.132662] [DEBUG] [LOCAL ] NPFD: Loaded 9877 existing records from primary storage. [2025-10-07T20:33:03.132921] [INFO ] [MAIN ] NPFD: Loaded 9877 existing records. [2025-10-07T20:33:03.315399] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:33:03.315700] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-07T20:33:03.315775] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-07T20:33:03.316021] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-07T20:33:03.316105] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-07T20:33:03.685779] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:33:03.847664] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-07T20:33:04.647707] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-07T20:33:05.452794] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-07T20:33:05.473927] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-07T20:33:05.780701] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T20:33:05.817235] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T20:33:06.247696] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-07T20:33:06.571705] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T20:33:07.047733] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-07T20:33:07.825263] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T20:33:07.847595] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-07T20:33:08.080060] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T20:33:08.647621] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-07T20:33:08.755626] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T20:33:09.447701] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-07T20:33:10.247689] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-07T20:33:10.694055] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T20:33:11.047625] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-07T20:33:11.108374] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-07T20:33:11.169200] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:33:11.847719] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-07T20:33:12.647628] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-07T20:33:12.818261] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-07T20:33:13.073056] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T20:33:13.447709] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-07T20:33:14.247711] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-07T20:33:14.263465] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T20:33:14.266766] [INFO ] [REMOTE ] NOV: Full fetch complete (76602 records). [2025-10-07T20:33:14.267065] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-07T20:33:14.268311] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:33:14.268444] [FATAL] [MAIN ] NOV: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:33:14.268515] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:33:14.268592] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-07T20:33:14.268708] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-07T20:33:14.268767] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-07T20:33:14.268958] [DEBUG] [LOCAL ] NOV: Deleted derivative data file. [2025-10-07T20:33:14.269079] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NOV took 36.2s. Estimated remaining: 2h 0m 0s. Rate: 7.1 symbols/min [2025-10-07T20:33:14.863745] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-07T20:33:15.047628] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-07T20:33:15.305978] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T20:33:15.847766] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-07T20:33:16.647739] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-07T20:33:16.927490] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-07T20:33:16.964438] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T20:33:17.299779] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T20:33:17.447710] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-07T20:33:18.247727] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-07T20:33:19.047726] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-07T20:33:19.221203] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T20:33:19.685397] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-07T20:33:19.847633] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-07T20:33:19.968099] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T20:33:20.647756] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-07T20:33:21.447732] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-07T20:33:21.827997] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T20:33:22.008965] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-07T20:33:22.247701] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-07T20:33:22.438212] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T20:33:23.047723] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-07T20:33:23.333975] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T20:33:23.847694] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-07T20:33:24.647628] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-07T20:33:25.012287] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T20:33:25.172309] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T20:33:25.447626] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-07T20:33:25.555187] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T20:33:26.247733] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-07T20:33:26.345467] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-07T20:33:26.351776] [INFO ] [REMOTE ] NOW: Full fetch complete (70344 records). [2025-10-07T20:33:26.352001] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-07T20:33:26.353331] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:33:26.353461] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:33:26.353520] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:33:26.353602] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-07T20:33:26.353728] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-07T20:33:26.353790] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-07T20:33:26.353852] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-07T20:33:26.353938] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NOW took 35.7s. Estimated remaining: 1h 59m 54s. Rate: 7.1 symbols/min [2025-10-07T20:33:27.047629] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-07T20:33:27.124512] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T20:33:27.847721] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-07T20:33:27.997364] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T20:33:28.629704] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T20:33:28.630904] [INFO ] [REMOTE ] NPFD: Full fetch complete (14710 records). [2025-10-07T20:33:28.630987] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-07T20:33:28.631424] [FATAL] [VALIDATOR ] NPFD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:33:28.631519] [FATAL] [MAIN ] NPFD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:33:28.631594] [WARN ] [MAIN ] NPFD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:33:28.631707] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-07T20:33:28.631805] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-07T20:33:28.631851] [INFO ] [LOCAL ] NPFD: Starting deletion of derivative data. [2025-10-07T20:33:28.632020] [DEBUG] [LOCAL ] NPFD: Deleted derivative data file. [2025-10-07T20:33:28.632110] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NPFD took 25.7s. Estimated remaining: 1h 59m 42s. Rate: 7.1 symbols/min [2025-10-07T20:33:28.647601] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-07T20:33:29.365317] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T20:33:29.447689] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-07T20:33:29.927306] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:33:29.928717] [INFO ] [REMOTE ] NPCT: Full fetch complete (25042 records). [2025-10-07T20:33:29.928792] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-07T20:33:29.929256] [FATAL] [VALIDATOR ] NPCT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:33:29.929338] [FATAL] [MAIN ] NPCT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:33:29.929381] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:33:29.929442] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-07T20:33:29.929511] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-07T20:33:29.929545] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-07T20:33:29.929707] [DEBUG] [LOCAL ] NPCT: Deleted derivative data file. [2025-10-07T20:33:29.929796] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NPCT took 28.1s. Estimated remaining: 1h 59m 29s. Rate: 7.1 symbols/min [2025-10-07T20:33:30.569438] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:33:30.671066] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:33:30.630282] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:33:30.671636] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-07T20:33:30.671738] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-07T20:33:30.671842] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-07T20:33:30.671881] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-07T20:33:30.671925] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-07T20:33:30.680913] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-07T20:33:30.730093] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:33:30.797364] [DEBUG] [LOCAL ] NPK: Loaded 8096 existing records from primary storage. [2025-10-07T20:33:30.821932] [INFO ] [MAIN ] NPK: Loaded 8096 existing records. [2025-10-07T20:33:30.802440] [DEBUG] [LOCAL ] NPO: Loaded 13100 existing records from primary storage. [2025-10-07T20:33:30.855036] [INFO ] [MAIN ] NPO: Loaded 13100 existing records. [2025-10-07T20:33:30.830707] [DEBUG] [LOCAL ] NPV: Loaded 5107 existing records from primary storage. [2025-10-07T20:33:30.885077] [INFO ] [MAIN ] NPV: Loaded 5107 existing records. [2025-10-07T20:33:31.578069] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:33:31.568268] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:33:31.578993] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-07T20:33:31.579262] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-07T20:33:31.597110] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-07T20:33:31.604394] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-07T20:33:31.604210] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:33:31.635667] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-07T20:33:31.646313] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-07T20:33:31.671906] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-07T20:33:31.665878] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-07T20:33:31.688230] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-07T20:33:31.735989] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-07T20:33:31.786012] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-07T20:33:31.834835] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-07T20:33:31.901117] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:33:31.940867] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-07T20:33:32.802962] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:33:32.815259] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:33:32.820788] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-07T20:33:32.840767] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-07T20:33:32.880463] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:33:32.881075] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-07T20:33:32.986036] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T20:33:33.447742] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-07T20:33:33.661858] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T20:33:33.676674] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T20:33:33.999331] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T20:33:34.247758] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-07T20:33:34.771108] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T20:33:35.047750] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-07T20:33:35.174050] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T20:33:35.847741] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-07T20:33:36.359861] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T20:33:36.647633] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-07T20:33:36.676736] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T20:33:37.447763] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-07T20:33:38.228700] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T20:33:38.255992] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-07T20:33:38.259401] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T20:33:39.046723] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T20:33:39.049160] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-07T20:33:39.847675] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-07T20:33:40.478493] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T20:33:40.647667] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-07T20:33:40.755572] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T20:33:41.335302] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-07T20:33:41.447673] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-07T20:33:42.247693] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-07T20:33:42.989774] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-07T20:33:43.047614] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-07T20:33:43.133034] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T20:33:43.572720] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-07T20:33:43.847693] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-07T20:33:44.647622] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-07T20:33:44.924364] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T20:33:45.447625] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-07T20:33:45.657587] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T20:33:46.247702] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-07T20:33:46.636289] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T20:33:46.979250] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-07T20:33:47.047623] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-07T20:33:47.821813] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T20:33:47.847600] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-07T20:33:48.637501] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T20:33:48.647593] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-07T20:33:49.365789] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T20:33:49.366752] [INFO ] [REMOTE ] NPV: Full fetch complete (6945 records). [2025-10-07T20:33:49.366824] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-07T20:33:49.452748] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-07T20:33:49.737912] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-07T20:33:49.738030] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-07T20:33:49.738290] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-07T20:33:49.738357] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-07T20:33:49.738863] [DEBUG] [LOCAL ] NPV: Trimmed 6945 records to 5136 (keeping 200 days of data) [2025-10-07T20:33:49.771817] [DEBUG] [LOCAL ] NPV: Primary data saved (5136 records). [2025-10-07T20:33:49.771912] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-07T20:33:49.771994] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPV took 19.8s. Estimated remaining: 1h 59m 27s. Rate: 7.1 symbols/min [2025-10-07T20:33:49.942284] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:33:49.987752] [DEBUG] [LOCAL ] NPWR: Loaded 42902 existing records from primary storage. [2025-10-07T20:33:49.988116] [INFO ] [MAIN ] NPWR: Loaded 42902 existing records. [2025-10-07T20:33:50.165242] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:33:50.165509] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-07T20:33:50.165564] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-07T20:33:50.165975] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-07T20:33:50.166034] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-07T20:33:50.255517] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-07T20:33:50.532391] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:33:50.839510] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T20:33:51.047670] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-07T20:33:51.265630] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T20:33:51.847635] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-07T20:33:52.311769] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T20:33:52.582328] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T20:33:52.647748] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-07T20:33:53.332512] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T20:33:53.447758] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-07T20:33:54.247769] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-07T20:33:55.047740] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-07T20:33:55.157200] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T20:33:55.847704] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-07T20:33:56.194616] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-07T20:33:56.247251] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T20:33:56.558547] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T20:33:56.647616] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-07T20:33:57.447701] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-07T20:33:58.247629] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-07T20:33:58.378415] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T20:33:58.456493] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T20:33:59.047689] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-07T20:33:59.597175] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T20:33:59.847656] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-07T20:34:00.647754] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-07T20:34:00.771889] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T20:34:01.363749] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T20:34:01.447713] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-07T20:34:01.845061] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T20:34:02.247730] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-07T20:34:03.047631] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-07T20:34:03.311600] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T20:34:03.847760] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-07T20:34:03.920229] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-07T20:34:03.941377] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T20:34:04.602670] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T20:34:04.647724] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-07T20:34:05.447698] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-07T20:34:06.247717] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-07T20:34:06.447979] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T20:34:06.539891] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T20:34:07.047670] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-07T20:34:07.131324] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T20:34:07.847689] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-07T20:34:08.499528] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:34:08.500964] [INFO ] [REMOTE ] NPK: Full fetch complete (10842 records). [2025-10-07T20:34:08.501046] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-07T20:34:08.501518] [FATAL] [VALIDATOR ] NPK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:34:08.501606] [FATAL] [MAIN ] NPK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:34:08.501680] [WARN ] [MAIN ] NPK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:34:08.501741] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-07T20:34:08.501805] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-07T20:34:08.501841] [INFO ] [LOCAL ] NPK: Starting deletion of derivative data. [2025-10-07T20:34:08.502633] [DEBUG] [LOCAL ] NPK: Deleted derivative data file. [2025-10-07T20:34:08.503124] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPK took 38.6s. Estimated remaining: 1h 59m 25s. Rate: 7.1 symbols/min [2025-10-07T20:34:08.652771] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-07T20:34:08.732249] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:34:08.745385] [DEBUG] [LOCAL ] NQP: Loaded 9259 existing records from primary storage. [2025-10-07T20:34:08.745821] [INFO ] [MAIN ] NQP: Loaded 9259 existing records. [2025-10-07T20:34:08.886136] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T20:34:08.977979] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:34:08.978250] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-07T20:34:08.978301] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-07T20:34:08.978527] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-07T20:34:08.978586] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-07T20:34:09.366235] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:34:09.452527] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-07T20:34:09.454795] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-07T20:34:09.458632] [INFO ] [REMOTE ] NPKI: Full fetch complete (55100 records). [2025-10-07T20:34:09.458843] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-07T20:34:09.459553] [FATAL] [VALIDATOR ] NPKI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:34:09.459666] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:34:09.459730] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:34:09.459800] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-07T20:34:09.459907] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-07T20:34:09.459951] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-07T20:34:09.459995] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-07T20:34:09.460055] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPKI took 39.5s. Estimated remaining: 1h 59m 12s. Rate: 7.1 symbols/min [2025-10-07T20:34:09.634950] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:34:09.674975] [DEBUG] [LOCAL ] NRDY: Loaded 32547 existing records from primary storage. [2025-10-07T20:34:09.675306] [INFO ] [MAIN ] NRDY: Loaded 32547 existing records. [2025-10-07T20:34:09.864530] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:34:09.864748] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-07T20:34:09.864802] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-07T20:34:09.865128] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-07T20:34:09.865185] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-07T20:34:10.223895] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:34:10.247596] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-07T20:34:10.980348] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T20:34:11.047623] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-07T20:34:11.847727] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-07T20:34:11.966373] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T20:34:12.337612] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T20:34:12.636714] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T20:34:12.639283] [INFO ] [REMOTE ] NPO: Full fetch complete (18137 records). [2025-10-07T20:34:12.639436] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-07T20:34:12.640249] [FATAL] [VALIDATOR ] NPO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:34:12.642074] [FATAL] [MAIN ] NPO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:34:12.644003] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:34:12.644130] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-07T20:34:12.644220] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-07T20:34:12.644263] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-07T20:34:12.644440] [DEBUG] [LOCAL ] NPO: Deleted derivative data file. [2025-10-07T20:34:12.644580] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPO took 42.7s. Estimated remaining: 1h 59m 1s. Rate: 7.1 symbols/min [2025-10-07T20:34:12.650328] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-07T20:34:12.934332] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:34:12.949925] [DEBUG] [LOCAL ] NREF: Loaded 7894 existing records from primary storage. [2025-10-07T20:34:12.950223] [INFO ] [MAIN ] NREF: Loaded 7894 existing records. [2025-10-07T20:34:13.158926] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:34:13.159210] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-07T20:34:13.159298] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-07T20:34:13.159528] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-07T20:34:13.159606] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-07T20:34:13.447762] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-07T20:34:13.533754] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:34:14.247637] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-07T20:34:14.413583] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T20:34:14.454148] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T20:34:15.047690] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-07T20:34:15.847769] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-07T20:34:16.057232] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T20:34:16.647620] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-07T20:34:16.732159] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T20:34:16.954044] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T20:34:17.447742] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-07T20:34:18.247692] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-07T20:34:18.335449] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T20:34:19.051891] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-07T20:34:19.057213] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T20:34:19.070747] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T20:34:19.847627] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-07T20:34:20.002092] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-07T20:34:20.647690] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-07T20:34:20.745111] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T20:34:21.447683] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-07T20:34:22.247638] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-07T20:34:22.419056] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T20:34:23.047742] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-07T20:34:23.071447] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T20:34:23.103388] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T20:34:23.847703] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-07T20:34:23.977159] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T20:34:24.647694] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-07T20:34:24.740541] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T20:34:25.447626] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-07T20:34:25.493784] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T20:34:26.174709] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T20:34:26.247718] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-07T20:34:27.047695] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-07T20:34:27.797607] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T20:34:27.847615] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-07T20:34:28.647673] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-07T20:34:28.728918] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T20:34:29.442350] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T20:34:29.450914] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-07T20:34:29.480218] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-07T20:34:30.247697] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-07T20:34:30.362866] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-07T20:34:31.047752] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-07T20:34:31.755503] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T20:34:31.773191] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T20:34:31.776543] [INFO ] [REMOTE ] NPWR: Full fetch complete (59245 records). [2025-10-07T20:34:31.776674] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-07T20:34:31.777304] [FATAL] [VALIDATOR ] NPWR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:34:31.777387] [FATAL] [MAIN ] NPWR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:34:31.777431] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:34:31.777526] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-07T20:34:31.777603] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-07T20:34:31.777686] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-07T20:34:31.777930] [DEBUG] [LOCAL ] NPWR: Deleted derivative data file. [2025-10-07T20:34:31.778057] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NPWR took 42.0s. Estimated remaining: 1h 58m 58s. Rate: 7.1 symbols/min [2025-10-07T20:34:31.852794] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-07T20:34:31.947311] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:34:31.947501] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-07T20:34:31.947561] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-07T20:34:31.947706] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-07T20:34:31.947764] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-07T20:34:31.947808] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-07T20:34:31.947840] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-07T20:34:32.291124] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:34:32.647630] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-07T20:34:32.884567] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T20:34:33.447628] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-07T20:34:33.579559] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T20:34:34.247685] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-07T20:34:34.309390] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-07T20:34:35.047756] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-07T20:34:35.688031] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T20:34:35.695044] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T20:34:35.847674] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-07T20:34:36.647699] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-07T20:34:37.263012] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T20:34:37.447681] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-07T20:34:38.053312] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T20:34:38.055568] [INFO ] [REMOTE ] NRDY: Full fetch complete (50909 records). [2025-10-07T20:34:38.055776] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-07T20:34:38.056626] [FATAL] [VALIDATOR ] NRDY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:34:38.056741] [FATAL] [MAIN ] NRDY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:34:38.056788] [WARN ] [MAIN ] NRDY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:34:38.056830] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-07T20:34:38.056890] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-07T20:34:38.056925] [INFO ] [LOCAL ] NRDY: Starting deletion of derivative data. [2025-10-07T20:34:38.057074] [DEBUG] [LOCAL ] NRDY: Deleted derivative data file. [2025-10-07T20:34:38.057209] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NRDY took 28.6s. Estimated remaining: 1h 58m 49s. Rate: 7.1 symbols/min [2025-10-07T20:34:38.232112] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:34:38.256546] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-07T20:34:38.275560] [DEBUG] [LOCAL ] NRGV: Loaded 43471 existing records from primary storage. [2025-10-07T20:34:38.275930] [INFO ] [MAIN ] NRGV: Loaded 43471 existing records. [2025-10-07T20:34:38.458998] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:34:38.459340] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-07T20:34:38.459417] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-07T20:34:38.459910] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-07T20:34:38.460122] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-07T20:34:38.593697] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-07T20:34:38.858129] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:34:39.047637] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-07T20:34:39.129202] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T20:34:39.691339] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T20:34:39.692365] [INFO ] [REMOTE ] NREF: Full fetch complete (10831 records). [2025-10-07T20:34:39.692438] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-07T20:34:39.692873] [FATAL] [VALIDATOR ] NREF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:34:39.692955] [FATAL] [MAIN ] NREF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:34:39.692998] [WARN ] [MAIN ] NREF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:34:39.693039] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-07T20:34:39.693099] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-07T20:34:39.693133] [INFO ] [LOCAL ] NREF: Starting deletion of derivative data. [2025-10-07T20:34:39.693317] [DEBUG] [LOCAL ] NREF: Deleted derivative data file. [2025-10-07T20:34:39.693405] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NREF took 27.0s. Estimated remaining: 1h 58m 36s. Rate: 7.1 symbols/min [2025-10-07T20:34:39.860488] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:34:39.856894] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-07T20:34:39.880964] [DEBUG] [LOCAL ] NRK: Loaded 20025 existing records from primary storage. [2025-10-07T20:34:39.881234] [INFO ] [MAIN ] NRK: Loaded 20025 existing records. [2025-10-07T20:34:40.062378] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:34:40.063028] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-07T20:34:40.063091] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-07T20:34:40.063422] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-07T20:34:40.063485] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-07T20:34:40.468766] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:34:40.647702] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-07T20:34:40.835026] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T20:34:41.447691] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-07T20:34:41.959207] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T20:34:42.201442] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T20:34:42.202526] [INFO ] [REMOTE ] NQP: Full fetch complete (13346 records). [2025-10-07T20:34:42.202597] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-07T20:34:42.254005] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-07T20:34:42.561584] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-07T20:34:42.561701] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-07T20:34:42.562072] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-07T20:34:42.562117] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-07T20:34:42.562664] [DEBUG] [LOCAL ] NQP: Trimmed 13346 records to 9263 (keeping 200 days of data) [2025-10-07T20:34:42.619780] [DEBUG] [LOCAL ] NQP: Primary data saved (9263 records). [2025-10-07T20:34:42.619921] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-07T20:34:42.620007] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NQP took 34.1s. Estimated remaining: 1h 58m 25s. Rate: 7.1 symbols/min [2025-10-07T20:34:42.786475] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:34:42.793700] [DEBUG] [LOCAL ] NRP: Loaded 4101 existing records from primary storage. [2025-10-07T20:34:42.793908] [INFO ] [MAIN ] NRP: Loaded 4101 existing records. [2025-10-07T20:34:42.964822] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:34:42.965029] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-07T20:34:42.965078] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-07T20:34:42.965285] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-07T20:34:42.965342] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-07T20:34:43.052950] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-07T20:34:43.316786] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:34:43.847699] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-07T20:34:44.286001] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T20:34:44.472133] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-07T20:34:44.647713] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-07T20:34:45.447757] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-07T20:34:46.247675] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-07T20:34:46.504301] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T20:34:46.563682] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-07T20:34:46.641057] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T20:34:47.047750] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-07T20:34:47.537348] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T20:34:47.847681] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-07T20:34:48.367887] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-07T20:34:48.647635] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-07T20:34:48.831450] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T20:34:49.447739] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-07T20:34:50.151610] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-07T20:34:50.247629] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-07T20:34:50.674991] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T20:34:50.979971] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T20:34:51.047697] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-07T20:34:51.847711] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-07T20:34:52.533794] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T20:34:52.647603] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-07T20:34:52.829071] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T20:34:53.447727] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-07T20:34:54.181869] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T20:34:54.247599] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-07T20:34:54.353931] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T20:34:55.047714] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-07T20:34:55.692639] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T20:34:55.847702] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-07T20:34:56.443845] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T20:34:56.647691] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-07T20:34:57.447728] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-07T20:34:57.545405] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T20:34:57.626774] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T20:34:58.247726] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-07T20:34:59.047633] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-07T20:34:59.150701] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T20:34:59.784411] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T20:34:59.847609] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-07T20:35:00.104621] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T20:35:00.647720] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-07T20:35:01.120944] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-07T20:35:01.447665] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-07T20:35:01.584400] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-07T20:35:02.247732] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-07T20:35:03.047762] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-07T20:35:03.854575] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-07T20:35:03.873605] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-07T20:35:04.028257] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T20:35:04.049439] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T20:35:04.494126] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-07T20:35:04.647601] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-07T20:35:05.447713] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-07T20:35:05.866374] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T20:35:06.247722] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-07T20:35:07.047713] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-07T20:35:07.508297] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-07T20:35:07.778662] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T20:35:07.847698] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-07T20:35:07.961254] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T20:35:08.647760] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-07T20:35:09.447671] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-07T20:35:09.922910] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T20:35:09.960842] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T20:35:09.962400] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-07T20:35:09.963541] [INFO ] [REMOTE ] NRP: Full fetch complete (6458 records). [2025-10-07T20:35:09.976471] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-07T20:35:09.977223] [FATAL] [VALIDATOR ] NRP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:35:09.977813] [FATAL] [MAIN ] NRP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:35:09.977883] [WARN ] [MAIN ] NRP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:35:09.977958] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-07T20:35:09.978030] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-07T20:35:09.978067] [INFO ] [LOCAL ] NRP: Starting deletion of derivative data. [2025-10-07T20:35:09.978335] [DEBUG] [LOCAL ] NRP: Deleted derivative data file. [2025-10-07T20:35:09.978435] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRP took 27.4s. Estimated remaining: 1h 58m 27s. Rate: 7.1 symbols/min [2025-10-07T20:35:10.148361] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:35:10.155742] [DEBUG] [LOCAL ] NRT: Loaded 4865 existing records from primary storage. [2025-10-07T20:35:10.155953] [INFO ] [MAIN ] NRT: Loaded 4865 existing records. [2025-10-07T20:35:10.254311] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-07T20:35:10.342034] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:35:10.342254] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-07T20:35:10.342304] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-07T20:35:10.342471] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-07T20:35:10.342529] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-07T20:35:10.703835] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:35:11.047704] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-07T20:35:11.494450] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T20:35:11.847691] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-07T20:35:12.647621] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-07T20:35:12.954347] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T20:35:12.996764] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T20:35:13.447629] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-07T20:35:14.247672] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-07T20:35:14.445151] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T20:35:14.447105] [INFO ] [REMOTE ] NRK: Full fetch complete (27736 records). [2025-10-07T20:35:14.447221] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-07T20:35:14.850161] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-07T20:35:14.850267] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-07T20:35:14.851023] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-07T20:35:14.851106] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-07T20:35:14.868223] [DEBUG] [LOCAL ] NRK: Trimmed 27736 records to 20033 (keeping 200 days of data) [2025-10-07T20:35:14.891441] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-07T20:35:15.025450] [DEBUG] [LOCAL ] NRK: Primary data saved (20033 records). [2025-10-07T20:35:15.025597] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-07T20:35:15.025729] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRK took 35.3s. Estimated remaining: 1h 58m 17s. Rate: 7.1 symbols/min [2025-10-07T20:35:15.056043] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-07T20:35:15.201266] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T20:35:15.206663] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:35:15.214289] [DEBUG] [LOCAL ] NRUC: Loaded 3083 existing records from primary storage. [2025-10-07T20:35:15.214456] [INFO ] [MAIN ] NRUC: Loaded 3083 existing records. [2025-10-07T20:35:15.392753] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:35:15.393033] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-07T20:35:15.393089] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-07T20:35:15.393402] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-07T20:35:15.393461] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-07T20:35:15.769682] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:35:15.799031] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T20:35:15.802482] [INFO ] [REMOTE ] NRG: Full fetch complete (76211 records). [2025-10-07T20:35:15.802699] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-07T20:35:15.803862] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:35:15.803970] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:35:15.804050] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:35:15.804249] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-07T20:35:15.804336] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-07T20:35:15.804375] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-07T20:35:15.804416] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-07T20:35:15.804482] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRG took 44.0s. Estimated remaining: 1h 58m 4s. Rate: 7.1 symbols/min [2025-10-07T20:35:15.852817] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-07T20:35:15.981359] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:35:16.025747] [DEBUG] [LOCAL ] NSA: Loaded 44679 existing records from primary storage. [2025-10-07T20:35:16.026124] [INFO ] [MAIN ] NSA: Loaded 44679 existing records. [2025-10-07T20:35:16.204218] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:35:16.204461] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-07T20:35:16.204555] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-07T20:35:16.205768] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-10-07T20:35:16.205827] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-07T20:35:16.562772] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:35:16.647617] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-07T20:35:17.135165] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T20:35:17.447728] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-07T20:35:18.226366] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T20:35:18.247599] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-07T20:35:18.497244] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T20:35:18.983968] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T20:35:19.047703] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-07T20:35:19.821338] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-07T20:35:19.847612] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-07T20:35:20.618862] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T20:35:20.647719] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-07T20:35:21.447739] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-07T20:35:22.162400] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T20:35:22.247696] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-07T20:35:22.589745] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T20:35:22.800290] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-07T20:35:23.047700] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-07T20:35:23.804475] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T20:35:23.847614] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-07T20:35:24.498672] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-07T20:35:24.647673] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-07T20:35:25.447672] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-07T20:35:25.453812] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T20:35:26.247758] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-07T20:35:26.989210] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T20:35:27.047599] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-07T20:35:27.156741] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T20:35:27.847757] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-07T20:35:28.501393] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T20:35:28.647666] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-07T20:35:28.662933] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T20:35:28.668281] [INFO ] [REMOTE ] NRGV: Full fetch complete (61879 records). [2025-10-07T20:35:28.668448] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-07T20:35:28.669498] [FATAL] [VALIDATOR ] NRGV: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:35:28.669695] [FATAL] [MAIN ] NRGV: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:35:28.669786] [WARN ] [MAIN ] NRGV: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:35:28.669881] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-07T20:35:28.669974] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-07T20:35:28.670029] [INFO ] [LOCAL ] NRGV: Starting deletion of derivative data. [2025-10-07T20:35:28.670234] [DEBUG] [LOCAL ] NRGV: Deleted derivative data file. [2025-10-07T20:35:28.670368] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRGV took 50.6s. Estimated remaining: 1h 57m 58s. Rate: 7.1 symbols/min [2025-10-07T20:35:28.855517] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:35:28.855783] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-07T20:35:28.855840] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-07T20:35:28.855959] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-07T20:35:28.856004] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-07T20:35:28.856072] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-07T20:35:28.856120] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-07T20:35:29.212856] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:35:29.306629] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-07T20:35:29.447717] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-07T20:35:30.119775] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T20:35:30.247699] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-07T20:35:30.861019] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T20:35:31.047698] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-07T20:35:31.847766] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-07T20:35:32.647704] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-07T20:35:33.232293] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-07T20:35:33.262754] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-07T20:35:33.338399] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T20:35:33.447707] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-07T20:35:34.247761] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-07T20:35:35.047712] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-07T20:35:35.072268] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T20:35:35.249458] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T20:35:35.847706] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-07T20:35:36.647630] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-07T20:35:36.995759] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T20:35:37.279750] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:35:37.280573] [INFO ] [REMOTE ] NRT: Full fetch complete (7926 records). [2025-10-07T20:35:37.280639] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-07T20:35:37.281071] [FATAL] [VALIDATOR ] NRT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:35:37.281155] [FATAL] [MAIN ] NRT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:35:37.281198] [WARN ] [MAIN ] NRT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:35:37.281255] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-07T20:35:37.281341] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-07T20:35:37.281384] [INFO ] [LOCAL ] NRT: Starting deletion of derivative data. [2025-10-07T20:35:37.281626] [DEBUG] [LOCAL ] NRT: Deleted derivative data file. [2025-10-07T20:35:37.281743] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRT took 27.3s. Estimated remaining: 1h 57m 50s. Rate: 7.1 symbols/min [2025-10-07T20:35:37.453453] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-07T20:35:37.456981] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:35:37.499290] [DEBUG] [LOCAL ] NSP: Loaded 35149 existing records from primary storage. [2025-10-07T20:35:37.499735] [INFO ] [MAIN ] NSP: Loaded 35149 existing records. [2025-10-07T20:35:37.703699] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T20:35:37.751342] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:35:37.751989] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-07T20:35:37.752069] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-07T20:35:37.752984] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-10-07T20:35:37.753046] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-07T20:35:38.127664] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:35:38.247622] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-07T20:35:39.047674] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-07T20:35:39.364435] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-07T20:35:39.847638] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-07T20:35:39.959590] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T20:35:40.647621] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-07T20:35:40.858637] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T20:35:41.447626] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-07T20:35:41.785717] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T20:35:42.220156] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T20:35:42.247621] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-07T20:35:43.047624] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-07T20:35:43.236525] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T20:35:43.595135] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T20:35:43.805228] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T20:35:43.847617] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-07T20:35:44.647706] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-07T20:35:45.313774] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T20:35:45.315174] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T20:35:45.447711] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-07T20:35:46.247757] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-07T20:35:47.047628] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-07T20:35:47.223515] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T20:35:47.349664] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-07T20:35:47.350423] [INFO ] [REMOTE ] NRUC: Full fetch complete (5397 records). [2025-10-07T20:35:47.350490] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-07T20:35:47.351018] [FATAL] [VALIDATOR ] NRUC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:35:47.351108] [FATAL] [MAIN ] NRUC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:35:47.351184] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:35:47.351256] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-07T20:35:47.351323] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-07T20:35:47.351359] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-07T20:35:47.351497] [DEBUG] [LOCAL ] NRUC: Deleted derivative data file. [2025-10-07T20:35:47.351604] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRUC took 32.3s. Estimated remaining: 1h 57m 42s. Rate: 7.1 symbols/min [2025-10-07T20:35:47.526085] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:35:47.547205] [DEBUG] [LOCAL ] NTB: Loaded 20092 existing records from primary storage. [2025-10-07T20:35:47.547475] [INFO ] [MAIN ] NTB: Loaded 20092 existing records. [2025-10-07T20:35:47.754200] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:35:47.754458] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-07T20:35:47.754508] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-07T20:35:47.755139] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-07T20:35:47.755200] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-07T20:35:47.854172] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-07T20:35:48.087170] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T20:35:48.164358] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:35:48.647736] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-07T20:35:49.447695] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-07T20:35:49.535321] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T20:35:50.197345] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T20:35:50.247706] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-07T20:35:51.047687] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-07T20:35:51.659745] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-07T20:35:51.678621] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:35:51.681545] [INFO ] [REMOTE ] NSA: Full fetch complete (61819 records). [2025-10-07T20:35:51.681639] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-07T20:35:51.682337] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:35:51.682428] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:35:51.682470] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:35:51.682565] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-07T20:35:51.682701] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-07T20:35:51.682759] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-07T20:35:51.682960] [DEBUG] [LOCAL ] NSA: Deleted derivative data file. [2025-10-07T20:35:51.683073] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSA took 35.9s. Estimated remaining: 1h 57m 31s. Rate: 7.1 symbols/min [2025-10-07T20:35:51.848052] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-07T20:35:51.869513] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:35:51.869853] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-07T20:35:51.869960] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-07T20:35:51.870209] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-07T20:35:51.870284] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-07T20:35:51.870443] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-07T20:35:51.870581] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-07T20:35:52.067961] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T20:35:52.254447] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:35:52.647796] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-07T20:35:53.447668] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-07T20:35:53.756017] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T20:35:53.805999] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T20:35:54.247737] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-07T20:35:54.977303] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T20:35:55.047692] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-07T20:35:55.847699] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-07T20:35:55.925759] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T20:35:56.647694] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-07T20:35:56.722347] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T20:35:56.783318] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T20:35:57.327776] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T20:35:57.447780] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-07T20:35:58.120970] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T20:35:58.247714] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-07T20:35:59.047750] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-07T20:35:59.687407] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T20:35:59.847626] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-07T20:36:00.041356] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T20:36:00.483710] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-07T20:36:00.647720] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-07T20:36:01.447687] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-07T20:36:02.247747] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-07T20:36:02.367505] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:36:03.047682] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-07T20:36:03.158928] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T20:36:03.346878] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T20:36:03.847693] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-07T20:36:04.045412] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T20:36:04.507740] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-07T20:36:04.647701] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-07T20:36:05.447634] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-07T20:36:05.574478] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T20:36:05.577107] [INFO ] [REMOTE ] NSP: Full fetch complete (49523 records). [2025-10-07T20:36:05.577230] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-07T20:36:05.578159] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:36:05.578246] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:36:05.578291] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:36:05.578382] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-07T20:36:05.578465] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-07T20:36:05.578503] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-07T20:36:05.578747] [DEBUG] [LOCAL ] NSP: Deleted derivative data file. [2025-10-07T20:36:05.578846] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSP took 28.3s. Estimated remaining: 1h 57m 26s. Rate: 7.1 symbols/min [2025-10-07T20:36:05.746336] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:36:05.796134] [DEBUG] [LOCAL ] NTR: Loaded 52588 existing records from primary storage. [2025-10-07T20:36:05.796467] [INFO ] [MAIN ] NTR: Loaded 52588 existing records. [2025-10-07T20:36:05.971003] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:36:05.971241] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-07T20:36:05.971289] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-07T20:36:05.972683] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-10-07T20:36:05.972743] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-07T20:36:06.251637] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-07T20:36:06.333801] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:36:06.622323] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T20:36:07.047723] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-07T20:36:07.146086] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T20:36:07.847697] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-07T20:36:08.022810] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T20:36:08.647696] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-07T20:36:09.447626] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-07T20:36:09.855222] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-07T20:36:10.040498] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T20:36:10.247692] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-07T20:36:11.008545] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T20:36:11.047605] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-07T20:36:11.730181] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:36:11.733210] [INFO ] [REMOTE ] NSC: Full fetch complete (70525 records). [2025-10-07T20:36:11.733367] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-07T20:36:11.734262] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:36:11.734363] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:36:11.734406] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:36:11.734448] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-07T20:36:11.734543] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-07T20:36:11.734604] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-07T20:36:11.734700] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-07T20:36:11.734807] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSC took 43.1s. Estimated remaining: 1h 57m 16s. Rate: 7.1 symbols/min [2025-10-07T20:36:11.852802] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-07T20:36:11.920838] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:36:11.977003] [DEBUG] [LOCAL ] NTST: Loaded 43613 existing records from primary storage. [2025-10-07T20:36:11.977500] [INFO ] [MAIN ] NTST: Loaded 43613 existing records. [2025-10-07T20:36:12.171315] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:36:12.171659] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-07T20:36:12.171734] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-07T20:36:12.171975] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-07T20:36:12.172048] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-07T20:36:12.314521] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-07T20:36:12.621005] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:36:12.647613] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-07T20:36:13.159967] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T20:36:13.447899] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-07T20:36:14.247755] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-07T20:36:14.470515] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T20:36:14.502416] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T20:36:15.047703] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-07T20:36:15.847722] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-07T20:36:15.924455] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T20:36:16.298404] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T20:36:16.546812] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T20:36:16.647620] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-07T20:36:17.202741] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T20:36:17.447691] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-07T20:36:18.035436] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T20:36:18.036139] [INFO ] [REMOTE ] NTEST: Full fetch complete (1991 records). [2025-10-07T20:36:18.036209] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-07T20:36:18.213084] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-07T20:36:18.213296] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:36:18.213367] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:36:18.213441] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-07T20:36:18.213506] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-07T20:36:18.213543] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-07T20:36:18.213583] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-07T20:36:18.213639] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTEST took 26.5s. Estimated remaining: 1h 57m 7s. Rate: 7.1 symbols/min [2025-10-07T20:36:18.252776] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-07T20:36:18.385252] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:36:18.385426] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-07T20:36:18.385483] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-07T20:36:18.385594] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-07T20:36:18.385637] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-07T20:36:18.385727] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-07T20:36:18.385764] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-07T20:36:18.729113] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:36:19.047682] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-07T20:36:19.461747] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T20:36:19.847725] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-07T20:36:20.647639] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-07T20:36:20.991714] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T20:36:21.447696] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-07T20:36:21.706263] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-07T20:36:22.012166] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T20:36:22.013747] [INFO ] [REMOTE ] NTB: Full fetch complete (30473 records). [2025-10-07T20:36:22.013832] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-07T20:36:22.014391] [FATAL] [VALIDATOR ] NTB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:36:22.014474] [FATAL] [MAIN ] NTB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:36:22.014517] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:36:22.014556] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-07T20:36:22.014615] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-07T20:36:22.014677] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-07T20:36:22.014865] [DEBUG] [LOCAL ] NTB: Deleted derivative data file. [2025-10-07T20:36:22.014958] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTB took 34.7s. Estimated remaining: 1h 56m 56s. Rate: 7.1 symbols/min [2025-10-07T20:36:22.197612] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:36:22.198110] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-07T20:36:22.198162] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-07T20:36:22.198272] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-07T20:36:22.198313] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-07T20:36:22.198355] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-07T20:36:22.198387] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-07T20:36:22.252757] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-07T20:36:22.561368] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:36:22.593719] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-07T20:36:23.047675] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-07T20:36:23.830908] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T20:36:23.847609] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-07T20:36:24.647669] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-07T20:36:24.881933] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T20:36:25.447673] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-07T20:36:25.688305] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T20:36:26.247706] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-07T20:36:26.783938] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-07T20:36:27.047783] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-07T20:36:27.847765] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-07T20:36:27.990090] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T20:36:28.020913] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-07T20:36:28.647706] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-07T20:36:29.144266] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T20:36:29.447694] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-07T20:36:29.606964] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T20:36:30.021713] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T20:36:30.247755] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-07T20:36:31.047764] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-07T20:36:31.731105] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-07T20:36:31.828914] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T20:36:31.847597] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-07T20:36:32.647638] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-07T20:36:32.986209] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T20:36:33.130480] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T20:36:33.447747] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-07T20:36:34.247760] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-07T20:36:35.047717] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-07T20:36:35.328459] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-07T20:36:35.657702] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-07T20:36:35.847741] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-07T20:36:36.149460] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T20:36:36.568343] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T20:36:36.647617] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-07T20:36:37.447626] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-07T20:36:37.649495] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T20:36:38.247615] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-07T20:36:38.419595] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T20:36:39.047743] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-07T20:36:39.862127] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-07T20:36:39.865434] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-07T20:36:40.059412] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T20:36:40.647688] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-07T20:36:40.740393] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T20:36:41.385816] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T20:36:41.447711] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-07T20:36:42.247713] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-07T20:36:42.745534] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-07T20:36:42.779774] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T20:36:42.782822] [INFO ] [REMOTE ] NTST: Full fetch complete (61045 records). [2025-10-07T20:36:42.782959] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-07T20:36:42.783982] [FATAL] [VALIDATOR ] NTST: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:36:42.784085] [FATAL] [MAIN ] NTST: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:36:42.784157] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:36:42.784237] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-07T20:36:42.784323] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-07T20:36:42.784401] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-07T20:36:42.784678] [DEBUG] [LOCAL ] NTST: Deleted derivative data file. [2025-10-07T20:36:42.784807] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTST took 31.0s. Estimated remaining: 1h 56m 54s. Rate: 7.1 symbols/min [2025-10-07T20:36:42.993702] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:36:43.035351] [DEBUG] [LOCAL ] NUS: Loaded 36420 existing records from primary storage. [2025-10-07T20:36:43.035761] [INFO ] [MAIN ] NUS: Loaded 36420 existing records. [2025-10-07T20:36:43.052854] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-07T20:36:43.269211] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:36:43.269909] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-07T20:36:43.270045] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-07T20:36:43.270928] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-10-07T20:36:43.270989] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-07T20:36:43.406123] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T20:36:43.666634] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:36:43.847618] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-07T20:36:44.647731] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-07T20:36:45.278218] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:36:45.281307] [INFO ] [REMOTE ] NTR: Full fetch complete (75925 records). [2025-10-07T20:36:45.281413] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-07T20:36:45.282288] [FATAL] [VALIDATOR ] NTR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:36:45.282384] [FATAL] [MAIN ] NTR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:36:45.282428] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:36:45.282493] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-07T20:36:45.282561] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-07T20:36:45.282599] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-07T20:36:45.282768] [DEBUG] [LOCAL ] NTR: Deleted derivative data file. [2025-10-07T20:36:45.282863] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NTR took 39.7s. Estimated remaining: 1h 56m 42s. Rate: 7.1 symbols/min [2025-10-07T20:36:45.453185] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:36:45.449976] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-07T20:36:45.476421] [DEBUG] [LOCAL ] NUV: Loaded 23678 existing records from primary storage. [2025-10-07T20:36:45.476751] [INFO ] [MAIN ] NUV: Loaded 23678 existing records. [2025-10-07T20:36:45.656045] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:36:45.656562] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-07T20:36:45.657156] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-07T20:36:45.677001] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-07T20:36:45.698829] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-07T20:36:45.726668] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T20:36:45.783983] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-07T20:36:46.118631] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:36:46.247623] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-07T20:36:47.047610] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-07T20:36:47.527301] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-07T20:36:47.654044] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T20:36:47.847708] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-07T20:36:48.647717] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-07T20:36:48.977280] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T20:36:49.264103] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-07T20:36:49.447734] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-07T20:36:50.247634] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-07T20:36:50.672028] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-07T20:36:51.006010] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T20:36:51.047620] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-07T20:36:51.848357] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-07T20:36:52.655906] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-07T20:36:52.674156] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T20:36:52.731565] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T20:36:52.773928] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-07T20:36:53.447700] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-07T20:36:54.247677] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-07T20:36:54.735921] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-07T20:36:55.037986] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T20:36:55.047591] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-07T20:36:55.433145] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T20:36:55.847702] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-07T20:36:56.647737] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-07T20:36:56.822981] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T20:36:57.447700] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-07T20:36:57.947778] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-07T20:36:58.247735] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-07T20:36:58.696619] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-07T20:36:59.047707] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-07T20:36:59.152272] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-07T20:36:59.693681] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T20:36:59.847714] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-07T20:37:00.510829] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T20:37:00.647612] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-07T20:37:01.447770] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-07T20:37:02.043500] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T20:37:02.046601] [INFO ] [REMOTE ] NUE: Full fetch complete (74440 records). [2025-10-07T20:37:02.046749] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-07T20:37:02.048531] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:37:02.048627] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:37:02.048716] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:37:02.048768] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-07T20:37:02.048843] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-07T20:37:02.048899] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-07T20:37:02.048958] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-07T20:37:02.049051] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NUE took 40.0s. Estimated remaining: 1h 56m 39s. Rate: 7.1 symbols/min [2025-10-07T20:37:02.227166] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:37:02.249292] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-07T20:37:02.265322] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-07T20:37:02.302748] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T20:37:02.347074] [DEBUG] [LOCAL ] NUVB: Loaded 51328 existing records from primary storage. [2025-10-07T20:37:02.347434] [INFO ] [MAIN ] NUVB: Loaded 51328 existing records. [2025-10-07T20:37:02.520520] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:37:02.520794] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-07T20:37:02.520851] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-07T20:37:02.522059] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-07T20:37:02.522119] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-07T20:37:02.867429] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:37:03.047601] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-07T20:37:03.544901] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-07T20:37:03.847698] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-07T20:37:04.482943] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T20:37:04.488734] [INFO ] [REMOTE ] NU: Full fetch complete (77490 records). [2025-10-07T20:37:04.488888] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-07T20:37:04.489996] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:37:04.490106] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:37:04.490193] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:37:04.490289] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-07T20:37:04.490383] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-07T20:37:04.490442] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-07T20:37:04.490508] [DEBUG] [LOCAL ] NU: No derivative data file found to delete. [2025-10-07T20:37:04.490593] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NU took 46.3s. Estimated remaining: 1h 56m 27s. Rate: 7.1 symbols/min [2025-10-07T20:37:04.651254] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-07T20:37:04.679407] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:37:04.709865] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T20:37:04.724560] [DEBUG] [LOCAL ] NUW: Loaded 7214 existing records from primary storage. [2025-10-07T20:37:04.724898] [INFO ] [MAIN ] NUW: Loaded 7214 existing records. [2025-10-07T20:37:04.899765] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:37:04.900063] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-07T20:37:04.900115] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-07T20:37:04.900414] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-07T20:37:04.900476] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-07T20:37:05.250633] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:37:05.447637] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-07T20:37:05.894834] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T20:37:06.247758] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-07T20:37:06.548691] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T20:37:07.047735] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-07T20:37:07.413727] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T20:37:07.847729] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-07T20:37:08.647716] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-07T20:37:08.724364] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T20:37:09.364921] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T20:37:09.447604] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-07T20:37:09.930349] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T20:37:10.134297] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T20:37:10.136600] [INFO ] [REMOTE ] NUS: Full fetch complete (53606 records). [2025-10-07T20:37:10.136719] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-07T20:37:10.137446] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:37:10.137535] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:37:10.137578] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:37:10.137618] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-07T20:37:10.137707] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-07T20:37:10.137759] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-07T20:37:10.137976] [DEBUG] [LOCAL ] NUS: Deleted derivative data file. [2025-10-07T20:37:10.138068] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUS took 27.4s. Estimated remaining: 1h 56m 17s. Rate: 7.1 symbols/min [2025-10-07T20:37:10.252782] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-07T20:37:10.307333] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:37:10.335291] [DEBUG] [LOCAL ] NVG: Loaded 27517 existing records from primary storage. [2025-10-07T20:37:10.335597] [INFO ] [MAIN ] NVG: Loaded 27517 existing records. [2025-10-07T20:37:10.509123] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:37:10.509299] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-07T20:37:10.509402] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-07T20:37:10.510222] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-07T20:37:10.510279] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-07T20:37:10.858489] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:37:11.047593] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-07T20:37:11.500681] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T20:37:11.847755] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-07T20:37:12.647715] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-07T20:37:12.703331] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T20:37:12.767493] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T20:37:13.447710] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-07T20:37:13.697781] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T20:37:14.247731] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-07T20:37:15.047684] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-07T20:37:15.108479] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T20:37:15.588795] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T20:37:15.847749] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-07T20:37:15.965398] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T20:37:15.967846] [INFO ] [REMOTE ] NUV: Full fetch complete (34494 records). [2025-10-07T20:37:15.967929] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-07T20:37:16.333891] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-07T20:37:16.333987] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-07T20:37:16.334670] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-07T20:37:16.334735] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-07T20:37:16.335471] [DEBUG] [LOCAL ] NUV: Trimmed 34494 records to 23675 (keeping 200 days of data) [2025-10-07T20:37:16.480332] [DEBUG] [LOCAL ] NUV: Primary data saved (23675 records). [2025-10-07T20:37:16.480473] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-07T20:37:16.480571] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUV took 31.2s. Estimated remaining: 1h 56m 7s. Rate: 7.1 symbols/min [2025-10-07T20:37:16.645568] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:37:16.647721] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-07T20:37:16.676625] [DEBUG] [LOCAL ] NVGS: Loaded 30438 existing records from primary storage. [2025-10-07T20:37:16.676948] [INFO ] [MAIN ] NVGS: Loaded 30438 existing records. [2025-10-07T20:37:16.854227] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:37:16.854436] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-07T20:37:16.854485] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-07T20:37:16.855201] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-07T20:37:16.855261] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-07T20:37:17.250744] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:37:17.447623] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-07T20:37:17.664747] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T20:37:17.692351] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T20:37:18.247734] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-07T20:37:18.697213] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T20:37:19.047720] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-07T20:37:19.446225] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T20:37:19.847675] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-07T20:37:20.016953] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T20:37:20.647722] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-07T20:37:21.152962] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T20:37:21.447753] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-07T20:37:21.747693] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:37:22.247730] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-07T20:37:22.648442] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T20:37:22.811855] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-07T20:37:23.047702] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-07T20:37:23.847723] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-07T20:37:24.647625] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-07T20:37:24.902548] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T20:37:24.962051] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T20:37:25.447678] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-07T20:37:25.837861] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T20:37:26.247632] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-07T20:37:26.457586] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T20:37:27.047717] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-07T20:37:27.380055] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T20:37:27.847682] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-07T20:37:28.644356] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T20:37:28.655532] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-07T20:37:28.945537] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T20:37:29.447638] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-07T20:37:30.064370] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T20:37:30.077215] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T20:37:30.247683] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-07T20:37:31.047718] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-07T20:37:31.847633] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-07T20:37:32.282818] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-07T20:37:32.574015] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T20:37:32.647613] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-07T20:37:33.447622] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-07T20:37:33.516186] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T20:37:34.151987] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-07T20:37:34.181787] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T20:37:34.247712] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-07T20:37:35.047733] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-07T20:37:35.671340] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T20:37:35.847756] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-07T20:37:36.647625] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-07T20:37:37.042907] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T20:37:37.090493] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T20:37:37.447724] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-07T20:37:37.649425] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T20:37:38.015484] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:37:38.017257] [INFO ] [REMOTE ] NVGS: Full fetch complete (41300 records). [2025-10-07T20:37:38.017360] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-07T20:37:38.018025] [FATAL] [VALIDATOR ] NVGS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:37:38.018109] [FATAL] [MAIN ] NVGS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:37:38.018152] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:37:38.018191] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-07T20:37:38.018250] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-07T20:37:38.018284] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-07T20:37:38.018507] [DEBUG] [LOCAL ] NVGS: Deleted derivative data file. [2025-10-07T20:37:38.018608] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NVGS took 21.5s. Estimated remaining: 1h 56m 6s. Rate: 7.1 symbols/min [2025-10-07T20:37:38.184101] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:37:38.236275] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-07T20:37:38.236678] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-10-07T20:37:38.256909] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-07T20:37:38.416291] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:37:38.416537] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-07T20:37:38.416599] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-07T20:37:38.416932] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-10-07T20:37:38.416990] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-07T20:37:38.834692] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:37:39.047669] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-07T20:37:39.083823] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T20:37:39.847688] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-07T20:37:40.599121] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T20:37:40.647607] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-07T20:37:41.397469] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T20:37:41.447675] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-07T20:37:41.667948] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-07T20:37:41.943925] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T20:37:41.944854] [INFO ] [REMOTE ] NUW: Full fetch complete (11423 records). [2025-10-07T20:37:41.944925] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-07T20:37:42.252912] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-07T20:37:42.354782] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-07T20:37:42.354864] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-07T20:37:42.355175] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-07T20:37:42.355217] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-07T20:37:42.355714] [DEBUG] [LOCAL ] NUW: Trimmed 11423 records to 7179 (keeping 200 days of data) [2025-10-07T20:37:42.400710] [DEBUG] [LOCAL ] NUW: Primary data saved (7179 records). [2025-10-07T20:37:42.400846] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-07T20:37:42.400934] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUW took 37.9s. Estimated remaining: 1h 55m 55s. Rate: 7.1 symbols/min [2025-10-07T20:37:42.575590] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:37:42.575814] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-07T20:37:42.575859] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-07T20:37:42.575976] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-07T20:37:42.576019] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-07T20:37:42.576063] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-07T20:37:42.576098] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-07T20:37:42.950313] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:37:43.047747] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-07T20:37:43.847706] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-07T20:37:44.359946] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T20:37:44.404710] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-07T20:37:44.647684] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-07T20:37:45.447743] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-07T20:37:46.247704] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-07T20:37:46.564808] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-07T20:37:46.911717] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-07T20:37:47.029818] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T20:37:47.047743] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-07T20:37:47.241035] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T20:37:47.847716] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-07T20:37:48.096810] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-07T20:37:48.100099] [INFO ] [REMOTE ] NVG: Full fetch complete (40517 records). [2025-10-07T20:37:48.100409] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-07T20:37:48.492087] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-07T20:37:48.492217] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-07T20:37:48.493242] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-07T20:37:48.493354] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-07T20:37:48.494706] [DEBUG] [LOCAL ] NVG: Trimmed 40517 records to 27429 (keeping 200 days of data) [2025-10-07T20:37:48.649361] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-07T20:37:48.680058] [DEBUG] [LOCAL ] NVG: Primary data saved (27429 records). [2025-10-07T20:37:48.680201] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-07T20:37:48.680299] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVG took 38.5s. Estimated remaining: 1h 55m 46s. Rate: 7.1 symbols/min [2025-10-07T20:37:48.854471] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:37:48.895028] [DEBUG] [LOCAL ] NVRI: Loaded 38760 existing records from primary storage. [2025-10-07T20:37:48.895461] [INFO ] [MAIN ] NVRI: Loaded 38760 existing records. [2025-10-07T20:37:49.082244] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:37:49.083938] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-07T20:37:49.084005] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-07T20:37:49.085122] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-10-07T20:37:49.085186] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-07T20:37:49.448756] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:37:49.448905] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-07T20:37:49.859314] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T20:37:50.161909] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T20:37:50.165431] [INFO ] [REMOTE ] NUVB: Full fetch complete (72519 records). [2025-10-07T20:37:50.165565] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-07T20:37:50.166440] [FATAL] [VALIDATOR ] NUVB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:37:50.166534] [FATAL] [MAIN ] NUVB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:37:50.166578] [WARN ] [MAIN ] NUVB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:37:50.166620] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-07T20:37:50.166742] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-07T20:37:50.166800] [INFO ] [LOCAL ] NUVB: Starting deletion of derivative data. [2025-10-07T20:37:50.167042] [DEBUG] [LOCAL ] NUVB: Deleted derivative data file. [2025-10-07T20:37:50.167168] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NUVB took 48.1s. Estimated remaining: 1h 55m 34s. Rate: 7.1 symbols/min [2025-10-07T20:37:50.257902] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-07T20:37:50.342530] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:37:50.394795] [DEBUG] [LOCAL ] NVS: Loaded 51536 existing records from primary storage. [2025-10-07T20:37:50.395202] [INFO ] [MAIN ] NVS: Loaded 51536 existing records. [2025-10-07T20:37:50.586481] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:37:50.586759] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-07T20:37:50.586859] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-07T20:37:50.600030] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-07T20:37:50.617578] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-07T20:37:50.723597] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-07T20:37:51.000843] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:37:51.047604] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-07T20:37:51.847688] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-07T20:37:51.910992] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T20:37:52.647690] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-07T20:37:52.879099] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T20:37:53.447756] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-07T20:37:53.989213] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T20:37:54.247733] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-07T20:37:54.533856] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-07T20:37:55.028939] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T20:37:55.047606] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-07T20:37:55.540134] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T20:37:55.847717] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-07T20:37:56.647630] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-07T20:37:56.906808] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T20:37:56.971826] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T20:37:57.447677] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-07T20:37:58.247784] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-07T20:37:59.047770] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-07T20:37:59.530553] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-10-07T20:37:59.678204] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-07T20:37:59.847658] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-07T20:37:59.922879] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T20:38:00.537913] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T20:38:00.647723] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-07T20:38:01.447628] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-07T20:38:01.752013] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T20:38:02.247678] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-07T20:38:02.335560] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T20:38:02.715257] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T20:38:03.047709] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-07T20:38:03.847729] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-07T20:38:04.199624] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T20:38:04.582022] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-07T20:38:04.647707] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-07T20:38:04.801186] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T20:38:05.447668] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-07T20:38:05.830562] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T20:38:06.247680] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-07T20:38:07.047619] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-07T20:38:07.079459] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T20:38:07.847622] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-07T20:38:08.108898] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T20:38:08.647699] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-07T20:38:09.160200] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T20:38:09.161747] [INFO ] [REMOTE ] NVR: Full fetch complete (29047 records). [2025-10-07T20:38:09.161837] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-07T20:38:09.162389] [FATAL] [VALIDATOR ] NVR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:38:09.162588] [FATAL] [MAIN ] NVR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:38:09.162633] [WARN ] [MAIN ] NVR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:38:09.162718] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-07T20:38:09.162786] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-07T20:38:09.162851] [INFO ] [LOCAL ] NVR: Starting deletion of derivative data. [2025-10-07T20:38:09.162916] [DEBUG] [LOCAL ] NVR: No derivative data file found to delete. [2025-10-07T20:38:09.162975] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVR took 26.8s. Estimated remaining: 1h 55m 31s. Rate: 7.1 symbols/min [2025-10-07T20:38:09.340300] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:38:09.395605] [DEBUG] [LOCAL ] NVST: Loaded 51599 existing records from primary storage. [2025-10-07T20:38:09.395990] [INFO ] [MAIN ] NVST: Loaded 51599 existing records. [2025-10-07T20:38:09.460527] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-07T20:38:09.583514] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:38:09.584004] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-07T20:38:09.584144] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-07T20:38:09.594298] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-10-07T20:38:09.599628] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-07T20:38:09.666722] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T20:38:09.984835] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:38:10.025157] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-10-07T20:38:10.247627] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-07T20:38:11.047728] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-07T20:38:11.546167] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-07T20:38:11.853613] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-07T20:38:11.858412] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T20:38:12.647675] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-07T20:38:13.447627] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-07T20:38:13.674338] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T20:38:13.786957] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-07T20:38:14.247379] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T20:38:14.251306] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-07T20:38:14.993764] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T20:38:15.047717] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-07T20:38:15.847763] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-07T20:38:16.647715] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-07T20:38:16.749028] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T20:38:17.015932] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-07T20:38:17.447714] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-07T20:38:17.585310] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T20:38:18.247688] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-07T20:38:18.442790] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T20:38:19.047632] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-07T20:38:19.210469] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T20:38:19.708741] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:38:19.711852] [INFO ] [REMOTE ] NVS: Full fetch complete (74434 records). [2025-10-07T20:38:19.711984] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-07T20:38:19.713055] [FATAL] [VALIDATOR ] NVS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:38:19.713161] [FATAL] [MAIN ] NVS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:38:19.713232] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:38:19.713309] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-07T20:38:19.713381] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-07T20:38:19.713419] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-07T20:38:19.713601] [DEBUG] [LOCAL ] NVS: Deleted derivative data file. [2025-10-07T20:38:19.713737] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVS took 29.5s. Estimated remaining: 1h 55m 23s. Rate: 7.1 symbols/min [2025-10-07T20:38:19.854626] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-07T20:38:19.888045] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:38:19.938870] [DEBUG] [LOCAL ] NVT: Loaded 51506 existing records from primary storage. [2025-10-07T20:38:19.939198] [INFO ] [MAIN ] NVT: Loaded 51506 existing records. [2025-10-07T20:38:20.115176] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:38:20.115362] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-07T20:38:20.115409] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-07T20:38:20.115767] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-10-07T20:38:20.115834] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-07T20:38:20.472265] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:38:20.513537] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:38:20.516149] [INFO ] [REMOTE ] NVRI: Full fetch complete (55540 records). [2025-10-07T20:38:20.516233] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-07T20:38:20.516879] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:38:20.517048] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:38:20.517103] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:38:20.517181] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-07T20:38:20.517263] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-07T20:38:20.517299] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-07T20:38:20.517465] [DEBUG] [LOCAL ] NVRI: Deleted derivative data file. [2025-10-07T20:38:20.517541] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVRI took 31.8s. Estimated remaining: 1h 55m 11s. Rate: 7.1 symbols/min [2025-10-07T20:38:20.656756] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-07T20:38:20.689557] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:38:20.745282] [DEBUG] [LOCAL ] NWG: Loaded 51460 existing records from primary storage. [2025-10-07T20:38:20.745610] [INFO ] [MAIN ] NWG: Loaded 51460 existing records. [2025-10-07T20:38:20.924948] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:38:20.925182] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-07T20:38:20.925231] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-07T20:38:20.925718] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-10-07T20:38:20.925778] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-07T20:38:21.276911] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:38:21.310270] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-10-07T20:38:21.447635] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-07T20:38:22.247710] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-07T20:38:22.641907] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-07T20:38:23.047629] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-07T20:38:23.190603] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T20:38:23.847633] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-07T20:38:24.647621] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-07T20:38:24.895404] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T20:38:25.082350] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-07T20:38:25.158476] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T20:38:25.447708] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-07T20:38:26.021680] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T20:38:26.247633] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-07T20:38:27.047963] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-07T20:38:27.168569] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T20:38:27.847723] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-07T20:38:28.064096] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T20:38:28.219609] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T20:38:28.223090] [INFO ] [REMOTE ] NVO: Full fetch complete (77565 records). [2025-10-07T20:38:28.223247] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-07T20:38:28.224366] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:38:28.224510] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:38:28.224586] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:38:28.224690] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-07T20:38:28.224805] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-07T20:38:28.224890] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-07T20:38:28.225119] [DEBUG] [LOCAL ] NVO: Deleted derivative data file. [2025-10-07T20:38:28.225286] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVO took 50.2s. Estimated remaining: 1h 55m 2s. Rate: 7.1 symbols/min [2025-10-07T20:38:28.431238] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:38:28.461278] [DEBUG] [LOCAL ] NWN: Loaded 26811 existing records from primary storage. [2025-10-07T20:38:28.461636] [INFO ] [MAIN ] NWN: Loaded 26811 existing records. [2025-10-07T20:38:28.652687] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-07T20:38:28.686939] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:38:28.687190] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-07T20:38:28.687238] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-07T20:38:28.691390] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-10-07T20:38:28.691480] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-07T20:38:29.102320] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:38:29.447754] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-07T20:38:29.593023] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T20:38:30.247731] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-07T20:38:30.623882] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T20:38:30.646795] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T20:38:31.047725] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-07T20:38:31.847681] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-07T20:38:32.081932] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T20:38:32.647625] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-07T20:38:32.928792] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T20:38:33.090169] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T20:38:33.447709] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-07T20:38:34.247631] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-07T20:38:34.604565] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T20:38:35.047679] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-07T20:38:35.398393] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T20:38:35.453538] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T20:38:35.847694] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-07T20:38:36.647742] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-07T20:38:37.047987] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T20:38:37.119767] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T20:38:37.447724] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-07T20:38:38.247668] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-07T20:38:38.577142] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T20:38:39.047740] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-07T20:38:39.224998] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T20:38:39.847671] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-07T20:38:40.026252] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T20:38:40.646515] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T20:38:40.653616] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-07T20:38:41.447768] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-07T20:38:41.754495] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T20:38:42.156805] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T20:38:42.247727] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-07T20:38:43.047697] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-07T20:38:43.122831] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T20:38:43.847738] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-07T20:38:44.321982] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-07T20:38:44.460732] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T20:38:44.647733] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-07T20:38:45.447727] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-07T20:38:45.931559] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-07T20:38:46.247671] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-07T20:38:46.511792] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T20:38:46.822456] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T20:38:47.047755] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-07T20:38:47.615325] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:38:47.619308] [INFO ] [REMOTE ] NVT: Full fetch complete (74178 records). [2025-10-07T20:38:47.619815] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-07T20:38:47.622004] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:38:47.622177] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:38:47.622224] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:38:47.622311] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-07T20:38:47.622443] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-07T20:38:47.622506] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-07T20:38:47.622841] [DEBUG] [LOCAL ] NVT: Deleted derivative data file. [2025-10-07T20:38:47.622980] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVT took 27.9s. Estimated remaining: 1h 54m 59s. Rate: 7.1 symbols/min [2025-10-07T20:38:47.789065] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T20:38:47.866867] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-07T20:38:47.870300] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:38:47.921030] [DEBUG] [LOCAL ] NX: Loaded 33137 existing records from primary storage. [2025-10-07T20:38:47.921830] [INFO ] [MAIN ] NX: Loaded 33137 existing records. [2025-10-07T20:38:48.105854] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:38:48.106120] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-07T20:38:48.106169] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-07T20:38:48.106544] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-10-07T20:38:48.106602] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-07T20:38:48.459911] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:38:48.647688] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-07T20:38:49.447754] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-07T20:38:49.716389] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T20:38:50.221251] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T20:38:50.247695] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-07T20:38:50.922844] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T20:38:51.047681] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-07T20:38:51.591552] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T20:38:51.847716] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-07T20:38:52.326207] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T20:38:52.647737] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-07T20:38:53.298333] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:38:53.302689] [INFO ] [REMOTE ] NWG: Full fetch complete (73160 records). [2025-10-07T20:38:53.302884] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-07T20:38:53.304057] [FATAL] [VALIDATOR ] NWG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:38:53.304187] [FATAL] [MAIN ] NWG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:38:53.304282] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:38:53.304389] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-07T20:38:53.304495] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-07T20:38:53.304556] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-07T20:38:53.304720] [DEBUG] [LOCAL ] NWG: Deleted derivative data file. [2025-10-07T20:38:53.304825] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NWG took 32.8s. Estimated remaining: 1h 54m 50s. Rate: 7.1 symbols/min [2025-10-07T20:38:53.447828] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-07T20:38:53.485561] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:38:53.495941] [DEBUG] [LOCAL ] NXC: Loaded 4130 existing records from primary storage. [2025-10-07T20:38:53.496799] [INFO ] [MAIN ] NXC: Loaded 4130 existing records. [2025-10-07T20:38:53.658048] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T20:38:53.729236] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:38:53.730026] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-07T20:38:53.730081] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-07T20:38:53.730306] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-07T20:38:53.730363] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-07T20:38:54.077499] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:38:54.247708] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-07T20:38:54.961045] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T20:38:55.047724] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-07T20:38:55.536677] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T20:38:55.847733] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-07T20:38:56.647629] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-07T20:38:56.718301] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T20:38:56.758917] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-07T20:38:57.447753] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-07T20:38:58.017510] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T20:38:58.247711] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-07T20:38:58.496603] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T20:38:58.892284] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T20:38:59.047748] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-07T20:38:59.847751] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-07T20:39:00.443129] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T20:39:00.445135] [INFO ] [REMOTE ] NWN: Full fetch complete (37205 records). [2025-10-07T20:39:00.445222] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-07T20:39:00.446941] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:39:00.447177] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:39:00.447228] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:39:00.447310] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-07T20:39:00.447427] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-07T20:39:00.447478] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-07T20:39:00.447634] [DEBUG] [LOCAL ] NWN: Deleted derivative data file. [2025-10-07T20:39:00.447795] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NWN took 32.2s. Estimated remaining: 1h 54m 40s. Rate: 7.1 symbols/min [2025-10-07T20:39:00.621235] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:39:00.621457] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-07T20:39:00.621495] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-07T20:39:00.621614] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-07T20:39:00.621689] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-07T20:39:00.621751] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-07T20:39:00.621784] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-07T20:39:00.652803] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-07T20:39:00.981595] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:39:01.263604] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-07T20:39:01.447757] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-07T20:39:01.994997] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T20:39:02.098748] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T20:39:02.247738] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-07T20:39:02.982517] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T20:39:03.047630] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-07T20:39:03.795628] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T20:39:03.847691] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-07T20:39:04.198636] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:39:04.199050] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-07T20:39:04.199141] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:39:04.199193] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-07T20:39:04.199228] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:39:04.199269] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-07T20:39:04.199328] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-07T20:39:04.199363] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-07T20:39:04.199402] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-07T20:39:04.199451] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NXDR took 3.8s. Estimated remaining: 1h 54m 30s. Rate: 7.1 symbols/min [2025-10-07T20:39:04.647687] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-07T20:39:05.447755] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-07T20:39:06.106269] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-07T20:39:06.125495] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T20:39:06.247616] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-07T20:39:07.047695] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-07T20:39:07.694885] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T20:39:07.738459] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-07T20:39:07.847746] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-07T20:39:08.647697] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-07T20:39:09.289727] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T20:39:09.303926] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:39:09.307133] [INFO ] [REMOTE ] NVST: Full fetch complete (73738 records). [2025-10-07T20:39:09.307239] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-07T20:39:09.310289] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:39:09.310377] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:39:09.310420] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:39:09.310461] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-07T20:39:09.310523] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-07T20:39:09.310557] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-07T20:39:09.310714] [DEBUG] [LOCAL ] NVST: Deleted derivative data file. [2025-10-07T20:39:09.310807] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NVST took 1m 0s. Estimated remaining: 1h 54m 19s. Rate: 7.1 symbols/min [2025-10-07T20:39:09.447622] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-07T20:39:10.042739] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T20:39:10.247739] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-07T20:39:10.914586] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T20:39:11.047689] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-07T20:39:11.606630] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T20:39:11.607465] [INFO ] [REMOTE ] NXC: Full fetch complete (5896 records). [2025-10-07T20:39:11.607534] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-07T20:39:11.853812] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-07T20:39:11.960867] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-07T20:39:11.960951] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-07T20:39:11.961118] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-07T20:39:11.961156] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-07T20:39:11.961525] [DEBUG] [LOCAL ] NXC: Trimmed 5896 records to 4130 (keeping 200 days of data) [2025-10-07T20:39:11.986595] [DEBUG] [LOCAL ] NXC: Primary data saved (4130 records). [2025-10-07T20:39:11.986687] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-07T20:39:11.986770] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NXC took 18.7s. Estimated remaining: 1h 54m 8s. Rate: 7.1 symbols/min [2025-10-07T20:39:13.432887] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T20:39:13.440320] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-07T20:39:15.129471] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T20:39:15.138430] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-07T20:39:15.795824] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:39:15.798377] [INFO ] [REMOTE ] NX: Full fetch complete (48028 records). [2025-10-07T20:39:15.798490] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-07T20:39:15.800071] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:39:15.800315] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:39:15.800385] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:39:15.800459] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-07T20:39:15.800537] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-07T20:39:15.800577] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-07T20:39:15.800757] [DEBUG] [LOCAL ] NX: Deleted derivative data file. [2025-10-07T20:39:15.800895] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NX took 28.2s. Estimated remaining: 1h 53m 57s. Rate: 7.1 symbols/min [2025-10-07T20:39:16.422235] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:39:16.543890] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:39:16.569377] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:39:16.570393] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:39:16.592839] [DEBUG] [LOCAL ] NXG: Loaded 10384 existing records from primary storage. [2025-10-07T20:39:16.593236] [INFO ] [MAIN ] NXG: Loaded 10384 existing records. [2025-10-07T20:39:16.652151] [DEBUG] [LOCAL ] NXDT: Loaded 15527 existing records from primary storage. [2025-10-07T20:39:16.670252] [DEBUG] [LOCAL ] NXJ: Loaded 15010 existing records from primary storage. [2025-10-07T20:39:16.682046] [INFO ] [MAIN ] NXJ: Loaded 15010 existing records. [2025-10-07T20:39:16.713105] [INFO ] [MAIN ] NXDT: Loaded 15527 existing records. [2025-10-07T20:39:16.977482] [DEBUG] [LOCAL ] NXE: Loaded 53004 existing records from primary storage. [2025-10-07T20:39:17.059127] [INFO ] [MAIN ] NXE: Loaded 53004 existing records. [2025-10-07T20:39:17.206505] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:39:17.253338] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-07T20:39:17.257531] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:39:17.262795] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-07T20:39:17.289877] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-07T20:39:17.313997] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:39:17.290155] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-07T20:39:17.301147] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-07T20:39:17.319466] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-07T20:39:17.374703] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-07T20:39:17.385176] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-07T20:39:17.416887] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-07T20:39:17.393980] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-07T20:39:17.438158] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-07T20:39:17.458812] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-07T20:39:17.683778] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:39:17.757030] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-07T20:39:17.767633] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-07T20:39:17.840099] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-07T20:39:17.868699] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-07T20:39:18.708154] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:39:18.756588] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-07T20:39:18.890841] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:39:18.916015] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-07T20:39:18.995419] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:39:19.006584] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-07T20:39:19.077759] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:39:19.078120] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-07T20:39:19.865742] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T20:39:19.870144] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-07T20:39:19.983958] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T20:39:19.988536] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-07T20:39:20.368893] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T20:39:20.374819] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-07T20:39:20.709591] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-07T20:39:20.712193] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-07T20:39:20.937960] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T20:39:20.941432] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-07T20:39:20.983073] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T20:39:21.422688] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T20:39:21.447769] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-07T20:39:21.628869] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T20:39:21.853591] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T20:39:22.168568] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-07T20:39:22.247669] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-07T20:39:23.047756] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-07T20:39:23.142106] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T20:39:23.847703] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-07T20:39:23.949895] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T20:39:24.382371] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-07T20:39:24.647675] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-07T20:39:25.447619] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-07T20:39:25.845987] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T20:39:26.247687] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-07T20:39:27.047627] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-07T20:39:27.390819] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-07T20:39:27.415406] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T20:39:27.542367] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T20:39:27.847689] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-07T20:39:28.647635] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-07T20:39:28.938046] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T20:39:29.447632] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-07T20:39:29.559633] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T20:39:30.247685] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-07T20:39:30.363975] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-07T20:39:31.047625] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-07T20:39:31.117533] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T20:39:31.847630] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-07T20:39:31.872567] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T20:39:32.647606] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-07T20:39:32.942758] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:39:33.447628] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-07T20:39:33.530981] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T20:39:34.247679] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-07T20:39:35.047632] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-07T20:39:35.299993] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T20:39:35.450587] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-07T20:39:35.548742] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T20:39:35.550055] [INFO ] [REMOTE ] NXG: Full fetch complete (14328 records). [2025-10-07T20:39:35.550129] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-07T20:39:35.550909] [FATAL] [VALIDATOR ] NXG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:39:35.550995] [FATAL] [MAIN ] NXG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:39:35.551038] [WARN ] [MAIN ] NXG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:39:35.551103] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-07T20:39:35.551192] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-07T20:39:35.551247] [INFO ] [LOCAL ] NXG: Starting deletion of derivative data. [2025-10-07T20:39:35.551446] [DEBUG] [LOCAL ] NXG: Deleted derivative data file. [2025-10-07T20:39:35.551546] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 19.7s. Estimated remaining: 1h 53m 55s. Rate: 7.1 symbols/min [2025-10-07T20:39:35.754248] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:39:35.760018] [DEBUG] [LOCAL ] NXN: Loaded 2315 existing records from primary storage. [2025-10-07T20:39:35.760203] [INFO ] [MAIN ] NXN: Loaded 2315 existing records. [2025-10-07T20:39:35.853040] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-07T20:39:35.990137] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:39:35.990456] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-07T20:39:35.990535] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-07T20:39:35.990861] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-07T20:39:35.990933] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-07T20:39:36.416149] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:39:36.647619] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-07T20:39:37.330083] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T20:39:37.447679] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-07T20:39:37.878464] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T20:39:38.247685] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-07T20:39:38.823929] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T20:39:39.047638] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-07T20:39:39.322338] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T20:39:39.847679] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-07T20:39:40.647720] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-07T20:39:41.294180] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-07T20:39:41.447638] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-07T20:39:41.464194] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T20:39:41.544352] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T20:39:42.247740] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-07T20:39:42.409461] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T20:39:43.047750] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-07T20:39:43.601392] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T20:39:43.847638] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-07T20:39:44.154408] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T20:39:44.321462] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T20:39:44.322838] [INFO ] [REMOTE ] NXDT: Full fetch complete (24970 records). [2025-10-07T20:39:44.322910] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-07T20:39:44.323342] [FATAL] [VALIDATOR ] NXDT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:39:44.323425] [FATAL] [MAIN ] NXDT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:39:44.323491] [WARN ] [MAIN ] NXDT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:39:44.323565] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-07T20:39:44.323631] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-07T20:39:44.323709] [INFO ] [LOCAL ] NXDT: Starting deletion of derivative data. [2025-10-07T20:39:44.323880] [DEBUG] [LOCAL ] NXDT: Deleted derivative data file. [2025-10-07T20:39:44.323984] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXDT took 28.5s. Estimated remaining: 1h 53m 46s. Rate: 7.1 symbols/min [2025-10-07T20:39:44.493255] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:39:44.507750] [DEBUG] [LOCAL ] NXP: Loaded 12444 existing records from primary storage. [2025-10-07T20:39:44.507996] [INFO ] [MAIN ] NXP: Loaded 12444 existing records. [2025-10-07T20:39:44.653724] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-07T20:39:44.684119] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:39:44.684300] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-07T20:39:44.684346] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-07T20:39:44.684554] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-07T20:39:44.684611] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-07T20:39:45.030314] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:39:45.447622] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-07T20:39:45.760757] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T20:39:46.247752] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-07T20:39:46.797507] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T20:39:47.047740] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-07T20:39:47.433882] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T20:39:47.637076] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T20:39:47.847702] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-07T20:39:48.647693] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-07T20:39:49.447674] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-07T20:39:49.718075] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T20:39:49.769403] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-07T20:39:49.935149] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-07T20:39:50.247692] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-07T20:39:51.047755] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-07T20:39:51.053289] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T20:39:51.055121] [INFO ] [REMOTE ] NXJ: Full fetch complete (20771 records). [2025-10-07T20:39:51.055216] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-07T20:39:51.412678] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-07T20:39:51.412768] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-07T20:39:51.413163] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-07T20:39:51.413203] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-07T20:39:51.413797] [DEBUG] [LOCAL ] NXJ: Trimmed 20771 records to 14999 (keeping 200 days of data) [2025-10-07T20:39:51.511237] [DEBUG] [LOCAL ] NXJ: Primary data saved (14999 records). [2025-10-07T20:39:51.511406] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-07T20:39:51.511531] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXJ took 35.7s. Estimated remaining: 1h 53m 37s. Rate: 7.1 symbols/min [2025-10-07T20:39:51.695866] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:39:51.717546] [DEBUG] [LOCAL ] NXRT: Loaded 18928 existing records from primary storage. [2025-10-07T20:39:51.717894] [INFO ] [MAIN ] NXRT: Loaded 18928 existing records. [2025-10-07T20:39:51.863422] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-07T20:39:51.906930] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:39:51.909592] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-07T20:39:51.911069] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-07T20:39:51.912175] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-07T20:39:51.912419] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-10-07T20:39:51.912479] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-07T20:39:52.257897] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:39:52.647684] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-07T20:39:53.447628] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-07T20:39:53.569208] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T20:39:53.933815] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-07T20:39:54.096435] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T20:39:54.247712] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-07T20:39:55.047681] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-07T20:39:55.087572] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-07T20:39:55.847726] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-07T20:39:56.020629] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-07T20:39:56.647637] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-07T20:39:56.666539] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T20:39:57.170977] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T20:39:57.447690] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-07T20:39:58.128330] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-07T20:39:58.247610] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-07T20:39:59.047732] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-07T20:39:59.847764] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-07T20:40:00.089236] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T20:40:00.203344] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-07T20:40:00.428308] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-07T20:40:00.647677] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-07T20:40:01.447772] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-07T20:40:01.804445] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T20:40:02.247688] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-07T20:40:02.365702] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:40:03.047736] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-07T20:40:03.847630] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-07T20:40:04.182970] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T20:40:04.314603] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T20:40:04.315329] [INFO ] [REMOTE ] NXN: Full fetch complete (3600 records). [2025-10-07T20:40:04.315400] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-07T20:40:04.612382] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-07T20:40:04.651876] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-07T20:40:04.748181] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-07T20:40:04.748261] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-07T20:40:04.748389] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-07T20:40:04.748427] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-07T20:40:04.748819] [DEBUG] [LOCAL ] NXN: Trimmed 3600 records to 2320 (keeping 200 days of data) [2025-10-07T20:40:04.763257] [DEBUG] [LOCAL ] NXN: Primary data saved (2320 records). [2025-10-07T20:40:04.763342] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-07T20:40:04.763418] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXN took 29.2s. Estimated remaining: 1h 53m 31s. Rate: 7.1 symbols/min [2025-10-07T20:40:04.936779] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:40:04.936966] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-07T20:40:04.937023] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-07T20:40:04.937156] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-07T20:40:04.937202] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-07T20:40:04.937277] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-07T20:40:04.937327] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-07T20:40:05.298308] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:40:05.447624] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-07T20:40:05.732734] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T20:40:06.197995] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T20:40:06.201552] [INFO ] [REMOTE ] NXE: Full fetch complete (76336 records). [2025-10-07T20:40:06.201690] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-07T20:40:06.202558] [FATAL] [VALIDATOR ] NXE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:40:06.202675] [FATAL] [MAIN ] NXE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:40:06.202738] [WARN ] [MAIN ] NXE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:40:06.202841] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-07T20:40:06.202931] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-07T20:40:06.202983] [INFO ] [LOCAL ] NXE: Starting deletion of derivative data. [2025-10-07T20:40:06.203169] [DEBUG] [LOCAL ] NXE: Deleted derivative data file. [2025-10-07T20:40:06.203303] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXE took 50.4s. Estimated remaining: 1h 53m 19s. Rate: 7.1 symbols/min [2025-10-07T20:40:06.255737] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-07T20:40:06.375764] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:40:06.418766] [DEBUG] [LOCAL ] NYT: Loaded 49837 existing records from primary storage. [2025-10-07T20:40:06.419085] [INFO ] [MAIN ] NYT: Loaded 49837 existing records. [2025-10-07T20:40:06.597158] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:40:06.600942] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-07T20:40:06.601017] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-07T20:40:06.601388] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-10-07T20:40:06.601459] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-07T20:40:06.961554] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:40:07.047675] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-07T20:40:07.510984] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T20:40:07.614698] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-07T20:40:07.847692] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-07T20:40:08.488829] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T20:40:08.647740] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-07T20:40:09.447712] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-07T20:40:09.865325] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-07T20:40:10.104596] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-07T20:40:10.247683] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-07T20:40:11.047760] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-07T20:40:11.386468] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-07T20:40:11.847624] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-07T20:40:12.219103] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T20:40:12.647706] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-07T20:40:13.447625] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-07T20:40:13.589549] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T20:40:13.770695] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T20:40:13.870945] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-07T20:40:14.247678] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-07T20:40:15.047615] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-07T20:40:15.163724] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T20:40:15.847709] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-07T20:40:16.465043] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T20:40:16.584076] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T20:40:16.647625] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-07T20:40:17.447707] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-07T20:40:18.247624] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-07T20:40:18.303133] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T20:40:18.304599] [INFO ] [REMOTE ] NXP: Full fetch complete (16892 records). [2025-10-07T20:40:18.304719] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-07T20:40:18.676431] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-07T20:40:18.676679] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-07T20:40:18.677072] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-07T20:40:18.677146] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-07T20:40:18.677949] [DEBUG] [LOCAL ] NXP: Trimmed 16892 records to 12442 (keeping 200 days of data) [2025-10-07T20:40:18.759680] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-07T20:40:18.791278] [DEBUG] [LOCAL ] NXP: Primary data saved (12442 records). [2025-10-07T20:40:18.791434] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-07T20:40:18.791522] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXP took 34.5s. Estimated remaining: 1h 53m 13s. Rate: 7.1 symbols/min [2025-10-07T20:40:18.963286] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:40:18.996278] [DEBUG] [LOCAL ] NZF: Loaded 29130 existing records from primary storage. [2025-10-07T20:40:18.996548] [INFO ] [MAIN ] NZF: Loaded 29130 existing records. [2025-10-07T20:40:19.060001] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-07T20:40:19.177812] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:40:19.178160] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-07T20:40:19.178217] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-07T20:40:19.178438] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-07T20:40:19.178494] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-07T20:40:19.545461] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:40:19.548427] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T20:40:19.747087] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T20:40:19.847720] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-07T20:40:20.647708] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-07T20:40:21.124449] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-07T20:40:21.402677] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T20:40:21.447685] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-07T20:40:22.247740] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-07T20:40:22.644682] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-07T20:40:22.906403] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T20:40:23.047743] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-07T20:40:23.847712] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-07T20:40:24.647714] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-07T20:40:24.999547] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T20:40:25.032613] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T20:40:25.121454] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T20:40:25.447696] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-07T20:40:26.247695] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-07T20:40:27.039423] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T20:40:27.050472] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-07T20:40:27.475078] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T20:40:27.847682] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-07T20:40:28.184622] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T20:40:28.647638] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-07T20:40:29.054149] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-07T20:40:29.318667] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T20:40:29.447717] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-07T20:40:30.247730] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-07T20:40:31.047670] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-07T20:40:31.262275] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T20:40:31.522403] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T20:40:31.524151] [INFO ] [REMOTE ] NXRT: Full fetch complete (25494 records). [2025-10-07T20:40:31.524247] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-07T20:40:31.524833] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:40:31.524919] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:40:31.524961] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:40:31.525044] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-07T20:40:31.525126] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-07T20:40:31.525164] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-07T20:40:31.525378] [DEBUG] [LOCAL ] NXRT: Deleted derivative data file. [2025-10-07T20:40:31.525504] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXRT took 40.0s. Estimated remaining: 1h 53m 7s. Rate: 7.1 symbols/min [2025-10-07T20:40:31.707456] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:40:31.707862] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-07T20:40:31.707988] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-07T20:40:31.724500] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-07T20:40:31.724682] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-07T20:40:31.726023] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-07T20:40:31.725911] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T20:40:31.726190] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-07T20:40:31.852823] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-07T20:40:32.087991] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:40:32.647695] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-07T20:40:33.447728] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-07T20:40:33.485614] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T20:40:34.035371] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T20:40:34.247695] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-07T20:40:34.441604] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T20:40:35.047725] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-07T20:40:35.594744] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T20:40:35.847737] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-07T20:40:36.647721] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-07T20:40:37.012773] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-07T20:40:37.447736] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-07T20:40:37.605718] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T20:40:37.606576] [INFO ] [REMOTE ] NYC: Full fetch complete (1888 records). [2025-10-07T20:40:37.606720] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-07T20:40:37.607268] [FATAL] [VALIDATOR ] NYC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:40:37.607379] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:40:37.607458] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:40:37.607548] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-07T20:40:37.607691] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-07T20:40:37.607767] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-07T20:40:37.607842] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-07T20:40:37.607926] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NYC took 32.8s. Estimated remaining: 1h 52m 57s. Rate: 7.1 symbols/min [2025-10-07T20:40:37.800314] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:40:37.850854] [DEBUG] [LOCAL ] OBDC: Loaded 51661 existing records from primary storage. [2025-10-07T20:40:37.851200] [INFO ] [MAIN ] OBDC: Loaded 51661 existing records. [2025-10-07T20:40:38.032409] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:40:38.032726] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-07T20:40:38.032781] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-07T20:40:38.033169] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-07T20:40:38.033226] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-07T20:40:38.203052] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-07T20:40:38.252823] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-07T20:40:38.418181] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:40:39.047745] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-07T20:40:39.847771] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-07T20:40:40.427229] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-07T20:40:40.498396] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T20:40:40.647737] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-07T20:40:40.869201] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (3.42 seconds). [2025-10-07T20:40:41.447764] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-07T20:40:41.770006] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T20:40:42.247681] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-07T20:40:43.047636] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-07T20:40:43.201680] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-07T20:40:43.847740] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-07T20:40:44.217706] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T20:40:44.220879] [INFO ] [REMOTE ] NYT: Full fetch complete (71740 records). [2025-10-07T20:40:44.221031] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-07T20:40:44.221886] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:40:44.221993] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:40:44.222074] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:40:44.222161] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-07T20:40:44.222272] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-07T20:40:44.222355] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-07T20:40:44.222673] [DEBUG] [LOCAL ] NYT: Deleted derivative data file. [2025-10-07T20:40:44.222784] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NYT took 38.0s. Estimated remaining: 1h 52m 48s. Rate: 7.1 symbols/min [2025-10-07T20:40:44.432593] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:40:44.451386] [DEBUG] [LOCAL ] OBK: Loaded 16137 existing records from primary storage. [2025-10-07T20:40:44.451673] [INFO ] [MAIN ] OBK: Loaded 16137 existing records. [2025-10-07T20:40:44.668073] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:40:44.668408] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-07T20:40:44.668484] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-07T20:40:44.668931] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-07T20:40:44.668997] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-07T20:40:45.094434] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:40:45.119881] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-07T20:40:45.125836] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (3.68 seconds). [2025-10-07T20:40:45.331246] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T20:40:45.447688] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-07T20:40:45.648566] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (3.40 seconds). [2025-10-07T20:40:46.247639] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-07T20:40:46.288079] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-07T20:40:46.641031] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T20:40:46.644095] [INFO ] [REMOTE ] NZF: Full fetch complete (43220 records). [2025-10-07T20:40:46.644229] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-07T20:40:47.047823] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-07T20:40:47.049413] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-07T20:40:47.049511] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-07T20:40:47.050384] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-07T20:40:47.050567] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-07T20:40:47.051569] [DEBUG] [LOCAL ] NZF: Trimmed 43220 records to 29073 (keeping 200 days of data) [2025-10-07T20:40:47.235680] [DEBUG] [LOCAL ] NZF: Primary data saved (29073 records). [2025-10-07T20:40:47.235864] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-07T20:40:47.235967] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NZF took 28.4s. Estimated remaining: 1h 52m 36s. Rate: 7.1 symbols/min [2025-10-07T20:40:47.403879] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:40:47.447412] [DEBUG] [LOCAL ] OC: Loaded 44624 existing records from primary storage. [2025-10-07T20:40:47.447794] [INFO ] [MAIN ] OC: Loaded 44624 existing records. [2025-10-07T20:40:47.624771] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:40:47.624987] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-07T20:40:47.625035] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-07T20:40:47.625298] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-10-07T20:40:47.625356] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-07T20:40:47.864993] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-07T20:40:48.022825] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:40:48.138477] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-07T20:40:48.214791] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T20:40:48.647734] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-07T20:40:49.447762] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-07T20:40:50.247631] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-07T20:40:50.386074] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T20:40:50.422176] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-07T20:40:50.671531] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T20:40:51.047717] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-07T20:40:51.847769] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-07T20:40:52.166069] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T20:40:52.526380] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-07T20:40:52.647762] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-07T20:40:52.812378] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T20:40:53.447762] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-07T20:40:53.522840] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-07T20:40:54.247684] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-07T20:40:55.047628] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-07T20:40:55.280001] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T20:40:55.847693] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-07T20:40:56.227805] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T20:40:56.647737] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-07T20:40:57.391804] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-07T20:40:57.447601] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-07T20:40:57.675318] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T20:40:58.247619] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-07T20:40:58.675826] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T20:40:59.047749] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-07T20:40:59.847706] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-07T20:41:00.008714] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-07T20:41:00.052547] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T20:41:00.647713] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-07T20:41:00.950542] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T20:41:01.178287] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-07T20:41:01.447765] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-07T20:41:02.247759] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-07T20:41:02.547524] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T20:41:03.047613] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-07T20:41:03.383529] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-07T20:41:03.852782] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-07T20:41:03.870385] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T20:41:04.248303] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T20:41:04.647739] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-07T20:41:05.447627] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-07T20:41:05.872554] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-07T20:41:06.247741] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-07T20:41:06.587146] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-07T20:41:07.047688] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-07T20:41:07.847708] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-07T20:41:08.019346] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-07T20:41:08.209101] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-07T20:41:08.500762] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-07T20:41:08.647628] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-07T20:41:08.723066] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T20:41:09.447701] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-07T20:41:10.247733] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-07T20:41:10.559607] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-07T20:41:11.047664] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-07T20:41:11.634044] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T20:41:11.637719] [INFO ] [REMOTE ] OBDC: Full fetch complete (74657 records). [2025-10-07T20:41:11.637885] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-07T20:41:11.638766] [FATAL] [VALIDATOR ] OBDC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:41:11.638873] [FATAL] [MAIN ] OBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:41:11.638948] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:41:11.639036] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-07T20:41:11.639118] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-07T20:41:11.639157] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-07T20:41:11.639592] [DEBUG] [LOCAL ] OBDC: Deleted derivative data file. [2025-10-07T20:41:11.639742] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. OBDC took 34.0s. Estimated remaining: 1h 52m 36s. Rate: 7.1 symbols/min [2025-10-07T20:41:11.816025] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:41:11.826855] [DEBUG] [LOCAL ] OCFT: Loaded 7844 existing records from primary storage. [2025-10-07T20:41:11.827084] [INFO ] [MAIN ] OCFT: Loaded 7844 existing records. [2025-10-07T20:41:11.857305] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-07T20:41:12.044048] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:41:12.044678] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-07T20:41:12.046614] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-07T20:41:12.057974] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-07T20:41:12.058828] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-07T20:41:12.059260] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-07T20:41:12.257867] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-07T20:41:12.472831] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:41:12.647606] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-07T20:41:12.999463] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T20:41:13.282775] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T20:41:13.447708] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-07T20:41:14.247714] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-07T20:41:15.047719] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-07T20:41:15.676824] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:41:15.678336] [INFO ] [REMOTE ] OBK: Full fetch complete (23753 records). [2025-10-07T20:41:15.678457] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-07T20:41:15.679012] [FATAL] [VALIDATOR ] OBK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:41:15.679104] [FATAL] [MAIN ] OBK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:41:15.679147] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:41:15.679186] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-07T20:41:15.679246] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-07T20:41:15.679329] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-07T20:41:15.679537] [DEBUG] [LOCAL ] OBK: Deleted derivative data file. [2025-10-07T20:41:15.679632] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. OBK took 31.5s. Estimated remaining: 1h 52m 25s. Rate: 7.1 symbols/min [2025-10-07T20:41:15.867799] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:41:15.863047] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-07T20:41:15.879819] [DEBUG] [LOCAL ] ODC: Loaded 8343 existing records from primary storage. [2025-10-07T20:41:15.880174] [INFO ] [MAIN ] ODC: Loaded 8343 existing records. [2025-10-07T20:41:16.065049] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:41:16.065701] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-07T20:41:16.065857] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-07T20:41:16.066301] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-07T20:41:16.066575] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-07T20:41:16.281397] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T20:41:16.436587] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-07T20:41:16.531468] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:41:16.563896] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-07T20:41:16.647601] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-07T20:41:17.447759] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-07T20:41:18.131144] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:41:18.134172] [INFO ] [REMOTE ] OC: Full fetch complete (63811 records). [2025-10-07T20:41:18.134278] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-07T20:41:18.135149] [FATAL] [VALIDATOR ] OC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:41:18.135252] [FATAL] [MAIN ] OC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:41:18.135294] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:41:18.135346] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-07T20:41:18.135429] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-07T20:41:18.135467] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-07T20:41:18.135667] [DEBUG] [LOCAL ] OC: Deleted derivative data file. [2025-10-07T20:41:18.135776] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OC took 30.9s. Estimated remaining: 1h 52m 14s. Rate: 7.1 symbols/min [2025-10-07T20:41:18.252813] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-07T20:41:18.306155] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:41:18.332420] [DEBUG] [LOCAL ] ODV: Loaded 27384 existing records from primary storage. [2025-10-07T20:41:18.332741] [INFO ] [MAIN ] ODV: Loaded 27384 existing records. [2025-10-07T20:41:18.507308] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:41:18.507582] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-07T20:41:18.507631] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-07T20:41:18.507913] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-07T20:41:18.507971] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-07T20:41:18.858597] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:41:19.047619] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-07T20:41:19.155790] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-07T20:41:19.334302] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T20:41:19.847755] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-07T20:41:20.148530] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T20:41:20.419740] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:41:20.423801] [INFO ] [REMOTE ] O: Full fetch complete (77169 records). [2025-10-07T20:41:20.423972] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-07T20:41:20.424803] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:41:20.424900] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:41:20.424944] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:41:20.425017] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-07T20:41:20.425086] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-07T20:41:20.425123] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-07T20:41:20.425162] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-07T20:41:20.425283] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. O took 48.9s. Estimated remaining: 1h 52m 2s. Rate: 7.1 symbols/min [2025-10-07T20:41:20.596357] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:41:20.634938] [DEBUG] [LOCAL ] OEC: Loaded 36886 existing records from primary storage. [2025-10-07T20:41:20.635270] [INFO ] [MAIN ] OEC: Loaded 36886 existing records. [2025-10-07T20:41:20.655309] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-07T20:41:20.853485] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:41:20.853761] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-07T20:41:20.853813] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-07T20:41:20.854002] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-07T20:41:20.854058] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-07T20:41:21.215918] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:41:21.447617] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-07T20:41:21.590128] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-07T20:41:22.247687] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-07T20:41:22.980423] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T20:41:23.047623] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-07T20:41:23.124541] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T20:41:23.847630] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-07T20:41:23.853765] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T20:41:24.647733] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-07T20:41:25.269438] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T20:41:25.447629] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-07T20:41:25.742064] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T20:41:26.247696] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-07T20:41:26.899908] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T20:41:27.047667] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-07T20:41:27.130505] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T20:41:27.847704] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-07T20:41:28.638696] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T20:41:28.647588] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-07T20:41:28.747267] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T20:41:29.447722] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-07T20:41:30.228597] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T20:41:30.247601] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-07T20:41:30.329372] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T20:41:31.047705] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-07T20:41:31.091854] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T20:41:31.847685] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-07T20:41:32.648223] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-07T20:41:32.653683] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T20:41:32.703697] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-07T20:41:33.447723] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-07T20:41:33.557581] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T20:41:34.247715] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-07T20:41:34.347322] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T20:41:35.047713] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-07T20:41:35.181412] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T20:41:35.799214] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T20:41:35.847609] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-07T20:41:36.647670] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-07T20:41:37.447722] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-07T20:41:37.639866] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T20:41:38.247704] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-07T20:41:38.845999] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-07T20:41:39.047722] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-07T20:41:39.755206] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-07T20:41:39.847687] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-07T20:41:40.650559] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-07T20:41:40.651856] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T20:41:40.894911] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-07T20:41:40.939896] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T20:41:40.940633] [INFO ] [REMOTE ] OCFT: Full fetch complete (11640 records). [2025-10-07T20:41:40.940738] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-07T20:41:40.941260] [FATAL] [VALIDATOR ] OCFT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:41:40.941354] [FATAL] [MAIN ] OCFT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:41:40.941440] [WARN ] [MAIN ] OCFT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:41:40.941538] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-07T20:41:40.941674] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-07T20:41:40.941742] [INFO ] [LOCAL ] OCFT: Starting deletion of derivative data. [2025-10-07T20:41:40.941950] [DEBUG] [LOCAL ] OCFT: Deleted derivative data file. [2025-10-07T20:41:40.942055] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. OCFT took 29.3s. Estimated remaining: 1h 52m 0s. Rate: 7.1 symbols/min [2025-10-07T20:41:41.132203] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T20:41:41.135566] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:41:41.167994] [DEBUG] [LOCAL ] OFG: Loaded 21218 existing records from primary storage. [2025-10-07T20:41:41.168277] [INFO ] [MAIN ] OFG: Loaded 21218 existing records. [2025-10-07T20:41:41.344934] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:41:41.345200] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-07T20:41:41.345253] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-07T20:41:41.345461] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-10-07T20:41:41.345518] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-07T20:41:41.447695] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-07T20:41:41.709779] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:41:42.247711] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-07T20:41:43.047733] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-07T20:41:43.395947] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T20:41:43.650501] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T20:41:43.847718] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-07T20:41:44.420199] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-07T20:41:44.647681] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-07T20:41:44.703219] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-07T20:41:45.447739] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-07T20:41:46.166637] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T20:41:46.247746] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-07T20:41:46.362773] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T20:41:47.047694] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-07T20:41:47.607108] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T20:41:47.847704] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-07T20:41:48.650164] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-07T20:41:48.650003] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T20:41:49.315871] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T20:41:49.330237] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-07T20:41:49.447701] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-07T20:41:49.954813] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T20:41:49.955800] [INFO ] [REMOTE ] ODC: Full fetch complete (10853 records). [2025-10-07T20:41:49.955873] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-07T20:41:49.956340] [FATAL] [VALIDATOR ] ODC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:41:49.956426] [FATAL] [MAIN ] ODC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:41:49.956469] [WARN ] [MAIN ] ODC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:41:49.956508] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-07T20:41:49.956568] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-07T20:41:49.956603] [INFO ] [LOCAL ] ODC: Starting deletion of derivative data. [2025-10-07T20:41:49.956849] [DEBUG] [LOCAL ] ODC: Deleted derivative data file. [2025-10-07T20:41:49.956938] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. ODC took 34.3s. Estimated remaining: 1h 51m 52s. Rate: 7.1 symbols/min [2025-10-07T20:41:50.140395] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:41:50.191469] [DEBUG] [LOCAL ] OGE: Loaded 46258 existing records from primary storage. [2025-10-07T20:41:50.191828] [INFO ] [MAIN ] OGE: Loaded 46258 existing records. [2025-10-07T20:41:50.255145] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-07T20:41:50.379054] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:41:50.379268] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-07T20:41:50.379316] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-07T20:41:50.379559] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-10-07T20:41:50.379615] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-07T20:41:50.746634] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:41:50.902682] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:41:50.904985] [INFO ] [REMOTE ] OEC: Full fetch complete (52627 records). [2025-10-07T20:41:50.905084] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-07T20:41:50.905672] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:41:50.905759] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:41:50.905802] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:41:50.905841] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-07T20:41:50.905900] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-07T20:41:50.905934] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-07T20:41:50.906119] [DEBUG] [LOCAL ] OEC: Deleted derivative data file. [2025-10-07T20:41:50.906207] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OEC took 30.5s. Estimated remaining: 1h 51m 40s. Rate: 7.1 symbols/min [2025-10-07T20:41:51.052253] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-07T20:41:51.075592] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:41:51.076464] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-07T20:41:51.076521] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-07T20:41:51.076727] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-07T20:41:51.076778] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-07T20:41:51.076821] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-07T20:41:51.076853] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-07T20:41:51.424723] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:41:51.847691] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-07T20:41:52.543507] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T20:41:52.647705] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-07T20:41:53.447742] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-07T20:41:53.908757] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-07T20:41:54.247705] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-07T20:41:54.318092] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T20:41:54.910853] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T20:41:55.047687] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-07T20:41:55.783847] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T20:41:55.847637] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-07T20:41:56.473631] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T20:41:56.647734] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-07T20:41:57.222166] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T20:41:57.447701] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-07T20:41:57.551155] [DEBUG] [REMOTE ] ODV: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-07T20:41:57.551518] [WARN ] [REMOTE ] ODV: No data returned for month 2025-09 [2025-10-07T20:41:57.551611] [FATAL] [REMOTE ] ODV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:41:57.551740] [FATAL] [MAIN ] ODV: Failed to fetch primary data. [2025-10-07T20:41:57.551808] [WARN ] [MAIN ] ODV: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:41:57.551882] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-07T20:41:57.551951] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-07T20:41:57.551990] [INFO ] [LOCAL ] ODV: Starting deletion of derivative data. [2025-10-07T20:41:57.552132] [DEBUG] [LOCAL ] ODV: Deleted derivative data file. [2025-10-07T20:41:57.552219] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. ODV took 39.4s. Estimated remaining: 1h 51m 30s. Rate: 7.1 symbols/min [2025-10-07T20:41:57.729878] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:41:57.766926] [DEBUG] [LOCAL ] OGS: Loaded 34301 existing records from primary storage. [2025-10-07T20:41:57.767318] [INFO ] [MAIN ] OGS: Loaded 34301 existing records. [2025-10-07T20:41:57.952880] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:41:57.953133] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-07T20:41:57.953295] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-07T20:41:57.953783] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-10-07T20:41:57.953849] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-07T20:41:58.077333] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T20:41:58.252678] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-07T20:41:58.332406] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:41:59.047715] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-07T20:41:59.463243] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T20:41:59.847726] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-07T20:42:00.647705] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-07T20:42:01.244781] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-07T20:42:01.411065] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T20:42:01.447629] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-07T20:42:02.121276] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T20:42:02.247617] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-07T20:42:02.632792] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T20:42:03.047723] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-07T20:42:03.847693] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-07T20:42:03.916755] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T20:42:04.647734] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-07T20:42:04.903740] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T20:42:05.436127] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T20:42:05.447604] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-07T20:42:06.247734] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-07T20:42:06.536336] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T20:42:06.944923] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T20:42:07.047697] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-07T20:42:07.241557] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T20:42:07.847686] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-07T20:42:08.456525] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T20:42:08.647613] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-07T20:42:09.004781] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T20:42:09.447739] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-07T20:42:10.256891] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-07T20:42:10.263034] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T20:42:11.047620] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-07T20:42:11.425401] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-07T20:42:11.567874] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-07T20:42:11.847608] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-07T20:42:12.361751] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T20:42:12.583827] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T20:42:12.585875] [INFO ] [REMOTE ] OFG: Full fetch complete (33963 records). [2025-10-07T20:42:12.585967] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-07T20:42:12.586665] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:42:12.586809] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:42:12.586891] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:42:12.587211] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-07T20:42:12.587319] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-07T20:42:12.587377] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-07T20:42:12.587626] [DEBUG] [LOCAL ] OFG: Deleted derivative data file. [2025-10-07T20:42:12.587745] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OFG took 31.6s. Estimated remaining: 1h 51m 25s. Rate: 7.1 symbols/min [2025-10-07T20:42:12.656997] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-07T20:42:12.771765] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:42:12.829544] [DEBUG] [LOCAL ] OHI: Loaded 51954 existing records from primary storage. [2025-10-07T20:42:12.829944] [INFO ] [MAIN ] OHI: Loaded 51954 existing records. [2025-10-07T20:42:13.002940] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:42:13.003160] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-07T20:42:13.003206] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-07T20:42:13.003485] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-10-07T20:42:13.003542] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-07T20:42:13.347356] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:42:13.447595] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-07T20:42:14.235850] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T20:42:14.247610] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-07T20:42:15.052789] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-07T20:42:15.073796] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T20:42:15.847626] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-07T20:42:16.046253] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T20:42:16.647633] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-07T20:42:16.831460] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T20:42:17.447761] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-07T20:42:17.769324] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-07T20:42:18.171404] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T20:42:18.247681] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-07T20:42:19.047620] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-07T20:42:19.440950] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T20:42:19.694125] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T20:42:19.847639] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-07T20:42:20.647762] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-07T20:42:20.846808] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T20:42:21.117525] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T20:42:21.119679] [INFO ] [REMOTE ] OGS: Full fetch complete (47817 records). [2025-10-07T20:42:21.119765] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-07T20:42:21.120412] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:42:21.120498] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:42:21.120541] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:42:21.120580] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-07T20:42:21.120638] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-07T20:42:21.120718] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-07T20:42:21.120901] [DEBUG] [LOCAL ] OGS: Deleted derivative data file. [2025-10-07T20:42:21.120993] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGS took 23.6s. Estimated remaining: 1h 51m 17s. Rate: 7.1 symbols/min [2025-10-07T20:42:21.289403] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:42:21.334186] [DEBUG] [LOCAL ] OI: Loaded 47053 existing records from primary storage. [2025-10-07T20:42:21.334498] [INFO ] [MAIN ] OI: Loaded 47053 existing records. [2025-10-07T20:42:21.452914] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-07T20:42:21.513396] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:42:21.513698] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-07T20:42:21.513852] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-07T20:42:21.514154] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-10-07T20:42:21.514250] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-07T20:42:21.827480] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T20:42:21.921243] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:42:22.247752] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-07T20:42:23.047738] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-07T20:42:23.155395] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T20:42:23.847678] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-07T20:42:23.998464] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T20:42:24.473986] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T20:42:24.647724] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-07T20:42:25.426796] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T20:42:25.447601] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-07T20:42:26.247770] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-07T20:42:26.321816] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T20:42:27.047638] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-07T20:42:27.152864] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T20:42:27.847773] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-07T20:42:28.162956] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T20:42:28.353478] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T20:42:28.647636] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-07T20:42:29.450162] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-07T20:42:29.452996] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T20:42:30.247701] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-07T20:42:30.530735] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T20:42:30.865693] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T20:42:31.047695] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-07T20:42:31.686266] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T20:42:31.847683] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-07T20:42:32.647621] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-07T20:42:32.816095] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T20:42:33.452834] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-07T20:42:33.475144] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T20:42:34.185810] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T20:42:34.247606] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-07T20:42:35.047732] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-07T20:42:35.425697] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T20:42:35.847728] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-07T20:42:35.904549] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T20:42:35.907323] [INFO ] [REMOTE ] OGE: Full fetch complete (66418 records). [2025-10-07T20:42:35.907438] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-07T20:42:35.908387] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:42:35.908498] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:42:35.908582] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:42:35.908702] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-07T20:42:35.908806] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-07T20:42:35.908861] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-07T20:42:35.909035] [DEBUG] [LOCAL ] OGE: Deleted derivative data file. [2025-10-07T20:42:35.909147] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGE took 46.0s. Estimated remaining: 1h 51m 12s. Rate: 7.1 symbols/min [2025-10-07T20:42:36.078739] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:42:36.093894] [DEBUG] [LOCAL ] OIA: Loaded 13637 existing records from primary storage. [2025-10-07T20:42:36.094143] [INFO ] [MAIN ] OIA: Loaded 13637 existing records. [2025-10-07T20:42:36.281329] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:42:36.281858] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-07T20:42:36.281959] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-07T20:42:36.282206] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-07T20:42:36.282262] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-07T20:42:36.648919] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-07T20:42:36.648775] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:42:36.681443] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-07T20:42:37.447744] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-07T20:42:38.247719] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-07T20:42:38.580440] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-07T20:42:39.047714] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-07T20:42:40.063228] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T20:42:40.067075] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-07T20:42:40.249085] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (3.60 seconds). [2025-10-07T20:42:40.647759] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-07T20:42:41.169151] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T20:42:41.314299] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T20:42:41.318897] [INFO ] [REMOTE ] OHI: Full fetch complete (74744 records). [2025-10-07T20:42:41.319120] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-07T20:42:41.320038] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:42:41.320138] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:42:41.320183] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:42:41.320225] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-07T20:42:41.320287] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-07T20:42:41.320324] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-07T20:42:41.320563] [DEBUG] [LOCAL ] OHI: Deleted derivative data file. [2025-10-07T20:42:41.320730] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OHI took 28.7s. Estimated remaining: 1h 51m 2s. Rate: 7.1 symbols/min [2025-10-07T20:42:41.464747] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-07T20:42:41.500251] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:42:41.542095] [DEBUG] [LOCAL ] OII: Loaded 42297 existing records from primary storage. [2025-10-07T20:42:41.555546] [INFO ] [MAIN ] OII: Loaded 42297 existing records. [2025-10-07T20:42:41.605448] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-07T20:42:41.775328] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:42:41.775666] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-07T20:42:41.775745] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-07T20:42:41.776124] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-10-07T20:42:41.776182] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-07T20:42:42.105346] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (4.66 seconds). [2025-10-07T20:42:42.199270] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:42:42.247679] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-07T20:42:43.047633] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-07T20:42:43.130041] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T20:42:43.847730] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-07T20:42:44.647732] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-07T20:42:45.002529] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-07T20:42:45.151311] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T20:42:45.447681] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-07T20:42:46.247739] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-07T20:42:46.390374] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (3.34 seconds). [2025-10-07T20:42:46.869293] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T20:42:47.026892] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-07T20:42:47.047635] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-07T20:42:47.121789] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T20:42:47.340041] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T20:42:47.343178] [INFO ] [REMOTE ] OGN: Full fetch complete (76408 records). [2025-10-07T20:42:47.343312] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-07T20:42:47.344204] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:42:47.344303] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:42:47.344346] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:42:47.344394] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-07T20:42:47.344459] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-07T20:42:47.344503] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-07T20:42:47.344543] [DEBUG] [LOCAL ] OGN: No derivative data file found to delete. [2025-10-07T20:42:47.344600] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OGN took 56.4s. Estimated remaining: 1h 50m 52s. Rate: 7.1 symbols/min [2025-10-07T20:42:47.510628] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:42:47.550988] [DEBUG] [LOCAL ] OIS: Loaded 40226 existing records from primary storage. [2025-10-07T20:42:47.551328] [INFO ] [MAIN ] OIS: Loaded 40226 existing records. [2025-10-07T20:42:47.727713] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:42:47.727984] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-07T20:42:47.728032] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-07T20:42:47.728275] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-07T20:42:47.728336] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-07T20:42:47.852949] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-07T20:42:48.090043] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:42:48.647692] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-07T20:42:48.826255] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T20:42:49.447730] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-07T20:42:50.137740] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T20:42:50.247613] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-07T20:42:51.047690] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-07T20:42:51.331041] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T20:42:51.398616] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T20:42:51.847726] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-07T20:42:52.625579] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T20:42:52.647604] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-07T20:42:53.300280] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T20:42:53.447637] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-07T20:42:54.218041] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T20:42:54.247770] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-07T20:42:55.047733] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-07T20:42:55.113469] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T20:42:55.847625] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-07T20:42:56.086102] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T20:42:56.647726] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-07T20:42:56.862436] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T20:42:57.079753] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T20:42:57.447714] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-07T20:42:57.621894] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T20:42:58.097845] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:42:58.100667] [INFO ] [REMOTE ] OI: Full fetch complete (67778 records). [2025-10-07T20:42:58.100776] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-07T20:42:58.101672] [FATAL] [VALIDATOR ] OI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:42:58.101769] [FATAL] [MAIN ] OI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:42:58.101813] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:42:58.101852] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-07T20:42:58.101939] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-07T20:42:58.101995] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-07T20:42:58.102161] [DEBUG] [LOCAL ] OI: Deleted derivative data file. [2025-10-07T20:42:58.102269] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OI took 37.0s. Estimated remaining: 1h 50m 45s. Rate: 7.1 symbols/min [2025-10-07T20:42:58.269815] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-07T20:42:58.273105] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:42:58.273284] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-07T20:42:58.274078] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-07T20:42:58.274192] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-07T20:42:58.274236] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-07T20:42:58.274279] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-07T20:42:58.274312] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-07T20:42:58.659056] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:42:59.047623] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-07T20:42:59.266769] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T20:42:59.847744] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-07T20:43:00.647695] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-07T20:43:00.793620] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T20:43:01.125288] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T20:43:01.447697] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-07T20:43:02.247631] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-07T20:43:02.493016] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T20:43:03.047706] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-07T20:43:03.505796] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-07T20:43:03.847667] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-07T20:43:03.923091] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T20:43:04.647702] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-07T20:43:04.784531] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T20:43:05.161023] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T20:43:05.447710] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-07T20:43:06.247631] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-07T20:43:06.280946] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T20:43:07.047680] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-07T20:43:07.091113] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T20:43:07.847631] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-07T20:43:07.876525] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T20:43:07.877803] [INFO ] [REMOTE ] OIA: Full fetch complete (21048 records). [2025-10-07T20:43:07.877877] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-07T20:43:08.222717] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T20:43:08.302130] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-07T20:43:08.302216] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-07T20:43:08.302701] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-07T20:43:08.302762] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-07T20:43:08.303311] [DEBUG] [LOCAL ] OIA: Trimmed 21048 records to 13604 (keeping 200 days of data) [2025-10-07T20:43:08.382924] [DEBUG] [LOCAL ] OIA: Primary data saved (13604 records). [2025-10-07T20:43:08.383062] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-07T20:43:08.383146] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OIA took 32.5s. Estimated remaining: 1h 50m 37s. Rate: 7.1 symbols/min [2025-10-07T20:43:08.553147] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:43:08.553339] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-07T20:43:08.553377] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-07T20:43:08.553489] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-07T20:43:08.553531] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-07T20:43:08.553573] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-07T20:43:08.553606] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-07T20:43:08.652841] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-07T20:43:08.909432] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:43:09.447632] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-07T20:43:09.664898] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T20:43:10.247723] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-07T20:43:10.402286] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T20:43:11.047633] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-07T20:43:11.359318] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-07T20:43:11.847673] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-07T20:43:12.647615] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-07T20:43:12.743486] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T20:43:12.997054] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-07T20:43:13.447603] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-07T20:43:13.627123] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T20:43:13.850749] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T20:43:14.247697] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-07T20:43:14.489985] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-07T20:43:14.492380] [INFO ] [REMOTE ] OIS: Full fetch complete (56881 records). [2025-10-07T20:43:14.492464] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-07T20:43:14.493081] [FATAL] [VALIDATOR ] OIS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:43:14.493169] [FATAL] [MAIN ] OIS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:43:14.493225] [WARN ] [MAIN ] OIS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:43:14.493314] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-07T20:43:14.493396] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-07T20:43:14.493445] [INFO ] [LOCAL ] OIS: Starting deletion of derivative data. [2025-10-07T20:43:14.493713] [DEBUG] [LOCAL ] OIS: Deleted derivative data file. [2025-10-07T20:43:14.493835] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OIS took 27.1s. Estimated remaining: 1h 50m 28s. Rate: 7.1 symbols/min [2025-10-07T20:43:14.659522] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:43:14.708154] [DEBUG] [LOCAL ] OLN: Loaded 51821 existing records from primary storage. [2025-10-07T20:43:14.708495] [INFO ] [MAIN ] OLN: Loaded 51821 existing records. [2025-10-07T20:43:14.883300] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:43:14.883527] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-07T20:43:14.883582] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-07T20:43:14.883833] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-10-07T20:43:14.883891] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-07T20:43:15.053034] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-07T20:43:15.242488] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:43:15.769160] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T20:43:15.771979] [INFO ] [REMOTE ] OII: Full fetch complete (61561 records). [2025-10-07T20:43:15.772112] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-07T20:43:15.772925] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:43:15.773033] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:43:15.773108] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:43:15.773247] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-07T20:43:15.773328] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-07T20:43:15.773364] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-07T20:43:15.773537] [DEBUG] [LOCAL ] OII: Deleted derivative data file. [2025-10-07T20:43:15.773706] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OII took 34.5s. Estimated remaining: 1h 50m 16s. Rate: 7.1 symbols/min [2025-10-07T20:43:15.848407] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-07T20:43:15.949453] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:43:15.961607] [DEBUG] [LOCAL ] OLP: Loaded 9941 existing records from primary storage. [2025-10-07T20:43:15.961900] [INFO ] [MAIN ] OLP: Loaded 9941 existing records. [2025-10-07T20:43:16.149972] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:43:16.150427] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-07T20:43:16.150478] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-07T20:43:16.150819] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-07T20:43:16.150892] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-07T20:43:16.538307] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:43:16.540476] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (3.09 seconds). [2025-10-07T20:43:16.647594] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-07T20:43:17.447620] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-07T20:43:17.712496] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T20:43:18.247683] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-07T20:43:19.047724] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-07T20:43:19.340626] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-07T20:43:19.438386] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T20:43:19.847671] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-07T20:43:20.000804] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T20:43:20.389181] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-07T20:43:20.647716] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-07T20:43:21.447741] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-07T20:43:21.534630] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T20:43:22.247621] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-07T20:43:22.578558] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-07T20:43:23.047717] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-07T20:43:23.591797] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-07T20:43:23.847613] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-07T20:43:23.907289] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T20:43:24.032875] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T20:43:24.647724] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-07T20:43:25.447717] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-07T20:43:25.571719] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:43:26.247736] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-07T20:43:26.682285] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-07T20:43:27.047739] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-07T20:43:27.195136] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T20:43:27.847712] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-07T20:43:27.917734] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T20:43:28.647721] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-07T20:43:28.737830] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T20:43:29.447609] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-07T20:43:30.005326] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-10-07T20:43:30.247619] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-07T20:43:30.705337] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-07T20:43:30.819236] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T20:43:31.047683] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-07T20:43:31.847762] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-07T20:43:32.648094] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-07T20:43:32.726230] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-07T20:43:33.106447] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-07T20:43:33.241941] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T20:43:33.447737] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-07T20:43:33.794549] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T20:43:34.247688] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-07T20:43:34.319742] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T20:43:35.047748] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-07T20:43:35.847727] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-07T20:43:36.569874] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-07T20:43:36.647693] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-07T20:43:36.980462] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T20:43:37.447704] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-07T20:43:38.040587] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T20:43:38.247697] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-07T20:43:39.047705] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-07T20:43:40.261041] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (4.41 seconds). [2025-10-07T20:43:40.275915] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-07T20:43:40.339855] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-07T20:43:40.343050] [INFO ] [REMOTE ] OKE: Full fetch complete (77109 records). [2025-10-07T20:43:40.343191] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-07T20:43:40.344097] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:43:40.344224] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:43:40.344270] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:43:40.344313] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-07T20:43:40.344433] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-07T20:43:40.344485] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-07T20:43:40.344528] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-07T20:43:40.344590] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OKE took 42.2s. Estimated remaining: 1h 50m 15s. Rate: 7.1 symbols/min [2025-10-07T20:43:40.529295] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:43:40.529565] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-07T20:43:40.529611] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-07T20:43:40.529746] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-07T20:43:40.529788] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-07T20:43:40.529830] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-07T20:43:40.529863] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-07T20:43:40.646046] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T20:43:40.665042] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-07T20:43:40.915121] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:43:40.965986] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-07T20:43:41.304866] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T20:43:41.447617] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-07T20:43:41.750223] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T20:43:42.247727] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-07T20:43:43.047744] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-07T20:43:43.505624] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T20:43:43.506836] [INFO ] [REMOTE ] OLP: Full fetch complete (14052 records). [2025-10-07T20:43:43.506909] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-07T20:43:43.507379] [FATAL] [VALIDATOR ] OLP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:43:43.507463] [FATAL] [MAIN ] OLP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:43:43.507506] [WARN ] [MAIN ] OLP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:43:43.507544] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-07T20:43:43.507621] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-07T20:43:43.507724] [INFO ] [LOCAL ] OLP: Starting deletion of derivative data. [2025-10-07T20:43:43.508141] [DEBUG] [LOCAL ] OLP: Deleted derivative data file. [2025-10-07T20:43:43.508230] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OLP took 27.7s. Estimated remaining: 1h 50m 4s. Rate: 7.1 symbols/min [2025-10-07T20:43:43.680087] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:43:43.724582] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-07T20:43:43.763522] [DEBUG] [LOCAL ] OMF: Loaded 46267 existing records from primary storage. [2025-10-07T20:43:43.763870] [INFO ] [MAIN ] OMF: Loaded 46267 existing records. [2025-10-07T20:43:43.855075] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-07T20:43:43.952885] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:43:43.953156] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-07T20:43:43.953225] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-07T20:43:43.953531] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-07T20:43:43.953591] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-07T20:43:44.301042] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:43:44.647720] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-07T20:43:45.447769] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-07T20:43:46.608316] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-07T20:43:46.627497] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-07T20:43:46.894992] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (3.85 seconds). [2025-10-07T20:43:47.057711] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-07T20:43:47.062486] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-07T20:43:47.181665] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T20:43:47.847619] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-07T20:43:47.957099] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-07T20:43:47.961307] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-10-07T20:43:47.961508] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-07T20:43:47.962745] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:43:47.962877] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:43:47.962943] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:43:47.963010] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-07T20:43:47.963120] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-07T20:43:47.963226] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-07T20:43:47.963305] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-07T20:43:47.963399] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OKLO took 39.6s. Estimated remaining: 1h 49m 54s. Rate: 7.1 symbols/min [2025-10-07T20:43:48.108065] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T20:43:48.178728] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:43:48.223333] [DEBUG] [LOCAL ] OMI: Loaded 45904 existing records from primary storage. [2025-10-07T20:43:48.223838] [INFO ] [MAIN ] OMI: Loaded 45904 existing records. [2025-10-07T20:43:48.446156] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:43:48.446430] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-07T20:43:48.446498] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-07T20:43:48.446817] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-10-07T20:43:48.446895] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-07T20:43:48.665484] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-07T20:43:48.917956] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:43:49.447630] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-07T20:43:49.534901] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T20:43:50.247718] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-07T20:43:50.389574] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T20:43:50.978921] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T20:43:51.047622] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-07T20:43:51.847668] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-07T20:43:52.026162] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T20:43:52.462342] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T20:43:52.647699] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-07T20:43:53.447638] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-07T20:43:53.984993] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-07T20:43:54.188132] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T20:43:54.247624] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-07T20:43:54.836881] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T20:43:54.840339] [INFO ] [REMOTE ] OLN: Full fetch complete (74263 records). [2025-10-07T20:43:54.840455] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-07T20:43:54.841320] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:43:54.841409] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:43:54.841453] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:43:54.841491] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-07T20:43:54.841549] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-07T20:43:54.841584] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-07T20:43:54.841771] [DEBUG] [LOCAL ] OLN: Deleted derivative data file. [2025-10-07T20:43:54.841887] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OLN took 40.3s. Estimated remaining: 1h 49m 44s. Rate: 7.1 symbols/min [2025-10-07T20:43:55.015596] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:43:55.044793] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T20:43:55.053816] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-07T20:43:55.059588] [DEBUG] [LOCAL ] ONIT: Loaded 7741 existing records from primary storage. [2025-10-07T20:43:55.059817] [INFO ] [MAIN ] ONIT: Loaded 7741 existing records. [2025-10-07T20:43:55.241062] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:43:55.241327] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-07T20:43:55.241381] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-07T20:43:55.241586] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-07T20:43:55.241687] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-07T20:43:55.593988] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:43:55.847623] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-07T20:43:56.647710] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-07T20:43:56.923712] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T20:43:56.984748] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T20:43:57.447727] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-07T20:43:58.247708] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-07T20:43:58.626954] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-07T20:43:59.047696] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-07T20:43:59.264403] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T20:43:59.847683] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-07T20:44:00.167220] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T20:44:00.568132] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T20:44:00.647610] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-07T20:44:01.280126] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-07T20:44:01.447666] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-07T20:44:01.564964] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T20:44:02.247697] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-07T20:44:03.047704] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-07T20:44:03.185615] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T20:44:03.847688] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-07T20:44:04.323294] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-07T20:44:04.647689] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-07T20:44:04.929062] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T20:44:05.164279] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-07T20:44:05.447675] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-07T20:44:06.247616] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-07T20:44:06.369985] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:44:06.664066] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-07T20:44:07.047746] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-07T20:44:07.852799] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-07T20:44:07.869505] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T20:44:08.647623] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-07T20:44:08.800592] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T20:44:09.092171] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T20:44:09.447784] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-07T20:44:10.235431] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T20:44:10.247704] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-07T20:44:10.338544] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T20:44:11.047740] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-07T20:44:11.847621] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-07T20:44:11.967007] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T20:44:12.574221] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T20:44:12.578849] [INFO ] [REMOTE ] OMC: Full fetch complete (76602 records). [2025-10-07T20:44:12.579006] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-07T20:44:12.580291] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:44:12.580453] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:44:12.580547] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:44:12.580679] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-07T20:44:12.580791] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-07T20:44:12.580850] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-07T20:44:12.580915] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-07T20:44:12.581004] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OMC took 32.2s. Estimated remaining: 1h 49m 41s. Rate: 7.1 symbols/min [2025-10-07T20:44:12.653696] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-07T20:44:12.772474] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:44:12.804373] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T20:44:12.836979] [DEBUG] [LOCAL ] ONL: Loaded 30131 existing records from primary storage. [2025-10-07T20:44:12.837341] [INFO ] [MAIN ] ONL: Loaded 30131 existing records. [2025-10-07T20:44:13.012057] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:44:13.012326] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-07T20:44:13.012391] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-07T20:44:13.012683] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-07T20:44:13.012742] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-07T20:44:13.368244] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:44:13.447614] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-07T20:44:14.247719] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-07T20:44:14.438218] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T20:44:14.931682] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T20:44:15.047717] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-07T20:44:15.847713] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-07T20:44:16.100411] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T20:44:16.362526] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T20:44:16.647624] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-07T20:44:16.788090] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T20:44:17.447785] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-07T20:44:17.961675] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T20:44:18.247703] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-07T20:44:18.351727] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T20:44:19.047688] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-07T20:44:19.394371] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T20:44:19.610205] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T20:44:19.613218] [INFO ] [REMOTE ] OMF: Full fetch complete (66728 records). [2025-10-07T20:44:19.613345] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-07T20:44:19.614994] [FATAL] [VALIDATOR ] OMF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:44:19.615112] [FATAL] [MAIN ] OMF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:44:19.615162] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:44:19.615228] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-07T20:44:19.615296] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-07T20:44:19.615331] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-07T20:44:19.615501] [DEBUG] [LOCAL ] OMF: Deleted derivative data file. [2025-10-07T20:44:19.615609] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OMF took 36.1s. Estimated remaining: 1h 49m 31s. Rate: 7.1 symbols/min [2025-10-07T20:44:19.840495] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:44:19.847711] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-07T20:44:19.904876] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-10-07T20:44:19.905310] [INFO ] [MAIN ] ONON: Loaded 53613 existing records. [2025-10-07T20:44:20.126830] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:44:20.127100] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-07T20:44:20.127165] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-07T20:44:20.127494] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-10-07T20:44:20.127576] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-07T20:44:20.569018] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:44:20.647628] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-07T20:44:21.447631] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-07T20:44:21.601460] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T20:44:22.016315] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T20:44:22.247750] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-07T20:44:22.876899] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-07T20:44:22.939253] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T20:44:22.943118] [INFO ] [REMOTE ] OMI: Full fetch complete (64487 records). [2025-10-07T20:44:22.943266] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-07T20:44:22.944448] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:44:22.944564] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:44:22.944632] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:44:22.944755] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-07T20:44:22.944836] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-07T20:44:22.944883] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-07T20:44:22.945114] [DEBUG] [LOCAL ] OMI: Deleted derivative data file. [2025-10-07T20:44:22.945235] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMI took 35.0s. Estimated remaining: 1h 49m 20s. Rate: 7.1 symbols/min [2025-10-07T20:44:23.052919] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-07T20:44:23.138533] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:44:23.162124] [DEBUG] [LOCAL ] ONTF: Loaded 22433 existing records from primary storage. [2025-10-07T20:44:23.162454] [INFO ] [MAIN ] ONTF: Loaded 22433 existing records. [2025-10-07T20:44:23.347387] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:44:23.347782] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-07T20:44:23.347864] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-07T20:44:23.348214] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-07T20:44:23.348271] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-07T20:44:23.707318] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:44:23.847619] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-07T20:44:24.047683] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T20:44:24.647676] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-07T20:44:25.447760] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-07T20:44:25.733504] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T20:44:25.734553] [INFO ] [REMOTE ] ONIT: Full fetch complete (11047 records). [2025-10-07T20:44:25.734636] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-07T20:44:25.735112] [FATAL] [VALIDATOR ] ONIT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:44:25.735199] [FATAL] [MAIN ] ONIT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:44:25.735246] [WARN ] [MAIN ] ONIT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:44:25.735298] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-07T20:44:25.735384] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-07T20:44:25.735422] [INFO ] [LOCAL ] ONIT: Starting deletion of derivative data. [2025-10-07T20:44:25.735659] [DEBUG] [LOCAL ] ONIT: Deleted derivative data file. [2025-10-07T20:44:25.735762] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. ONIT took 30.9s. Estimated remaining: 1h 49m 9s. Rate: 7.1 symbols/min [2025-10-07T20:44:25.920099] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:44:25.952950] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-07T20:44:26.005006] [DEBUG] [LOCAL ] ONTO: Loaded 46896 existing records from primary storage. [2025-10-07T20:44:26.005353] [INFO ] [MAIN ] ONTO: Loaded 46896 existing records. [2025-10-07T20:44:26.202186] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:44:26.202588] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-07T20:44:26.202719] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-07T20:44:26.202996] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-10-07T20:44:26.203053] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-07T20:44:26.254980] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-07T20:44:26.353237] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T20:44:26.590709] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:44:27.047711] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-07T20:44:27.501793] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T20:44:27.847738] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-07T20:44:28.637301] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T20:44:28.647601] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-07T20:44:28.680145] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T20:44:29.447743] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-07T20:44:29.664419] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T20:44:30.247734] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-07T20:44:31.047613] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-07T20:44:31.557922] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-07T20:44:31.730090] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T20:44:31.847715] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-07T20:44:32.647628] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-07T20:44:32.782941] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T20:44:33.456983] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-07T20:44:33.462621] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T20:44:33.999679] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T20:44:34.247697] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-07T20:44:35.043830] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T20:44:35.052624] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-07T20:44:35.362501] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T20:44:35.847720] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-07T20:44:36.647721] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-07T20:44:37.371157] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-07T20:44:37.447603] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-07T20:44:37.692995] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T20:44:37.844059] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T20:44:38.247716] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-07T20:44:39.047731] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-07T20:44:39.565900] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T20:44:39.847737] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-07T20:44:39.895936] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-07T20:44:40.647672] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-07T20:44:40.861921] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T20:44:40.912911] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T20:44:41.447713] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-07T20:44:41.871782] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T20:44:41.994108] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T20:44:41.996004] [INFO ] [REMOTE ] ONL: Full fetch complete (42861 records). [2025-10-07T20:44:41.996165] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-07T20:44:41.997144] [FATAL] [VALIDATOR ] ONL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:44:41.997237] [FATAL] [MAIN ] ONL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:44:41.997356] [WARN ] [MAIN ] ONL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:44:41.997451] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-07T20:44:41.997553] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-07T20:44:41.997611] [INFO ] [LOCAL ] ONL: Starting deletion of derivative data. [2025-10-07T20:44:41.997827] [DEBUG] [LOCAL ] ONL: Deleted derivative data file. [2025-10-07T20:44:41.997936] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. ONL took 29.4s. Estimated remaining: 1h 49m 5s. Rate: 7.1 symbols/min [2025-10-07T20:44:42.191219] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:44:42.213307] [DEBUG] [LOCAL ] OOMA: Loaded 18660 existing records from primary storage. [2025-10-07T20:44:42.213671] [INFO ] [MAIN ] OOMA: Loaded 18660 existing records. [2025-10-07T20:44:42.252935] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-07T20:44:42.419095] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:44:42.419446] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-07T20:44:42.419501] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-07T20:44:42.419823] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-07T20:44:42.419885] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-07T20:44:42.771312] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:44:43.047701] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-07T20:44:43.847606] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-07T20:44:44.349486] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-07T20:44:44.647679] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-07T20:44:44.967271] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T20:44:45.447741] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-07T20:44:46.218950] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T20:44:46.247607] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-07T20:44:46.629117] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T20:44:46.818162] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-10-07T20:44:47.047717] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-07T20:44:47.847637] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-07T20:44:47.899535] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T20:44:47.963559] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T20:44:48.647677] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-07T20:44:49.447754] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-07T20:44:49.792458] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T20:44:50.003290] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-07T20:44:50.113078] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-07T20:44:50.247705] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-07T20:44:51.047625] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-07T20:44:51.285713] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T20:44:51.847673] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-07T20:44:52.647742] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-07T20:44:53.057848] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T20:44:53.241726] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-07T20:44:53.350731] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T20:44:53.352405] [INFO ] [REMOTE ] ONTF: Full fetch complete (31334 records). [2025-10-07T20:44:53.352479] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-07T20:44:53.353070] [FATAL] [VALIDATOR ] ONTF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:44:53.353169] [FATAL] [MAIN ] ONTF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:44:53.353243] [WARN ] [MAIN ] ONTF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:44:53.353332] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-07T20:44:53.353410] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-07T20:44:53.353450] [INFO ] [LOCAL ] ONTF: Starting deletion of derivative data. [2025-10-07T20:44:53.353614] [DEBUG] [LOCAL ] ONTF: Deleted derivative data file. [2025-10-07T20:44:53.353741] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONTF took 30.4s. Estimated remaining: 1h 48m 58s. Rate: 7.1 symbols/min [2025-10-07T20:44:53.447686] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-07T20:44:54.247679] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-07T20:44:55.047684] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-07T20:44:55.538821] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T20:44:55.749807] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-07T20:44:55.847679] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-07T20:44:56.388731] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T20:44:56.647697] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-07T20:44:56.925293] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T20:44:57.447725] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-07T20:44:58.247618] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-07T20:44:58.617332] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T20:44:58.727970] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-07T20:44:59.047772] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-07T20:44:59.159008] [DEBUG] [REMOTE ] OOMA: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-07T20:44:59.159353] [WARN ] [REMOTE ] OOMA: No data returned for month 2025-07 [2025-10-07T20:44:59.159447] [FATAL] [REMOTE ] OOMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:44:59.159543] [FATAL] [MAIN ] OOMA: Failed to fetch primary data. [2025-10-07T20:44:59.159617] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:44:59.159708] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-07T20:44:59.159785] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-07T20:44:59.159822] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-07T20:44:59.159991] [DEBUG] [LOCAL ] OOMA: Deleted derivative data file. [2025-10-07T20:44:59.160082] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. OOMA took 17.2s. Estimated remaining: 1h 48m 48s. Rate: 7.1 symbols/min [2025-10-07T20:44:59.847630] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-07T20:44:59.981246] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T20:45:00.605490] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T20:45:00.608952] [INFO ] [REMOTE ] ONON: Full fetch complete (77192 records). [2025-10-07T20:45:00.609125] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-07T20:45:00.610449] [FATAL] [VALIDATOR ] ONON: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:45:00.610587] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:45:00.610706] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:45:00.610807] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-07T20:45:00.610909] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-07T20:45:00.610956] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-07T20:45:00.611136] [DEBUG] [LOCAL ] ONON: Deleted derivative data file. [2025-10-07T20:45:00.611240] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONON took 41.0s. Estimated remaining: 1h 48m 36s. Rate: 7.1 symbols/min [2025-10-07T20:45:00.647708] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-07T20:45:02.578727] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T20:45:02.590350] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-07T20:45:04.653554] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-07T20:45:04.664553] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-07T20:45:05.396209] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T20:45:05.399610] [INFO ] [REMOTE ] ONTO: Full fetch complete (65988 records). [2025-10-07T20:45:05.399763] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-07T20:45:05.400593] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:45:05.400720] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:45:05.400790] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:45:05.400865] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-07T20:45:05.400970] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-07T20:45:05.401027] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-07T20:45:05.401177] [DEBUG] [LOCAL ] ONTO: Deleted derivative data file. [2025-10-07T20:45:05.401272] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. ONTO took 39.7s. Estimated remaining: 1h 48m 26s. Rate: 7.1 symbols/min [2025-10-07T20:45:05.964222] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:45:06.037157] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:45:06.099261] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:45:06.125215] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:45:06.125801] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-07T20:45:06.125862] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-07T20:45:06.125956] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-07T20:45:06.125997] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-07T20:45:06.126043] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-07T20:45:06.126121] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-07T20:45:06.208527] [DEBUG] [LOCAL ] OPAD: Loaded 22813 existing records from primary storage. [2025-10-07T20:45:06.233039] [INFO ] [MAIN ] OPAD: Loaded 22813 existing records. [2025-10-07T20:45:06.261062] [DEBUG] [LOCAL ] OPP: Loaded 11702 existing records from primary storage. [2025-10-07T20:45:06.272006] [INFO ] [MAIN ] OPP: Loaded 11702 existing records. [2025-10-07T20:45:06.601055] [DEBUG] [LOCAL ] OPFI: Loaded 46414 existing records from primary storage. [2025-10-07T20:45:06.657234] [INFO ] [MAIN ] OPFI: Loaded 46414 existing records. [2025-10-07T20:45:06.895513] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:45:06.958919] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:45:07.011421] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-07T20:45:07.011691] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-07T20:45:07.011580] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-07T20:45:07.022626] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-07T20:45:07.044261] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:45:07.052627] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-07T20:45:07.052793] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-07T20:45:07.052717] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-07T20:45:07.053350] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-07T20:45:07.058594] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-07T20:45:07.300349] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:45:07.353962] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-07T20:45:07.354353] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-07T20:45:07.429680] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-07T20:45:07.429809] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-07T20:45:08.076333] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:45:08.140316] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:45:08.140715] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-07T20:45:08.134520] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T20:45:08.147177] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-07T20:45:08.149398] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-07T20:45:08.269324] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:45:08.269638] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-07T20:45:09.049685] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T20:45:09.052132] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-07T20:45:09.138636] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-07T20:45:09.141178] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-07T20:45:09.368824] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T20:45:09.373516] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-07T20:45:09.639200] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T20:45:09.647120] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-07T20:45:09.849868] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T20:45:09.934222] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T20:45:10.247699] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-07T20:45:10.453667] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T20:45:10.967325] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-07T20:45:11.047693] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-07T20:45:11.765923] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-07T20:45:11.847713] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-07T20:45:11.871863] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T20:45:12.647626] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-07T20:45:12.863913] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T20:45:13.440612] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T20:45:13.447592] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-07T20:45:14.247717] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-07T20:45:14.282674] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-07T20:45:15.047672] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-07T20:45:15.095410] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T20:45:15.769630] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T20:45:15.847690] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-07T20:45:16.647689] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-07T20:45:17.447726] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-07T20:45:17.566971] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T20:45:17.819378] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-07T20:45:18.247617] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-07T20:45:18.325228] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-07T20:45:19.047624] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-07T20:45:19.156743] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T20:45:19.847716] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-07T20:45:19.940281] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T20:45:20.647693] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-07T20:45:20.778569] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T20:45:21.447626] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-07T20:45:21.481064] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T20:45:22.247632] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-07T20:45:22.424823] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T20:45:23.047693] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-07T20:45:23.850522] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-07T20:45:23.852357] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T20:45:24.155098] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T20:45:24.533564] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T20:45:24.647720] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-07T20:45:25.447758] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-07T20:45:25.610136] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T20:45:26.247752] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-07T20:45:26.987069] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T20:45:27.047599] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-07T20:45:27.847690] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-07T20:45:27.942047] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T20:45:28.647745] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-07T20:45:28.684788] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T20:45:28.781508] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T20:45:29.447685] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-07T20:45:30.247631] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-07T20:45:30.381161] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-07T20:45:31.047742] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-07T20:45:31.313092] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-07T20:45:31.847699] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-07T20:45:31.958744] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T20:45:32.103403] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-07T20:45:32.104841] [INFO ] [REMOTE ] OPY: Full fetch complete (10083 records). [2025-10-07T20:45:32.104936] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-07T20:45:32.105528] [FATAL] [VALIDATOR ] OPY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:45:32.105630] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:45:32.105737] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:45:32.105825] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-07T20:45:32.105928] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-07T20:45:32.105999] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-07T20:45:32.106063] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-07T20:45:32.106147] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPY took 26.7s. Estimated remaining: 1h 48m 26s. Rate: 7.1 symbols/min [2025-10-07T20:45:32.295621] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:45:32.337432] [DEBUG] [LOCAL ] OR: Loaded 46259 existing records from primary storage. [2025-10-07T20:45:32.337769] [INFO ] [MAIN ] OR: Loaded 46259 existing records. [2025-10-07T20:45:32.514459] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:45:32.514706] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-07T20:45:32.514765] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-07T20:45:32.515192] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-07T20:45:32.515279] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-07T20:45:32.654414] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-07T20:45:32.874548] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:45:32.912070] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-07T20:45:33.447727] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-07T20:45:34.247676] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-07T20:45:34.495586] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T20:45:34.814570] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:45:34.816451] [INFO ] [REMOTE ] OPP: Full fetch complete (17338 records). [2025-10-07T20:45:34.816550] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-07T20:45:35.049540] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-07T20:45:35.244428] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-07T20:45:35.265606] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-07T20:45:35.266240] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-07T20:45:35.266329] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-07T20:45:35.268393] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T20:45:35.277328] [DEBUG] [LOCAL ] OPP: Trimmed 17338 records to 11698 (keeping 200 days of data) [2025-10-07T20:45:35.348762] [DEBUG] [LOCAL ] OPP: Primary data saved (11698 records). [2025-10-07T20:45:35.348891] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-07T20:45:35.348973] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPP took 29.9s. Estimated remaining: 1h 48m 15s. Rate: 7.1 symbols/min [2025-10-07T20:45:35.524686] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:45:35.556134] [DEBUG] [LOCAL ] ORA: Loaded 32689 existing records from primary storage. [2025-10-07T20:45:35.556465] [INFO ] [MAIN ] ORA: Loaded 32689 existing records. [2025-10-07T20:45:35.728687] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:45:35.728927] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-07T20:45:35.728985] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-07T20:45:35.729361] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-10-07T20:45:35.729418] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-07T20:45:35.852834] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-07T20:45:36.078125] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:45:36.647621] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-07T20:45:36.711368] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T20:45:36.714820] [INFO ] [REMOTE ] OPAD: Full fetch complete (25658 records). [2025-10-07T20:45:36.714961] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-07T20:45:36.715514] [FATAL] [VALIDATOR ] OPAD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:45:36.715598] [FATAL] [MAIN ] OPAD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:45:36.715669] [WARN ] [MAIN ] OPAD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:45:36.715755] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-07T20:45:36.715836] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-07T20:45:36.715914] [INFO ] [LOCAL ] OPAD: Starting deletion of derivative data. [2025-10-07T20:45:36.716120] [DEBUG] [LOCAL ] OPAD: Deleted derivative data file. [2025-10-07T20:45:36.716256] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPAD took 31.3s. Estimated remaining: 1h 48m 3s. Rate: 7.1 symbols/min [2025-10-07T20:45:36.893139] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:45:36.942967] [DEBUG] [LOCAL ] ORC: Loaded 52443 existing records from primary storage. [2025-10-07T20:45:36.943420] [INFO ] [MAIN ] ORC: Loaded 52443 existing records. [2025-10-07T20:45:37.141181] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:45:37.156329] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-07T20:45:37.159861] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-07T20:45:37.160233] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-07T20:45:37.160956] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-07T20:45:37.195383] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-07T20:45:37.448006] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-07T20:45:37.528483] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:45:38.247677] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-07T20:45:38.603710] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T20:45:39.046639] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T20:45:39.054982] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-07T20:45:39.668813] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T20:45:39.847682] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-07T20:45:40.647745] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-07T20:45:41.200747] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-07T20:45:41.452784] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-07T20:45:41.468990] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T20:45:42.247744] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-07T20:45:42.259005] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T20:45:43.047694] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-07T20:45:43.264876] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T20:45:43.847693] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-07T20:45:44.207529] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-07T20:45:44.259143] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T20:45:44.411879] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T20:45:44.415318] [INFO ] [REMOTE ] OPFI: Full fetch complete (67842 records). [2025-10-07T20:45:44.415513] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-07T20:45:44.416897] [FATAL] [VALIDATOR ] OPFI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:45:44.417038] [FATAL] [MAIN ] OPFI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:45:44.417092] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:45:44.417140] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-07T20:45:44.417338] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-07T20:45:44.417456] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-07T20:45:44.417753] [DEBUG] [LOCAL ] OPFI: Deleted derivative data file. [2025-10-07T20:45:44.417896] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 39.0s. Estimated remaining: 1h 47m 55s. Rate: 7.1 symbols/min [2025-10-07T20:45:44.612740] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:45:44.613110] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-07T20:45:44.613170] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-07T20:45:44.613306] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-07T20:45:44.613351] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-07T20:45:44.613397] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-07T20:45:44.613431] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-07T20:45:44.653786] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-07T20:45:45.012078] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:45:45.447694] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-07T20:45:46.247630] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-07T20:45:46.660021] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-07T20:45:47.047681] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-07T20:45:47.847627] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-07T20:45:48.001296] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T20:45:48.116590] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-07T20:45:48.647723] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-07T20:45:49.248632] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-07T20:45:49.447621] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-07T20:45:49.577867] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T20:45:50.247618] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-07T20:45:51.047691] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-07T20:45:51.310697] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-07T20:45:51.825763] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-07T20:45:51.853054] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-07T20:45:51.862461] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T20:45:52.647695] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-07T20:45:53.459781] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-07T20:45:53.465333] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-07T20:45:54.185448] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T20:45:54.247722] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-07T20:45:54.765196] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-10-07T20:45:55.047697] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-07T20:45:55.154380] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T20:45:55.847694] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-07T20:45:56.584423] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T20:45:56.647606] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-07T20:45:56.889348] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-07T20:45:57.082193] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T20:45:57.447683] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-07T20:45:58.247740] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-07T20:45:58.498212] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T20:45:59.047737] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-07T20:45:59.152960] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T20:45:59.847631] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-07T20:46:00.620836] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T20:46:00.647609] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-07T20:46:00.829846] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-07T20:46:01.447749] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-07T20:46:02.038782] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T20:46:02.247701] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-07T20:46:02.364812] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-07T20:46:02.640216] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T20:46:03.047778] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-07T20:46:03.664226] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:46:03.666691] [INFO ] [REMOTE ] ORA: Full fetch complete (48845 records). [2025-10-07T20:46:03.666780] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-07T20:46:03.667469] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:46:03.667555] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:46:03.667599] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:46:03.667688] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-07T20:46:03.667798] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-07T20:46:03.667854] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-07T20:46:03.668019] [DEBUG] [LOCAL ] ORA: Deleted derivative data file. [2025-10-07T20:46:03.668124] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. ORA took 28.3s. Estimated remaining: 1h 47m 51s. Rate: 7.1 symbols/min [2025-10-07T20:46:03.839476] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:03.839719] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-07T20:46:03.839775] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-07T20:46:03.839887] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-07T20:46:03.839930] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-07T20:46:03.839972] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-07T20:46:03.840004] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-07T20:46:03.852912] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-07T20:46:04.193097] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:46:04.647727] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-07T20:46:05.008835] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-07T20:46:05.447730] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-07T20:46:06.232019] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T20:46:06.247617] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-07T20:46:06.543428] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-07T20:46:06.931181] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:46:06.934717] [INFO ] [REMOTE ] OR: Full fetch complete (65326 records). [2025-10-07T20:46:06.934908] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-07T20:46:06.935823] [FATAL] [VALIDATOR ] OR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:46:06.935909] [FATAL] [MAIN ] OR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:46:06.935955] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:46:06.935997] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-07T20:46:06.936057] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-07T20:46:06.936094] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-07T20:46:06.936286] [DEBUG] [LOCAL ] OR: Deleted derivative data file. [2025-10-07T20:46:06.936398] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. OR took 34.8s. Estimated remaining: 1h 47m 40s. Rate: 7.1 symbols/min [2025-10-07T20:46:07.052749] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-07T20:46:07.112460] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:07.141669] [DEBUG] [LOCAL ] ORN: Loaded 30826 existing records from primary storage. [2025-10-07T20:46:07.141984] [INFO ] [MAIN ] ORN: Loaded 30826 existing records. [2025-10-07T20:46:07.347250] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T20:46:07.351901] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:46:07.362396] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-07T20:46:07.362602] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-07T20:46:07.362894] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-07T20:46:07.362954] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-07T20:46:07.712063] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:46:07.847611] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-07T20:46:08.647707] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-07T20:46:09.257828] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-07T20:46:09.317879] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T20:46:09.447634] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-07T20:46:10.247732] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-07T20:46:10.873304] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-07T20:46:11.047619] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-07T20:46:11.308301] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T20:46:11.721961] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T20:46:11.847709] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-07T20:46:12.647728] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-07T20:46:13.447743] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-07T20:46:13.580434] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T20:46:13.641812] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T20:46:13.858580] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-10-07T20:46:14.247731] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-07T20:46:15.047624] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-07T20:46:15.555992] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-07T20:46:15.622709] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T20:46:15.847711] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-07T20:46:16.553488] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T20:46:16.647697] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-07T20:46:17.447628] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-07T20:46:17.677797] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T20:46:18.247678] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-07T20:46:19.047676] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-07T20:46:19.124936] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T20:46:19.554734] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-07T20:46:19.695102] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:46:19.698246] [INFO ] [REMOTE ] ORC: Full fetch complete (75021 records). [2025-10-07T20:46:19.698356] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-07T20:46:19.700026] [FATAL] [VALIDATOR ] ORC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:46:19.700114] [FATAL] [MAIN ] ORC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:46:19.700157] [WARN ] [MAIN ] ORC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:46:19.700198] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-07T20:46:19.700257] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-07T20:46:19.700292] [INFO ] [LOCAL ] ORC: Starting deletion of derivative data. [2025-10-07T20:46:19.700476] [DEBUG] [LOCAL ] ORC: Deleted derivative data file. [2025-10-07T20:46:19.700569] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 43.0s. Estimated remaining: 1h 47m 34s. Rate: 7.1 symbols/min [2025-10-07T20:46:19.857803] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-07T20:46:19.874753] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:19.875013] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-07T20:46:19.875070] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-07T20:46:19.876232] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-07T20:46:19.876285] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-07T20:46:19.876330] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-07T20:46:19.876361] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-07T20:46:20.241779] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:46:20.269855] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-07T20:46:20.647686] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-07T20:46:21.447759] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-07T20:46:22.247710] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-07T20:46:22.388279] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T20:46:22.739347] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-07T20:46:23.047681] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-07T20:46:23.669069] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-07T20:46:23.829928] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T20:46:23.847601] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-07T20:46:24.647758] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-07T20:46:25.242087] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T20:46:25.452803] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-07T20:46:25.468985] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-07T20:46:26.167231] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T20:46:26.247609] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-07T20:46:27.047697] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-07T20:46:27.318339] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T20:46:27.847620] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-07T20:46:28.366412] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-07T20:46:28.647674] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-07T20:46:29.195455] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-07T20:46:29.371762] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T20:46:29.435157] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T20:46:29.438482] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-10-07T20:46:29.438684] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-07T20:46:29.439917] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:46:29.440028] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:46:29.440114] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:46:29.440213] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-07T20:46:29.440299] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-07T20:46:29.440338] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-07T20:46:29.440379] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-07T20:46:29.440440] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORCL took 45.0s. Estimated remaining: 1h 47m 26s. Rate: 7.1 symbols/min [2025-10-07T20:46:29.452747] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-07T20:46:29.617706] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:29.617920] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-07T20:46:29.617960] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-07T20:46:29.618099] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-07T20:46:29.618176] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-07T20:46:29.618258] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-07T20:46:29.618294] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-07T20:46:29.974888] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:46:30.247668] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-07T20:46:31.047622] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-07T20:46:31.317634] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T20:46:31.680435] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T20:46:31.847635] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-07T20:46:32.129139] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-07T20:46:32.130971] [INFO ] [REMOTE ] ORN: Full fetch complete (45104 records). [2025-10-07T20:46:32.131049] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-07T20:46:32.131629] [FATAL] [VALIDATOR ] ORN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:46:32.131735] [FATAL] [MAIN ] ORN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:46:32.131781] [WARN ] [MAIN ] ORN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:46:32.131824] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-07T20:46:32.131880] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-07T20:46:32.131915] [INFO ] [LOCAL ] ORN: Starting deletion of derivative data. [2025-10-07T20:46:32.132154] [DEBUG] [LOCAL ] ORN: Deleted derivative data file. [2025-10-07T20:46:32.132244] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. ORN took 25.2s. Estimated remaining: 1h 47m 15s. Rate: 7.1 symbols/min [2025-10-07T20:46:32.300408] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:32.300678] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-07T20:46:32.300750] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-07T20:46:32.300951] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-07T20:46:32.301059] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-07T20:46:32.301134] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-07T20:46:32.301176] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-07T20:46:32.660053] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-07T20:46:32.666843] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:46:32.692208] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T20:46:33.447703] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-07T20:46:34.247710] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-07T20:46:34.563163] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:46:34.563506] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-07T20:46:34.563599] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:46:34.563671] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-07T20:46:34.563741] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:46:34.563817] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-07T20:46:34.563884] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-07T20:46:34.563979] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-07T20:46:34.564043] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-07T20:46:34.564091] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. OTF took 2.4s. Estimated remaining: 1h 47m 4s. Rate: 7.1 symbols/min [2025-10-07T20:46:34.741286] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:34.741687] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-07T20:46:34.741853] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-07T20:46:34.741973] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-07T20:46:34.742017] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-07T20:46:34.742058] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-07T20:46:34.742090] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-07T20:46:35.075088] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-07T20:46:35.139047] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:46:35.141447] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-07T20:46:35.179500] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T20:46:35.847673] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-07T20:46:36.647671] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-07T20:46:37.012940] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T20:46:37.447696] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-07T20:46:37.620036] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T20:46:38.072130] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:46:38.075115] [INFO ] [REMOTE ] ORI: Full fetch complete (69936 records). [2025-10-07T20:46:38.075216] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-07T20:46:38.076015] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:46:38.076101] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:46:38.076145] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:46:38.076211] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-07T20:46:38.076278] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-07T20:46:38.076312] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-07T20:46:38.076356] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-07T20:46:38.076412] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. ORI took 34.4s. Estimated remaining: 1h 46m 53s. Rate: 7.1 symbols/min [2025-10-07T20:46:38.247127] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:38.247720] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-07T20:46:38.271893] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T20:46:38.318270] [DEBUG] [LOCAL ] OUT: Loaded 47809 existing records from primary storage. [2025-10-07T20:46:38.318593] [INFO ] [MAIN ] OUT: Loaded 47809 existing records. [2025-10-07T20:46:38.492789] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:46:38.493025] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-07T20:46:38.493189] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-07T20:46:38.494100] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-10-07T20:46:38.494157] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-07T20:46:38.866259] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:46:39.047694] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-07T20:46:39.847624] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-07T20:46:40.044543] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T20:46:40.647716] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-07T20:46:41.022894] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T20:46:41.255115] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T20:46:41.447722] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-07T20:46:42.247749] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-07T20:46:42.804541] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-07T20:46:43.047685] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-07T20:46:43.265924] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T20:46:43.847681] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-07T20:46:44.170631] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-07T20:46:44.511384] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T20:46:44.647623] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-07T20:46:45.447667] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-07T20:46:45.481738] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T20:46:46.208920] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T20:46:46.247597] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-07T20:46:47.047678] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-07T20:46:47.847631] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-07T20:46:47.967327] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-07T20:46:48.038124] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T20:46:48.647733] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-07T20:46:48.920485] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-07T20:46:49.447614] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-07T20:46:49.645537] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T20:46:50.247758] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-07T20:46:51.047669] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-07T20:46:51.284538] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T20:46:51.330723] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-07T20:46:51.847671] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-07T20:46:52.285389] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T20:46:52.647738] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-07T20:46:52.933774] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T20:46:53.060806] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T20:46:53.447675] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-07T20:46:54.247737] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-07T20:46:55.047692] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-07T20:46:55.324266] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T20:46:55.362255] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-07T20:46:55.847715] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-07T20:46:55.883972] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T20:46:56.647754] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-07T20:46:57.117931] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-07T20:46:57.134833] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T20:46:57.138339] [INFO ] [REMOTE ] OSK: Full fetch complete (60983 records). [2025-10-07T20:46:57.138477] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-07T20:46:57.139351] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:46:57.139442] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:46:57.139487] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:46:57.139555] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-07T20:46:57.139665] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-07T20:46:57.139729] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-07T20:46:57.139777] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-07T20:46:57.139839] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OSK took 27.7s. Estimated remaining: 1h 46m 50s. Rate: 7.1 symbols/min [2025-10-07T20:46:57.317793] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:57.368921] [DEBUG] [LOCAL ] OVV: Loaded 53516 existing records from primary storage. [2025-10-07T20:46:57.369288] [INFO ] [MAIN ] OVV: Loaded 53516 existing records. [2025-10-07T20:46:57.452971] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-07T20:46:57.550639] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:46:57.550876] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-07T20:46:57.550924] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-07T20:46:57.551345] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-10-07T20:46:57.551406] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-07T20:46:57.907835] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:46:58.247748] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-07T20:46:58.504517] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-07T20:46:59.047730] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-07T20:46:59.439444] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T20:46:59.673257] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:46:59.676415] [INFO ] [REMOTE ] OSCR: Full fetch complete (77132 records). [2025-10-07T20:46:59.676540] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-07T20:46:59.677551] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:46:59.677711] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:46:59.677785] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:46:59.677870] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-07T20:46:59.677957] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-07T20:46:59.678035] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-07T20:46:59.678088] [DEBUG] [LOCAL ] OSCR: No derivative data file found to delete. [2025-10-07T20:46:59.678148] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSCR took 40.0s. Estimated remaining: 1h 46m 38s. Rate: 7.1 symbols/min [2025-10-07T20:46:59.848276] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:46:59.848442] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-07T20:46:59.912617] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T20:46:59.938636] [DEBUG] [LOCAL ] OWL: Loaded 53556 existing records from primary storage. [2025-10-07T20:46:59.938985] [INFO ] [MAIN ] OWL: Loaded 53556 existing records. [2025-10-07T20:47:00.112992] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:47:00.113214] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-07T20:47:00.113285] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-07T20:47:00.114603] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-10-07T20:47:00.114689] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-07T20:47:00.475254] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:47:00.647719] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-07T20:47:01.447751] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-07T20:47:01.833357] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T20:47:02.247732] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-07T20:47:02.668621] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-07T20:47:03.047617] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-07T20:47:03.225993] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T20:47:03.788540] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T20:47:03.847615] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-07T20:47:04.647674] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-07T20:47:04.888369] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T20:47:05.447618] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-07T20:47:05.768675] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T20:47:06.247632] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-07T20:47:06.735576] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-07T20:47:07.001397] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T20:47:07.047673] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-07T20:47:07.642182] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T20:47:07.847607] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-07T20:47:08.511538] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:47:08.514626] [INFO ] [REMOTE ] OUT: Full fetch complete (68706 records). [2025-10-07T20:47:08.514843] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-07T20:47:08.515901] [FATAL] [VALIDATOR ] OUT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:47:08.516003] [FATAL] [MAIN ] OUT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:47:08.516047] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:47:08.516088] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-07T20:47:08.516147] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-07T20:47:08.516182] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-07T20:47:08.516396] [DEBUG] [LOCAL ] OUT: Deleted derivative data file. [2025-10-07T20:47:08.516503] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OUT took 30.4s. Estimated remaining: 1h 46m 30s. Rate: 7.1 symbols/min [2025-10-07T20:47:08.662102] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-07T20:47:08.697599] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:47:08.712480] [DEBUG] [LOCAL ] OWLT: Loaded 8988 existing records from primary storage. [2025-10-07T20:47:08.712910] [INFO ] [MAIN ] OWLT: Loaded 8988 existing records. [2025-10-07T20:47:08.893216] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:47:08.893586] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-07T20:47:08.893707] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-07T20:47:08.894024] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-07T20:47:08.894084] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-07T20:47:09.258831] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:47:09.294038] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-07T20:47:09.447629] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-07T20:47:10.247703] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-07T20:47:10.366814] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T20:47:10.625833] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T20:47:11.047709] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-07T20:47:11.775492] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T20:47:11.847618] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-07T20:47:12.312534] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-07T20:47:12.633580] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T20:47:12.647596] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-07T20:47:13.447727] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-07T20:47:14.247684] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-07T20:47:14.834203] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-07T20:47:15.047637] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-07T20:47:15.149861] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T20:47:15.427342] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-07T20:47:15.847684] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-07T20:47:16.647625] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-07T20:47:16.924215] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-07T20:47:17.447720] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-07T20:47:17.796120] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-07T20:47:18.247688] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-07T20:47:18.657781] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-07T20:47:18.875845] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T20:47:18.973218] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T20:47:19.047687] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-07T20:47:19.847732] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-07T20:47:20.554104] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T20:47:20.660161] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-07T20:47:20.668099] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T20:47:21.447705] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-07T20:47:22.247682] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-07T20:47:22.627804] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-07T20:47:23.047685] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-07T20:47:23.186126] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T20:47:23.482252] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T20:47:23.847702] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-07T20:47:24.647750] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-07T20:47:24.820478] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T20:47:24.923421] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T20:47:25.280742] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:47:25.284715] [INFO ] [REMOTE ] OTIS: Full fetch complete (75569 records). [2025-10-07T20:47:25.284868] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-07T20:47:25.286117] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:47:25.286226] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:47:25.286271] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:47:25.286327] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-07T20:47:25.286467] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-07T20:47:25.286537] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-07T20:47:25.286610] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-07T20:47:25.286762] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OTIS took 50.7s. Estimated remaining: 1h 46m 26s. Rate: 7.1 symbols/min [2025-10-07T20:47:25.454738] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-07T20:47:25.482212] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:47:25.522488] [DEBUG] [LOCAL ] OXM: Loaded 33171 existing records from primary storage. [2025-10-07T20:47:25.522947] [INFO ] [MAIN ] OXM: Loaded 33171 existing records. [2025-10-07T20:47:25.706979] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:47:25.707382] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-07T20:47:25.707459] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-07T20:47:25.708578] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-10-07T20:47:25.708692] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-07T20:47:26.091557] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:47:26.247709] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-07T20:47:26.672622] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T20:47:27.047711] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-07T20:47:27.847697] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-07T20:47:28.262288] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T20:47:28.647689] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-07T20:47:28.737537] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T20:47:28.893230] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T20:47:29.301077] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:47:29.304695] [INFO ] [REMOTE ] OVV: Full fetch complete (76932 records). [2025-10-07T20:47:29.304842] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-07T20:47:29.305931] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:47:29.306022] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:47:29.306066] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:47:29.306109] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-07T20:47:29.306177] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-07T20:47:29.306216] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-07T20:47:29.306509] [DEBUG] [LOCAL ] OVV: Deleted derivative data file. [2025-10-07T20:47:29.306662] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OVV took 32.2s. Estimated remaining: 1h 46m 15s. Rate: 7.1 symbols/min [2025-10-07T20:47:29.456863] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-07T20:47:29.499948] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:47:29.500577] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-07T20:47:29.500626] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-07T20:47:29.500788] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-07T20:47:29.500835] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-07T20:47:29.500885] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-07T20:47:29.500922] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-07T20:47:29.910821] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:47:30.247692] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-07T20:47:31.052783] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-07T20:47:31.058951] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T20:47:31.690480] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T20:47:31.691961] [INFO ] [REMOTE ] OWLT: Full fetch complete (11693 records). [2025-10-07T20:47:31.692037] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-07T20:47:31.692522] [FATAL] [VALIDATOR ] OWLT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:47:31.692612] [FATAL] [MAIN ] OWLT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:47:31.692693] [WARN ] [MAIN ] OWLT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:47:31.692772] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-07T20:47:31.692852] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-07T20:47:31.692890] [INFO ] [LOCAL ] OWLT: Starting deletion of derivative data. [2025-10-07T20:47:31.693298] [DEBUG] [LOCAL ] OWLT: Deleted derivative data file. [2025-10-07T20:47:31.693399] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OWLT took 23.2s. Estimated remaining: 1h 46m 4s. Rate: 7.1 symbols/min [2025-10-07T20:47:31.857379] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-07T20:47:31.883981] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:47:31.944728] [DEBUG] [LOCAL ] PAAS: Loaded 53605 existing records from primary storage. [2025-10-07T20:47:31.945169] [INFO ] [MAIN ] PAAS: Loaded 53605 existing records. [2025-10-07T20:47:32.120660] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:47:32.120902] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-07T20:47:32.120952] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-07T20:47:32.122297] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-10-07T20:47:32.122364] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-07T20:47:32.478721] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:47:32.647707] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-07T20:47:32.929879] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-07T20:47:33.447745] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-07T20:47:33.579952] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T20:47:33.939607] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-07T20:47:34.247685] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-07T20:47:35.047714] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-07T20:47:35.567949] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-07T20:47:35.606309] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T20:47:35.847688] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-07T20:47:36.647748] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-07T20:47:37.447620] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-07T20:47:37.756267] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T20:47:38.132233] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (3.08 seconds). [2025-10-07T20:47:38.247700] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-07T20:47:38.750667] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T20:47:39.047677] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-07T20:47:39.697985] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-07T20:47:39.847675] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-07T20:47:40.468779] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-07T20:47:40.647679] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-07T20:47:41.024002] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-07T20:47:41.444255] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T20:47:41.448394] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-07T20:47:42.247693] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-07T20:47:42.887772] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T20:47:42.891433] [INFO ] [REMOTE ] OWL: Full fetch complete (77140 records). [2025-10-07T20:47:42.891591] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-07T20:47:42.893246] [FATAL] [VALIDATOR ] OWL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:47:42.893361] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:47:42.893406] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:47:42.893452] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-07T20:47:42.893535] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-07T20:47:42.893577] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-07T20:47:42.893847] [DEBUG] [LOCAL ] OWL: Deleted derivative data file. [2025-10-07T20:47:42.894037] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OWL took 43.2s. Estimated remaining: 1h 45m 57s. Rate: 7.1 symbols/min [2025-10-07T20:47:43.052877] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-07T20:47:43.084959] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:47:43.100706] [DEBUG] [LOCAL ] PAC: Loaded 11550 existing records from primary storage. [2025-10-07T20:47:43.101026] [INFO ] [MAIN ] PAC: Loaded 11550 existing records. [2025-10-07T20:47:43.295789] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:47:43.296591] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-07T20:47:43.296916] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-07T20:47:43.297630] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-07T20:47:43.297734] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-07T20:47:43.444500] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-07T20:47:43.614430] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-10-07T20:47:43.779775] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:47:43.847595] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-07T20:47:44.424762] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T20:47:44.647737] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-07T20:47:44.742957] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-07T20:47:45.447730] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-07T20:47:46.167952] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T20:47:46.247622] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-07T20:47:47.047619] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-07T20:47:47.343931] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T20:47:47.427116] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T20:47:47.847668] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-07T20:47:48.647715] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-07T20:47:48.838202] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T20:47:49.447755] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-07T20:47:49.796830] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-07T20:47:50.111199] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T20:47:50.247745] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-07T20:47:51.047722] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-07T20:47:51.489092] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-07T20:47:51.847724] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-07T20:47:52.137313] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T20:47:52.647705] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-07T20:47:52.830831] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T20:47:53.001843] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-07T20:47:53.447724] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-07T20:47:54.107245] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T20:47:54.247685] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-07T20:47:54.496633] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T20:47:55.047706] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-07T20:47:55.460109] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-07T20:47:55.462511] [INFO ] [REMOTE ] OXM: Full fetch complete (45763 records). [2025-10-07T20:47:55.462621] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-07T20:47:55.463440] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:47:55.463533] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:47:55.463576] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:47:55.463618] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-07T20:47:55.463719] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-07T20:47:55.463772] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-07T20:47:55.464099] [DEBUG] [LOCAL ] OXM: Deleted derivative data file. [2025-10-07T20:47:55.464206] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OXM took 30.2s. Estimated remaining: 1h 45m 50s. Rate: 7.1 symbols/min [2025-10-07T20:47:55.635545] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:47:55.670533] [DEBUG] [LOCAL ] PACK: Loaded 31829 existing records from primary storage. [2025-10-07T20:47:55.670929] [INFO ] [MAIN ] PACK: Loaded 31829 existing records. [2025-10-07T20:47:55.902172] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-07T20:47:55.909074] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:47:55.910621] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-07T20:47:55.910725] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-07T20:47:55.911414] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-07T20:47:55.911546] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-07T20:47:56.300182] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:47:56.522145] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-07T20:47:56.647639] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-07T20:47:57.095036] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-07T20:47:57.447695] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-07T20:47:58.247627] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-07T20:47:58.508062] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T20:47:59.047626] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-07T20:47:59.399612] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-07T20:47:59.847634] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-07T20:47:59.991902] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T20:48:00.187092] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T20:48:00.647713] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-07T20:48:01.447728] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-07T20:48:02.247629] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-07T20:48:02.466193] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-07T20:48:02.599839] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T20:48:02.793330] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-07T20:48:03.047761] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-07T20:48:03.275556] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T20:48:03.847678] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-07T20:48:04.647739] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-07T20:48:04.822179] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T20:48:05.447681] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-07T20:48:05.521147] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-07T20:48:06.247746] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-07T20:48:06.416598] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T20:48:06.892422] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-07T20:48:06.929475] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:48:06.932679] [INFO ] [REMOTE ] OXY: Full fetch complete (77180 records). [2025-10-07T20:48:06.932816] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-07T20:48:06.933727] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:48:06.933840] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:48:06.933884] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:48:06.933956] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-07T20:48:06.934054] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-07T20:48:06.934113] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-07T20:48:06.934171] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-07T20:48:06.934253] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. OXY took 37.6s. Estimated remaining: 1h 45m 43s. Rate: 7.1 symbols/min [2025-10-07T20:48:07.052719] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-07T20:48:07.108225] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:07.146479] [DEBUG] [LOCAL ] PACS: Loaded 34501 existing records from primary storage. [2025-10-07T20:48:07.146808] [INFO ] [MAIN ] PACS: Loaded 34501 existing records. [2025-10-07T20:48:07.328475] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:48:07.328672] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-07T20:48:07.328734] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-07T20:48:07.329421] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-07T20:48:07.329480] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-07T20:48:07.703024] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:07.847606] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-07T20:48:08.647739] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-07T20:48:09.215242] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:48:09.216481] [INFO ] [REMOTE ] PAC: Full fetch complete (16448 records). [2025-10-07T20:48:09.216567] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-07T20:48:09.217113] [FATAL] [VALIDATOR ] PAC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:48:09.217207] [FATAL] [MAIN ] PAC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:48:09.217251] [WARN ] [MAIN ] PAC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:48:09.217293] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-07T20:48:09.217352] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-07T20:48:09.217388] [INFO ] [LOCAL ] PAC: Starting deletion of derivative data. [2025-10-07T20:48:09.217542] [DEBUG] [LOCAL ] PAC: Deleted derivative data file. [2025-10-07T20:48:09.217637] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. PAC took 26.3s. Estimated remaining: 1h 45m 32s. Rate: 7.1 symbols/min [2025-10-07T20:48:09.392353] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:09.414419] [DEBUG] [LOCAL ] PAG: Loaded 21658 existing records from primary storage. [2025-10-07T20:48:09.414911] [INFO ] [MAIN ] PAG: Loaded 21658 existing records. [2025-10-07T20:48:09.451888] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-07T20:48:09.634234] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-07T20:48:09.685698] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:48:09.698480] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-07T20:48:09.712986] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-07T20:48:09.714831] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-10-07T20:48:09.714786] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T20:48:09.714988] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-07T20:48:10.084275] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:10.247727] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-07T20:48:10.673068] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T20:48:11.047721] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-07T20:48:11.062754] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T20:48:11.065903] [INFO ] [REMOTE ] PAAS: Full fetch complete (77023 records). [2025-10-07T20:48:11.066019] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-07T20:48:11.066775] [FATAL] [VALIDATOR ] PAAS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:48:11.066891] [FATAL] [MAIN ] PAAS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:48:11.066958] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:48:11.067030] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-07T20:48:11.067097] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-07T20:48:11.067131] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-07T20:48:11.067353] [DEBUG] [LOCAL ] PAAS: Deleted derivative data file. [2025-10-07T20:48:11.067447] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PAAS took 39.4s. Estimated remaining: 1h 45m 20s. Rate: 7.1 symbols/min [2025-10-07T20:48:11.233028] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:11.281023] [DEBUG] [LOCAL ] PAGS: Loaded 52717 existing records from primary storage. [2025-10-07T20:48:11.281375] [INFO ] [MAIN ] PAGS: Loaded 52717 existing records. [2025-10-07T20:48:11.454364] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:48:11.454602] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-07T20:48:11.454674] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-07T20:48:11.454986] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-10-07T20:48:11.455042] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-07T20:48:11.807258] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:11.847619] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-07T20:48:12.330348] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T20:48:12.647702] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-07T20:48:13.447750] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-07T20:48:13.831968] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T20:48:14.148680] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T20:48:14.247680] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-07T20:48:14.612619] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T20:48:15.047680] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-07T20:48:15.827829] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T20:48:15.847628] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-07T20:48:16.647714] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-07T20:48:16.949382] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T20:48:17.287585] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T20:48:17.447740] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-07T20:48:17.689415] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T20:48:18.247690] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-07T20:48:19.047684] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-07T20:48:19.277581] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T20:48:19.468534] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T20:48:19.847711] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-07T20:48:20.126485] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T20:48:20.647718] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-07T20:48:21.264597] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-07T20:48:21.447705] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-07T20:48:21.763243] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T20:48:22.247711] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-07T20:48:22.973699] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T20:48:23.047622] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-07T20:48:23.309888] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T20:48:23.847750] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-07T20:48:24.474865] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T20:48:24.647677] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-07T20:48:24.749194] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T20:48:25.447678] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-07T20:48:26.247631] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-07T20:48:26.380225] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T20:48:27.022545] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T20:48:27.047764] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-07T20:48:27.514721] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T20:48:27.847684] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-07T20:48:28.647719] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-07T20:48:28.703608] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T20:48:29.388175] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T20:48:29.447731] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-07T20:48:30.152296] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T20:48:30.247705] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-07T20:48:30.977888] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T20:48:31.047630] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-07T20:48:31.415297] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T20:48:31.656567] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T20:48:31.659002] [INFO ] [REMOTE ] PACK: Full fetch complete (44172 records). [2025-10-07T20:48:31.659083] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-07T20:48:31.659935] [FATAL] [VALIDATOR ] PACK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:48:31.660021] [FATAL] [MAIN ] PACK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:48:31.660063] [WARN ] [MAIN ] PACK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:48:31.660127] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-07T20:48:31.660250] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-07T20:48:31.660308] [INFO ] [LOCAL ] PACK: Starting deletion of derivative data. [2025-10-07T20:48:31.660487] [DEBUG] [LOCAL ] PACK: Deleted derivative data file. [2025-10-07T20:48:31.660597] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PACK took 36.2s. Estimated remaining: 1h 45m 17s. Rate: 7.1 symbols/min [2025-10-07T20:48:31.833281] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:31.839003] [DEBUG] [LOCAL ] PAI: Loaded 2671 existing records from primary storage. [2025-10-07T20:48:31.839202] [INFO ] [MAIN ] PAI: Loaded 2671 existing records. [2025-10-07T20:48:31.852888] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-07T20:48:32.021039] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:48:32.021305] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-07T20:48:32.021354] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-07T20:48:32.021577] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-07T20:48:32.021636] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-07T20:48:32.389036] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:32.647689] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-07T20:48:33.045321] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-07T20:48:33.193931] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T20:48:33.447693] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-07T20:48:34.247749] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-07T20:48:34.877151] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T20:48:34.899751] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T20:48:35.047688] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-07T20:48:35.847677] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-07T20:48:36.605924] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T20:48:36.647607] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-07T20:48:37.097323] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T20:48:37.447677] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-07T20:48:38.091823] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T20:48:38.247686] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-07T20:48:38.895454] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:48:38.898500] [INFO ] [REMOTE ] PACS: Full fetch complete (50477 records). [2025-10-07T20:48:38.898602] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-07T20:48:38.899286] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:48:38.899387] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:48:38.899464] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:48:38.899555] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-07T20:48:38.899633] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-07T20:48:38.899721] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-07T20:48:38.899927] [DEBUG] [LOCAL ] PACS: Deleted derivative data file. [2025-10-07T20:48:38.900024] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PACS took 32.0s. Estimated remaining: 1h 45m 8s. Rate: 7.1 symbols/min [2025-10-07T20:48:39.050255] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-07T20:48:39.076112] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:39.077387] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-07T20:48:39.077506] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-07T20:48:39.077709] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-07T20:48:39.078030] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-07T20:48:39.078514] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-07T20:48:39.078793] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-07T20:48:39.223081] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T20:48:39.487716] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:39.847707] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-07T20:48:39.863634] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T20:48:40.647721] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-07T20:48:41.262721] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T20:48:41.447679] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-07T20:48:41.765046] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-07T20:48:42.247673] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-07T20:48:42.678013] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T20:48:43.047686] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-07T20:48:43.847619] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-07T20:48:44.123466] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T20:48:44.169284] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T20:48:44.460488] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T20:48:44.647623] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-07T20:48:44.992487] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:48:44.993057] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-07T20:48:44.993167] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:48:44.993221] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-07T20:48:44.993285] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:48:44.993367] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-07T20:48:44.993447] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-07T20:48:44.993487] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-07T20:48:44.993784] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-07T20:48:44.994068] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAII took 6.1s. Estimated remaining: 1h 44m 59s. Rate: 7.1 symbols/min [2025-10-07T20:48:45.166077] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:45.194162] [DEBUG] [LOCAL ] PAM: Loaded 28113 existing records from primary storage. [2025-10-07T20:48:45.194491] [INFO ] [MAIN ] PAM: Loaded 28113 existing records. [2025-10-07T20:48:45.371660] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:48:45.371889] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-07T20:48:45.371964] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-07T20:48:45.372277] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-07T20:48:45.372338] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-07T20:48:45.452738] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-07T20:48:45.732712] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:46.066989] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T20:48:46.247704] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-07T20:48:47.047739] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-07T20:48:47.645627] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T20:48:47.647195] [INFO ] [REMOTE ] PAG: Full fetch complete (30254 records). [2025-10-07T20:48:47.647275] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-07T20:48:47.647781] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:48:47.647872] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:48:47.647916] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:48:47.647982] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-07T20:48:47.648048] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-07T20:48:47.648084] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-07T20:48:47.648225] [DEBUG] [LOCAL ] PAG: Deleted derivative data file. [2025-10-07T20:48:47.648317] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAG took 38.4s. Estimated remaining: 1h 44m 48s. Rate: 7.1 symbols/min [2025-10-07T20:48:47.825195] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:47.847621] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-07T20:48:47.864164] [DEBUG] [LOCAL ] PAR: Loaded 33107 existing records from primary storage. [2025-10-07T20:48:47.864474] [INFO ] [MAIN ] PAR: Loaded 33107 existing records. [2025-10-07T20:48:48.041225] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:48:48.041675] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-07T20:48:48.041758] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-07T20:48:48.052857] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-07T20:48:48.067614] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-07T20:48:48.141089] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T20:48:48.458679] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:48.647720] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-07T20:48:49.260105] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T20:48:49.259976] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T20:48:49.447722] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-07T20:48:50.051315] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-07T20:48:50.247678] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-07T20:48:51.047714] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-07T20:48:51.831157] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T20:48:51.847601] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-07T20:48:52.404839] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T20:48:52.647637] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-07T20:48:53.263563] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T20:48:53.447746] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-07T20:48:54.003016] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T20:48:54.247626] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-07T20:48:54.619271] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-07T20:48:54.782154] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-07T20:48:55.047699] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-07T20:48:55.527796] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:48:55.528529] [INFO ] [REMOTE ] PAI: Full fetch complete (4051 records). [2025-10-07T20:48:55.528599] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-07T20:48:55.863324] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-07T20:48:55.908338] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-07T20:48:55.908420] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-07T20:48:55.908597] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-07T20:48:55.908680] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-07T20:48:55.909241] [DEBUG] [LOCAL ] PAI: Trimmed 4051 records to 2663 (keeping 200 days of data) [2025-10-07T20:48:55.928171] [DEBUG] [LOCAL ] PAI: Primary data saved (2663 records). [2025-10-07T20:48:55.928249] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-07T20:48:55.928351] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAI took 24.3s. Estimated remaining: 1h 44m 39s. Rate: 7.1 symbols/min [2025-10-07T20:48:56.099519] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:56.147237] [DEBUG] [LOCAL ] PARR: Loaded 48330 existing records from primary storage. [2025-10-07T20:48:56.147573] [INFO ] [MAIN ] PARR: Loaded 48330 existing records. [2025-10-07T20:48:56.329489] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:48:56.329729] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-07T20:48:56.329799] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-07T20:48:56.330096] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-10-07T20:48:56.330153] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-07T20:48:56.653371] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-07T20:48:56.697165] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:57.447739] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-07T20:48:57.512698] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T20:48:57.724759] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-07T20:48:57.728036] [INFO ] [REMOTE ] PAGS: Full fetch complete (75935 records). [2025-10-07T20:48:57.728177] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-07T20:48:57.728930] [FATAL] [VALIDATOR ] PAGS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:48:57.729016] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:48:57.729058] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:48:57.729097] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-07T20:48:57.729231] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-07T20:48:57.729289] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-07T20:48:57.729476] [DEBUG] [LOCAL ] PAGS: Deleted derivative data file. [2025-10-07T20:48:57.729570] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAGS took 46.7s. Estimated remaining: 1h 44m 28s. Rate: 7.1 symbols/min [2025-10-07T20:48:57.908570] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:48:57.954162] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T20:48:57.979268] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-10-07T20:48:57.979630] [INFO ] [MAIN ] PATH: Loaded 53678 existing records. [2025-10-07T20:48:58.157773] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:48:58.158197] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-07T20:48:58.158247] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-07T20:48:58.158611] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-10-07T20:48:58.158705] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-07T20:48:58.252887] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-07T20:48:58.542892] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:48:59.047754] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-07T20:48:59.590066] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T20:48:59.847714] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-07T20:49:00.082114] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T20:49:00.647774] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-07T20:49:01.416250] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T20:49:01.447598] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-07T20:49:02.102602] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T20:49:02.247700] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-07T20:49:02.738009] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T20:49:03.047689] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-07T20:49:03.093256] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T20:49:03.847714] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-07T20:49:04.647770] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-07T20:49:05.332866] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T20:49:05.454001] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-07T20:49:05.460271] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-07T20:49:05.707759] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T20:49:06.247722] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-07T20:49:07.047707] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-07T20:49:07.107197] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T20:49:07.622389] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T20:49:07.847733] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-07T20:49:08.647737] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-07T20:49:09.344241] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T20:49:09.447720] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-07T20:49:09.610610] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-07T20:49:10.247619] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-07T20:49:10.399712] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T20:49:10.886042] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T20:49:11.047718] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-07T20:49:11.536224] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T20:49:11.847619] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-07T20:49:12.495905] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T20:49:12.647746] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-07T20:49:12.910944] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T20:49:13.447794] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-07T20:49:14.040898] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T20:49:14.043199] [INFO ] [REMOTE ] PAM: Full fetch complete (41932 records). [2025-10-07T20:49:14.043277] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-07T20:49:14.256450] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-07T20:49:14.417610] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-07T20:49:14.417714] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-07T20:49:14.418571] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-07T20:49:14.418794] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-07T20:49:14.419796] [DEBUG] [LOCAL ] PAM: Trimmed 41932 records to 28079 (keeping 200 days of data) [2025-10-07T20:49:14.583034] [DEBUG] [LOCAL ] PAM: Primary data saved (28079 records). [2025-10-07T20:49:14.583167] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-07T20:49:14.583251] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAM took 29.6s. Estimated remaining: 1h 44m 23s. Rate: 7.1 symbols/min [2025-10-07T20:49:14.751001] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:49:14.771669] [DEBUG] [LOCAL ] PAXS: Loaded 20787 existing records from primary storage. [2025-10-07T20:49:14.771921] [INFO ] [MAIN ] PAXS: Loaded 20787 existing records. [2025-10-07T20:49:14.887692] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T20:49:14.970312] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:49:14.970516] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-07T20:49:14.970564] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-07T20:49:14.970770] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-07T20:49:14.970828] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-07T20:49:15.052923] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-07T20:49:15.327323] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:49:15.847625] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-07T20:49:16.647628] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-07T20:49:16.776967] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-07T20:49:16.877757] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T20:49:17.338985] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T20:49:17.447926] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-07T20:49:18.247751] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-07T20:49:18.431571] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T20:49:19.047717] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-07T20:49:19.642485] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-07T20:49:19.847680] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-07T20:49:19.887595] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T20:49:19.940885] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T20:49:20.647705] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-07T20:49:21.447630] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-07T20:49:21.562542] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T20:49:22.247700] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-07T20:49:22.575522] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T20:49:22.968297] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-07T20:49:23.047668] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-07T20:49:23.597498] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T20:49:23.615395] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T20:49:23.618323] [INFO ] [REMOTE ] PAR: Full fetch complete (48051 records). [2025-10-07T20:49:23.618452] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-07T20:49:23.619084] [FATAL] [VALIDATOR ] PAR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:49:23.619174] [FATAL] [MAIN ] PAR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:49:23.619217] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:49:23.619255] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-07T20:49:23.619332] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-07T20:49:23.619399] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-07T20:49:23.619758] [DEBUG] [LOCAL ] PAR: Deleted derivative data file. [2025-10-07T20:49:23.619924] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAR took 36.0s. Estimated remaining: 1h 44m 15s. Rate: 7.1 symbols/min [2025-10-07T20:49:23.787956] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:49:23.825269] [DEBUG] [LOCAL ] PAY: Loaded 37988 existing records from primary storage. [2025-10-07T20:49:23.825578] [INFO ] [MAIN ] PAY: Loaded 37988 existing records. [2025-10-07T20:49:23.853954] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-07T20:49:24.004998] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:49:24.005223] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-07T20:49:24.005298] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-07T20:49:24.005770] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-07T20:49:24.005829] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-07T20:49:24.349936] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:49:24.647638] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-07T20:49:25.447680] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-07T20:49:25.710754] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T20:49:26.247688] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-07T20:49:26.496265] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T20:49:27.021515] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-07T20:49:27.047459] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T20:49:27.048982] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-07T20:49:27.847687] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-07T20:49:28.647683] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-07T20:49:29.053710] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T20:49:29.332028] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-07T20:49:29.447735] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-07T20:49:29.724711] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T20:49:30.247678] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-07T20:49:30.703179] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T20:49:31.047690] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-07T20:49:31.847637] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-07T20:49:32.010503] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T20:49:32.647729] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-07T20:49:33.019287] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T20:49:33.161254] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-07T20:49:33.300542] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:49:33.303552] [INFO ] [REMOTE ] PARR: Full fetch complete (68666 records). [2025-10-07T20:49:33.303742] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-07T20:49:33.304627] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:49:33.304783] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:49:33.304828] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:49:33.304871] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-07T20:49:33.304931] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-07T20:49:33.304966] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-07T20:49:33.305143] [DEBUG] [LOCAL ] PARR: Deleted derivative data file. [2025-10-07T20:49:33.305239] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PARR took 37.4s. Estimated remaining: 1h 44m 7s. Rate: 7.1 symbols/min [2025-10-07T20:49:33.452376] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-07T20:49:33.479378] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:49:33.480100] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-07T20:49:33.480146] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-07T20:49:33.480290] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-07T20:49:33.480351] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-07T20:49:33.480403] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-07T20:49:33.480439] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-07T20:49:33.829395] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:49:34.247681] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-07T20:49:34.989630] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T20:49:35.047612] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-07T20:49:35.847620] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-07T20:49:35.867612] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T20:49:36.264685] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T20:49:36.647683] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-07T20:49:37.447717] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-07T20:49:38.184410] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-07T20:49:38.218561] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T20:49:38.247597] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-07T20:49:38.579366] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T20:49:39.047712] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-07T20:49:39.386835] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T20:49:39.564547] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T20:49:39.566177] [INFO ] [REMOTE ] PAXS: Full fetch complete (30469 records). [2025-10-07T20:49:39.566251] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-07T20:49:39.566745] [FATAL] [VALIDATOR ] PAXS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:49:39.566882] [FATAL] [MAIN ] PAXS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:49:39.566952] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:49:39.567003] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-07T20:49:39.567074] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-07T20:49:39.567129] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-07T20:49:39.567919] [DEBUG] [LOCAL ] PAXS: Deleted derivative data file. [2025-10-07T20:49:39.568022] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAXS took 25.0s. Estimated remaining: 1h 43m 58s. Rate: 7.1 symbols/min [2025-10-07T20:49:39.741424] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:49:39.741705] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-07T20:49:39.741769] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-07T20:49:39.741885] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-07T20:49:39.741926] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-07T20:49:39.742023] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-07T20:49:39.742071] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-07T20:49:39.852829] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-07T20:49:40.096761] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:49:40.647689] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-07T20:49:41.447629] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-07T20:49:41.514465] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T20:49:41.737434] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T20:49:42.247726] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-07T20:49:43.047685] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-07T20:49:43.847757] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-07T20:49:43.920984] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T20:49:44.057773] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-07T20:49:44.647712] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-07T20:49:44.731797] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T20:49:45.436226] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-07T20:49:45.447615] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-07T20:49:45.855439] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T20:49:46.247752] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-07T20:49:46.622136] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T20:49:47.047764] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-07T20:49:47.847727] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-07T20:49:48.003455] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-07T20:49:48.647740] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-07T20:49:48.801938] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T20:49:49.447722] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-07T20:49:49.496218] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T20:49:49.499503] [INFO ] [REMOTE ] PATH: Full fetch complete (77374 records). [2025-10-07T20:49:49.499665] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-07T20:49:49.500419] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:49:49.500517] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:49:49.500562] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:49:49.500603] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-07T20:49:49.500689] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-07T20:49:49.500745] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-07T20:49:49.500998] [DEBUG] [LOCAL ] PATH: Deleted derivative data file. [2025-10-07T20:49:49.501108] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PATH took 51.8s. Estimated remaining: 1h 43m 50s. Rate: 7.1 symbols/min [2025-10-07T20:49:49.710276] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:49:49.713002] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T20:49:49.771522] [DEBUG] [LOCAL ] PBA: Loaded 48952 existing records from primary storage. [2025-10-07T20:49:49.771921] [INFO ] [MAIN ] PBA: Loaded 48952 existing records. [2025-10-07T20:49:49.963956] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:49:49.964202] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-07T20:49:49.964259] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-07T20:49:49.964487] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-07T20:49:49.964544] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-07T20:49:50.250088] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-07T20:49:50.329613] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:49:51.047636] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-07T20:49:51.054065] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T20:49:51.847674] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-07T20:49:51.909841] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T20:49:52.647714] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-07T20:49:52.930458] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T20:49:53.453889] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-07T20:49:53.469985] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T20:49:53.919962] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T20:49:54.247680] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-07T20:49:55.047689] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-07T20:49:55.253971] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T20:49:55.539955] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T20:49:55.847714] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-07T20:49:56.578623] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T20:49:56.647693] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-07T20:49:57.447673] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-07T20:49:57.611933] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T20:49:58.247718] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-07T20:49:58.400453] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T20:49:58.898337] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T20:49:59.047667] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-07T20:49:59.386391] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T20:49:59.847736] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-07T20:50:00.647720] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-07T20:50:01.020873] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T20:50:01.447624] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-07T20:50:01.557243] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T20:50:02.181561] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T20:50:02.247768] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-07T20:50:03.047777] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-07T20:50:03.428922] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T20:50:03.847721] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-07T20:50:04.067056] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T20:50:04.185937] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-07T20:50:04.188563] [INFO ] [REMOTE ] PAY: Full fetch complete (53252 records). [2025-10-07T20:50:04.188696] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-07T20:50:04.189425] [FATAL] [VALIDATOR ] PAY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:50:04.189512] [FATAL] [MAIN ] PAY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:50:04.189555] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:50:04.189622] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-07T20:50:04.189725] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-07T20:50:04.189770] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-07T20:50:04.189943] [DEBUG] [LOCAL ] PAY: Deleted derivative data file. [2025-10-07T20:50:04.190036] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PAY took 40.6s. Estimated remaining: 1h 43m 44s. Rate: 7.1 symbols/min [2025-10-07T20:50:04.394345] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:50:04.421250] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T20:50:04.482237] [DEBUG] [LOCAL ] PBF: Loaded 53143 existing records from primary storage. [2025-10-07T20:50:04.482621] [INFO ] [MAIN ] PBF: Loaded 53143 existing records. [2025-10-07T20:50:04.653016] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-07T20:50:04.656608] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:50:04.658213] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-07T20:50:04.658271] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-07T20:50:04.658496] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-10-07T20:50:04.658556] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-07T20:50:05.002876] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:50:05.447805] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-07T20:50:06.247667] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-07T20:50:06.600478] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T20:50:07.047623] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-07T20:50:07.316534] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T20:50:07.847735] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-07T20:50:08.062831] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T20:50:08.187704] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-07T20:50:08.191276] [INFO ] [REMOTE ] PB: Full fetch complete (58687 records). [2025-10-07T20:50:08.191416] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-07T20:50:08.192366] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:50:08.192467] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:50:08.192535] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:50:08.192685] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-07T20:50:08.192784] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-07T20:50:08.192825] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-07T20:50:08.192868] [DEBUG] [LOCAL ] PB: No derivative data file found to delete. [2025-10-07T20:50:08.192938] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PB took 28.6s. Estimated remaining: 1h 43m 34s. Rate: 7.1 symbols/min [2025-10-07T20:50:08.389628] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:50:08.431490] [DEBUG] [LOCAL ] PBH: Loaded 32095 existing records from primary storage. [2025-10-07T20:50:08.432042] [INFO ] [MAIN ] PBH: Loaded 32095 existing records. [2025-10-07T20:50:08.630718] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:50:08.631038] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-07T20:50:08.631089] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-07T20:50:08.631390] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-10-07T20:50:08.631448] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-07T20:50:08.652820] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-07T20:50:09.124572] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:50:09.150797] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-07T20:50:09.447757] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-07T20:50:10.247635] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-07T20:50:10.545536] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T20:50:11.047626] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-07T20:50:11.167714] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:50:11.847712] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-07T20:50:11.949169] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T20:50:12.647613] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-07T20:50:12.899523] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T20:50:13.042876] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T20:50:13.447692] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-07T20:50:14.247626] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-07T20:50:14.445789] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T20:50:14.708833] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T20:50:14.964172] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T20:50:14.966802] [INFO ] [REMOTE ] PAYC: Full fetch complete (52790 records). [2025-10-07T20:50:14.966913] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-07T20:50:14.967624] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:50:14.967737] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:50:14.967813] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:50:14.967902] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-07T20:50:14.967985] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-07T20:50:14.968080] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-07T20:50:14.968157] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-07T20:50:14.968256] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PAYC took 41.7s. Estimated remaining: 1h 43m 25s. Rate: 7.1 symbols/min [2025-10-07T20:50:15.052819] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-07T20:50:15.139665] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:50:15.186390] [DEBUG] [LOCAL ] PBI: Loaded 49909 existing records from primary storage. [2025-10-07T20:50:15.186790] [INFO ] [MAIN ] PBI: Loaded 49909 existing records. [2025-10-07T20:50:15.359093] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:50:15.359325] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-07T20:50:15.359373] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-07T20:50:15.359615] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-10-07T20:50:15.359709] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-07T20:50:15.708714] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:50:15.847604] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-07T20:50:16.647685] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-07T20:50:16.953927] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T20:50:17.447674] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-07T20:50:17.730149] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T20:50:17.785263] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T20:50:18.247667] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-07T20:50:19.047638] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-07T20:50:19.239256] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T20:50:19.529544] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T20:50:19.847679] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-07T20:50:20.539312] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T20:50:20.647676] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-07T20:50:21.447710] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-07T20:50:21.750301] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T20:50:22.247721] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-07T20:50:22.642325] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T20:50:22.925028] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T20:50:23.047690] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-07T20:50:23.847613] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-07T20:50:24.335062] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-07T20:50:24.575816] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T20:50:24.635573] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T20:50:24.638610] [INFO ] [REMOTE ] PBA: Full fetch complete (71022 records). [2025-10-07T20:50:24.638742] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-07T20:50:24.639881] [FATAL] [VALIDATOR ] PBA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:50:24.640008] [FATAL] [MAIN ] PBA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:50:24.640085] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:50:24.640189] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-07T20:50:24.640311] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-07T20:50:24.640378] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-07T20:50:24.640550] [DEBUG] [LOCAL ] PBA: Deleted derivative data file. [2025-10-07T20:50:24.640730] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBA took 35.1s. Estimated remaining: 1h 43m 17s. Rate: 7.1 symbols/min [2025-10-07T20:50:24.647595] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-07T20:50:25.447728] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-07T20:50:26.247743] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-07T20:50:26.644000] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T20:50:26.782423] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-07T20:50:27.047704] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-07T20:50:27.847698] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-07T20:50:28.037589] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T20:50:28.627672] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T20:50:28.647601] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-07T20:50:29.447764] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-07T20:50:29.740537] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T20:50:30.195809] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T20:50:30.247601] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-07T20:50:31.047733] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-07T20:50:31.281161] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T20:50:31.501196] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T20:50:31.847716] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-07T20:50:32.647685] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-07T20:50:33.004878] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-07T20:50:33.259601] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T20:50:33.261819] [INFO ] [REMOTE ] PBH: Full fetch complete (43543 records). [2025-10-07T20:50:33.261897] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-07T20:50:33.262580] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:50:33.262697] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:50:33.262748] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:50:33.262787] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-07T20:50:33.262845] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-07T20:50:33.262887] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-07T20:50:33.263061] [DEBUG] [LOCAL ] PBH: Deleted derivative data file. [2025-10-07T20:50:33.263150] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBH took 25.1s. Estimated remaining: 1h 43m 8s. Rate: 7.1 symbols/min [2025-10-07T20:50:33.447617] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-07T20:50:33.773984] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T20:50:34.247762] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-07T20:50:35.452205] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-07T20:50:35.464746] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-07T20:50:36.096302] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T20:50:36.107032] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-07T20:50:36.117049] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:50:36.120185] [INFO ] [REMOTE ] PBF: Full fetch complete (76244 records). [2025-10-07T20:50:36.120312] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-07T20:50:36.123401] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:50:36.123579] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:50:36.123671] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:50:36.123746] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-07T20:50:36.123813] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-07T20:50:36.123848] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-07T20:50:36.123983] [DEBUG] [LOCAL ] PBF: Deleted derivative data file. [2025-10-07T20:50:36.124087] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBF took 31.9s. Estimated remaining: 1h 42m 57s. Rate: 7.1 symbols/min [2025-10-07T20:50:38.050519] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T20:50:38.062984] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-07T20:50:39.945170] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T20:50:39.956996] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-07T20:50:41.824495] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T20:50:41.836306] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-07T20:50:42.488751] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T20:50:42.492214] [INFO ] [REMOTE ] PBI: Full fetch complete (71786 records). [2025-10-07T20:50:42.492357] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-07T20:50:42.493312] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:50:42.493410] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:50:42.493455] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:50:42.493528] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-07T20:50:42.493597] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-07T20:50:42.493635] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-07T20:50:42.493988] [DEBUG] [LOCAL ] PBI: Deleted derivative data file. [2025-10-07T20:50:42.494092] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBI took 27.5s. Estimated remaining: 1h 42m 48s. Rate: 7.1 symbols/min [2025-10-07T20:50:43.281402] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:50:43.277365] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:50:43.283324] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:50:43.305697] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-07T20:50:43.305003] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:50:43.305862] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-07T20:50:43.306587] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-07T20:50:43.306638] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-07T20:50:43.306731] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-07T20:50:43.306793] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-07T20:50:43.420470] [DEBUG] [LOCAL ] PCF: Loaded 8944 existing records from primary storage. [2025-10-07T20:50:43.421476] [INFO ] [MAIN ] PCF: Loaded 8944 existing records. [2025-10-07T20:50:43.528940] [DEBUG] [LOCAL ] PBT: Loaded 17357 existing records from primary storage. [2025-10-07T20:50:43.646960] [INFO ] [MAIN ] PBT: Loaded 17357 existing records. [2025-10-07T20:50:43.925777] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:50:43.948490] [DEBUG] [LOCAL ] PBR: Loaded 53710 existing records from primary storage. [2025-10-07T20:50:43.949093] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-07T20:50:43.955074] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-07T20:50:43.970820] [INFO ] [MAIN ] PBR: Loaded 53710 existing records. [2025-10-07T20:50:44.050383] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-07T20:50:44.167767] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:50:44.174272] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-07T20:50:44.189535] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-07T20:50:44.195022] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:50:44.205479] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-07T20:50:44.232988] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-07T20:50:44.247223] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-07T20:50:44.282428] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-07T20:50:44.538290] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:50:44.629700] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-07T20:50:44.638416] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-07T20:50:44.638710] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-07T20:50:44.638783] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-07T20:50:45.310581] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:50:45.401828] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:50:45.423966] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-07T20:50:45.407758] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-07T20:50:45.512234] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:50:45.512592] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-07T20:50:46.200708] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T20:50:46.213227] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-07T20:50:46.659884] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T20:50:46.664834] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-07T20:50:46.732674] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T20:50:46.736871] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-07T20:50:47.646739] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T20:50:47.649722] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-07T20:50:47.691302] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T20:50:47.696447] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-07T20:50:47.793400] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-07T20:50:47.805104] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-07T20:50:48.351290] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-07T20:50:48.354873] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-07T20:50:48.426006] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-07T20:50:48.438837] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-07T20:50:48.480969] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T20:50:48.647704] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-07T20:50:49.051753] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T20:50:49.447710] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-07T20:50:49.750500] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T20:50:49.802015] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T20:50:50.247738] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-07T20:50:50.470923] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-07T20:50:50.508850] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T20:50:51.047707] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-07T20:50:51.847721] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-07T20:50:52.377960] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-07T20:50:52.647677] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-07T20:50:52.789376] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-07T20:50:53.045589] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-07T20:50:53.447693] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-07T20:50:53.979440] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-07T20:50:54.247766] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-07T20:50:54.546422] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T20:50:55.047741] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-07T20:50:55.091300] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T20:50:55.847735] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-07T20:50:56.647705] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-07T20:50:56.960626] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T20:50:57.447723] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-07T20:50:57.749537] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T20:50:58.260338] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-07T20:50:58.284096] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-07T20:50:59.047886] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-07T20:50:59.208461] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T20:50:59.379226] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T20:50:59.847684] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-07T20:51:00.647688] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-07T20:51:01.087727] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T20:51:01.418093] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-07T20:51:01.447635] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-07T20:51:02.247747] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-07T20:51:02.798506] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-07T20:51:03.047720] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-07T20:51:03.254250] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T20:51:03.822468] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-07T20:51:03.847612] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-07T20:51:04.265048] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T20:51:04.647706] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-07T20:51:05.447718] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-07T20:51:05.767975] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T20:51:06.024301] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-07T20:51:06.247721] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-07T20:51:07.031317] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T20:51:07.032551] [INFO ] [REMOTE ] PCF: Full fetch complete (13945 records). [2025-10-07T20:51:07.032623] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-07T20:51:07.053860] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-07T20:51:07.411148] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-07T20:51:07.411296] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-07T20:51:07.411637] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-07T20:51:07.411796] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-07T20:51:07.412740] [DEBUG] [LOCAL ] PCF: Trimmed 13945 records to 8969 (keeping 200 days of data) [2025-10-07T20:51:07.466422] [DEBUG] [LOCAL ] PCF: Primary data saved (8969 records). [2025-10-07T20:51:07.466570] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-07T20:51:07.466682] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 24.9s. Estimated remaining: 1h 42m 47s. Rate: 7.1 symbols/min [2025-10-07T20:51:07.642283] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:51:07.681678] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-07T20:51:07.698532] [DEBUG] [LOCAL ] PCM: Loaded 6735 existing records from primary storage. [2025-10-07T20:51:07.699110] [INFO ] [MAIN ] PCM: Loaded 6735 existing records. [2025-10-07T20:51:07.848032] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-07T20:51:07.878567] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:51:07.878843] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-07T20:51:07.878932] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-07T20:51:07.879119] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-07T20:51:07.879175] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-07T20:51:08.237819] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:51:08.602707] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T20:51:08.647629] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-07T20:51:09.447740] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-07T20:51:09.807616] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T20:51:10.053389] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-07T20:51:10.247718] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-07T20:51:10.844049] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T20:51:10.845519] [INFO ] [REMOTE ] PBT: Full fetch complete (25144 records). [2025-10-07T20:51:10.845587] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-07T20:51:10.846114] [FATAL] [VALIDATOR ] PBT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:51:10.846204] [FATAL] [MAIN ] PBT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:51:10.846246] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:51:10.846285] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-07T20:51:10.846341] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-07T20:51:10.846375] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-07T20:51:10.846521] [DEBUG] [LOCAL ] PBT: Deleted derivative data file. [2025-10-07T20:51:10.846606] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PBT took 28.4s. Estimated remaining: 1h 42m 36s. Rate: 7.1 symbols/min [2025-10-07T20:51:11.011467] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:51:11.035368] [DEBUG] [LOCAL ] PCN: Loaded 24578 existing records from primary storage. [2025-10-07T20:51:11.035637] [INFO ] [MAIN ] PCN: Loaded 24578 existing records. [2025-10-07T20:51:11.055710] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-07T20:51:11.212244] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:51:11.212432] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-07T20:51:11.212478] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-07T20:51:11.212766] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-07T20:51:11.212823] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-07T20:51:11.583618] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:51:11.647231] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-07T20:51:11.847615] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-07T20:51:12.279182] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-07T20:51:12.647709] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-07T20:51:13.294483] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T20:51:13.447709] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-07T20:51:14.247701] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-07T20:51:14.629854] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-07T20:51:14.963899] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-07T20:51:15.047622] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-07T20:51:15.129705] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T20:51:15.847619] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-07T20:51:15.997381] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T20:51:16.464243] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:51:16.467952] [INFO ] [REMOTE ] PCG: Full fetch complete (77347 records). [2025-10-07T20:51:16.468098] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-07T20:51:16.468848] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:51:16.468938] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:51:16.468981] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:51:16.469021] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-07T20:51:16.469108] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-07T20:51:16.469165] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-07T20:51:16.469210] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-07T20:51:16.469268] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PCG took 34.0s. Estimated remaining: 1h 42m 27s. Rate: 7.1 symbols/min [2025-10-07T20:51:16.639508] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:51:16.647681] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-07T20:51:16.682166] [DEBUG] [LOCAL ] PCOR: Loaded 47854 existing records from primary storage. [2025-10-07T20:51:16.682495] [INFO ] [MAIN ] PCOR: Loaded 47854 existing records. [2025-10-07T20:51:16.856792] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:51:16.857026] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-07T20:51:16.857074] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-07T20:51:16.857306] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-07T20:51:16.857363] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-07T20:51:17.204762] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:51:17.447697] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-07T20:51:18.203750] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T20:51:18.247722] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-07T20:51:18.928252] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-07T20:51:19.047699] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-07T20:51:19.440306] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T20:51:19.847721] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-07T20:51:19.860004] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T20:51:20.647737] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-07T20:51:21.270230] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T20:51:21.327347] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T20:51:21.447679] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-07T20:51:22.174464] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T20:51:22.247666] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-07T20:51:23.047735] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-07T20:51:23.425135] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T20:51:23.847683] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-07T20:51:23.928437] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-07T20:51:24.470550] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:51:24.474094] [INFO ] [REMOTE ] PBR: Full fetch complete (77385 records). [2025-10-07T20:51:24.474236] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-07T20:51:24.475137] [FATAL] [VALIDATOR ] PBR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:51:24.475230] [FATAL] [MAIN ] PBR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:51:24.475272] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:51:24.475341] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-07T20:51:24.475420] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-07T20:51:24.475474] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-07T20:51:24.475681] [DEBUG] [LOCAL ] PBR: Deleted derivative data file. [2025-10-07T20:51:24.475788] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBR took 42.0s. Estimated remaining: 1h 42m 18s. Rate: 7.1 symbols/min [2025-10-07T20:51:24.650900] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-07T20:51:24.659900] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:51:24.676812] [DEBUG] [LOCAL ] PCQ: Loaded 12075 existing records from primary storage. [2025-10-07T20:51:24.677105] [INFO ] [MAIN ] PCQ: Loaded 12075 existing records. [2025-10-07T20:51:24.890681] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:51:24.891242] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-07T20:51:24.891306] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-07T20:51:24.891563] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-07T20:51:24.891622] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-07T20:51:25.250003] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:51:25.447723] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-07T20:51:25.610759] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T20:51:26.247629] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-07T20:51:26.306452] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T20:51:27.047638] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-07T20:51:27.538435] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T20:51:27.847606] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-07T20:51:27.870083] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T20:51:28.647623] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-07T20:51:28.717713] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T20:51:29.447687] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-07T20:51:30.247624] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-07T20:51:30.301733] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-07T20:51:30.372064] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T20:51:31.038227] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T20:51:31.047592] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-07T20:51:31.847619] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-07T20:51:31.958401] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T20:51:32.607948] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T20:51:32.609193] [INFO ] [REMOTE ] PCM: Full fetch complete (10440 records). [2025-10-07T20:51:32.609294] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-07T20:51:32.653414] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-07T20:51:33.054527] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-07T20:51:33.054692] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-07T20:51:33.055094] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-07T20:51:33.055150] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-07T20:51:33.055773] [DEBUG] [LOCAL ] PCM: Trimmed 10440 records to 6722 (keeping 200 days of data) [2025-10-07T20:51:33.101023] [DEBUG] [LOCAL ] PCM: Primary data saved (6722 records). [2025-10-07T20:51:33.101164] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-07T20:51:33.101268] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCM took 25.6s. Estimated remaining: 1h 42m 10s. Rate: 7.1 symbols/min [2025-10-07T20:51:33.297688] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:51:33.342198] [DEBUG] [LOCAL ] PD: Loaded 47928 existing records from primary storage. [2025-10-07T20:51:33.342541] [INFO ] [MAIN ] PD: Loaded 47928 existing records. [2025-10-07T20:51:33.452752] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-07T20:51:33.520609] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:51:33.520895] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-07T20:51:33.520962] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-07T20:51:33.521292] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-07T20:51:33.521369] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-07T20:51:33.869859] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:51:34.032579] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T20:51:34.247614] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-07T20:51:34.638717] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-07T20:51:35.047684] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-07T20:51:35.847629] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-07T20:51:35.949537] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T20:51:36.647621] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-07T20:51:36.735556] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T20:51:37.160934] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T20:51:37.447718] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-07T20:51:38.247635] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-07T20:51:38.427756] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T20:51:38.771551] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T20:51:39.047632] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-07T20:51:39.509998] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T20:51:39.722582] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T20:51:39.847616] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-07T20:51:40.647681] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-07T20:51:40.747283] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T20:51:41.447691] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-07T20:51:42.247629] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-07T20:51:42.281342] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T20:51:42.330084] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T20:51:43.047670] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-07T20:51:43.847719] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-07T20:51:43.988956] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T20:51:44.192323] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T20:51:44.647760] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-07T20:51:45.450311] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-07T20:51:45.455955] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T20:51:45.665879] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T20:51:46.247708] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-07T20:51:47.009600] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T20:51:47.047617] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-07T20:51:47.311289] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T20:51:47.313413] [INFO ] [REMOTE ] PCN: Full fetch complete (34177 records). [2025-10-07T20:51:47.313497] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-07T20:51:47.729433] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-07T20:51:47.729543] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-07T20:51:47.730282] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-07T20:51:47.730348] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-07T20:51:47.731333] [DEBUG] [LOCAL ] PCN: Trimmed 34177 records to 24648 (keeping 200 days of data) [2025-10-07T20:51:47.848398] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-07T20:51:47.891864] [DEBUG] [LOCAL ] PCN: Primary data saved (24648 records). [2025-10-07T20:51:47.892028] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-07T20:51:47.892123] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCN took 37.0s. Estimated remaining: 1h 42m 4s. Rate: 7.1 symbols/min [2025-10-07T20:51:48.066621] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:51:48.066882] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-07T20:51:48.066928] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-07T20:51:48.067045] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-07T20:51:48.067090] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-07T20:51:48.067206] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-07T20:51:48.067260] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-07T20:51:48.452884] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:51:48.647714] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-07T20:51:48.853634] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T20:51:49.447625] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-07T20:51:49.496707] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T20:51:49.548785] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T20:51:50.247748] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-07T20:51:50.603882] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-07T20:51:51.054392] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-07T20:51:51.078412] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T20:51:51.847731] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-07T20:51:51.876331] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T20:51:51.877885] [INFO ] [REMOTE ] PCQ: Full fetch complete (17274 records). [2025-10-07T20:51:51.877993] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-07T20:51:52.228938] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-07T20:51:52.229022] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-07T20:51:52.229428] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-07T20:51:52.229468] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-07T20:51:52.230018] [DEBUG] [LOCAL ] PCQ: Trimmed 17274 records to 12109 (keeping 200 days of data) [2025-10-07T20:51:52.304396] [DEBUG] [LOCAL ] PCQ: Primary data saved (12109 records). [2025-10-07T20:51:52.304534] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-07T20:51:52.304619] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCQ took 27.8s. Estimated remaining: 1h 41m 54s. Rate: 7.1 symbols/min [2025-10-07T20:51:52.469600] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:51:52.523085] [DEBUG] [LOCAL ] PDI: Loaded 50065 existing records from primary storage. [2025-10-07T20:51:52.523424] [INFO ] [MAIN ] PDI: Loaded 50065 existing records. [2025-10-07T20:51:52.660735] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-07T20:51:52.700677] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:51:52.700864] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-07T20:51:52.700911] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-07T20:51:52.701270] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-07T20:51:52.701326] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-07T20:51:53.045513] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:51:53.447620] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-07T20:51:53.562601] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T20:51:54.135425] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T20:51:54.247605] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-07T20:51:55.056635] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-07T20:51:55.076194] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T20:51:55.650209] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T20:51:55.847626] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-07T20:51:56.647622] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-07T20:51:56.821775] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T20:51:57.447633] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-07T20:51:57.476978] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T20:51:58.247719] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-07T20:51:58.578883] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T20:51:59.047717] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-07T20:51:59.214239] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T20:51:59.595444] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T20:51:59.847678] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-07T20:52:00.101711] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T20:52:00.647700] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-07T20:52:01.148629] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T20:52:01.151856] [INFO ] [REMOTE ] PCOR: Full fetch complete (69155 records). [2025-10-07T20:52:01.152014] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-07T20:52:01.153039] [FATAL] [VALIDATOR ] PCOR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:52:01.153179] [FATAL] [MAIN ] PCOR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:52:01.153259] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:52:01.153324] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-07T20:52:01.153418] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-07T20:52:01.153476] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-07T20:52:01.153728] [DEBUG] [LOCAL ] PCOR: Deleted derivative data file. [2025-10-07T20:52:01.153874] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PCOR took 44.7s. Estimated remaining: 1h 41m 46s. Rate: 7.1 symbols/min [2025-10-07T20:52:01.336476] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:52:01.373095] [DEBUG] [LOCAL ] PDM: Loaded 39499 existing records from primary storage. [2025-10-07T20:52:01.373435] [INFO ] [MAIN ] PDM: Loaded 39499 existing records. [2025-10-07T20:52:01.453445] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-07T20:52:01.555416] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:52:01.555607] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-07T20:52:01.555686] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-07T20:52:01.555976] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-07T20:52:01.556035] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-07T20:52:01.931716] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:52:01.959304] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-07T20:52:02.118072] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T20:52:02.247737] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-07T20:52:03.047719] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-07T20:52:03.847721] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-07T20:52:04.272230] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-07T20:52:04.647617] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-07T20:52:05.076474] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T20:52:05.128262] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T20:52:05.165687] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-07T20:52:05.447695] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-07T20:52:05.919961] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T20:52:06.247677] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-07T20:52:07.047680] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-07T20:52:07.605679] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T20:52:07.608759] [INFO ] [REMOTE ] PD: Full fetch complete (67553 records). [2025-10-07T20:52:07.608905] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-07T20:52:07.609706] [FATAL] [VALIDATOR ] PD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:52:07.609785] [FATAL] [MAIN ] PD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:52:07.609822] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:52:07.609862] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-07T20:52:07.609922] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-07T20:52:07.609957] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-07T20:52:07.610075] [DEBUG] [LOCAL ] PD: Deleted derivative data file. [2025-10-07T20:52:07.610180] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PD took 34.5s. Estimated remaining: 1h 41m 36s. Rate: 7.1 symbols/min [2025-10-07T20:52:07.774095] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:52:07.807054] [DEBUG] [LOCAL ] PDO: Loaded 31295 existing records from primary storage. [2025-10-07T20:52:07.807348] [INFO ] [MAIN ] PDO: Loaded 31295 existing records. [2025-10-07T20:52:07.855579] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-07T20:52:07.997407] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:52:07.997668] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-07T20:52:07.997729] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-07T20:52:07.997949] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-07T20:52:07.998005] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-07T20:52:08.366751] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:52:08.402093] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-07T20:52:08.647670] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-07T20:52:09.192687] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-07T20:52:09.334136] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T20:52:09.447633] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-07T20:52:10.247758] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-07T20:52:11.053090] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-07T20:52:11.060770] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T20:52:11.847616] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-07T20:52:12.261475] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T20:52:12.299638] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T20:52:12.647626] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-07T20:52:12.691856] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T20:52:13.087475] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T20:52:13.447681] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-07T20:52:13.899452] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T20:52:14.247624] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-07T20:52:14.485430] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-07T20:52:14.486157] [INFO ] [REMOTE ] PDCC: Full fetch complete (1332 records). [2025-10-07T20:52:14.486229] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-07T20:52:14.486587] [FATAL] [VALIDATOR ] PDCC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:52:14.486700] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:52:14.486799] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:52:14.487128] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-07T20:52:14.487260] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-07T20:52:14.487321] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-07T20:52:14.487369] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-07T20:52:14.487465] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PDCC took 26.6s. Estimated remaining: 1h 41m 27s. Rate: 7.1 symbols/min [2025-10-07T20:52:14.667835] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:52:14.686054] [DEBUG] [LOCAL ] PDS: Loaded 17468 existing records from primary storage. [2025-10-07T20:52:14.686406] [INFO ] [MAIN ] PDS: Loaded 17468 existing records. [2025-10-07T20:52:14.868050] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:52:14.868279] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-07T20:52:14.868327] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-07T20:52:14.868620] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-07T20:52:14.868743] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-07T20:52:15.052864] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-07T20:52:15.217330] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:52:15.847730] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-07T20:52:16.647695] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-07T20:52:16.761950] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T20:52:16.901817] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T20:52:17.447721] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-07T20:52:18.247622] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-07T20:52:18.551183] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T20:52:18.575341] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T20:52:19.047711] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-07T20:52:19.639282] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T20:52:19.847636] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-07T20:52:20.603077] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T20:52:20.647614] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-07T20:52:21.454510] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-07T20:52:21.471871] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T20:52:22.102850] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T20:52:22.247674] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-07T20:52:23.047673] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-07T20:52:23.560977] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-07T20:52:23.859040] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-07T20:52:23.861747] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T20:52:24.142208] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T20:52:24.647700] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-07T20:52:25.447629] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-07T20:52:25.859287] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T20:52:25.918242] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T20:52:26.247675] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-07T20:52:26.893489] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T20:52:27.047686] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-07T20:52:27.623183] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T20:52:27.847616] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-07T20:52:28.647677] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-07T20:52:28.769079] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T20:52:29.447611] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-07T20:52:29.551513] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T20:52:29.768898] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T20:52:30.247694] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-07T20:52:30.490199] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T20:52:31.047709] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-07T20:52:31.847753] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-07T20:52:32.334036] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-07T20:52:32.448093] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T20:52:32.647701] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-07T20:52:33.334252] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T20:52:33.447611] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-07T20:52:34.048269] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T20:52:34.051823] [INFO ] [REMOTE ] PDI: Full fetch complete (72987 records). [2025-10-07T20:52:34.051928] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-07T20:52:34.257621] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-07T20:52:34.440471] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-07T20:52:34.440552] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-07T20:52:34.441532] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-07T20:52:34.441620] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-07T20:52:34.443122] [DEBUG] [LOCAL ] PDI: Trimmed 72987 records to 50078 (keeping 200 days of data) [2025-10-07T20:52:34.759532] [DEBUG] [LOCAL ] PDI: Primary data saved (50078 records). [2025-10-07T20:52:34.759719] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-07T20:52:34.759854] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDI took 42.5s. Estimated remaining: 1h 41m 24s. Rate: 7.1 symbols/min [2025-10-07T20:52:34.931498] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:52:34.949760] [DEBUG] [LOCAL ] PDT: Loaded 17389 existing records from primary storage. [2025-10-07T20:52:34.950011] [INFO ] [MAIN ] PDT: Loaded 17389 existing records. [2025-10-07T20:52:35.054684] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-07T20:52:35.148632] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:52:35.163060] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-07T20:52:35.163211] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-07T20:52:35.165171] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:52:35.165276] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-07T20:52:35.173538] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-07T20:52:35.534299] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:52:35.840861] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T20:52:35.848440] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-07T20:52:36.256993] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-07T20:52:36.454875] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T20:52:36.458007] [INFO ] [REMOTE ] PDM: Full fetch complete (57063 records). [2025-10-07T20:52:36.458105] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-07T20:52:36.458737] [FATAL] [VALIDATOR ] PDM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:52:36.458820] [FATAL] [MAIN ] PDM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:52:36.458865] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:52:36.458907] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-07T20:52:36.458964] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-07T20:52:36.458999] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-07T20:52:36.459296] [DEBUG] [LOCAL ] PDM: Deleted derivative data file. [2025-10-07T20:52:36.459400] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDM took 35.3s. Estimated remaining: 1h 41m 12s. Rate: 7.1 symbols/min [2025-10-07T20:52:36.629977] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:52:36.646257] [DEBUG] [LOCAL ] PDX: Loaded 14391 existing records from primary storage. [2025-10-07T20:52:36.646486] [INFO ] [MAIN ] PDX: Loaded 14391 existing records. [2025-10-07T20:52:36.657239] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-07T20:52:36.829290] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:52:36.829510] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-07T20:52:36.829559] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-07T20:52:36.829802] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-07T20:52:36.829861] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-07T20:52:37.184945] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:52:37.447705] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-07T20:52:37.893391] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T20:52:38.247723] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-07T20:52:38.646179] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T20:52:39.047742] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-07T20:52:39.847683] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-07T20:52:40.114537] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T20:52:40.288361] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-07T20:52:40.647633] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-07T20:52:41.012258] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T20:52:41.447733] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-07T20:52:41.745407] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T20:52:42.247753] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-07T20:52:43.047621] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-07T20:52:43.116941] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-07T20:52:43.595149] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T20:52:43.847621] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-07T20:52:43.991324] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T20:52:44.647743] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-07T20:52:44.912708] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T20:52:45.447622] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-07T20:52:45.738884] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T20:52:46.247716] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-07T20:52:46.505624] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T20:52:46.581410] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-07T20:52:46.582776] [INFO ] [REMOTE ] PDS: Full fetch complete (25463 records). [2025-10-07T20:52:46.582849] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-07T20:52:46.583333] [FATAL] [VALIDATOR ] PDS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:52:46.583429] [FATAL] [MAIN ] PDS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:52:46.583473] [WARN ] [MAIN ] PDS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:52:46.583542] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-07T20:52:46.583609] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-07T20:52:46.583678] [INFO ] [LOCAL ] PDS: Starting deletion of derivative data. [2025-10-07T20:52:46.583952] [DEBUG] [LOCAL ] PDS: Deleted derivative data file. [2025-10-07T20:52:46.584044] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDS took 32.1s. Estimated remaining: 1h 41m 5s. Rate: 7.1 symbols/min [2025-10-07T20:52:46.749680] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:52:46.802970] [DEBUG] [LOCAL ] PEB: Loaded 50658 existing records from primary storage. [2025-10-07T20:52:46.803290] [INFO ] [MAIN ] PEB: Loaded 50658 existing records. [2025-10-07T20:52:46.998631] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:52:46.999044] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-07T20:52:46.999103] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-07T20:52:46.999373] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-10-07T20:52:46.999429] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-07T20:52:47.056681] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-07T20:52:47.367794] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:52:47.847670] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-07T20:52:48.191125] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T20:52:48.647747] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-07T20:52:49.385125] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T20:52:49.447742] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-07T20:52:49.720154] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T20:52:50.247684] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-07T20:52:50.847838] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T20:52:51.047717] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-07T20:52:51.304616] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T20:52:51.808236] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T20:52:51.847639] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-07T20:52:52.647725] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-07T20:52:53.051404] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T20:52:53.447699] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-07T20:52:54.247762] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-07T20:52:54.372386] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T20:52:54.504752] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T20:52:55.047746] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-07T20:52:55.134022] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T20:52:55.138375] [INFO ] [REMOTE ] PDO: Full fetch complete (47376 records). [2025-10-07T20:52:55.138535] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-07T20:52:55.541494] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-07T20:52:55.541601] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-07T20:52:55.542396] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-07T20:52:55.542461] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-07T20:52:55.543810] [DEBUG] [LOCAL ] PDO: Trimmed 47376 records to 31297 (keeping 200 days of data) [2025-10-07T20:52:55.740229] [DEBUG] [LOCAL ] PDO: Primary data saved (31297 records). [2025-10-07T20:52:55.740592] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-07T20:52:55.740756] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDO took 48.1s. Estimated remaining: 1h 40m 57s. Rate: 7.1 symbols/min [2025-10-07T20:52:55.848111] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-07T20:52:55.880198] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T20:52:55.934084] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:52:55.935204] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-07T20:52:55.936098] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-07T20:52:55.936241] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-07T20:52:55.936286] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-07T20:52:55.936327] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-07T20:52:55.936361] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-07T20:52:56.339798] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:52:56.647737] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-07T20:52:57.128711] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T20:52:57.447681] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-07T20:52:57.499464] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-07T20:52:58.247737] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-07T20:52:58.601864] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T20:52:59.047691] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-07T20:52:59.682036] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:52:59.683231] [INFO ] [REMOTE ] PDX: Full fetch complete (24049 records). [2025-10-07T20:52:59.683301] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-07T20:52:59.683815] [FATAL] [VALIDATOR ] PDX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:52:59.683899] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:52:59.683941] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:52:59.683980] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-07T20:52:59.684036] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-07T20:52:59.684070] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-07T20:52:59.684263] [DEBUG] [LOCAL ] PDX: Deleted derivative data file. [2025-10-07T20:52:59.684353] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDX took 23.2s. Estimated remaining: 1h 40m 46s. Rate: 7.1 symbols/min [2025-10-07T20:52:59.850608] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-07T20:52:59.855000] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:52:59.888733] [DEBUG] [LOCAL ] PEN: Loaded 30168 existing records from primary storage. [2025-10-07T20:52:59.889034] [INFO ] [MAIN ] PEN: Loaded 30168 existing records. [2025-10-07T20:53:00.078151] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:53:00.078633] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-07T20:53:00.078753] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-07T20:53:00.079129] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-10-07T20:53:00.079377] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-07T20:53:00.324769] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-07T20:53:00.484270] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:53:00.647682] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-07T20:53:01.447731] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-07T20:53:01.647763] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T20:53:02.042978] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T20:53:02.247738] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-07T20:53:03.047731] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-07T20:53:03.517092] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-07T20:53:03.748727] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T20:53:03.847725] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-07T20:53:03.880128] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T20:53:04.647679] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-07T20:53:05.447678] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-07T20:53:05.549726] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T20:53:05.696964] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T20:53:06.247686] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-07T20:53:07.047628] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-07T20:53:07.211068] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T20:53:07.833200] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T20:53:07.847594] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-07T20:53:08.225106] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T20:53:08.647618] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-07T20:53:08.758358] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T20:53:08.760146] [INFO ] [REMOTE ] PDT: Full fetch complete (25276 records). [2025-10-07T20:53:08.760310] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-07T20:53:09.122787] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-07T20:53:09.122895] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-07T20:53:09.123405] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-07T20:53:09.123447] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-07T20:53:09.124093] [DEBUG] [LOCAL ] PDT: Trimmed 25276 records to 17417 (keeping 200 days of data) [2025-10-07T20:53:09.240033] [DEBUG] [LOCAL ] PDT: Primary data saved (17417 records). [2025-10-07T20:53:09.240180] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-07T20:53:09.240264] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDT took 34.5s. Estimated remaining: 1h 40m 38s. Rate: 7.1 symbols/min [2025-10-07T20:53:09.404324] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:53:09.418563] [DEBUG] [LOCAL ] PEO: Loaded 11128 existing records from primary storage. [2025-10-07T20:53:09.418828] [INFO ] [MAIN ] PEO: Loaded 11128 existing records. [2025-10-07T20:53:09.452883] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-07T20:53:09.602769] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:53:09.603010] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-07T20:53:09.603065] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-07T20:53:09.603241] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-07T20:53:09.603298] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-07T20:53:09.954356] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:53:10.193720] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T20:53:10.247733] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-07T20:53:11.047723] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-07T20:53:11.095414] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T20:53:11.448674] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T20:53:11.847765] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-07T20:53:12.647703] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-07T20:53:13.105349] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-07T20:53:13.201960] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T20:53:13.447704] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-07T20:53:13.923761] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T20:53:14.247691] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-07T20:53:15.047684] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-07T20:53:15.222721] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T20:53:15.847692] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-07T20:53:15.939674] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T20:53:16.178744] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T20:53:16.647701] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-07T20:53:17.447638] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-07T20:53:17.764457] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-07T20:53:18.248465] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-07T20:53:18.253145] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T20:53:19.047626] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-07T20:53:19.227291] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T20:53:19.354008] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-07T20:53:19.847679] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-07T20:53:20.395875] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T20:53:20.647690] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-07T20:53:21.447640] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-07T20:53:21.697433] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T20:53:21.830270] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T20:53:22.247687] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-07T20:53:22.825995] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T20:53:23.047631] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-07T20:53:23.069505] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T20:53:23.847676] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-07T20:53:24.457032] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T20:53:24.647712] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-07T20:53:25.447623] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-07T20:53:25.535234] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T20:53:26.247627] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-07T20:53:26.686426] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T20:53:26.717164] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T20:53:27.047713] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-07T20:53:27.847704] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-07T20:53:27.943206] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T20:53:27.984940] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T20:53:28.647692] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-07T20:53:29.447628] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-07T20:53:29.676892] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T20:53:29.795324] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T20:53:30.085157] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T20:53:30.087361] [INFO ] [REMOTE ] PEN: Full fetch complete (43981 records). [2025-10-07T20:53:30.087449] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-07T20:53:30.088246] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:53:30.088334] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:53:30.088378] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:53:30.088458] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-07T20:53:30.088548] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-07T20:53:30.088617] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-07T20:53:30.088857] [DEBUG] [LOCAL ] PEN: Deleted derivative data file. [2025-10-07T20:53:30.088950] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEN took 30.4s. Estimated remaining: 1h 40m 35s. Rate: 7.1 symbols/min [2025-10-07T20:53:30.248687] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-07T20:53:30.269532] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:53:30.286328] [DEBUG] [LOCAL ] PERF: Loaded 14234 existing records from primary storage. [2025-10-07T20:53:30.286711] [INFO ] [MAIN ] PERF: Loaded 14234 existing records. [2025-10-07T20:53:30.476510] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:53:30.476825] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-07T20:53:30.476879] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-07T20:53:30.477064] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-07T20:53:30.477121] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-07T20:53:30.849818] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:53:31.047683] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-07T20:53:31.847708] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-07T20:53:31.918851] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T20:53:32.116600] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T20:53:32.391981] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T20:53:32.395155] [INFO ] [REMOTE ] PEB: Full fetch complete (72564 records). [2025-10-07T20:53:32.395264] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-07T20:53:32.396089] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:53:32.396199] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:53:32.396244] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:53:32.396286] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-07T20:53:32.396346] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-07T20:53:32.396382] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-07T20:53:32.396540] [DEBUG] [LOCAL ] PEB: Deleted derivative data file. [2025-10-07T20:53:32.396632] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEB took 45.8s. Estimated remaining: 1h 40m 24s. Rate: 7.1 symbols/min [2025-10-07T20:53:32.596871] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:53:32.597104] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-07T20:53:32.597162] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-07T20:53:32.597281] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-07T20:53:32.597323] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-07T20:53:32.597364] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-07T20:53:32.597396] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-07T20:53:32.652933] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-07T20:53:32.948257] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:53:33.447728] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-07T20:53:33.580540] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-07T20:53:33.726114] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T20:53:33.726444] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-07T20:53:33.726535] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T20:53:33.726606] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-07T20:53:33.726711] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T20:53:33.726964] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-07T20:53:33.727050] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-07T20:53:33.727115] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-07T20:53:33.727205] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-07T20:53:33.727293] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEW took 1.3s. Estimated remaining: 1h 40m 12s. Rate: 7.1 symbols/min [2025-10-07T20:53:33.912975] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:53:33.921245] [DEBUG] [LOCAL ] PFD: Loaded 5201 existing records from primary storage. [2025-10-07T20:53:33.921433] [INFO ] [MAIN ] PFD: Loaded 5201 existing records. [2025-10-07T20:53:34.106389] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:53:34.106676] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-07T20:53:34.106766] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-07T20:53:34.106953] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-07T20:53:34.107010] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-07T20:53:34.252751] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-07T20:53:34.468921] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:53:35.047625] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-07T20:53:35.092335] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T20:53:35.093633] [INFO ] [REMOTE ] PEO: Full fetch complete (16301 records). [2025-10-07T20:53:35.093730] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-07T20:53:35.458540] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-07T20:53:35.458667] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-07T20:53:35.459012] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-07T20:53:35.459055] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-07T20:53:35.459565] [DEBUG] [LOCAL ] PEO: Trimmed 16301 records to 11173 (keeping 200 days of data) [2025-10-07T20:53:35.528376] [DEBUG] [LOCAL ] PEO: Primary data saved (11173 records). [2025-10-07T20:53:35.528510] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-07T20:53:35.528591] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEO took 26.3s. Estimated remaining: 1h 40m 1s. Rate: 7.1 symbols/min [2025-10-07T20:53:35.703256] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:53:35.703446] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-07T20:53:35.703503] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-07T20:53:35.703632] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-07T20:53:35.703711] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-07T20:53:35.703764] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-07T20:53:35.703798] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-07T20:53:35.848352] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-07T20:53:35.972776] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T20:53:36.001826] [INFO ] [REMOTE ] PEG: Full fetch complete (76329 records). [2025-10-07T20:53:36.001995] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-07T20:53:36.018787] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:53:36.041854] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:53:36.050147] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:53:36.056081] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-07T20:53:36.065867] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-07T20:53:36.066943] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-07T20:53:36.073870] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-07T20:53:36.081897] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PEG took 40.3s. Estimated remaining: 1h 39m 49s. Rate: 7.1 symbols/min [2025-10-07T20:53:36.097529] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:53:36.251794] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:53:36.296100] [DEBUG] [LOCAL ] PFGC: Loaded 46910 existing records from primary storage. [2025-10-07T20:53:36.296430] [INFO ] [MAIN ] PFGC: Loaded 46910 existing records. [2025-10-07T20:53:36.468467] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:53:36.468715] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-07T20:53:36.468772] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-07T20:53:36.469007] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-10-07T20:53:36.469063] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-07T20:53:36.652994] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-07T20:53:36.823118] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:53:37.126712] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T20:53:37.447601] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-07T20:53:37.528999] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T20:53:38.247701] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-07T20:53:39.047735] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-07T20:53:39.721964] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-07T20:53:39.852817] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-07T20:53:39.863988] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T20:53:40.273506] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-10-07T20:53:40.647740] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-07T20:53:41.002055] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T20:53:41.447723] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-07T20:53:42.236905] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T20:53:42.247610] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-07T20:53:42.614462] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T20:53:43.047689] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-07T20:53:43.847668] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-07T20:53:43.967010] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T20:53:44.598488] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T20:53:44.647692] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-07T20:53:45.447687] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-07T20:53:45.485838] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-07T20:53:46.116112] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T20:53:46.252809] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-07T20:53:46.267611] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T20:53:47.004394] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-07T20:53:47.047691] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-07T20:53:47.761138] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T20:53:47.847707] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-07T20:53:48.647765] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-07T20:53:48.772518] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T20:53:49.447686] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-07T20:53:50.155739] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T20:53:50.247736] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-07T20:53:51.047665] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-07T20:53:51.316557] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-07T20:53:51.847638] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-07T20:53:51.944636] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T20:53:52.182320] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T20:53:52.647625] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-07T20:53:52.655922] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T20:53:53.447709] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-07T20:53:54.247698] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-07T20:53:54.292822] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T20:53:55.047670] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-07T20:53:55.389580] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-07T20:53:55.847725] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-07T20:53:56.090192] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T20:53:56.134580] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T20:53:56.647732] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-07T20:53:56.744874] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T20:53:57.447701] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-07T20:53:58.201133] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T20:53:58.217483] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T20:53:58.247617] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-07T20:53:58.968380] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T20:53:58.969450] [INFO ] [REMOTE ] PFD: Full fetch complete (7593 records). [2025-10-07T20:53:58.969519] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-07T20:53:59.052738] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-07T20:53:59.344183] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-07T20:53:59.344376] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-07T20:53:59.344595] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-07T20:53:59.344635] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-07T20:53:59.345122] [DEBUG] [LOCAL ] PFD: Trimmed 7593 records to 5325 (keeping 200 days of data) [2025-10-07T20:53:59.377605] [DEBUG] [LOCAL ] PFD: Primary data saved (5325 records). [2025-10-07T20:53:59.377738] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-07T20:53:59.377858] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PFD took 25.7s. Estimated remaining: 1h 39m 47s. Rate: 7.1 symbols/min [2025-10-07T20:53:59.546022] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:53:59.556071] [DEBUG] [LOCAL ] PFH: Loaded 6805 existing records from primary storage. [2025-10-07T20:53:59.556353] [INFO ] [MAIN ] PFH: Loaded 6805 existing records. [2025-10-07T20:53:59.730342] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:53:59.730593] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-07T20:53:59.730666] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-07T20:53:59.730896] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-07T20:53:59.730953] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-07T20:53:59.852794] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-07T20:54:00.085966] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:54:00.647728] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-07T20:54:01.159184] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T20:54:01.447634] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-07T20:54:01.997546] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-07T20:54:02.247616] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-07T20:54:02.373785] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T20:54:02.619333] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T20:54:03.047724] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-07T20:54:03.214051] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T20:54:03.847735] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-07T20:54:04.647624] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-07T20:54:04.797958] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T20:54:05.447690] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-07T20:54:05.662536] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-07T20:54:06.247717] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-07T20:54:06.953330] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-10-07T20:54:06.974495] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T20:54:07.047631] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-07T20:54:07.372495] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T20:54:07.847714] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-07T20:54:07.975082] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-07T20:54:08.647702] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-07T20:54:08.700829] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T20:54:09.005058] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-07T20:54:09.006938] [INFO ] [REMOTE ] PERF: Full fetch complete (21892 records). [2025-10-07T20:54:09.007031] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-07T20:54:09.007684] [FATAL] [VALIDATOR ] PERF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:54:09.007777] [FATAL] [MAIN ] PERF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:54:09.007822] [WARN ] [MAIN ] PERF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:54:09.007864] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-07T20:54:09.007951] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-07T20:54:09.008045] [INFO ] [LOCAL ] PERF: Starting deletion of derivative data. [2025-10-07T20:54:09.008352] [DEBUG] [LOCAL ] PERF: Deleted derivative data file. [2025-10-07T20:54:09.008478] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PERF took 38.9s. Estimated remaining: 1h 39m 39s. Rate: 7.1 symbols/min [2025-10-07T20:54:09.224481] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:54:09.242437] [DEBUG] [LOCAL ] PFL: Loaded 13790 existing records from primary storage. [2025-10-07T20:54:09.242811] [INFO ] [MAIN ] PFL: Loaded 13790 existing records. [2025-10-07T20:54:09.421820] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:54:09.422052] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-07T20:54:09.422099] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-07T20:54:09.422309] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-07T20:54:09.422368] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-07T20:54:09.452897] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-07T20:54:09.795973] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:54:10.228385] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T20:54:10.231237] [INFO ] [REMOTE ] PFGC: Full fetch complete (67040 records). [2025-10-07T20:54:10.231349] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-07T20:54:10.232042] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:54:10.232133] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:54:10.232177] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:54:10.232218] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-07T20:54:10.232274] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-07T20:54:10.232309] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-07T20:54:10.232508] [DEBUG] [LOCAL ] PFGC: Deleted derivative data file. [2025-10-07T20:54:10.232602] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PFGC took 34.1s. Estimated remaining: 1h 39m 28s. Rate: 7.1 symbols/min [2025-10-07T20:54:10.253176] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-07T20:54:10.405138] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:54:10.444970] [DEBUG] [LOCAL ] PFLT: Loaded 43861 existing records from primary storage. [2025-10-07T20:54:10.445311] [INFO ] [MAIN ] PFLT: Loaded 43861 existing records. [2025-10-07T20:54:10.617568] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:54:10.617803] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-07T20:54:10.617853] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-07T20:54:10.618199] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-07T20:54:10.618255] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-07T20:54:10.978098] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:54:11.047698] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-07T20:54:11.116633] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-07T20:54:11.847745] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-07T20:54:12.072236] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T20:54:12.647749] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-07T20:54:12.739458] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T20:54:13.447734] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-07T20:54:14.247705] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-07T20:54:14.259604] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-07T20:54:14.521261] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T20:54:15.047692] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-07T20:54:15.195814] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T20:54:15.847698] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-07T20:54:16.629838] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-07T20:54:16.647594] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-07T20:54:17.282537] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-07T20:54:17.447634] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-07T20:54:17.525228] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T20:54:18.247716] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-07T20:54:19.047616] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-07T20:54:19.102952] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T20:54:19.128780] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T20:54:19.847671] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-07T20:54:20.647680] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-07T20:54:21.168332] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T20:54:21.395791] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-07T20:54:21.447698] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-07T20:54:21.884725] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-07T20:54:22.247673] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-07T20:54:23.047664] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-07T20:54:23.270894] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T20:54:23.665810] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:54:23.666704] [INFO ] [REMOTE ] PFH: Full fetch complete (10259 records). [2025-10-07T20:54:23.666807] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-07T20:54:23.667225] [FATAL] [VALIDATOR ] PFH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:54:23.667312] [FATAL] [MAIN ] PFH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:54:23.667365] [WARN ] [MAIN ] PFH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:54:23.667448] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-07T20:54:23.667545] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-07T20:54:23.667598] [INFO ] [LOCAL ] PFH: Starting deletion of derivative data. [2025-10-07T20:54:23.667823] [DEBUG] [LOCAL ] PFH: Deleted derivative data file. [2025-10-07T20:54:23.667943] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFH took 24.3s. Estimated remaining: 1h 39m 22s. Rate: 7.1 symbols/min [2025-10-07T20:54:23.837602] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:54:23.849242] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-07T20:54:23.859925] [DEBUG] [LOCAL ] PFN: Loaded 21981 existing records from primary storage. [2025-10-07T20:54:23.860181] [INFO ] [MAIN ] PFN: Loaded 21981 existing records. [2025-10-07T20:54:24.039701] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:54:24.039915] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-07T20:54:24.039963] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-07T20:54:24.040190] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-07T20:54:24.040247] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-07T20:54:24.413572] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:54:24.647628] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-07T20:54:24.927827] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-07T20:54:25.416578] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T20:54:25.447603] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-07T20:54:25.557076] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T20:54:26.247682] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-07T20:54:27.047629] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-07T20:54:27.219542] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T20:54:27.423058] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T20:54:27.847607] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-07T20:54:28.234565] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T20:54:28.647699] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-07T20:54:29.447688] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-07T20:54:30.258259] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-07T20:54:30.260117] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T20:54:30.382978] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-07T20:54:30.647417] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T20:54:30.876612] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T20:54:31.047703] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-07T20:54:31.847687] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-07T20:54:32.647632] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-07T20:54:32.748973] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T20:54:32.866205] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T20:54:33.330800] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:54:33.333981] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-10-07T20:54:33.334104] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-07T20:54:33.334980] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:54:33.335073] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:54:33.335116] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:54:33.335237] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-07T20:54:33.335328] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-07T20:54:33.335384] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-07T20:54:33.335427] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-07T20:54:33.335486] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFE took 57.8s. Estimated remaining: 1h 39m 14s. Rate: 7.1 symbols/min [2025-10-07T20:54:33.452741] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-07T20:54:33.513244] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:54:33.521668] [DEBUG] [LOCAL ] PFO: Loaded 6020 existing records from primary storage. [2025-10-07T20:54:33.521910] [INFO ] [MAIN ] PFO: Loaded 6020 existing records. [2025-10-07T20:54:33.705916] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:54:33.706162] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-07T20:54:33.706210] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-07T20:54:33.706373] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-07T20:54:33.706441] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-07T20:54:34.056466] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:54:34.247688] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-07T20:54:34.421568] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T20:54:35.047688] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-07T20:54:35.847699] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-07T20:54:36.121822] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T20:54:36.203579] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T20:54:36.647715] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-07T20:54:36.923342] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T20:54:37.447616] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-07T20:54:37.838975] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T20:54:38.148588] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T20:54:38.247730] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-07T20:54:39.047706] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-07T20:54:39.847624] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-07T20:54:40.035247] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T20:54:40.349549] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T20:54:40.647633] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-07T20:54:40.727921] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T20:54:41.238948] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T20:54:41.243258] [INFO ] [REMOTE ] PFLT: Full fetch complete (63516 records). [2025-10-07T20:54:41.243410] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-07T20:54:41.244306] [FATAL] [VALIDATOR ] PFLT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:54:41.244413] [FATAL] [MAIN ] PFLT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:54:41.244522] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:54:41.244618] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-07T20:54:41.244749] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-07T20:54:41.244836] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-07T20:54:41.245063] [DEBUG] [LOCAL ] PFLT: Deleted derivative data file. [2025-10-07T20:54:41.245206] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFLT took 31.0s. Estimated remaining: 1h 39m 5s. Rate: 7.1 symbols/min [2025-10-07T20:54:41.421637] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:54:41.454821] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-07T20:54:41.457482] [DEBUG] [LOCAL ] PFS: Loaded 35572 existing records from primary storage. [2025-10-07T20:54:41.457782] [INFO ] [MAIN ] PFS: Loaded 35572 existing records. [2025-10-07T20:54:41.633867] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:54:41.634095] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-07T20:54:41.634143] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-07T20:54:41.634379] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-10-07T20:54:41.634437] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-07T20:54:41.982065] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:54:42.247634] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-07T20:54:42.711397] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T20:54:43.047758] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-07T20:54:43.765796] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T20:54:43.802156] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T20:54:43.847600] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-07T20:54:44.647731] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-07T20:54:45.358688] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-07T20:54:45.413638] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T20:54:45.447633] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-07T20:54:46.247715] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-07T20:54:47.016222] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T20:54:47.047664] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-07T20:54:47.402387] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T20:54:47.847676] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-07T20:54:48.591750] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T20:54:48.647119] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T20:54:48.648415] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-07T20:54:49.447705] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-07T20:54:49.825007] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T20:54:50.247695] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-07T20:54:51.047633] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-07T20:54:51.112253] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T20:54:51.494126] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T20:54:51.576272] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-07T20:54:51.847705] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-07T20:54:52.647676] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-07T20:54:53.015393] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-07T20:54:53.354052] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T20:54:53.355846] [INFO ] [REMOTE ] PFL: Full fetch complete (20271 records). [2025-10-07T20:54:53.355936] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-07T20:54:53.452903] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-07T20:54:53.763856] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-07T20:54:53.763936] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-07T20:54:53.764489] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-07T20:54:53.764551] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-07T20:54:53.765154] [DEBUG] [LOCAL ] PFL: Trimmed 20271 records to 13896 (keeping 200 days of data) [2025-10-07T20:54:53.850720] [DEBUG] [LOCAL ] PFL: Primary data saved (13896 records). [2025-10-07T20:54:53.850865] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-07T20:54:53.850963] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFL took 44.8s. Estimated remaining: 1h 38m 58s. Rate: 7.1 symbols/min [2025-10-07T20:54:54.016542] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:54:54.047307] [DEBUG] [LOCAL ] PFSI: Loaded 28803 existing records from primary storage. [2025-10-07T20:54:54.047594] [INFO ] [MAIN ] PFSI: Loaded 28803 existing records. [2025-10-07T20:54:54.220761] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:54:54.220987] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-07T20:54:54.221034] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-07T20:54:54.221266] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-07T20:54:54.221323] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-07T20:54:54.251708] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-07T20:54:54.583402] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T20:54:54.587108] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:54:54.589862] [INFO ] [REMOTE ] PFN: Full fetch complete (31087 records). [2025-10-07T20:54:54.589949] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-07T20:54:54.949600] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-07T20:54:54.949704] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-07T20:54:54.950336] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-07T20:54:54.950379] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-07T20:54:54.951148] [DEBUG] [LOCAL ] PFN: Trimmed 31087 records to 22048 (keeping 200 days of data) [2025-10-07T20:54:55.048382] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-07T20:54:55.068881] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T20:54:55.092576] [DEBUG] [LOCAL ] PFN: Primary data saved (22048 records). [2025-10-07T20:54:55.092704] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-07T20:54:55.092791] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFN took 31.4s. Estimated remaining: 1h 38m 47s. Rate: 7.1 symbols/min [2025-10-07T20:54:55.257040] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:54:55.257184] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-07T20:54:55.257236] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-07T20:54:55.257345] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-07T20:54:55.257387] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-07T20:54:55.257428] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-07T20:54:55.257460] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-07T20:54:55.599490] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:54:55.847609] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-07T20:54:56.647683] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-07T20:54:56.933012] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T20:54:57.044937] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T20:54:57.271371] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T20:54:57.447618] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-07T20:54:58.247733] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-07T20:54:58.719748] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T20:54:59.047707] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-07T20:54:59.764608] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T20:54:59.847700] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-07T20:55:00.267395] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-07T20:55:00.647753] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-07T20:55:01.258730] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T20:55:01.309272] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-07T20:55:01.447742] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-07T20:55:02.247700] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-07T20:55:02.900118] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T20:55:03.047615] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-07T20:55:03.847763] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-07T20:55:04.623064] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-07T20:55:04.655166] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-07T20:55:04.662090] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T20:55:04.804169] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T20:55:05.447717] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-07T20:55:06.247634] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-07T20:55:06.314230] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T20:55:07.047625] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-07T20:55:07.333944] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T20:55:07.847678] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-07T20:55:08.391391] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T20:55:08.647728] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-07T20:55:08.716030] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-07T20:55:08.969026] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T20:55:09.447681] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-07T20:55:09.899552] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T20:55:10.139297] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T20:55:10.140230] [INFO ] [REMOTE ] PFO: Full fetch complete (7910 records). [2025-10-07T20:55:10.140300] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-07T20:55:10.252775] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-07T20:55:10.492758] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-07T20:55:10.492837] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-07T20:55:10.493040] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-07T20:55:10.493079] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-07T20:55:10.493482] [DEBUG] [LOCAL ] PFO: Trimmed 7910 records to 6045 (keeping 200 days of data) [2025-10-07T20:55:10.528811] [DEBUG] [LOCAL ] PFO: Primary data saved (6045 records). [2025-10-07T20:55:10.528921] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-07T20:55:10.528999] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFO took 37.2s. Estimated remaining: 1h 38m 41s. Rate: 7.1 symbols/min [2025-10-07T20:55:10.697679] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:55:10.705571] [DEBUG] [LOCAL ] PGP: Loaded 5591 existing records from primary storage. [2025-10-07T20:55:10.705811] [INFO ] [MAIN ] PGP: Loaded 5591 existing records. [2025-10-07T20:55:10.877886] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:55:10.878097] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-07T20:55:10.878145] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-07T20:55:10.878314] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-07T20:55:10.878370] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-07T20:55:11.047631] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-07T20:55:11.225149] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:55:11.847689] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-07T20:55:11.898880] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T20:55:12.647611] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-07T20:55:12.728734] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T20:55:13.427375] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T20:55:13.429965] [INFO ] [REMOTE ] PFS: Full fetch complete (51508 records). [2025-10-07T20:55:13.430092] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-07T20:55:13.430985] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:55:13.431084] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:55:13.431185] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:55:13.431280] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-07T20:55:13.431378] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-07T20:55:13.431434] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-07T20:55:13.432274] [DEBUG] [LOCAL ] PFS: Deleted derivative data file. [2025-10-07T20:55:13.432409] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFS took 32.2s. Estimated remaining: 1h 38m 30s. Rate: 7.1 symbols/min [2025-10-07T20:55:13.453422] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-07T20:55:13.606082] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:55:13.606306] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-07T20:55:13.606362] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-07T20:55:13.606505] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-07T20:55:13.606568] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-07T20:55:13.606618] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-07T20:55:13.606698] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-07T20:55:13.961091] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:55:14.103599] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-07T20:55:14.130567] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T20:55:14.247602] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-07T20:55:15.047754] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-07T20:55:15.668903] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T20:55:15.847612] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-07T20:55:16.647620] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-07T20:55:16.772851] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T20:55:17.339862] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T20:55:17.447622] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-07T20:55:18.045720] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T20:55:18.047789] [INFO ] [REMOTE ] PFSI: Full fetch complete (41020 records). [2025-10-07T20:55:18.047868] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-07T20:55:18.048413] [FATAL] [VALIDATOR ] PFSI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:55:18.048501] [FATAL] [MAIN ] PFSI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:55:18.048545] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:55:18.048585] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-07T20:55:18.048662] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-07T20:55:18.048720] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-07T20:55:18.048889] [DEBUG] [LOCAL ] PFSI: Deleted derivative data file. [2025-10-07T20:55:18.048978] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFSI took 24.2s. Estimated remaining: 1h 38m 20s. Rate: 7.1 symbols/min [2025-10-07T20:55:18.213403] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:55:18.253043] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-07T20:55:18.255733] [DEBUG] [LOCAL ] PGRE: Loaded 46751 existing records from primary storage. [2025-10-07T20:55:18.255991] [INFO ] [MAIN ] PGRE: Loaded 46751 existing records. [2025-10-07T20:55:18.431386] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:55:18.431565] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-07T20:55:18.431612] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-07T20:55:18.431912] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-07T20:55:18.431968] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-07T20:55:18.791183] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:55:18.917936] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-07T20:55:19.047625] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-07T20:55:19.847697] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-07T20:55:20.352279] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T20:55:20.647673] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-07T20:55:21.256150] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-07T20:55:21.395192] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T20:55:21.447597] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-07T20:55:22.247630] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-07T20:55:22.285520] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T20:55:22.523151] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T20:55:23.000255] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T20:55:23.047679] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-07T20:55:23.847688] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-07T20:55:24.647690] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-07T20:55:25.325406] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-07T20:55:25.358477] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T20:55:25.369813] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T20:55:25.447599] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-07T20:55:26.247741] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-07T20:55:26.895094] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T20:55:27.052835] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-07T20:55:27.073325] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T20:55:27.847701] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-07T20:55:27.938574] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T20:55:28.647699] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-07T20:55:29.447629] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-07T20:55:29.496864] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T20:55:29.532155] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T20:55:30.247683] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-07T20:55:31.047754] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-07T20:55:31.847630] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-07T20:55:31.890993] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-07T20:55:31.957109] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T20:55:32.533798] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T20:55:32.647755] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-07T20:55:32.712855] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T20:55:33.447629] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-07T20:55:33.492984] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T20:55:34.247694] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-07T20:55:34.996460] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T20:55:35.047696] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-07T20:55:35.764050] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-07T20:55:35.780437] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T20:55:35.847707] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-07T20:55:36.647729] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-07T20:55:37.311841] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:55:37.312966] [INFO ] [REMOTE ] PGP: Full fetch complete (7931 records). [2025-10-07T20:55:37.313055] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-07T20:55:37.460015] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-07T20:55:37.687316] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-07T20:55:37.687435] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-07T20:55:37.687757] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-07T20:55:37.687821] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-07T20:55:37.688235] [DEBUG] [LOCAL ] PGP: Trimmed 7931 records to 5630 (keeping 200 days of data) [2025-10-07T20:55:37.724039] [DEBUG] [LOCAL ] PGP: Primary data saved (5630 records). [2025-10-07T20:55:37.724136] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-07T20:55:37.724216] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PGP took 27.2s. Estimated remaining: 1h 38m 17s. Rate: 7.1 symbols/min [2025-10-07T20:55:37.898394] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:55:37.909070] [DEBUG] [LOCAL ] PGZ: Loaded 5468 existing records from primary storage. [2025-10-07T20:55:37.909282] [INFO ] [MAIN ] PGZ: Loaded 5468 existing records. [2025-10-07T20:55:38.090751] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:55:38.091009] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-07T20:55:38.091079] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-07T20:55:38.091493] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-07T20:55:38.091677] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-07T20:55:38.232077] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-07T20:55:38.249392] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-07T20:55:38.499496] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:55:38.904672] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T20:55:39.047677] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-07T20:55:39.847693] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-07T20:55:39.984430] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T20:55:40.655516] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-07T20:55:40.661675] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-07T20:55:41.447638] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-07T20:55:41.495359] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-07T20:55:41.864921] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-07T20:55:42.247703] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-07T20:55:42.915700] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T20:55:43.047636] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-07T20:55:43.204275] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T20:55:43.386071] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-07T20:55:43.389241] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-10-07T20:55:43.389358] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-07T20:55:43.390168] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:55:43.390257] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:55:43.390300] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:55:43.390391] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-07T20:55:43.390473] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-07T20:55:43.390510] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-07T20:55:43.390551] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-07T20:55:43.390609] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PG took 48.3s. Estimated remaining: 1h 38m 7s. Rate: 7.1 symbols/min [2025-10-07T20:55:43.575944] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:55:43.576087] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-07T20:55:43.576125] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-07T20:55:43.576235] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-07T20:55:43.576278] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-07T20:55:43.576320] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-07T20:55:43.576354] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-07T20:55:43.852967] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-07T20:55:43.986999] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:55:44.594839] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T20:55:44.647703] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-07T20:55:45.447738] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-07T20:55:46.143681] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T20:55:46.247690] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-07T20:55:46.487995] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T20:55:47.047700] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-07T20:55:47.847734] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-07T20:55:47.881277] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T20:55:48.641701] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T20:55:48.647676] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-07T20:55:48.936994] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T20:55:49.104659] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-07T20:55:49.447699] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-07T20:55:50.247720] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-07T20:55:51.047726] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-07T20:55:51.628747] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-07T20:55:51.746093] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-07T20:55:51.847622] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-07T20:55:51.941110] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T20:55:52.647622] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-07T20:55:53.447671] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-07T20:55:53.563338] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T20:55:54.247708] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-07T20:55:54.408910] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T20:55:54.996928] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T20:55:55.000030] [INFO ] [REMOTE ] PGRE: Full fetch complete (63812 records). [2025-10-07T20:55:55.000169] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-07T20:55:55.001206] [FATAL] [VALIDATOR ] PGRE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:55:55.001326] [FATAL] [MAIN ] PGRE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:55:55.001410] [WARN ] [MAIN ] PGRE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:55:55.001501] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-07T20:55:55.001585] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-07T20:55:55.001691] [INFO ] [LOCAL ] PGRE: Starting deletion of derivative data. [2025-10-07T20:55:55.001948] [DEBUG] [LOCAL ] PGRE: Deleted derivative data file. [2025-10-07T20:55:55.002084] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PGRE took 37.0s. Estimated remaining: 1h 37m 60s. Rate: 7.1 symbols/min [2025-10-07T20:55:55.052787] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-07T20:55:55.188117] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:55:55.200942] [DEBUG] [LOCAL ] PHD: Loaded 10767 existing records from primary storage. [2025-10-07T20:55:55.201180] [INFO ] [MAIN ] PHD: Loaded 10767 existing records. [2025-10-07T20:55:55.389895] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T20:55:55.409955] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:55:55.421002] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-10-07T20:55:55.421094] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-07T20:55:55.421532] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-10-07T20:55:55.421592] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-10-07T20:55:55.780783] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:55:55.847603] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-10-07T20:55:55.865984] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T20:55:56.647619] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-07T20:55:56.703291] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T20:55:57.447741] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-07T20:55:58.247722] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-07T20:55:58.448973] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T20:55:58.451310] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T20:55:59.047672] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-07T20:55:59.715906] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T20:55:59.716927] [INFO ] [REMOTE ] PGZ: Full fetch complete (8943 records). [2025-10-07T20:55:59.717003] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-07T20:55:59.858952] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-10-07T20:56:00.086521] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-07T20:56:00.086694] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-07T20:56:00.087068] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-07T20:56:00.087146] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-07T20:56:00.087898] [DEBUG] [LOCAL ] PGZ: Trimmed 8943 records to 5481 (keeping 200 days of data) [2025-10-07T20:56:00.121034] [DEBUG] [LOCAL ] PGZ: Primary data saved (5481 records). [2025-10-07T20:56:00.121115] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-07T20:56:00.121191] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 22.4s. Estimated remaining: 1h 37m 50s. Rate: 7.1 symbols/min [2025-10-07T20:56:00.292182] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:56:00.323392] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-07T20:56:00.379996] [DEBUG] [LOCAL ] PHG: Loaded 45936 existing records from primary storage. [2025-10-07T20:56:00.380376] [INFO ] [MAIN ] PHG: Loaded 45936 existing records. [2025-10-07T20:56:00.557406] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:56:00.557636] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-07T20:56:00.557721] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-07T20:56:00.557975] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-07T20:56:00.558033] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-07T20:56:00.653237] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-07T20:56:00.854271] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T20:56:00.928662] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:56:01.414937] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T20:56:01.418248] [INFO ] [REMOTE ] PGR: Full fetch complete (76147 records). [2025-10-07T20:56:01.418381] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-07T20:56:01.420671] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:56:01.420766] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:56:01.420813] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:56:01.420854] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-07T20:56:01.420914] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-07T20:56:01.420951] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-07T20:56:01.420993] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-07T20:56:01.421056] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGR took 48.0s. Estimated remaining: 1h 37m 39s. Rate: 7.1 symbols/min [2025-10-07T20:56:01.447633] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-07T20:56:02.247752] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-07T20:56:03.047688] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-10-07T20:56:03.352851] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-07T20:56:03.672770] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T20:56:03.847676] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-07T20:56:03.908674] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T20:56:04.647716] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-10-07T20:56:05.447668] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-07T20:56:05.522779] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T20:56:05.583600] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T20:56:06.247693] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-07T20:56:07.047626] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-10-07T20:56:07.103751] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T20:56:07.847684] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-07T20:56:08.090105] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T20:56:08.106863] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T20:56:08.647717] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-07T20:56:09.266176] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T20:56:09.447675] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-07T20:56:10.247630] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-10-07T20:56:10.464391] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T20:56:10.952866] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T20:56:11.047610] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-07T20:56:11.098211] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T20:56:11.847687] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-07T20:56:12.647634] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-10-07T20:56:12.745335] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T20:56:13.447627] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-07T20:56:13.464662] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T20:56:13.653794] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T20:56:14.247683] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-10-07T20:56:14.669017] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T20:56:15.047624] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-07T20:56:15.230134] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-07T20:56:15.472719] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-07T20:56:15.474633] [INFO ] [REMOTE ] PH: Full fetch complete (55785 records). [2025-10-07T20:56:15.474746] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-07T20:56:15.475567] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:56:15.475699] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:56:15.475785] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:56:15.475899] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-07T20:56:15.475989] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-07T20:56:15.476027] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-07T20:56:15.476129] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-07T20:56:15.476217] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PH took 32.1s. Estimated remaining: 1h 37m 33s. Rate: 7.1 symbols/min [2025-10-07T20:56:15.847637] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-07T20:56:16.647684] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-10-07T20:56:17.645310] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T20:56:17.656167] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-07T20:56:17.671328] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T20:56:18.247762] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-10-07T20:56:19.036858] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T20:56:19.057271] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-07T20:56:19.059020] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T20:56:19.847638] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-10. [2025-10-07T20:56:20.560153] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T20:56:20.647604] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-07T20:56:20.753732] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T20:56:20.755675] [INFO ] [REMOTE ] PHD: Full fetch complete (14994 records). [2025-10-07T20:56:20.755752] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-10-07T20:56:21.118497] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-10-07T20:56:21.118585] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-10-07T20:56:21.118932] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-10-07T20:56:21.118995] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-10-07T20:56:21.119484] [DEBUG] [LOCAL ] PHD: Trimmed 14994 records to 10759 (keeping 200 days of data) [2025-10-07T20:56:21.185042] [DEBUG] [LOCAL ] PHD: Primary data saved (10759 records). [2025-10-07T20:56:21.185181] [INFO ] [MAIN ] PHD: Full history saved. [2025-10-07T20:56:21.185267] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PHD took 26.2s. Estimated remaining: 1h 37m 23s. Rate: 7.1 symbols/min [2025-10-07T20:56:22.353203] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T20:56:22.363731] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-07T20:56:24.101411] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T20:56:24.111688] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-07T20:56:24.719035] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T20:56:24.721804] [INFO ] [REMOTE ] PHG: Full fetch complete (65352 records). [2025-10-07T20:56:24.721944] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-07T20:56:24.722992] [FATAL] [VALIDATOR ] PHG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:56:24.723104] [FATAL] [MAIN ] PHG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:56:24.723179] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:56:24.723266] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-07T20:56:24.723354] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-07T20:56:24.723425] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-07T20:56:24.723621] [DEBUG] [LOCAL ] PHG: Deleted derivative data file. [2025-10-07T20:56:24.723774] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHG took 24.6s. Estimated remaining: 1h 37m 13s. Rate: 7.1 symbols/min [2025-10-07T20:56:25.337944] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:56:25.331318] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:56:25.446949] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:56:25.465598] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-07T20:56:25.469971] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:56:25.470328] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-07T20:56:25.471097] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-07T20:56:25.471197] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-07T20:56:25.471357] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-07T20:56:25.471423] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-07T20:56:25.601291] [DEBUG] [LOCAL ] PHI: Loaded 15090 existing records from primary storage. [2025-10-07T20:56:25.601773] [INFO ] [MAIN ] PHI: Loaded 15090 existing records. [2025-10-07T20:56:25.793934] [DEBUG] [LOCAL ] PHK: Loaded 26508 existing records from primary storage. [2025-10-07T20:56:25.841851] [INFO ] [MAIN ] PHK: Loaded 26508 existing records. [2025-10-07T20:56:25.865904] [DEBUG] [LOCAL ] PHIN: Loaded 32374 existing records from primary storage. [2025-10-07T20:56:25.983140] [INFO ] [MAIN ] PHIN: Loaded 32374 existing records. [2025-10-07T20:56:26.109327] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:56:26.154048] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-07T20:56:26.220224] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-07T20:56:26.311633] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:56:26.314902] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-07T20:56:26.314446] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-07T20:56:26.380008] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-07T20:56:26.483569] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:56:26.505332] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:56:26.538898] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-07T20:56:26.544209] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-07T20:56:26.550517] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-07T20:56:26.544332] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-07T20:56:26.566357] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-10-07T20:56:26.573863] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-07T20:56:26.574063] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-07T20:56:26.573944] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-07T20:56:27.386812] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:56:27.403195] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-07T20:56:27.545586] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:56:27.572196] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-07T20:56:27.575872] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:56:27.576988] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-07T20:56:28.418987] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T20:56:28.422999] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-07T20:56:28.453106] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-07T20:56:28.464819] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-07T20:56:29.040229] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T20:56:29.046838] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-07T20:56:29.161991] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T20:56:29.169615] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-07T20:56:29.192479] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T20:56:29.447731] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-07T20:56:30.149418] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T20:56:30.168371] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T20:56:30.247624] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-07T20:56:30.440673] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T20:56:30.657787] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T20:56:30.911617] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T20:56:31.047688] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-07T20:56:31.847687] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-07T20:56:32.563957] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T20:56:32.647615] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-07T20:56:33.167897] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T20:56:33.447629] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-07T20:56:34.247631] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-07T20:56:34.280517] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T20:56:34.750898] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T20:56:35.047743] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-07T20:56:35.847623] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-07T20:56:36.015124] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T20:56:36.168988] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T20:56:36.647714] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-07T20:56:37.063972] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T20:56:37.447687] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-07T20:56:37.645144] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T20:56:38.247694] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-07T20:56:39.047708] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-07T20:56:39.119072] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T20:56:39.368527] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T20:56:39.847737] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-07T20:56:40.648326] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-07T20:56:40.650534] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T20:56:41.207390] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T20:56:41.447700] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-07T20:56:42.247632] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-07T20:56:42.665256] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-07T20:56:42.880201] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T20:56:43.047684] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-07T20:56:43.294802] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T20:56:43.847697] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-07T20:56:44.647701] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-07T20:56:45.030390] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T20:56:45.033527] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T20:56:45.447729] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-07T20:56:45.684848] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T20:56:46.247717] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-07T20:56:46.876011] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T20:56:47.047770] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-07T20:56:47.658278] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T20:56:47.847699] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-07T20:56:48.137467] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-07T20:56:48.647724] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-07T20:56:49.447767] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-07T20:56:49.711262] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T20:56:49.757082] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T20:56:50.247743] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-07T20:56:50.945504] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T20:56:51.047626] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-07T20:56:51.630165] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T20:56:51.847682] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-07T20:56:52.592400] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T20:56:52.647605] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-07T20:56:53.225093] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T20:56:53.227170] [INFO ] [REMOTE ] PHIN: Full fetch complete (47758 records). [2025-10-07T20:56:53.227263] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-07T20:56:53.228065] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:56:53.228162] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:56:53.228261] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:56:53.228336] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-07T20:56:53.228423] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-07T20:56:53.228480] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-07T20:56:53.228730] [DEBUG] [LOCAL ] PHIN: Deleted derivative data file. [2025-10-07T20:56:53.228825] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHIN took 28.4s. Estimated remaining: 1h 37m 12s. Rate: 7.1 symbols/min [2025-10-07T20:56:53.400389] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:56:53.439399] [DEBUG] [LOCAL ] PHR: Loaded 37515 existing records from primary storage. [2025-10-07T20:56:53.439870] [INFO ] [MAIN ] PHR: Loaded 37515 existing records. [2025-10-07T20:56:53.447677] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-07T20:56:53.629999] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:56:53.630331] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-07T20:56:53.630439] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-07T20:56:53.630850] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-07T20:56:53.630907] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-07T20:56:53.828473] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T20:56:54.032535] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:56:54.247678] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-07T20:56:54.653716] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T20:56:54.656089] [INFO ] [REMOTE ] PHK: Full fetch complete (39498 records). [2025-10-07T20:56:54.656180] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-07T20:56:55.051802] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-07T20:56:55.067546] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-07T20:56:55.067636] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-07T20:56:55.068402] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-07T20:56:55.068452] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-07T20:56:55.069738] [DEBUG] [LOCAL ] PHK: Trimmed 39498 records to 26549 (keeping 200 days of data) [2025-10-07T20:56:55.227937] [DEBUG] [LOCAL ] PHK: Primary data saved (26549 records). [2025-10-07T20:56:55.228082] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-07T20:56:55.228206] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHK took 30.5s. Estimated remaining: 1h 37m 1s. Rate: 7.1 symbols/min [2025-10-07T20:56:55.395738] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:56:55.440716] [DEBUG] [LOCAL ] PII: Loaded 48885 existing records from primary storage. [2025-10-07T20:56:55.441038] [INFO ] [MAIN ] PII: Loaded 48885 existing records. [2025-10-07T20:56:55.618743] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:56:55.618984] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-07T20:56:55.619032] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-07T20:56:55.619384] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-10-07T20:56:55.619440] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-07T20:56:55.864335] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-07T20:56:56.035445] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:56:56.037235] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T20:56:56.239942] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T20:56:56.647696] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-07T20:56:57.447690] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-07T20:56:57.866133] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T20:56:58.247696] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-07T20:56:58.450269] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T20:56:58.603323] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T20:56:59.047683] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-07T20:56:59.847742] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-07T20:57:00.264976] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-07T20:57:00.326229] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:57:00.327958] [INFO ] [REMOTE ] PHI: Full fetch complete (20881 records). [2025-10-07T20:57:00.328035] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-07T20:57:00.328488] [FATAL] [VALIDATOR ] PHI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:57:00.328572] [FATAL] [MAIN ] PHI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:57:00.328615] [WARN ] [MAIN ] PHI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:57:00.328704] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-07T20:57:00.328774] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-07T20:57:00.328810] [INFO ] [LOCAL ] PHI: Starting deletion of derivative data. [2025-10-07T20:57:00.329034] [DEBUG] [LOCAL ] PHI: Deleted derivative data file. [2025-10-07T20:57:00.329132] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHI took 35.6s. Estimated remaining: 1h 36m 51s. Rate: 7.1 symbols/min [2025-10-07T20:57:00.494727] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:57:00.502721] [DEBUG] [LOCAL ] PIM: Loaded 4804 existing records from primary storage. [2025-10-07T20:57:00.502951] [INFO ] [MAIN ] PIM: Loaded 4804 existing records. [2025-10-07T20:57:00.653519] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-07T20:57:00.685854] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:57:00.686154] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-07T20:57:00.686340] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-07T20:57:00.686551] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-07T20:57:00.686607] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-07T20:57:01.044725] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:57:01.072713] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-07T20:57:01.447718] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-07T20:57:01.744387] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T20:57:02.110608] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T20:57:02.114049] [INFO ] [REMOTE ] PHM: Full fetch complete (74545 records). [2025-10-07T20:57:02.114223] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-07T20:57:02.115150] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:57:02.115258] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:57:02.115301] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:57:02.115340] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-07T20:57:02.115399] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-07T20:57:02.115434] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-07T20:57:02.115473] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-07T20:57:02.115532] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHM took 37.4s. Estimated remaining: 1h 36m 40s. Rate: 7.1 symbols/min [2025-10-07T20:57:02.259780] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-07T20:57:02.294541] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:57:02.311882] [DEBUG] [LOCAL ] PINE: Loaded 14143 existing records from primary storage. [2025-10-07T20:57:02.312208] [INFO ] [MAIN ] PINE: Loaded 14143 existing records. [2025-10-07T20:57:02.491786] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:57:02.492077] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-07T20:57:02.492127] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-07T20:57:02.492316] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-07T20:57:02.492373] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-07T20:57:02.851614] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:57:03.047686] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-07T20:57:03.847715] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-07T20:57:04.066374] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T20:57:04.149490] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T20:57:04.421018] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-07T20:57:04.647674] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-07T20:57:05.447603] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-07T20:57:05.754239] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T20:57:06.247737] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-07T20:57:06.954851] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T20:57:07.047707] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-07T20:57:07.154132] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T20:57:07.847670] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-07T20:57:08.647687] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-07T20:57:08.721021] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T20:57:09.447630] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-07T20:57:09.657096] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T20:57:09.738201] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T20:57:09.900365] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-07T20:57:10.247683] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-07T20:57:11.047687] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-07T20:57:11.801114] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T20:57:11.847694] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-07T20:57:12.185995] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T20:57:12.647693] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-07T20:57:13.447690] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-07T20:57:13.694731] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T20:57:13.804954] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T20:57:14.247632] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-07T20:57:14.997066] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T20:57:15.047686] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-07T20:57:15.238927] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T20:57:15.561962] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-07T20:57:15.847685] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-07T20:57:16.601629] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T20:57:16.647675] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-07T20:57:17.447701] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-07T20:57:18.247626] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-07T20:57:18.527425] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T20:57:18.580994] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T20:57:18.923141] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T20:57:19.047675] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-07T20:57:19.789040] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T20:57:19.847588] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-07T20:57:20.647721] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-07T20:57:21.447696] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-07T20:57:21.520588] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T20:57:21.678474] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T20:57:22.247689] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-07T20:57:22.766248] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T20:57:23.047694] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-07T20:57:23.847731] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-07T20:57:24.106000] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-07T20:57:24.521276] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-07T20:57:24.647605] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-07T20:57:24.836334] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T20:57:25.432884] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T20:57:25.447598] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-07T20:57:26.247708] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-07T20:57:26.302426] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T20:57:27.047711] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-07T20:57:27.365668] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T20:57:27.651241] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T20:57:27.654265] [INFO ] [REMOTE ] PHR: Full fetch complete (52388 records). [2025-10-07T20:57:27.654398] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-07T20:57:27.655288] [FATAL] [VALIDATOR ] PHR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:57:27.655399] [FATAL] [MAIN ] PHR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:57:27.655451] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:57:27.655523] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-07T20:57:27.655623] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-07T20:57:27.655708] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-07T20:57:27.655912] [DEBUG] [LOCAL ] PHR: Deleted derivative data file. [2025-10-07T20:57:27.656013] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PHR took 34.4s. Estimated remaining: 1h 36m 39s. Rate: 7.1 symbols/min [2025-10-07T20:57:27.842780] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:57:27.847727] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-07T20:57:27.902485] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-07T20:57:27.902988] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-10-07T20:57:28.102175] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:57:28.102496] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-07T20:57:28.102549] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-07T20:57:28.102915] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-10-07T20:57:28.102975] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-07T20:57:28.539808] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:57:28.647714] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-07T20:57:28.701978] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-07T20:57:29.447776] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-07T20:57:30.066476] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:57:30.067367] [INFO ] [REMOTE ] PIM: Full fetch complete (6500 records). [2025-10-07T20:57:30.067438] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-07T20:57:30.253477] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-07T20:57:30.428163] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-07T20:57:30.428241] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-07T20:57:30.428420] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-07T20:57:30.428458] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-07T20:57:30.428874] [DEBUG] [LOCAL ] PIM: Trimmed 6500 records to 4797 (keeping 200 days of data) [2025-10-07T20:57:30.458516] [DEBUG] [LOCAL ] PIM: Primary data saved (4797 records). [2025-10-07T20:57:30.458612] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-07T20:57:30.458718] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PIM took 30.1s. Estimated remaining: 1h 36m 28s. Rate: 7.1 symbols/min [2025-10-07T20:57:30.634832] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:57:30.655169] [DEBUG] [LOCAL ] PIPR: Loaded 14899 existing records from primary storage. [2025-10-07T20:57:30.655502] [INFO ] [MAIN ] PIPR: Loaded 14899 existing records. [2025-10-07T20:57:30.849412] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:57:30.849832] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-07T20:57:30.849957] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-07T20:57:30.850210] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-10-07T20:57:30.850339] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-07T20:57:31.027518] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-07T20:57:31.055720] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-07T20:57:31.193013] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T20:57:31.273981] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:57:31.847737] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-07T20:57:32.647672] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-07T20:57:32.711428] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T20:57:33.433441] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T20:57:33.434815] [INFO ] [REMOTE ] PINE: Full fetch complete (20983 records). [2025-10-07T20:57:33.434887] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-07T20:57:33.435331] [FATAL] [VALIDATOR ] PINE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:57:33.435414] [FATAL] [MAIN ] PINE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:57:33.435456] [WARN ] [MAIN ] PINE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:57:33.435495] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-07T20:57:33.435551] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-07T20:57:33.435585] [INFO ] [LOCAL ] PINE: Starting deletion of derivative data. [2025-10-07T20:57:33.435805] [DEBUG] [LOCAL ] PINE: Deleted derivative data file. [2025-10-07T20:57:33.435904] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PINE took 31.3s. Estimated remaining: 1h 36m 17s. Rate: 7.1 symbols/min [2025-10-07T20:57:33.456291] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-07T20:57:33.618507] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:57:33.641198] [DEBUG] [LOCAL ] PJT: Loaded 21570 existing records from primary storage. [2025-10-07T20:57:33.641458] [INFO ] [MAIN ] PJT: Loaded 21570 existing records. [2025-10-07T20:57:33.834870] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:57:33.835167] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-07T20:57:33.835287] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-07T20:57:33.835688] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-10-07T20:57:33.835751] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-07T20:57:34.163109] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-07T20:57:34.250397] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-07T20:57:34.253458] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:57:34.546210] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T20:57:35.047671] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-07T20:57:35.847617] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-07T20:57:36.147475] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-07T20:57:36.250475] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T20:57:36.647622] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-07T20:57:37.447633] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-07T20:57:37.628596] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T20:57:37.658973] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T20:57:38.247715] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-07T20:57:38.738448] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T20:57:38.797688] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T20:57:38.800777] [INFO ] [REMOTE ] PII: Full fetch complete (70846 records). [2025-10-07T20:57:38.800892] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-07T20:57:38.801789] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:57:38.801889] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:57:38.801956] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:57:38.802045] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-07T20:57:38.802128] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-07T20:57:38.802177] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-07T20:57:38.802371] [DEBUG] [LOCAL ] PII: Deleted derivative data file. [2025-10-07T20:57:38.802542] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PII took 43.6s. Estimated remaining: 1h 36m 8s. Rate: 7.1 symbols/min [2025-10-07T20:57:38.970755] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:57:39.021390] [DEBUG] [LOCAL ] PK: Loaded 52805 existing records from primary storage. [2025-10-07T20:57:39.021737] [INFO ] [MAIN ] PK: Loaded 52805 existing records. [2025-10-07T20:57:39.056596] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-07T20:57:39.207463] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:57:39.207741] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-07T20:57:39.207797] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-07T20:57:39.208281] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-10-07T20:57:39.208338] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-07T20:57:39.553186] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:57:39.847720] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-07T20:57:40.213995] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T20:57:40.647701] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-07T20:57:41.447687] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-07T20:57:41.889060] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T20:57:42.247720] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-07T20:57:42.476366] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T20:57:42.540338] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T20:57:43.047753] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-07T20:57:43.847718] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-07T20:57:44.231675] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T20:57:44.445683] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-07T20:57:44.647722] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-07T20:57:44.905378] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T20:57:45.447703] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-07T20:57:45.915850] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T20:57:46.247678] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-07T20:57:47.047631] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-07T20:57:47.316074] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-07T20:57:47.435183] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T20:57:47.847756] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-07T20:57:48.647743] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-07T20:57:48.882039] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T20:57:49.263997] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-07T20:57:49.447679] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-07T20:57:50.247738] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-07T20:57:50.474339] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T20:57:50.637809] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T20:57:51.047723] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-07T20:57:51.847638] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-07T20:57:52.015381] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T20:57:52.038187] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T20:57:52.647744] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-07T20:57:53.447638] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-07T20:57:53.594035] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T20:57:54.247779] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-07T20:57:54.555567] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T20:57:54.899711] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T20:57:54.961593] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T20:57:55.047629] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-07T20:57:55.847670] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-07T20:57:56.647707] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-07T20:57:57.447717] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-07T20:57:57.499095] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-07T20:57:57.832125] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T20:57:57.831752] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T20:57:57.846227] [INFO ] [REMOTE ] PIPR: Full fetch complete (20494 records). [2025-10-07T20:57:57.853265] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-07T20:57:57.855910] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:57:57.856084] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:57:57.856153] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:57:57.856245] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-07T20:57:57.856364] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-07T20:57:57.856440] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-07T20:57:57.857192] [DEBUG] [LOCAL ] PIPR: Deleted derivative data file. [2025-10-07T20:57:57.857345] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PIPR took 27.4s. Estimated remaining: 1h 36m 4s. Rate: 7.1 symbols/min [2025-10-07T20:57:58.071562] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T20:57:58.175587] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:57:58.200612] [DEBUG] [LOCAL ] PKE: Loaded 13242 existing records from primary storage. [2025-10-07T20:57:58.201016] [INFO ] [MAIN ] PKE: Loaded 13242 existing records. [2025-10-07T20:57:58.252826] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-07T20:57:58.404236] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:57:58.404477] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-07T20:57:58.404546] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-07T20:57:58.404814] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-07T20:57:58.404872] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-07T20:57:58.782344] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:57:59.047689] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-07T20:57:59.847688] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-07T20:58:00.130614] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T20:58:00.184001] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T20:58:00.647688] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-07T20:58:01.447702] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-07T20:58:01.936753] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-07T20:58:02.247700] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-07T20:58:02.469158] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T20:58:02.694911] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T20:58:02.753848] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T20:58:02.757094] [INFO ] [REMOTE ] PINS: Full fetch complete (77350 records). [2025-10-07T20:58:02.757214] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-07T20:58:02.758075] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:58:02.758165] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:58:02.758208] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:58:02.758303] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-07T20:58:02.758383] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-07T20:58:02.758420] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-07T20:58:02.758600] [DEBUG] [LOCAL ] PINS: Deleted derivative data file. [2025-10-07T20:58:02.758719] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PINS took 35.1s. Estimated remaining: 1h 35m 54s. Rate: 7.1 symbols/min [2025-10-07T20:58:02.924343] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:58:02.924548] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-07T20:58:02.924586] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-07T20:58:02.924722] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-07T20:58:02.924769] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-07T20:58:02.924810] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-07T20:58:02.924841] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-07T20:58:03.052759] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-07T20:58:03.303386] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:58:03.847664] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-07T20:58:04.647700] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-07T20:58:05.017056] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T20:58:05.290250] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T20:58:05.447605] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-07T20:58:06.247614] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-07T20:58:06.422673] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T20:58:06.658624] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-07T20:58:07.047689] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-07T20:58:07.358760] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T20:58:07.847676] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-07T20:58:08.647614] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-07T20:58:08.732512] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T20:58:08.938921] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T20:58:09.208266] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T20:58:09.210004] [INFO ] [REMOTE ] PJT: Full fetch complete (31911 records). [2025-10-07T20:58:09.210107] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-07T20:58:09.210683] [FATAL] [VALIDATOR ] PJT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:58:09.210774] [FATAL] [MAIN ] PJT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:58:09.210818] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:58:09.210858] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-07T20:58:09.210915] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-07T20:58:09.210951] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-07T20:58:09.211164] [DEBUG] [LOCAL ] PJT: Deleted derivative data file. [2025-10-07T20:58:09.211258] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PJT took 35.8s. Estimated remaining: 1h 35m 44s. Rate: 7.1 symbols/min [2025-10-07T20:58:09.384088] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:58:09.404421] [DEBUG] [LOCAL ] PKST: Loaded 18746 existing records from primary storage. [2025-10-07T20:58:09.404716] [INFO ] [MAIN ] PKST: Loaded 18746 existing records. [2025-10-07T20:58:09.457832] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-07T20:58:09.586041] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:58:09.586240] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-07T20:58:09.586287] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-07T20:58:09.586477] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-07T20:58:09.586534] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-07T20:58:09.968430] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:58:10.247687] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-07T20:58:11.047677] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-07T20:58:11.205599] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T20:58:11.671794] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T20:58:11.697556] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T20:58:11.847595] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-07T20:58:12.647724] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-07T20:58:13.071681] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T20:58:13.447691] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-07T20:58:14.069256] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-07T20:58:14.247637] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-07T20:58:14.551695] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T20:58:15.047691] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-07T20:58:15.847620] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-07T20:58:15.946300] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T20:58:16.118568] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T20:58:16.647739] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-07T20:58:16.903688] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-07T20:58:17.447715] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-07T20:58:17.549425] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T20:58:18.247639] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-07T20:58:18.631345] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T20:58:19.047748] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-07T20:58:19.847707] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-07T20:58:19.967635] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-07T20:58:20.152457] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T20:58:20.647621] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-07T20:58:20.668402] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T20:58:21.447711] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-07T20:58:22.247734] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-07T20:58:22.409613] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T20:58:22.964812] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T20:58:23.056325] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-07T20:58:23.071579] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T20:58:23.847615] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-07T20:58:24.099256] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T20:58:24.259965] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-07T20:58:24.263405] [INFO ] [REMOTE ] PK: Full fetch complete (76000 records). [2025-10-07T20:58:24.263553] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-07T20:58:24.264741] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:58:24.264868] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:58:24.264949] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:58:24.265064] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-07T20:58:24.265182] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-07T20:58:24.265245] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-07T20:58:24.265475] [DEBUG] [LOCAL ] PK: Deleted derivative data file. [2025-10-07T20:58:24.265605] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PK took 45.5s. Estimated remaining: 1h 35m 39s. Rate: 7.1 symbols/min [2025-10-07T20:58:24.474011] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:58:24.502923] [DEBUG] [LOCAL ] PKX: Loaded 24067 existing records from primary storage. [2025-10-07T20:58:24.503217] [INFO ] [MAIN ] PKX: Loaded 24067 existing records. [2025-10-07T20:58:24.652877] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-07T20:58:24.739388] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:58:24.739667] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-07T20:58:24.739759] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-07T20:58:24.740125] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-07T20:58:24.740187] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-07T20:58:25.086366] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:58:25.447686] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-07T20:58:25.886898] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T20:58:26.247745] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-07T20:58:26.699874] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T20:58:27.047676] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-07T20:58:27.487317] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T20:58:27.847679] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-07T20:58:28.159952] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T20:58:28.647699] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-07T20:58:29.447674] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-07T20:58:29.577043] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T20:58:29.633627] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T20:58:30.247620] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-07T20:58:30.565762] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T20:58:31.047748] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-07T20:58:31.635745] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-07T20:58:31.847666] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-07T20:58:32.647629] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-07T20:58:32.753387] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T20:58:32.809306] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T20:58:33.447693] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-07T20:58:34.216577] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T20:58:34.247605] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-07T20:58:34.685520] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T20:58:35.047635] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-07T20:58:35.721576] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T20:58:35.847673] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-07T20:58:36.643697] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T20:58:36.651829] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-07T20:58:36.663877] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T20:58:37.447681] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-07T20:58:37.926202] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T20:58:37.927743] [INFO ] [REMOTE ] PKST: Full fetch complete (29235 records). [2025-10-07T20:58:37.927815] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-07T20:58:37.928496] [FATAL] [VALIDATOR ] PKST: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:58:37.928580] [FATAL] [MAIN ] PKST: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:58:37.928623] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:58:37.928698] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-07T20:58:37.928770] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-07T20:58:37.928804] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-07T20:58:37.928979] [DEBUG] [LOCAL ] PKST: Deleted derivative data file. [2025-10-07T20:58:37.929078] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKST took 28.7s. Estimated remaining: 1h 35m 32s. Rate: 7.1 symbols/min [2025-10-07T20:58:38.135253] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:58:38.150348] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T20:58:38.217514] [DEBUG] [LOCAL ] PL: Loaded 53152 existing records from primary storage. [2025-10-07T20:58:38.217865] [INFO ] [MAIN ] PL: Loaded 53152 existing records. [2025-10-07T20:58:38.252739] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-07T20:58:38.396333] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:58:38.396553] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-07T20:58:38.396669] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-07T20:58:38.397084] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-10-07T20:58:38.397141] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-07T20:58:38.750025] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:58:38.960979] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T20:58:38.963246] [INFO ] [REMOTE ] PKG: Full fetch complete (57478 records). [2025-10-07T20:58:38.963345] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-07T20:58:38.964131] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:58:38.964228] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:58:38.964271] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:58:38.964339] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-07T20:58:38.964405] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-07T20:58:38.964441] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-07T20:58:38.964479] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-07T20:58:38.964534] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKG took 36.2s. Estimated remaining: 1h 35m 21s. Rate: 7.1 symbols/min [2025-10-07T20:58:39.052757] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-07T20:58:39.177785] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:58:39.177998] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-07T20:58:39.178057] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-07T20:58:39.178173] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-07T20:58:39.178216] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-07T20:58:39.178260] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-07T20:58:39.178294] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-07T20:58:39.574466] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:58:39.670585] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T20:58:39.672355] [INFO ] [REMOTE ] PKE: Full fetch complete (17424 records). [2025-10-07T20:58:39.672431] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-07T20:58:39.672989] [FATAL] [VALIDATOR ] PKE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:58:39.673078] [FATAL] [MAIN ] PKE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:58:39.673122] [WARN ] [MAIN ] PKE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:58:39.673164] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-07T20:58:39.673231] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-07T20:58:39.673273] [INFO ] [LOCAL ] PKE: Starting deletion of derivative data. [2025-10-07T20:58:39.673804] [DEBUG] [LOCAL ] PKE: Deleted derivative data file. [2025-10-07T20:58:39.674190] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKE took 41.8s. Estimated remaining: 1h 35m 9s. Rate: 7.1 symbols/min [2025-10-07T20:58:39.843857] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:58:39.847687] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-07T20:58:39.902759] [DEBUG] [LOCAL ] PLNT: Loaded 48202 existing records from primary storage. [2025-10-07T20:58:39.903282] [INFO ] [MAIN ] PLNT: Loaded 48202 existing records. [2025-10-07T20:58:40.094398] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:58:40.094681] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-07T20:58:40.094745] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-07T20:58:40.095896] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-10-07T20:58:40.095957] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-07T20:58:40.443252] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:58:40.647690] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-07T20:58:41.447743] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-07T20:58:41.926418] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-07T20:58:42.247632] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-07T20:58:42.318852] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T20:58:42.697217] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T20:58:43.047680] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-07T20:58:43.847670] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-07T20:58:44.384751] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T20:58:44.571344] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-07T20:58:44.647603] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-07T20:58:45.447692] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-07T20:58:45.858579] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-07T20:58:46.247675] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-07T20:58:46.810409] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-07T20:58:46.909129] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T20:58:47.047805] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-07T20:58:47.713382] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T20:58:47.847615] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-07T20:58:48.332915] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T20:58:48.647627] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-07T20:58:49.447690] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-07T20:58:50.102282] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-07T20:58:50.247778] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-07T20:58:50.541763] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T20:58:50.706970] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T20:58:51.047697] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-07T20:58:51.847706] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-07T20:58:52.499953] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-07T20:58:52.647667] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-07T20:58:52.826138] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T20:58:53.447689] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-07T20:58:53.609781] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T20:58:54.247687] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-07T20:58:54.690714] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T20:58:55.047724] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-07T20:58:55.100999] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T20:58:55.127363] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T20:58:55.847676] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-07T20:58:56.647704] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-07T20:58:57.109407] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-07T20:58:57.175144] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T20:58:57.176933] [INFO ] [REMOTE ] PKX: Full fetch complete (36477 records). [2025-10-07T20:58:57.177033] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-07T20:58:57.177705] [FATAL] [VALIDATOR ] PKX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:58:57.177794] [FATAL] [MAIN ] PKX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:58:57.177839] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:58:57.177935] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-07T20:58:57.178045] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-07T20:58:57.178118] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-07T20:58:57.178383] [DEBUG] [LOCAL ] PKX: Deleted derivative data file. [2025-10-07T20:58:57.178503] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKX took 32.9s. Estimated remaining: 1h 35m 4s. Rate: 7.1 symbols/min [2025-10-07T20:58:57.349273] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:58:57.349433] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-07T20:58:57.349471] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-07T20:58:57.349586] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-07T20:58:57.349681] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-07T20:58:57.349764] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-07T20:58:57.349830] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-07T20:58:57.449215] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-07T20:58:57.716266] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:58:57.744127] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T20:58:58.247697] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-07T20:58:59.047714] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-07T20:58:59.566908] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-07T20:58:59.847688] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-07T20:59:00.173275] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T20:59:00.283685] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-07T20:59:00.647698] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-07T20:59:01.447634] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-07T20:59:01.859312] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-07T20:59:01.910376] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T20:59:02.247728] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-07T20:59:03.047614] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-07T20:59:03.350822] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T20:59:03.405793] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T20:59:03.847731] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-07T20:59:04.647690] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-07T20:59:05.049194] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T20:59:05.072087] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-07T20:59:05.447690] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-07T20:59:06.247625] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-07T20:59:06.797308] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-07T20:59:07.047666] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-07T20:59:07.108374] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T20:59:07.847727] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-07T20:59:08.647622] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-07T20:59:08.888951] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-07T20:59:08.992123] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T20:59:09.447620] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-07T20:59:09.581477] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T20:59:09.938676] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T20:59:10.247717] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-07T20:59:10.939950] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T20:59:10.944311] [INFO ] [REMOTE ] PLNT: Full fetch complete (70073 records). [2025-10-07T20:59:10.944498] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-07T20:59:10.945513] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:59:10.945673] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:59:10.945749] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:59:10.945832] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-07T20:59:10.945942] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-07T20:59:10.946017] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-07T20:59:10.946326] [DEBUG] [LOCAL ] PLNT: Deleted derivative data file. [2025-10-07T20:59:10.946459] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PLNT took 31.3s. Estimated remaining: 1h 34m 58s. Rate: 7.1 symbols/min [2025-10-07T20:59:11.053924] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-07T20:59:11.127486] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:59:11.159941] [DEBUG] [LOCAL ] PLYM: Loaded 33649 existing records from primary storage. [2025-10-07T20:59:11.160238] [INFO ] [MAIN ] PLYM: Loaded 33649 existing records. [2025-10-07T20:59:11.344186] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:59:11.344466] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-07T20:59:11.344519] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-07T20:59:11.345358] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-07T20:59:11.345417] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-07T20:59:11.706222] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:59:11.847608] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-07T20:59:11.903807] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-07T20:59:12.376241] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-07T20:59:12.647680] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-07T20:59:13.357582] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T20:59:13.447739] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-07T20:59:13.715054] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T20:59:14.247706] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-07T20:59:14.815600] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T20:59:15.047632] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-07T20:59:15.847739] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-07T20:59:16.342515] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T20:59:16.647710] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-07T20:59:16.833757] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-07T20:59:16.880051] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T20:59:17.447632] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-07T20:59:17.840280] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-07T20:59:18.247748] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-07T20:59:19.047768] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-07T20:59:19.405489] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T20:59:19.709748] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T20:59:19.725371] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T20:59:19.728742] [INFO ] [REMOTE ] PL: Full fetch complete (76579 records). [2025-10-07T20:59:19.728875] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-07T20:59:19.729618] [FATAL] [VALIDATOR ] PL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:59:19.729730] [FATAL] [MAIN ] PL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:59:19.729772] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:59:19.729812] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-07T20:59:19.729869] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-07T20:59:19.729903] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-07T20:59:19.730073] [DEBUG] [LOCAL ] PL: Deleted derivative data file. [2025-10-07T20:59:19.730165] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PL took 41.8s. Estimated remaining: 1h 34m 50s. Rate: 7.1 symbols/min [2025-10-07T20:59:19.852764] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-07T20:59:19.901015] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:59:19.901223] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-07T20:59:19.901302] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-07T20:59:19.901418] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-07T20:59:19.901459] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-07T20:59:19.901500] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-07T20:59:19.901531] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-07T20:59:20.240773] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:59:20.647754] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-07T20:59:21.405221] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T20:59:21.447614] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-07T20:59:22.247633] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-07T20:59:22.771045] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-07T20:59:22.916355] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T20:59:22.951882] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-07T20:59:23.047683] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-07T20:59:23.847672] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-07T20:59:24.549853] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T20:59:24.647604] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-07T20:59:25.447667] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-07T20:59:25.709938] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T20:59:25.889083] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T20:59:25.893247] [INFO ] [REMOTE ] PLD: Full fetch complete (76984 records). [2025-10-07T20:59:25.893483] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-07T20:59:25.894928] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:59:25.895060] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:59:25.895112] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:59:25.895207] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-07T20:59:25.895304] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-07T20:59:25.895358] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-07T20:59:25.895413] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-07T20:59:25.895538] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLD took 46.9s. Estimated remaining: 1h 34m 40s. Rate: 7.1 symbols/min [2025-10-07T20:59:26.087006] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:59:26.110972] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T20:59:26.137037] [DEBUG] [LOCAL ] PML: Loaded 21461 existing records from primary storage. [2025-10-07T20:59:26.137357] [INFO ] [MAIN ] PML: Loaded 21461 existing records. [2025-10-07T20:59:26.252829] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-07T20:59:26.317213] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:59:26.317735] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-07T20:59:26.317823] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-07T20:59:26.318117] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-07T20:59:26.318178] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-07T20:59:26.681431] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:59:26.881395] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:59:26.882787] [INFO ] [REMOTE ] PLOW: Full fetch complete (28489 records). [2025-10-07T20:59:26.882859] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-07T20:59:26.883303] [FATAL] [VALIDATOR ] PLOW: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:59:26.883390] [FATAL] [MAIN ] PLOW: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:59:26.883433] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:59:26.883503] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-07T20:59:26.883568] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-07T20:59:26.883603] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-07T20:59:26.883668] [DEBUG] [LOCAL ] PLOW: No derivative data file found to delete. [2025-10-07T20:59:26.883770] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLOW took 29.7s. Estimated remaining: 1h 34m 29s. Rate: 7.1 symbols/min [2025-10-07T20:59:27.053013] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-07T20:59:27.052931] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:59:27.065743] [DEBUG] [LOCAL ] PMM: Loaded 10754 existing records from primary storage. [2025-10-07T20:59:27.066000] [INFO ] [MAIN ] PMM: Loaded 10754 existing records. [2025-10-07T20:59:27.243893] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:59:27.244145] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-07T20:59:27.244196] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-07T20:59:27.244556] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-07T20:59:27.244615] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-07T20:59:27.595820] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:59:27.847671] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-07T20:59:28.654745] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-07T20:59:28.659762] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T20:59:29.447622] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-07T20:59:29.536735] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T20:59:29.745726] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T20:59:30.247690] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-07T20:59:30.703450] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T20:59:31.047695] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-07T20:59:31.356281] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T20:59:31.847676] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-07T20:59:32.305312] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T20:59:32.647724] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-07T20:59:33.452879] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-07T20:59:33.465306] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T20:59:34.247618] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-07T20:59:34.561813] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T20:59:34.908126] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-07T20:59:34.960725] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T20:59:35.047599] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-07T20:59:35.847675] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-07T20:59:36.177103] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-07T20:59:36.478548] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T20:59:36.481018] [INFO ] [REMOTE ] PLYM: Full fetch complete (46896 records). [2025-10-07T20:59:36.481102] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-07T20:59:36.481724] [FATAL] [VALIDATOR ] PLYM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:59:36.481824] [FATAL] [MAIN ] PLYM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:59:36.481901] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:59:36.482000] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-07T20:59:36.482083] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-07T20:59:36.482121] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-07T20:59:36.482318] [DEBUG] [LOCAL ] PLYM: Deleted derivative data file. [2025-10-07T20:59:36.482411] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLYM took 25.5s. Estimated remaining: 1h 34m 21s. Rate: 7.1 symbols/min [2025-10-07T20:59:36.667365] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-07T20:59:36.671195] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:59:36.684850] [DEBUG] [LOCAL ] PMO: Loaded 10208 existing records from primary storage. [2025-10-07T20:59:36.685089] [INFO ] [MAIN ] PMO: Loaded 10208 existing records. [2025-10-07T20:59:36.871404] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:59:36.871713] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-07T20:59:36.871774] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-07T20:59:36.871950] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-07T20:59:36.872007] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-07T20:59:37.231104] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:59:37.447600] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-07T20:59:38.247612] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-07T20:59:38.614867] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-07T20:59:38.808907] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-07T20:59:39.047686] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-07T20:59:39.465004] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T20:59:39.847623] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-07T20:59:39.871980] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T20:59:40.647727] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-07T20:59:41.447629] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-07T20:59:41.573980] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-07T20:59:42.055310] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-07T20:59:42.162599] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T20:59:42.247750] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-07T20:59:43.047624] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-07T20:59:43.358713] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T20:59:43.847669] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-07T20:59:44.114228] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T20:59:44.647735] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-07T20:59:45.447637] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-07T20:59:45.913099] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T20:59:45.952047] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-07T20:59:46.246878] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T20:59:46.251108] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-07T20:59:47.047675] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-07T20:59:47.145770] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T20:59:47.847637] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-07T20:59:48.256299] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T20:59:48.647690] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-07T20:59:48.796447] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T20:59:49.447745] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-07T20:59:50.247698] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-07T20:59:50.608439] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T20:59:51.047697] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-07T20:59:51.083848] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-07T20:59:51.155123] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T20:59:51.847693] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-07T20:59:52.334928] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T20:59:52.647742] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-07T20:59:53.447734] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-07T20:59:53.974301] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T20:59:54.092689] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-07T20:59:54.247612] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-07T20:59:54.335907] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T20:59:55.047711] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-07T20:59:55.847694] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-07T20:59:56.012346] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T20:59:56.394273] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-07T20:59:56.647723] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-07T20:59:56.834313] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T20:59:56.836305] [INFO ] [REMOTE ] PML: Full fetch complete (29766 records). [2025-10-07T20:59:56.836380] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-07T20:59:57.219751] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-07T20:59:57.219853] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-07T20:59:57.220458] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-07T20:59:57.220499] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-07T20:59:57.221226] [DEBUG] [LOCAL ] PML: Trimmed 29766 records to 21482 (keeping 200 days of data) [2025-10-07T20:59:57.354304] [DEBUG] [LOCAL ] PML: Primary data saved (21482 records). [2025-10-07T20:59:57.354451] [INFO ] [MAIN ] PML: Full history saved. [2025-10-07T20:59:57.354559] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PML took 31.5s. Estimated remaining: 1h 34m 17s. Rate: 7.1 symbols/min [2025-10-07T20:59:57.453952] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-07T20:59:57.528357] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:59:57.545044] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T20:59:57.579898] [DEBUG] [LOCAL ] PMT: Loaded 40380 existing records from primary storage. [2025-10-07T20:59:57.580269] [INFO ] [MAIN ] PMT: Loaded 40380 existing records. [2025-10-07T20:59:57.753147] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T20:59:57.753422] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-07T20:59:57.753473] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-07T20:59:57.754487] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-10-07T20:59:57.754549] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-07T20:59:58.103226] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:59:58.202250] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T20:59:58.205554] [INFO ] [REMOTE ] PM: Full fetch complete (77318 records). [2025-10-07T20:59:58.205727] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-07T20:59:58.206679] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T20:59:58.206803] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T20:59:58.206887] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T20:59:58.206998] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-07T20:59:58.207095] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-07T20:59:58.207142] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-07T20:59:58.207217] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-07T20:59:58.207304] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PM took 38.5s. Estimated remaining: 1h 34m 6s. Rate: 7.1 symbols/min [2025-10-07T20:59:58.252796] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-07T20:59:58.379298] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T20:59:58.379457] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-07T20:59:58.379495] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-07T20:59:58.379636] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-07T20:59:58.379730] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-07T20:59:58.379808] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-07T20:59:58.379842] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-07T20:59:58.727258] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T20:59:59.047676] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-07T20:59:59.855360] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-07T20:59:59.872015] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T20:59:59.902022] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T21:00:00.647636] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-07T21:00:00.780004] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T21:00:01.157343] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-07T21:00:01.447744] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-07T21:00:02.247697] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-07T21:00:02.388256] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T21:00:03.047732] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-07T21:00:03.214509] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T21:00:03.847637] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-07T21:00:03.933119] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T21:00:03.934538] [INFO ] [REMOTE ] PMM: Full fetch complete (18090 records). [2025-10-07T21:00:03.934612] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-07T21:00:04.294974] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-07T21:00:04.295053] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-07T21:00:04.295375] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-07T21:00:04.295414] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-07T21:00:04.295947] [DEBUG] [LOCAL ] PMM: Trimmed 18090 records to 10674 (keeping 200 days of data) [2025-10-07T21:00:04.358837] [DEBUG] [LOCAL ] PMM: Primary data saved (10674 records). [2025-10-07T21:00:04.358957] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-07T21:00:04.359034] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PMM took 37.5s. Estimated remaining: 1h 33m 57s. Rate: 7.1 symbols/min [2025-10-07T21:00:04.528080] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:04.530745] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T21:00:04.530599] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-07T21:00:04.531852] [INFO ] [REMOTE ] PMO: Full fetch complete (16833 records). [2025-10-07T21:00:04.531936] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-07T21:00:04.531794] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-07T21:00:04.574231] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-07T21:00:04.599520] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-07T21:00:04.610234] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-07T21:00:04.620288] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-07T21:00:04.652804] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-07T21:00:05.241057] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-07T21:00:05.292360] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-07T21:00:05.292282] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:05.293002] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-07T21:00:05.294804] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-07T21:00:05.295362] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T21:00:05.296735] [DEBUG] [LOCAL ] PMO: Trimmed 16833 records to 10089 (keeping 200 days of data) [2025-10-07T21:00:05.356312] [DEBUG] [LOCAL ] PMO: Primary data saved (10089 records). [2025-10-07T21:00:05.356423] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-07T21:00:05.356499] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PMO took 28.9s. Estimated remaining: 1h 33m 45s. Rate: 7.1 symbols/min [2025-10-07T21:00:05.452704] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-07T21:00:05.523513] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:05.523661] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-07T21:00:05.523718] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-07T21:00:05.523824] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-07T21:00:05.523865] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-07T21:00:05.523906] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-07T21:00:05.523937] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-07T21:00:05.868411] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:05.915296] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:00:05.915555] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-07T21:00:05.915665] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:00:05.915726] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-07T21:00:05.915787] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:00:05.915859] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-07T21:00:05.915925] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-07T21:00:05.915961] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-07T21:00:05.916000] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-07T21:00:05.916046] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMTV took 1.6s. Estimated remaining: 1h 33m 34s. Rate: 7.1 symbols/min [2025-10-07T21:00:06.081956] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:06.082212] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-07T21:00:06.082268] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-07T21:00:06.082387] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-07T21:00:06.082430] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-07T21:00:06.082470] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-07T21:00:06.082502] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-07T21:00:06.254668] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-07T21:00:06.436100] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:06.885195] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T21:00:07.047627] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-07T21:00:07.847695] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-07T21:00:08.263458] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:00:08.263796] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-07T21:00:08.263885] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:00:08.263931] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-07T21:00:08.263991] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:00:08.264062] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-07T21:00:08.264128] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-07T21:00:08.264165] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-07T21:00:08.264207] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-07T21:00:08.264254] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMTW took 2.9s. Estimated remaining: 1h 33m 23s. Rate: 7.1 symbols/min [2025-10-07T21:00:08.429967] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:08.438198] [DEBUG] [LOCAL ] PNI: Loaded 6790 existing records from primary storage. [2025-10-07T21:00:08.438398] [INFO ] [MAIN ] PNI: Loaded 6790 existing records. [2025-10-07T21:00:08.613686] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:00:08.613956] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-07T21:00:08.614067] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-07T21:00:08.614415] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-07T21:00:08.614473] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-07T21:00:08.655272] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-07T21:00:08.975713] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:08.996314] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T21:00:09.158690] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-07T21:00:09.447687] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-07T21:00:10.247671] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-07T21:00:11.047635] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-07T21:00:11.111804] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T21:00:11.622613] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T21:00:11.847683] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-07T21:00:12.156113] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T21:00:12.647629] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-07T21:00:13.133146] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-07T21:00:13.298085] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T21:00:13.447738] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-07T21:00:14.247621] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-07T21:00:14.313427] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T21:00:15.047715] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-07T21:00:15.537162] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T21:00:15.847678] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-07T21:00:16.099108] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T21:00:16.340352] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-07T21:00:16.647710] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-07T21:00:17.090729] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T21:00:17.447710] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-07T21:00:18.247706] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-07T21:00:18.980464] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T21:00:19.047702] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-07T21:00:19.847872] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-07T21:00:20.178081] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T21:00:20.266365] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-07T21:00:20.609482] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:00:20.647614] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-07T21:00:21.447668] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-07T21:00:22.221916] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T21:00:22.247709] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-07T21:00:22.426028] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T21:00:23.047675] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-07T21:00:23.847681] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-07T21:00:24.094637] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T21:00:24.127474] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-07T21:00:24.128435] [INFO ] [REMOTE ] PMTU: Full fetch complete (1210 records). [2025-10-07T21:00:24.128612] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-07T21:00:24.129396] [FATAL] [VALIDATOR ] PMTU: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:00:24.129610] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:00:24.129733] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:00:24.129857] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-07T21:00:24.130055] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-07T21:00:24.130121] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-07T21:00:24.130185] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-07T21:00:24.130268] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMTU took 25.9s. Estimated remaining: 1h 33m 17s. Rate: 7.1 symbols/min [2025-10-07T21:00:24.315451] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:24.347030] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-07T21:00:24.384103] [DEBUG] [LOCAL ] PNNT: Loaded 32938 existing records from primary storage. [2025-10-07T21:00:24.384414] [INFO ] [MAIN ] PNNT: Loaded 32938 existing records. [2025-10-07T21:00:24.572957] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:00:24.573247] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-07T21:00:24.573350] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-07T21:00:24.574279] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-07T21:00:24.574350] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-07T21:00:24.652767] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-07T21:00:24.931984] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:25.447699] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-07T21:00:26.147180] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T21:00:26.247622] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-07T21:00:27.036418] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T21:00:27.047588] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-07T21:00:27.091152] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T21:00:27.847636] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-07T21:00:27.970263] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T21:00:28.647681] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-07T21:00:29.447628] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-07T21:00:29.481088] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T21:00:30.247724] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-07T21:00:30.738374] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-07T21:00:31.021070] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T21:00:31.047600] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-07T21:00:31.739782] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T21:00:31.752782] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T21:00:31.756113] [INFO ] [REMOTE ] PMT: Full fetch complete (58252 records). [2025-10-07T21:00:31.756234] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-07T21:00:31.756959] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:00:31.757064] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:00:31.757144] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:00:31.757239] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-07T21:00:31.757367] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-07T21:00:31.757439] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-07T21:00:31.757743] [DEBUG] [LOCAL ] PMT: Deleted derivative data file. [2025-10-07T21:00:31.757866] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMT took 34.4s. Estimated remaining: 1h 33m 9s. Rate: 7.1 symbols/min [2025-10-07T21:00:31.852751] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-07T21:00:31.935399] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:31.935602] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-07T21:00:31.935684] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-07T21:00:31.935832] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-07T21:00:31.935902] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-07T21:00:31.935957] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-07T21:00:31.936064] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-07T21:00:32.294872] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:32.647701] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-07T21:00:33.447713] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-07T21:00:33.923006] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-07T21:00:34.222811] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T21:00:34.247694] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-07T21:00:34.429130] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:00:35.038071] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T21:00:35.047683] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-07T21:00:35.847670] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-07T21:00:36.647686] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-07T21:00:37.054324] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T21:00:37.210815] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-07T21:00:37.383719] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T21:00:37.447699] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-07T21:00:38.247707] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-07T21:00:38.384847] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T21:00:39.047684] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-07T21:00:39.847632] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-07T21:00:39.904454] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T21:00:40.026139] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T21:00:40.647742] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-07T21:00:41.447726] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-07T21:00:41.566132] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T21:00:42.083567] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T21:00:42.084426] [INFO ] [REMOTE ] PNI: Full fetch complete (9723 records). [2025-10-07T21:00:42.084495] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-07T21:00:42.256511] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-07T21:00:42.451876] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-07T21:00:42.452102] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-07T21:00:42.452398] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-07T21:00:42.452472] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-07T21:00:42.453188] [DEBUG] [LOCAL ] PNI: Trimmed 9723 records to 6798 (keeping 200 days of data) [2025-10-07T21:00:42.512596] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T21:00:42.535395] [DEBUG] [LOCAL ] PNI: Primary data saved (6798 records). [2025-10-07T21:00:42.535503] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-07T21:00:42.535580] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNI took 34.3s. Estimated remaining: 1h 33m 1s. Rate: 7.1 symbols/min [2025-10-07T21:00:42.713733] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:42.713945] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-07T21:00:42.714003] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-07T21:00:42.714161] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-07T21:00:42.714213] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-07T21:00:42.714257] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-07T21:00:42.714290] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-07T21:00:43.056388] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-07T21:00:43.086597] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:43.847622] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-07T21:00:43.961275] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T21:00:44.647711] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-07T21:00:44.965102] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T21:00:45.447619] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-07T21:00:45.842129] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T21:00:46.136510] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T21:00:46.247699] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-07T21:00:47.047734] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-07T21:00:47.267534] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T21:00:47.847703] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-07T21:00:48.140419] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T21:00:48.363204] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-07T21:00:48.647630] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-07T21:00:49.447709] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-07T21:00:50.050749] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-07T21:00:50.247639] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-07T21:00:50.530024] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T21:00:50.943423] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T21:00:51.047639] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-07T21:00:51.847615] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-07T21:00:52.061475] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T21:00:52.647615] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-07T21:00:52.834639] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-07T21:00:53.204088] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T21:00:53.447685] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-07T21:00:53.975843] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T21:00:54.247689] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-07T21:00:55.047680] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-07T21:00:55.441192] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-07T21:00:55.749482] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T21:00:55.751832] [INFO ] [REMOTE ] PNNT: Full fetch complete (47250 records). [2025-10-07T21:00:55.751933] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-07T21:00:55.752594] [FATAL] [VALIDATOR ] PNNT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:00:55.752745] [FATAL] [MAIN ] PNNT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:00:55.752801] [WARN ] [MAIN ] PNNT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:00:55.752867] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-07T21:00:55.752938] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-07T21:00:55.752978] [INFO ] [LOCAL ] PNNT: Starting deletion of derivative data. [2025-10-07T21:00:55.753275] [DEBUG] [LOCAL ] PNNT: Deleted derivative data file. [2025-10-07T21:00:55.753380] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNNT took 31.6s. Estimated remaining: 1h 32m 54s. Rate: 7.1 symbols/min [2025-10-07T21:00:55.854936] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-07T21:00:55.935389] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:55.981577] [DEBUG] [LOCAL ] POR: Loaded 47006 existing records from primary storage. [2025-10-07T21:00:55.981965] [INFO ] [MAIN ] POR: Loaded 47006 existing records. [2025-10-07T21:00:56.169441] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:00:56.169888] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-07T21:00:56.169953] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-07T21:00:56.170355] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-10-07T21:00:56.170419] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-07T21:00:56.494217] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-07T21:00:56.583844] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:56.647601] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-07T21:00:57.447623] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-07T21:00:57.518967] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T21:00:57.963168] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T21:00:57.966750] [INFO ] [REMOTE ] PNC: Full fetch complete (75025 records). [2025-10-07T21:00:57.967097] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-07T21:00:57.992195] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:00:57.992413] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:00:57.992742] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:00:57.994414] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T21:00:57.993290] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-07T21:00:58.004453] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-07T21:00:58.004523] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-07T21:00:58.004572] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-07T21:00:58.004638] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNC took 52.1s. Estimated remaining: 1h 32m 44s. Rate: 7.1 symbols/min [2025-10-07T21:00:58.182714] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:00:58.222362] [DEBUG] [LOCAL ] POST: Loaded 38793 existing records from primary storage. [2025-10-07T21:00:58.222706] [INFO ] [MAIN ] POST: Loaded 38793 existing records. [2025-10-07T21:00:58.252732] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-07T21:00:58.412777] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:00:58.413005] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-07T21:00:58.413066] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-07T21:00:58.413593] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-10-07T21:00:58.413689] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-07T21:00:58.794528] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:00:59.047640] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-07T21:00:59.847626] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-07T21:00:59.994818] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T21:01:00.093559] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T21:01:00.647683] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-07T21:01:01.447698] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-07T21:01:01.691811] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T21:01:02.156614] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T21:01:02.247694] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-07T21:01:03.047686] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-07T21:01:03.423407] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T21:01:03.847668] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-07T21:01:04.215140] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-07T21:01:04.647633] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-07T21:01:04.726365] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T21:01:05.447627] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-07T21:01:05.713678] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T21:01:06.247619] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-07T21:01:06.537534] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T21:01:06.878555] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:01:06.881439] [INFO ] [REMOTE ] PNR: Full fetch complete (68793 records). [2025-10-07T21:01:06.881690] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-07T21:01:06.882921] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:01:06.883034] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:01:06.883081] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:01:06.883127] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-07T21:01:06.883190] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-07T21:01:06.883231] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-07T21:01:06.883322] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-07T21:01:06.883393] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNR took 35.1s. Estimated remaining: 1h 32m 35s. Rate: 7.1 symbols/min [2025-10-07T21:01:07.060631] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:01:07.054550] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-07T21:01:07.061085] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-07T21:01:07.061185] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-07T21:01:07.070741] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-07T21:01:07.094030] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-07T21:01:07.097168] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-07T21:01:07.097396] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-07T21:01:07.099660] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T21:01:07.504552] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:01:07.847725] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-07T21:01:08.647610] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-07T21:01:08.985953] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T21:01:09.406859] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T21:01:09.447609] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-07T21:01:10.256391] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-07T21:01:10.280353] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T21:01:10.650624] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T21:01:11.047637] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-07T21:01:11.847681] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-07T21:01:12.313787] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-07T21:01:12.647681] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-07T21:01:12.814458] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T21:01:13.447695] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-07T21:01:13.534826] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T21:01:14.247739] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-07T21:01:14.609474] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-07T21:01:15.047691] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-07T21:01:15.298134] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T21:01:15.435465] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T21:01:15.847689] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-07T21:01:16.647687] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-07T21:01:16.802704] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T21:01:17.447717] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-07T21:01:17.601929] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T21:01:18.091225] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T21:01:18.247715] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-07T21:01:19.047697] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-07T21:01:19.381580] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T21:01:19.847743] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-07T21:01:19.916810] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:01:20.388240] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T21:01:20.647629] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-07T21:01:21.447732] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-07T21:01:21.648242] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:01:22.078992] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:01:22.081976] [INFO ] [REMOTE ] PNW: Full fetch complete (65709 records). [2025-10-07T21:01:22.082139] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-07T21:01:22.083202] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:01:22.083336] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:01:22.083412] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:01:22.083503] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-07T21:01:22.083584] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-07T21:01:22.083624] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-07T21:01:22.083717] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-07T21:01:22.083795] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNW took 39.5s. Estimated remaining: 1h 32m 30s. Rate: 7.1 symbols/min [2025-10-07T21:01:22.263793] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:01:22.259431] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-07T21:01:22.264220] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-07T21:01:22.264992] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-07T21:01:22.265146] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-07T21:01:22.265216] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-07T21:01:22.265272] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-07T21:01:22.265309] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-07T21:01:22.631864] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:01:22.658711] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-07T21:01:23.047684] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-07T21:01:23.847696] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-07T21:01:24.150905] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T21:01:24.647696] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-07T21:01:25.083789] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T21:01:25.447756] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-07T21:01:25.524013] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T21:01:26.247628] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-07T21:01:26.746551] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-07T21:01:26.936858] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:01:26.940674] [INFO ] [REMOTE ] POR: Full fetch complete (68225 records). [2025-10-07T21:01:26.940876] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-07T21:01:26.943116] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:01:26.943235] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:01:26.943345] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:01:26.943450] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-07T21:01:26.943556] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-07T21:01:26.943612] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-07T21:01:26.943905] [DEBUG] [LOCAL ] POR: Deleted derivative data file. [2025-10-07T21:01:26.944111] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. POR took 31.2s. Estimated remaining: 1h 32m 20s. Rate: 7.1 symbols/min [2025-10-07T21:01:27.052134] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-07T21:01:27.144617] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:01:27.167774] [DEBUG] [LOCAL ] PPT: Loaded 19961 existing records from primary storage. [2025-10-07T21:01:27.168049] [INFO ] [MAIN ] PPT: Loaded 19961 existing records. [2025-10-07T21:01:27.348872] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:01:27.349095] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-07T21:01:27.349144] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-07T21:01:27.349677] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-07T21:01:27.349739] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-07T21:01:27.736066] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:01:27.755434] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-07T21:01:27.847608] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-07T21:01:28.647620] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-07T21:01:28.937623] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T21:01:29.447696] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-07T21:01:29.773181] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T21:01:30.247640] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-07T21:01:30.388992] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T21:01:30.637770] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T21:01:31.047731] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-07T21:01:31.729852] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T21:01:31.732262] [INFO ] [REMOTE ] POST: Full fetch complete (55374 records). [2025-10-07T21:01:31.732354] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-07T21:01:31.733045] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:01:31.733135] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:01:31.733192] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:01:31.733285] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-07T21:01:31.733400] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-07T21:01:31.733459] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-07T21:01:31.733716] [DEBUG] [LOCAL ] POST: Deleted derivative data file. [2025-10-07T21:01:31.733826] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POST took 33.7s. Estimated remaining: 1h 32m 10s. Rate: 7.1 symbols/min [2025-10-07T21:01:31.852613] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-07T21:01:31.936016] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:01:31.991268] [DEBUG] [LOCAL ] PR: Loaded 53611 existing records from primary storage. [2025-10-07T21:01:31.991882] [INFO ] [MAIN ] PR: Loaded 53611 existing records. [2025-10-07T21:01:32.180085] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:01:32.180400] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-07T21:01:32.180482] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-07T21:01:32.181857] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-10-07T21:01:32.181920] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-07T21:01:32.389998] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-07T21:01:32.586002] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:01:32.647620] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-07T21:01:33.447712] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-07T21:01:33.667598] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:01:34.247749] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-07T21:01:34.554766] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T21:01:35.047627] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-07T21:01:35.214483] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T21:01:35.847619] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-07T21:01:36.257483] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T21:01:36.647615] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-07T21:01:37.038749] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T21:01:37.074110] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-07T21:01:37.447723] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-07T21:01:38.247632] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-07T21:01:38.384905] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T21:01:38.606266] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T21:01:39.047624] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-07T21:01:39.361386] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T21:01:39.847697] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-07T21:01:40.647635] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-07T21:01:40.942192] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T21:01:41.447632] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-07T21:01:41.490681] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T21:01:41.853906] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T21:01:42.033832] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:01:42.037171] [INFO ] [REMOTE ] PPG: Full fetch complete (73429 records). [2025-10-07T21:01:42.037351] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-07T21:01:42.038263] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:01:42.038361] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:01:42.038430] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:01:42.038506] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-07T21:01:42.038599] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-07T21:01:42.038702] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-07T21:01:42.038810] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-07T21:01:42.038913] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPG took 35.2s. Estimated remaining: 1h 32m 2s. Rate: 7.1 symbols/min [2025-10-07T21:01:42.247723] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-07T21:01:43.047708] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-07T21:01:43.847677] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-07T21:01:44.098764] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T21:01:44.268457] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T21:01:44.647777] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-07T21:01:45.447703] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-07T21:01:45.840547] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T21:01:46.247691] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-07T21:01:46.488889] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T21:01:46.524055] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T21:01:47.047631] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-07T21:01:47.847626] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-07T21:01:47.938853] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T21:01:48.299597] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T21:01:48.647737] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-07T21:01:49.447730] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-07T21:01:49.872924] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-07T21:01:50.247696] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-07T21:01:50.694246] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T21:01:50.752838] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T21:01:51.047620] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-07T21:01:51.847737] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-07T21:01:52.083101] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T21:01:52.259913] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T21:01:52.647737] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-07T21:01:53.144170] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T21:01:53.147429] [INFO ] [REMOTE ] PPL: Full fetch complete (77028 records). [2025-10-07T21:01:53.147539] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-07T21:01:53.149846] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:01:53.149938] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:01:53.149983] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:01:53.150025] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-07T21:01:53.150130] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-07T21:01:53.150206] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-07T21:01:53.150268] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-07T21:01:53.150347] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPL took 31.1s. Estimated remaining: 1h 31m 55s. Rate: 7.1 symbols/min [2025-10-07T21:01:53.447703] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-07T21:01:53.896059] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-07T21:01:54.247785] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-07T21:01:54.710053] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T21:01:55.047692] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-07T21:01:55.994745] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-07T21:01:55.996669] [INFO ] [REMOTE ] PPT: Full fetch complete (29114 records). [2025-10-07T21:01:55.996787] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-07T21:01:56.382665] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-07T21:01:56.382769] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-07T21:01:56.383494] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-07T21:01:56.383573] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-07T21:01:56.395544] [DEBUG] [LOCAL ] PPT: Trimmed 29114 records to 20071 (keeping 200 days of data) [2025-10-07T21:01:56.417389] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-07T21:01:56.484816] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-07T21:01:56.545148] [DEBUG] [LOCAL ] PPT: Primary data saved (20071 records). [2025-10-07T21:01:56.545286] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-07T21:01:56.545387] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPT took 29.6s. Estimated remaining: 1h 31m 44s. Rate: 7.1 symbols/min [2025-10-07T21:01:58.583552] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-07T21:01:58.596947] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-07T21:02:00.547018] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T21:02:00.561721] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-07T21:02:02.602318] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T21:02:02.614893] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-07T21:02:03.617337] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T21:02:03.621342] [INFO ] [REMOTE ] PR: Full fetch complete (77208 records). [2025-10-07T21:02:03.621598] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-07T21:02:03.623519] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:02:03.623777] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:02:03.623833] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:02:03.623880] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-07T21:02:03.623948] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-07T21:02:03.623984] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-07T21:02:03.624194] [DEBUG] [LOCAL ] PR: Deleted derivative data file. [2025-10-07T21:02:03.624310] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PR took 31.9s. Estimated remaining: 1h 31m 35s. Rate: 7.1 symbols/min [2025-10-07T21:02:04.312288] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:04.404777] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:04.418894] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:04.476606] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:04.482349] [DEBUG] [LOCAL ] PRCS: Loaded 2758 existing records from primary storage. [2025-10-07T21:02:04.483294] [INFO ] [MAIN ] PRCS: Loaded 2758 existing records. [2025-10-07T21:02:04.714867] [DEBUG] [LOCAL ] PRA: Loaded 35372 existing records from primary storage. [2025-10-07T21:02:04.721630] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:04.723144] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-07T21:02:04.723421] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-07T21:02:04.723269] [INFO ] [MAIN ] PRA: Loaded 35372 existing records. [2025-10-07T21:02:04.758232] [DEBUG] [LOCAL ] PRG: Loaded 29868 existing records from primary storage. [2025-10-07T21:02:04.757769] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-07T21:02:04.796685] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-07T21:02:04.802137] [INFO ] [MAIN ] PRG: Loaded 29868 existing records. [2025-10-07T21:02:05.119451] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:05.115744] [DEBUG] [LOCAL ] PRGO: Loaded 46941 existing records from primary storage. [2025-10-07T21:02:05.135575] [INFO ] [MAIN ] PRGO: Loaded 46941 existing records. [2025-10-07T21:02:05.157045] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-07T21:02:05.270906] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-07T21:02:05.358184] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-10-07T21:02:05.485822] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:05.521279] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-07T21:02:05.521379] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-07T21:02:05.550961] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-07T21:02:05.718055] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-10-07T21:02:05.707544] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:05.763104] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-07T21:02:05.763215] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-07T21:02:05.823760] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-07T21:02:05.868380] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:05.907985] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-10-07T21:02:05.913635] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-07T21:02:05.908402] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-07T21:02:06.638272] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:06.681977] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T21:02:06.731357] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-07T21:02:06.730345] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:06.751349] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-07T21:02:06.726233] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-07T21:02:06.866531] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:06.867071] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-07T21:02:07.386558] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T21:02:07.387845] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-07T21:02:07.935897] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T21:02:07.937387] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-07T21:02:08.047946] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T21:02:08.052853] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-07T21:02:08.259919] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T21:02:08.266792] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-07T21:02:08.371580] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T21:02:08.381780] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-07T21:02:08.561320] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T21:02:08.562597] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-07T21:02:09.028960] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-07T21:02:09.030996] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-07T21:02:09.042754] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T21:02:09.047748] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-07T21:02:09.714049] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T21:02:09.720215] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-07T21:02:09.726937] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T21:02:10.031967] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T21:02:10.247747] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-07T21:02:10.287393] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T21:02:10.932874] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-07T21:02:11.047717] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-07T21:02:11.847706] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-07T21:02:11.916798] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T21:02:12.613349] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T21:02:12.647608] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-07T21:02:13.021811] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T21:02:13.447687] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-07T21:02:14.033255] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T21:02:14.134241] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T21:02:14.247716] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-07T21:02:15.047764] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-07T21:02:15.702847] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T21:02:15.847711] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-07T21:02:16.647692] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-07T21:02:16.977661] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-07T21:02:17.447612] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-07T21:02:17.594423] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T21:02:17.623463] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T21:02:18.247742] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-07T21:02:18.901854] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-07T21:02:19.047729] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-07T21:02:19.272800] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T21:02:19.847733] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-07T21:02:20.402606] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T21:02:20.647732] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-07T21:02:21.229407] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T21:02:21.447731] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-07T21:02:21.854554] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T21:02:22.247755] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-07T21:02:22.903819] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T21:02:23.047860] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-07T21:02:23.793722] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T21:02:23.847606] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-07T21:02:24.396354] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T21:02:24.647749] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-07T21:02:25.177486] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-07T21:02:25.249410] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T21:02:25.447720] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-07T21:02:26.247791] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-07T21:02:26.754574] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T21:02:26.755358] [INFO ] [REMOTE ] PRCS: Full fetch complete (3860 records). [2025-10-07T21:02:26.755426] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-07T21:02:26.893872] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T21:02:27.052791] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-07T21:02:27.155461] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-07T21:02:27.155539] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-07T21:02:27.155686] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-07T21:02:27.155748] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-07T21:02:27.156107] [DEBUG] [LOCAL ] PRCS: Trimmed 3860 records to 2749 (keeping 200 days of data) [2025-10-07T21:02:27.172526] [DEBUG] [LOCAL ] PRCS: Primary data saved (2749 records). [2025-10-07T21:02:27.172587] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-07T21:02:27.172676] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRCS took 23.5s. Estimated remaining: 1h 31m 33s. Rate: 7.1 symbols/min [2025-10-07T21:02:27.337892] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:27.345405] [DEBUG] [LOCAL ] PRH: Loaded 4780 existing records from primary storage. [2025-10-07T21:02:27.345624] [INFO ] [MAIN ] PRH: Loaded 4780 existing records. [2025-10-07T21:02:27.521557] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:27.521768] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-07T21:02:27.521817] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-07T21:02:27.521990] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-07T21:02:27.522046] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-07T21:02:27.820394] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T21:02:27.850408] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-07T21:02:27.869751] [INFO ] [REMOTE ] PRA: Full fetch complete (43875 records). [2025-10-07T21:02:27.892541] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-07T21:02:27.892424] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:27.893661] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:02:27.893749] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:02:27.893793] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:02:27.893835] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-07T21:02:27.893891] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-07T21:02:27.893925] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-07T21:02:27.894109] [DEBUG] [LOCAL ] PRA: Deleted derivative data file. [2025-10-07T21:02:27.894200] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRA took 24.3s. Estimated remaining: 1h 31m 21s. Rate: 7.1 symbols/min [2025-10-07T21:02:28.062351] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:28.081156] [DEBUG] [LOCAL ] PRI: Loaded 18263 existing records from primary storage. [2025-10-07T21:02:28.081415] [INFO ] [MAIN ] PRI: Loaded 18263 existing records. [2025-10-07T21:02:28.254139] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:28.254334] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-07T21:02:28.254386] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-07T21:02:28.254628] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-10-07T21:02:28.254720] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-07T21:02:28.602078] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:28.647611] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-07T21:02:29.447630] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-07T21:02:29.647272] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T21:02:29.704725] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T21:02:30.215924] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T21:02:30.247605] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-07T21:02:31.047699] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-07T21:02:31.093916] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T21:02:31.847692] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-07T21:02:32.340447] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T21:02:32.647731] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-07T21:02:33.447631] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-07T21:02:33.489734] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T21:02:33.624143] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T21:02:34.247679] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-07T21:02:34.267130] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T21:02:35.047746] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-07T21:02:35.531965] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T21:02:35.847740] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-07T21:02:36.275126] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T21:02:36.591703] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T21:02:36.647601] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-07T21:02:37.447680] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-07T21:02:38.132488] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T21:02:38.134865] [INFO ] [REMOTE ] PRG: Full fetch complete (44192 records). [2025-10-07T21:02:38.134945] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-07T21:02:38.135758] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:02:38.135842] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:02:38.135889] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:02:38.135971] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-07T21:02:38.136066] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-07T21:02:38.136134] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-07T21:02:38.136323] [DEBUG] [LOCAL ] PRG: Deleted derivative data file. [2025-10-07T21:02:38.136467] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRG took 34.5s. Estimated remaining: 1h 31m 14s. Rate: 7.1 symbols/min [2025-10-07T21:02:38.252372] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-07T21:02:38.319860] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:38.373932] [DEBUG] [LOCAL ] PRIM: Loaded 44236 existing records from primary storage. [2025-10-07T21:02:38.374323] [INFO ] [MAIN ] PRIM: Loaded 44236 existing records. [2025-10-07T21:02:38.568770] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T21:02:38.599330] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:38.599894] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-07T21:02:38.599952] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-07T21:02:38.600205] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-07T21:02:38.600267] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-07T21:02:38.967942] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:38.968591] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-07T21:02:39.047592] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-07T21:02:39.847703] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-07T21:02:40.639062] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T21:02:40.647816] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-07T21:02:41.447716] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-07T21:02:41.854987] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T21:02:42.240821] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T21:02:42.252689] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-07T21:02:42.266486] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T21:02:42.979220] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T21:02:43.047623] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-07T21:02:43.515871] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T21:02:43.847690] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-07T21:02:44.647709] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-07T21:02:45.447730] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-07T21:02:45.497355] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T21:02:45.522340] [INFO ] [REMOTE ] PRGO: Full fetch complete (68207 records). [2025-10-07T21:02:45.523704] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T21:02:45.523007] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-07T21:02:45.533323] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:02:45.533429] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:02:45.533474] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:02:45.533538] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-07T21:02:45.533604] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-07T21:02:45.533638] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-07T21:02:45.533875] [DEBUG] [LOCAL ] PRGO: Deleted derivative data file. [2025-10-07T21:02:45.533965] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRGO took 41.9s. Estimated remaining: 1h 31m 5s. Rate: 7.1 symbols/min [2025-10-07T21:02:45.702678] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:45.743297] [DEBUG] [LOCAL ] PRKS: Loaded 42476 existing records from primary storage. [2025-10-07T21:02:45.743597] [INFO ] [MAIN ] PRKS: Loaded 42476 existing records. [2025-10-07T21:02:45.921202] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:45.921420] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-07T21:02:45.921469] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-07T21:02:45.921787] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-07T21:02:45.921850] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-07T21:02:46.249147] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-07T21:02:46.281127] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T21:02:46.284251] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:47.047670] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-07T21:02:47.847628] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-07T21:02:48.100294] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T21:02:48.277385] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-07T21:02:48.655791] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-07T21:02:48.659290] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T21:02:49.117196] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T21:02:49.118095] [INFO ] [REMOTE ] PRH: Full fetch complete (7501 records). [2025-10-07T21:02:49.118167] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-07T21:02:49.118538] [FATAL] [VALIDATOR ] PRH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:02:49.118620] [FATAL] [MAIN ] PRH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:02:49.118702] [WARN ] [MAIN ] PRH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:02:49.118751] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-07T21:02:49.118809] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-07T21:02:49.118844] [INFO ] [LOCAL ] PRH: Starting deletion of derivative data. [2025-10-07T21:02:49.119012] [DEBUG] [LOCAL ] PRH: Deleted derivative data file. [2025-10-07T21:02:49.119101] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRH took 21.9s. Estimated remaining: 1h 30m 54s. Rate: 7.1 symbols/min [2025-10-07T21:02:49.293616] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:02:49.316744] [DEBUG] [LOCAL ] PRLB: Loaded 20362 existing records from primary storage. [2025-10-07T21:02:49.317028] [INFO ] [MAIN ] PRLB: Loaded 20362 existing records. [2025-10-07T21:02:49.461749] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-07T21:02:49.506744] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:02:49.507251] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-07T21:02:49.507307] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-07T21:02:49.507582] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-10-07T21:02:49.507669] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-07T21:02:49.857992] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:02:50.247697] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-07T21:02:51.047671] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-07T21:02:51.346800] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T21:02:51.399929] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T21:02:51.847679] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-07T21:02:52.647678] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-07T21:02:52.707880] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T21:02:52.961448] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-07T21:02:53.454372] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-07T21:02:53.457239] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T21:02:54.247698] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-07T21:02:55.047673] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-07T21:02:55.278207] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T21:02:55.847688] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-07T21:02:55.903199] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T21:02:55.979108] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T21:02:56.647689] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-07T21:02:57.454212] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-07T21:02:57.469295] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T21:02:57.895602] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T21:02:58.247690] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-07T21:02:59.047669] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-07T21:02:59.169962] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T21:02:59.847698] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-07T21:03:00.013299] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T21:03:00.140982] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T21:03:00.647743] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-07T21:03:01.022169] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T21:03:01.447728] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-07T21:03:01.910771] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T21:03:02.247690] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-07T21:03:02.790746] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T21:03:03.047708] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-07T21:03:03.397868] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T21:03:03.847717] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-07T21:03:04.647629] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-07T21:03:04.875120] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T21:03:04.977413] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T21:03:05.447691] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-07T21:03:05.861576] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T21:03:06.247837] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-07T21:03:06.361036] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T21:03:07.047712] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-07T21:03:07.643285] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T21:03:07.662057] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T21:03:07.663405] [INFO ] [REMOTE ] PRI: Full fetch complete (25597 records). [2025-10-07T21:03:07.663514] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-07T21:03:07.664150] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:03:07.664232] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:03:07.664297] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:03:07.664373] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-07T21:03:07.664461] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-07T21:03:07.664520] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-07T21:03:07.664743] [DEBUG] [LOCAL ] PRI: Deleted derivative data file. [2025-10-07T21:03:07.664866] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRI took 39.8s. Estimated remaining: 1h 30m 50s. Rate: 7.1 symbols/min [2025-10-07T21:03:07.835540] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:03:07.858163] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-07T21:03:07.878171] [DEBUG] [LOCAL ] PRM: Loaded 44679 existing records from primary storage. [2025-10-07T21:03:07.878537] [INFO ] [MAIN ] PRM: Loaded 44679 existing records. [2025-10-07T21:03:08.053593] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:03:08.053836] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-07T21:03:08.053891] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-07T21:03:08.054115] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-07T21:03:08.054173] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-07T21:03:08.411125] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:03:08.647608] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-07T21:03:09.029713] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T21:03:09.447684] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-07T21:03:10.247634] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-07T21:03:10.447477] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:03:11.047619] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-07T21:03:11.167697] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T21:03:11.836544] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T21:03:11.847592] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-07T21:03:12.242957] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T21:03:12.647763] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-07T21:03:13.417163] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T21:03:13.447610] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-07T21:03:14.247632] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-07T21:03:14.310569] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T21:03:15.047688] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-07T21:03:15.220009] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T21:03:15.389843] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T21:03:15.847759] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-07T21:03:16.653257] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-07T21:03:16.658592] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T21:03:17.447730] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-07T21:03:17.503687] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T21:03:17.550371] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-07T21:03:18.022581] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T21:03:18.025336] [INFO ] [REMOTE ] PRIM: Full fetch complete (63276 records). [2025-10-07T21:03:18.025447] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-07T21:03:18.026493] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:03:18.026581] [FATAL] [MAIN ] PRIM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:03:18.026630] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:03:18.026744] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-07T21:03:18.026826] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-07T21:03:18.026864] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-07T21:03:18.027038] [DEBUG] [LOCAL ] PRIM: Deleted derivative data file. [2025-10-07T21:03:18.027132] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRIM took 39.9s. Estimated remaining: 1h 30m 42s. Rate: 7.1 symbols/min [2025-10-07T21:03:18.194558] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:03:18.245060] [DEBUG] [LOCAL ] PRMB: Loaded 53159 existing records from primary storage. [2025-10-07T21:03:18.245417] [INFO ] [MAIN ] PRMB: Loaded 53159 existing records. [2025-10-07T21:03:18.256313] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-07T21:03:18.425364] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:03:18.425629] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-07T21:03:18.425712] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-07T21:03:18.426219] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-07T21:03:18.426276] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-07T21:03:18.785843] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:03:19.047687] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-07T21:03:19.496238] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-07T21:03:19.497818] [INFO ] [REMOTE ] PRLB: Full fetch complete (30425 records). [2025-10-07T21:03:19.497917] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-07T21:03:19.498427] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:03:19.498513] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:03:19.498555] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:03:19.498596] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-07T21:03:19.498678] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-07T21:03:19.498734] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-07T21:03:19.498963] [DEBUG] [LOCAL ] PRLB: Deleted derivative data file. [2025-10-07T21:03:19.499089] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRLB took 30.4s. Estimated remaining: 1h 30m 31s. Rate: 7.1 symbols/min [2025-10-07T21:03:19.679108] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:03:19.720056] [DEBUG] [LOCAL ] PRO: Loaded 38575 existing records from primary storage. [2025-10-07T21:03:19.720355] [INFO ] [MAIN ] PRO: Loaded 38575 existing records. [2025-10-07T21:03:19.862134] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-07T21:03:19.905435] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:03:19.905605] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-07T21:03:19.905695] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-07T21:03:19.905905] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-07T21:03:19.905963] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-07T21:03:20.289952] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:03:20.320073] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-07T21:03:20.647688] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-07T21:03:21.267941] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T21:03:21.270727] [INFO ] [REMOTE ] PRKS: Full fetch complete (61195 records). [2025-10-07T21:03:21.270844] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-07T21:03:21.271462] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:03:21.271567] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:03:21.271610] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:03:21.271681] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-07T21:03:21.271779] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-07T21:03:21.271836] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-07T21:03:21.272045] [DEBUG] [LOCAL ] PRKS: Deleted derivative data file. [2025-10-07T21:03:21.272138] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRKS took 35.7s. Estimated remaining: 1h 30m 20s. Rate: 7.1 symbols/min [2025-10-07T21:03:21.456259] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-07T21:03:21.460688] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:03:21.461973] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-07T21:03:21.462033] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-07T21:03:21.462156] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-07T21:03:21.462202] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-07T21:03:21.462245] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-07T21:03:21.462278] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-07T21:03:21.866749] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:03:21.870211] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T21:03:22.247743] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-07T21:03:23.044047] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T21:03:23.051189] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-07T21:03:23.847712] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-07T21:03:24.042617] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T21:03:24.519288] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T21:03:24.647756] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-07T21:03:25.447693] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-07T21:03:25.668068] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T21:03:25.765445] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:03:25.765914] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-07T21:03:25.766008] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:03:25.766055] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-07T21:03:25.766116] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:03:25.766189] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-07T21:03:25.766255] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-07T21:03:25.766290] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-07T21:03:25.766329] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-07T21:03:25.766375] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRSU took 4.5s. Estimated remaining: 1h 30m 10s. Rate: 7.1 symbols/min [2025-10-07T21:03:25.977740] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:03:25.986038] [DEBUG] [LOCAL ] PRT: Loaded 5232 existing records from primary storage. [2025-10-07T21:03:25.986277] [INFO ] [MAIN ] PRT: Loaded 5232 existing records. [2025-10-07T21:03:26.190037] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:03:26.190284] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-07T21:03:26.190333] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-07T21:03:26.190510] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-07T21:03:26.190567] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-07T21:03:26.253200] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-07T21:03:26.570817] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:03:26.601403] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T21:03:27.047689] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-07T21:03:27.679839] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T21:03:27.847750] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-07T21:03:27.993495] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T21:03:28.647711] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-07T21:03:29.024355] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T21:03:29.447736] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-07T21:03:30.247732] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-07T21:03:30.379327] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T21:03:30.413430] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T21:03:31.047725] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-07T21:03:31.847623] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-07T21:03:31.883158] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T21:03:31.912191] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T21:03:32.647749] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-07T21:03:33.447628] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-07T21:03:33.702939] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T21:03:33.763585] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T21:03:34.247711] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-07T21:03:35.047696] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-07T21:03:35.079890] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T21:03:35.847696] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-07T21:03:35.961007] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T21:03:36.089083] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T21:03:36.647681] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-07T21:03:37.361486] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T21:03:37.447627] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-07T21:03:38.247727] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-07T21:03:38.660753] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T21:03:39.010364] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:03:39.011090] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T21:03:39.047601] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-07T21:03:39.847710] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-07T21:03:40.647695] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-07T21:03:40.814630] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T21:03:41.383747] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T21:03:41.447676] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-07T21:03:41.590581] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T21:03:42.247713] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-07T21:03:42.761071] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T21:03:42.761301] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-07T21:03:43.047724] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-07T21:03:43.847699] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-07T21:03:44.647718] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-07T21:03:44.792037] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T21:03:45.447693] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-07T21:03:45.899702] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-07T21:03:46.008982] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T21:03:46.026693] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T21:03:46.029715] [INFO ] [REMOTE ] PRO: Full fetch complete (52171 records). [2025-10-07T21:03:46.029825] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-07T21:03:46.030525] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:03:46.030624] [FATAL] [MAIN ] PRO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:03:46.030704] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:03:46.030755] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-07T21:03:46.030816] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-07T21:03:46.030851] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-07T21:03:46.031372] [DEBUG] [LOCAL ] PRO: Deleted derivative data file. [2025-10-07T21:03:46.031466] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRO took 26.5s. Estimated remaining: 1h 30m 6s. Rate: 7.1 symbols/min [2025-10-07T21:03:46.215408] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:03:46.215616] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-07T21:03:46.215689] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-07T21:03:46.215807] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-07T21:03:46.215851] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-07T21:03:46.215894] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-07T21:03:46.215928] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-07T21:03:46.252865] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-07T21:03:46.598744] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:03:47.047692] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-07T21:03:47.162075] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T21:03:47.635597] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:03:47.638601] [INFO ] [REMOTE ] PRM: Full fetch complete (64216 records). [2025-10-07T21:03:47.638783] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-07T21:03:47.639604] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:03:47.639719] [FATAL] [MAIN ] PRM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:03:47.639764] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:03:47.639829] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-07T21:03:47.639897] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-07T21:03:47.639932] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-07T21:03:47.640102] [DEBUG] [LOCAL ] PRM: Deleted derivative data file. [2025-10-07T21:03:47.640198] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRM took 40.0s. Estimated remaining: 1h 29m 55s. Rate: 7.1 symbols/min [2025-10-07T21:03:47.812199] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:03:47.812423] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-07T21:03:47.812478] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-07T21:03:47.812598] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-07T21:03:47.812640] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-07T21:03:47.812729] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-07T21:03:47.812763] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-07T21:03:47.853056] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-07T21:03:48.196214] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:03:48.647697] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-07T21:03:48.959720] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T21:03:49.106448] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-07T21:03:49.447708] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-07T21:03:50.247697] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-07T21:03:51.047679] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-07T21:03:51.373399] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-07T21:03:51.653846] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-07T21:03:51.657188] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T21:03:51.847781] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-07T21:03:52.647700] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-07T21:03:53.435494] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T21:03:53.447684] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-07T21:03:53.617346] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T21:03:53.842208] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T21:03:53.843359] [INFO ] [REMOTE ] PRT: Full fetch complete (8968 records). [2025-10-07T21:03:53.843442] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-07T21:03:53.844094] [FATAL] [VALIDATOR ] PRT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:03:53.844177] [FATAL] [MAIN ] PRT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:03:53.844221] [WARN ] [MAIN ] PRT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:03:53.844288] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-07T21:03:53.844355] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-07T21:03:53.844390] [INFO ] [LOCAL ] PRT: Starting deletion of derivative data. [2025-10-07T21:03:53.844574] [DEBUG] [LOCAL ] PRT: Deleted derivative data file. [2025-10-07T21:03:53.844685] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRT took 28.1s. Estimated remaining: 1h 29m 46s. Rate: 7.1 symbols/min [2025-10-07T21:03:54.020369] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:03:54.020574] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-07T21:03:54.020613] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-07T21:03:54.020751] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-07T21:03:54.020793] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-07T21:03:54.020838] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-07T21:03:54.020871] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-07T21:03:54.252741] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-07T21:03:54.382327] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:03:55.047667] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-07T21:03:55.847876] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-07T21:03:56.144797] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-07T21:03:56.263352] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-07T21:03:56.647692] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-07T21:03:56.808529] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T21:03:57.447699] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-07T21:03:58.247751] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-07T21:03:59.047683] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-07T21:03:59.576131] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T21:03:59.847736] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-07T21:04:00.349575] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-07T21:04:00.647730] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-07T21:04:01.133084] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (4.49 seconds). [2025-10-07T21:04:01.139467] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-07T21:04:01.447632] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-07T21:04:01.888030] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-07T21:04:02.247628] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-07T21:04:02.651069] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-07T21:04:03.047764] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-07T21:04:03.165939] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (5.72 seconds). [2025-10-07T21:04:03.497568] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-07T21:04:03.847631] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-07T21:04:04.305575] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (6.06 seconds). [2025-10-07T21:04:04.647726] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-07T21:04:05.447725] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-07T21:04:05.866309] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-07T21:04:06.247746] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-07T21:04:06.681846] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T21:04:06.695884] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T21:04:06.730702] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T21:04:07.047707] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-07T21:04:07.847745] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-07T21:04:08.647739] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-07T21:04:08.949239] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-07T21:04:09.078810] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-07T21:04:09.079497] [INFO ] [REMOTE ] PRVS: Full fetch complete (1272 records). [2025-10-07T21:04:09.079567] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-07T21:04:09.263336] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-07T21:04:09.263633] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:04:09.263773] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:04:09.263954] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-07T21:04:09.264141] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-07T21:04:09.264227] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-07T21:04:09.264340] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-07T21:04:09.264572] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRVS took 21.6s. Estimated remaining: 1h 29m 40s. Rate: 7.1 symbols/min [2025-10-07T21:04:09.446849] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:04:09.447617] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-07T21:04:09.473767] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T21:04:09.487091] [DEBUG] [LOCAL ] PSBD: Loaded 7270 existing records from primary storage. [2025-10-07T21:04:09.487306] [INFO ] [MAIN ] PSBD: Loaded 7270 existing records. [2025-10-07T21:04:09.665242] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:04:09.665439] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-07T21:04:09.665488] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-07T21:04:09.665689] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-07T21:04:09.665746] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-07T21:04:10.025446] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:04:10.247629] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-07T21:04:10.930629] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T21:04:11.047619] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-07T21:04:11.366308] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T21:04:11.618164] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T21:04:11.847695] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-07T21:04:12.647787] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-07T21:04:13.447668] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-07T21:04:13.653353] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T21:04:13.962426] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T21:04:13.968980] [INFO ] [REMOTE ] PRMB: Full fetch complete (75689 records). [2025-10-07T21:04:13.969199] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-07T21:04:13.970496] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:04:13.970618] [FATAL] [MAIN ] PRMB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:04:13.970697] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:04:13.970783] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-07T21:04:13.970870] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-07T21:04:13.970911] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-07T21:04:13.971093] [DEBUG] [LOCAL ] PRMB: Deleted derivative data file. [2025-10-07T21:04:13.971196] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRMB took 55.9s. Estimated remaining: 1h 29m 30s. Rate: 7.1 symbols/min [2025-10-07T21:04:14.167879] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:04:14.203453] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T21:04:14.217529] [DEBUG] [LOCAL ] PSF: Loaded 6963 existing records from primary storage. [2025-10-07T21:04:14.218165] [INFO ] [MAIN ] PSF: Loaded 6963 existing records. [2025-10-07T21:04:14.252732] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-07T21:04:14.426780] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:04:14.427041] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-07T21:04:14.427090] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-07T21:04:14.427303] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-07T21:04:14.427360] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-07T21:04:14.793083] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:04:15.047727] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-07T21:04:15.847753] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-07T21:04:16.543565] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-07T21:04:16.647755] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-07T21:04:17.313494] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-10-07T21:04:17.447617] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-07T21:04:17.456182] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T21:04:18.125662] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (3.08 seconds). [2025-10-07T21:04:18.247736] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-07T21:04:18.341823] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T21:04:19.047687] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-07T21:04:19.127702] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T21:04:19.847761] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-07T21:04:20.647708] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-07T21:04:20.715881] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T21:04:20.983584] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T21:04:21.447702] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-07T21:04:21.458722] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T21:04:22.201540] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T21:04:22.247715] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-07T21:04:22.666847] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T21:04:22.670065] [INFO ] [REMOTE ] PRU: Full fetch complete (73843 records). [2025-10-07T21:04:22.670206] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-07T21:04:22.673105] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:04:22.673200] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:04:22.673244] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:04:22.673284] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-07T21:04:22.673343] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-07T21:04:22.673377] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-07T21:04:22.673417] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-07T21:04:22.673490] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PRU took 36.6s. Estimated remaining: 1h 29m 22s. Rate: 7.1 symbols/min [2025-10-07T21:04:22.840343] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:04:22.872167] [DEBUG] [LOCAL ] PSFE: Loaded 29798 existing records from primary storage. [2025-10-07T21:04:22.872443] [INFO ] [MAIN ] PSFE: Loaded 29798 existing records. [2025-10-07T21:04:23.046915] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:04:23.047147] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-07T21:04:23.047194] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-07T21:04:23.047420] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-07T21:04:23.047476] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-07T21:04:23.052914] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-07T21:04:23.398018] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:04:23.847711] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-07T21:04:23.909572] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T21:04:24.647685] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-07T21:04:25.275911] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T21:04:25.282854] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T21:04:25.447675] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-07T21:04:26.247672] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-07T21:04:26.532592] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T21:04:27.047753] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-07T21:04:27.585984] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T21:04:27.847692] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-07T21:04:27.864484] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T21:04:28.647702] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-07T21:04:29.447636] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-07T21:04:29.593847] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T21:04:29.630779] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T21:04:30.247713] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-07T21:04:30.856332] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:04:31.047634] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-07T21:04:31.118015] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T21:04:31.847685] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-07T21:04:32.647716] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-07T21:04:32.737899] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T21:04:32.929136] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T21:04:33.202815] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-07T21:04:33.447735] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-07T21:04:34.168229] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T21:04:34.247615] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-07T21:04:35.047673] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-07T21:04:35.847624] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-07T21:04:35.914601] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T21:04:36.533770] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T21:04:36.647620] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-07T21:04:36.708330] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T21:04:37.447693] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-07T21:04:37.927151] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T21:04:37.928414] [INFO ] [REMOTE ] PSBD: Full fetch complete (9642 records). [2025-10-07T21:04:37.928488] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-07T21:04:37.929011] [FATAL] [VALIDATOR ] PSBD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:04:37.929096] [FATAL] [MAIN ] PSBD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:04:37.929140] [WARN ] [MAIN ] PSBD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:04:37.929237] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-07T21:04:37.929355] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-07T21:04:37.929416] [INFO ] [LOCAL ] PSBD: Starting deletion of derivative data. [2025-10-07T21:04:37.929682] [DEBUG] [LOCAL ] PSBD: Deleted derivative data file. [2025-10-07T21:04:37.929788] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSBD took 28.7s. Estimated remaining: 1h 29m 16s. Rate: 7.1 symbols/min [2025-10-07T21:04:38.133999] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:04:38.152626] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T21:04:38.206321] [DEBUG] [LOCAL ] PSN: Loaded 45927 existing records from primary storage. [2025-10-07T21:04:38.206759] [INFO ] [MAIN ] PSN: Loaded 45927 existing records. [2025-10-07T21:04:38.252694] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-07T21:04:38.408470] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:04:38.408757] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-07T21:04:38.408810] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-07T21:04:38.409017] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-10-07T21:04:38.409075] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-07T21:04:38.788387] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:04:39.047671] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-07T21:04:39.847634] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-07T21:04:39.915521] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T21:04:40.647671] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-07T21:04:40.689002] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T21:04:40.873887] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-07T21:04:41.447638] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-07T21:04:42.082994] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T21:04:42.097094] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T21:04:42.100197] [INFO ] [REMOTE ] PSA: Full fetch complete (59033 records). [2025-10-07T21:04:42.100362] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-07T21:04:42.101181] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:04:42.101292] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:04:42.101351] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:04:42.101435] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-07T21:04:42.101520] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-07T21:04:42.101569] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-07T21:04:42.101622] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-07T21:04:42.101787] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSA took 48.3s. Estimated remaining: 1h 29m 6s. Rate: 7.1 symbols/min [2025-10-07T21:04:42.254669] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-07T21:04:42.274044] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:04:42.311551] [DEBUG] [LOCAL ] PSO: Loaded 36922 existing records from primary storage. [2025-10-07T21:04:42.311875] [INFO ] [MAIN ] PSO: Loaded 36922 existing records. [2025-10-07T21:04:42.490892] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:04:42.491147] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-07T21:04:42.491209] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-07T21:04:42.491434] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-10-07T21:04:42.491491] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-07T21:04:42.838314] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:04:43.047678] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-07T21:04:43.847726] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-07T21:04:43.994575] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T21:04:44.413454] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T21:04:44.647633] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-07T21:04:44.717122] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T21:04:45.447709] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-07T21:04:46.159083] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T21:04:46.247621] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-07T21:04:47.031236] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T21:04:47.047603] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-07T21:04:47.658603] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:04:47.847601] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-07T21:04:48.568127] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T21:04:48.647609] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-07T21:04:49.308795] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:04:49.309869] [INFO ] [REMOTE ] PSF: Full fetch complete (9867 records). [2025-10-07T21:04:49.309960] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-07T21:04:49.452307] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-07T21:04:49.704884] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-07T21:04:49.705107] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-07T21:04:49.705398] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-07T21:04:49.705470] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-07T21:04:49.731165] [DEBUG] [LOCAL ] PSF: Trimmed 9867 records to 6979 (keeping 200 days of data) [2025-10-07T21:04:49.734311] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T21:04:49.789903] [DEBUG] [LOCAL ] PSF: Primary data saved (6979 records). [2025-10-07T21:04:49.790062] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-07T21:04:49.790152] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSF took 35.8s. Estimated remaining: 1h 28m 57s. Rate: 7.1 symbols/min [2025-10-07T21:04:49.962627] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:04:50.002450] [DEBUG] [LOCAL ] PSQH: Loaded 34901 existing records from primary storage. [2025-10-07T21:04:50.002759] [INFO ] [MAIN ] PSQH: Loaded 34901 existing records. [2025-10-07T21:04:50.174901] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:04:50.175114] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-07T21:04:50.175162] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-07T21:04:50.175374] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-07T21:04:50.175430] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-07T21:04:50.252809] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-07T21:04:50.533210] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:04:50.911772] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T21:04:51.047726] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-07T21:04:51.847636] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-07T21:04:52.122687] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-07T21:04:52.399163] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T21:04:52.401305] [INFO ] [REMOTE ] PSFE: Full fetch complete (42860 records). [2025-10-07T21:04:52.401494] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-07T21:04:52.402342] [FATAL] [VALIDATOR ] PSFE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:04:52.402446] [FATAL] [MAIN ] PSFE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:04:52.402532] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:04:52.402672] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-07T21:04:52.402765] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-07T21:04:52.402804] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-07T21:04:52.402951] [DEBUG] [LOCAL ] PSFE: Deleted derivative data file. [2025-10-07T21:04:52.403054] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSFE took 29.7s. Estimated remaining: 1h 28m 47s. Rate: 7.1 symbols/min [2025-10-07T21:04:52.582909] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:04:52.633878] [DEBUG] [LOCAL ] PSTG: Loaded 52841 existing records from primary storage. [2025-10-07T21:04:52.634243] [INFO ] [MAIN ] PSTG: Loaded 52841 existing records. [2025-10-07T21:04:52.654490] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-07T21:04:52.820759] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:04:52.820994] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-07T21:04:52.821153] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-07T21:04:52.821506] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-10-07T21:04:52.821565] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-07T21:04:52.951375] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T21:04:53.251616] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:04:53.447635] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-07T21:04:54.247680] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-07T21:04:54.526908] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-07T21:04:55.047666] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-07T21:04:55.558526] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-07T21:04:55.825297] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T21:04:55.847611] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-07T21:04:56.647737] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-07T21:04:57.087408] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-07T21:04:57.447633] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-07T21:04:57.875435] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-07T21:04:58.247625] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-07T21:04:58.505292] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T21:04:59.047757] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-07T21:04:59.300742] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-07T21:04:59.847686] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-07T21:05:00.084345] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T21:05:00.647748] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-07T21:05:00.909823] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T21:05:01.447630] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-07T21:05:01.619988] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T21:05:02.247715] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-07T21:05:02.632262] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T21:05:03.047705] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-07T21:05:03.381229] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-07T21:05:03.508978] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T21:05:03.847743] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-07T21:05:04.647636] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-07T21:05:04.773142] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T21:05:05.454387] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-07T21:05:05.459392] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T21:05:06.253176] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-07T21:05:06.278382] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T21:05:06.914879] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T21:05:07.047754] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-07T21:05:07.847627] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-07T21:05:08.328499] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-07T21:05:08.368570] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T21:05:08.647628] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-07T21:05:09.447615] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-07T21:05:09.545128] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T21:05:10.247620] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-07T21:05:10.632670] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-07T21:05:10.671476] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-07T21:05:11.047732] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-07T21:05:11.699766] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T21:05:11.753871] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T21:05:11.756162] [INFO ] [REMOTE ] PSO: Full fetch complete (51736 records). [2025-10-07T21:05:11.756251] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-07T21:05:11.757201] [FATAL] [VALIDATOR ] PSO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:05:11.757293] [FATAL] [MAIN ] PSO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:05:11.757339] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:05:11.757405] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-07T21:05:11.757480] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-07T21:05:11.757554] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-07T21:05:11.757757] [DEBUG] [LOCAL ] PSO: Deleted derivative data file. [2025-10-07T21:05:11.757852] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSO took 29.7s. Estimated remaining: 1h 28m 42s. Rate: 7.1 symbols/min [2025-10-07T21:05:11.852773] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-07T21:05:11.974007] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:05:11.997152] [DEBUG] [LOCAL ] PSTL: Loaded 20041 existing records from primary storage. [2025-10-07T21:05:11.997443] [INFO ] [MAIN ] PSTL: Loaded 20041 existing records. [2025-10-07T21:05:12.210416] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:05:12.210734] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-07T21:05:12.210840] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-07T21:05:12.211088] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-07T21:05:12.211161] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-07T21:05:12.623612] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:05:12.647598] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-07T21:05:13.447637] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-07T21:05:13.524252] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:05:13.787431] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T21:05:14.247633] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-07T21:05:15.047631] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-07T21:05:15.304565] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T21:05:15.847616] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-07T21:05:15.886563] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T21:05:15.916741] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T21:05:16.647705] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-07T21:05:17.447716] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-07T21:05:17.834760] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-07T21:05:18.247614] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-07T21:05:18.477693] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T21:05:18.562436] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T21:05:19.047709] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-07T21:05:19.847634] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-07T21:05:20.066039] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-07T21:05:20.647615] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-07T21:05:20.702154] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T21:05:21.447614] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-07T21:05:21.510705] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T21:05:21.514899] [INFO ] [REMOTE ] PSQH: Full fetch complete (53165 records). [2025-10-07T21:05:21.514992] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-07T21:05:21.515730] [FATAL] [VALIDATOR ] PSQH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:05:21.515819] [FATAL] [MAIN ] PSQH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:05:21.515862] [WARN ] [MAIN ] PSQH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:05:21.515903] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-07T21:05:21.515978] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-07T21:05:21.516034] [INFO ] [LOCAL ] PSQH: Starting deletion of derivative data. [2025-10-07T21:05:21.516319] [DEBUG] [LOCAL ] PSQH: Deleted derivative data file. [2025-10-07T21:05:21.516414] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSQH took 31.7s. Estimated remaining: 1h 28m 34s. Rate: 7.1 symbols/min [2025-10-07T21:05:21.684522] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:05:21.684732] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-07T21:05:21.684779] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-07T21:05:21.684887] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-07T21:05:21.684928] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-07T21:05:21.684970] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-07T21:05:21.685002] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-07T21:05:22.037716] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:05:22.066034] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-07T21:05:22.247607] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-07T21:05:22.330074] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T21:05:23.047744] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-07T21:05:23.847634] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-07T21:05:24.155593] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T21:05:24.647624] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-07T21:05:24.805763] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T21:05:25.114513] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T21:05:25.447683] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-07T21:05:26.247699] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-07T21:05:26.569910] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-07T21:05:26.609359] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-07T21:05:26.612700] [INFO ] [REMOTE ] PSTG: Full fetch complete (76158 records). [2025-10-07T21:05:26.612836] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-07T21:05:26.613933] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:05:26.614029] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:05:26.614072] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:05:26.614113] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-07T21:05:26.614190] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-07T21:05:26.614245] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-07T21:05:26.614487] [DEBUG] [LOCAL ] PSTG: Deleted derivative data file. [2025-10-07T21:05:26.614595] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSTG took 34.2s. Estimated remaining: 1h 28m 24s. Rate: 7.1 symbols/min [2025-10-07T21:05:26.793768] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:05:26.810474] [DEBUG] [LOCAL ] PTA: Loaded 14982 existing records from primary storage. [2025-10-07T21:05:26.810762] [INFO ] [MAIN ] PTA: Loaded 14982 existing records. [2025-10-07T21:05:26.997913] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:05:26.998593] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-07T21:05:26.998732] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-07T21:05:26.999120] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-07T21:05:26.999181] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-07T21:05:27.060160] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-07T21:05:27.360186] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:05:27.391377] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T21:05:27.847698] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-07T21:05:28.570798] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:05:28.573787] [INFO ] [REMOTE ] PSN: Full fetch complete (66743 records). [2025-10-07T21:05:28.573965] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-07T21:05:28.574810] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:05:28.574896] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:05:28.574963] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:05:28.575018] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-07T21:05:28.575080] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-07T21:05:28.575116] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-07T21:05:28.575353] [DEBUG] [LOCAL ] PSN: Deleted derivative data file. [2025-10-07T21:05:28.575468] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSN took 50.6s. Estimated remaining: 1h 28m 14s. Rate: 7.1 symbols/min [2025-10-07T21:05:28.649371] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-07T21:05:28.748530] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:05:28.785385] [DEBUG] [LOCAL ] PTY: Loaded 37336 existing records from primary storage. [2025-10-07T21:05:28.785922] [INFO ] [MAIN ] PTY: Loaded 37336 existing records. [2025-10-07T21:05:28.965098] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:05:28.965442] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-07T21:05:28.965604] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-07T21:05:28.965959] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-07T21:05:28.966021] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-07T21:05:29.238718] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-07T21:05:29.358606] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:05:29.447720] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-07T21:05:29.999533] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T21:05:30.247730] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-07T21:05:30.670331] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-07T21:05:31.047729] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-07T21:05:31.847717] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-07T21:05:32.234041] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-07T21:05:32.656185] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-07T21:05:32.663114] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T21:05:32.977270] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-07T21:05:33.447681] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-07T21:05:34.247686] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-07T21:05:34.786771] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-07T21:05:34.855871] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T21:05:35.047701] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-07T21:05:35.301142] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-07T21:05:35.847626] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-07T21:05:36.153308] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T21:05:36.647675] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-07T21:05:37.447613] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-07T21:05:37.760225] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T21:05:38.128536] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-07T21:05:38.247618] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-07T21:05:38.634407] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-07T21:05:39.047666] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-07T21:05:39.847704] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-07T21:05:40.199093] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T21:05:40.279610] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-07T21:05:40.547600] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T21:05:40.647697] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-07T21:05:41.447693] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-07T21:05:41.599263] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T21:05:42.247691] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-07T21:05:43.047750] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-07T21:05:43.602494] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-07T21:05:43.847692] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-07T21:05:43.908170] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T21:05:44.007209] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T21:05:44.647746] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-07T21:05:45.447630] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-07T21:05:45.813837] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-07T21:05:46.025448] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T21:05:46.027265] [INFO ] [REMOTE ] PSTL: Full fetch complete (29621 records). [2025-10-07T21:05:46.027343] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-07T21:05:46.027885] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:05:46.027970] [FATAL] [MAIN ] PSTL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:05:46.028041] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:05:46.028115] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-07T21:05:46.028193] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-07T21:05:46.028249] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-07T21:05:46.028432] [DEBUG] [LOCAL ] PSTL: Deleted derivative data file. [2025-10-07T21:05:46.028525] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTL took 34.3s. Estimated remaining: 1h 28m 8s. Rate: 7.1 symbols/min [2025-10-07T21:05:46.200917] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:05:46.244067] [DEBUG] [LOCAL ] PUK: Loaded 44658 existing records from primary storage. [2025-10-07T21:05:46.244420] [INFO ] [MAIN ] PUK: Loaded 44658 existing records. [2025-10-07T21:05:46.255201] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-07T21:05:46.433610] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:05:46.434007] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-07T21:05:46.434197] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-07T21:05:46.454287] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-07T21:05:46.454485] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-07T21:05:46.488843] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T21:05:46.818379] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:05:47.047635] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-07T21:05:47.847624] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-07T21:05:48.297538] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T21:05:48.647711] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-07T21:05:48.894325] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T21:05:48.956352] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T21:05:49.297608] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T21:05:49.300853] [INFO ] [REMOTE ] PSX: Full fetch complete (76658 records). [2025-10-07T21:05:49.300960] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-07T21:05:49.301605] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:05:49.301713] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:05:49.301756] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:05:49.301795] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-07T21:05:49.301853] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-07T21:05:49.301888] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-07T21:05:49.301932] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-07T21:05:49.301991] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSX took 27.8s. Estimated remaining: 1h 27m 58s. Rate: 7.1 symbols/min [2025-10-07T21:05:49.473867] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:05:49.453332] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-07T21:05:49.518554] [DEBUG] [LOCAL ] PUMP: Loaded 49373 existing records from primary storage. [2025-10-07T21:05:49.518936] [INFO ] [MAIN ] PUMP: Loaded 49373 existing records. [2025-10-07T21:05:49.692748] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:05:49.692962] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-07T21:05:49.693011] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-07T21:05:49.693303] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-10-07T21:05:49.693360] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-07T21:05:50.043227] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:05:50.247696] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-07T21:05:51.047755] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-07T21:05:51.250759] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T21:05:51.847706] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-07T21:05:52.057701] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T21:05:52.131710] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T21:05:52.647704] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-07T21:05:53.438541] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T21:05:53.447798] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-07T21:05:53.763101] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T21:05:54.247708] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-07T21:05:54.790911] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T21:05:55.047633] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-07T21:05:55.358608] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T21:05:55.847696] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-07T21:05:56.322049] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:05:56.324405] [INFO ] [REMOTE ] PTA: Full fetch complete (23002 records). [2025-10-07T21:05:56.324549] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-07T21:05:56.325056] [FATAL] [VALIDATOR ] PTA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:05:56.325141] [FATAL] [MAIN ] PTA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:05:56.325188] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:05:56.325235] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-07T21:05:56.325332] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-07T21:05:56.325400] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-07T21:05:56.325595] [DEBUG] [LOCAL ] PTA: Deleted derivative data file. [2025-10-07T21:05:56.325751] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PTA took 29.7s. Estimated remaining: 1h 27m 49s. Rate: 7.1 symbols/min [2025-10-07T21:05:56.500437] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:05:56.549776] [DEBUG] [LOCAL ] PVH: Loaded 50263 existing records from primary storage. [2025-10-07T21:05:56.550101] [INFO ] [MAIN ] PVH: Loaded 50263 existing records. [2025-10-07T21:05:56.647996] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-07T21:05:56.729416] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:05:56.729836] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-07T21:05:56.730004] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-07T21:05:56.730565] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-10-07T21:05:56.730624] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-07T21:05:56.937479] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T21:05:57.152850] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:05:57.447695] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-07T21:05:58.215712] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T21:05:58.247606] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-07T21:05:59.047690] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-07T21:05:59.167240] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T21:05:59.847629] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-07T21:06:00.045802] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T21:06:00.647760] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-07T21:06:01.013139] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-07T21:06:01.447752] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-07T21:06:01.804159] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T21:06:02.247707] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-07T21:06:02.465110] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T21:06:02.693155] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T21:06:03.047762] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-07T21:06:03.811053] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T21:06:03.847724] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-07T21:06:04.643540] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T21:06:04.653575] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-07T21:06:05.393622] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T21:06:05.447692] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-07T21:06:06.247702] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-07T21:06:06.443115] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T21:06:06.631914] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T21:06:07.047763] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-07T21:06:07.709470] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T21:06:07.847731] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-07T21:06:08.647725] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-07T21:06:09.008684] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T21:06:09.123896] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T21:06:09.127242] [INFO ] [REMOTE ] PTY: Full fetch complete (53909 records). [2025-10-07T21:06:09.127373] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-07T21:06:09.452919] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-07T21:06:09.508489] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-07T21:06:09.508589] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-07T21:06:09.509545] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-07T21:06:09.509614] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-07T21:06:09.510813] [DEBUG] [LOCAL ] PTY: Trimmed 53909 records to 37381 (keeping 200 days of data) [2025-10-07T21:06:09.744107] [DEBUG] [LOCAL ] PTY: Primary data saved (37381 records). [2025-10-07T21:06:09.744269] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-07T21:06:09.744398] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTY took 41.2s. Estimated remaining: 1h 27m 43s. Rate: 7.1 symbols/min [2025-10-07T21:06:09.920111] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:06:09.927844] [DEBUG] [LOCAL ] PVL: Loaded 4697 existing records from primary storage. [2025-10-07T21:06:09.928095] [INFO ] [MAIN ] PVL: Loaded 4697 existing records. [2025-10-07T21:06:10.137407] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:06:10.137739] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-07T21:06:10.137836] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-07T21:06:10.138151] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-07T21:06:10.138281] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-07T21:06:10.254678] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-07T21:06:10.269605] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T21:06:10.542489] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:06:11.047708] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-07T21:06:11.449106] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T21:06:11.847747] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-07T21:06:12.468355] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-07T21:06:12.647616] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-07T21:06:12.899734] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T21:06:13.447725] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-07T21:06:13.578758] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T21:06:14.247620] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-07T21:06:14.476711] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T21:06:14.604348] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T21:06:15.047624] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-07T21:06:15.653019] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T21:06:15.693153] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-07T21:06:15.847728] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-07T21:06:16.556869] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T21:06:16.647704] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-07T21:06:17.447679] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-07T21:06:18.195605] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T21:06:18.247694] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-07T21:06:18.593857] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T21:06:19.047675] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-07T21:06:19.759110] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T21:06:19.847694] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-07T21:06:20.067382] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T21:06:20.596551] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T21:06:20.647637] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-07T21:06:21.446012] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T21:06:21.447958] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-07T21:06:22.247742] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-07T21:06:23.047683] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-07T21:06:23.424713] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-07T21:06:23.782700] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T21:06:23.847699] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-07T21:06:24.444984] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-07T21:06:24.446056] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T21:06:24.462704] [INFO ] [REMOTE ] PUMP: Full fetch complete (71326 records). [2025-10-07T21:06:24.462856] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-07T21:06:24.463696] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:06:24.463801] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:06:24.463853] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:06:24.463919] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-07T21:06:24.464023] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-07T21:06:24.464093] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-07T21:06:24.464372] [DEBUG] [LOCAL ] PUMP: Deleted derivative data file. [2025-10-07T21:06:24.464472] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PUMP took 35.2s. Estimated remaining: 1h 27m 36s. Rate: 7.1 symbols/min [2025-10-07T21:06:24.637929] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:06:24.638143] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-07T21:06:24.638187] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-07T21:06:24.638322] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-07T21:06:24.638374] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-07T21:06:24.638416] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-07T21:06:24.638447] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-07T21:06:24.652728] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-07T21:06:24.998934] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:06:25.447728] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-07T21:06:26.247629] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-07T21:06:26.502415] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T21:06:27.047698] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-07T21:06:27.485268] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T21:06:27.595213] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-07T21:06:27.650191] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T21:06:27.847704] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-07T21:06:28.647709] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-07T21:06:29.447709] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-07T21:06:29.668761] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T21:06:30.126560] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-07T21:06:30.247730] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-07T21:06:30.526596] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T21:06:30.557470] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-07T21:06:30.558339] [INFO ] [REMOTE ] PVL: Full fetch complete (7366 records). [2025-10-07T21:06:30.558415] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-07T21:06:30.558906] [FATAL] [VALIDATOR ] PVL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:06:30.559021] [FATAL] [MAIN ] PVL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:06:30.559067] [WARN ] [MAIN ] PVL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:06:30.559136] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-07T21:06:30.559247] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-07T21:06:30.559343] [INFO ] [LOCAL ] PVL: Starting deletion of derivative data. [2025-10-07T21:06:30.559722] [DEBUG] [LOCAL ] PVL: Deleted derivative data file. [2025-10-07T21:06:30.559840] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PVL took 20.8s. Estimated remaining: 1h 27m 27s. Rate: 7.1 symbols/min [2025-10-07T21:06:30.751852] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:06:30.785802] [DEBUG] [LOCAL ] PX: Loaded 34376 existing records from primary storage. [2025-10-07T21:06:30.786111] [INFO ] [MAIN ] PX: Loaded 34376 existing records. [2025-10-07T21:06:30.964598] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:06:30.964880] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-07T21:06:30.964933] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-07T21:06:30.965183] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-10-07T21:06:30.965242] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-07T21:06:31.052928] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-07T21:06:31.316360] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:06:31.847705] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-07T21:06:32.647611] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-07T21:06:33.049756] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-07T21:06:33.172342] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T21:06:33.447629] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-07T21:06:34.247737] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-07T21:06:34.456717] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T21:06:34.974903] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T21:06:35.047699] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-07T21:06:35.623755] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T21:06:35.627152] [INFO ] [REMOTE ] PVH: Full fetch complete (70556 records). [2025-10-07T21:06:35.627309] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-07T21:06:35.628059] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:06:35.628163] [FATAL] [MAIN ] PVH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:06:35.628214] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:06:35.628261] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-07T21:06:35.628325] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-07T21:06:35.628359] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-07T21:06:35.628512] [DEBUG] [LOCAL ] PVH: Deleted derivative data file. [2025-10-07T21:06:35.628607] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVH took 39.3s. Estimated remaining: 1h 27m 17s. Rate: 7.1 symbols/min [2025-10-07T21:06:35.808210] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:06:35.827553] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-07T21:06:35.828233] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-07T21:06:35.828428] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-07T21:06:35.828484] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-07T21:06:35.829340] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T21:06:35.837057] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-07T21:06:35.837621] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-07T21:06:35.852796] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-07T21:06:36.189167] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:06:36.561978] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T21:06:36.565497] [INFO ] [REMOTE ] PUK: Full fetch complete (64902 records). [2025-10-07T21:06:36.565716] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-07T21:06:36.566925] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:06:36.567046] [FATAL] [MAIN ] PUK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:06:36.567090] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:06:36.567159] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-07T21:06:36.567232] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-07T21:06:36.567268] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-07T21:06:36.567783] [DEBUG] [LOCAL ] PUK: Deleted derivative data file. [2025-10-07T21:06:36.567888] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PUK took 50.5s. Estimated remaining: 1h 27m 6s. Rate: 7.1 symbols/min [2025-10-07T21:06:36.652813] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-07T21:06:36.800010] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:06:36.827024] [DEBUG] [LOCAL ] QD: Loaded 27749 existing records from primary storage. [2025-10-07T21:06:36.827302] [INFO ] [MAIN ] QD: Loaded 27749 existing records. [2025-10-07T21:06:37.004012] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:06:37.004276] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-07T21:06:37.004326] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-07T21:06:37.004570] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-07T21:06:37.004629] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-07T21:06:37.357957] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:06:37.447606] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-07T21:06:38.247678] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-07T21:06:38.853351] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T21:06:39.047680] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-07T21:06:39.562188] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-10-07T21:06:39.847683] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-07T21:06:40.088814] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T21:06:40.218305] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T21:06:40.647678] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-07T21:06:41.447694] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-07T21:06:41.944045] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T21:06:42.247688] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-07T21:06:42.420217] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-07T21:06:43.047615] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-07T21:06:43.154184] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T21:06:43.656819] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T21:06:43.847624] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-07T21:06:44.647704] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-07T21:06:45.347992] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T21:06:45.447705] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-07T21:06:45.756617] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-07T21:06:46.253213] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-07T21:06:46.256462] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T21:06:46.417914] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T21:06:47.047732] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-07T21:06:47.775975] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T21:06:47.847637] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-07T21:06:48.647699] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-07T21:06:49.402631] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T21:06:49.447671] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-07T21:06:49.512683] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-07T21:06:49.796894] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T21:06:50.247758] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-07T21:06:51.047762] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-07T21:06:51.356799] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-07T21:06:51.493808] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T21:06:51.847762] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-07T21:06:52.647695] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-07T21:06:52.708276] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T21:06:53.447754] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-07T21:06:53.742089] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T21:06:54.247717] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-07T21:06:54.884204] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T21:06:55.047711] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-07T21:06:55.438896] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-07T21:06:55.853584] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-07T21:06:55.866404] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T21:06:56.377029] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T21:06:56.647638] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-07T21:06:57.447686] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-07T21:06:58.078686] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:06:58.081055] [INFO ] [REMOTE ] QD: Full fetch complete (39887 records). [2025-10-07T21:06:58.081162] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-07T21:06:58.082028] [FATAL] [VALIDATOR ] QD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:06:58.082125] [FATAL] [MAIN ] QD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:06:58.082169] [WARN ] [MAIN ] QD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:06:58.082215] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-07T21:06:58.082275] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-07T21:06:58.082310] [INFO ] [LOCAL ] QD: Starting deletion of derivative data. [2025-10-07T21:06:58.082606] [DEBUG] [LOCAL ] QD: Deleted derivative data file. [2025-10-07T21:06:58.082752] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. QD took 21.5s. Estimated remaining: 1h 27m 2s. Rate: 7.1 symbols/min [2025-10-07T21:06:58.252725] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-07T21:06:58.279077] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:06:58.328220] [DEBUG] [LOCAL ] QGEN: Loaded 49157 existing records from primary storage. [2025-10-07T21:06:58.328748] [INFO ] [MAIN ] QGEN: Loaded 49157 existing records. [2025-10-07T21:06:58.545841] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:06:58.549529] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-07T21:06:58.549843] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-07T21:06:58.549938] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-07T21:06:58.561697] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-07T21:06:58.561774] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-07T21:06:58.946238] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:06:58.983374] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-10-07T21:06:59.047634] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-07T21:06:59.759824] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T21:06:59.847691] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-07T21:07:00.647697] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-07T21:07:01.103337] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-07T21:07:01.404079] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:07:01.447737] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-07T21:07:02.247796] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-07T21:07:03.048340] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-07T21:07:03.073558] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T21:07:03.090453] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T21:07:03.097422] [INFO ] [REMOTE ] PWR: Full fetch complete (68452 records). [2025-10-07T21:07:03.097766] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-07T21:07:03.099221] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:07:03.099332] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:07:03.099378] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:07:03.099458] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-07T21:07:03.099541] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-07T21:07:03.099582] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-07T21:07:03.099624] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-07T21:07:03.099736] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PWR took 38.6s. Estimated remaining: 1h 26m 53s. Rate: 7.1 symbols/min [2025-10-07T21:07:03.277544] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:07:03.335600] [DEBUG] [LOCAL ] QS: Loaded 53745 existing records from primary storage. [2025-10-07T21:07:03.336084] [INFO ] [MAIN ] QS: Loaded 53745 existing records. [2025-10-07T21:07:03.543017] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:07:03.543525] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-07T21:07:03.543615] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-07T21:07:03.544070] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-10-07T21:07:03.544146] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-07T21:07:03.698267] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (3.05 seconds). [2025-10-07T21:07:03.852829] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-07T21:07:03.960597] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:07:04.647631] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-07T21:07:04.881262] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T21:07:05.447736] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-07T21:07:06.121370] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T21:07:06.247702] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-07T21:07:06.410743] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-07T21:07:07.047749] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-07T21:07:07.351237] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T21:07:07.847751] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-07T21:07:08.020338] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-07T21:07:08.528684] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T21:07:08.647688] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-07T21:07:09.447753] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-07T21:07:10.248100] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-07T21:07:10.525168] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T21:07:10.810368] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.96 seconds). [2025-10-07T21:07:10.967241] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:07:10.969317] [INFO ] [REMOTE ] PX: Full fetch complete (50295 records). [2025-10-07T21:07:10.969457] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-07T21:07:10.970291] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:07:10.970389] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:07:10.970432] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:07:10.970471] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-07T21:07:10.970534] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-07T21:07:10.970570] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-07T21:07:10.970750] [DEBUG] [LOCAL ] PX: Deleted derivative data file. [2025-10-07T21:07:10.970877] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. PX took 40.4s. Estimated remaining: 1h 26m 44s. Rate: 7.1 symbols/min [2025-10-07T21:07:11.052967] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-07T21:07:11.145786] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:07:11.200744] [DEBUG] [LOCAL ] QSR: Loaded 52452 existing records from primary storage. [2025-10-07T21:07:11.201158] [INFO ] [MAIN ] QSR: Loaded 52452 existing records. [2025-10-07T21:07:11.381359] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:07:11.381632] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-07T21:07:11.381724] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-07T21:07:11.382156] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-07T21:07:11.382213] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-07T21:07:11.750629] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:07:11.817688] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-07T21:07:11.847610] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-07T21:07:12.647772] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-07T21:07:13.215883] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-07T21:07:13.447620] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-07T21:07:14.116542] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-07T21:07:14.247742] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-07T21:07:14.490157] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T21:07:15.047683] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-07T21:07:15.847621] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-07T21:07:16.017941] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-07T21:07:16.481608] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T21:07:16.589498] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-07T21:07:16.647614] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-07T21:07:17.447623] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-07T21:07:17.491480] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T21:07:18.057256] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T21:07:18.060523] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-07T21:07:18.060738] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-07T21:07:18.063020] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:07:18.063126] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:07:18.063174] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:07:18.063229] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-07T21:07:18.063344] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-07T21:07:18.063403] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-07T21:07:18.063451] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-07T21:07:18.063528] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QBTS took 42.4s. Estimated remaining: 1h 26m 35s. Rate: 7.1 symbols/min [2025-10-07T21:07:18.234174] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:07:18.247765] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-07T21:07:18.276625] [DEBUG] [LOCAL ] QTWO: Loaded 39198 existing records from primary storage. [2025-10-07T21:07:18.277027] [INFO ] [MAIN ] QTWO: Loaded 39198 existing records. [2025-10-07T21:07:18.460130] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:07:18.460433] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-07T21:07:18.460491] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-07T21:07:18.460818] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-07T21:07:18.460876] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-07T21:07:18.826723] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:07:18.995152] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-07T21:07:19.047715] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-07T21:07:19.847707] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-07T21:07:20.085903] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T21:07:20.647703] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-07T21:07:20.731476] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T21:07:21.447639] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-07T21:07:21.552500] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T21:07:22.247695] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-07T21:07:22.985564] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-07T21:07:23.049044] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-07T21:07:23.051717] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T21:07:23.769843] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T21:07:23.847682] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-07T21:07:24.647699] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-07T21:07:25.256169] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-07T21:07:25.447699] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-07T21:07:25.752092] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T21:07:26.247632] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-07T21:07:26.684057] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-07T21:07:26.765014] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T21:07:27.047638] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-07T21:07:27.847630] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-07T21:07:28.647625] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-07T21:07:28.814229] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T21:07:29.134733] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-07T21:07:29.447623] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-07T21:07:29.702154] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T21:07:30.168903] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T21:07:30.247605] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-07T21:07:31.047712] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-07T21:07:31.847691] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-07T21:07:31.958626] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-07T21:07:32.238083] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T21:07:32.387930] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T21:07:32.477242] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:07:32.480326] [INFO ] [REMOTE ] QGEN: Full fetch complete (69858 records). [2025-10-07T21:07:32.480426] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-07T21:07:32.481212] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:07:32.481319] [FATAL] [MAIN ] QGEN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:07:32.481396] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:07:32.481504] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-07T21:07:32.481586] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-07T21:07:32.481623] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-07T21:07:32.481874] [DEBUG] [LOCAL ] QGEN: Deleted derivative data file. [2025-10-07T21:07:32.481966] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QGEN took 34.4s. Estimated remaining: 1h 26m 29s. Rate: 7.1 symbols/min [2025-10-07T21:07:32.647703] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-07T21:07:33.447707] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-07T21:07:34.247722] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-07T21:07:35.371872] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T21:07:35.381399] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-07T21:07:35.526779] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-07T21:07:35.847730] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-07T21:07:36.168230] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-07T21:07:36.431051] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-07T21:07:36.564747] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:07:36.568533] [INFO ] [REMOTE ] QS: Full fetch complete (77496 records). [2025-10-07T21:07:36.568739] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-07T21:07:36.569907] [FATAL] [VALIDATOR ] QS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:07:36.570030] [FATAL] [MAIN ] QS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:07:36.570117] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:07:36.570225] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-07T21:07:36.570340] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-07T21:07:36.570417] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-07T21:07:36.570638] [DEBUG] [LOCAL ] QS: Deleted derivative data file. [2025-10-07T21:07:36.570800] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QS took 33.5s. Estimated remaining: 1h 26m 19s. Rate: 7.1 symbols/min [2025-10-07T21:07:36.647701] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-07T21:07:37.447744] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-07T21:07:38.255439] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T21:07:38.267557] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-07T21:07:38.933816] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T21:07:39.047623] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-07T21:07:40.164543] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T21:07:40.176452] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-07T21:07:40.289401] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T21:07:40.647724] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-07T21:07:42.118060] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T21:07:42.130314] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-07T21:07:42.355874] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T21:07:42.366560] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-07T21:07:42.964052] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T21:07:42.967786] [INFO ] [REMOTE ] QSR: Full fetch complete (75465 records). [2025-10-07T21:07:42.967946] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-07T21:07:42.969250] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:07:42.969350] [FATAL] [MAIN ] QSR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:07:42.969396] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:07:42.969437] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-07T21:07:42.969507] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-07T21:07:42.969543] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-07T21:07:42.969777] [DEBUG] [LOCAL ] QSR: Deleted derivative data file. [2025-10-07T21:07:42.969883] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QSR took 32.0s. Estimated remaining: 1h 26m 10s. Rate: 7.1 symbols/min [2025-10-07T21:07:43.001274] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:07:43.004272] [INFO ] [REMOTE ] QTWO: Full fetch complete (57273 records). [2025-10-07T21:07:43.004375] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-07T21:07:43.005071] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:07:43.005163] [FATAL] [MAIN ] QTWO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:07:43.005209] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:07:43.005285] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-07T21:07:43.005384] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-07T21:07:43.005461] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-07T21:07:43.005682] [DEBUG] [LOCAL ] QTWO: Deleted derivative data file. [2025-10-07T21:07:43.005792] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QTWO took 24.9s. Estimated remaining: 1h 25m 58s. Rate: 7.1 symbols/min [2025-10-07T21:07:43.586541] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:07:43.683483] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:07:43.733545] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:07:43.754165] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:07:43.766726] [DEBUG] [LOCAL ] QVCD: Loaded 4548 existing records from primary storage. [2025-10-07T21:07:43.767036] [INFO ] [MAIN ] QVCD: Loaded 4548 existing records. [2025-10-07T21:07:43.794232] [DEBUG] [LOCAL ] QVCC: Loaded 8892 existing records from primary storage. [2025-10-07T21:07:43.810956] [INFO ] [MAIN ] QVCC: Loaded 8892 existing records. [2025-10-07T21:07:43.984909] [DEBUG] [LOCAL ] QUAD: Loaded 23420 existing records from primary storage. [2025-10-07T21:07:44.030702] [INFO ] [MAIN ] QUAD: Loaded 23420 existing records. [2025-10-07T21:07:44.252601] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:07:44.287871] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:07:44.295307] [DEBUG] [LOCAL ] QXO: Loaded 53309 existing records from primary storage. [2025-10-07T21:07:44.311549] [INFO ] [MAIN ] QXO: Loaded 53309 existing records. [2025-10-07T21:07:44.311398] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-07T21:07:44.320428] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-07T21:07:44.332742] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-07T21:07:44.320639] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-07T21:07:44.375795] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-07T21:07:44.370501] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-07T21:07:44.381257] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-07T21:07:44.387135] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-07T21:07:44.722410] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:07:44.815012] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-07T21:07:44.892557] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:07:44.916936] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-07T21:07:44.903137] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-07T21:07:45.000365] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-07T21:07:45.053945] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-10-07T21:07:45.093131] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-07T21:07:45.123076] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-07T21:07:45.147531] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-07T21:07:45.541721] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:07:45.592870] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-07T21:07:45.632760] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:07:45.658963] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-07T21:07:46.171286] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:07:46.188201] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-07T21:07:46.194707] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:07:46.195994] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-07T21:07:46.480620] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-07T21:07:46.482437] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-07T21:07:46.648280] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T21:07:47.047755] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-07T21:07:47.178711] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-07T21:07:47.806143] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T21:07:47.847597] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-07T21:07:47.943554] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T21:07:47.973681] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:07:48.647604] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-07T21:07:49.048982] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T21:07:49.299165] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-07T21:07:49.447706] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-07T21:07:50.247705] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-07T21:07:50.691986] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T21:07:51.047692] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-07T21:07:51.847629] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-07T21:07:51.961317] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T21:07:52.304951] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T21:07:52.647707] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-07T21:07:52.723810] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-07T21:07:53.197445] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T21:07:53.447679] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-07T21:07:54.247702] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-07T21:07:54.788595] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T21:07:54.801617] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T21:07:55.047632] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-07T21:07:55.847701] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-07T21:07:56.476946] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T21:07:56.647701] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-07T21:07:57.260388] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:07:57.294180] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-07T21:07:57.447712] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-07T21:07:58.229918] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T21:07:58.247598] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-07T21:07:58.876267] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T21:07:59.047700] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-07T21:07:59.847626] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-07T21:07:59.930145] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T21:08:00.590618] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T21:08:00.647613] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-07T21:08:01.309751] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T21:08:01.447721] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-07T21:08:02.154895] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-07T21:08:02.247611] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-07T21:08:03.048435] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-07T21:08:03.048898] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T21:08:03.847690] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-07T21:08:04.231500] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T21:08:04.232355] [INFO ] [REMOTE ] QVCD: Full fetch complete (6167 records). [2025-10-07T21:08:04.232425] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-07T21:08:04.232918] [FATAL] [VALIDATOR ] QVCD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:08:04.233013] [FATAL] [MAIN ] QVCD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:08:04.233056] [WARN ] [MAIN ] QVCD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:08:04.233103] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-07T21:08:04.233175] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-07T21:08:04.233230] [INFO ] [LOCAL ] QVCD: Starting deletion of derivative data. [2025-10-07T21:08:04.233439] [DEBUG] [LOCAL ] QVCD: Deleted derivative data file. [2025-10-07T21:08:04.233528] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCD took 21.2s. Estimated remaining: 1h 25m 54s. Rate: 7.1 symbols/min [2025-10-07T21:08:04.394675] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T21:08:04.428554] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:08:04.460126] [DEBUG] [LOCAL ] R: Loaded 28763 existing records from primary storage. [2025-10-07T21:08:04.460427] [INFO ] [MAIN ] R: Loaded 28763 existing records. [2025-10-07T21:08:04.655224] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-07T21:08:04.674212] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:08:04.674590] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-07T21:08:04.674673] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-07T21:08:04.674950] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-10-07T21:08:04.675010] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-07T21:08:05.096319] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:08:05.447678] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-07T21:08:05.586902] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T21:08:06.247690] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-07T21:08:06.640166] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T21:08:07.047740] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-07T21:08:07.097332] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T21:08:07.158637] [DEBUG] [REMOTE ] QUAD: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-07T21:08:07.159111] [WARN ] [REMOTE ] QUAD: No data returned for month 2025-08 [2025-10-07T21:08:07.159247] [FATAL] [REMOTE ] QUAD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:08:07.159359] [FATAL] [MAIN ] QUAD: Failed to fetch primary data. [2025-10-07T21:08:07.159441] [WARN ] [MAIN ] QUAD: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:08:07.159534] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-07T21:08:07.159620] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-07T21:08:07.159717] [INFO ] [LOCAL ] QUAD: Starting deletion of derivative data. [2025-10-07T21:08:07.159951] [DEBUG] [LOCAL ] QUAD: Deleted derivative data file. [2025-10-07T21:08:07.160085] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QUAD took 24.2s. Estimated remaining: 1h 25m 44s. Rate: 7.1 symbols/min [2025-10-07T21:08:07.377193] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:08:07.404744] [DEBUG] [LOCAL ] RA: Loaded 21763 existing records from primary storage. [2025-10-07T21:08:07.405193] [INFO ] [MAIN ] RA: Loaded 21763 existing records. [2025-10-07T21:08:07.649091] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:08:07.649346] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-07T21:08:07.649404] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-07T21:08:07.649723] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-07T21:08:07.649781] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-07T21:08:07.857024] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-07T21:08:08.010933] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:08:08.647696] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-07T21:08:09.447690] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-07T21:08:09.674886] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T21:08:09.896962] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T21:08:10.079369] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T21:08:10.247759] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-07T21:08:11.047669] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-07T21:08:11.847635] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-07T21:08:12.399319] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-07T21:08:12.536584] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T21:08:12.647709] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-07T21:08:12.719362] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T21:08:13.447748] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-07T21:08:14.061377] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:08:14.247722] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-07T21:08:14.676840] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T21:08:14.835005] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:08:14.836071] [INFO ] [REMOTE ] QVCC: Full fetch complete (11921 records). [2025-10-07T21:08:14.836146] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-07T21:08:14.836618] [FATAL] [VALIDATOR ] QVCC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:08:14.836744] [FATAL] [MAIN ] QVCC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:08:14.836792] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:08:14.836860] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-07T21:08:14.836926] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-07T21:08:14.836960] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-07T21:08:14.837177] [DEBUG] [LOCAL ] QVCC: Deleted derivative data file. [2025-10-07T21:08:14.837283] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QVCC took 31.8s. Estimated remaining: 1h 25m 35s. Rate: 7.1 symbols/min [2025-10-07T21:08:15.017573] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:08:15.056567] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-07T21:08:15.059890] [DEBUG] [LOCAL ] RACE: Loaded 32600 existing records from primary storage. [2025-10-07T21:08:15.060209] [INFO ] [MAIN ] RACE: Loaded 32600 existing records. [2025-10-07T21:08:15.270893] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:08:15.271181] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-07T21:08:15.271235] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-07T21:08:15.271471] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-07T21:08:15.271530] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-07T21:08:15.651187] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:08:15.847732] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-07T21:08:16.647696] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-07T21:08:17.326007] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-07T21:08:17.448367] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-07T21:08:17.453763] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T21:08:17.839490] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T21:08:18.247710] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-07T21:08:19.047693] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-07T21:08:19.232738] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:08:19.847691] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-07T21:08:20.251825] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-07T21:08:20.614412] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T21:08:20.647620] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-07T21:08:20.720339] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T21:08:21.447717] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-07T21:08:21.853321] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T21:08:22.247624] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-07T21:08:22.947740] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T21:08:23.047676] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-07T21:08:23.733845] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T21:08:23.847672] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-07T21:08:24.361499] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T21:08:24.647688] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-07T21:08:25.447686] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-07T21:08:25.481980] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T21:08:26.163264] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T21:08:26.247680] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-07T21:08:27.047632] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-07T21:08:27.450436] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T21:08:27.554319] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-07T21:08:27.847666] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-07T21:08:28.647612] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-07T21:08:28.992376] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T21:08:29.162961] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T21:08:29.447732] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-07T21:08:30.247623] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-07T21:08:30.651374] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T21:08:30.824959] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-07T21:08:31.047569] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-07T21:08:31.340825] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T21:08:31.847734] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-07T21:08:32.297630] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-07T21:08:32.299675] [INFO ] [REMOTE ] R: Full fetch complete (42131 records). [2025-10-07T21:08:32.299762] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-07T21:08:32.300344] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:08:32.300446] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:08:32.300616] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:08:32.300736] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-07T21:08:32.300823] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-07T21:08:32.300862] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-07T21:08:32.301073] [DEBUG] [LOCAL ] R: Deleted derivative data file. [2025-10-07T21:08:32.301167] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. R took 28.1s. Estimated remaining: 1h 25m 30s. Rate: 7.1 symbols/min [2025-10-07T21:08:32.469056] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:08:32.504221] [DEBUG] [LOCAL ] RAMP: Loaded 37446 existing records from primary storage. [2025-10-07T21:08:32.504521] [INFO ] [MAIN ] RAMP: Loaded 37446 existing records. [2025-10-07T21:08:32.652739] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-07T21:08:32.682195] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:08:32.682380] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-07T21:08:32.682427] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-07T21:08:32.682675] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-10-07T21:08:32.682733] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-07T21:08:33.039961] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:08:33.243693] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-07T21:08:33.447689] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-07T21:08:34.247621] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-07T21:08:34.487178] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T21:08:34.552108] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T21:08:34.748333] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T21:08:34.751869] [INFO ] [REMOTE ] QXO: Full fetch complete (75372 records). [2025-10-07T21:08:34.752056] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-07T21:08:34.753799] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:08:34.753907] [FATAL] [MAIN ] QXO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:08:34.753974] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:08:34.754049] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-07T21:08:34.754115] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-07T21:08:34.754150] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-07T21:08:34.754307] [DEBUG] [LOCAL ] QXO: Deleted derivative data file. [2025-10-07T21:08:34.754404] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. QXO took 51.7s. Estimated remaining: 1h 25m 19s. Rate: 7.1 symbols/min [2025-10-07T21:08:34.921215] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:08:34.966240] [DEBUG] [LOCAL ] RBA: Loaded 45793 existing records from primary storage. [2025-10-07T21:08:34.966533] [INFO ] [MAIN ] RBA: Loaded 45793 existing records. [2025-10-07T21:08:35.052848] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-07T21:08:35.144816] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:08:35.145022] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-07T21:08:35.145072] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-07T21:08:35.145359] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-10-07T21:08:35.145416] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-07T21:08:35.491411] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:08:35.847679] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-07T21:08:36.552715] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T21:08:36.647728] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-07T21:08:37.014385] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T21:08:37.447728] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-07T21:08:38.159598] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T21:08:38.247686] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-07T21:08:39.052722] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-07T21:08:39.069071] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T21:08:39.736904] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T21:08:39.847748] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-07T21:08:40.448249] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T21:08:40.647633] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-07T21:08:41.447615] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-07T21:08:41.483202] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T21:08:41.826879] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T21:08:42.247688] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-07T21:08:42.749436] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-07T21:08:43.047686] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-07T21:08:43.468311] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T21:08:43.847742] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-07T21:08:44.310054] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T21:08:44.647761] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-07T21:08:45.447637] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-07T21:08:45.552941] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T21:08:46.247668] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-07T21:08:46.340680] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T21:08:46.784810] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T21:08:47.047705] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-07T21:08:47.253794] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T21:08:47.257331] [INFO ] [REMOTE ] RA: Full fetch complete (31916 records). [2025-10-07T21:08:47.257621] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-07T21:08:47.624443] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-07T21:08:47.624545] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-07T21:08:47.625179] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-07T21:08:47.625244] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-07T21:08:47.626045] [DEBUG] [LOCAL ] RA: Trimmed 31916 records to 21836 (keeping 200 days of data) [2025-10-07T21:08:47.764617] [DEBUG] [LOCAL ] RA: Primary data saved (21836 records). [2025-10-07T21:08:47.764772] [INFO ] [MAIN ] RA: Full history saved. [2025-10-07T21:08:47.764855] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. RA took 40.6s. Estimated remaining: 1h 25m 13s. Rate: 7.1 symbols/min [2025-10-07T21:08:47.853050] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-07T21:08:47.935262] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:08:47.953411] [DEBUG] [LOCAL ] RBC: Loaded 15284 existing records from primary storage. [2025-10-07T21:08:47.953684] [INFO ] [MAIN ] RBC: Loaded 15284 existing records. [2025-10-07T21:08:48.125806] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:08:48.126044] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-07T21:08:48.126090] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-07T21:08:48.126283] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-10-07T21:08:48.126339] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-07T21:08:48.478214] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:08:48.647638] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-07T21:08:48.853373] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:08:49.447688] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-07T21:08:49.450760] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T21:08:49.893018] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T21:08:50.247729] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-07T21:08:51.047679] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-07T21:08:51.149559] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T21:08:51.847670] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-07T21:08:52.002014] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T21:08:52.108279] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T21:08:52.647719] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-07T21:08:53.447704] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-07T21:08:53.494494] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T21:08:54.069714] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-07T21:08:54.247728] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-07T21:08:54.794358] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T21:08:54.797187] [INFO ] [REMOTE ] RACE: Full fetch complete (47510 records). [2025-10-07T21:08:54.797294] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-07T21:08:54.798182] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:08:54.798277] [FATAL] [MAIN ] RACE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:08:54.798345] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:08:54.798406] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-07T21:08:54.798475] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-07T21:08:54.798512] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-07T21:08:54.798744] [DEBUG] [LOCAL ] RACE: Deleted derivative data file. [2025-10-07T21:08:54.798870] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RACE took 40.0s. Estimated remaining: 1h 25m 4s. Rate: 7.1 symbols/min [2025-10-07T21:08:54.976154] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:08:55.035750] [DEBUG] [LOCAL ] RBLX: Loaded 53714 existing records from primary storage. [2025-10-07T21:08:55.036203] [INFO ] [MAIN ] RBLX: Loaded 53714 existing records. [2025-10-07T21:08:55.057992] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-07T21:08:55.236933] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:08:55.237465] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-07T21:08:55.237622] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-07T21:08:55.237993] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-10-07T21:08:55.238145] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-07T21:08:55.695439] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-07T21:08:55.729767] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:08:55.847715] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-07T21:08:56.276481] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T21:08:56.647721] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-07T21:08:57.195494] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T21:08:57.447701] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-07T21:08:57.799227] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-07T21:08:58.247762] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-07T21:08:58.968587] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T21:08:59.047674] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-07T21:08:59.608304] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T21:08:59.611429] [INFO ] [REMOTE ] RAMP: Full fetch complete (53419 records). [2025-10-07T21:08:59.611542] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-07T21:08:59.612393] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:08:59.612528] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:08:59.612585] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:08:59.612697] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-07T21:08:59.612847] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-07T21:08:59.612912] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-07T21:08:59.613099] [DEBUG] [LOCAL ] RAMP: Deleted derivative data file. [2025-10-07T21:08:59.613213] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RAMP took 27.3s. Estimated remaining: 1h 24m 54s. Rate: 7.1 symbols/min [2025-10-07T21:08:59.792765] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:08:59.801272] [DEBUG] [LOCAL ] RBOT: Loaded 5599 existing records from primary storage. [2025-10-07T21:08:59.801498] [INFO ] [MAIN ] RBOT: Loaded 5599 existing records. [2025-10-07T21:08:59.859577] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-07T21:08:59.994238] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:08:59.994576] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-07T21:08:59.994672] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-07T21:08:59.994933] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-07T21:08:59.995004] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-07T21:09:00.380543] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:09:00.574746] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-07T21:09:00.647623] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-07T21:09:01.447677] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-07T21:09:01.722148] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T21:09:02.247636] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-07T21:09:02.628463] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T21:09:03.016233] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-07T21:09:03.047608] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-07T21:09:03.847720] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-07T21:09:03.962321] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T21:09:04.647688] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-07T21:09:05.060548] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T21:09:05.390872] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-07T21:09:05.447691] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-07T21:09:06.247713] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-07T21:09:06.454352] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T21:09:06.604205] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T21:09:06.869154] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-07T21:09:07.047736] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-07T21:09:07.847744] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-07T21:09:08.647735] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-07T21:09:09.135222] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-07T21:09:09.447714] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-07T21:09:09.595881] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T21:09:09.708306] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T21:09:10.100574] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-07T21:09:10.247720] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-07T21:09:11.047746] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-07T21:09:11.847679] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-07T21:09:12.008116] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T21:09:12.647749] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-07T21:09:12.812287] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T21:09:13.413343] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-07T21:09:13.447603] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-07T21:09:13.729897] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T21:09:14.247727] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-07T21:09:14.937404] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:09:14.942894] [INFO ] [REMOTE ] RBA: Full fetch complete (65497 records). [2025-10-07T21:09:14.943204] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-07T21:09:14.944804] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:09:14.945016] [FATAL] [MAIN ] RBA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:09:14.945086] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:09:14.945158] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-07T21:09:14.945268] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-07T21:09:14.945333] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-07T21:09:14.945734] [DEBUG] [LOCAL ] RBA: Deleted derivative data file. [2025-10-07T21:09:14.945887] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RBA took 40.2s. Estimated remaining: 1h 24m 48s. Rate: 7.1 symbols/min [2025-10-07T21:09:15.053565] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-07T21:09:15.253063] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:09:15.253771] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-07T21:09:15.253840] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-07T21:09:15.255674] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-07T21:09:15.255803] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-07T21:09:15.255892] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-07T21:09:15.255977] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-07T21:09:15.774513] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:09:15.847697] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-07T21:09:16.076597] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-07T21:09:16.229908] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T21:09:16.647746] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-07T21:09:17.395203] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T21:09:17.447736] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-07T21:09:17.660122] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T21:09:18.191505] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-07T21:09:18.247690] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-07T21:09:18.828993] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T21:09:19.047699] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-07T21:09:19.670241] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T21:09:19.847704] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-07T21:09:20.647723] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-07T21:09:21.447670] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-07T21:09:21.473737] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T21:09:21.689359] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T21:09:22.247714] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-07T21:09:23.047706] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-07T21:09:23.311799] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T21:09:23.523152] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T21:09:23.526139] [INFO ] [REMOTE ] RBC: Full fetch complete (21674 records). [2025-10-07T21:09:23.526296] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-07T21:09:23.527250] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:09:23.527372] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:09:23.527451] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:09:23.527555] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-07T21:09:23.527699] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-07T21:09:23.527779] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-07T21:09:23.528153] [DEBUG] [LOCAL ] RBC: Deleted derivative data file. [2025-10-07T21:09:23.528302] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 35.8s. Estimated remaining: 1h 24m 39s. Rate: 7.1 symbols/min [2025-10-07T21:09:23.796461] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:09:23.848073] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-07T21:09:23.864726] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-07T21:09:23.894790] [DEBUG] [LOCAL ] RC: Loaded 48920 existing records from primary storage. [2025-10-07T21:09:23.895419] [INFO ] [MAIN ] RC: Loaded 48920 existing records. [2025-10-07T21:09:24.106285] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:09:24.106622] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-07T21:09:24.106790] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-07T21:09:24.107115] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-07T21:09:24.107174] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-07T21:09:24.472706] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:09:24.647631] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-07T21:09:24.715253] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T21:09:25.447701] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-07T21:09:26.169082] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:09:26.170545] [INFO ] [REMOTE ] RBOT: Full fetch complete (8781 records). [2025-10-07T21:09:26.170673] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-07T21:09:26.171103] [FATAL] [VALIDATOR ] RBOT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:09:26.171188] [FATAL] [MAIN ] RBOT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:09:26.171231] [WARN ] [MAIN ] RBOT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:09:26.171271] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-07T21:09:26.171329] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-07T21:09:26.171364] [INFO ] [LOCAL ] RBOT: Starting deletion of derivative data. [2025-10-07T21:09:26.171590] [DEBUG] [LOCAL ] RBOT: Deleted derivative data file. [2025-10-07T21:09:26.171709] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBOT took 26.6s. Estimated remaining: 1h 24m 29s. Rate: 7.1 symbols/min [2025-10-07T21:09:26.252812] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-07T21:09:26.354475] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:09:26.354817] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-07T21:09:26.354898] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-07T21:09:26.355239] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-07T21:09:26.355447] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-07T21:09:26.355713] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-07T21:09:26.355855] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-07T21:09:26.657535] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-07T21:09:26.781144] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:09:27.047636] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-07T21:09:27.610894] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-07T21:09:27.847683] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-07T21:09:28.188557] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-07T21:09:28.435896] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T21:09:28.647700] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-07T21:09:29.322842] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-07T21:09:29.447719] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-07T21:09:30.145797] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T21:09:30.247704] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-07T21:09:30.974688] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T21:09:31.047707] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-07T21:09:31.847720] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-07T21:09:32.510600] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-07T21:09:32.647795] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-07T21:09:32.840168] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-07T21:09:33.217704] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-07T21:09:33.447728] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-07T21:09:33.921662] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T21:09:34.247721] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-07T21:09:35.047752] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-07T21:09:35.847720] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-07T21:09:36.010824] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T21:09:36.647761] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-07T21:09:37.126860] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T21:09:37.447724] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-07T21:09:38.021342] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T21:09:38.247672] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-07T21:09:38.626291] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T21:09:38.699029] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T21:09:38.703675] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-07T21:09:39.047712] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-07T21:09:39.304047] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-07T21:09:39.304941] [INFO ] [REMOTE ] RCB: Full fetch complete (3739 records). [2025-10-07T21:09:39.305015] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-07T21:09:39.305690] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:09:39.305791] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:09:39.305836] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:09:39.305881] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-07T21:09:39.305948] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-07T21:09:39.305985] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-07T21:09:39.306025] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-07T21:09:39.306084] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RCB took 13.1s. Estimated remaining: 1h 24m 22s. Rate: 7.1 symbols/min [2025-10-07T21:09:39.486511] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:09:39.486765] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-07T21:09:39.486818] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-07T21:09:39.486976] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-07T21:09:39.487036] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-07T21:09:39.487086] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-07T21:09:39.487120] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-07T21:09:39.858722] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-07T21:09:39.866971] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:09:40.647712] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-07T21:09:41.447773] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-07T21:09:41.913995] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-07T21:09:42.247664] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-07T21:09:42.299589] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T21:09:43.047619] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-07T21:09:43.386029] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-07T21:09:43.612084] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T21:09:43.847674] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-07T21:09:44.074314] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T21:09:44.647696] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-07T21:09:45.268806] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T21:09:45.447699] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-07T21:09:46.075218] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-07T21:09:46.183811] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T21:09:46.247612] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-07T21:09:47.047730] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-07T21:09:47.699019] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-07T21:09:47.847683] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-07T21:09:48.080628] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T21:09:48.647734] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-07T21:09:49.431778] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T21:09:49.448075] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-07T21:09:49.971384] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-07T21:09:50.247747] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-07T21:09:51.047697] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-07T21:09:51.289729] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T21:09:51.775705] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T21:09:51.847695] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-07T21:09:52.510513] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T21:09:52.624695] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-07T21:09:52.647613] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-07T21:09:53.447707] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-07T21:09:54.247666] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-07T21:09:54.688034] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-07T21:09:54.960066] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-07T21:09:55.047715] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-07T21:09:55.295146] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T21:09:55.836195] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T21:09:55.847588] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-07T21:09:56.530086] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T21:09:56.530875] [INFO ] [REMOTE ] RCD: Full fetch complete (6972 records). [2025-10-07T21:09:56.530944] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-07T21:09:56.531448] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:09:56.531534] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:09:56.531595] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:09:56.531681] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-07T21:09:56.531759] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-07T21:09:56.531804] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-07T21:09:56.531846] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-07T21:09:56.531912] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RCD took 17.2s. Estimated remaining: 1h 24m 17s. Rate: 7.1 symbols/min [2025-10-07T21:09:56.652850] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-07T21:09:56.706579] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:09:56.756037] [DEBUG] [LOCAL ] RCI: Loaded 48598 existing records from primary storage. [2025-10-07T21:09:56.756424] [INFO ] [MAIN ] RCI: Loaded 48598 existing records. [2025-10-07T21:09:56.932705] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:09:56.932953] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-07T21:09:56.933024] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-07T21:09:56.933249] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-07T21:09:56.933304] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-07T21:09:57.285861] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:09:57.447631] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-07T21:09:58.247682] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-07T21:09:59.047676] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-07T21:09:59.311177] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T21:09:59.342841] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-07T21:09:59.664971] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T21:09:59.847687] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-07T21:10:00.369225] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T21:10:00.373134] [INFO ] [REMOTE ] RBLX: Full fetch complete (77393 records). [2025-10-07T21:10:00.373282] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-07T21:10:00.374059] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:10:00.374166] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:10:00.374241] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:10:00.374337] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-07T21:10:00.374419] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-07T21:10:00.374494] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-07T21:10:00.374633] [DEBUG] [LOCAL ] RBLX: Deleted derivative data file. [2025-10-07T21:10:00.374747] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RBLX took 1m 6s. Estimated remaining: 1h 24m 7s. Rate: 7.1 symbols/min [2025-10-07T21:10:00.540199] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:10:00.540422] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-07T21:10:00.540479] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-07T21:10:00.540617] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-07T21:10:00.540703] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-07T21:10:00.540757] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-07T21:10:00.540791] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-07T21:10:00.652747] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-07T21:10:00.895521] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:10:01.447635] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-07T21:10:01.586116] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-07T21:10:02.247700] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-07T21:10:02.537510] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T21:10:02.877379] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:10:02.880921] [INFO ] [REMOTE ] RBRK: Full fetch complete (76142 records). [2025-10-07T21:10:02.881099] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-07T21:10:02.883594] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:10:02.883791] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:10:02.883839] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:10:02.883879] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-07T21:10:02.883942] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-07T21:10:02.883977] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-07T21:10:02.884017] [DEBUG] [LOCAL ] RBRK: No derivative data file found to delete. [2025-10-07T21:10:02.884081] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RBRK took 47.9s. Estimated remaining: 1h 23m 56s. Rate: 7.1 symbols/min [2025-10-07T21:10:03.054228] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-07T21:10:03.057892] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:10:03.079318] [DEBUG] [LOCAL ] RCS: Loaded 11893 existing records from primary storage. [2025-10-07T21:10:03.079571] [INFO ] [MAIN ] RCS: Loaded 11893 existing records. [2025-10-07T21:10:03.293422] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:10:03.297454] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T21:10:03.297985] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-07T21:10:03.309428] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-07T21:10:03.310275] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-07T21:10:03.310347] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-07T21:10:03.673368] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:10:03.847748] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-07T21:10:04.647717] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-07T21:10:04.806011] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T21:10:04.929352] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-07T21:10:04.932978] [INFO ] [REMOTE ] RC: Full fetch complete (70564 records). [2025-10-07T21:10:04.933118] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-07T21:10:04.934108] [FATAL] [VALIDATOR ] RC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:10:04.934210] [FATAL] [MAIN ] RC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:10:04.934263] [WARN ] [MAIN ] RC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:10:04.934306] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-07T21:10:04.934366] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-07T21:10:04.934423] [INFO ] [LOCAL ] RC: Starting deletion of derivative data. [2025-10-07T21:10:04.934613] [DEBUG] [LOCAL ] RC: Deleted derivative data file. [2025-10-07T21:10:04.934796] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RC took 41.4s. Estimated remaining: 1h 23m 46s. Rate: 7.1 symbols/min [2025-10-07T21:10:05.129373] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:10:05.129574] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-07T21:10:05.129617] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-07T21:10:05.129749] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-07T21:10:05.129791] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-07T21:10:05.129831] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-07T21:10:05.129863] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-07T21:10:05.452595] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-07T21:10:05.475064] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:10:05.716179] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T21:10:06.247683] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-07T21:10:06.693552] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T21:10:07.047694] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-07T21:10:07.698330] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T21:10:07.847764] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-07T21:10:08.321297] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T21:10:08.647742] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-07T21:10:09.447704] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-07T21:10:09.676078] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T21:10:10.247669] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-07T21:10:10.438885] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T21:10:10.471556] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T21:10:11.047712] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-07T21:10:11.847698] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-07T21:10:11.910949] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T21:10:12.647637] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-07T21:10:12.855160] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:10:13.251364] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T21:10:13.447728] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-07T21:10:14.097208] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T21:10:14.247692] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-07T21:10:14.637947] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T21:10:15.047739] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-07T21:10:15.847712] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-07T21:10:16.528584] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-07T21:10:16.647701] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-07T21:10:16.861526] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T21:10:16.924867] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-07T21:10:17.447628] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-07T21:10:18.248993] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-07T21:10:18.255613] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T21:10:18.427015] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T21:10:19.047637] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-07T21:10:19.363272] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T21:10:19.735974] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-07T21:10:19.847608] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-07T21:10:20.647616] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-07T21:10:20.932033] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T21:10:21.447684] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-07T21:10:22.247680] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-07T21:10:22.345995] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T21:10:22.611671] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T21:10:23.047695] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-07T21:10:23.847731] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-07T21:10:24.102831] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T21:10:24.634362] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T21:10:24.647590] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-07T21:10:24.830701] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T21:10:25.447710] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-07T21:10:26.220476] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T21:10:26.247611] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-07T21:10:26.356552] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T21:10:27.047772] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-07T21:10:27.847619] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-07T21:10:27.879571] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T21:10:28.033181] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T21:10:28.647730] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-07T21:10:28.750541] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T21:10:29.447732] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-07T21:10:30.247639] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-07T21:10:30.415544] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T21:10:30.534892] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T21:10:30.644859] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-07T21:10:30.648067] [INFO ] [REMOTE ] RCI: Full fetch complete (70130 records). [2025-10-07T21:10:30.648229] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-07T21:10:30.649404] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:10:30.649531] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:10:30.649610] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:10:30.649725] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-07T21:10:30.649802] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-07T21:10:30.649837] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-07T21:10:30.650014] [DEBUG] [LOCAL ] RCI: Deleted derivative data file. [2025-10-07T21:10:30.650133] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCI took 34.1s. Estimated remaining: 1h 23m 43s. Rate: 7.1 symbols/min [2025-10-07T21:10:30.826562] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:10:30.826820] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-07T21:10:30.826882] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-07T21:10:30.826996] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-07T21:10:30.827040] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-07T21:10:30.827081] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-07T21:10:30.827114] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-07T21:10:31.053138] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-07T21:10:31.184089] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:10:31.847635] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-07T21:10:31.951863] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-07T21:10:31.953840] [INFO ] [REMOTE ] RCS: Full fetch complete (19241 records). [2025-10-07T21:10:31.953911] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-07T21:10:32.322338] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-07T21:10:32.322435] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-07T21:10:32.322959] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-07T21:10:32.323067] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-07T21:10:32.323808] [DEBUG] [LOCAL ] RCS: Trimmed 19241 records to 11963 (keeping 200 days of data) [2025-10-07T21:10:32.402169] [DEBUG] [LOCAL ] RCS: Primary data saved (11963 records). [2025-10-07T21:10:32.402359] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-07T21:10:32.402461] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 29.5s. Estimated remaining: 1h 23m 32s. Rate: 7.1 symbols/min [2025-10-07T21:10:32.600090] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:10:32.645117] [DEBUG] [LOCAL ] RDN: Loaded 44886 existing records from primary storage. [2025-10-07T21:10:32.645519] [INFO ] [MAIN ] RDN: Loaded 44886 existing records. [2025-10-07T21:10:32.657505] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-07T21:10:32.846881] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:10:32.847139] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-07T21:10:32.847189] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-07T21:10:32.847420] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-10-07T21:10:32.847479] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-07T21:10:33.226930] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:10:33.447703] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-07T21:10:33.475804] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T21:10:34.247740] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-07T21:10:34.961472] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T21:10:35.047682] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-07T21:10:35.265598] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-07T21:10:35.320854] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T21:10:35.847751] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-07T21:10:36.540516] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:10:36.544169] [INFO ] [REMOTE ] RCL: Full fetch complete (75021 records). [2025-10-07T21:10:36.544347] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-07T21:10:36.545261] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:10:36.545432] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:10:36.545524] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:10:36.545597] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-07T21:10:36.545754] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-07T21:10:36.545812] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-07T21:10:36.545860] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-07T21:10:36.545936] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCL took 36.2s. Estimated remaining: 1h 23m 22s. Rate: 7.1 symbols/min [2025-10-07T21:10:36.658617] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-07T21:10:36.748444] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:10:36.821222] [DEBUG] [LOCAL ] RDW: Loaded 52096 existing records from primary storage. [2025-10-07T21:10:36.822029] [INFO ] [MAIN ] RDW: Loaded 52096 existing records. [2025-10-07T21:10:37.066847] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-07T21:10:37.075002] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:10:37.086538] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-07T21:10:37.086613] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-07T21:10:37.087023] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-10-07T21:10:37.087085] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-07T21:10:37.448619] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-07T21:10:37.473530] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:10:38.247776] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-07T21:10:39.047749] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-07T21:10:39.116725] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-07T21:10:39.156056] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T21:10:39.847707] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-07T21:10:40.316084] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-07T21:10:40.399807] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-07T21:10:40.647756] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-07T21:10:41.447751] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-07T21:10:42.247705] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-07T21:10:42.391805] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T21:10:42.456571] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-07T21:10:43.047749] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-07T21:10:43.524870] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-07T21:10:43.852795] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-07T21:10:43.877502] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T21:10:44.647692] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-07T21:10:45.447628] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-07T21:10:45.566140] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-07T21:10:45.716255] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T21:10:46.247628] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-07T21:10:46.328882] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T21:10:47.047724] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-07T21:10:47.685446] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T21:10:47.688186] [INFO ] [REMOTE ] RCUS: Full fetch complete (59873 records). [2025-10-07T21:10:47.688274] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-07T21:10:47.689021] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:10:47.689107] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:10:47.689150] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:10:47.689218] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-07T21:10:47.689282] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-07T21:10:47.689318] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-07T21:10:47.689355] [DEBUG] [LOCAL ] RCUS: No derivative data file found to delete. [2025-10-07T21:10:47.689410] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCUS took 42.8s. Estimated remaining: 1h 23m 15s. Rate: 7.1 symbols/min [2025-10-07T21:10:47.861563] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-07T21:10:47.865712] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:10:47.895768] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-07T21:10:47.937695] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T21:10:47.983083] [DEBUG] [LOCAL ] RDY: Loaded 46845 existing records from primary storage. [2025-10-07T21:10:47.983412] [INFO ] [MAIN ] RDY: Loaded 46845 existing records. [2025-10-07T21:10:48.166534] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:10:48.166871] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-07T21:10:48.166925] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-07T21:10:48.167229] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-07T21:10:48.167288] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-07T21:10:48.521304] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:10:48.647690] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-07T21:10:49.447748] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-07T21:10:50.247666] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-07T21:10:50.454593] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T21:10:50.865018] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-07T21:10:51.047701] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-07T21:10:51.637161] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-07T21:10:51.719136] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T21:10:51.847613] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-07T21:10:52.647622] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-07T21:10:52.996162] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T21:10:53.447625] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-07T21:10:53.619733] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T21:10:54.247623] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-07T21:10:54.597906] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T21:10:55.047741] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-07T21:10:55.847627] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-07T21:10:56.017127] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T21:10:56.225594] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-07T21:10:56.647620] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-07T21:10:56.864134] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T21:10:56.952920] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T21:10:57.447697] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-07T21:10:58.247707] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-07T21:10:59.047760] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-07T21:10:59.291907] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-07T21:10:59.322135] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T21:10:59.847713] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-07T21:11:00.538049] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T21:11:00.599139] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-07T21:11:00.647741] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-07T21:11:00.936366] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T21:11:00.940832] [INFO ] [REMOTE ] RDN: Full fetch complete (65758 records). [2025-10-07T21:11:00.941038] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-07T21:11:00.942152] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:11:00.942269] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:11:00.942331] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:11:00.942414] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-07T21:11:00.942499] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-07T21:11:00.942546] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-07T21:11:00.942928] [DEBUG] [LOCAL ] RDN: Deleted derivative data file. [2025-10-07T21:11:00.943075] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RDN took 28.5s. Estimated remaining: 1h 23m 8s. Rate: 7.1 symbols/min [2025-10-07T21:11:01.191528] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:11:01.241581] [DEBUG] [LOCAL ] RELX: Loaded 48055 existing records from primary storage. [2025-10-07T21:11:01.242046] [INFO ] [MAIN ] RELX: Loaded 48055 existing records. [2025-10-07T21:11:01.436489] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:11:01.436764] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-07T21:11:01.436828] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-07T21:11:01.438213] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-07T21:11:01.438290] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-07T21:11:01.452799] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-07T21:11:01.819376] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:11:02.247626] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-07T21:11:02.538436] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-07T21:11:03.053830] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-07T21:11:03.067959] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T21:11:03.847692] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-07T21:11:03.918122] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T21:11:04.647687] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-07T21:11:05.447722] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-07T21:11:05.805841] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-07T21:11:06.247713] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-07T21:11:06.447502] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T21:11:06.545499] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-07T21:11:06.996011] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T21:11:07.047702] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-07T21:11:07.847695] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-07T21:11:08.619604] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T21:11:08.647621] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-07T21:11:08.899239] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-07T21:11:09.447623] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-07T21:11:09.707877] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T21:11:10.171219] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:11:10.175633] [INFO ] [REMOTE ] RDDT: Full fetch complete (77497 records). [2025-10-07T21:11:10.175821] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-07T21:11:10.176875] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:11:10.176987] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:11:10.177038] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:11:10.177120] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-07T21:11:10.177202] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-07T21:11:10.177248] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-07T21:11:10.177300] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-07T21:11:10.177373] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDDT took 39.5s. Estimated remaining: 1h 22m 60s. Rate: 7.1 symbols/min [2025-10-07T21:11:10.255453] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-07T21:11:10.355356] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:11:10.393086] [DEBUG] [LOCAL ] RERE: Loaded 41085 existing records from primary storage. [2025-10-07T21:11:10.393447] [INFO ] [MAIN ] RERE: Loaded 41085 existing records. [2025-10-07T21:11:10.577801] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:11:10.578193] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-07T21:11:10.578262] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-07T21:11:10.578526] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-07T21:11:10.578596] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-07T21:11:10.945456] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:11:10.977201] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-07T21:11:11.047603] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-07T21:11:11.847631] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-07T21:11:12.085209] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T21:11:12.647716] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-07T21:11:13.447703] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-07T21:11:13.576845] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T21:11:13.619898] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-07T21:11:14.247704] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-07T21:11:14.512209] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T21:11:14.541709] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T21:11:14.544961] [INFO ] [REMOTE ] RDW: Full fetch complete (74681 records). [2025-10-07T21:11:14.545101] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-07T21:11:14.545873] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:11:14.545959] [FATAL] [MAIN ] RDW: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:11:14.546001] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:11:14.546040] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-07T21:11:14.546123] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-07T21:11:14.546180] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-07T21:11:14.546321] [DEBUG] [LOCAL ] RDW: Deleted derivative data file. [2025-10-07T21:11:14.546408] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDW took 38.0s. Estimated remaining: 1h 22m 50s. Rate: 7.1 symbols/min [2025-10-07T21:11:14.714420] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:11:14.756344] [DEBUG] [LOCAL ] RES: Loaded 47230 existing records from primary storage. [2025-10-07T21:11:14.756764] [INFO ] [MAIN ] RES: Loaded 47230 existing records. [2025-10-07T21:11:14.933726] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:11:14.933979] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-07T21:11:14.934046] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-07T21:11:14.934408] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-07T21:11:14.934467] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-07T21:11:15.049814] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-07T21:11:15.235546] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T21:11:15.321175] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:11:15.847694] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-07T21:11:16.647677] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-07T21:11:16.848300] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:11:17.447802] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-07T21:11:17.644814] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T21:11:17.677535] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T21:11:18.247751] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-07T21:11:18.728673] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T21:11:19.047706] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-07T21:11:19.755753] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T21:11:19.847687] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-07T21:11:20.647745] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-07T21:11:20.895584] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T21:11:21.198267] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T21:11:21.201477] [INFO ] [REMOTE ] RDY: Full fetch complete (68537 records). [2025-10-07T21:11:21.201609] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-07T21:11:21.202339] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:11:21.202427] [FATAL] [MAIN ] RDY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:11:21.202525] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:11:21.202601] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-07T21:11:21.202695] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-07T21:11:21.202751] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-07T21:11:21.202914] [DEBUG] [LOCAL ] RDY: Deleted derivative data file. [2025-10-07T21:11:21.203007] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDY took 33.5s. Estimated remaining: 1h 22m 41s. Rate: 7.1 symbols/min [2025-10-07T21:11:21.379053] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:11:21.407114] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T21:11:21.451189] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-07T21:11:21.453248] [DEBUG] [LOCAL ] REVG: Loaded 40624 existing records from primary storage. [2025-10-07T21:11:21.453714] [INFO ] [MAIN ] REVG: Loaded 40624 existing records. [2025-10-07T21:11:21.631903] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:11:21.632122] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-07T21:11:21.632230] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-07T21:11:21.632494] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-07T21:11:21.632551] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-07T21:11:21.981285] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:11:22.247726] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-07T21:11:23.047733] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-07T21:11:23.260823] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T21:11:23.847675] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-07T21:11:23.882572] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T21:11:24.654730] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-07T21:11:24.657778] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T21:11:25.447669] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-07T21:11:25.768755] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T21:11:26.247745] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-07T21:11:26.386711] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T21:11:26.497484] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T21:11:27.047754] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-07T21:11:27.564333] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T21:11:27.847712] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-07T21:11:28.611878] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T21:11:28.647620] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-07T21:11:29.215032] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T21:11:29.447707] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-07T21:11:30.247619] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-07T21:11:30.422806] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T21:11:30.492416] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T21:11:31.047699] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-07T21:11:31.847626] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-07T21:11:31.899444] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T21:11:32.647730] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-07T21:11:32.871676] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T21:11:33.328736] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T21:11:33.447614] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-07T21:11:34.247612] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-07T21:11:34.318535] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T21:11:34.799996] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T21:11:35.047683] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-07T21:11:35.847603] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-07T21:11:36.044571] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T21:11:36.647678] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-07T21:11:36.860496] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T21:11:37.447625] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-07T21:11:37.538962] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T21:11:37.814376] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-07T21:11:37.817181] [INFO ] [REMOTE ] RERE: Full fetch complete (57188 records). [2025-10-07T21:11:37.817300] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-07T21:11:37.817954] [FATAL] [VALIDATOR ] RERE: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:11:37.818078] [FATAL] [MAIN ] RERE: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:11:37.818129] [WARN ] [MAIN ] RERE: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:11:37.818205] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-07T21:11:37.818307] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-07T21:11:37.818382] [INFO ] [LOCAL ] RERE: Starting deletion of derivative data. [2025-10-07T21:11:37.818604] [DEBUG] [LOCAL ] RERE: Deleted derivative data file. [2025-10-07T21:11:37.818749] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RERE took 27.6s. Estimated remaining: 1h 22m 35s. Rate: 7.1 symbols/min [2025-10-07T21:11:37.985545] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:11:38.002590] [DEBUG] [LOCAL ] REX: Loaded 14253 existing records from primary storage. [2025-10-07T21:11:38.002872] [INFO ] [MAIN ] REX: Loaded 14253 existing records. [2025-10-07T21:11:38.177626] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:11:38.177867] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-07T21:11:38.177915] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-07T21:11:38.178165] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-10-07T21:11:38.178222] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-07T21:11:38.250768] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-07T21:11:38.569062] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:11:38.597624] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T21:11:39.047705] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-07T21:11:39.847698] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-07T21:11:39.942194] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T21:11:40.510615] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:11:40.513752] [INFO ] [REMOTE ] RELX: Full fetch complete (67306 records). [2025-10-07T21:11:40.513857] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-07T21:11:40.514481] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:11:40.514567] [FATAL] [MAIN ] RELX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:11:40.514610] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:11:40.514682] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-07T21:11:40.514765] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-07T21:11:40.514802] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-07T21:11:40.514946] [DEBUG] [LOCAL ] RELX: Deleted derivative data file. [2025-10-07T21:11:40.515076] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RELX took 39.6s. Estimated remaining: 1h 22m 25s. Rate: 7.1 symbols/min [2025-10-07T21:11:40.656618] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-07T21:11:40.690222] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:11:40.719583] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T21:11:40.772395] [DEBUG] [LOCAL ] REXR: Loaded 52097 existing records from primary storage. [2025-10-07T21:11:40.772789] [INFO ] [MAIN ] REXR: Loaded 52097 existing records. [2025-10-07T21:11:40.950436] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:11:40.950684] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-07T21:11:40.950744] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-07T21:11:40.951106] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-10-07T21:11:40.951162] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-07T21:11:41.343467] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:11:41.447706] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-07T21:11:42.247680] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-07T21:11:42.442965] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T21:11:43.047715] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-07T21:11:43.330542] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-07T21:11:43.805881] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T21:11:43.847738] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-07T21:11:44.291110] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T21:11:44.647710] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-07T21:11:45.447621] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-07T21:11:45.522701] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T21:11:45.749686] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T21:11:46.247691] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-07T21:11:46.833184] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T21:11:47.047700] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-07T21:11:47.315009] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T21:11:47.847722] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-07T21:11:48.647702] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-07T21:11:48.751631] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T21:11:48.774235] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T21:11:49.447692] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-07T21:11:50.219861] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T21:11:50.247622] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-07T21:11:50.823763] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T21:11:50.826756] [INFO ] [REMOTE ] REVG: Full fetch complete (57793 records). [2025-10-07T21:11:50.826870] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-07T21:11:50.827592] [FATAL] [VALIDATOR ] REVG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:11:50.827707] [FATAL] [MAIN ] REVG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:11:50.827759] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:11:50.827799] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-07T21:11:50.827864] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-07T21:11:50.827946] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-07T21:11:50.828236] [DEBUG] [LOCAL ] REVG: Deleted derivative data file. [2025-10-07T21:11:50.828334] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. REVG took 29.6s. Estimated remaining: 1h 22m 17s. Rate: 7.1 symbols/min [2025-10-07T21:11:51.044162] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:11:51.054799] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-07T21:11:51.075325] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T21:11:51.123454] [DEBUG] [LOCAL ] REZI: Loaded 47026 existing records from primary storage. [2025-10-07T21:11:51.123812] [INFO ] [MAIN ] REZI: Loaded 47026 existing records. [2025-10-07T21:11:51.303466] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:11:51.303886] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-07T21:11:51.303956] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-07T21:11:51.304320] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-10-07T21:11:51.304378] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-07T21:11:51.653815] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:11:51.847700] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-07T21:11:52.647746] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-07T21:11:52.861756] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:11:53.012950] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-07T21:11:53.447692] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-07T21:11:54.247703] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-07T21:11:54.394905] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T21:11:55.047629] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-07T21:11:55.298703] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T21:11:55.386530] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T21:11:55.847671] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-07T21:11:55.965942] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T21:11:55.968931] [INFO ] [REMOTE ] RES: Full fetch complete (68473 records). [2025-10-07T21:11:55.969029] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-07T21:11:55.969842] [FATAL] [VALIDATOR ] RES: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:11:55.969927] [FATAL] [MAIN ] RES: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:11:55.969971] [WARN ] [MAIN ] RES: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:11:55.970011] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-07T21:11:55.970072] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-07T21:11:55.970108] [INFO ] [LOCAL ] RES: Starting deletion of derivative data. [2025-10-07T21:11:55.970273] [DEBUG] [LOCAL ] RES: Deleted derivative data file. [2025-10-07T21:11:55.970365] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. RES took 41.4s. Estimated remaining: 1h 22m 7s. Rate: 7.1 symbols/min [2025-10-07T21:11:56.150475] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:11:56.151444] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-07T21:11:56.151500] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-07T21:11:56.151708] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-07T21:11:56.151763] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-07T21:11:56.151807] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-07T21:11:56.151839] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-07T21:11:56.506210] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:11:56.647628] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-07T21:11:57.447705] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-07T21:11:57.820781] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T21:11:58.212365] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T21:11:58.247607] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-07T21:11:58.552457] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T21:11:59.047703] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-07T21:11:59.847687] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-07T21:12:00.152830] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-07T21:12:00.190041] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T21:12:00.647711] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-07T21:12:01.447721] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-07T21:12:01.757936] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-07T21:12:02.170030] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T21:12:02.247617] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-07T21:12:02.536031] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-07T21:12:03.047689] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-07T21:12:03.847709] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-07T21:12:04.072234] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T21:12:04.647687] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-07T21:12:04.905609] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T21:12:05.219210] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-07T21:12:05.447702] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-07T21:12:06.247672] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-07T21:12:06.281852] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T21:12:07.047627] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-07T21:12:07.283966] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T21:12:07.483543] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T21:12:07.847741] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-07T21:12:08.647624] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-07T21:12:08.699587] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-07T21:12:08.896742] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T21:12:09.447700] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-07T21:12:10.247696] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-07T21:12:10.446454] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T21:12:11.047609] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-07T21:12:11.401157] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T21:12:11.847611] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-07T21:12:12.068282] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T21:12:12.647625] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-07T21:12:12.876755] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T21:12:13.122972] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T21:12:13.125029] [INFO ] [REMOTE ] REX: Full fetch complete (21035 records). [2025-10-07T21:12:13.125167] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-07T21:12:13.125917] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:12:13.126010] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:12:13.126053] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:12:13.126123] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-07T21:12:13.126193] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-07T21:12:13.126232] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-07T21:12:13.126561] [DEBUG] [LOCAL ] REX: Deleted derivative data file. [2025-10-07T21:12:13.126728] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REX took 35.3s. Estimated remaining: 1h 22m 2s. Rate: 7.1 symbols/min [2025-10-07T21:12:13.304479] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:12:13.317573] [DEBUG] [LOCAL ] RFI: Loaded 10454 existing records from primary storage. [2025-10-07T21:12:13.317870] [INFO ] [MAIN ] RFI: Loaded 10454 existing records. [2025-10-07T21:12:13.452878] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-07T21:12:13.513586] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:12:13.514204] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-07T21:12:13.514378] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-07T21:12:13.514701] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-07T21:12:13.514828] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-07T21:12:13.710609] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T21:12:13.921080] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:12:14.247723] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-07T21:12:15.047715] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-07T21:12:15.398945] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T21:12:15.847629] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-07T21:12:15.991889] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T21:12:16.151858] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T21:12:16.647728] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-07T21:12:17.211794] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T21:12:17.447626] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-07T21:12:17.594349] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T21:12:18.247624] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-07T21:12:18.912248] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:12:18.915822] [INFO ] [REMOTE ] REXR: Full fetch complete (74787 records). [2025-10-07T21:12:18.915946] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-07T21:12:18.916958] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:12:18.917056] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:12:18.917099] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:12:18.917167] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-07T21:12:18.917234] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-07T21:12:18.917306] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-07T21:12:18.917449] [DEBUG] [LOCAL ] REXR: Deleted derivative data file. [2025-10-07T21:12:18.917567] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REXR took 38.4s. Estimated remaining: 1h 21m 52s. Rate: 7.1 symbols/min [2025-10-07T21:12:19.056013] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-07T21:12:19.090080] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:12:19.103600] [DEBUG] [LOCAL ] RFL: Loaded 11280 existing records from primary storage. [2025-10-07T21:12:19.103856] [INFO ] [MAIN ] RFL: Loaded 11280 existing records. [2025-10-07T21:12:19.285114] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T21:12:19.356370] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:12:19.357843] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-07T21:12:19.357941] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-07T21:12:19.358721] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-07T21:12:19.358794] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-07T21:12:19.730087] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:12:19.847669] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-07T21:12:19.999452] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-07T21:12:20.626932] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-07T21:12:20.647607] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-07T21:12:21.331805] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T21:12:21.447601] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-07T21:12:22.119504] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T21:12:22.247614] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-07T21:12:23.047625] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-07T21:12:23.100778] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T21:12:23.847703] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-07T21:12:24.647620] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-07T21:12:24.822231] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T21:12:24.839552] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T21:12:25.447692] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-07T21:12:26.247690] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-07T21:12:26.291060] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-07T21:12:26.443133] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T21:12:27.047616] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-07T21:12:27.287417] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T21:12:27.847681] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-07T21:12:28.647671] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-07T21:12:28.794990] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T21:12:28.844331] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T21:12:29.257224] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T21:12:29.447720] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-07T21:12:30.247724] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-07T21:12:30.420491] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T21:12:31.047616] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-07T21:12:31.202319] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T21:12:31.847619] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-07T21:12:32.086284] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T21:12:32.647701] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-07T21:12:33.337009] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:12:33.340033] [INFO ] [REMOTE ] REZI: Full fetch complete (65683 records). [2025-10-07T21:12:33.340154] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-07T21:12:33.341800] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:12:33.341888] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:12:33.341932] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:12:33.341996] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-07T21:12:33.342080] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-07T21:12:33.342117] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-07T21:12:33.342396] [DEBUG] [LOCAL ] REZI: Deleted derivative data file. [2025-10-07T21:12:33.342566] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. REZI took 42.5s. Estimated remaining: 1h 21m 46s. Rate: 7.1 symbols/min [2025-10-07T21:12:33.452943] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-07T21:12:33.515240] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:12:33.522459] [DEBUG] [LOCAL ] RFM: Loaded 4146 existing records from primary storage. [2025-10-07T21:12:33.522684] [INFO ] [MAIN ] RFM: Loaded 4146 existing records. [2025-10-07T21:12:33.702738] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:12:33.703284] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-07T21:12:33.703453] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-07T21:12:33.703766] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-07T21:12:33.703843] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-07T21:12:34.087164] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-07T21:12:34.130773] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:12:34.247733] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-07T21:12:34.526303] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T21:12:35.047701] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-07T21:12:35.847746] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-07T21:12:35.885964] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T21:12:36.239196] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T21:12:36.523534] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-07T21:12:36.647700] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-07T21:12:37.447740] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-07T21:12:37.779144] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T21:12:37.978104] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-07T21:12:38.247727] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-07T21:12:39.047725] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-07T21:12:39.250485] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T21:12:39.456926] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-07T21:12:39.458147] [INFO ] [REMOTE ] RFL: Full fetch complete (13030 records). [2025-10-07T21:12:39.458221] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-07T21:12:39.458727] [FATAL] [VALIDATOR ] RFL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:12:39.458872] [FATAL] [MAIN ] RFL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:12:39.458928] [WARN ] [MAIN ] RFL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:12:39.458997] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-07T21:12:39.459074] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-07T21:12:39.459116] [INFO ] [LOCAL ] RFL: Starting deletion of derivative data. [2025-10-07T21:12:39.459309] [DEBUG] [LOCAL ] RFL: Deleted derivative data file. [2025-10-07T21:12:39.459408] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. RFL took 20.5s. Estimated remaining: 1h 21m 37s. Rate: 7.1 symbols/min [2025-10-07T21:12:39.638841] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:12:39.655377] [DEBUG] [LOCAL ] RFMZ: Loaded 8713 existing records from primary storage. [2025-10-07T21:12:39.655715] [INFO ] [MAIN ] RFMZ: Loaded 8713 existing records. [2025-10-07T21:12:39.844555] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:12:39.845075] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-07T21:12:39.845154] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-07T21:12:39.845456] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-07T21:12:39.845516] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-07T21:12:39.857072] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-07T21:12:40.275360] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:12:40.612214] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T21:12:40.613587] [INFO ] [REMOTE ] RFI: Full fetch complete (15652 records). [2025-10-07T21:12:40.613700] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-07T21:12:40.652831] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-07T21:12:41.014788] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-07T21:12:41.014914] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-07T21:12:41.015465] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-07T21:12:41.015549] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-07T21:12:41.016523] [DEBUG] [LOCAL ] RFI: Trimmed 15652 records to 10474 (keeping 200 days of data) [2025-10-07T21:12:41.105155] [DEBUG] [LOCAL ] RFI: Primary data saved (10474 records). [2025-10-07T21:12:41.105339] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-07T21:12:41.105445] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RFI took 28.0s. Estimated remaining: 1h 21m 26s. Rate: 7.1 symbols/min [2025-10-07T21:12:41.288794] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:12:41.322595] [DEBUG] [LOCAL ] RGA: Loaded 29656 existing records from primary storage. [2025-10-07T21:12:41.322990] [INFO ] [MAIN ] RGA: Loaded 29656 existing records. [2025-10-07T21:12:41.452814] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-07T21:12:41.513047] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:12:41.519688] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-07T21:12:41.522035] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-07T21:12:41.523208] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T21:12:41.523279] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-10-07T21:12:41.523530] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-07T21:12:41.573515] [INFO ] [REMOTE ] RF: Full fetch complete (77237 records). [2025-10-07T21:12:41.609154] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-07T21:12:41.640361] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:12:41.644014] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:12:41.649605] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:12:41.660003] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-07T21:12:41.660130] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-07T21:12:41.665333] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-07T21:12:41.670568] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-07T21:12:41.685241] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RF took 45.7s. Estimated remaining: 1h 21m 15s. Rate: 7.1 symbols/min [2025-10-07T21:12:42.090503] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:12:42.123368] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:12:42.154235] [DEBUG] [LOCAL ] RGR: Loaded 20697 existing records from primary storage. [2025-10-07T21:12:42.154731] [INFO ] [MAIN ] RGR: Loaded 20697 existing records. [2025-10-07T21:12:42.250314] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-07T21:12:42.374633] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:12:42.375008] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-07T21:12:42.375119] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-07T21:12:42.375482] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-10-07T21:12:42.375543] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-07T21:12:42.586959] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T21:12:42.803903] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:12:43.047741] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-07T21:12:43.062763] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T21:12:43.847775] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-07T21:12:44.332934] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T21:12:44.355752] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T21:12:44.647748] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-07T21:12:45.447674] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-07T21:12:45.457032] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T21:12:46.247707] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-07T21:12:47.034293] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T21:12:47.047597] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-07T21:12:47.434132] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T21:12:47.847721] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-07T21:12:48.336003] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T21:12:48.578953] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T21:12:48.647731] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-07T21:12:49.453686] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-07T21:12:49.456020] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T21:12:50.247729] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-07T21:12:51.024701] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T21:12:51.047632] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-07T21:12:51.158378] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T21:12:51.731928] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-07T21:12:51.847695] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-07T21:12:52.647700] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-07T21:12:53.358185] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T21:12:53.447148] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T21:12:53.451603] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-07T21:12:54.210214] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T21:12:54.247637] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-07T21:12:55.047713] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-07T21:12:55.785464] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T21:12:55.847728] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-07T21:12:56.190430] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T21:12:56.647709] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-07T21:12:57.352733] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T21:12:57.447622] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-07T21:12:57.842973] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T21:12:58.247690] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-07T21:12:58.685122] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T21:12:59.047732] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-07T21:12:59.490584] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T21:12:59.537101] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-07T21:12:59.847687] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-07T21:13:00.541832] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T21:13:00.647669] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-07T21:13:01.447765] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-07T21:13:01.831534] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T21:13:02.247672] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-07T21:13:02.255445] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T21:13:03.047695] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-07T21:13:03.847631] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-07T21:13:04.064030] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T21:13:04.310479] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T21:13:04.647691] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-07T21:13:04.706311] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T21:13:05.447672] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-07T21:13:06.128095] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T21:13:06.143190] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T21:13:06.247632] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-07T21:13:06.833743] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:13:06.836131] [INFO ] [REMOTE ] RGA: Full fetch complete (45248 records). [2025-10-07T21:13:06.836217] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-07T21:13:06.837440] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:13:06.837533] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:13:06.837578] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:13:06.837633] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-07T21:13:06.837747] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-07T21:13:06.837790] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-07T21:13:06.838025] [DEBUG] [LOCAL ] RGA: Deleted derivative data file. [2025-10-07T21:13:06.838146] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RGA took 25.7s. Estimated remaining: 1h 21m 12s. Rate: 7.1 symbols/min [2025-10-07T21:13:07.021424] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:13:07.027879] [DEBUG] [LOCAL ] RGT: Loaded 2739 existing records from primary storage. [2025-10-07T21:13:07.028073] [INFO ] [MAIN ] RGT: Loaded 2739 existing records. [2025-10-07T21:13:07.057797] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-07T21:13:07.227636] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:13:07.228001] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-07T21:13:07.228053] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-07T21:13:07.228266] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-07T21:13:07.228322] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-07T21:13:07.603124] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:13:07.847766] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-07T21:13:08.331514] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T21:13:08.568768] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-07T21:13:08.647683] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-07T21:13:09.447685] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-07T21:13:09.557758] [DEBUG] [REMOTE ] RFM: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-07T21:13:09.558097] [WARN ] [REMOTE ] RFM: No data returned for month 2025-10 [2025-10-07T21:13:09.558451] [FATAL] [REMOTE ] RFM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:13:09.558609] [FATAL] [MAIN ] RFM: Failed to fetch primary data. [2025-10-07T21:13:09.558743] [WARN ] [MAIN ] RFM: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:13:09.558848] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-07T21:13:09.558953] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-07T21:13:09.559022] [INFO ] [LOCAL ] RFM: Starting deletion of derivative data. [2025-10-07T21:13:09.559362] [DEBUG] [LOCAL ] RFM: Deleted derivative data file. [2025-10-07T21:13:09.559467] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RFM took 36.2s. Estimated remaining: 1h 21m 2s. Rate: 7.1 symbols/min [2025-10-07T21:13:09.737241] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:13:09.782344] [DEBUG] [LOCAL ] RH: Loaded 47481 existing records from primary storage. [2025-10-07T21:13:09.782754] [INFO ] [MAIN ] RH: Loaded 47481 existing records. [2025-10-07T21:13:09.968480] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:13:09.968786] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-07T21:13:09.968948] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-07T21:13:09.969254] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-10-07T21:13:09.980552] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-07T21:13:10.025451] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T21:13:10.252922] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-07T21:13:10.353155] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:13:10.929189] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T21:13:11.047720] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-07T21:13:11.628786] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T21:13:11.847713] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-07T21:13:12.647688] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-07T21:13:13.204977] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T21:13:13.447697] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-07T21:13:13.586494] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-07T21:13:14.056398] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T21:13:14.058275] [INFO ] [REMOTE ] RGR: Full fetch complete (28729 records). [2025-10-07T21:13:14.058356] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-07T21:13:14.059511] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:13:14.059864] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:13:14.059936] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:13:14.060017] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-07T21:13:14.060100] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-07T21:13:14.060138] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-07T21:13:14.060301] [DEBUG] [LOCAL ] RGR: Deleted derivative data file. [2025-10-07T21:13:14.060423] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RGR took 32.4s. Estimated remaining: 1h 20m 52s. Rate: 7.1 symbols/min [2025-10-07T21:13:14.247730] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-07T21:13:14.708337] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-07T21:13:15.047737] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-07T21:13:15.738064] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T21:13:15.847738] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-07T21:13:16.568457] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T21:13:16.647728] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-07T21:13:17.447746] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-07T21:13:17.463240] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T21:13:18.247755] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-07T21:13:18.284868] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-07T21:13:19.047757] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-07T21:13:19.847632] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-07T21:13:19.870793] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T21:13:20.204804] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T21:13:20.586084] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T21:13:20.647601] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-07T21:13:21.447736] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-07T21:13:21.557313] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T21:13:21.959032] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-07T21:13:22.247707] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-07T21:13:22.822124] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T21:13:23.047712] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-07T21:13:23.592704] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T21:13:23.593608] [INFO ] [REMOTE ] RGT: Full fetch complete (4118 records). [2025-10-07T21:13:23.593718] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-07T21:13:23.847848] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-07T21:13:23.984773] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-07T21:13:23.984889] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-07T21:13:23.985079] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-07T21:13:23.985126] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-07T21:13:23.985685] [DEBUG] [LOCAL ] RGT: Trimmed 4118 records to 2723 (keeping 200 days of data) [2025-10-07T21:13:24.005055] [DEBUG] [LOCAL ] RGT: Primary data saved (2723 records). [2025-10-07T21:13:24.005258] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-07T21:13:24.005367] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGT took 17.2s. Estimated remaining: 1h 20m 44s. Rate: 7.1 symbols/min [2025-10-07T21:13:24.647756] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-07T21:13:25.544669] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-07T21:13:25.548028] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-07T21:13:25.572068] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T21:13:26.001980] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-07T21:13:26.003005] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12516 records). [2025-10-07T21:13:26.003074] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-07T21:13:26.003472] [FATAL] [VALIDATOR ] RFMZ: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:13:26.003576] [FATAL] [MAIN ] RFMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:13:26.003619] [WARN ] [MAIN ] RFMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:13:26.003769] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-07T21:13:26.003859] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-07T21:13:26.003916] [INFO ] [LOCAL ] RFMZ: Starting deletion of derivative data. [2025-10-07T21:13:26.004077] [DEBUG] [LOCAL ] RFMZ: Deleted derivative data file. [2025-10-07T21:13:26.004165] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RFMZ took 46.5s. Estimated remaining: 1h 20m 33s. Rate: 7.1 symbols/min [2025-10-07T21:13:26.247759] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-07T21:13:27.939728] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T21:13:27.947777] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-07T21:13:29.511417] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T21:13:29.522495] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-07T21:13:31.697812] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-07T21:13:31.709351] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-07T21:13:33.662250] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-07T21:13:33.672795] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-07T21:13:35.878320] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-07T21:13:35.890423] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-07T21:13:37.912303] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-07T21:13:37.923552] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-07T21:13:39.830164] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T21:13:39.840776] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-07T21:13:41.812228] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-07T21:13:41.823128] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-07T21:13:42.606063] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T21:13:42.609254] [INFO ] [REMOTE ] RH: Full fetch complete (65338 records). [2025-10-07T21:13:42.609362] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-07T21:13:42.610254] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:13:42.610353] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:13:42.610398] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:13:42.610437] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-07T21:13:42.610512] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-07T21:13:42.610567] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-07T21:13:42.610802] [DEBUG] [LOCAL ] RH: Deleted derivative data file. [2025-10-07T21:13:42.610903] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RH took 33.1s. Estimated remaining: 1h 20m 28s. Rate: 7.1 symbols/min [2025-10-07T21:13:43.226317] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:13:43.319005] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:13:43.316876] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-07T21:13:43.345151] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-07T21:13:43.367542] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-07T21:13:43.371345] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-07T21:13:43.371241] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:13:43.390905] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-07T21:13:43.394570] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-07T21:13:43.403953] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:13:43.437607] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-07T21:13:43.444077] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-07T21:13:43.451837] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-07T21:13:43.457864] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-07T21:13:43.472290] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-07T21:13:43.494960] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-07T21:13:43.833265] [DEBUG] [LOCAL ] RIG: Loaded 53670 existing records from primary storage. [2025-10-07T21:13:43.860077] [DEBUG] [LOCAL ] RHP: Loaded 41067 existing records from primary storage. [2025-10-07T21:13:43.876023] [INFO ] [MAIN ] RIG: Loaded 53670 existing records. [2025-10-07T21:13:43.922748] [INFO ] [MAIN ] RHP: Loaded 41067 existing records. [2025-10-07T21:13:44.315700] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:13:44.357388] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-07T21:13:44.518491] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:13:44.540411] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-07T21:13:44.634144] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:13:44.639958] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:13:44.640131] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-07T21:13:44.640709] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-07T21:13:44.640802] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-07T21:13:44.640977] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-07T21:13:44.641378] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-07T21:13:44.641339] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-10-07T21:13:44.641636] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-07T21:13:44.641562] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-07T21:13:44.799095] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:13:44.859585] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-07T21:13:44.863916] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:13:44.869740] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-07T21:13:44.890930] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:13:44.906508] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-07T21:13:44.911811] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-07T21:13:44.939455] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-07T21:13:44.996253] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-07T21:13:45.063741] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHLD took 2.5s. Estimated remaining: 1h 20m 17s. Rate: 7.1 symbols/min [2025-10-07T21:13:45.507634] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:13:45.524177] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-07T21:13:45.677894] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:13:45.703406] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:13:45.704246] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-07T21:13:45.762250] [DEBUG] [LOCAL ] RIO: Loaded 53393 existing records from primary storage. [2025-10-07T21:13:45.762698] [INFO ] [MAIN ] RIO: Loaded 53393 existing records. [2025-10-07T21:13:45.975235] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:13:45.975866] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-07T21:13:45.975951] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-07T21:13:45.976226] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-07T21:13:45.976284] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-07T21:13:46.329211] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:13:46.329726] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-07T21:13:46.356183] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T21:13:46.366483] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-07T21:13:47.335883] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T21:13:47.344494] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-07T21:13:47.443039] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T21:13:47.454804] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-07T21:13:48.029087] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T21:13:48.038601] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-07T21:13:48.768608] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-07T21:13:48.780398] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-07T21:13:49.045088] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T21:13:49.052776] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-07T21:13:49.386959] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T21:13:49.398599] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-07T21:13:49.723051] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T21:13:49.734709] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-07T21:13:50.578993] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T21:13:50.587369] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-07T21:13:50.681744] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T21:13:50.693633] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-07T21:13:50.937293] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T21:13:50.949846] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-07T21:13:51.457985] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T21:13:51.468958] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-07T21:13:52.188381] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T21:13:52.200001] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-07T21:13:52.368190] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T21:13:52.379415] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-07T21:13:52.859094] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T21:13:52.870553] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-07T21:13:53.237200] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-07T21:13:53.250832] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-07T21:13:53.600682] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T21:13:53.619444] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-07T21:13:54.602002] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-07T21:13:54.615150] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-07T21:13:54.688468] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T21:13:54.699487] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-07T21:13:54.959720] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T21:13:54.973367] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-07T21:13:55.420021] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T21:13:55.430044] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-07T21:13:56.647680] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-07T21:13:56.660431] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-07T21:13:56.730680] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-07T21:13:56.744317] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-07T21:13:57.055963] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T21:13:57.066580] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-07T21:13:57.103229] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-07T21:13:57.117444] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-07T21:13:58.491786] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T21:13:58.503923] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-07T21:13:58.730592] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-07T21:13:58.743834] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-07T21:13:58.916866] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T21:13:59.047729] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-07T21:13:59.157102] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-07T21:13:59.847626] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-07T21:14:00.114758] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T21:14:00.647725] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-07T21:14:00.788036] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T21:14:01.040491] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-07T21:14:01.447714] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-07T21:14:01.932980] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-07T21:14:02.247626] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-07T21:14:02.512846] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T21:14:03.047700] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-07T21:14:03.815170] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-07T21:14:03.856724] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-07T21:14:03.880539] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T21:14:04.647708] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-07T21:14:05.195141] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-07T21:14:05.215900] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T21:14:05.221163] [INFO ] [REMOTE ] RHI: Full fetch complete (69723 records). [2025-10-07T21:14:05.221272] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-07T21:14:05.222074] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:14:05.222163] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:14:05.222207] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:14:05.222250] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-07T21:14:05.222310] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-07T21:14:05.222351] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-07T21:14:05.222438] [DEBUG] [LOCAL ] RHI: No derivative data file found to delete. [2025-10-07T21:14:05.222557] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHI took 22.6s. Estimated remaining: 1h 20m 12s. Rate: 7.1 symbols/min [2025-10-07T21:14:05.399595] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:14:05.457633] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-07T21:14:05.460848] [DEBUG] [LOCAL ] RITM: Loaded 52870 existing records from primary storage. [2025-10-07T21:14:05.461160] [INFO ] [MAIN ] RITM: Loaded 52870 existing records. [2025-10-07T21:14:05.647413] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:14:05.647749] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-07T21:14:05.647984] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-07T21:14:05.648342] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-10-07T21:14:05.648501] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-07T21:14:06.033016] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:14:06.055995] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-07T21:14:06.247711] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-07T21:14:07.047768] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-07T21:14:07.580120] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T21:14:07.847700] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-07T21:14:08.030394] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:14:08.433786] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:14:08.437132] [INFO ] [REMOTE ] RIG: Full fetch complete (77316 records). [2025-10-07T21:14:08.437255] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-07T21:14:08.438165] [FATAL] [VALIDATOR ] RIG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:14:08.438265] [FATAL] [MAIN ] RIG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:14:08.438405] [WARN ] [MAIN ] RIG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:14:08.438482] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-07T21:14:08.438550] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-07T21:14:08.438586] [INFO ] [LOCAL ] RIG: Starting deletion of derivative data. [2025-10-07T21:14:08.438795] [DEBUG] [LOCAL ] RIG: Deleted derivative data file. [2025-10-07T21:14:08.438893] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RIG took 25.8s. Estimated remaining: 1h 20m 2s. Rate: 7.1 symbols/min [2025-10-07T21:14:08.605063] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:14:08.619041] [DEBUG] [LOCAL ] RIV: Loaded 12420 existing records from primary storage. [2025-10-07T21:14:08.619275] [INFO ] [MAIN ] RIV: Loaded 12420 existing records. [2025-10-07T21:14:08.652966] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-07T21:14:08.803182] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:14:08.803525] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-07T21:14:08.803606] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-07T21:14:08.804025] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-07T21:14:08.804137] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-07T21:14:09.210955] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:14:09.215937] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-07T21:14:09.447685] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-07T21:14:09.491322] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T21:14:09.494138] [INFO ] [REMOTE ] RHP: Full fetch complete (57758 records). [2025-10-07T21:14:09.494264] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-07T21:14:09.494901] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:14:09.494985] [FATAL] [MAIN ] RHP: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:14:09.495028] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:14:09.495069] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-07T21:14:09.495140] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-07T21:14:09.495196] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-07T21:14:09.495404] [DEBUG] [LOCAL ] RHP: Deleted derivative data file. [2025-10-07T21:14:09.495499] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHP took 26.9s. Estimated remaining: 1h 19m 52s. Rate: 7.1 symbols/min [2025-10-07T21:14:09.695028] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:14:09.695235] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-07T21:14:09.695273] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-07T21:14:09.695387] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-07T21:14:09.695431] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-07T21:14:09.695472] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-07T21:14:09.695503] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-07T21:14:10.078481] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:14:10.247691] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-07T21:14:10.422599] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T21:14:11.047710] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-07T21:14:11.847634] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-07T21:14:12.230944] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-07T21:14:12.474806] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:14:12.478438] [INFO ] [REMOTE ] RIO: Full fetch complete (76970 records). [2025-10-07T21:14:12.478611] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-07T21:14:12.479589] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:14:12.479721] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:14:12.479767] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:14:12.479808] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-07T21:14:12.479894] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-07T21:14:12.479949] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-07T21:14:12.480080] [DEBUG] [LOCAL ] RIO: Deleted derivative data file. [2025-10-07T21:14:12.480190] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIO took 27.3s. Estimated remaining: 1h 19m 41s. Rate: 7.1 symbols/min [2025-10-07T21:14:12.652856] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-07T21:14:12.656084] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:14:12.714403] [DEBUG] [LOCAL ] RKT: Loaded 53723 existing records from primary storage. [2025-10-07T21:14:12.714840] [INFO ] [MAIN ] RKT: Loaded 53723 existing records. [2025-10-07T21:14:12.901423] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:14:12.901892] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-07T21:14:12.902116] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-07T21:14:12.902430] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-10-07T21:14:12.902550] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-07T21:14:13.099285] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-07T21:14:13.314798] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:14:13.447686] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-07T21:14:14.247707] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-07T21:14:14.605112] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-07T21:14:15.047625] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-07T21:14:15.541927] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T21:14:15.847666] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-07T21:14:16.105781] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-07T21:14:16.140837] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T21:14:16.647711] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-07T21:14:17.447731] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-07T21:14:17.789164] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T21:14:18.247760] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-07T21:14:18.482214] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T21:14:18.891173] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T21:14:19.057441] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-07T21:14:19.083812] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T21:14:19.847716] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-07T21:14:20.023841] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T21:14:20.647746] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-07T21:14:21.352585] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T21:14:21.447742] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-07T21:14:22.247718] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-07T21:14:22.377760] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T21:14:22.709408] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-07T21:14:23.047727] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-07T21:14:23.847734] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-07T21:14:24.068183] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T21:14:24.647636] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-07T21:14:25.134079] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-07T21:14:25.447666] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-07T21:14:26.247711] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-07T21:14:26.317922] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-07T21:14:26.596569] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T21:14:26.895683] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T21:14:27.047735] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-07T21:14:27.611286] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-07T21:14:27.847706] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-07T21:14:28.647787] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-07T21:14:29.016492] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T21:14:29.255600] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T21:14:29.447714] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-07T21:14:30.247738] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-07T21:14:30.432061] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T21:14:30.905992] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T21:14:31.047704] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-07T21:14:31.847678] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-07T21:14:31.982288] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T21:14:32.647697] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-07T21:14:33.169472] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-07T21:14:33.338790] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T21:14:33.447697] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-07T21:14:34.247687] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-07T21:14:34.758772] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-07T21:14:35.047728] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-07T21:14:35.099267] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T21:14:35.847702] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-07T21:14:35.864103] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T21:14:36.620083] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-07T21:14:36.647632] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-07T21:14:37.447633] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-07T21:14:38.049521] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-07T21:14:38.247719] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-07T21:14:38.418356] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T21:14:38.769343] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-07T21:14:39.047704] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-07T21:14:39.136836] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T21:14:39.139803] [INFO ] [REMOTE ] RJF: Full fetch complete (68002 records). [2025-10-07T21:14:39.139965] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-07T21:14:39.140925] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:14:39.141028] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:14:39.141073] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:14:39.141116] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-07T21:14:39.141177] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-07T21:14:39.141212] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-07T21:14:39.141252] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-07T21:14:39.141339] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RJF took 29.6s. Estimated remaining: 1h 19m 39s. Rate: 7.1 symbols/min [2025-10-07T21:14:39.313519] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:14:39.313738] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-07T21:14:39.313836] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-07T21:14:39.313920] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-07T21:14:39.313959] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-07T21:14:39.314007] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-07T21:14:39.314064] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-07T21:14:39.664586] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:14:39.847674] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-07T21:14:40.647618] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-07T21:14:41.146621] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-07T21:14:41.260865] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T21:14:41.447625] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-07T21:14:41.563398] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T21:14:42.247624] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-07T21:14:42.561698] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T21:14:42.677240] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-07T21:14:42.680508] [INFO ] [REMOTE ] RITM: Full fetch complete (76221 records). [2025-10-07T21:14:42.680612] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-07T21:14:42.681306] [FATAL] [VALIDATOR ] RITM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:14:42.681415] [FATAL] [MAIN ] RITM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:14:42.681458] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:14:42.681498] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-07T21:14:42.681572] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-07T21:14:42.681629] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-07T21:14:42.681882] [DEBUG] [LOCAL ] RITM: Deleted derivative data file. [2025-10-07T21:14:42.681971] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RITM took 37.5s. Estimated remaining: 1h 19m 29s. Rate: 7.1 symbols/min [2025-10-07T21:14:42.851599] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:14:42.885485] [DEBUG] [LOCAL ] RLI: Loaded 33924 existing records from primary storage. [2025-10-07T21:14:42.885822] [INFO ] [MAIN ] RLI: Loaded 33924 existing records. [2025-10-07T21:14:43.055014] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-07T21:14:43.059792] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:14:43.060022] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-07T21:14:43.060086] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-07T21:14:43.060913] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-10-07T21:14:43.060975] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-07T21:14:43.414120] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:14:43.847612] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-07T21:14:44.076088] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T21:14:44.077770] [INFO ] [REMOTE ] RIV: Full fetch complete (17768 records). [2025-10-07T21:14:44.077842] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-07T21:14:44.467631] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-07T21:14:44.467764] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-07T21:14:44.468261] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-07T21:14:44.468325] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-07T21:14:44.469247] [DEBUG] [LOCAL ] RIV: Trimmed 17768 records to 12477 (keeping 200 days of data) [2025-10-07T21:14:44.569293] [DEBUG] [LOCAL ] RIV: Primary data saved (12477 records). [2025-10-07T21:14:44.569806] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-07T21:14:44.569943] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RIV took 36.1s. Estimated remaining: 1h 19m 18s. Rate: 7.1 symbols/min [2025-10-07T21:14:44.652860] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-07T21:14:44.750723] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:14:44.793356] [DEBUG] [LOCAL ] RLJ: Loaded 48114 existing records from primary storage. [2025-10-07T21:14:44.793703] [INFO ] [MAIN ] RLJ: Loaded 48114 existing records. [2025-10-07T21:14:44.983661] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:14:44.984967] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T21:14:44.989733] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-07T21:14:44.989796] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-07T21:14:44.990305] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-07T21:14:44.990363] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-07T21:14:45.350125] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:14:45.447680] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-07T21:14:46.247753] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-07T21:14:46.450737] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T21:14:46.709977] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T21:14:47.047743] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-07T21:14:47.418249] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T21:14:47.847710] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-07T21:14:48.647747] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-07T21:14:48.866835] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T21:14:49.447721] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-07T21:14:50.091087] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T21:14:50.255837] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-07T21:14:50.280483] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-07T21:14:50.835332] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-07T21:14:51.047683] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-07T21:14:51.668020] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T21:14:51.847692] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-07T21:14:51.875678] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T21:14:51.878956] [INFO ] [REMOTE ] RKT: Full fetch complete (77045 records). [2025-10-07T21:14:51.879110] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-07T21:14:51.879996] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:14:51.880084] [FATAL] [MAIN ] RKT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:14:51.880127] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:14:51.880166] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-07T21:14:51.880224] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-07T21:14:51.880262] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-07T21:14:51.880518] [DEBUG] [LOCAL ] RKT: Deleted derivative data file. [2025-10-07T21:14:51.880613] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RKT took 39.4s. Estimated remaining: 1h 19m 9s. Rate: 7.1 symbols/min [2025-10-07T21:14:52.049357] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:14:52.062262] [DEBUG] [LOCAL ] RLTY: Loaded 11206 existing records from primary storage. [2025-10-07T21:14:52.062468] [INFO ] [MAIN ] RLTY: Loaded 11206 existing records. [2025-10-07T21:14:52.237345] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:14:52.237682] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-07T21:14:52.237752] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-07T21:14:52.237954] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-07T21:14:52.238011] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-07T21:14:52.604160] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:14:52.647608] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-07T21:14:53.448241] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-07T21:14:53.451133] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T21:14:53.771674] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T21:14:54.247680] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-07T21:14:55.047698] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-07T21:14:55.335768] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T21:14:55.847729] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-07T21:14:56.155807] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T21:14:56.275381] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T21:14:56.551589] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-07T21:14:56.647678] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-07T21:14:57.447769] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-07T21:14:58.247626] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-07T21:14:58.440983] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T21:14:59.047683] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-07T21:14:59.262140] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T21:14:59.368740] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T21:14:59.761589] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T21:14:59.847687] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-07T21:15:00.647720] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-07T21:15:00.740731] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-07T21:15:01.447736] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-07T21:15:02.247718] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-07T21:15:02.558292] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-07T21:15:03.047716] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-07T21:15:03.676603] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-07T21:15:03.847722] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-07T21:15:03.977066] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T21:15:04.647750] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-07T21:15:04.869076] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T21:15:04.894272] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T21:15:05.447723] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-07T21:15:06.247759] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-07T21:15:06.395494] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T21:15:06.565839] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T21:15:07.047731] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-07T21:15:07.847692] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-07T21:15:08.034838] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T21:15:08.647711] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-07T21:15:08.879620] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T21:15:08.932369] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T21:15:09.447689] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-07T21:15:10.247621] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-07T21:15:10.350869] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T21:15:10.382668] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T21:15:11.047680] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-07T21:15:11.151579] [DEBUG] [REMOTE ] RLTY: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-07T21:15:11.152016] [WARN ] [REMOTE ] RLTY: No data returned for month 2025-08 [2025-10-07T21:15:11.152149] [FATAL] [REMOTE ] RLTY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:15:11.152261] [FATAL] [MAIN ] RLTY: Failed to fetch primary data. [2025-10-07T21:15:11.152336] [WARN ] [MAIN ] RLTY: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:15:11.152441] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-07T21:15:11.152549] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-07T21:15:11.152612] [INFO ] [LOCAL ] RLTY: Starting deletion of derivative data. [2025-10-07T21:15:11.152904] [DEBUG] [LOCAL ] RLTY: Deleted derivative data file. [2025-10-07T21:15:11.153023] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RLTY took 19.3s. Estimated remaining: 1h 19m 4s. Rate: 7.1 symbols/min [2025-10-07T21:15:11.321234] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:15:11.367881] [DEBUG] [LOCAL ] RLX: Loaded 48160 existing records from primary storage. [2025-10-07T21:15:11.368222] [INFO ] [MAIN ] RLX: Loaded 48160 existing records. [2025-10-07T21:15:11.541101] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:15:11.541304] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-07T21:15:11.541353] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-07T21:15:11.541780] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-07T21:15:11.541838] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-07T21:15:11.866795] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-07T21:15:11.904718] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:15:11.998624] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T21:15:12.647735] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-07T21:15:13.447618] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-07T21:15:13.611133] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T21:15:14.247624] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-07T21:15:14.411316] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T21:15:15.047624] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-07T21:15:15.352842] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-07T21:15:15.393795] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-07T21:15:15.396803] [INFO ] [REMOTE ] RL: Full fetch complete (59689 records). [2025-10-07T21:15:15.396953] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-07T21:15:15.397766] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:15:15.397879] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:15:15.397936] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:15:15.398006] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-07T21:15:15.398073] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-07T21:15:15.398109] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-07T21:15:15.398150] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-07T21:15:15.398234] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RL took 36.3s. Estimated remaining: 1h 18m 55s. Rate: 7.1 symbols/min [2025-10-07T21:15:15.617173] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:15:15.630229] [DEBUG] [LOCAL ] RM: Loaded 7565 existing records from primary storage. [2025-10-07T21:15:15.630489] [INFO ] [MAIN ] RM: Loaded 7565 existing records. [2025-10-07T21:15:15.851064] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-07T21:15:15.867491] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:15:15.869033] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-07T21:15:15.869174] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-07T21:15:15.869378] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-07T21:15:15.869428] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-07T21:15:16.029926] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T21:15:16.299704] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:15:16.647697] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-07T21:15:17.447634] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-07T21:15:17.556583] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T21:15:17.911071] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T21:15:18.247693] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-07T21:15:18.330205] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T21:15:19.047691] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-07T21:15:19.847720] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-07T21:15:19.965544] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T21:15:20.020397] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T21:15:20.647688] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-07T21:15:21.268342] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T21:15:21.447682] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-07T21:15:21.599229] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T21:15:21.769242] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-07T21:15:21.774355] [INFO ] [REMOTE ] RLI: Full fetch complete (47336 records). [2025-10-07T21:15:21.774537] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-07T21:15:21.778093] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:15:21.778231] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:15:21.778284] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:15:21.778330] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-07T21:15:21.778400] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-07T21:15:21.778438] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-07T21:15:21.778839] [DEBUG] [LOCAL ] RLI: Deleted derivative data file. [2025-10-07T21:15:21.778970] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RLI took 39.1s. Estimated remaining: 1h 18m 45s. Rate: 7.1 symbols/min [2025-10-07T21:15:21.966054] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:15:21.992982] [DEBUG] [LOCAL ] RMAX: Loaded 21508 existing records from primary storage. [2025-10-07T21:15:21.993335] [INFO ] [MAIN ] RMAX: Loaded 21508 existing records. [2025-10-07T21:15:22.188890] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:15:22.189220] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-07T21:15:22.189275] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-07T21:15:22.189689] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-10-07T21:15:22.189750] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-07T21:15:22.254232] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-07T21:15:22.587614] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:15:23.047733] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-07T21:15:23.683371] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T21:15:23.686870] [INFO ] [REMOTE ] RLJ: Full fetch complete (68912 records). [2025-10-07T21:15:23.687015] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-07T21:15:23.687890] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:15:23.687981] [FATAL] [MAIN ] RLJ: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:15:23.688024] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:15:23.688065] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-07T21:15:23.688127] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-07T21:15:23.688162] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-07T21:15:23.688347] [DEBUG] [LOCAL ] RLJ: Deleted derivative data file. [2025-10-07T21:15:23.688444] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 39.1s. Estimated remaining: 1h 18m 35s. Rate: 7.1 symbols/min [2025-10-07T21:15:23.858017] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-07T21:15:23.864336] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:15:23.864548] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-07T21:15:23.865377] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-07T21:15:23.865556] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-07T21:15:23.865607] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-07T21:15:23.865687] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-07T21:15:23.865741] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-07T21:15:24.237166] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:15:24.535249] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-07T21:15:24.647729] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-07T21:15:24.921568] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T21:15:25.251737] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T21:15:25.447722] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-07T21:15:26.247637] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-07T21:15:26.408385] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T21:15:27.047848] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-07T21:15:27.328166] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T21:15:27.847668] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-07T21:15:27.960627] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-07T21:15:28.647638] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-07T21:15:28.929517] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T21:15:29.447721] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-07T21:15:30.247744] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-07T21:15:30.448937] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T21:15:30.492286] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T21:15:31.047671] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-07T21:15:31.847672] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-07T21:15:31.889100] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T21:15:31.931774] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T21:15:32.647714] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-07T21:15:33.447627] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-07T21:15:33.756733] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T21:15:33.883955] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-07T21:15:34.080242] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T21:15:34.247733] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-07T21:15:35.047703] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-07T21:15:35.137942] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T21:15:35.847733] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-07T21:15:36.647716] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-07T21:15:36.771515] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T21:15:37.447704] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-07T21:15:37.629699] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T21:15:37.682677] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T21:15:38.247748] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-07T21:15:38.683895] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T21:15:38.686180] [INFO ] [REMOTE ] RM: Full fetch complete (11521 records). [2025-10-07T21:15:38.686921] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-07T21:15:38.687996] [FATAL] [VALIDATOR ] RM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:15:38.688122] [FATAL] [MAIN ] RM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:15:38.688186] [WARN ] [MAIN ] RM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:15:38.688254] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-07T21:15:38.688354] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-07T21:15:38.688408] [INFO ] [LOCAL ] RM: Starting deletion of derivative data. [2025-10-07T21:15:38.689415] [DEBUG] [LOCAL ] RM: Deleted derivative data file. [2025-10-07T21:15:38.689858] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RM took 23.3s. Estimated remaining: 1h 18m 29s. Rate: 7.1 symbols/min [2025-10-07T21:15:38.971398] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:15:38.982628] [DEBUG] [LOCAL ] RMI: Loaded 4694 existing records from primary storage. [2025-10-07T21:15:38.982921] [INFO ] [MAIN ] RMI: Loaded 4694 existing records. [2025-10-07T21:15:39.053365] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-07T21:15:39.223329] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:15:39.223945] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-07T21:15:39.224078] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-07T21:15:39.224355] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-07T21:15:39.224418] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-07T21:15:39.637709] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-07T21:15:39.690208] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:15:39.847701] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-07T21:15:40.542422] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T21:15:40.647720] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-07T21:15:41.447689] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-07T21:15:41.781349] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T21:15:42.247761] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-07T21:15:42.257820] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T21:15:42.498731] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T21:15:43.047715] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-07T21:15:43.736076] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T21:15:43.847624] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-07T21:15:44.178183] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T21:15:44.510700] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:15:44.513726] [INFO ] [REMOTE ] RLX: Full fetch complete (69782 records). [2025-10-07T21:15:44.513826] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-07T21:15:44.514784] [FATAL] [VALIDATOR ] RLX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:15:44.514934] [FATAL] [MAIN ] RLX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:15:44.515021] [WARN ] [MAIN ] RLX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:15:44.515117] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-07T21:15:44.515201] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-07T21:15:44.515239] [INFO ] [LOCAL ] RLX: Starting deletion of derivative data. [2025-10-07T21:15:44.515423] [DEBUG] [LOCAL ] RLX: Deleted derivative data file. [2025-10-07T21:15:44.515515] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RLX took 33.4s. Estimated remaining: 1h 18m 19s. Rate: 7.1 symbols/min [2025-10-07T21:15:44.653437] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-07T21:15:44.686805] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:15:44.699780] [DEBUG] [LOCAL ] RMM: Loaded 10607 existing records from primary storage. [2025-10-07T21:15:44.700077] [INFO ] [MAIN ] RMM: Loaded 10607 existing records. [2025-10-07T21:15:44.872522] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:15:44.872751] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-07T21:15:44.872802] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-07T21:15:44.873003] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-07T21:15:44.873059] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-07T21:15:45.221863] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:15:45.447604] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-07T21:15:46.247620] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-07T21:15:46.384515] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T21:15:46.645174] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T21:15:47.047616] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-07T21:15:47.444250] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-07T21:15:47.847639] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-07T21:15:47.938419] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T21:15:48.647691] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-07T21:15:49.290803] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-07T21:15:49.447633] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-07T21:15:49.554596] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T21:15:50.048165] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T21:15:50.247670] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-07T21:15:51.047672] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-07T21:15:51.603621] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T21:15:51.824804] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T21:15:51.847604] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-07T21:15:52.647710] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-07T21:15:53.447633] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-07T21:15:53.692857] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T21:15:53.755111] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T21:15:54.150327] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T21:15:54.247695] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-07T21:15:54.909921] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-07T21:15:55.047714] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-07T21:15:55.847697] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-07T21:15:56.545293] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T21:15:56.647616] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-07T21:15:56.844253] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:15:57.290283] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T21:15:57.447714] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-07T21:15:58.247717] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-07T21:15:58.422676] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T21:15:59.047661] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-07T21:15:59.102990] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T21:15:59.777945] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T21:15:59.780673] [INFO ] [REMOTE ] RMD: Full fetch complete (60909 records). [2025-10-07T21:15:59.780776] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-07T21:15:59.781490] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:15:59.781583] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:15:59.781626] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:15:59.781702] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-07T21:15:59.781788] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-07T21:15:59.781851] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-07T21:15:59.781919] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-07T21:15:59.782012] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RMD took 36.1s. Estimated remaining: 1h 18m 13s. Rate: 7.1 symbols/min [2025-10-07T21:15:59.852918] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-07T21:15:59.991344] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:15:59.999243] [DEBUG] [LOCAL ] RMMZ: Loaded 4816 existing records from primary storage. [2025-10-07T21:15:59.999422] [INFO ] [MAIN ] RMMZ: Loaded 4816 existing records. [2025-10-07T21:16:00.171603] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:16:00.171810] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-07T21:16:00.171857] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-07T21:16:00.172061] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-07T21:16:00.172119] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-07T21:16:00.517813] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:16:00.647598] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-07T21:16:00.935380] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T21:16:01.447730] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-07T21:16:01.754785] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T21:16:02.208913] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T21:16:02.247748] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-07T21:16:03.047684] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-07T21:16:03.132802] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T21:16:03.847629] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-07T21:16:03.995897] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T21:16:04.572220] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T21:16:04.647724] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-07T21:16:05.447638] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-07T21:16:05.469582] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T21:16:06.039903] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T21:16:06.247699] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-07T21:16:07.047724] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-07T21:16:07.153777] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-07T21:16:07.847722] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-07T21:16:08.227876] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T21:16:08.620770] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T21:16:08.647634] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-07T21:16:09.026422] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-07T21:16:09.027805] [INFO ] [REMOTE ] RMI: Full fetch complete (6200 records). [2025-10-07T21:16:09.027894] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-07T21:16:09.028497] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:16:09.028601] [FATAL] [MAIN ] RMI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:16:09.028696] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:16:09.028762] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-07T21:16:09.028874] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-07T21:16:09.028951] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-07T21:16:09.029479] [DEBUG] [LOCAL ] RMI: Deleted derivative data file. [2025-10-07T21:16:09.029948] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMI took 30.3s. Estimated remaining: 1h 18m 5s. Rate: 7.1 symbols/min [2025-10-07T21:16:09.223408] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:16:09.244522] [DEBUG] [LOCAL ] RMT: Loaded 17391 existing records from primary storage. [2025-10-07T21:16:09.244869] [INFO ] [MAIN ] RMT: Loaded 17391 existing records. [2025-10-07T21:16:09.427677] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:16:09.427935] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-07T21:16:09.427987] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-07T21:16:09.428282] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-07T21:16:09.428341] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-07T21:16:09.457844] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-07T21:16:09.796201] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:16:10.247625] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-07T21:16:10.553383] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T21:16:10.675504] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-07T21:16:11.047685] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-07T21:16:11.753499] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T21:16:11.847749] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-07T21:16:12.568044] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T21:16:12.647703] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-07T21:16:13.447712] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-07T21:16:13.807692] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T21:16:14.247683] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-07T21:16:14.424977] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T21:16:14.918990] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-07T21:16:15.047699] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-07T21:16:15.847677] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-07T21:16:16.200810] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T21:16:16.647673] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-07T21:16:16.689197] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T21:16:17.447690] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-07T21:16:17.860587] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T21:16:18.247740] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-07T21:16:18.380986] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-07T21:16:19.047616] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-07T21:16:19.288188] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T21:16:19.718048] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T21:16:19.847630] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-07T21:16:20.234979] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T21:16:20.235837] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7018 records). [2025-10-07T21:16:20.235905] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-07T21:16:20.236299] [FATAL] [VALIDATOR ] RMMZ: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:16:20.236384] [FATAL] [MAIN ] RMMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:16:20.236448] [WARN ] [MAIN ] RMMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:16:20.236520] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-07T21:16:20.236598] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-07T21:16:20.236712] [INFO ] [LOCAL ] RMMZ: Starting deletion of derivative data. [2025-10-07T21:16:20.236876] [DEBUG] [LOCAL ] RMMZ: Deleted derivative data file. [2025-10-07T21:16:20.236965] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMMZ took 20.5s. Estimated remaining: 1h 17m 57s. Rate: 7.1 symbols/min [2025-10-07T21:16:20.409417] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:16:20.457602] [DEBUG] [LOCAL ] RNG: Loaded 47976 existing records from primary storage. [2025-10-07T21:16:20.457975] [INFO ] [MAIN ] RNG: Loaded 47976 existing records. [2025-10-07T21:16:20.633068] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:16:20.633339] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-07T21:16:20.633401] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-07T21:16:20.633835] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-07T21:16:20.633895] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-07T21:16:20.653734] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-07T21:16:20.988095] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:16:21.257313] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T21:16:21.258554] [INFO ] [REMOTE ] RMM: Full fetch complete (14952 records). [2025-10-07T21:16:21.258626] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-07T21:16:21.259100] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:16:21.259181] [FATAL] [MAIN ] RMM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:16:21.259224] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:16:21.259263] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-07T21:16:21.259321] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-07T21:16:21.259356] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-07T21:16:21.259542] [DEBUG] [LOCAL ] RMM: Deleted derivative data file. [2025-10-07T21:16:21.259666] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMM took 36.7s. Estimated remaining: 1h 17m 46s. Rate: 7.1 symbols/min [2025-10-07T21:16:21.431906] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:16:21.452736] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-07T21:16:21.454328] [DEBUG] [LOCAL ] RNGR: Loaded 20390 existing records from primary storage. [2025-10-07T21:16:21.455358] [INFO ] [MAIN ] RNGR: Loaded 20390 existing records. [2025-10-07T21:16:21.637185] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:16:21.637427] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-07T21:16:21.637482] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-07T21:16:21.637781] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-07T21:16:21.637839] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-07T21:16:21.984567] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:16:22.247705] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-07T21:16:23.047749] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-07T21:16:23.404163] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-07T21:16:23.483449] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T21:16:23.847683] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-07T21:16:23.880933] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-07T21:16:24.647702] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-07T21:16:25.053778] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T21:16:25.447743] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-07T21:16:25.988998] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T21:16:26.006825] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T21:16:26.008479] [INFO ] [REMOTE ] RMAX: Full fetch complete (29860 records). [2025-10-07T21:16:26.008554] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-07T21:16:26.009220] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:16:26.009305] [FATAL] [MAIN ] RMAX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:16:26.009348] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:16:26.009390] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-07T21:16:26.009449] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-07T21:16:26.009485] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-07T21:16:26.009764] [DEBUG] [LOCAL ] RMAX: Deleted derivative data file. [2025-10-07T21:16:26.009882] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMAX took 1m 4s. Estimated remaining: 1h 17m 37s. Rate: 7.1 symbols/min [2025-10-07T21:16:26.177378] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:16:26.194103] [DEBUG] [LOCAL ] RNP: Loaded 15983 existing records from primary storage. [2025-10-07T21:16:26.194345] [INFO ] [MAIN ] RNP: Loaded 15983 existing records. [2025-10-07T21:16:26.254582] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-07T21:16:26.371713] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:16:26.371903] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-07T21:16:26.371949] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-07T21:16:26.372139] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-07T21:16:26.372196] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-07T21:16:26.723565] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:16:27.047671] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-07T21:16:27.393212] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T21:16:27.847714] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-07T21:16:28.647618] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-07T21:16:28.711960] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T21:16:28.991855] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T21:16:29.447691] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-07T21:16:29.769451] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T21:16:30.247675] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-07T21:16:31.047610] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-07T21:16:31.156741] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T21:16:31.415748] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T21:16:31.847712] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-07T21:16:32.270792] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T21:16:32.647688] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-07T21:16:33.160903] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T21:16:33.447721] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-07T21:16:34.247755] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-07T21:16:34.551473] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T21:16:34.650444] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T21:16:35.047684] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-07T21:16:35.178780] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-07T21:16:35.847728] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-07T21:16:36.204036] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T21:16:36.647716] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-07T21:16:36.917427] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-07T21:16:37.447696] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-07T21:16:38.229711] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T21:16:38.247595] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-07T21:16:38.576314] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T21:16:39.047684] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-07T21:16:39.847715] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-07T21:16:39.969939] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T21:16:40.022534] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-07T21:16:40.647684] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-07T21:16:41.195859] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T21:16:41.447612] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-07T21:16:41.797868] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T21:16:42.247684] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-07T21:16:42.723175] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T21:16:43.047692] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-07T21:16:43.333005] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T21:16:43.847699] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-07T21:16:44.245759] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-07T21:16:44.647697] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-07T21:16:45.013341] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T21:16:45.447677] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-07T21:16:46.105061] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T21:16:46.247606] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-07T21:16:46.743756] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-07T21:16:47.047720] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-07T21:16:47.847666] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-07T21:16:48.262988] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-07T21:16:48.342778] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T21:16:48.435962] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:16:48.438982] [INFO ] [REMOTE ] RNGR: Full fetch complete (28036 records). [2025-10-07T21:16:48.439185] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-07T21:16:48.439922] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:16:48.440011] [FATAL] [MAIN ] RNGR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:16:48.440055] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:16:48.440135] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-07T21:16:48.440230] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-07T21:16:48.440287] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-07T21:16:48.440486] [DEBUG] [LOCAL ] RNGR: Deleted derivative data file. [2025-10-07T21:16:48.440620] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RNGR took 27.2s. Estimated remaining: 1h 17m 33s. Rate: 7.1 symbols/min [2025-10-07T21:16:48.613903] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:16:48.651296] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-07T21:16:48.652219] [DEBUG] [LOCAL ] RNR: Loaded 33812 existing records from primary storage. [2025-10-07T21:16:48.653139] [INFO ] [MAIN ] RNR: Loaded 33812 existing records. [2025-10-07T21:16:48.841772] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:16:48.842034] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-07T21:16:48.842084] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-07T21:16:48.842330] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-10-07T21:16:48.842388] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-07T21:16:49.207994] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:16:49.447623] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-07T21:16:49.813384] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T21:16:50.247680] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-07T21:16:51.049679] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-07T21:16:51.051994] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T21:16:51.403854] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T21:16:51.831612] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T21:16:51.847638] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-07T21:16:52.647674] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-07T21:16:52.730979] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T21:16:52.732743] [INFO ] [REMOTE ] RMT: Full fetch complete (25389 records). [2025-10-07T21:16:52.732896] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-07T21:16:53.101941] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-07T21:16:53.102033] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-07T21:16:53.102639] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-07T21:16:53.102723] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-07T21:16:53.103706] [DEBUG] [LOCAL ] RMT: Trimmed 25389 records to 17377 (keeping 200 days of data) [2025-10-07T21:16:53.211418] [DEBUG] [LOCAL ] RMT: Primary data saved (17377 records). [2025-10-07T21:16:53.211570] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-07T21:16:53.211690] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 44.2s. Estimated remaining: 1h 17m 23s. Rate: 7.1 symbols/min [2025-10-07T21:16:53.380493] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:16:53.419327] [DEBUG] [LOCAL ] RNST: Loaded 36974 existing records from primary storage. [2025-10-07T21:16:53.419635] [INFO ] [MAIN ] RNST: Loaded 36974 existing records. [2025-10-07T21:16:53.452779] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-07T21:16:53.597041] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:16:53.597293] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-07T21:16:53.597341] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-07T21:16:53.597769] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-10-07T21:16:53.597826] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-07T21:16:53.961019] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:16:54.247681] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-07T21:16:54.551060] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T21:16:54.575806] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T21:16:54.577896] [INFO ] [REMOTE ] RNP: Full fetch complete (23684 records). [2025-10-07T21:16:54.577998] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-07T21:16:54.963089] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-07T21:16:54.963195] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-07T21:16:54.964091] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-07T21:16:54.964156] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-07T21:16:54.964957] [DEBUG] [LOCAL ] RNP: Trimmed 23684 records to 16007 (keeping 200 days of data) [2025-10-07T21:16:55.053100] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-07T21:16:55.095314] [DEBUG] [LOCAL ] RNP: Primary data saved (16007 records). [2025-10-07T21:16:55.095531] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-07T21:16:55.095706] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNP took 29.1s. Estimated remaining: 1h 17m 13s. Rate: 7.1 symbols/min [2025-10-07T21:16:55.288952] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:16:55.311223] [DEBUG] [LOCAL ] ROG: Loaded 22753 existing records from primary storage. [2025-10-07T21:16:55.311485] [INFO ] [MAIN ] ROG: Loaded 22753 existing records. [2025-10-07T21:16:55.521467] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:16:55.521774] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-07T21:16:55.521843] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-07T21:16:55.522038] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-10-07T21:16:55.522096] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-07T21:16:55.857796] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-07T21:16:55.916957] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:16:55.948151] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T21:16:56.647707] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-07T21:16:56.817084] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T21:16:57.143137] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T21:16:57.447696] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-07T21:16:57.926378] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T21:16:58.186537] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-07T21:16:58.247600] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-07T21:16:59.047702] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-07T21:16:59.283167] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T21:16:59.847702] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-07T21:17:00.622465] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T21:17:00.647616] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-07T21:17:01.447742] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-07T21:17:01.586771] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T21:17:02.177419] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T21:17:02.247717] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-07T21:17:02.639913] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T21:17:03.047734] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-07T21:17:03.674390] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:17:03.677868] [INFO ] [REMOTE ] RNG: Full fetch complete (69035 records). [2025-10-07T21:17:03.678002] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-07T21:17:03.678842] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:17:03.678935] [FATAL] [MAIN ] RNG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:17:03.678979] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:17:03.679048] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-07T21:17:03.679115] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-07T21:17:03.679153] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-07T21:17:03.679367] [DEBUG] [LOCAL ] RNG: Deleted derivative data file. [2025-10-07T21:17:03.679496] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNG took 43.4s. Estimated remaining: 1h 17m 4s. Rate: 7.1 symbols/min [2025-10-07T21:17:03.854947] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-07T21:17:03.858821] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:17:03.859886] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-07T21:17:03.859954] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-07T21:17:03.860165] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-07T21:17:03.860224] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-07T21:17:03.860279] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-07T21:17:03.860444] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-07T21:17:04.179347] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T21:17:04.267879] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:17:04.647734] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-07T21:17:05.132230] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T21:17:05.447719] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-07T21:17:06.247730] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-07T21:17:06.335834] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T21:17:07.047705] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-07T21:17:07.212078] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T21:17:07.847700] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-07T21:17:07.989822] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T21:17:08.647741] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-07T21:17:08.930350] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T21:17:09.415327] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T21:17:09.447599] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-07T21:17:10.247708] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-07T21:17:10.373584] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T21:17:11.047710] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-07T21:17:11.121700] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:17:11.781529] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T21:17:11.847678] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-07T21:17:12.210435] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-07T21:17:12.647718] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-07T21:17:13.014355] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T21:17:13.447722] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-07T21:17:13.964526] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-07T21:17:14.247741] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-07T21:17:15.028086] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T21:17:15.047610] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-07T21:17:15.847627] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-07T21:17:16.005602] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T21:17:16.649154] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-07T21:17:16.666717] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T21:17:17.032980] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T21:17:17.447680] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-07T21:17:18.039137] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:17:18.041702] [INFO ] [REMOTE ] RNR: Full fetch complete (50856 records). [2025-10-07T21:17:18.041806] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-07T21:17:18.042604] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:17:18.042718] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:17:18.042764] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:17:18.042805] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-07T21:17:18.042866] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-07T21:17:18.042904] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-07T21:17:18.043324] [DEBUG] [LOCAL ] RNR: Deleted derivative data file. [2025-10-07T21:17:18.043455] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNR took 29.6s. Estimated remaining: 1h 16m 57s. Rate: 7.1 symbols/min [2025-10-07T21:17:18.215231] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:17:18.215509] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-07T21:17:18.215574] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-07T21:17:18.215738] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-07T21:17:18.215821] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-07T21:17:18.215905] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-07T21:17:18.216030] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-07T21:17:18.252749] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-07T21:17:18.384169] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T21:17:18.616130] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:17:19.047697] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-07T21:17:19.614527] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-07T21:17:19.847667] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-07T21:17:20.647609] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-07T21:17:20.911085] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-07T21:17:20.986102] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-07T21:17:21.447739] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-07T21:17:22.247719] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-07T21:17:22.494196] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T21:17:23.047614] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-07T21:17:23.321246] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-07T21:17:23.454598] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T21:17:23.847699] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-07T21:17:24.647686] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-07T21:17:24.861506] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T21:17:25.361369] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T21:17:25.447621] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-07T21:17:25.753174] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T21:17:26.247695] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-07T21:17:26.961402] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T21:17:27.047628] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-07T21:17:27.601318] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T21:17:27.602883] [INFO ] [REMOTE ] ROG: Full fetch complete (30877 records). [2025-10-07T21:17:27.602954] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-07T21:17:27.603449] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:17:27.603532] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:17:27.603574] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:17:27.603733] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-07T21:17:27.603824] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-07T21:17:27.603988] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-07T21:17:27.604332] [DEBUG] [LOCAL ] ROG: Deleted derivative data file. [2025-10-07T21:17:27.604432] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. ROG took 32.5s. Estimated remaining: 1h 16m 49s. Rate: 7.1 symbols/min [2025-10-07T21:17:27.776107] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:17:27.822323] [DEBUG] [LOCAL ] RPM: Loaded 41589 existing records from primary storage. [2025-10-07T21:17:27.822681] [INFO ] [MAIN ] RPM: Loaded 41589 existing records. [2025-10-07T21:17:27.852790] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-07T21:17:28.010580] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:17:28.010917] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-07T21:17:28.010994] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-07T21:17:28.011386] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-10-07T21:17:28.011446] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-07T21:17:28.316210] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-07T21:17:28.411312] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:17:28.647669] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-07T21:17:29.447730] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-07T21:17:29.740229] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-07T21:17:30.099233] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T21:17:30.102929] [INFO ] [REMOTE ] RNST: Full fetch complete (52932 records). [2025-10-07T21:17:30.103051] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-07T21:17:30.103820] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:17:30.103912] [FATAL] [MAIN ] RNST: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:17:30.103961] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:17:30.104047] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-07T21:17:30.104157] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-07T21:17:30.104227] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-07T21:17:30.104450] [DEBUG] [LOCAL ] RNST: Deleted derivative data file. [2025-10-07T21:17:30.104545] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. RNST took 36.9s. Estimated remaining: 1h 16m 39s. Rate: 7.1 symbols/min [2025-10-07T21:17:30.257847] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-07T21:17:30.333895] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:17:30.359229] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T21:17:30.383959] [DEBUG] [LOCAL ] RPT: Loaded 18988 existing records from primary storage. [2025-10-07T21:17:30.384262] [INFO ] [MAIN ] RPT: Loaded 18988 existing records. [2025-10-07T21:17:30.611277] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:17:30.611514] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-07T21:17:30.611589] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-07T21:17:30.611804] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-07T21:17:30.611864] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-07T21:17:31.038552] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:17:31.047718] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-07T21:17:31.788786] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T21:17:31.847614] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-07T21:17:32.364509] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T21:17:32.647689] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-07T21:17:33.447726] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-07T21:17:33.792691] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T21:17:34.245677] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T21:17:34.251128] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-07T21:17:34.308180] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T21:17:35.047718] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-07T21:17:35.431096] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-07T21:17:35.847719] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-07T21:17:36.647800] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-07T21:17:36.808521] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T21:17:37.006985] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T21:17:37.447728] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-07T21:17:38.247684] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-07T21:17:38.380254] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T21:17:39.047757] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-07T21:17:39.315877] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T21:17:39.356306] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T21:17:39.847739] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-07T21:17:40.647721] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-07T21:17:41.095077] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T21:17:41.447791] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-07T21:17:41.649696] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:17:41.699521] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T21:17:42.247742] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-07T21:17:43.047630] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-07T21:17:43.191724] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T21:17:43.257593] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T21:17:43.847626] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-07T21:17:44.118961] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T21:17:44.647673] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-07T21:17:45.447709] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-07T21:17:45.448686] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T21:17:45.971169] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T21:17:46.247731] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-07T21:17:46.860706] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T21:17:46.982514] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T21:17:46.985217] [INFO ] [REMOTE ] ROK: Full fetch complete (62584 records). [2025-10-07T21:17:46.985332] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-07T21:17:46.986019] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:17:46.986103] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:17:46.986146] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:17:46.986215] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-07T21:17:46.986281] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-07T21:17:46.986317] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-07T21:17:46.986357] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-07T21:17:46.986414] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. ROK took 43.3s. Estimated remaining: 1h 16m 33s. Rate: 7.1 symbols/min [2025-10-07T21:17:47.052756] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-07T21:17:47.159972] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:17:47.193237] [DEBUG] [LOCAL ] RQI: Loaded 29074 existing records from primary storage. [2025-10-07T21:17:47.193549] [INFO ] [MAIN ] RQI: Loaded 29074 existing records. [2025-10-07T21:17:47.376105] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:17:47.376317] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-07T21:17:47.376365] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-07T21:17:47.376717] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-07T21:17:47.376780] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-07T21:17:47.725911] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:17:47.847702] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-07T21:17:48.647623] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-07T21:17:49.043603] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-07T21:17:49.420939] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T21:17:49.447612] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-07T21:17:50.148406] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T21:17:50.247751] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-07T21:17:50.996273] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T21:17:51.047785] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-07T21:17:51.847709] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-07T21:17:51.899733] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T21:17:52.283637] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T21:17:52.647690] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-07T21:17:52.775974] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-07T21:17:53.447725] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-07T21:17:53.814819] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T21:17:54.247730] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-07T21:17:55.047687] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-07T21:17:55.143038] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T21:17:55.748674] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T21:17:55.812029] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T21:17:55.847666] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-07T21:17:56.647723] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-07T21:17:56.990233] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T21:17:57.243884] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T21:17:57.247835] [INFO ] [REMOTE ] ROL: Full fetch complete (72515 records). [2025-10-07T21:17:57.248028] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-07T21:17:57.249200] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:17:57.249303] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:17:57.249350] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:17:57.249415] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-07T21:17:57.249509] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-07T21:17:57.249551] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-07T21:17:57.249594] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-07T21:17:57.249757] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. ROL took 39.2s. Estimated remaining: 1h 16m 25s. Rate: 7.1 symbols/min [2025-10-07T21:17:57.428291] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:17:57.461922] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-07T21:17:57.485462] [DEBUG] [LOCAL ] RRC: Loaded 52852 existing records from primary storage. [2025-10-07T21:17:57.485921] [INFO ] [MAIN ] RRC: Loaded 52852 existing records. [2025-10-07T21:17:57.672030] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:17:57.672336] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-07T21:17:57.672387] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-07T21:17:57.672700] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-10-07T21:17:57.672769] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-07T21:17:58.100193] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:17:58.247742] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-07T21:17:58.605451] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T21:17:59.047739] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-07T21:17:59.470704] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T21:17:59.472146] [INFO ] [REMOTE ] RPT: Full fetch complete (28368 records). [2025-10-07T21:17:59.472231] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-07T21:17:59.473050] [FATAL] [VALIDATOR ] RPT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:17:59.473204] [FATAL] [MAIN ] RPT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:17:59.473289] [WARN ] [MAIN ] RPT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:17:59.473386] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-07T21:17:59.473470] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-07T21:17:59.473508] [INFO ] [LOCAL ] RPT: Starting deletion of derivative data. [2025-10-07T21:17:59.473746] [DEBUG] [LOCAL ] RPT: Deleted derivative data file. [2025-10-07T21:17:59.473843] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. RPT took 29.4s. Estimated remaining: 1h 16m 15s. Rate: 7.1 symbols/min [2025-10-07T21:17:59.644698] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:17:59.692032] [DEBUG] [LOCAL ] RRX: Loaded 41022 existing records from primary storage. [2025-10-07T21:17:59.692350] [INFO ] [MAIN ] RRX: Loaded 41022 existing records. [2025-10-07T21:17:59.850484] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-07T21:17:59.879285] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:17:59.880753] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-07T21:17:59.880837] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-07T21:17:59.881350] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-10-07T21:17:59.881412] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-07T21:18:00.090792] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T21:18:00.275343] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:18:00.647779] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-07T21:18:01.257837] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T21:18:01.261977] [INFO ] [REMOTE ] RPM: Full fetch complete (59161 records). [2025-10-07T21:18:01.262127] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-07T21:18:01.262992] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:18:01.263093] [FATAL] [MAIN ] RPM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:18:01.263137] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:18:01.263177] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-07T21:18:01.263251] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-07T21:18:01.263323] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-07T21:18:01.263513] [DEBUG] [LOCAL ] RPM: Deleted derivative data file. [2025-10-07T21:18:01.263636] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPM took 33.7s. Estimated remaining: 1h 16m 4s. Rate: 7.1 symbols/min [2025-10-07T21:18:01.447478] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:18:01.447680] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-07T21:18:01.476841] [DEBUG] [LOCAL ] RS: Loaded 25118 existing records from primary storage. [2025-10-07T21:18:01.477147] [INFO ] [MAIN ] RS: Loaded 25118 existing records. [2025-10-07T21:18:01.660912] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:18:01.661346] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-07T21:18:01.661474] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-07T21:18:01.661739] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-10-07T21:18:01.661797] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-07T21:18:02.088629] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:18:02.091240] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-07T21:18:02.247740] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-07T21:18:03.047626] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-07T21:18:03.140459] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T21:18:03.847629] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-07T21:18:03.922630] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T21:18:04.012310] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T21:18:04.647716] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-07T21:18:05.447728] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-07T21:18:05.529180] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T21:18:06.256860] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-07T21:18:06.262961] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T21:18:06.981787] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T21:18:07.047734] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-07T21:18:07.847676] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-07T21:18:08.242947] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-07T21:18:08.636555] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T21:18:08.647602] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-07T21:18:09.411575] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T21:18:09.447619] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-07T21:18:10.231777] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T21:18:10.247597] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-07T21:18:10.970591] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T21:18:11.047677] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-07T21:18:11.761961] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T21:18:11.847717] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-07T21:18:12.572969] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T21:18:12.647711] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-07T21:18:13.084971] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T21:18:13.447784] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-07T21:18:14.247752] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-07T21:18:14.299945] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T21:18:15.047702] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-07T21:18:15.279203] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T21:18:15.634615] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T21:18:15.847689] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-07T21:18:16.647708] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-07T21:18:16.855853] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T21:18:17.317625] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T21:18:17.447712] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-07T21:18:17.827420] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T21:18:17.829768] [INFO ] [REMOTE ] RQI: Full fetch complete (43192 records). [2025-10-07T21:18:17.829856] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-07T21:18:18.202996] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-07T21:18:18.203085] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-07T21:18:18.203869] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-07T21:18:18.203936] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-07T21:18:18.205238] [DEBUG] [LOCAL ] RQI: Trimmed 43192 records to 29076 (keeping 200 days of data) [2025-10-07T21:18:18.266233] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-07T21:18:18.397550] [DEBUG] [LOCAL ] RQI: Primary data saved (29076 records). [2025-10-07T21:18:18.397743] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-07T21:18:18.397882] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RQI took 31.4s. Estimated remaining: 1h 15m 59s. Rate: 7.1 symbols/min [2025-10-07T21:18:18.566081] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:18:18.573120] [DEBUG] [LOCAL ] RSF: Loaded 4284 existing records from primary storage. [2025-10-07T21:18:18.573334] [INFO ] [MAIN ] RSF: Loaded 4284 existing records. [2025-10-07T21:18:18.748100] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:18:18.748351] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-07T21:18:18.748403] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-07T21:18:18.748578] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-07T21:18:18.748636] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-07T21:18:19.049713] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-07T21:18:19.110243] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:18:19.327059] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T21:18:19.582332] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T21:18:19.847720] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-07T21:18:20.647627] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-07T21:18:21.096741] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-07T21:18:21.122136] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T21:18:21.246811] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T21:18:21.447668] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-07T21:18:22.247675] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-07T21:18:22.781455] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T21:18:22.783185] [INFO ] [REMOTE ] RS: Full fetch complete (39027 records). [2025-10-07T21:18:22.783267] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-07T21:18:22.783894] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:18:22.784008] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:18:22.784051] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:18:22.784152] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-07T21:18:22.784230] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-07T21:18:22.784267] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-07T21:18:22.784428] [DEBUG] [LOCAL ] RS: Deleted derivative data file. [2025-10-07T21:18:22.784522] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RS took 21.5s. Estimated remaining: 1h 15m 49s. Rate: 7.1 symbols/min [2025-10-07T21:18:22.967675] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:18:22.967923] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-07T21:18:22.967980] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-07T21:18:22.968100] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-07T21:18:22.968146] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-07T21:18:22.968191] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-07T21:18:22.968242] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-07T21:18:23.048517] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-07T21:18:23.392275] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:18:23.575734] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-07T21:18:23.805951] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T21:18:23.847709] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-07T21:18:24.509580] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T21:18:24.647702] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-07T21:18:25.447698] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-07T21:18:26.247689] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-07T21:18:26.952133] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-07T21:18:27.047688] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-07T21:18:27.224056] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:18:27.574181] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T21:18:27.662197] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T21:18:27.847681] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-07T21:18:28.532713] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-07T21:18:28.647699] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-07T21:18:29.447682] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-07T21:18:30.247738] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-07T21:18:30.579236] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T21:18:30.691478] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-07T21:18:31.047750] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-07T21:18:31.847814] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-07T21:18:32.472525] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-07T21:18:32.647626] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-07T21:18:32.976241] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-07T21:18:33.144263] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T21:18:33.447728] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-07T21:18:34.247627] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-07T21:18:34.658172] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T21:18:35.047014] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T21:18:35.048352] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-07T21:18:35.087465] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T21:18:35.847705] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-07T21:18:36.647633] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-07T21:18:37.051503] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T21:18:37.447688] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-07T21:18:37.500580] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T21:18:37.833547] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-07T21:18:38.247685] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-07T21:18:39.047624] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-07T21:18:39.358580] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-07T21:18:39.847628] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-07T21:18:40.244301] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T21:18:40.264093] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T21:18:40.267952] [INFO ] [REMOTE ] RRC: Full fetch complete (76037 records). [2025-10-07T21:18:40.268083] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-07T21:18:40.269341] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:18:40.269436] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:18:40.269481] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:18:40.269524] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-07T21:18:40.269594] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-07T21:18:40.269633] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-07T21:18:40.269826] [DEBUG] [LOCAL ] RRC: Deleted derivative data file. [2025-10-07T21:18:40.269919] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRC took 43.0s. Estimated remaining: 1h 15m 43s. Rate: 7.1 symbols/min [2025-10-07T21:18:40.448866] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:18:40.498416] [DEBUG] [LOCAL ] RSI: Loaded 46819 existing records from primary storage. [2025-10-07T21:18:40.498869] [INFO ] [MAIN ] RSI: Loaded 46819 existing records. [2025-10-07T21:18:40.649919] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-07T21:18:40.684362] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:18:40.684853] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-07T21:18:40.685113] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-07T21:18:40.685426] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-10-07T21:18:40.685529] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-07T21:18:41.042031] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T21:18:41.131899] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:18:41.447627] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-07T21:18:41.453917] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-07T21:18:42.024021] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T21:18:42.027093] [INFO ] [REMOTE ] RRX: Full fetch complete (58083 records). [2025-10-07T21:18:42.027217] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-07T21:18:42.028020] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:18:42.028136] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:18:42.028220] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:18:42.028316] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-07T21:18:42.028395] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-07T21:18:42.028433] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-07T21:18:42.028963] [DEBUG] [LOCAL ] RRX: Deleted derivative data file. [2025-10-07T21:18:42.029364] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RRX took 42.6s. Estimated remaining: 1h 15m 33s. Rate: 7.1 symbols/min [2025-10-07T21:18:42.207275] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:18:42.246251] [DEBUG] [LOCAL ] RSKD: Loaded 33490 existing records from primary storage. [2025-10-07T21:18:42.246715] [INFO ] [MAIN ] RSKD: Loaded 33490 existing records. [2025-10-07T21:18:42.252895] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-07T21:18:42.439300] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:18:42.439610] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-07T21:18:42.439698] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-07T21:18:42.439961] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-07T21:18:42.440015] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-07T21:18:42.831800] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:18:43.047628] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-07T21:18:43.168782] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T21:18:43.847714] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-07T21:18:44.501483] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T21:18:44.507564] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T21:18:44.647722] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-07T21:18:45.447690] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-07T21:18:46.247719] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-07T21:18:46.500674] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T21:18:46.848179] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T21:18:46.849269] [INFO ] [REMOTE ] RSF: Full fetch complete (5678 records). [2025-10-07T21:18:46.849368] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-07T21:18:47.052828] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-07T21:18:47.177510] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T21:18:47.300787] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-07T21:18:47.300941] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-07T21:18:47.301284] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-07T21:18:47.301363] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-07T21:18:47.302083] [DEBUG] [LOCAL ] RSF: Trimmed 5678 records to 4310 (keeping 200 days of data) [2025-10-07T21:18:47.333946] [DEBUG] [LOCAL ] RSF: Primary data saved (4310 records). [2025-10-07T21:18:47.334119] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-07T21:18:47.334219] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RSF took 28.9s. Estimated remaining: 1h 15m 23s. Rate: 7.1 symbols/min [2025-10-07T21:18:47.501064] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:18:47.537867] [DEBUG] [LOCAL ] RTO: Loaded 40048 existing records from primary storage. [2025-10-07T21:18:47.538185] [INFO ] [MAIN ] RTO: Loaded 40048 existing records. [2025-10-07T21:18:47.716413] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:18:47.716771] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-07T21:18:47.716843] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-07T21:18:47.717109] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-07T21:18:47.717167] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-07T21:18:47.853043] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-07T21:18:48.070571] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:18:48.647693] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-07T21:18:49.008015] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-07T21:18:49.447748] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-07T21:18:49.787114] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-07T21:18:49.996961] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T21:18:50.247724] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-07T21:18:50.999632] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T21:18:51.047605] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-07T21:18:51.502592] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T21:18:51.847714] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-07T21:18:52.455175] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T21:18:52.647744] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-07T21:18:53.447747] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-07T21:18:53.577290] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T21:18:54.252959] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-07T21:18:54.275477] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T21:18:54.643204] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T21:18:55.047767] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-07T21:18:55.847719] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-07T21:18:56.209733] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T21:18:56.647636] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-07T21:18:56.843381] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T21:18:57.314133] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T21:18:57.447686] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-07T21:18:58.247729] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-07T21:18:58.475748] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T21:18:59.047713] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-07T21:18:59.355351] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T21:18:59.415339] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T21:18:59.847756] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-07T21:19:00.647687] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-07T21:19:01.157375] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T21:19:01.447789] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-07T21:19:01.600104] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T21:19:02.233197] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-07T21:19:02.247610] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-07T21:19:03.047700] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-07T21:19:03.358098] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T21:19:03.686193] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T21:19:03.847734] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-07T21:19:04.647731] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-07T21:19:04.705599] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T21:19:04.824922] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T21:19:05.447729] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-07T21:19:06.241037] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T21:19:06.249248] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-07T21:19:06.933044] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T21:19:06.936624] [INFO ] [REMOTE ] RSG: Full fetch complete (67718 records). [2025-10-07T21:19:06.936817] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-07T21:19:06.937889] [FATAL] [VALIDATOR ] RSG: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:19:06.937981] [FATAL] [MAIN ] RSG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:19:06.938027] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:19:06.938072] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-07T21:19:06.938160] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-07T21:19:06.938217] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-07T21:19:06.938275] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-07T21:19:06.938372] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSG took 44.2s. Estimated remaining: 1h 15m 18s. Rate: 7.1 symbols/min [2025-10-07T21:19:07.047718] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-07T21:19:07.180321] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T21:19:07.847727] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-07T21:19:08.491424] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T21:19:08.647743] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-07T21:19:09.393243] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T21:19:09.418614] [INFO ] [REMOTE ] RSKD: Full fetch complete (48049 records). [2025-10-07T21:19:09.419621] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T21:19:09.419984] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-07T21:19:09.429442] [FATAL] [VALIDATOR ] RSKD: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:19:09.430012] [FATAL] [MAIN ] RSKD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:19:09.430091] [WARN ] [MAIN ] RSKD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:19:09.430169] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-07T21:19:09.430249] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-07T21:19:09.430287] [INFO ] [LOCAL ] RSKD: Starting deletion of derivative data. [2025-10-07T21:19:09.430590] [DEBUG] [LOCAL ] RSKD: Deleted derivative data file. [2025-10-07T21:19:09.430733] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSKD took 27.4s. Estimated remaining: 1h 15m 8s. Rate: 7.1 symbols/min [2025-10-07T21:19:09.447616] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-07T21:19:10.247800] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-07T21:19:11.200691] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T21:19:11.211285] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-07T21:19:11.950797] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T21:19:11.962965] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-07T21:19:12.920945] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T21:19:12.930999] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-07T21:19:13.762601] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:19:13.774925] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-07T21:19:14.516891] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T21:19:14.526537] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-07T21:19:15.192368] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T21:19:15.195232] [INFO ] [REMOTE ] RTO: Full fetch complete (58297 records). [2025-10-07T21:19:15.195368] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-07T21:19:15.196047] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:19:15.196135] [FATAL] [MAIN ] RTO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:19:15.196180] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:19:15.196219] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-07T21:19:15.196278] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-07T21:19:15.196314] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-07T21:19:15.196460] [DEBUG] [LOCAL ] RTO: Deleted derivative data file. [2025-10-07T21:19:15.196554] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RTO took 27.9s. Estimated remaining: 1h 14m 59s. Rate: 7.1 symbols/min [2025-10-07T21:19:15.624865] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T21:19:15.638022] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-07T21:19:16.391348] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-07T21:19:16.394767] [INFO ] [REMOTE ] RSI: Full fetch complete (69126 records). [2025-10-07T21:19:16.394982] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-07T21:19:16.396002] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:19:16.396098] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:19:16.396146] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:19:16.396186] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-07T21:19:16.396252] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-07T21:19:16.396288] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-07T21:19:16.396514] [DEBUG] [LOCAL ] RSI: Deleted derivative data file. [2025-10-07T21:19:16.396668] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSI took 36.1s. Estimated remaining: 1h 14m 48s. Rate: 7.1 symbols/min [2025-10-07T21:19:16.978974] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:19:17.037629] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:19:17.198835] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:19:17.184746] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:19:17.199734] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-07T21:19:17.199609] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-07T21:19:17.200000] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-07T21:19:17.199912] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-07T21:19:17.200280] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-07T21:19:17.200548] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-07T21:19:17.200714] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-07T21:19:17.201215] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-07T21:19:17.201371] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-07T21:19:17.201278] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-07T21:19:17.233007] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-07T21:19:17.244669] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-07T21:19:17.441012] [DEBUG] [LOCAL ] RVT: Loaded 26395 existing records from primary storage. [2025-10-07T21:19:17.499206] [DEBUG] [LOCAL ] RVLV: Loaded 47506 existing records from primary storage. [2025-10-07T21:19:17.520114] [INFO ] [MAIN ] RVT: Loaded 26395 existing records. [2025-10-07T21:19:17.525720] [INFO ] [MAIN ] RVLV: Loaded 47506 existing records. [2025-10-07T21:19:18.356775] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:19:18.417634] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:19:18.366917] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:19:18.428123] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-07T21:19:18.443288] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-07T21:19:18.443540] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-07T21:19:18.449460] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-07T21:19:18.449793] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-07T21:19:18.461437] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-10-07T21:19:18.476790] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-07T21:19:18.486856] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-07T21:19:18.503624] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-07T21:19:18.496708] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:19:18.532855] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-07T21:19:19.243044] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:19:19.265905] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-07T21:19:19.265545] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:19:19.267272] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-07T21:19:20.117797] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T21:19:20.127217] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-07T21:19:20.899614] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T21:19:20.907077] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-07T21:19:20.985216] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-07T21:19:20.997452] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-07T21:19:21.079383] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T21:19:21.447694] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-07T21:19:22.002637] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T21:19:22.247756] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-07T21:19:22.383961] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T21:19:23.047626] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-07T21:19:23.094806] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T21:19:23.165074] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T21:19:23.628862] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T21:19:23.847773] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-07T21:19:24.412940] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T21:19:24.647753] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-07T21:19:25.191574] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T21:19:25.447704] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-07T21:19:26.247637] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-07T21:19:26.506453] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T21:19:26.904780] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T21:19:27.047688] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-07T21:19:27.847716] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-07T21:19:28.000127] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T21:19:28.483946] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T21:19:28.647712] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-07T21:19:29.447688] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-07T21:19:29.800491] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T21:19:30.247713] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-07T21:19:30.473147] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T21:19:31.047717] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-07T21:19:31.253140] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:19:31.847684] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-07T21:19:32.100282] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T21:19:32.652034] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-07T21:19:32.670086] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T21:19:33.050286] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T21:19:33.447680] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-07T21:19:34.247687] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-07T21:19:34.491005] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-07T21:19:35.047639] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-07T21:19:35.248846] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T21:19:35.847683] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-07T21:19:36.557378] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T21:19:36.647622] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-07T21:19:36.909631] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-07T21:19:37.447723] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-07T21:19:37.670258] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T21:19:38.083865] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T21:19:38.247740] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-07T21:19:39.047677] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-07T21:19:39.375572] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-07T21:19:39.847631] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-07T21:19:40.081073] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T21:19:40.200833] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T21:19:40.647694] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-07T21:19:41.447637] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-07T21:19:41.635548] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T21:19:42.247623] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-07T21:19:42.451811] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:19:42.510025] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-07T21:19:43.047698] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-07T21:19:43.847633] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-07T21:19:44.063263] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-07T21:19:44.647733] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-07T21:19:45.368705] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:19:45.372101] [INFO ] [REMOTE ] RVTY: Full fetch complete (66634 records). [2025-10-07T21:19:45.372258] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-07T21:19:45.373161] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:19:45.373367] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:19:45.373509] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:19:45.373587] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-07T21:19:45.373704] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-07T21:19:45.373761] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-07T21:19:45.373823] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-07T21:19:45.373919] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVTY took 29.0s. Estimated remaining: 1h 14m 46s. Rate: 7.1 symbols/min [2025-10-07T21:19:45.469279] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-07T21:19:45.520136] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-07T21:19:45.608792] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:19:45.638670] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T21:19:45.683150] [DEBUG] [LOCAL ] RWT: Loaded 40852 existing records from primary storage. [2025-10-07T21:19:45.683465] [INFO ] [MAIN ] RWT: Loaded 40852 existing records. [2025-10-07T21:19:45.908122] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:19:45.908383] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-07T21:19:45.908444] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-07T21:19:45.908728] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-07T21:19:45.908786] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-07T21:19:46.254586] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-07T21:19:46.259366] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:19:46.609033] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T21:19:46.611255] [INFO ] [REMOTE ] RVT: Full fetch complete (39345 records). [2025-10-07T21:19:46.611351] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-07T21:19:46.913069] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:19:46.955530] [INFO ] [REMOTE ] RVLV: Full fetch complete (68415 records). [2025-10-07T21:19:46.975574] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-07T21:19:47.005218] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-07T21:19:47.005009] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:19:47.005373] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-07T21:19:47.005328] [FATAL] [MAIN ] RVLV: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:19:47.006222] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-07T21:19:47.006354] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-07T21:19:47.006301] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:19:47.006559] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-07T21:19:47.006957] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-07T21:19:47.007113] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-07T21:19:47.007486] [DEBUG] [LOCAL ] RVLV: Deleted derivative data file. [2025-10-07T21:19:47.007742] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVLV took 30.6s. Estimated remaining: 1h 14m 35s. Rate: 7.1 symbols/min [2025-10-07T21:19:47.007613] [DEBUG] [LOCAL ] RVT: Trimmed 39345 records to 26409 (keeping 200 days of data) [2025-10-07T21:19:47.056924] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-07T21:19:47.277116] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:19:47.278044] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-07T21:19:47.278112] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-07T21:19:47.278769] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-07T21:19:47.278848] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-07T21:19:47.280159] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-07T21:19:47.280745] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-07T21:19:47.698803] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:19:47.751791] [DEBUG] [LOCAL ] RVT: Primary data saved (26409 records). [2025-10-07T21:19:47.751935] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-07T21:19:47.752035] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RVT took 31.3s. Estimated remaining: 1h 14m 24s. Rate: 7.1 symbols/min [2025-10-07T21:19:47.851618] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-07T21:19:47.922529] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:19:47.922725] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-07T21:19:47.922776] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-07T21:19:47.922883] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-07T21:19:47.922924] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-07T21:19:47.922966] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-07T21:19:47.922999] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-07T21:19:48.277819] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:19:48.458446] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-07T21:19:48.647719] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-07T21:19:49.231106] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T21:19:49.447691] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-07T21:19:49.606075] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-07T21:19:50.154066] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-07T21:19:50.247726] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-07T21:19:50.772285] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-07T21:19:51.047703] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-07T21:19:51.847724] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-07T21:19:52.437280] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T21:19:52.647698] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-07T21:19:52.768222] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T21:19:53.447749] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-07T21:19:54.056759] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T21:19:54.247690] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-07T21:19:54.851685] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-07T21:19:54.905744] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-07T21:19:55.047722] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-07T21:19:55.586535] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-07T21:19:55.847728] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-07T21:19:56.537442] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-07T21:19:56.647624] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-07T21:19:57.305852] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T21:19:57.447718] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-07T21:19:58.247732] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-07T21:19:58.750731] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-07T21:19:59.047167] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T21:19:59.056244] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-07T21:19:59.806540] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T21:19:59.847602] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-07T21:20:00.557765] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T21:20:00.647696] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-07T21:20:01.447746] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-07T21:20:02.012714] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T21:20:02.013575] [INFO ] [REMOTE ] RWTO: Full fetch complete (4807 records). [2025-10-07T21:20:02.013676] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-07T21:20:02.014070] [FATAL] [VALIDATOR ] RWTO: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:20:02.014152] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:20:02.014195] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:20:02.014235] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-07T21:20:02.014292] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-07T21:20:02.014327] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-07T21:20:02.014366] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-07T21:20:02.014417] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RWTO took 14.3s. Estimated remaining: 1h 14m 18s. Rate: 7.1 symbols/min [2025-10-07T21:20:02.188240] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:20:02.188435] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-07T21:20:02.188474] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-07T21:20:02.188587] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-07T21:20:02.188628] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-07T21:20:02.188714] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-07T21:20:02.188788] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-07T21:20:02.252903] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-07T21:20:02.548638] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:20:02.889218] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-07T21:20:03.047732] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-07T21:20:03.847680] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-07T21:20:04.001513] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T21:20:04.159523] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T21:20:04.411079] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-07T21:20:04.647711] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-07T21:20:05.201687] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-07T21:20:05.447728] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-07T21:20:06.102556] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-07T21:20:06.247787] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-07T21:20:06.717312] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-07T21:20:07.047714] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-07T21:20:07.412418] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:20:07.412922] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-07T21:20:07.413084] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:20:07.413165] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-07T21:20:07.413235] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:20:07.413299] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-07T21:20:07.413361] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-07T21:20:07.413397] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-07T21:20:07.413435] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-07T21:20:07.413482] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RWTP took 5.4s. Estimated remaining: 1h 14m 8s. Rate: 7.1 symbols/min [2025-10-07T21:20:07.585725] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:20:07.631035] [DEBUG] [LOCAL ] RXO: Loaded 47976 existing records from primary storage. [2025-10-07T21:20:07.631345] [INFO ] [MAIN ] RXO: Loaded 47976 existing records. [2025-10-07T21:20:07.805318] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:20:07.805534] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-07T21:20:07.805581] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-07T21:20:07.806813] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-07T21:20:07.806874] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-07T21:20:07.852932] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-07T21:20:08.159994] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:20:08.372896] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T21:20:08.647683] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-07T21:20:09.447687] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-07T21:20:10.247626] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-07T21:20:10.319353] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T21:20:10.847701] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T21:20:10.874618] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T21:20:10.877804] [INFO ] [REMOTE ] RTX: Full fetch complete (77342 records). [2025-10-07T21:20:10.877908] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-07T21:20:10.878598] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:20:10.878707] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:20:10.878754] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:20:10.878818] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-07T21:20:10.878886] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-07T21:20:10.878924] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-07T21:20:10.878963] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-07T21:20:10.879019] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RTX took 54.5s. Estimated remaining: 1h 13m 58s. Rate: 7.1 symbols/min [2025-10-07T21:20:11.043178] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:20:11.047636] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-07T21:20:11.098171] [DEBUG] [LOCAL ] RY: Loaded 47823 existing records from primary storage. [2025-10-07T21:20:11.098502] [INFO ] [MAIN ] RY: Loaded 47823 existing records. [2025-10-07T21:20:11.274794] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:20:11.275137] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-07T21:20:11.275195] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-07T21:20:11.275707] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-07T21:20:11.275765] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-07T21:20:11.621704] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:20:11.765369] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T21:20:11.847680] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-07T21:20:12.647709] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-07T21:20:13.180629] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-07T21:20:13.447620] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-07T21:20:13.639219] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T21:20:14.247688] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-07T21:20:14.834610] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:20:14.835376] [INFO ] [REMOTE ] RWTN: Full fetch complete (3143 records). [2025-10-07T21:20:14.835445] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-07T21:20:14.835831] [FATAL] [VALIDATOR ] RWTN: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:20:14.835914] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:20:14.835957] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:20:14.836020] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-07T21:20:14.836092] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-07T21:20:14.836146] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-07T21:20:14.836188] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-07T21:20:14.836242] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RWTN took 27.8s. Estimated remaining: 1h 13m 49s. Rate: 7.1 symbols/min [2025-10-07T21:20:15.006759] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:20:15.040848] [DEBUG] [LOCAL ] RYAM: Loaded 35095 existing records from primary storage. [2025-10-07T21:20:15.041216] [INFO ] [MAIN ] RYAM: Loaded 35095 existing records. [2025-10-07T21:20:15.054079] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-07T21:20:15.228374] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:20:15.228577] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-07T21:20:15.228626] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-07T21:20:15.229015] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-07T21:20:15.229074] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-07T21:20:15.621463] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:20:15.622950] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-07T21:20:15.847681] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-07T21:20:16.647691] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-07T21:20:16.864308] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T21:20:17.320460] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T21:20:17.447606] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-07T21:20:18.247715] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-07T21:20:18.311846] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T21:20:18.859160] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T21:20:19.047692] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-07T21:20:19.847624] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-07T21:20:19.971860] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T21:20:20.647698] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-07T21:20:20.706370] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T21:20:21.447621] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-07T21:20:21.589165] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T21:20:22.204989] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:20:22.247600] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-07T21:20:23.047682] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-07T21:20:23.257405] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T21:20:23.847627] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-07T21:20:23.953404] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T21:20:24.417978] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T21:20:24.647694] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-07T21:20:25.447639] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-07T21:20:25.719009] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T21:20:26.172175] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T21:20:26.247685] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-07T21:20:27.011936] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T21:20:27.047603] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-07T21:20:27.661327] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T21:20:27.847678] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-07T21:20:28.647624] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-07T21:20:28.753471] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T21:20:29.026060] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T21:20:29.447681] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-07T21:20:30.247715] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-07T21:20:30.339983] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T21:20:30.975182] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T21:20:31.000468] [INFO ] [REMOTE ] RWT: Full fetch complete (58346 records). [2025-10-07T21:20:31.002366] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-07T21:20:31.002466] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-07T21:20:31.012475] [FATAL] [VALIDATOR ] RWT: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-07). Symbol may be delisted or halted. [2025-10-07T21:20:31.012639] [FATAL] [MAIN ] RWT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:20:31.012764] [WARN ] [MAIN ] RWT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:20:31.012861] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-07T21:20:31.012951] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-07T21:20:31.012991] [INFO ] [LOCAL ] RWT: Starting deletion of derivative data. [2025-10-07T21:20:31.013293] [DEBUG] [LOCAL ] RWT: Deleted derivative data file. [2025-10-07T21:20:31.013396] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWT took 45.6s. Estimated remaining: 1h 13m 42s. Rate: 7.1 symbols/min [2025-10-07T21:20:31.052906] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-07T21:20:31.198929] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:20:31.240573] [DEBUG] [LOCAL ] RYAN: Loaded 44584 existing records from primary storage. [2025-10-07T21:20:31.240947] [INFO ] [MAIN ] RYAN: Loaded 44584 existing records. [2025-10-07T21:20:31.420032] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:20:31.420309] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-07T21:20:31.420370] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-07T21:20:31.421364] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-07T21:20:31.421425] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-07T21:20:31.787599] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:20:31.847723] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-07T21:20:32.539321] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T21:20:32.647736] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-07T21:20:33.447625] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-07T21:20:33.534304] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T21:20:34.247676] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-07T21:20:34.516822] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T21:20:35.047669] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-07T21:20:35.363359] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T21:20:35.852810] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-07T21:20:35.868064] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T21:20:36.481803] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T21:20:36.647796] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-07T21:20:37.447689] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-07T21:20:37.714285] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T21:20:38.247772] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-07T21:20:38.541277] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T21:20:39.047730] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-07T21:20:39.096060] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T21:20:39.847683] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-07T21:20:39.871856] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T21:20:40.647693] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-07T21:20:40.895205] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T21:20:41.447620] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-07T21:20:41.546975] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T21:20:41.979940] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T21:20:42.247721] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-07T21:20:43.047720] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-07T21:20:43.171940] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T21:20:43.256255] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T21:20:43.260590] [INFO ] [REMOTE ] RXO: Full fetch complete (68458 records). [2025-10-07T21:20:43.260730] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-07T21:20:43.659330] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-07T21:20:43.659406] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-07T21:20:43.660311] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-07T21:20:43.660375] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-07T21:20:43.661771] [DEBUG] [LOCAL ] RXO: Trimmed 68458 records to 48034 (keeping 200 days of data) [2025-10-07T21:20:43.863132] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-07T21:20:43.949012] [DEBUG] [LOCAL ] RXO: Primary data saved (48034 records). [2025-10-07T21:20:43.949258] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-07T21:20:43.949383] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RXO took 36.5s. Estimated remaining: 1h 13m 35s. Rate: 7.1 symbols/min [2025-10-07T21:20:44.120144] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:20:44.140232] [DEBUG] [LOCAL ] RYI: Loaded 21616 existing records from primary storage. [2025-10-07T21:20:44.140469] [INFO ] [MAIN ] RYI: Loaded 21616 existing records. [2025-10-07T21:20:44.319524] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:20:44.319914] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-07T21:20:44.319997] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-07T21:20:44.320679] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-07T21:20:44.320843] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-07T21:20:44.450190] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T21:20:44.652925] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-07T21:20:44.713905] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:20:45.216886] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T21:20:45.447711] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-07T21:20:46.247740] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-07T21:20:46.521972] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T21:20:46.545625] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T21:20:47.047713] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-07T21:20:47.744272] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T21:20:47.847612] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-07T21:20:48.300880] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T21:20:48.647707] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-07T21:20:49.450165] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-07T21:20:49.453731] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T21:20:50.247696] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-07T21:20:50.295560] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T21:20:50.649822] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T21:20:51.047742] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-07T21:20:51.474220] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T21:20:51.477968] [INFO ] [REMOTE ] RYAM: Full fetch complete (49123 records). [2025-10-07T21:20:51.478119] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-07T21:20:51.858749] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-07T21:20:51.861632] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-07T21:20:51.861742] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-07T21:20:51.863583] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-07T21:20:51.863772] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-07T21:20:51.864892] [DEBUG] [LOCAL ] RYAM: Trimmed 49123 records to 35091 (keeping 200 days of data) [2025-10-07T21:20:52.062218] [DEBUG] [LOCAL ] RYAM: Primary data saved (35091 records). [2025-10-07T21:20:52.062367] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-07T21:20:52.062473] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RYAM took 37.2s. Estimated remaining: 1h 13m 27s. Rate: 7.1 symbols/min [2025-10-07T21:20:52.236819] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:20:52.251345] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T21:20:52.297682] [DEBUG] [LOCAL ] RYN: Loaded 45522 existing records from primary storage. [2025-10-07T21:20:52.298016] [INFO ] [MAIN ] RYN: Loaded 45522 existing records. [2025-10-07T21:20:52.506233] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:20:52.506577] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-07T21:20:52.506688] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-07T21:20:52.506924] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-07T21:20:52.506984] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-07T21:20:52.652916] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-07T21:20:52.873320] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:20:53.083693] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T21:20:53.447677] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-07T21:20:54.049566] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T21:20:54.054370] [INFO ] [REMOTE ] RY: Full fetch complete (68927 records). [2025-10-07T21:20:54.054767] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-07T21:20:54.252375] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-07T21:20:54.473766] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-07T21:20:54.473856] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-07T21:20:54.474877] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-07T21:20:54.474945] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-07T21:20:54.476509] [DEBUG] [LOCAL ] RY: Trimmed 68927 records to 47824 (keeping 200 days of data) [2025-10-07T21:20:54.788075] [DEBUG] [LOCAL ] RY: Primary data saved (47824 records). [2025-10-07T21:20:54.788270] [INFO ] [MAIN ] RY: Full history saved. [2025-10-07T21:20:54.788393] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RY took 43.9s. Estimated remaining: 1h 13m 17s. Rate: 7.1 symbols/min [2025-10-07T21:20:54.986551] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:20:54.995132] [DEBUG] [LOCAL ] RZB: Loaded 6105 existing records from primary storage. [2025-10-07T21:20:54.995395] [INFO ] [MAIN ] RZB: Loaded 6105 existing records. [2025-10-07T21:20:55.057554] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-07T21:20:55.176197] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:20:55.176459] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-07T21:20:55.176543] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-07T21:20:55.177184] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-07T21:20:55.177261] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-07T21:20:55.295286] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T21:20:55.570234] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:20:55.826247] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T21:20:55.847675] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-07T21:20:56.206351] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T21:20:56.647709] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-07T21:20:57.273896] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T21:20:57.447694] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-07T21:20:57.696114] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T21:20:58.247703] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-07T21:20:58.990891] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T21:20:59.047707] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-07T21:20:59.789269] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-07T21:20:59.853285] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-07T21:20:59.867418] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T21:21:00.552518] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-07T21:21:00.647680] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-07T21:21:01.447722] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-07T21:21:02.247636] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-07T21:21:02.369967] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T21:21:03.030386] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-07T21:21:03.055731] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-07T21:21:03.074200] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T21:21:03.847711] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-07T21:21:04.380016] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-07T21:21:04.390704] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-07T21:21:04.647712] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-07T21:21:05.447729] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-07T21:21:05.740181] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T21:21:05.744140] [INFO ] [REMOTE ] RYAN: Full fetch complete (64188 records). [2025-10-07T21:21:05.744283] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-07T21:21:05.999279] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T21:21:06.158154] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-07T21:21:06.158256] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-07T21:21:06.159327] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-07T21:21:06.159391] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-07T21:21:06.160753] [DEBUG] [LOCAL ] RYAN: Trimmed 64188 records to 44622 (keeping 200 days of data) [2025-10-07T21:21:06.258088] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-07T21:21:06.443020] [DEBUG] [LOCAL ] RYAN: Primary data saved (44622 records). [2025-10-07T21:21:06.443154] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-07T21:21:06.443239] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYAN took 35.4s. Estimated remaining: 1h 13m 9s. Rate: 7.1 symbols/min [2025-10-07T21:21:06.607804] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:21:06.617424] [DEBUG] [LOCAL ] RZC: Loaded 6753 existing records from primary storage. [2025-10-07T21:21:06.617632] [INFO ] [MAIN ] RZC: Loaded 6753 existing records. [2025-10-07T21:21:06.793814] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:21:06.794043] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-07T21:21:06.794099] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-07T21:21:06.794325] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-07T21:21:06.794389] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-07T21:21:06.977471] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-07T21:21:07.048203] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-07T21:21:07.162795] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:21:07.669375] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T21:21:07.847668] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-07T21:21:08.647696] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-07T21:21:09.447621] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-07T21:21:09.476985] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T21:21:09.511309] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T21:21:10.247689] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-07T21:21:10.599354] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T21:21:11.047684] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-07T21:21:11.167243] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-07T21:21:11.671013] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-07T21:21:11.847685] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-07T21:21:12.647676] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-07T21:21:13.355969] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T21:21:13.452838] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-07T21:21:13.467625] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T21:21:14.247716] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-07T21:21:14.601472] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T21:21:15.047688] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-07T21:21:15.753663] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T21:21:15.764634] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:21:15.770003] [INFO ] [REMOTE ] RYI: Full fetch complete (32322 records). [2025-10-07T21:21:15.770121] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-07T21:21:15.852853] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-07T21:21:16.185797] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-07T21:21:16.185919] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-07T21:21:16.187021] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-07T21:21:16.187089] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-07T21:21:16.188136] [DEBUG] [LOCAL ] RYI: Trimmed 32322 records to 21623 (keeping 200 days of data) [2025-10-07T21:21:16.338584] [DEBUG] [LOCAL ] RYI: Primary data saved (21623 records). [2025-10-07T21:21:16.338832] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-07T21:21:16.338943] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RYI took 32.4s. Estimated remaining: 1h 13m 1s. Rate: 7.1 symbols/min [2025-10-07T21:21:16.532451] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:21:16.535534] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-07T21:21:16.587504] [DEBUG] [LOCAL ] S: Loaded 53532 existing records from primary storage. [2025-10-07T21:21:16.587906] [INFO ] [MAIN ] S: Loaded 53532 existing records. [2025-10-07T21:21:16.652832] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-07T21:21:16.769438] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:21:16.769744] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-07T21:21:16.769799] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-07T21:21:16.770981] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-07T21:21:16.771042] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-07T21:21:17.148480] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:21:17.447707] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-07T21:21:17.499237] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T21:21:18.247681] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-07T21:21:18.820998] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T21:21:19.047693] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-07T21:21:19.847621] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-07T21:21:19.940782] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-07T21:21:20.420440] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T21:21:20.647600] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-07T21:21:20.746804] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-07T21:21:21.052283] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-07T21:21:21.053204] [INFO ] [REMOTE ] RZB: Full fetch complete (8591 records). [2025-10-07T21:21:21.053275] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-07T21:21:21.401145] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-07T21:21:21.401226] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-07T21:21:21.401448] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-07T21:21:21.401487] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-07T21:21:21.401980] [DEBUG] [LOCAL ] RZB: Trimmed 8591 records to 6054 (keeping 200 days of data) [2025-10-07T21:21:21.438716] [DEBUG] [LOCAL ] RZB: Primary data saved (6054 records). [2025-10-07T21:21:21.438803] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-07T21:21:21.438881] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RZB took 26.7s. Estimated remaining: 1h 12m 52s. Rate: 7.1 symbols/min [2025-10-07T21:21:21.451809] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-07T21:21:21.616658] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:21:21.660828] [DEBUG] [LOCAL ] SA: Loaded 43688 existing records from primary storage. [2025-10-07T21:21:21.661140] [INFO ] [MAIN ] SA: Loaded 43688 existing records. [2025-10-07T21:21:21.838509] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:21:21.838773] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-07T21:21:21.838824] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-07T21:21:21.839745] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-07T21:21:21.839804] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-07T21:21:22.186445] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:21:22.247593] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-07T21:21:23.052491] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-07T21:21:23.055374] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T21:21:23.777879] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T21:21:23.847610] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-07T21:21:24.647720] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-07T21:21:24.824495] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T21:21:24.893931] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T21:21:25.447751] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-07T21:21:26.243305] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T21:21:26.247586] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-07T21:21:26.380291] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T21:21:26.853586] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T21:21:27.047681] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-07T21:21:27.738749] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T21:21:27.847693] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-07T21:21:28.601107] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T21:21:28.647627] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-07T21:21:29.343539] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T21:21:29.447677] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-07T21:21:30.060529] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T21:21:30.247679] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-07T21:21:30.727329] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T21:21:30.728385] [INFO ] [REMOTE ] RZC: Full fetch complete (9784 records). [2025-10-07T21:21:30.728455] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-07T21:21:31.052773] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-07T21:21:31.096241] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-07T21:21:31.096343] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-07T21:21:31.096691] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-07T21:21:31.096762] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-07T21:21:31.097226] [DEBUG] [LOCAL ] RZC: Trimmed 9784 records to 6766 (keeping 200 days of data) [2025-10-07T21:21:31.141840] [DEBUG] [LOCAL ] RZC: Primary data saved (6766 records). [2025-10-07T21:21:31.141978] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-07T21:21:31.142066] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZC took 24.7s. Estimated remaining: 1h 12m 44s. Rate: 7.1 symbols/min [2025-10-07T21:21:31.308845] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:21:31.320122] [DEBUG] [LOCAL ] SABA: Loaded 9269 existing records from primary storage. [2025-10-07T21:21:31.320353] [INFO ] [MAIN ] SABA: Loaded 9269 existing records. [2025-10-07T21:21:31.497011] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:21:31.497284] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-07T21:21:31.497372] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-07T21:21:31.497549] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-07T21:21:31.497608] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-07T21:21:31.852753] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-07T21:21:31.921390] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:21:32.410991] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T21:21:32.414752] [INFO ] [REMOTE ] RYN: Full fetch complete (65090 records). [2025-10-07T21:21:32.414849] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-07T21:21:32.653077] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-07T21:21:32.820034] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-07T21:21:32.820145] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-07T21:21:32.821154] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-07T21:21:32.821225] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-07T21:21:32.823279] [DEBUG] [LOCAL ] RYN: Trimmed 65090 records to 45524 (keeping 200 days of data) [2025-10-07T21:21:33.104762] [DEBUG] [LOCAL ] RYN: Primary data saved (45524 records). [2025-10-07T21:21:33.104903] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-07T21:21:33.104990] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RYN took 41.0s. Estimated remaining: 1h 12m 33s. Rate: 7.1 symbols/min [2025-10-07T21:21:33.270939] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:21:33.301411] [DEBUG] [LOCAL ] SAFE: Loaded 30265 existing records from primary storage. [2025-10-07T21:21:33.301713] [INFO ] [MAIN ] SAFE: Loaded 30265 existing records. [2025-10-07T21:21:33.450171] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-07T21:21:33.490457] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:21:33.490876] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-07T21:21:33.490936] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-07T21:21:33.491713] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-07T21:21:33.491773] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-07T21:21:33.849078] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:21:33.903055] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-07T21:21:34.217474] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T21:21:34.247621] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-07T21:21:34.411967] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-07T21:21:35.047679] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-07T21:21:35.846340] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T21:21:35.855069] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-07T21:21:36.024936] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T21:21:36.647734] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-07T21:21:37.447727] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-07T21:21:37.985269] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-07T21:21:38.037202] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T21:21:38.247758] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-07T21:21:39.047639] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-07T21:21:39.163919] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T21:21:39.847731] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-07T21:21:40.255794] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T21:21:40.442426] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T21:21:40.641904] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T21:21:40.647598] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-07T21:21:41.287725] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T21:21:41.447690] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-07T21:21:42.247676] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-07T21:21:42.301947] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-07T21:21:43.047707] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-07T21:21:43.490432] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T21:21:43.790257] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T21:21:43.847629] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-07T21:21:44.604497] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T21:21:44.647685] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-07T21:21:45.447705] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-07T21:21:46.247676] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-07T21:21:46.301497] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T21:21:46.757263] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T21:21:47.015279] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T21:21:47.047682] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-07T21:21:47.847753] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-07T21:21:48.595691] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T21:21:48.623530] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T21:21:48.647595] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-07T21:21:49.447703] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-07T21:21:50.170668] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T21:21:50.247723] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-07T21:21:51.047633] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-07T21:21:51.147941] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T21:21:51.369382] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T21:21:51.847756] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-07T21:21:52.486367] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T21:21:52.647898] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-07T21:21:53.435219] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T21:21:53.447606] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-07T21:21:53.555166] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T21:21:54.042312] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:21:54.043953] [INFO ] [REMOTE ] SABA: Full fetch complete (15353 records). [2025-10-07T21:21:54.044046] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-07T21:21:54.256629] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-07T21:21:54.431242] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-07T21:21:54.431339] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-07T21:21:54.431710] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-07T21:21:54.431775] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-07T21:21:54.432374] [DEBUG] [LOCAL ] SABA: Trimmed 15353 records to 9275 (keeping 200 days of data) [2025-10-07T21:21:54.489065] [DEBUG] [LOCAL ] SABA: Primary data saved (9275 records). [2025-10-07T21:21:54.489222] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-07T21:21:54.489329] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. SABA took 23.3s. Estimated remaining: 1h 12m 28s. Rate: 7.1 symbols/min [2025-10-07T21:21:54.660870] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:21:54.682166] [DEBUG] [LOCAL ] SAH: Loaded 21715 existing records from primary storage. [2025-10-07T21:21:54.682506] [INFO ] [MAIN ] SAH: Loaded 21715 existing records. [2025-10-07T21:21:54.858428] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:21:54.858698] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-07T21:21:54.858764] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-07T21:21:54.859042] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-07T21:21:54.859098] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-07T21:21:55.058075] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-07T21:21:55.218867] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:21:55.847611] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-07T21:21:55.927893] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T21:21:55.931535] [INFO ] [REMOTE ] SA: Full fetch complete (62716 records). [2025-10-07T21:21:55.931854] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-07T21:21:56.356735] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-07T21:21:56.356816] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-07T21:21:56.357674] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-07T21:21:56.357736] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-07T21:21:56.359065] [DEBUG] [LOCAL ] SA: Trimmed 62716 records to 43765 (keeping 200 days of data) [2025-10-07T21:21:56.618029] [DEBUG] [LOCAL ] SA: Primary data saved (43765 records). [2025-10-07T21:21:56.618175] [INFO ] [MAIN ] SA: Full history saved. [2025-10-07T21:21:56.618302] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SA took 35.2s. Estimated remaining: 1h 12m 18s. Rate: 7.1 symbols/min [2025-10-07T21:21:56.649843] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-07T21:21:56.797956] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:21:56.798453] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-07T21:21:56.798603] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-07T21:21:56.806433] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-07T21:21:56.807087] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-07T21:21:56.807388] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-07T21:21:56.807516] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-07T21:21:56.811111] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-07T21:21:57.169821] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:21:57.198228] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-07T21:21:57.447608] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-07T21:21:58.035160] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T21:21:58.247665] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-07T21:21:59.047617] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-07T21:21:59.370639] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T21:21:59.397676] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-07T21:21:59.665214] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-07T21:21:59.847686] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-07T21:22:00.192693] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T21:22:00.647696] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-07T21:22:01.447724] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-07T21:22:01.729969] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T21:22:02.247759] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-07T21:22:02.845606] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T21:22:03.047721] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-07T21:22:03.338842] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T21:22:03.847712] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-07T21:22:04.647747] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-07T21:22:04.974528] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-07T21:22:05.088738] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T21:22:05.251429] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-07T21:22:05.447701] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-07T21:22:05.773516] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-07T21:22:06.247702] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-07T21:22:06.602148] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-07T21:22:07.047691] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-07T21:22:07.847699] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-07T21:22:08.177856] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-07T21:22:08.647704] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-07T21:22:09.160614] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-07T21:22:09.447699] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-07T21:22:09.792398] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-07T21:22:09.934689] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T21:22:10.247740] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-07T21:22:11.047751] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-07T21:22:11.847730] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-07T21:22:12.157440] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T21:22:12.257058] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-07T21:22:12.261504] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-10-07T21:22:12.261636] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-07T21:22:12.652751] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-07T21:22:12.677525] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-07T21:22:12.677614] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-07T21:22:12.678728] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-07T21:22:12.678835] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-07T21:22:12.680452] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 53532 (keeping 200 days of data) [2025-10-07T21:22:13.017631] [DEBUG] [LOCAL ] S: Primary data saved (53532 records). [2025-10-07T21:22:13.017826] [INFO ] [MAIN ] S: Full history saved. [2025-10-07T21:22:13.017923] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. S took 56.7s. Estimated remaining: 1h 12m 12s. Rate: 7.1 symbols/min [2025-10-07T21:22:13.212828] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-07T21:22:13.255056] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:22:13.260438] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T21:22:13.288017] [DEBUG] [LOCAL ] SAM: Loaded 21406 existing records from primary storage. [2025-10-07T21:22:13.288295] [INFO ] [MAIN ] SAM: Loaded 21406 existing records. [2025-10-07T21:22:13.460683] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-07T21:22:13.467964] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:22:13.468320] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-07T21:22:13.469146] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-07T21:22:13.469431] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-07T21:22:13.469489] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-07T21:22:13.911571] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:22:14.247682] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-07T21:22:14.582818] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-07T21:22:14.750411] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T21:22:15.047687] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-07T21:22:15.847630] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-07T21:22:16.145356] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T21:22:16.393330] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-07T21:22:16.647719] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-07T21:22:16.890687] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-07T21:22:16.891770] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-10-07T21:22:16.891853] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-07T21:22:17.167835] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-07T21:22:17.169774] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:22:17.171340] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:22:17.172938] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-07T21:22:17.173066] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-07T21:22:17.173141] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-07T21:22:17.173259] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-07T21:22:17.173389] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SAJ took 20.6s. Estimated remaining: 1h 12m 2s. Rate: 7.1 symbols/min [2025-10-07T21:22:17.447187] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:22:17.447837] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-07T21:22:17.511047] [DEBUG] [LOCAL ] SAN: Loaded 52977 existing records from primary storage. [2025-10-07T21:22:17.511502] [INFO ] [MAIN ] SAN: Loaded 52977 existing records. [2025-10-07T21:22:17.743837] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:22:17.744104] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-07T21:22:17.744155] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-07T21:22:17.744695] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-07T21:22:17.744759] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-07T21:22:18.128891] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:22:18.247702] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-07T21:22:18.456378] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T21:22:18.458623] [INFO ] [REMOTE ] SAFE: Full fetch complete (44986 records). [2025-10-07T21:22:18.458740] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-07T21:22:18.829452] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-07T21:22:18.829535] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-07T21:22:18.830322] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-07T21:22:18.830385] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-07T21:22:18.831367] [DEBUG] [LOCAL ] SAFE: Trimmed 44986 records to 30290 (keeping 200 days of data) [2025-10-07T21:22:19.020306] [DEBUG] [LOCAL ] SAFE: Primary data saved (30290 records). [2025-10-07T21:22:19.020458] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-07T21:22:19.020549] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAFE took 45.9s. Estimated remaining: 1h 11m 52s. Rate: 7.1 symbols/min [2025-10-07T21:22:19.052843] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-07T21:22:19.189580] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:22:19.240955] [DEBUG] [LOCAL ] SAND: Loaded 51800 existing records from primary storage. [2025-10-07T21:22:19.241410] [INFO ] [MAIN ] SAND: Loaded 51800 existing records. [2025-10-07T21:22:19.452092] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:22:19.452336] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-07T21:22:19.452386] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-07T21:22:19.452717] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-07T21:22:19.452778] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-07T21:22:19.861123] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-07T21:22:19.861043] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:22:19.890507] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T21:22:20.647628] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-07T21:22:20.843781] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-07T21:22:21.447740] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-07T21:22:22.247756] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-07T21:22:22.455920] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T21:22:23.047695] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-07T21:22:23.089369] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T21:22:23.499958] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T21:22:23.769245] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (4.72 seconds). [2025-10-07T21:22:23.847669] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-07T21:22:24.647691] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-07T21:22:24.700827] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T21:22:24.724340] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T21:22:25.447727] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-07T21:22:26.253507] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-07T21:22:26.259838] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T21:22:26.446460] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T21:22:27.047728] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-07T21:22:27.847637] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-07T21:22:28.285176] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T21:22:28.647697] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-07T21:22:28.683592] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T21:22:28.953384] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-07T21:22:29.404915] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T21:22:29.406716] [INFO ] [REMOTE ] SAH: Full fetch complete (30619 records). [2025-10-07T21:22:29.406859] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-07T21:22:29.452832] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-07T21:22:29.792101] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-07T21:22:29.792199] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-07T21:22:29.792882] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-07T21:22:29.792946] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-07T21:22:29.793832] [DEBUG] [LOCAL ] SAH: Trimmed 30619 records to 21676 (keeping 200 days of data) [2025-10-07T21:22:29.930942] [DEBUG] [LOCAL ] SAH: Primary data saved (21676 records). [2025-10-07T21:22:29.931080] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-07T21:22:29.931164] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAH took 35.4s. Estimated remaining: 1h 11m 44s. Rate: 7.1 symbols/min [2025-10-07T21:22:30.103079] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:22:30.150476] [DEBUG] [LOCAL ] SAP: Loaded 49939 existing records from primary storage. [2025-10-07T21:22:30.150856] [INFO ] [MAIN ] SAP: Loaded 49939 existing records. [2025-10-07T21:22:30.252915] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-07T21:22:30.338781] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:22:30.339013] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-07T21:22:30.339060] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-07T21:22:30.339334] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-07T21:22:30.339390] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-07T21:22:30.722499] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:22:30.724417] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T21:22:31.047713] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-07T21:22:31.847728] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-07T21:22:31.919046] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T21:22:32.647635] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-07T21:22:32.914807] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T21:22:33.013534] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T21:22:33.447734] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-07T21:22:34.247638] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-07T21:22:34.475846] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T21:22:34.498225] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T21:22:35.047687] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-07T21:22:35.847763] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-07T21:22:36.144152] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-07T21:22:36.647631] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-07T21:22:37.447632] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-07T21:22:37.845442] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-07T21:22:38.247742] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-07T21:22:39.169908] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (4.12 seconds). [2025-10-07T21:22:39.181412] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-07T21:22:39.336849] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T21:22:39.847714] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-07T21:22:40.898929] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T21:22:40.915613] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-07T21:22:41.036540] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (5.19 seconds). [2025-10-07T21:22:41.320346] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T21:22:41.447631] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-07T21:22:42.175152] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (3.93 seconds). [2025-10-07T21:22:42.247619] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-07T21:22:42.862486] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T21:22:43.047629] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-07T21:22:43.343492] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T21:22:43.372885] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T21:22:43.847672] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-07T21:22:44.547177] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T21:22:44.647609] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-07T21:22:45.447708] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-07T21:22:45.493846] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T21:22:46.247676] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-07T21:22:46.568595] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T21:22:46.679808] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-07T21:22:47.047715] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-07T21:22:47.847727] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-07T21:22:48.137761] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T21:22:48.647621] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-07T21:22:48.786009] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T21:22:48.788245] [INFO ] [REMOTE ] SAM: Full fetch complete (30884 records). [2025-10-07T21:22:48.788407] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-07T21:22:49.159557] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-07T21:22:49.159810] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-07T21:22:49.160543] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-07T21:22:49.160619] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-07T21:22:49.188007] [DEBUG] [LOCAL ] SAM: Trimmed 30884 records to 21368 (keeping 200 days of data) [2025-10-07T21:22:49.189560] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-07T21:22:49.331725] [DEBUG] [LOCAL ] SAM: Primary data saved (21368 records). [2025-10-07T21:22:49.331861] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-07T21:22:49.331943] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAM took 36.3s. Estimated remaining: 1h 11m 39s. Rate: 7.1 symbols/min [2025-10-07T21:22:49.452750] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-07T21:22:49.509146] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:22:49.528773] [DEBUG] [LOCAL ] SAR: Loaded 16460 existing records from primary storage. [2025-10-07T21:22:49.529038] [INFO ] [MAIN ] SAR: Loaded 16460 existing records. [2025-10-07T21:22:49.702185] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:22:49.702417] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-07T21:22:49.702465] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-07T21:22:49.702749] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-07T21:22:49.702808] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-07T21:22:50.052635] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:22:50.143497] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T21:22:50.247605] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-07T21:22:51.047737] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-07T21:22:51.422182] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-07T21:22:51.645140] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T21:22:51.649110] [INFO ] [REMOTE ] SAND: Full fetch complete (74455 records). [2025-10-07T21:22:51.649288] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-07T21:22:51.853006] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-07T21:22:52.056327] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-07T21:22:52.056435] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-07T21:22:52.058015] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-07T21:22:52.058121] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-07T21:22:52.060228] [DEBUG] [LOCAL ] SAND: Trimmed 74455 records to 51804 (keeping 200 days of data) [2025-10-07T21:22:52.395744] [DEBUG] [LOCAL ] SAND: Primary data saved (51804 records). [2025-10-07T21:22:52.395887] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-07T21:22:52.395973] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAND took 33.4s. Estimated remaining: 1h 11m 29s. Rate: 7.1 symbols/min [2025-10-07T21:22:52.569272] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:22:52.615775] [DEBUG] [LOCAL ] SARO: Loaded 48593 existing records from primary storage. [2025-10-07T21:22:52.616112] [INFO ] [MAIN ] SARO: Loaded 48593 existing records. [2025-10-07T21:22:52.658437] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-07T21:22:52.794906] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:22:52.795101] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-07T21:22:52.795148] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-07T21:22:52.795400] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-07T21:22:52.795456] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-07T21:22:53.143845] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:22:53.447706] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-07T21:23:05.245873] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (11.80 seconds). [2025-10-07T21:23:05.257900] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-07T21:23:05.589449] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (14.54 seconds). [2025-10-07T21:23:05.593265] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-07T21:23:05.850884] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (13.19 seconds). [2025-10-07T21:23:05.860848] [INFO ] [REMOTE ] SAN: Full fetch complete (76292 records). [2025-10-07T21:23:05.861015] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-07T21:23:06.223915] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T21:23:06.271040] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-07T21:23:06.290341] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-07T21:23:06.290677] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-07T21:23:06.292956] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-07T21:23:06.293527] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-07T21:23:06.311076] [DEBUG] [LOCAL ] SAN: Trimmed 76292 records to 52981 (keeping 200 days of data) [2025-10-07T21:23:06.332514] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (14.48 seconds). [2025-10-07T21:23:06.401543] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-07T21:23:06.668424] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T21:23:06.680627] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-07T21:23:06.698797] [DEBUG] [LOCAL ] SAN: Primary data saved (52981 records). [2025-10-07T21:23:06.698969] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-07T21:23:06.699112] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAN took 49.5s. Estimated remaining: 1h 11m 22s. Rate: 7.1 symbols/min [2025-10-07T21:23:06.866766] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:23:06.866984] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-07T21:23:06.867023] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-07T21:23:06.867141] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-07T21:23:06.867205] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-07T21:23:06.867273] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-07T21:23:06.867307] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-07T21:23:07.175126] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T21:23:07.206499] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-07T21:23:07.267345] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:23:07.267790] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-07T21:23:07.926032] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T21:23:07.938544] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-07T21:23:08.049517] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T21:23:08.058880] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-07T21:23:08.314159] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T21:23:08.320030] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-07T21:23:08.343912] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T21:23:08.345261] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-07T21:23:08.681230] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-07T21:23:08.682849] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-07T21:23:09.259087] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T21:23:09.261621] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-07T21:23:09.452253] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-07T21:23:09.460763] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-07T21:23:09.660225] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-07T21:23:09.662062] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-07T21:23:09.754155] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T21:23:09.768448] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-07T21:23:09.862261] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T21:23:09.877297] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-07T21:23:09.943247] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-07T21:23:09.944922] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-07T21:23:10.255749] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T21:23:10.260013] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-07T21:23:10.297338] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-07T21:23:10.298268] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-07T21:23:10.691317] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-07T21:23:10.692382] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-07T21:23:11.026985] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-07T21:23:11.047617] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-07T21:23:11.221464] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T21:23:11.323704] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T21:23:11.405270] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-07T21:23:11.563091] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T21:23:11.847706] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-07T21:23:12.647695] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-07T21:23:12.993724] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-07T21:23:13.119483] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T21:23:13.447739] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-07T21:23:14.247710] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-07T21:23:14.503946] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-07T21:23:14.504692] [INFO ] [REMOTE ] SAT: Full fetch complete (1577 records). [2025-10-07T21:23:14.504765] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-07T21:23:14.706552] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-07T21:23:14.706860] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:23:14.706941] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:23:14.707002] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-07T21:23:14.707061] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-07T21:23:14.707101] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-07T21:23:14.707169] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-07T21:23:14.707284] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAT took 8.0s. Estimated remaining: 1h 11m 13s. Rate: 7.1 symbols/min [2025-10-07T21:23:14.912755] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:23:14.912974] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-07T21:23:14.913025] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-07T21:23:14.913143] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-07T21:23:14.913188] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-07T21:23:14.913234] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-07T21:23:14.913266] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-07T21:23:15.054232] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-07T21:23:15.288253] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:23:15.396586] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T21:23:15.847727] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-07T21:23:16.590077] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T21:23:16.647610] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-07T21:23:16.898925] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T21:23:17.447696] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-07T21:23:17.895432] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T21:23:18.247617] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-07T21:23:18.455631] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T21:23:19.047667] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-07T21:23:19.492057] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-07T21:23:19.847669] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-07T21:23:20.172027] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-07T21:23:20.175576] [INFO ] [REMOTE ] SAP: Full fetch complete (71905 records). [2025-10-07T21:23:20.175706] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-07T21:23:20.562063] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-07T21:23:20.562158] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-07T21:23:20.563217] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-07T21:23:20.563292] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-07T21:23:20.564934] [DEBUG] [LOCAL ] SAP: Trimmed 71905 records to 49931 (keeping 200 days of data) [2025-10-07T21:23:20.662929] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-07T21:23:20.882367] [DEBUG] [LOCAL ] SAP: Primary data saved (49931 records). [2025-10-07T21:23:20.882503] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-07T21:23:20.882601] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SAP took 51.0s. Estimated remaining: 1h 11m 4s. Rate: 7.1 symbols/min [2025-10-07T21:23:21.032712] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-07T21:23:21.056064] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:23:21.057378] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-07T21:23:21.057424] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-07T21:23:21.057533] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-07T21:23:21.057575] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-07T21:23:21.057617] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-07T21:23:21.057678] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-07T21:23:21.414203] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:23:21.447600] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-07T21:23:21.533510] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T21:23:21.841637] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-07T21:23:22.247669] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-07T21:23:22.597530] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-07T21:23:23.047687] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-07T21:23:23.375726] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-07T21:23:23.847688] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-07T21:23:24.196615] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T21:23:24.647892] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-07T21:23:24.995679] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-07T21:23:25.447678] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-07T21:23:25.777206] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-07T21:23:26.247709] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-07T21:23:26.851493] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T21:23:27.047680] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-07T21:23:27.478300] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-07T21:23:27.847693] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-07T21:23:28.286984] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-07T21:23:28.647682] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-07T21:23:29.447732] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-07T21:23:29.472463] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T21:23:29.474617] [INFO ] [REMOTE ] SAR: Full fetch complete (23093 records). [2025-10-07T21:23:29.474754] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-07T21:23:29.858555] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-07T21:23:29.858634] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-07T21:23:29.859169] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-07T21:23:29.859215] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-07T21:23:29.859891] [DEBUG] [LOCAL ] SAR: Trimmed 23093 records to 16626 (keeping 200 days of data) [2025-10-07T21:23:29.968561] [DEBUG] [LOCAL ] SAR: Primary data saved (16626 records). [2025-10-07T21:23:29.968747] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-07T21:23:29.968845] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAR took 40.6s. Estimated remaining: 1h 10m 56s. Rate: 7.1 symbols/min [2025-10-07T21:23:30.138309] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:23:30.170244] [DEBUG] [LOCAL ] SB: Loaded 33086 existing records from primary storage. [2025-10-07T21:23:30.170536] [INFO ] [MAIN ] SB: Loaded 33086 existing records. [2025-10-07T21:23:30.252750] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-07T21:23:30.356317] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:23:30.356666] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-07T21:23:30.356736] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-07T21:23:30.356997] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-07T21:23:30.357056] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-07T21:23:30.641074] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-07T21:23:30.758258] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:23:31.047689] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-07T21:23:31.124252] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T21:23:31.847679] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-07T21:23:32.182754] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-07T21:23:32.441560] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T21:23:32.647683] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-07T21:23:32.998195] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-07T21:23:33.447748] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-07T21:23:33.705047] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-07T21:23:34.247712] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-07T21:23:34.577199] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-07T21:23:35.047681] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-07T21:23:35.847756] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-07T21:23:36.551802] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T21:23:36.573238] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T21:23:36.647621] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-07T21:23:37.447686] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-07T21:23:37.793073] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-07T21:23:38.247633] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-07T21:23:38.525492] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-07T21:23:38.526219] [INFO ] [REMOTE ] SAZ: Full fetch complete (1823 records). [2025-10-07T21:23:38.526335] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-07T21:23:38.723742] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T21:23:38.723960] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:23:38.724033] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:23:38.724112] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-07T21:23:38.724215] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-07T21:23:38.724267] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-07T21:23:38.724397] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-07T21:23:38.724488] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAZ took 17.8s. Estimated remaining: 1h 10m 48s. Rate: 7.1 symbols/min [2025-10-07T21:23:38.946020] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-07T21:23:39.008609] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:23:39.008891] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-07T21:23:39.008950] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-07T21:23:39.009070] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-07T21:23:39.009116] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-07T21:23:39.009163] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-07T21:23:39.009197] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-07T21:23:39.052929] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-07T21:23:39.368588] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:23:39.459975] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-07T21:23:39.847776] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-07T21:23:40.047275] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:23:40.047610] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-07T21:23:40.047737] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:23:40.047785] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-07T21:23:40.047818] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:23:40.047869] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-07T21:23:40.047926] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-07T21:23:40.047961] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-07T21:23:40.048000] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-07T21:23:40.048048] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SBDS took 1.3s. Estimated remaining: 1h 10m 37s. Rate: 7.1 symbols/min [2025-10-07T21:23:40.237321] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:23:40.282840] [DEBUG] [LOCAL ] SBH: Loaded 49800 existing records from primary storage. [2025-10-07T21:23:40.283251] [INFO ] [MAIN ] SBH: Loaded 49800 existing records. [2025-10-07T21:23:40.469403] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:23:40.469634] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-07T21:23:40.469790] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-07T21:23:40.470060] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-07T21:23:40.470118] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-07T21:23:40.655464] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-07T21:23:40.837080] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:23:41.447733] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-07T21:23:42.195773] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T21:23:42.247619] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-07T21:23:43.047685] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-07T21:23:43.112050] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T21:23:43.382474] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-07T21:23:43.847755] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-07T21:23:43.969058] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T21:23:44.647702] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-07T21:23:44.909396] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-07T21:23:44.910472] [INFO ] [REMOTE ] SAY: Full fetch complete (1376 records). [2025-10-07T21:23:44.910543] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-07T21:23:45.091804] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-07T21:23:45.091993] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:23:45.092051] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:23:45.092091] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-07T21:23:45.092161] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-07T21:23:45.092217] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-07T21:23:45.092259] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-07T21:23:45.092316] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SAY took 30.4s. Estimated remaining: 1h 10m 28s. Rate: 7.1 symbols/min [2025-10-07T21:23:45.200170] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T21:23:45.215377] [INFO ] [REMOTE ] SARO: Full fetch complete (68924 records). [2025-10-07T21:23:45.225816] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-07T21:23:45.352068] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:23:45.449966] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-07T21:23:45.493334] [DEBUG] [LOCAL ] SBI: Loaded 7412 existing records from primary storage. [2025-10-07T21:23:45.507568] [INFO ] [MAIN ] SBI: Loaded 7412 existing records. [2025-10-07T21:23:45.861628] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:23:45.878950] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-07T21:23:45.879067] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-07T21:23:45.880383] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-07T21:23:45.878830] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-07T21:23:45.880523] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-07T21:23:45.880819] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-07T21:23:45.881094] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-07T21:23:45.881452] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-07T21:23:45.971329] [DEBUG] [LOCAL ] SARO: Trimmed 68924 records to 48570 (keeping 200 days of data) [2025-10-07T21:23:46.264632] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-07T21:23:46.357855] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:23:46.551286] [DEBUG] [LOCAL ] SARO: Primary data saved (48570 records). [2025-10-07T21:23:46.551429] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-07T21:23:46.551566] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SARO took 54.2s. Estimated remaining: 1h 10m 18s. Rate: 7.1 symbols/min [2025-10-07T21:23:46.718162] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:23:46.728447] [DEBUG] [LOCAL ] SBR: Loaded 7502 existing records from primary storage. [2025-10-07T21:23:46.728691] [INFO ] [MAIN ] SBR: Loaded 7502 existing records. [2025-10-07T21:23:46.903982] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:23:46.904364] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-07T21:23:46.904418] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-07T21:23:46.904617] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-07T21:23:46.904709] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-07T21:23:47.054042] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-07T21:23:47.077524] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T21:23:47.306352] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:23:47.573947] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T21:23:47.847702] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-07T21:23:47.858276] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T21:23:48.647694] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-07T21:23:48.852489] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T21:23:49.305613] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T21:23:49.447685] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-07T21:23:50.131460] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-07T21:23:50.247697] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-07T21:23:51.047743] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-07T21:23:51.588131] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T21:23:51.772968] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T21:23:51.847715] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-07T21:23:52.647749] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-07T21:23:52.683621] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T21:23:53.392274] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T21:23:53.447677] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-07T21:23:54.247714] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-07T21:23:54.946591] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T21:23:54.977590] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T21:23:55.047628] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-07T21:23:55.831894] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T21:23:55.847586] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-07T21:23:56.599931] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T21:23:56.647619] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-07T21:23:57.447706] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-07T21:23:57.461155] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T21:23:58.247720] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-07T21:23:58.937449] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-07T21:23:59.047608] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-07T21:23:59.847614] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-07T21:23:59.866547] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T21:24:00.530630] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (3.08 seconds). [2025-10-07T21:24:00.647603] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-07T21:24:01.272871] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T21:24:01.447700] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-07T21:24:02.167215] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T21:24:02.223974] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-07T21:24:02.247674] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-07T21:24:03.047688] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-07T21:24:03.820585] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T21:24:03.826129] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T21:24:03.847601] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-07T21:24:04.647691] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-07T21:24:05.395033] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T21:24:05.447704] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-07T21:24:06.097390] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T21:24:06.247716] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-07T21:24:06.984979] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T21:24:07.047717] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-07T21:24:07.086884] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T21:24:07.847697] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-07T21:24:08.444971] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T21:24:08.647721] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-07T21:24:09.168817] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T21:24:09.212232] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T21:24:09.447729] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-07T21:24:10.247703] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-07T21:24:10.697754] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T21:24:11.047754] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-07T21:24:11.817023] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T21:24:11.847691] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-07T21:24:11.992788] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T21:24:12.619765] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T21:24:12.647595] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-07T21:24:13.352130] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T21:24:13.353488] [INFO ] [REMOTE ] SBR: Full fetch complete (11195 records). [2025-10-07T21:24:13.353561] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-07T21:24:13.455734] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-07T21:24:13.728569] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-07T21:24:13.728697] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-07T21:24:13.729005] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-07T21:24:13.729048] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-07T21:24:13.729625] [DEBUG] [LOCAL ] SBR: Trimmed 11195 records to 7553 (keeping 200 days of data) [2025-10-07T21:24:13.782187] [DEBUG] [LOCAL ] SBR: Primary data saved (7553 records). [2025-10-07T21:24:13.782374] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-07T21:24:13.782482] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SBR took 27.2s. Estimated remaining: 1h 10m 14s. Rate: 7.1 symbols/min [2025-10-07T21:24:13.953557] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:24:13.997705] [DEBUG] [LOCAL ] SBS: Loaded 49382 existing records from primary storage. [2025-10-07T21:24:13.998033] [INFO ] [MAIN ] SBS: Loaded 49382 existing records. [2025-10-07T21:24:14.170402] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:24:14.170604] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-07T21:24:14.170675] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-07T21:24:14.170958] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-07T21:24:14.171016] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-07T21:24:14.252898] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-07T21:24:14.523179] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:24:14.548498] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T21:24:14.552111] [INFO ] [REMOTE ] SB: Full fetch complete (50005 records). [2025-10-07T21:24:14.552412] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-07T21:24:14.984096] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-07T21:24:14.983799] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T21:24:14.984350] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-07T21:24:14.987826] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-07T21:24:14.988405] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-07T21:24:14.990452] [DEBUG] [LOCAL ] SB: Trimmed 50005 records to 33087 (keeping 200 days of data) [2025-10-07T21:24:15.054492] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-07T21:24:15.206976] [DEBUG] [LOCAL ] SB: Primary data saved (33087 records). [2025-10-07T21:24:15.207199] [INFO ] [MAIN ] SB: Full history saved. [2025-10-07T21:24:15.207315] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SB took 45.2s. Estimated remaining: 1h 10m 4s. Rate: 7.1 symbols/min [2025-10-07T21:24:15.381471] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:24:15.400055] [DEBUG] [LOCAL ] SBSI: Loaded 14853 existing records from primary storage. [2025-10-07T21:24:15.400453] [INFO ] [MAIN ] SBSI: Loaded 14853 existing records. [2025-10-07T21:24:15.589409] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:24:15.589735] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-07T21:24:15.589805] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-07T21:24:15.590107] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-07T21:24:15.590181] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-07T21:24:15.852910] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-07T21:24:15.970284] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:24:16.325334] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:24:16.327462] [INFO ] [REMOTE ] SBI: Full fetch complete (10524 records). [2025-10-07T21:24:16.327594] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-07T21:24:16.652860] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-07T21:24:16.747317] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-07T21:24:16.747495] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-07T21:24:16.748125] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-07T21:24:16.748193] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-07T21:24:16.748867] [DEBUG] [LOCAL ] SBI: Trimmed 10524 records to 7424 (keeping 200 days of data) [2025-10-07T21:24:16.806675] [DEBUG] [LOCAL ] SBI: Primary data saved (7424 records). [2025-10-07T21:24:16.806914] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-07T21:24:16.807093] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBI took 31.7s. Estimated remaining: 1h 9m 54s. Rate: 7.1 symbols/min [2025-10-07T21:24:17.019037] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:24:17.021265] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T21:24:17.094461] [DEBUG] [LOCAL ] SBSW: Loaded 53054 existing records from primary storage. [2025-10-07T21:24:17.094940] [INFO ] [MAIN ] SBSW: Loaded 53054 existing records. [2025-10-07T21:24:17.284223] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:24:17.284506] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-07T21:24:17.284566] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-07T21:24:17.284859] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-07T21:24:17.284922] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-07T21:24:17.451255] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-07T21:24:17.680750] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:24:17.691490] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T21:24:18.247715] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-07T21:24:18.833168] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T21:24:18.837252] [INFO ] [REMOTE ] SBH: Full fetch complete (72877 records). [2025-10-07T21:24:18.837380] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-07T21:24:19.050635] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-07T21:24:19.333899] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T21:24:19.397286] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-07T21:24:19.397506] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-07T21:24:19.399982] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-07T21:24:19.400104] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-07T21:24:19.402267] [DEBUG] [LOCAL ] SBH: Trimmed 72877 records to 49797 (keeping 200 days of data) [2025-10-07T21:24:19.848071] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-07T21:24:19.862351] [DEBUG] [LOCAL ] SBH: Primary data saved (49797 records). [2025-10-07T21:24:19.862597] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-07T21:24:19.862730] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBH took 39.8s. Estimated remaining: 1h 9m 44s. Rate: 7.1 symbols/min [2025-10-07T21:24:20.055010] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:24:20.055264] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-07T21:24:20.055331] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-07T21:24:20.055497] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-07T21:24:20.055568] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-07T21:24:20.055688] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-07T21:24:20.055759] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-07T21:24:20.433283] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:24:20.646181] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-07T21:24:20.649133] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-07T21:24:20.883625] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-10-07T21:24:20.939214] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T21:24:21.447738] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-07T21:24:22.247700] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-07T21:24:22.469186] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-07T21:24:23.047627] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-07T21:24:23.285324] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T21:24:23.847693] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-07T21:24:23.976979] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T21:24:24.647755] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-07T21:24:24.991741] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-07T21:24:25.312413] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T21:24:25.447667] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-07T21:24:26.247675] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-07T21:24:26.510980] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-07T21:24:27.047727] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-07T21:24:27.274607] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T21:24:27.847786] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-07T21:24:28.112060] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-07T21:24:28.171809] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T21:24:28.647707] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-07T21:24:28.989404] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-07T21:24:29.447706] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-07T21:24:30.232383] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-07T21:24:30.247614] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-07T21:24:30.835723] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T21:24:31.047716] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-07T21:24:31.847694] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-07T21:24:32.647686] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-07T21:24:33.014569] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T21:24:33.123993] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-07T21:24:33.452933] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-07T21:24:33.467812] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T21:24:33.800376] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-07T21:24:34.247700] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-07T21:24:34.517244] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-07T21:24:34.517982] [INFO ] [REMOTE ] SBXD: Full fetch complete (3101 records). [2025-10-07T21:24:34.518057] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-07T21:24:34.697961] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-07T21:24:34.698181] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:24:34.698265] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:24:34.698351] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-07T21:24:34.698423] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-07T21:24:34.698461] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-07T21:24:34.698502] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-07T21:24:34.698562] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBXD took 14.8s. Estimated remaining: 1h 9m 37s. Rate: 7.1 symbols/min [2025-10-07T21:24:35.047722] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-07T21:24:35.847755] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-07T21:24:36.647769] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-07T21:24:36.917942] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T21:24:36.988522] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T21:24:37.447685] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-07T21:24:37.941439] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T21:24:38.247713] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-07T21:24:39.047705] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-07T21:24:39.115431] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T21:24:39.849470] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-07T21:24:39.855307] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T21:24:39.911040] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T21:24:40.647724] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-07T21:24:41.447621] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-07T21:24:42.020206] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-07T21:24:42.247736] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-07T21:24:42.386067] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T21:24:42.385489] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T21:24:43.047747] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-07T21:24:43.847714] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-07T21:24:44.027012] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T21:24:44.611170] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:24:44.647604] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-07T21:24:44.815078] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T21:24:45.447700] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-07T21:24:46.247666] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-07T21:24:46.355618] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T21:24:47.047714] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-07T21:24:47.169867] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-07T21:24:47.360535] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-07T21:24:47.847690] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-07T21:24:48.216763] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T21:24:48.647710] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-07T21:24:48.822414] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T21:24:49.447708] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-07T21:24:50.176085] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T21:24:50.178176] [INFO ] [REMOTE ] SBSI: Full fetch complete (21274 records). [2025-10-07T21:24:50.178414] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-07T21:24:50.256791] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-07T21:24:50.563893] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T21:24:50.650476] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-07T21:24:50.650585] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-07T21:24:50.651164] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-07T21:24:50.651232] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-07T21:24:50.652135] [DEBUG] [LOCAL ] SBSI: Trimmed 21274 records to 14852 (keeping 200 days of data) [2025-10-07T21:24:50.747337] [DEBUG] [LOCAL ] SBSI: Primary data saved (14852 records). [2025-10-07T21:24:50.747502] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-07T21:24:50.747590] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBSI took 35.5s. Estimated remaining: 1h 9m 30s. Rate: 7.1 symbols/min [2025-10-07T21:24:51.047749] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-07T21:24:52.060033] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-07T21:24:52.065069] [INFO ] [REMOTE ] SBSW: Full fetch complete (76537 records). [2025-10-07T21:24:52.065255] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-07T21:24:52.430687] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T21:24:52.479636] [INFO ] [REMOTE ] SBS: Full fetch complete (70127 records). [2025-10-07T21:24:52.483415] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-07T21:24:52.610728] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-07T21:24:52.616035] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-07T21:24:52.630181] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-07T21:24:52.642301] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-07T21:24:52.689752] [DEBUG] [LOCAL ] SBSW: Trimmed 76537 records to 53069 (keeping 200 days of data) [2025-10-07T21:24:53.073076] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-07T21:24:53.076114] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-07T21:24:53.079325] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-07T21:24:53.079728] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-07T21:24:53.085923] [DEBUG] [LOCAL ] SBS: Trimmed 70127 records to 49403 (keeping 200 days of data) [2025-10-07T21:24:53.662322] [DEBUG] [LOCAL ] SBSW: Primary data saved (53069 records). [2025-10-07T21:24:53.664142] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-07T21:24:53.664326] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBSW took 36.9s. Estimated remaining: 1h 9m 20s. Rate: 7.1 symbols/min [2025-10-07T21:24:53.668114] [DEBUG] [LOCAL ] SBS: Primary data saved (49403 records). [2025-10-07T21:24:53.668358] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-07T21:24:53.668489] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBS took 39.9s. Estimated remaining: 1h 9m 10s. Rate: 7.1 symbols/min [2025-10-07T21:24:54.339678] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:24:54.534069] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:24:54.590933] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:24:54.615548] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:24:54.635077] [DEBUG] [LOCAL ] SCD: Loaded 12993 existing records from primary storage. [2025-10-07T21:24:54.635529] [INFO ] [MAIN ] SCD: Loaded 12993 existing records. [2025-10-07T21:24:54.890631] [DEBUG] [LOCAL ] SCI: Loaded 46518 existing records from primary storage. [2025-10-07T21:24:54.917787] [INFO ] [MAIN ] SCI: Loaded 46518 existing records. [2025-10-07T21:24:54.917459] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:24:54.937016] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-07T21:24:54.946331] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-07T21:24:54.946856] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-07T21:24:54.952185] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-07T21:24:54.973832] [DEBUG] [LOCAL ] SCCO: Loaded 49525 existing records from primary storage. [2025-10-07T21:24:54.972677] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-07T21:24:55.021147] [INFO ] [MAIN ] SCCO: Loaded 49525 existing records. [2025-10-07T21:24:55.100681] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-07T21:24:55.488247] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:24:55.556903] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-07T21:24:55.561095] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-07T21:24:55.564766] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:24:55.565327] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-07T21:24:55.611421] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-07T21:24:55.591453] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-07T21:24:55.646434] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-07T21:24:55.663392] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-07T21:24:55.681787] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-07T21:24:55.942356] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:24:56.021936] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-07T21:24:56.066766] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-07T21:24:56.094187] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-07T21:24:56.138080] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-07T21:24:56.294270] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:24:56.344325] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-07T21:24:57.050697] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:24:57.055023] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:24:57.084349] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-07T21:24:57.090144] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-07T21:24:57.148429] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T21:24:57.190035] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-07T21:24:57.226234] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:24:57.226776] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-07T21:24:58.039803] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T21:24:58.042563] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-07T21:24:58.824441] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T21:24:58.827039] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-07T21:24:58.881946] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T21:24:58.892232] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-07T21:24:58.958915] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T21:24:58.971043] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-07T21:24:59.252795] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-07T21:24:59.255676] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-07T21:24:59.348177] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-07T21:24:59.847685] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-07T21:25:00.035249] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-07T21:25:00.569608] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T21:25:00.647706] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-07T21:25:01.447776] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-07T21:25:01.661026] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T21:25:02.247717] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-07T21:25:02.300081] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-07T21:25:02.535199] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-07T21:25:02.572086] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (3.60 seconds). [2025-10-07T21:25:03.047724] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-07T21:25:03.859374] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-07T21:25:03.866987] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T21:25:04.647785] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-07T21:25:04.762805] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T21:25:04.813562] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T21:25:05.447735] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-07T21:25:06.247636] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-07T21:25:06.356417] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T21:25:06.550629] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T21:25:07.047779] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-07T21:25:07.847759] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-07T21:25:08.261559] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T21:25:08.647749] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-07T21:25:08.887934] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T21:25:09.447760] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-07T21:25:09.928768] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T21:25:10.148107] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T21:25:10.247689] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-07T21:25:10.885875] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T21:25:11.047745] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-07T21:25:11.847693] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-07T21:25:12.018909] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T21:25:12.086302] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T21:25:12.647721] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-07T21:25:13.413134] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T21:25:13.447744] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-07T21:25:14.247638] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-07T21:25:14.735369] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-07T21:25:15.048456] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T21:25:15.048616] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-07T21:25:15.847724] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-07T21:25:16.012196] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-07T21:25:16.105546] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T21:25:16.647740] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-07T21:25:17.447682] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-07T21:25:17.820364] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-07T21:25:18.247722] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-07T21:25:18.335915] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T21:25:18.723609] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T21:25:18.725060] [INFO ] [REMOTE ] SCD: Full fetch complete (16547 records). [2025-10-07T21:25:18.725295] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-07T21:25:19.051021] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-07T21:25:19.093669] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-07T21:25:19.093939] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-07T21:25:19.094362] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-07T21:25:19.094441] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-07T21:25:19.095520] [DEBUG] [LOCAL ] SCD: Trimmed 16547 records to 13049 (keeping 200 days of data) [2025-10-07T21:25:19.216475] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T21:25:19.241839] [DEBUG] [LOCAL ] SCD: Primary data saved (13049 records). [2025-10-07T21:25:19.242008] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-07T21:25:19.242125] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 25.6s. Estimated remaining: 1h 9m 6s. Rate: 7.1 symbols/min [2025-10-07T21:25:19.406051] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:25:19.424495] [DEBUG] [LOCAL ] SCL: Loaded 14883 existing records from primary storage. [2025-10-07T21:25:19.424754] [INFO ] [MAIN ] SCL: Loaded 14883 existing records. [2025-10-07T21:25:19.595177] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:25:19.595388] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-07T21:25:19.595443] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-07T21:25:19.595664] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-07T21:25:19.595724] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-07T21:25:19.857290] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-07T21:25:19.938617] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:25:20.647719] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-07T21:25:20.873733] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T21:25:21.447749] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-07T21:25:21.571628] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T21:25:22.247672] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-07T21:25:22.292091] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T21:25:23.047616] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-07T21:25:23.211834] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-07T21:25:23.490976] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T21:25:23.847679] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-07T21:25:24.151740] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T21:25:24.155087] [INFO ] [REMOTE ] SCI: Full fetch complete (67391 records). [2025-10-07T21:25:24.155199] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-07T21:25:24.555075] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-07T21:25:24.555172] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-07T21:25:24.556144] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-07T21:25:24.556215] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-07T21:25:24.557703] [DEBUG] [LOCAL ] SCI: Trimmed 67391 records to 46524 (keeping 200 days of data) [2025-10-07T21:25:24.649512] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-07T21:25:24.861762] [DEBUG] [LOCAL ] SCI: Primary data saved (46524 records). [2025-10-07T21:25:24.861984] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-07T21:25:24.862123] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCI took 31.2s. Estimated remaining: 1h 8m 57s. Rate: 7.1 symbols/min [2025-10-07T21:25:25.033906] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:25:25.056886] [DEBUG] [LOCAL ] SCM: Loaded 19758 existing records from primary storage. [2025-10-07T21:25:25.057164] [INFO ] [MAIN ] SCM: Loaded 19758 existing records. [2025-10-07T21:25:25.236974] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:25:25.237439] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-07T21:25:25.237558] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-07T21:25:25.237880] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-07T21:25:25.237941] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-07T21:25:25.453744] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-07T21:25:25.540682] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T21:25:25.661783] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:25:25.674138] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T21:25:26.247747] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-07T21:25:27.047637] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-07T21:25:27.282161] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T21:25:27.847726] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-07T21:25:28.344768] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-07T21:25:28.646608] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T21:25:28.650193] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-07T21:25:28.651705] [INFO ] [REMOTE ] SCCO: Full fetch complete (71155 records). [2025-10-07T21:25:28.651794] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-07T21:25:28.818845] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T21:25:29.151869] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-07T21:25:29.151968] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-07T21:25:29.153064] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-07T21:25:29.153134] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-07T21:25:29.155098] [DEBUG] [LOCAL ] SCCO: Trimmed 71155 records to 49563 (keeping 200 days of data) [2025-10-07T21:25:29.457425] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-07T21:25:29.476389] [DEBUG] [LOCAL ] SCCO: Primary data saved (49563 records). [2025-10-07T21:25:29.476491] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-07T21:25:29.476602] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCCO took 35.8s. Estimated remaining: 1h 8m 47s. Rate: 7.1 symbols/min [2025-10-07T21:25:29.644675] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:25:29.679192] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T21:25:29.703968] [DEBUG] [LOCAL ] SCS: Loaded 43586 existing records from primary storage. [2025-10-07T21:25:29.704380] [INFO ] [MAIN ] SCS: Loaded 43586 existing records. [2025-10-07T21:25:29.877360] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:25:29.877637] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-07T21:25:29.877721] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-07T21:25:29.877964] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-07T21:25:29.878021] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-07T21:25:30.225257] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:25:30.234604] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-07T21:25:30.247591] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-07T21:25:31.047635] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-07T21:25:31.369388] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T21:25:31.780675] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T21:25:31.847665] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-07T21:25:32.647702] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-07T21:25:33.008129] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-07T21:25:33.447672] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-07T21:25:33.917357] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T21:25:34.247680] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-07T21:25:35.047616] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-07T21:25:35.399442] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T21:25:35.647824] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-07T21:25:35.847677] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-07T21:25:36.129756] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T21:25:36.647688] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-07T21:25:37.447737] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-07T21:25:37.494754] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T21:25:37.507404] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T21:25:37.511999] [INFO ] [REMOTE ] SCHW: Full fetch complete (77704 records). [2025-10-07T21:25:37.512192] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-07T21:25:37.906326] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-07T21:25:37.906419] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-07T21:25:37.907486] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-07T21:25:37.907562] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-07T21:25:37.909161] [DEBUG] [LOCAL ] SCHW: Trimmed 77704 records to 53685 (keeping 200 days of data) [2025-10-07T21:25:38.248719] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-07T21:25:38.252805] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-07T21:25:38.253325] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-07T21:25:38.254231] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCHW took 44.5s. Estimated remaining: 1h 8m 39s. Rate: 7.1 symbols/min [2025-10-07T21:25:38.428880] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:25:38.459488] [DEBUG] [LOCAL ] SD: Loaded 28759 existing records from primary storage. [2025-10-07T21:25:38.459792] [INFO ] [MAIN ] SD: Loaded 28759 existing records. [2025-10-07T21:25:38.639452] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:25:38.639758] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-07T21:25:38.639834] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-07T21:25:38.640144] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-07T21:25:38.646215] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-07T21:25:38.765363] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T21:25:39.043547] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:25:39.045046] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-07T21:25:39.048560] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-07T21:25:39.847620] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-07T21:25:40.053026] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T21:25:40.647632] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-07T21:25:40.893588] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T21:25:41.447685] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-07T21:25:41.837026] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T21:25:42.247622] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-07T21:25:42.486015] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T21:25:43.047742] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-07T21:25:43.847688] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-07T21:25:43.874812] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T21:25:43.931795] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T21:25:44.480244] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-07T21:25:44.647711] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-07T21:25:45.447709] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-07T21:25:45.459120] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-07T21:25:45.460728] [INFO ] [REMOTE ] SCL: Full fetch complete (21398 records). [2025-10-07T21:25:45.460816] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-07T21:25:45.855714] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-07T21:25:45.855808] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-07T21:25:45.856329] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-07T21:25:45.856373] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-07T21:25:45.857141] [DEBUG] [LOCAL ] SCL: Trimmed 21398 records to 14865 (keeping 200 days of data) [2025-10-07T21:25:45.955251] [DEBUG] [LOCAL ] SCL: Primary data saved (14865 records). [2025-10-07T21:25:45.955428] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-07T21:25:45.955542] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 26.7s. Estimated remaining: 1h 8m 30s. Rate: 7.1 symbols/min [2025-10-07T21:25:46.177568] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:25:46.190698] [DEBUG] [LOCAL ] SDHC: Loaded 10336 existing records from primary storage. [2025-10-07T21:25:46.191007] [INFO ] [MAIN ] SDHC: Loaded 10336 existing records. [2025-10-07T21:25:46.255225] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-07T21:25:46.379417] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:25:46.379675] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-07T21:25:46.379784] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-07T21:25:46.379997] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-07T21:25:46.380054] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-07T21:25:46.734270] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:25:47.047759] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-07T21:25:47.713613] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T21:25:47.730024] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T21:25:47.847734] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-07T21:25:48.647693] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-07T21:25:48.782068] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (3.33 seconds). [2025-10-07T21:25:49.306524] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T21:25:49.447690] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-07T21:25:50.253925] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-07T21:25:50.272374] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T21:25:50.568372] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T21:25:51.047737] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-07T21:25:51.451729] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T21:25:51.847736] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-07T21:25:51.972382] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T21:25:51.974575] [INFO ] [REMOTE ] SCM: Full fetch complete (28640 records). [2025-10-07T21:25:51.974706] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-07T21:25:52.351402] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-07T21:25:52.351483] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-07T21:25:52.352100] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-07T21:25:52.352165] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-07T21:25:52.353162] [DEBUG] [LOCAL ] SCM: Trimmed 28640 records to 19820 (keeping 200 days of data) [2025-10-07T21:25:52.474051] [DEBUG] [LOCAL ] SCM: Primary data saved (19820 records). [2025-10-07T21:25:52.474200] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-07T21:25:52.474282] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCM took 27.6s. Estimated remaining: 1h 8m 21s. Rate: 7.1 symbols/min [2025-10-07T21:25:52.639329] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:25:52.652267] [DEBUG] [LOCAL ] SDHY: Loaded 10632 existing records from primary storage. [2025-10-07T21:25:52.647784] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-07T21:25:52.652789] [INFO ] [MAIN ] SDHY: Loaded 10632 existing records. [2025-10-07T21:25:52.830254] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:25:52.830453] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-07T21:25:52.830501] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-07T21:25:52.830694] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-07T21:25:52.830751] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-07T21:25:53.200465] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:25:53.220814] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T21:25:53.447639] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-07T21:25:53.676133] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T21:25:54.247678] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-07T21:25:54.850989] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T21:25:55.047731] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-07T21:25:55.221583] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T21:25:55.847682] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-07T21:25:56.622018] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T21:25:56.647597] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-07T21:25:56.857315] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T21:25:57.447632] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-07T21:25:57.460180] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T21:25:58.247774] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-07T21:25:59.047715] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-07T21:25:59.847694] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-07T21:25:59.963271] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T21:25:59.996124] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-07T21:26:00.077368] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T21:26:00.647639] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-07T21:26:00.670145] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T21:26:01.447730] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-07T21:26:02.132405] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T21:26:02.174923] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T21:26:02.247690] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-07T21:26:03.047714] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-07T21:26:03.208093] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T21:26:03.847739] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-07T21:26:04.530723] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T21:26:04.598248] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T21:26:04.647735] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-07T21:26:05.447688] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-07T21:26:05.959982] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T21:26:06.247735] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-07T21:26:06.421215] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-07T21:26:06.996544] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T21:26:07.047696] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-07T21:26:07.847771] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-07T21:26:08.275150] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T21:26:08.640343] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T21:26:08.647610] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-07T21:26:09.447636] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-07T21:26:09.585973] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T21:26:10.247696] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-07T21:26:10.954674] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-07T21:26:11.047678] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-07T21:26:11.142133] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T21:26:11.811788] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T21:26:11.847689] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-07T21:26:12.641178] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T21:26:12.647591] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-07T21:26:13.435931] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T21:26:13.447606] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-07T21:26:14.252391] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-07T21:26:14.256147] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-07T21:26:15.047696] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-07T21:26:15.853879] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-07T21:26:15.860527] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T21:26:16.180507] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T21:26:16.647620] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-07T21:26:16.658553] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T21:26:17.253548] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T21:26:17.254880] [INFO ] [REMOTE ] SDHC: Full fetch complete (17210 records). [2025-10-07T21:26:17.254951] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-07T21:26:17.454013] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-07T21:26:17.614708] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-07T21:26:17.614812] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-07T21:26:17.615243] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-07T21:26:17.615283] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-07T21:26:17.615838] [DEBUG] [LOCAL ] SDHC: Trimmed 17210 records to 10332 (keeping 200 days of data) [2025-10-07T21:26:17.678471] [DEBUG] [LOCAL ] SDHC: Primary data saved (10332 records). [2025-10-07T21:26:17.678613] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-07T21:26:17.678740] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SDHC took 31.7s. Estimated remaining: 1h 8m 17s. Rate: 7.1 symbols/min [2025-10-07T21:26:17.848432] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:26:17.889877] [DEBUG] [LOCAL ] SDRL: Loaded 41480 existing records from primary storage. [2025-10-07T21:26:17.890191] [INFO ] [MAIN ] SDRL: Loaded 41480 existing records. [2025-10-07T21:26:18.080599] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:26:18.080912] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-07T21:26:18.080965] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-07T21:26:18.081504] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-07T21:26:18.081830] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-07T21:26:18.261538] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-07T21:26:18.473624] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:26:18.558980] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T21:26:18.562379] [INFO ] [REMOTE ] SCS: Full fetch complete (60905 records). [2025-10-07T21:26:18.562487] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-07T21:26:18.949075] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-07T21:26:18.949155] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-07T21:26:18.950058] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-07T21:26:18.950162] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-07T21:26:18.951513] [DEBUG] [LOCAL ] SCS: Trimmed 60905 records to 43572 (keeping 200 days of data) [2025-10-07T21:26:19.048007] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-07T21:26:19.238335] [DEBUG] [LOCAL ] SCS: Primary data saved (43572 records). [2025-10-07T21:26:19.238487] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-07T21:26:19.238577] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SCS took 49.8s. Estimated remaining: 1h 8m 7s. Rate: 7.1 symbols/min [2025-10-07T21:26:19.409917] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:26:19.444412] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T21:26:19.447353] [INFO ] [REMOTE ] SD: Full fetch complete (41147 records). [2025-10-07T21:26:19.447495] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-07T21:26:19.607180] [DEBUG] [LOCAL ] SE: Loaded 53346 existing records from primary storage. [2025-10-07T21:26:19.628803] [INFO ] [MAIN ] SE: Loaded 53346 existing records. [2025-10-07T21:26:19.649819] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T21:26:19.688210] [INFO ] [REMOTE ] SDHY: Full fetch complete (15756 records). [2025-10-07T21:26:19.748942] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-07T21:26:19.907013] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-07T21:26:20.093003] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:26:20.135369] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-07T21:26:20.152377] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-07T21:26:20.232904] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-07T21:26:20.232547] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-07T21:26:20.239182] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-07T21:26:20.280021] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-07T21:26:20.301214] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-07T21:26:20.343805] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-07T21:26:20.542329] [DEBUG] [LOCAL ] SD: Trimmed 41147 records to 28769 (keeping 200 days of data) [2025-10-07T21:26:20.769884] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-07T21:26:20.838759] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-07T21:26:20.856525] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-07T21:26:20.874248] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-07T21:26:20.917092] [DEBUG] [LOCAL ] SDHY: Trimmed 15756 records to 10757 (keeping 200 days of data) [2025-10-07T21:26:21.126679] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:26:21.128087] [DEBUG] [LOCAL ] SDHY: Primary data saved (10757 records). [2025-10-07T21:26:21.128994] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-07T21:26:21.134775] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-07T21:26:21.138047] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SDHY took 28.7s. Estimated remaining: 1h 7m 57s. Rate: 7.1 symbols/min [2025-10-07T21:26:21.378596] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:26:21.384093] [DEBUG] [LOCAL ] SD: Primary data saved (28769 records). [2025-10-07T21:26:21.384417] [INFO ] [MAIN ] SD: Full history saved. [2025-10-07T21:26:21.384530] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SD took 43.1s. Estimated remaining: 1h 7m 46s. Rate: 7.1 symbols/min [2025-10-07T21:26:21.570033] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:26:21.612600] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T21:26:21.627606] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-07T21:26:21.648829] [DEBUG] [LOCAL ] SEG: Loaded 13325 existing records from primary storage. [2025-10-07T21:26:21.649797] [DEBUG] [LOCAL ] SEE: Loaded 48238 existing records from primary storage. [2025-10-07T21:26:21.650093] [INFO ] [MAIN ] SEG: Loaded 13325 existing records. [2025-10-07T21:26:21.672574] [INFO ] [MAIN ] SEE: Loaded 48238 existing records. [2025-10-07T21:26:22.033777] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:26:22.059359] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-07T21:26:22.065129] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-07T21:26:22.064990] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:26:22.065549] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-07T21:26:22.065427] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-07T21:26:22.065842] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-07T21:26:22.065758] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-07T21:26:22.108524] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-07T21:26:22.141587] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-07T21:26:22.823272] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:26:22.859371] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-07T21:26:22.902169] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:26:22.934457] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T21:26:22.992446] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T21:26:23.047617] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-07T21:26:23.747193] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T21:26:23.847680] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-07T21:26:24.647740] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-07T21:26:25.095085] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-07T21:26:25.368071] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T21:26:25.447704] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-07T21:26:26.166887] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T21:26:26.247631] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-07T21:26:27.004736] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T21:26:27.047607] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-07T21:26:27.847722] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-07T21:26:28.237272] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T21:26:28.561386] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T21:26:28.647686] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-07T21:26:28.685191] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-07T21:26:29.447705] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-07T21:26:30.114269] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T21:26:30.247728] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-07T21:26:30.435493] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T21:26:31.047717] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-07T21:26:31.849831] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-07T21:26:31.856163] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T21:26:32.656282] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-07T21:26:32.662340] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T21:26:33.447703] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-07T21:26:33.990380] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-07T21:26:34.068145] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T21:26:34.233290] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T21:26:34.247605] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-07T21:26:35.047688] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-07T21:26:35.256415] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T21:26:35.847742] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-07T21:26:36.647708] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-07T21:26:37.152407] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-07T21:26:37.447634] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-07T21:26:37.485688] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T21:26:38.211750] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T21:26:38.247692] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-07T21:26:39.047628] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-07T21:26:39.377313] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T21:26:39.847682] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-07T21:26:39.941284] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T21:26:40.647717] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-07T21:26:40.898055] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T21:26:41.447632] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-07T21:26:41.524077] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T21:26:41.835997] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T21:26:42.247673] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-07T21:26:42.669696] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T21:26:42.732492] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-07T21:26:43.047686] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-07T21:26:43.847686] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-07T21:26:43.898812] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T21:26:44.647671] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-07T21:26:45.093630] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T21:26:45.096780] [INFO ] [REMOTE ] SDRL: Full fetch complete (61653 records). [2025-10-07T21:26:45.096888] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-07T21:26:45.447613] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-07T21:26:45.491119] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-07T21:26:45.491294] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-07T21:26:45.492531] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-07T21:26:45.492699] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-07T21:26:45.494233] [DEBUG] [LOCAL ] SDRL: Trimmed 61653 records to 41477 (keeping 200 days of data) [2025-10-07T21:26:45.594077] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T21:26:45.754096] [DEBUG] [LOCAL ] SDRL: Primary data saved (41477 records). [2025-10-07T21:26:45.754231] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-07T21:26:45.754329] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SDRL took 28.1s. Estimated remaining: 1h 7m 42s. Rate: 7.1 symbols/min [2025-10-07T21:26:45.918795] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:26:45.963103] [DEBUG] [LOCAL ] SEI: Loaded 49660 existing records from primary storage. [2025-10-07T21:26:45.963431] [INFO ] [MAIN ] SEI: Loaded 49660 existing records. [2025-10-07T21:26:46.136262] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:26:46.136471] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-07T21:26:46.136519] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-07T21:26:46.136788] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-07T21:26:46.136845] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-07T21:26:46.252886] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-07T21:26:46.489605] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:26:47.047680] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-07T21:26:47.120188] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T21:26:47.404300] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-07T21:26:47.847681] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-07T21:26:48.627467] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T21:26:48.647639] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-07T21:26:49.447664] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-07T21:26:49.570519] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T21:26:50.240444] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T21:26:50.250738] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-07T21:26:50.915632] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:26:50.917194] [INFO ] [REMOTE ] SEG: Full fetch complete (19812 records). [2025-10-07T21:26:50.917599] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-07T21:26:51.058964] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-07T21:26:51.275015] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T21:26:51.362422] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-07T21:26:51.362533] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-07T21:26:51.363261] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-07T21:26:51.363329] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-07T21:26:51.364130] [DEBUG] [LOCAL ] SEG: Trimmed 19812 records to 13247 (keeping 200 days of data) [2025-10-07T21:26:51.450413] [DEBUG] [LOCAL ] SEG: Primary data saved (13247 records). [2025-10-07T21:26:51.450637] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-07T21:26:51.450796] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SEG took 30.1s. Estimated remaining: 1h 7m 33s. Rate: 7.1 symbols/min [2025-10-07T21:26:51.627083] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:26:51.672883] [DEBUG] [LOCAL ] SEM: Loaded 42846 existing records from primary storage. [2025-10-07T21:26:51.673357] [INFO ] [MAIN ] SEM: Loaded 42846 existing records. [2025-10-07T21:26:51.851699] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-07T21:26:51.864851] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:26:51.865260] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-07T21:26:51.865317] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-07T21:26:51.865780] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-07T21:26:51.865842] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-07T21:26:52.247366] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:26:52.620536] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:26:52.647613] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-07T21:26:53.420886] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T21:26:53.447597] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-07T21:26:54.248779] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-07T21:26:54.251804] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T21:26:55.047709] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-07T21:26:55.209506] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T21:26:55.847758] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-07T21:26:55.917919] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T21:26:56.647623] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-07T21:26:56.724831] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T21:26:57.447620] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-07T21:26:57.652625] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T21:26:58.162969] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T21:26:58.247619] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-07T21:26:59.052762] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-07T21:26:59.068327] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T21:26:59.847618] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-07T21:26:59.896191] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T21:27:00.601627] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T21:27:00.647611] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-07T21:27:01.447702] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-07T21:27:01.473479] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T21:27:01.477898] [INFO ] [REMOTE ] SE: Full fetch complete (77071 records). [2025-10-07T21:27:01.478081] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-07T21:27:01.915704] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-07T21:27:01.916004] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-07T21:27:01.917682] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-07T21:27:01.917831] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-07T21:27:01.920103] [DEBUG] [LOCAL ] SE: Trimmed 77071 records to 53329 (keeping 200 days of data) [2025-10-07T21:27:02.109672] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T21:27:02.247818] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-07T21:27:02.373924] [DEBUG] [LOCAL ] SE: Primary data saved (53329 records). [2025-10-07T21:27:02.374427] [INFO ] [MAIN ] SE: Full history saved. [2025-10-07T21:27:02.374589] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SE took 43.1s. Estimated remaining: 1h 7m 25s. Rate: 7.1 symbols/min [2025-10-07T21:27:02.547199] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:02.585125] [DEBUG] [LOCAL ] SEMR: Loaded 41760 existing records from primary storage. [2025-10-07T21:27:02.585430] [INFO ] [MAIN ] SEMR: Loaded 41760 existing records. [2025-10-07T21:27:02.759526] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:27:02.759885] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-07T21:27:02.759962] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-07T21:27:02.760804] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-07T21:27:02.760888] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-07T21:27:03.053152] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-07T21:27:03.121067] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:27:03.227124] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T21:27:03.402432] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T21:27:03.847726] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-07T21:27:04.647685] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-07T21:27:04.779664] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T21:27:05.447748] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-07T21:27:05.767375] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T21:27:06.230565] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T21:27:06.247611] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-07T21:27:06.653724] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T21:27:07.047764] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-07T21:27:07.773981] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T21:27:07.847687] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-07T21:27:08.389523] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T21:27:08.647698] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-07T21:27:09.405190] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T21:27:09.447606] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-07T21:27:10.253335] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-07T21:27:10.264928] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T21:27:11.047621] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-07T21:27:11.143251] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T21:27:11.847601] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-07T21:27:12.003270] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T21:27:12.188178] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T21:27:12.647729] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-07T21:27:12.964053] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-07T21:27:13.447723] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-07T21:27:13.727252] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T21:27:13.731209] [INFO ] [REMOTE ] SEI: Full fetch complete (70110 records). [2025-10-07T21:27:13.731363] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-07T21:27:14.127197] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-07T21:27:14.127303] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-07T21:27:14.128294] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-07T21:27:14.128358] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-07T21:27:14.130335] [DEBUG] [LOCAL ] SEI: Trimmed 70110 records to 49697 (keeping 200 days of data) [2025-10-07T21:27:14.247875] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-07T21:27:14.438424] [DEBUG] [LOCAL ] SEI: Primary data saved (49697 records). [2025-10-07T21:27:14.438560] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-07T21:27:14.438678] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEI took 28.7s. Estimated remaining: 1h 7m 17s. Rate: 7.1 symbols/min [2025-10-07T21:27:14.609441] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:14.666754] [DEBUG] [LOCAL ] SES: Loaded 51560 existing records from primary storage. [2025-10-07T21:27:14.667283] [INFO ] [MAIN ] SES: Loaded 51560 existing records. [2025-10-07T21:27:14.766253] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T21:27:14.786739] [INFO ] [REMOTE ] SEM: Full fetch complete (61541 records). [2025-10-07T21:27:14.807710] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-07T21:27:14.936917] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:27:14.960451] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-07T21:27:14.962937] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-07T21:27:14.963293] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-07T21:27:14.968823] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-07T21:27:15.051798] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-07T21:27:15.540104] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-07T21:27:15.540559] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-07T21:27:15.552381] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-07T21:27:15.557634] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-07T21:27:15.625739] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:27:15.604091] [DEBUG] [LOCAL ] SEM: Trimmed 61541 records to 42871 (keeping 200 days of data) [2025-10-07T21:27:15.731814] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T21:27:15.737381] [INFO ] [REMOTE ] SEE: Full fetch complete (69792 records). [2025-10-07T21:27:15.738475] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-07T21:27:15.858312] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-07T21:27:16.167891] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-07T21:27:16.168604] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-07T21:27:16.171543] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-07T21:27:16.171953] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-07T21:27:16.179416] [DEBUG] [LOCAL ] SEE: Trimmed 69792 records to 48226 (keeping 200 days of data) [2025-10-07T21:27:16.416994] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T21:27:16.477010] [DEBUG] [LOCAL ] SEM: Primary data saved (42871 records). [2025-10-07T21:27:16.478340] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-07T21:27:16.478710] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEM took 25.0s. Estimated remaining: 1h 7m 7s. Rate: 7.1 symbols/min [2025-10-07T21:27:16.648672] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-07T21:27:16.670563] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:16.816136] [DEBUG] [LOCAL ] SF: Loaded 41566 existing records from primary storage. [2025-10-07T21:27:16.817983] [INFO ] [MAIN ] SF: Loaded 41566 existing records. [2025-10-07T21:27:17.011921] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:27:17.014243] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-07T21:27:17.014837] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-07T21:27:17.020614] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-07T21:27:17.020804] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-07T21:27:17.181796] [DEBUG] [LOCAL ] SEE: Primary data saved (48226 records). [2025-10-07T21:27:17.185411] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-07T21:27:17.185532] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEE took 56.0s. Estimated remaining: 1h 6m 57s. Rate: 7.1 symbols/min [2025-10-07T21:27:17.595816] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:17.681258] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:27:17.681821] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-07T21:27:17.685945] [DEBUG] [LOCAL ] SFB: Loaded 4152 existing records from primary storage. [2025-10-07T21:27:17.686372] [INFO ] [MAIN ] SFB: Loaded 4152 existing records. [2025-10-07T21:27:17.877589] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:27:17.878022] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-07T21:27:17.878137] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-07T21:27:17.878519] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-07T21:27:17.878584] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-07T21:27:17.976635] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-07T21:27:18.257482] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-07T21:27:18.380263] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:27:18.382615] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T21:27:19.047666] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-07T21:27:19.172100] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T21:27:19.847730] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-07T21:27:20.199158] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T21:27:20.479613] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-07T21:27:20.495498] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T21:27:20.647628] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-07T21:27:21.447695] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-07T21:27:22.247751] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-07T21:27:22.811450] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T21:27:22.863211] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T21:27:23.047621] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-07T21:27:23.167891] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-07T21:27:23.847697] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-07T21:27:24.568225] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T21:27:24.647690] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-07T21:27:25.112080] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T21:27:25.447676] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-07T21:27:25.762387] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-07T21:27:25.908888] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T21:27:26.247673] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-07T21:27:27.047701] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-07T21:27:27.644969] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T21:27:27.847684] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-07T21:27:28.647636] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-07T21:27:28.708469] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-07T21:27:29.259543] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T21:27:29.403596] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T21:27:29.447607] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-07T21:27:30.247715] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-07T21:27:30.564762] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T21:27:30.568212] [INFO ] [REMOTE ] SEMR: Full fetch complete (59571 records). [2025-10-07T21:27:30.568331] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-07T21:27:30.951290] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-07T21:27:30.951436] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-07T21:27:30.952354] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-07T21:27:30.952421] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-07T21:27:30.953731] [DEBUG] [LOCAL ] SEMR: Trimmed 59571 records to 41770 (keeping 200 days of data) [2025-10-07T21:27:31.047916] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-07T21:27:31.208446] [DEBUG] [LOCAL ] SEMR: Primary data saved (41770 records). [2025-10-07T21:27:31.208689] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-07T21:27:31.208815] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 28.8s. Estimated remaining: 1h 6m 50s. Rate: 7.1 symbols/min [2025-10-07T21:27:31.377462] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:31.400480] [DEBUG] [LOCAL ] SFBS: Loaded 21134 existing records from primary storage. [2025-10-07T21:27:31.400745] [INFO ] [MAIN ] SFBS: Loaded 21134 existing records. [2025-10-07T21:27:31.579895] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:27:31.580142] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-07T21:27:31.580282] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-07T21:27:31.580555] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-07T21:27:31.580611] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-07T21:27:31.682174] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T21:27:31.853750] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-07T21:27:31.981129] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:27:31.984546] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T21:27:32.485833] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T21:27:32.647763] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-07T21:27:33.447710] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-07T21:27:34.247732] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-07T21:27:34.839690] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T21:27:34.946016] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T21:27:35.047744] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-07T21:27:35.111071] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-07T21:27:35.699879] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T21:27:35.847681] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-07T21:27:36.647730] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-07T21:27:37.447688] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-07T21:27:37.645353] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T21:27:38.247611] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-07T21:27:38.339596] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T21:27:39.055459] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-07T21:27:39.080721] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-07T21:27:39.403577] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T21:27:39.847667] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-07T21:27:40.110712] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T21:27:40.647879] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-07T21:27:41.290214] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T21:27:41.447692] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-07T21:27:41.763548] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T21:27:42.247743] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-07T21:27:43.047704] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-07T21:27:43.759299] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-07T21:27:43.764393] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T21:27:43.812597] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T21:27:43.847618] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-07T21:27:44.647687] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-07T21:27:45.259608] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T21:27:45.447718] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-07T21:27:45.941420] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T21:27:45.986329] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-07T21:27:46.247675] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-07T21:27:47.047741] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-07T21:27:47.264176] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T21:27:47.847704] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-07T21:27:48.647709] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-07T21:27:49.373311] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-07T21:27:49.417540] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T21:27:49.447615] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-07T21:27:49.878178] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T21:27:50.247708] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-07T21:27:51.047702] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-07T21:27:51.360119] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T21:27:51.373263] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-07T21:27:51.374339] [INFO ] [REMOTE ] SFB: Full fetch complete (5824 records). [2025-10-07T21:27:51.374415] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-07T21:27:51.813847] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-07T21:27:51.813618] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-07T21:27:51.814020] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-07T21:27:51.827319] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-07T21:27:51.827768] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-07T21:27:51.828526] [DEBUG] [LOCAL ] SFB: Trimmed 5824 records to 4159 (keeping 200 days of data) [2025-10-07T21:27:51.849959] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-07T21:27:51.858825] [DEBUG] [LOCAL ] SFB: Primary data saved (4159 records). [2025-10-07T21:27:51.858908] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-07T21:27:51.859002] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SFB took 34.7s. Estimated remaining: 1h 6m 44s. Rate: 7.1 symbols/min [2025-10-07T21:27:52.054196] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:52.112852] [DEBUG] [LOCAL ] SFL: Loaded 45117 existing records from primary storage. [2025-10-07T21:27:52.113267] [INFO ] [MAIN ] SFL: Loaded 45117 existing records. [2025-10-07T21:27:52.301973] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:27:52.302299] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-07T21:27:52.302432] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-07T21:27:52.302871] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-07T21:27:52.302935] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-07T21:27:52.657342] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-07T21:27:52.706758] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:27:53.447759] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-07T21:27:53.800805] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T21:27:53.850741] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-07T21:27:54.247741] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-07T21:27:54.408311] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T21:27:54.412226] [INFO ] [REMOTE ] SF: Full fetch complete (59998 records). [2025-10-07T21:27:54.412425] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-07T21:27:54.823068] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-07T21:27:54.823177] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-07T21:27:54.824527] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-07T21:27:54.824611] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-07T21:27:54.826802] [DEBUG] [LOCAL ] SF: Trimmed 59998 records to 41637 (keeping 200 days of data) [2025-10-07T21:27:55.060802] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-07T21:27:55.119868] [DEBUG] [LOCAL ] SF: Primary data saved (41637 records). [2025-10-07T21:27:55.120061] [INFO ] [MAIN ] SF: Full history saved. [2025-10-07T21:27:55.120191] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SF took 38.6s. Estimated remaining: 1h 6m 34s. Rate: 7.1 symbols/min [2025-10-07T21:27:55.304015] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:55.365291] [DEBUG] [LOCAL ] SG: Loaded 53460 existing records from primary storage. [2025-10-07T21:27:55.365780] [INFO ] [MAIN ] SG: Loaded 53460 existing records. [2025-10-07T21:27:55.561386] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:27:55.561685] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-07T21:27:55.561750] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-07T21:27:55.562323] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-07T21:27:55.562386] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-07T21:27:55.856781] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-07T21:27:55.953866] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:27:56.321516] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-07T21:27:56.326267] [INFO ] [REMOTE ] SES: Full fetch complete (75433 records). [2025-10-07T21:27:56.326437] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-07T21:27:56.666486] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-07T21:27:56.780750] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-07T21:27:56.818692] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-07T21:27:56.824830] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T21:27:56.828067] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-07T21:27:56.829639] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T21:27:56.829935] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-07T21:27:56.849634] [DEBUG] [LOCAL ] SES: Trimmed 75433 records to 51568 (keeping 200 days of data) [2025-10-07T21:27:57.209423] [DEBUG] [LOCAL ] SES: Primary data saved (51568 records). [2025-10-07T21:27:57.209627] [INFO ] [MAIN ] SES: Full history saved. [2025-10-07T21:27:57.209795] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SES took 42.8s. Estimated remaining: 1h 6m 24s. Rate: 7.1 symbols/min [2025-10-07T21:27:57.443157] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:57.447740] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-07T21:27:57.494298] [DEBUG] [LOCAL ] SGHC: Loaded 46270 existing records from primary storage. [2025-10-07T21:27:57.494743] [INFO ] [MAIN ] SGHC: Loaded 46270 existing records. [2025-10-07T21:27:57.684443] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:27:57.684757] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-07T21:27:57.684816] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-07T21:27:57.685293] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-07T21:27:57.685355] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-07T21:27:58.051522] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:27:58.247747] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-07T21:27:58.635486] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T21:27:58.842038] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T21:27:58.925386] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T21:27:58.928013] [INFO ] [REMOTE ] SFBS: Full fetch complete (30328 records). [2025-10-07T21:27:58.928102] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-07T21:27:59.052771] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-07T21:27:59.341853] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-07T21:27:59.341983] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-07T21:27:59.342927] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-07T21:27:59.342994] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-07T21:27:59.345165] [DEBUG] [LOCAL ] SFBS: Trimmed 30328 records to 21147 (keeping 200 days of data) [2025-10-07T21:27:59.490007] [DEBUG] [LOCAL ] SFBS: Primary data saved (21147 records). [2025-10-07T21:27:59.490188] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-07T21:27:59.490323] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 28.3s. Estimated remaining: 1h 6m 14s. Rate: 7.1 symbols/min [2025-10-07T21:27:59.674440] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:27:59.674739] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-07T21:27:59.674792] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-07T21:27:59.674921] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-07T21:27:59.674966] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-07T21:27:59.675009] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-07T21:27:59.675043] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-07T21:27:59.857028] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-07T21:28:00.063061] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:28:00.583114] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T21:28:00.647686] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-07T21:28:01.447764] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-07T21:28:01.655835] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:28:01.656127] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-07T21:28:01.656219] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:28:01.656272] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-07T21:28:01.656337] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:28:01.656414] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-07T21:28:01.656482] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-07T21:28:01.656519] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-07T21:28:01.656617] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-07T21:28:01.656735] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SGI took 2.2s. Estimated remaining: 1h 6m 4s. Rate: 7.1 symbols/min [2025-10-07T21:28:01.874079] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:28:01.921409] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-07T21:28:01.947596] [DEBUG] [LOCAL ] SGU: Loaded 6656 existing records from primary storage. [2025-10-07T21:28:01.947979] [INFO ] [MAIN ] SGU: Loaded 6656 existing records. [2025-10-07T21:28:02.148085] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:28:02.149002] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-07T21:28:02.149151] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-07T21:28:02.149476] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-07T21:28:02.149537] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-07T21:28:02.251312] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-07T21:28:02.349261] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T21:28:02.574028] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:28:03.047749] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-07T21:28:03.852872] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-07T21:28:03.881943] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T21:28:04.603827] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T21:28:04.647680] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-07T21:28:05.447624] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-07T21:28:05.481154] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T21:28:06.118821] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T21:28:06.120287] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T21:28:06.247610] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-07T21:28:06.864003] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-07T21:28:07.047665] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-07T21:28:07.847708] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-07T21:28:08.647724] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-07T21:28:08.685330] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T21:28:09.447634] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-07T21:28:09.524814] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T21:28:10.129227] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-07T21:28:10.247633] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-07T21:28:10.468752] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T21:28:10.802354] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T21:28:11.047735] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-07T21:28:11.847741] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-07T21:28:12.647692] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-07T21:28:12.691848] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T21:28:13.447627] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-07T21:28:13.594468] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T21:28:13.634501] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-07T21:28:14.247640] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-07T21:28:14.869344] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T21:28:14.954851] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T21:28:15.047606] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-07T21:28:15.847682] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-07T21:28:16.650307] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-07T21:28:16.659148] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T21:28:17.275606] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T21:28:17.452725] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-07T21:28:17.469613] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T21:28:18.247724] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-07T21:28:19.047716] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-07T21:28:19.513415] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-07T21:28:19.585701] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T21:28:19.817994] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T21:28:19.847629] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-07T21:28:20.586089] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T21:28:20.647618] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-07T21:28:21.359597] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T21:28:21.447716] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-07T21:28:22.247735] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-07T21:28:23.047695] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-07T21:28:23.347677] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T21:28:23.513872] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:28:23.515255] [INFO ] [REMOTE ] SGU: Full fetch complete (9019 records). [2025-10-07T21:28:23.515847] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-07T21:28:23.848923] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-07T21:28:23.979377] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-07T21:28:23.979613] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-07T21:28:23.980127] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-07T21:28:24.009829] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-07T21:28:24.014000] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T21:28:24.014198] [DEBUG] [LOCAL ] SGU: Trimmed 9019 records to 6620 (keeping 200 days of data) [2025-10-07T21:28:24.082408] [DEBUG] [LOCAL ] SGU: Primary data saved (6620 records). [2025-10-07T21:28:24.082605] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-07T21:28:24.082792] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SGU took 22.4s. Estimated remaining: 1h 5m 59s. Rate: 7.1 symbols/min [2025-10-07T21:28:24.279461] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:28:24.327495] [DEBUG] [LOCAL ] SHAK: Loaded 48933 existing records from primary storage. [2025-10-07T21:28:24.327900] [INFO ] [MAIN ] SHAK: Loaded 48933 existing records. [2025-10-07T21:28:24.500489] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:28:24.500769] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-07T21:28:24.500820] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-07T21:28:24.501073] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-07T21:28:24.501131] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-07T21:28:24.652916] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-07T21:28:24.903783] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:28:25.390469] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T21:28:25.447728] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-07T21:28:26.247717] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-07T21:28:26.491455] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T21:28:27.016836] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T21:28:27.047625] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-07T21:28:27.847637] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-07T21:28:27.907291] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T21:28:28.647634] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-07T21:28:28.680800] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T21:28:29.447677] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-07T21:28:29.615593] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T21:28:30.247707] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-07T21:28:30.641508] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T21:28:31.048994] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-07T21:28:31.054237] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T21:28:31.847623] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-07T21:28:31.992843] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T21:28:32.647628] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-07T21:28:33.048248] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-07T21:28:33.136476] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T21:28:33.447707] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-07T21:28:34.090452] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T21:28:34.094218] [INFO ] [REMOTE ] SGHC: Full fetch complete (64138 records). [2025-10-07T21:28:34.094327] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-07T21:28:34.252775] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-07T21:28:34.503277] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-07T21:28:34.503367] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-07T21:28:34.504289] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-07T21:28:34.504355] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-07T21:28:34.505685] [DEBUG] [LOCAL ] SGHC: Trimmed 64138 records to 46419 (keeping 200 days of data) [2025-10-07T21:28:34.787454] [DEBUG] [LOCAL ] SGHC: Primary data saved (46419 records). [2025-10-07T21:28:34.787614] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-07T21:28:34.787755] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGHC took 37.6s. Estimated remaining: 1h 5m 51s. Rate: 7.1 symbols/min [2025-10-07T21:28:34.925985] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T21:28:34.969756] [INFO ] [REMOTE ] SG: Full fetch complete (77305 records). [2025-10-07T21:28:34.972047] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-07T21:28:34.991236] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:28:35.054588] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-07T21:28:35.285292] [DEBUG] [LOCAL ] SHCO: Loaded 25527 existing records from primary storage. [2025-10-07T21:28:35.311368] [INFO ] [MAIN ] SHCO: Loaded 25527 existing records. [2025-10-07T21:28:35.564952] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-07T21:28:35.576278] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-07T21:28:35.591113] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-07T21:28:35.607350] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T21:28:35.607701] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-07T21:28:35.606402] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:28:35.611004] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-07T21:28:35.611727] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-07T21:28:35.612278] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-07T21:28:35.612242] [INFO ] [REMOTE ] SFL: Full fetch complete (65638 records). [2025-10-07T21:28:35.612722] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-07T21:28:35.612639] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-07T21:28:35.612547] [DEBUG] [LOCAL ] SG: Trimmed 77305 records to 53472 (keeping 200 days of data) [2025-10-07T21:28:36.423682] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:28:36.449243] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-07T21:28:36.500065] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-07T21:28:36.500482] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-07T21:28:36.502681] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-07T21:28:36.503560] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-07T21:28:36.513729] [DEBUG] [LOCAL ] SFL: Trimmed 65638 records to 45130 (keeping 200 days of data) [2025-10-07T21:28:36.897608] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T21:28:36.916165] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-07T21:28:37.047616] [DEBUG] [LOCAL ] SG: Primary data saved (53472 records). [2025-10-07T21:28:37.049319] [INFO ] [MAIN ] SG: Full history saved. [2025-10-07T21:28:37.049868] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SG took 41.9s. Estimated remaining: 1h 5m 41s. Rate: 7.1 symbols/min [2025-10-07T21:28:37.272317] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:28:37.278462] [DEBUG] [LOCAL ] SFL: Primary data saved (45130 records). [2025-10-07T21:28:37.278630] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-07T21:28:37.278832] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SFL took 45.4s. Estimated remaining: 1h 5m 31s. Rate: 7.1 symbols/min [2025-10-07T21:28:37.476523] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:28:37.497349] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-10-07T21:28:37.497925] [INFO ] [MAIN ] SHEL: Loaded 53672 existing records. [2025-10-07T21:28:37.708388] [DEBUG] [LOCAL ] SHG: Loaded 26257 existing records from primary storage. [2025-10-07T21:28:37.706504] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:28:37.709016] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-07T21:28:37.709169] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-07T21:28:37.715695] [INFO ] [MAIN ] SHG: Loaded 26257 existing records. [2025-10-07T21:28:37.737310] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-07T21:28:37.737524] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-07T21:28:37.769449] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T21:28:37.826399] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-07T21:28:38.178118] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:28:38.222341] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-07T21:28:38.222475] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-07T21:28:38.248379] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-07T21:28:38.248582] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-07T21:28:38.430571] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:28:38.436306] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-07T21:28:38.717714] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:28:38.754015] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T21:28:39.047680] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-07T21:28:39.156719] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T21:28:39.847636] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-07T21:28:40.332698] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T21:28:40.407517] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T21:28:40.647748] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-07T21:28:41.343632] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T21:28:41.447676] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-07T21:28:41.678846] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T21:28:42.247703] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-07T21:28:42.893865] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T21:28:43.047636] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-07T21:28:43.507142] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T21:28:43.847706] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-07T21:28:44.647625] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-07T21:28:45.060049] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T21:28:45.105136] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-07T21:28:45.447756] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-07T21:28:46.004022] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T21:28:46.247689] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-07T21:28:47.047611] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-07T21:28:47.162395] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T21:28:47.449744] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T21:28:47.847630] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-07T21:28:48.109392] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T21:28:48.647694] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-07T21:28:49.447636] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-07T21:28:49.535504] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-07T21:28:49.638078] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T21:28:50.247693] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-07T21:28:51.047619] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-07T21:28:51.307902] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T21:28:51.441436] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T21:28:51.847699] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-07T21:28:52.058689] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T21:28:52.647744] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-07T21:28:53.175300] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T21:28:53.447691] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-07T21:28:54.247674] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-07T21:28:54.513982] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T21:28:55.047675] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-07T21:28:55.142805] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T21:28:55.598865] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T21:28:55.847671] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-07T21:28:55.887867] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-07T21:28:56.647788] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-07T21:28:57.188617] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T21:28:57.192764] [INFO ] [REMOTE ] SHAK: Full fetch complete (70681 records). [2025-10-07T21:28:57.192953] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-07T21:28:57.357871] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T21:28:57.404376] [INFO ] [REMOTE ] SHCO: Full fetch complete (37967 records). [2025-10-07T21:28:57.426916] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-07T21:28:57.455410] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-07T21:28:58.020470] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-07T21:28:58.020662] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-07T21:28:58.021873] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-07T21:28:58.027720] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-07T21:28:58.097513] [DEBUG] [LOCAL ] SHAK: Trimmed 70681 records to 48936 (keeping 200 days of data) [2025-10-07T21:28:58.113457] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-07T21:28:58.113550] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-07T21:28:58.113933] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-07T21:28:58.114056] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-07T21:28:58.115215] [DEBUG] [LOCAL ] SHCO: Trimmed 37967 records to 25498 (keeping 200 days of data) [2025-10-07T21:28:58.250936] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-07T21:28:58.368626] [DEBUG] [LOCAL ] SHCO: Primary data saved (25498 records). [2025-10-07T21:28:58.369837] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-07T21:28:58.370240] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SHCO took 23.6s. Estimated remaining: 1h 5m 26s. Rate: 7.1 symbols/min [2025-10-07T21:28:58.643813] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:28:58.694716] [DEBUG] [LOCAL ] SHO: Loaded 49635 existing records from primary storage. [2025-10-07T21:28:58.695771] [INFO ] [MAIN ] SHO: Loaded 49635 existing records. [2025-10-07T21:28:58.933500] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:28:58.936295] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-07T21:28:58.936989] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-07T21:28:58.937924] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-07T21:28:58.938985] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-07T21:28:58.991719] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T21:28:59.048544] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-07T21:28:59.177699] [DEBUG] [LOCAL ] SHAK: Primary data saved (48936 records). [2025-10-07T21:28:59.215156] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-07T21:28:59.231274] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHAK took 35.1s. Estimated remaining: 1h 5m 15s. Rate: 7.1 symbols/min [2025-10-07T21:28:59.476984] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:28:59.509720] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:28:59.516605] [DEBUG] [LOCAL ] SHOC: Loaded 3381 existing records from primary storage. [2025-10-07T21:28:59.516857] [INFO ] [MAIN ] SHOC: Loaded 3381 existing records. [2025-10-07T21:28:59.699490] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:28:59.699771] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-07T21:28:59.699885] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-07T21:28:59.700078] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-07T21:28:59.700134] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-07T21:28:59.857227] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-07T21:29:00.087637] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:29:00.218785] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T21:29:00.523826] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-07T21:29:00.647709] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-07T21:29:01.432411] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T21:29:01.447604] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-07T21:29:02.023197] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T21:29:02.247741] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-07T21:29:02.988187] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T21:29:03.047610] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-07T21:29:03.309576] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T21:29:03.847737] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-07T21:29:04.470604] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T21:29:04.647753] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-07T21:29:05.396698] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T21:29:05.447771] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-07T21:29:05.684481] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T21:29:06.198196] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T21:29:06.247616] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-07T21:29:06.879100] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T21:29:07.047627] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-07T21:29:07.847682] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-07T21:29:08.652774] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-07T21:29:08.665713] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T21:29:09.447681] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-07T21:29:09.920823] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-07T21:29:09.922263] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T21:29:10.247683] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-07T21:29:10.985512] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T21:29:11.047617] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-07T21:29:11.152989] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T21:29:11.847723] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-07T21:29:12.448730] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T21:29:12.652309] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-07T21:29:12.660397] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T21:29:13.447730] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-07T21:29:13.563583] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T21:29:13.566092] [INFO ] [REMOTE ] SHG: Full fetch complete (40959 records). [2025-10-07T21:29:13.566201] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-07T21:29:13.873269] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-07T21:29:13.968015] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-07T21:29:13.968117] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-07T21:29:13.969739] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-07T21:29:13.969809] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-07T21:29:13.970984] [DEBUG] [LOCAL ] SHG: Trimmed 40959 records to 26280 (keeping 200 days of data) [2025-10-07T21:29:14.152715] [DEBUG] [LOCAL ] SHG: Primary data saved (26280 records). [2025-10-07T21:29:14.152941] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-07T21:29:14.153085] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHG took 36.9s. Estimated remaining: 1h 5m 8s. Rate: 7.1 symbols/min [2025-10-07T21:29:14.252954] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-07T21:29:14.333089] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:29:14.393814] [DEBUG] [LOCAL ] SHW: Loaded 50294 existing records from primary storage. [2025-10-07T21:29:14.394320] [INFO ] [MAIN ] SHW: Loaded 50294 existing records. [2025-10-07T21:29:14.589539] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:29:14.589844] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-07T21:29:14.589898] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-07T21:29:14.590508] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-07T21:29:14.590568] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-07T21:29:14.969026] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:29:15.047688] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-07T21:29:15.847735] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-07T21:29:16.365092] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-07T21:29:16.588414] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-07T21:29:16.621336] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T21:29:16.647633] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-07T21:29:17.447742] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-07T21:29:18.247621] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-07T21:29:18.437305] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-07T21:29:18.814328] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-07T21:29:19.047675] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-07T21:29:19.087620] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T21:29:19.847710] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-07T21:29:20.647741] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-07T21:29:21.147696] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-07T21:29:21.447751] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-07T21:29:21.629414] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T21:29:22.164752] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T21:29:22.247617] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-07T21:29:23.047682] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-07T21:29:23.238170] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T21:29:23.590503] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-07T21:29:23.847616] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-07T21:29:23.974696] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T21:29:24.647737] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-07T21:29:25.447739] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-07T21:29:25.489620] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T21:29:25.494106] [INFO ] [REMOTE ] SHEL: Full fetch complete (77694 records). [2025-10-07T21:29:25.494277] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-07T21:29:25.891932] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-07T21:29:25.892040] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-07T21:29:25.893074] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-07T21:29:25.893139] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-07T21:29:25.895850] [DEBUG] [LOCAL ] SHEL: Trimmed 77694 records to 53672 (keeping 200 days of data) [2025-10-07T21:29:26.256530] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-07T21:29:26.275282] [DEBUG] [LOCAL ] SHEL: Primary data saved (53672 records). [2025-10-07T21:29:26.275147] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T21:29:26.275459] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-07T21:29:26.279284] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHEL took 49.2s. Estimated remaining: 1h 5m 1s. Rate: 7.1 symbols/min [2025-10-07T21:29:26.457089] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:29:26.457312] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-07T21:29:26.457350] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-07T21:29:26.457460] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-07T21:29:26.457518] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-07T21:29:26.457600] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-07T21:29:26.457661] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-07T21:29:26.811832] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:29:26.821989] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T21:29:27.047691] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-07T21:29:27.624345] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-07T21:29:27.847754] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-07T21:29:28.072047] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T21:29:28.075996] [INFO ] [REMOTE ] SHO: Full fetch complete (71008 records). [2025-10-07T21:29:28.076147] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-07T21:29:28.336529] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T21:29:28.390773] [INFO ] [REMOTE ] SHOC: Full fetch complete (7205 records). [2025-10-07T21:29:28.398756] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-07T21:29:28.673557] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-07T21:29:28.709164] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-07T21:29:28.654435] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-07T21:29:28.710625] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-07T21:29:28.727009] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-07T21:29:28.811389] [DEBUG] [LOCAL ] SHO: Trimmed 71008 records to 49629 (keeping 200 days of data) [2025-10-07T21:29:28.941424] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-07T21:29:28.968268] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-07T21:29:28.968473] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-07T21:29:28.968853] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-07T21:29:28.970378] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:29:28.971699] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-07T21:29:28.975433] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:29:28.976290] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-07T21:29:28.976755] [DEBUG] [LOCAL ] SHOC: Trimmed 7205 records to 3365 (keeping 200 days of data) [2025-10-07T21:29:28.977150] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:29:28.978451] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-07T21:29:28.979608] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-07T21:29:28.980813] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-07T21:29:28.992013] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-07T21:29:28.992388] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SI took 2.7s. Estimated remaining: 1h 4m 51s. Rate: 7.1 symbols/min [2025-10-07T21:29:29.109625] [DEBUG] [LOCAL ] SHOC: Primary data saved (3365 records). [2025-10-07T21:29:29.115872] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-07T21:29:29.126850] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHOC took 29.9s. Estimated remaining: 1h 4m 41s. Rate: 7.1 symbols/min [2025-10-07T21:29:29.223788] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:29:29.373343] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:29:29.418190] [DEBUG] [LOCAL ] SID: Loaded 42284 existing records from primary storage. [2025-10-07T21:29:29.421756] [INFO ] [MAIN ] SID: Loaded 42284 existing records. [2025-10-07T21:29:29.502046] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-07T21:29:29.652239] [DEBUG] [LOCAL ] SIG: Loaded 45999 existing records from primary storage. [2025-10-07T21:29:29.687997] [INFO ] [MAIN ] SIG: Loaded 45999 existing records. [2025-10-07T21:29:29.792318] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:29:29.792605] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-07T21:29:29.793037] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-07T21:29:29.806708] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-07T21:29:29.807096] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-07T21:29:30.022449] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:29:30.039129] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-07T21:29:30.050158] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-07T21:29:30.069283] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-07T21:29:30.127238] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-07T21:29:30.429823] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:29:30.456367] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-07T21:29:30.731290] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:29:30.748525] [DEBUG] [LOCAL ] SHO: Primary data saved (49629 records). [2025-10-07T21:29:30.748705] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-07T21:29:30.748810] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHO took 32.4s. Estimated remaining: 1h 4m 30s. Rate: 7.1 symbols/min [2025-10-07T21:29:30.918183] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:29:30.940631] [DEBUG] [LOCAL ] SII: Loaded 23694 existing records from primary storage. [2025-10-07T21:29:30.940962] [INFO ] [MAIN ] SII: Loaded 23694 existing records. [2025-10-07T21:29:31.052891] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-07T21:29:31.116808] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:29:31.117005] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-07T21:29:31.117055] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-07T21:29:31.117713] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-07T21:29:31.117772] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-07T21:29:31.473786] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:29:31.506466] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T21:29:31.847618] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-07T21:29:32.154070] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T21:29:32.515125] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T21:29:32.647629] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-07T21:29:33.447619] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-07T21:29:33.725889] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T21:29:34.247710] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-07T21:29:34.318305] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T21:29:34.395530] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T21:29:35.047684] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-07T21:29:35.847668] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-07T21:29:35.911901] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T21:29:36.647694] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-07T21:29:36.725569] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T21:29:36.983979] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T21:29:37.447680] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-07T21:29:38.247687] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-07T21:29:38.473477] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T21:29:39.047718] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-07T21:29:39.280783] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T21:29:39.650619] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T21:29:39.847688] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-07T21:29:40.456175] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T21:29:40.647702] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-07T21:29:41.447629] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-07T21:29:41.673935] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T21:29:42.210855] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T21:29:42.247609] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-07T21:29:42.328853] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T21:29:43.047708] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-07T21:29:43.482842] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T21:29:43.847708] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-07T21:29:44.647624] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-07T21:29:44.818103] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T21:29:45.350323] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T21:29:45.447613] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-07T21:29:46.247692] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-07T21:29:46.607878] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T21:29:46.921507] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T21:29:47.047604] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-07T21:29:47.847623] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-07T21:29:47.926018] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T21:29:48.275984] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T21:29:48.647832] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-07T21:29:48.766095] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T21:29:49.447711] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-07T21:29:50.247702] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-07T21:29:50.330928] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T21:29:50.373915] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T21:29:51.047687] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-07T21:29:51.519206] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-07T21:29:51.847715] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-07T21:29:52.647611] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-07T21:29:52.682546] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T21:29:53.340974] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T21:29:53.344863] [INFO ] [REMOTE ] SHW: Full fetch complete (73034 records). [2025-10-07T21:29:53.344978] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-07T21:29:53.448946] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-07T21:29:53.747346] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-07T21:29:53.747524] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-07T21:29:53.748599] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-07T21:29:53.748725] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-07T21:29:53.752406] [DEBUG] [LOCAL ] SHW: Trimmed 73034 records to 50318 (keeping 200 days of data) [2025-10-07T21:29:53.867822] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T21:29:54.105211] [DEBUG] [LOCAL ] SHW: Primary data saved (50318 records). [2025-10-07T21:29:54.105359] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-07T21:29:54.105445] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SHW took 40.0s. Estimated remaining: 1h 4m 26s. Rate: 7.1 symbols/min [2025-10-07T21:29:54.252844] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-07T21:29:54.281411] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:29:54.315922] [DEBUG] [LOCAL ] SILA: Loaded 30652 existing records from primary storage. [2025-10-07T21:29:54.316250] [INFO ] [MAIN ] SILA: Loaded 30652 existing records. [2025-10-07T21:29:54.504614] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:29:54.504928] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-07T21:29:54.504977] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-07T21:29:54.505281] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-07T21:29:54.505337] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-07T21:29:54.877034] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:29:54.999106] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T21:29:55.047685] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-07T21:29:55.380907] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T21:29:55.847717] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-07T21:29:56.453539] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T21:29:56.611328] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T21:29:56.647636] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-07T21:29:57.447671] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-07T21:29:57.830838] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-07T21:29:58.247713] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-07T21:29:58.685850] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T21:29:59.047626] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-07T21:29:59.363322] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T21:29:59.847693] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-07T21:30:00.330518] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T21:30:00.334342] [INFO ] [REMOTE ] SID: Full fetch complete (60822 records). [2025-10-07T21:30:00.334459] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-07T21:30:00.657353] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-07T21:30:00.770204] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-07T21:30:00.770373] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-07T21:30:00.772111] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-07T21:30:00.772184] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-07T21:30:00.774129] [DEBUG] [LOCAL ] SID: Trimmed 60822 records to 42365 (keeping 200 days of data) [2025-10-07T21:30:01.007553] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T21:30:01.066848] [DEBUG] [LOCAL ] SID: Primary data saved (42365 records). [2025-10-07T21:30:01.067041] [INFO ] [MAIN ] SID: Full history saved. [2025-10-07T21:30:01.067188] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SID took 32.1s. Estimated remaining: 1h 4m 17s. Rate: 7.1 symbols/min [2025-10-07T21:30:01.240246] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:30:01.282777] [DEBUG] [LOCAL ] SITC: Loaded 41598 existing records from primary storage. [2025-10-07T21:30:01.283198] [INFO ] [MAIN ] SITC: Loaded 41598 existing records. [2025-10-07T21:30:01.448200] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-07T21:30:01.494687] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:30:01.495389] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-07T21:30:01.495458] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-07T21:30:01.495759] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-07T21:30:01.495820] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-07T21:30:01.967696] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:30:01.992451] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T21:30:02.247705] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-07T21:30:03.047730] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-07T21:30:03.292029] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T21:30:03.357427] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T21:30:03.847730] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-07T21:30:04.647636] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-07T21:30:04.762852] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T21:30:05.242196] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T21:30:05.447729] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-07T21:30:05.903947] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T21:30:05.907592] [INFO ] [REMOTE ] SIG: Full fetch complete (67881 records). [2025-10-07T21:30:05.907774] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-07T21:30:06.250079] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-07T21:30:06.303379] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T21:30:06.370846] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-07T21:30:06.371051] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-07T21:30:06.372401] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-07T21:30:06.370523] [INFO ] [REMOTE ] SII: Full fetch complete (30415 records). [2025-10-07T21:30:06.372580] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-07T21:30:06.372783] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-07T21:30:06.375331] [DEBUG] [LOCAL ] SIG: Trimmed 67881 records to 45878 (keeping 200 days of data) [2025-10-07T21:30:06.917380] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-07T21:30:06.918394] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-07T21:30:06.920779] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-07T21:30:06.921756] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-07T21:30:06.926976] [DEBUG] [LOCAL ] SII: Trimmed 30415 records to 23648 (keeping 200 days of data) [2025-10-07T21:30:07.050582] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-07T21:30:07.242087] [DEBUG] [LOCAL ] SII: Primary data saved (23648 records). [2025-10-07T21:30:07.242902] [INFO ] [MAIN ] SII: Full history saved. [2025-10-07T21:30:07.243385] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 36.5s. Estimated remaining: 1h 4m 8s. Rate: 7.1 symbols/min [2025-10-07T21:30:07.437014] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:30:07.520695] [DEBUG] [LOCAL ] SITE: Loaded 35180 existing records from primary storage. [2025-10-07T21:30:07.522381] [INFO ] [MAIN ] SITE: Loaded 35180 existing records. [2025-10-07T21:30:07.629465] [DEBUG] [LOCAL ] SIG: Primary data saved (45878 records). [2025-10-07T21:30:07.629758] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-07T21:30:07.631512] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SIG took 38.5s. Estimated remaining: 1h 3m 57s. Rate: 7.1 symbols/min [2025-10-07T21:30:07.713699] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:30:07.714254] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-07T21:30:07.714503] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-07T21:30:07.715437] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-07T21:30:07.715501] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-07T21:30:07.865736] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T21:30:07.935414] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-07T21:30:08.129879] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:30:08.592496] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T21:30:08.647748] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-07T21:30:09.425825] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T21:30:09.447613] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-07T21:30:09.928910] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-07T21:30:10.247689] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-07T21:30:10.825076] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T21:30:11.047750] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-07T21:30:11.632238] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T21:30:11.847707] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-07T21:30:12.232576] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T21:30:12.647733] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-07T21:30:13.225013] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T21:30:13.447739] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-07T21:30:13.918473] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T21:30:14.247808] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-07T21:30:15.009941] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T21:30:15.010911] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T21:30:15.023955] [INFO ] [REMOTE ] SILA: Full fetch complete (44744 records). [2025-10-07T21:30:15.024190] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-07T21:30:15.060209] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-07T21:30:15.431106] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-07T21:30:15.431206] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-07T21:30:15.432555] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-07T21:30:15.432688] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-07T21:30:15.433962] [DEBUG] [LOCAL ] SILA: Trimmed 44744 records to 30664 (keeping 200 days of data) [2025-10-07T21:30:15.644811] [DEBUG] [LOCAL ] SILA: Primary data saved (30664 records). [2025-10-07T21:30:15.645026] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-07T21:30:15.645142] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 21.5s. Estimated remaining: 1h 3m 49s. Rate: 7.1 symbols/min [2025-10-07T21:30:15.847707] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-07T21:30:16.665634] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T21:30:16.674542] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-07T21:30:17.466632] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T21:30:17.476179] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-07T21:30:17.855767] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T21:30:18.247749] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-07T21:30:19.043202] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T21:30:19.052571] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-07T21:30:19.252509] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T21:30:19.847712] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-07T21:30:20.101350] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T21:30:20.647622] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-07T21:30:21.123236] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T21:30:21.447754] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-07T21:30:21.934173] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T21:30:22.247727] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-07T21:30:22.888471] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T21:30:23.047718] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-07T21:30:23.863492] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T21:30:23.875044] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-07T21:30:24.615090] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T21:30:24.647752] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-07T21:30:25.422779] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T21:30:25.447773] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-07T21:30:25.800194] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T21:30:26.247750] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-07T21:30:26.720799] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T21:30:27.047726] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-07T21:30:27.185714] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T21:30:27.188915] [INFO ] [REMOTE ] SITE: Full fetch complete (49894 records). [2025-10-07T21:30:27.189051] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-07T21:30:27.585272] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-07T21:30:27.585385] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-07T21:30:27.586231] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-07T21:30:27.586298] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-07T21:30:27.587758] [DEBUG] [LOCAL ] SITE: Trimmed 49894 records to 35237 (keeping 200 days of data) [2025-10-07T21:30:27.819110] [DEBUG] [LOCAL ] SITE: Primary data saved (35237 records). [2025-10-07T21:30:27.819299] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-07T21:30:27.819428] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SITE took 20.6s. Estimated remaining: 1h 3m 41s. Rate: 7.1 symbols/min [2025-10-07T21:30:28.289221] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T21:30:28.292584] [INFO ] [REMOTE ] SITC: Full fetch complete (60765 records). [2025-10-07T21:30:28.292721] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-07T21:30:28.669797] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-07T21:30:28.669919] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-07T21:30:28.670961] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-07T21:30:28.671031] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-07T21:30:28.672608] [DEBUG] [LOCAL ] SITC: Trimmed 60765 records to 41616 (keeping 200 days of data) [2025-10-07T21:30:28.930781] [DEBUG] [LOCAL ] SITC: Primary data saved (41616 records). [2025-10-07T21:30:28.931012] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-07T21:30:28.931151] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITC took 27.9s. Estimated remaining: 1h 3m 31s. Rate: 7.1 symbols/min [2025-10-07T21:30:29.483548] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:30:29.531849] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:30:29.618931] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:30:29.644429] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:30:29.665237] [DEBUG] [LOCAL ] SJT: Loaded 22376 existing records from primary storage. [2025-10-07T21:30:29.668164] [INFO ] [MAIN ] SJT: Loaded 22376 existing records. [2025-10-07T21:30:29.729708] [DEBUG] [LOCAL ] SKIL: Loaded 6442 existing records from primary storage. [2025-10-07T21:30:29.745099] [INFO ] [MAIN ] SKIL: Loaded 6442 existing records. [2025-10-07T21:30:29.985001] [DEBUG] [LOCAL ] SKE: Loaded 36125 existing records from primary storage. [2025-10-07T21:30:29.999715] [INFO ] [MAIN ] SKE: Loaded 36125 existing records. [2025-10-07T21:30:30.008241] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:30:30.057181] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-07T21:30:30.088309] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-07T21:30:30.157399] [DEBUG] [LOCAL ] SJM: Loaded 50126 existing records from primary storage. [2025-10-07T21:30:30.172065] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-07T21:30:30.210134] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:30:30.216214] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-07T21:30:30.216607] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-07T21:30:30.216412] [INFO ] [MAIN ] SJM: Loaded 50126 existing records. [2025-10-07T21:30:30.265474] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-07T21:30:30.413158] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-07T21:30:30.531784] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:30:30.523710] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-07T21:30:30.568213] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-07T21:30:30.618735] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-07T21:30:30.647236] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-07T21:30:30.648500] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-07T21:30:30.782091] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:30:30.806207] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-07T21:30:30.818098] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-07T21:30:30.888040] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-07T21:30:30.984226] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-07T21:30:31.915669] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:30:31.904049] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:30:31.953631] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-07T21:30:31.957032] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-07T21:30:32.137877] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:30:32.149221] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-07T21:30:32.181779] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:30:32.182176] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-07T21:30:32.794492] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T21:30:32.797211] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-07T21:30:32.962894] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T21:30:32.968629] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-07T21:30:33.503272] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T21:30:33.510799] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-07T21:30:33.573753] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T21:30:33.581415] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-07T21:30:33.769305] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T21:30:33.834142] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T21:30:34.229575] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-07T21:30:34.247607] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-07T21:30:34.768726] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T21:30:34.981749] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T21:30:35.047687] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-07T21:30:35.566210] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-07T21:30:35.847684] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-07T21:30:36.428013] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T21:30:36.647631] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-07T21:30:37.447695] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-07T21:30:38.192202] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T21:30:38.253381] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-07T21:30:38.256202] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T21:30:39.047667] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-07T21:30:39.070596] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T21:30:39.847743] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-07T21:30:40.149503] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-07T21:30:40.647699] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-07T21:30:41.446237] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T21:30:41.457689] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-07T21:30:41.969304] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-07T21:30:42.078314] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T21:30:42.247883] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-07T21:30:43.047742] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-07T21:30:43.847732] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-07T21:30:44.010347] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T21:30:44.137362] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T21:30:44.625056] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T21:30:44.647615] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-07T21:30:45.337908] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:30:45.339339] [INFO ] [REMOTE ] SKIL: Full fetch complete (10093 records). [2025-10-07T21:30:45.339415] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-07T21:30:45.452888] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-07T21:30:45.704935] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-07T21:30:45.705031] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-07T21:30:45.705281] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-07T21:30:45.705319] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-07T21:30:45.705838] [DEBUG] [LOCAL ] SKIL: Trimmed 10093 records to 6496 (keeping 200 days of data) [2025-10-07T21:30:45.747134] [DEBUG] [LOCAL ] SKIL: Primary data saved (6496 records). [2025-10-07T21:30:45.747310] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-07T21:30:45.747406] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SKIL took 16.8s. Estimated remaining: 1h 3m 25s. Rate: 7.1 symbols/min [2025-10-07T21:30:45.918021] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:30:45.932113] [DEBUG] [LOCAL ] SKLZ: Loaded 11641 existing records from primary storage. [2025-10-07T21:30:45.932439] [INFO ] [MAIN ] SKLZ: Loaded 11641 existing records. [2025-10-07T21:30:46.115552] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:30:46.115901] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-07T21:30:46.115960] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-07T21:30:46.116239] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-07T21:30:46.116299] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-07T21:30:46.260695] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-07T21:30:46.491979] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:30:47.047728] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-07T21:30:47.344223] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T21:30:47.384872] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T21:30:47.847702] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-07T21:30:48.406183] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T21:30:48.647772] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-07T21:30:49.067737] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-07T21:30:49.447755] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-07T21:30:50.088472] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T21:30:50.247687] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-07T21:30:51.047730] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-07T21:30:51.118156] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T21:30:51.645526] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T21:30:51.847624] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-07T21:30:52.202167] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T21:30:52.647723] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-07T21:30:52.706870] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-07T21:30:53.447754] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-07T21:30:54.003176] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T21:30:54.151099] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-07T21:30:54.247680] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-07T21:30:55.047705] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-07T21:30:55.247771] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-07T21:30:55.847758] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-07T21:30:56.538133] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T21:30:56.647719] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-07T21:30:57.435033] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T21:30:57.447591] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-07T21:30:57.694149] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T21:30:58.247620] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-07T21:30:58.380374] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T21:30:59.047621] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-07T21:30:59.455599] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-07T21:30:59.847736] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-07T21:31:00.370920] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T21:31:00.647728] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-07T21:31:00.755999] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-07T21:31:01.447701] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-07T21:31:02.247840] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-07T21:31:02.247756] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T21:31:02.325599] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T21:31:03.047629] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-07T21:31:03.340352] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-07T21:31:03.847724] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-07T21:31:04.452459] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T21:31:04.455887] [INFO ] [REMOTE ] SKE: Full fetch complete (50863 records). [2025-10-07T21:31:04.456084] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-07T21:31:04.652846] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-07T21:31:04.720674] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T21:31:04.888070] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-07T21:31:04.888162] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-07T21:31:04.889100] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-07T21:31:04.889167] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-07T21:31:04.890263] [DEBUG] [LOCAL ] SKE: Trimmed 50863 records to 36214 (keeping 200 days of data) [2025-10-07T21:31:05.125207] [DEBUG] [LOCAL ] SKE: Primary data saved (36214 records). [2025-10-07T21:31:05.125434] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-07T21:31:05.125637] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SKE took 36.2s. Estimated remaining: 1h 3m 19s. Rate: 7.1 symbols/min [2025-10-07T21:31:05.294759] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:31:05.342349] [DEBUG] [LOCAL ] SKM: Loaded 34925 existing records from primary storage. [2025-10-07T21:31:05.342726] [INFO ] [MAIN ] SKM: Loaded 34925 existing records. [2025-10-07T21:31:05.452794] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-07T21:31:05.524364] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:31:05.524756] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-07T21:31:05.524813] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-07T21:31:05.525084] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-07T21:31:05.525143] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-07T21:31:05.627901] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T21:31:05.645686] [INFO ] [REMOTE ] SJT: Full fetch complete (31967 records). [2025-10-07T21:31:05.656021] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-07T21:31:06.093052] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:31:06.256676] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-07T21:31:06.307721] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-07T21:31:06.307857] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-07T21:31:06.308571] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-07T21:31:06.308770] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-07T21:31:06.309975] [DEBUG] [LOCAL ] SJT: Trimmed 31967 records to 22383 (keeping 200 days of data) [2025-10-07T21:31:06.439132] [DEBUG] [LOCAL ] SJT: Primary data saved (22383 records). [2025-10-07T21:31:06.439295] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-07T21:31:06.439390] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SJT took 37.5s. Estimated remaining: 1h 3m 9s. Rate: 7.1 symbols/min [2025-10-07T21:31:06.570052] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T21:31:06.632629] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:31:06.679248] [DEBUG] [LOCAL ] SKT: Loaded 42500 existing records from primary storage. [2025-10-07T21:31:06.679610] [INFO ] [MAIN ] SKT: Loaded 42500 existing records. [2025-10-07T21:31:06.856730] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:31:06.857000] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-07T21:31:06.857048] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-07T21:31:06.857636] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-07T21:31:06.857734] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-07T21:31:07.053700] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-07T21:31:07.216488] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:31:07.640705] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T21:31:07.847729] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-07T21:31:08.074372] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T21:31:08.647739] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-07T21:31:09.303774] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T21:31:09.447740] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-07T21:31:09.813144] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T21:31:10.247678] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-07T21:31:10.310801] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-07T21:31:11.047703] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-07T21:31:11.671399] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T21:31:11.847720] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-07T21:31:12.318011] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T21:31:12.647734] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-07T21:31:13.305600] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:31:13.306966] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18677 records). [2025-10-07T21:31:13.307041] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-07T21:31:13.450735] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-07T21:31:13.693044] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-07T21:31:13.693299] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-07T21:31:13.693879] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-07T21:31:13.693971] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-07T21:31:13.694969] [DEBUG] [LOCAL ] SKLZ: Trimmed 18677 records to 11624 (keeping 200 days of data) [2025-10-07T21:31:13.800623] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T21:31:13.804337] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11624 records). [2025-10-07T21:31:13.804764] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-07T21:31:13.816769] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SKLZ took 28.1s. Estimated remaining: 1h 2m 60s. Rate: 7.1 symbols/min [2025-10-07T21:31:13.995664] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:31:14.035523] [DEBUG] [LOCAL ] SKY: Loaded 37908 existing records from primary storage. [2025-10-07T21:31:14.035946] [INFO ] [MAIN ] SKY: Loaded 37908 existing records. [2025-10-07T21:31:14.218837] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:31:14.219180] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-07T21:31:14.219236] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-07T21:31:14.220160] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-07T21:31:14.220220] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-07T21:31:14.252915] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-07T21:31:14.572130] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:31:14.887715] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T21:31:15.047742] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-07T21:31:15.847753] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-07T21:31:15.944016] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T21:31:16.647740] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-07T21:31:16.922893] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T21:31:17.396329] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T21:31:17.447703] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-07T21:31:17.857200] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T21:31:18.206942] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T21:31:18.247680] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-07T21:31:18.353925] [DEBUG] [REMOTE ] SKM: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-07T21:31:18.354289] [WARN ] [REMOTE ] SKM: No data returned for month 2025-05 [2025-10-07T21:31:18.354397] [FATAL] [REMOTE ] SKM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:31:18.354527] [FATAL] [MAIN ] SKM: Failed to fetch primary data. [2025-10-07T21:31:18.354613] [WARN ] [MAIN ] SKM: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:31:18.354745] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-07T21:31:18.354831] [DEBUG] [LOCAL ] SKM: No primary data file found to delete. [2025-10-07T21:31:18.354869] [INFO ] [LOCAL ] SKM: Starting deletion of derivative data. [2025-10-07T21:31:18.355178] [DEBUG] [LOCAL ] SKM: Deleted derivative data file. [2025-10-07T21:31:18.355330] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKM took 13.2s. Estimated remaining: 1h 2m 51s. Rate: 7.1 symbols/min [2025-10-07T21:31:18.525747] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:31:18.546333] [DEBUG] [LOCAL ] SKYH: Loaded 16590 existing records from primary storage. [2025-10-07T21:31:18.546688] [INFO ] [MAIN ] SKYH: Loaded 16590 existing records. [2025-10-07T21:31:18.724026] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:31:18.724340] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-07T21:31:18.724398] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-07T21:31:18.724584] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-07T21:31:18.724677] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-07T21:31:19.052805] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-07T21:31:19.092854] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:31:19.847697] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-07T21:31:20.577315] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T21:31:20.581376] [INFO ] [REMOTE ] SJM: Full fetch complete (72120 records). [2025-10-07T21:31:20.581509] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-07T21:31:20.656081] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-07T21:31:21.028502] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-07T21:31:21.028595] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-07T21:31:21.029592] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-07T21:31:21.029681] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-07T21:31:21.031190] [DEBUG] [LOCAL ] SJM: Trimmed 72120 records to 50142 (keeping 200 days of data) [2025-10-07T21:31:21.391112] [DEBUG] [LOCAL ] SJM: Primary data saved (50142 records). [2025-10-07T21:31:21.391348] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-07T21:31:21.391488] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SJM took 52.5s. Estimated remaining: 1h 2m 41s. Rate: 7.1 symbols/min [2025-10-07T21:31:21.454596] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-07T21:31:21.593276] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:31:21.596336] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T21:31:21.660203] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-07T21:31:21.660606] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-10-07T21:31:21.875667] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:31:21.876675] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-07T21:31:21.876756] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-07T21:31:21.877184] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-07T21:31:21.877243] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-07T21:31:22.235244] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:31:22.247597] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-07T21:31:22.370139] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T21:31:22.564061] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T21:31:23.047720] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-07T21:31:23.847742] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-07T21:31:23.926921] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T21:31:24.360209] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-07T21:31:24.647705] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-07T21:31:25.440631] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T21:31:25.450271] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-07T21:31:26.247639] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-07T21:31:26.308762] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T21:31:26.427711] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T21:31:27.047704] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-07T21:31:27.480290] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T21:31:27.847697] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-07T21:31:28.619091] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T21:31:28.647603] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-07T21:31:29.034541] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-07T21:31:29.447636] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-07T21:31:30.073272] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T21:31:30.247615] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-07T21:31:31.047623] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-07T21:31:31.122577] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:31:31.333217] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T21:31:31.847709] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-07T21:31:32.550196] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T21:31:32.647716] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-07T21:31:32.999766] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T21:31:33.447712] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-07T21:31:33.942277] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T21:31:34.247730] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-07T21:31:34.932882] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T21:31:35.047727] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-07T21:31:35.334301] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T21:31:35.847757] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-07T21:31:36.056085] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T21:31:36.647757] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-07T21:31:37.447633] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-07T21:31:37.924256] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T21:31:38.250689] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-07T21:31:38.257308] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T21:31:38.721899] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-07T21:31:39.047759] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-07T21:31:39.847747] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-07T21:31:40.492284] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T21:31:40.540249] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-07T21:31:40.647676] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-07T21:31:41.083452] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T21:31:41.086697] [INFO ] [REMOTE ] SKT: Full fetch complete (60521 records). [2025-10-07T21:31:41.086841] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-07T21:31:41.462706] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-07T21:31:41.466107] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-07T21:31:41.467408] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-07T21:31:41.468482] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-07T21:31:41.468728] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-07T21:31:41.474259] [DEBUG] [LOCAL ] SKT: Trimmed 60521 records to 42521 (keeping 200 days of data) [2025-10-07T21:31:41.740848] [DEBUG] [LOCAL ] SKT: Primary data saved (42521 records). [2025-10-07T21:31:41.741042] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-07T21:31:41.741148] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKT took 35.3s. Estimated remaining: 1h 2m 35s. Rate: 7.1 symbols/min [2025-10-07T21:31:41.919859] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:31:41.955339] [DEBUG] [LOCAL ] SLF: Loaded 38714 existing records from primary storage. [2025-10-07T21:31:41.955704] [INFO ] [MAIN ] SLF: Loaded 38714 existing records. [2025-10-07T21:31:42.139520] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:31:42.139976] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-07T21:31:42.140102] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-07T21:31:42.149801] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-07T21:31:42.155478] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-07T21:31:42.249667] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T21:31:42.249791] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-07T21:31:42.556297] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:31:42.570820] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T21:31:43.047723] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-07T21:31:43.847693] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-07T21:31:44.268279] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-07T21:31:44.435459] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T21:31:44.647775] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-07T21:31:45.382819] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T21:31:45.447735] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-07T21:31:46.188606] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T21:31:46.247671] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-07T21:31:46.354946] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T21:31:47.047753] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-07T21:31:47.769810] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T21:31:47.847613] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-07T21:31:48.017870] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T21:31:48.020840] [INFO ] [REMOTE ] SKY: Full fetch complete (54411 records). [2025-10-07T21:31:48.020954] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-07T21:31:48.402825] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-07T21:31:48.403000] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-07T21:31:48.403954] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-07T21:31:48.404020] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-07T21:31:48.405362] [DEBUG] [LOCAL ] SKY: Trimmed 54411 records to 38001 (keeping 200 days of data) [2025-10-07T21:31:48.644536] [DEBUG] [LOCAL ] SKY: Primary data saved (38001 records). [2025-10-07T21:31:48.644738] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-07T21:31:48.644838] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKY took 34.8s. Estimated remaining: 1h 2m 26s. Rate: 7.1 symbols/min [2025-10-07T21:31:48.656176] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-07T21:31:48.830998] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:31:48.836785] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T21:31:48.880938] [DEBUG] [LOCAL ] SLG: Loaded 45223 existing records from primary storage. [2025-10-07T21:31:48.881323] [INFO ] [MAIN ] SLG: Loaded 45223 existing records. [2025-10-07T21:31:49.057585] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:31:49.057893] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-07T21:31:49.057944] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-07T21:31:49.058192] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-07T21:31:49.058251] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-07T21:31:49.453036] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-07T21:31:49.459951] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:31:50.247715] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-07T21:31:50.836149] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-07T21:31:50.869044] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-07T21:31:50.996445] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T21:31:51.047683] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-07T21:31:51.847713] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-07T21:31:52.647634] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-07T21:31:52.649181] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T21:31:53.447634] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-07T21:31:53.541240] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T21:31:54.247685] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-07T21:31:54.353712] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T21:31:54.487534] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T21:31:55.047754] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-07T21:31:55.847710] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-07T21:31:55.938836] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T21:31:56.380767] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T21:31:56.384010] [INFO ] [REMOTE ] SKYH: Full fetch complete (22340 records). [2025-10-07T21:31:56.384265] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-07T21:31:56.652101] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-07T21:31:56.766160] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-07T21:31:56.766271] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-07T21:31:56.767006] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-07T21:31:56.767078] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-07T21:31:56.767697] [DEBUG] [LOCAL ] SKYH: Trimmed 22340 records to 16609 (keeping 200 days of data) [2025-10-07T21:31:56.869745] [DEBUG] [LOCAL ] SKYH: Primary data saved (16609 records). [2025-10-07T21:31:56.869904] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-07T21:31:56.869995] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKYH took 38.5s. Estimated remaining: 1h 2m 18s. Rate: 7.1 symbols/min [2025-10-07T21:31:57.039312] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:31:57.080168] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-07T21:31:57.123189] [DEBUG] [LOCAL ] SLGN: Loaded 40550 existing records from primary storage. [2025-10-07T21:31:57.123554] [INFO ] [MAIN ] SLGN: Loaded 40550 existing records. [2025-10-07T21:31:57.324780] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:31:57.325055] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-07T21:31:57.325140] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-07T21:31:57.325480] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-07T21:31:57.325541] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-07T21:31:57.450303] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-07T21:31:57.769822] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:31:58.247633] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-07T21:31:58.295410] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T21:31:59.047622] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-07T21:31:59.546968] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-07T21:31:59.831832] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T21:31:59.847605] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-07T21:32:00.291163] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T21:32:00.647676] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-07T21:32:01.447637] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-07T21:32:01.512668] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:32:02.133214] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T21:32:02.247869] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-07T21:32:03.047758] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-07T21:32:03.235728] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-07T21:32:03.239885] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-10-07T21:32:03.240084] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-07T21:32:03.695794] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T21:32:03.724603] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-07T21:32:03.724969] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-07T21:32:03.726674] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-07T21:32:03.727134] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-07T21:32:03.728966] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-10-07T21:32:03.847835] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-07T21:32:04.082190] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-10-07T21:32:04.082378] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-07T21:32:04.082489] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SLB took 42.7s. Estimated remaining: 1h 2m 9s. Rate: 7.1 symbols/min [2025-10-07T21:32:04.273426] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:32:04.273884] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-07T21:32:04.274074] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-07T21:32:04.274387] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-07T21:32:04.274539] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-07T21:32:04.274794] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-07T21:32:04.274951] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-07T21:32:04.430737] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T21:32:04.656996] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-07T21:32:04.698379] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:32:05.447772] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-07T21:32:05.576420] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T21:32:05.772912] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-07T21:32:06.158515] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T21:32:06.247636] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-07T21:32:06.596679] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T21:32:07.047730] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-07T21:32:07.397282] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-07T21:32:07.847703] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-07T21:32:08.647712] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-07T21:32:09.447743] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-07T21:32:09.512596] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T21:32:09.793490] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-07T21:32:10.035045] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T21:32:10.247705] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-07T21:32:10.579186] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-07T21:32:11.047721] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-07T21:32:11.847697] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-07T21:32:12.625157] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T21:32:12.647600] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-07T21:32:13.447632] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-07T21:32:13.487524] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T21:32:13.872170] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-07T21:32:14.245984] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T21:32:14.254554] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-07T21:32:15.047688] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-07T21:32:15.437573] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T21:32:15.440313] [INFO ] [REMOTE ] SLF: Full fetch complete (56338 records). [2025-10-07T21:32:15.440410] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-07T21:32:15.830077] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-07T21:32:15.830278] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-07T21:32:15.831179] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-07T21:32:15.831242] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-07T21:32:15.832601] [DEBUG] [LOCAL ] SLF: Trimmed 56338 records to 38723 (keeping 200 days of data) [2025-10-07T21:32:15.886336] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-07T21:32:16.073180] [DEBUG] [LOCAL ] SLF: Primary data saved (38723 records). [2025-10-07T21:32:16.073346] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-07T21:32:16.073524] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLF took 34.3s. Estimated remaining: 1h 2m 1s. Rate: 7.1 symbols/min [2025-10-07T21:32:16.244549] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:32:16.270370] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-07T21:32:16.288181] [DEBUG] [LOCAL ] SLQT: Loaded 43497 existing records from primary storage. [2025-10-07T21:32:16.288506] [INFO ] [MAIN ] SLQT: Loaded 43497 existing records. [2025-10-07T21:32:16.470044] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:32:16.470395] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-07T21:32:16.470636] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-07T21:32:16.471178] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-07T21:32:16.471240] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-07T21:32:16.562128] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T21:32:16.652717] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-07T21:32:16.861115] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:32:17.063070] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-07T21:32:17.447692] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-07T21:32:18.247703] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-07T21:32:19.047712] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-07T21:32:19.202904] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T21:32:19.374484] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-07T21:32:19.706695] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T21:32:19.847699] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-07T21:32:20.647707] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-07T21:32:21.447669] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-07T21:32:21.490747] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T21:32:22.176766] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T21:32:22.247682] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-07T21:32:22.846256] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T21:32:23.047675] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-07T21:32:23.372693] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-07T21:32:23.847631] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-07T21:32:23.884575] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T21:32:24.647676] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-07T21:32:25.452887] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-07T21:32:25.476260] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T21:32:26.257821] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-07T21:32:26.263445] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T21:32:26.518535] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-07T21:32:26.519318] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1049 records). [2025-10-07T21:32:26.519387] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-07T21:32:26.703040] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-07T21:32:26.703323] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:32:26.703396] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:32:26.703470] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-07T21:32:26.703541] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-07T21:32:26.703580] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-07T21:32:26.703637] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-07T21:32:26.703753] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLNZ took 22.6s. Estimated remaining: 1h 1m 53s. Rate: 7.1 symbols/min [2025-10-07T21:32:26.877733] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:32:26.906335] [DEBUG] [LOCAL ] SLVM: Loaded 28017 existing records from primary storage. [2025-10-07T21:32:26.906735] [INFO ] [MAIN ] SLVM: Loaded 28017 existing records. [2025-10-07T21:32:27.050351] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-07T21:32:27.124421] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:32:27.130685] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:32:27.140138] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-07T21:32:27.140199] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-07T21:32:27.140412] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-07T21:32:27.140827] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-07T21:32:27.557633] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:32:27.847691] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-07T21:32:28.652842] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-07T21:32:28.668619] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T21:32:29.029742] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T21:32:29.447706] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-07T21:32:29.908311] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T21:32:30.247719] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-07T21:32:31.057266] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-07T21:32:31.061156] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T21:32:31.329730] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T21:32:31.847695] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-07T21:32:32.627527] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T21:32:32.647613] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-07T21:32:32.716745] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-07T21:32:33.447740] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-07T21:32:33.910368] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T21:32:33.913832] [INFO ] [REMOTE ] SLGN: Full fetch complete (58671 records). [2025-10-07T21:32:33.914005] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-07T21:32:34.259711] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-07T21:32:34.315488] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-07T21:32:34.315611] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-07T21:32:34.316726] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-07T21:32:34.316794] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-07T21:32:34.318226] [DEBUG] [LOCAL ] SLGN: Trimmed 58671 records to 40559 (keeping 200 days of data) [2025-10-07T21:32:34.606243] [DEBUG] [LOCAL ] SLGN: Primary data saved (40559 records). [2025-10-07T21:32:34.606418] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-07T21:32:34.606591] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLGN took 37.7s. Estimated remaining: 1h 1m 45s. Rate: 7.1 symbols/min [2025-10-07T21:32:34.826048] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:32:34.907972] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T21:32:34.960136] [DEBUG] [LOCAL ] SM: Loaded 52319 existing records from primary storage. [2025-10-07T21:32:34.960523] [INFO ] [MAIN ] SM: Loaded 52319 existing records. [2025-10-07T21:32:35.053698] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-07T21:32:35.135954] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:32:35.136235] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-07T21:32:35.136286] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-07T21:32:35.136601] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-07T21:32:35.136696] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-07T21:32:35.522534] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:32:35.548470] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-07T21:32:35.848149] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-07T21:32:36.259106] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T21:32:36.647754] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-07T21:32:37.447770] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-07T21:32:37.579544] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-07T21:32:37.856555] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T21:32:37.860155] [INFO ] [REMOTE ] SLG: Full fetch complete (64984 records). [2025-10-07T21:32:37.860304] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-07T21:32:38.263470] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-07T21:32:38.286078] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-07T21:32:38.286156] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-07T21:32:38.287345] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-07T21:32:38.287455] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-07T21:32:38.289077] [DEBUG] [LOCAL ] SLG: Trimmed 64984 records to 45184 (keeping 200 days of data) [2025-10-07T21:32:38.585542] [DEBUG] [LOCAL ] SLG: Primary data saved (45184 records). [2025-10-07T21:32:38.585774] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-07T21:32:38.585938] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLG took 49.9s. Estimated remaining: 1h 1m 35s. Rate: 7.1 symbols/min [2025-10-07T21:32:38.761007] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:32:38.761301] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-07T21:32:38.761431] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-07T21:32:38.761870] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-07T21:32:38.762057] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-07T21:32:38.762242] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-07T21:32:38.778899] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-07T21:32:38.847659] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T21:32:39.052942] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-07T21:32:39.154539] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:32:39.847730] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-07T21:32:39.920550] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T21:32:40.050748] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:32:40.051257] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-07T21:32:40.051368] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:32:40.051460] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-07T21:32:40.051532] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:32:40.051611] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-07T21:32:40.051720] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-07T21:32:40.051774] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-07T21:32:40.051817] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-07T21:32:40.051869] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SMA took 1.5s. Estimated remaining: 1h 1m 25s. Rate: 7.1 symbols/min [2025-10-07T21:32:40.230491] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:32:40.230754] [DEBUG] [LOCAL ] SMBK: No existing data file found in primary storage. [2025-10-07T21:32:40.230803] [WARN ] [MAIN ] SMBK: No existing data found, performing full refresh instead. [2025-10-07T21:32:40.230918] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-07T21:32:40.230962] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-07T21:32:40.231003] [DEBUG] [LOCAL ] SMBK: No primary data file found to delete. [2025-10-07T21:32:40.231035] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-07T21:32:40.594275] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:32:40.640123] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T21:32:40.651004] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-07T21:32:41.447634] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-07T21:32:41.491954] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T21:32:42.247746] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-07T21:32:43.047737] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-07T21:32:43.130717] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T21:32:43.847628] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-07T21:32:43.957623] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T21:32:44.003947] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-07T21:32:44.647619] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-07T21:32:45.041387] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T21:32:45.447694] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-07T21:32:46.155794] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T21:32:46.247702] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-07T21:32:46.693741] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T21:32:47.047699] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-07T21:32:47.672287] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T21:32:47.847624] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-07T21:32:48.081475] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T21:32:48.647721] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-07T21:32:49.247180] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T21:32:49.446400] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T21:32:49.448746] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-07T21:32:50.247741] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-07T21:32:51.047701] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-07T21:32:51.240530] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T21:32:51.586589] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T21:32:51.847636] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-07T21:32:52.009567] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T21:32:52.013096] [INFO ] [REMOTE ] SLQT: Full fetch complete (63890 records). [2025-10-07T21:32:52.013274] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-07T21:32:52.429953] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-07T21:32:52.430057] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-07T21:32:52.431637] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-07T21:32:52.431732] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-07T21:32:52.433555] [DEBUG] [LOCAL ] SLQT: Trimmed 63890 records to 43504 (keeping 200 days of data) [2025-10-07T21:32:52.651367] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-07T21:32:52.699290] [DEBUG] [LOCAL ] SLQT: Primary data saved (43504 records). [2025-10-07T21:32:52.699455] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-07T21:32:52.699563] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLQT took 36.6s. Estimated remaining: 1h 1m 18s. Rate: 7.1 symbols/min [2025-10-07T21:32:52.865382] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:32:52.878919] [DEBUG] [LOCAL ] SMC: Loaded 11311 existing records from primary storage. [2025-10-07T21:32:52.879183] [INFO ] [MAIN ] SMC: Loaded 11311 existing records. [2025-10-07T21:32:53.054581] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:32:53.054838] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-07T21:32:53.054886] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-07T21:32:53.055165] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-07T21:32:53.055224] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-07T21:32:53.418265] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:32:53.447622] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-07T21:32:53.461695] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T21:32:53.667067] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T21:32:54.247781] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-07T21:32:54.249626] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T21:32:55.017919] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T21:32:55.047628] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-07T21:32:55.842725] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T21:32:55.847589] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-07T21:32:56.647752] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-07T21:32:56.688829] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T21:32:57.447756] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-07T21:32:58.247730] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-07T21:32:58.259034] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T21:32:58.396850] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T21:32:59.047742] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-07T21:32:59.382681] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T21:32:59.385373] [INFO ] [REMOTE ] SLVM: Full fetch complete (40186 records). [2025-10-07T21:32:59.385462] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-07T21:32:59.776781] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-07T21:32:59.776909] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-07T21:32:59.777725] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-07T21:32:59.777794] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-07T21:32:59.779057] [DEBUG] [LOCAL ] SLVM: Trimmed 40186 records to 27995 (keeping 200 days of data) [2025-10-07T21:32:59.848160] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-07T21:32:59.877785] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T21:32:59.974345] [DEBUG] [LOCAL ] SLVM: Primary data saved (27995 records). [2025-10-07T21:32:59.974552] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-07T21:32:59.974697] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SLVM took 33.3s. Estimated remaining: 1h 1m 9s. Rate: 7.1 symbols/min [2025-10-07T21:33:00.148661] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:33:00.196941] [DEBUG] [LOCAL ] SMFG: Loaded 48122 existing records from primary storage. [2025-10-07T21:33:00.197336] [INFO ] [MAIN ] SMFG: Loaded 48122 existing records. [2025-10-07T21:33:00.373983] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:33:00.374220] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-07T21:33:00.374271] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-07T21:33:00.374873] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-07T21:33:00.374934] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-07T21:33:00.652853] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-07T21:33:00.733123] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:33:01.447709] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-07T21:33:01.512770] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T21:33:01.771371] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-07T21:33:02.247693] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-07T21:33:03.047687] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-07T21:33:03.115446] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T21:33:03.164391] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T21:33:03.847756] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-07T21:33:04.636185] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T21:33:04.647594] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-07T21:33:04.901215] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-07T21:33:05.381476] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T21:33:05.447699] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-07T21:33:06.208622] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T21:33:06.247702] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-07T21:33:07.047694] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-07T21:33:07.847624] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-07T21:33:08.045854] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T21:33:08.395112] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T21:33:08.396342] [INFO ] [REMOTE ] SMBK: Full fetch complete (11809 records). [2025-10-07T21:33:08.396416] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-07T21:33:08.648846] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-07T21:33:08.796237] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-07T21:33:08.796896] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-07T21:33:08.797845] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T21:33:08.798177] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-07T21:33:08.807278] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-07T21:33:08.808420] [DEBUG] [LOCAL ] SMBK: Trimmed 11809 records to 8173 (keeping 200 days of data) [2025-10-07T21:33:08.860627] [DEBUG] [LOCAL ] SMBK: Primary data saved (8173 records). [2025-10-07T21:33:08.860782] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-07T21:33:08.860864] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SMBK took 28.8s. Estimated remaining: 1h 1m 1s. Rate: 7.1 symbols/min [2025-10-07T21:33:09.031469] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:33:09.072137] [DEBUG] [LOCAL ] SMG: Loaded 43667 existing records from primary storage. [2025-10-07T21:33:09.072463] [INFO ] [MAIN ] SMG: Loaded 43667 existing records. [2025-10-07T21:33:09.253172] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:33:09.253444] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-07T21:33:09.253538] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-07T21:33:09.254126] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-07T21:33:09.254208] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-07T21:33:09.455290] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-07T21:33:09.562096] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-07T21:33:09.633867] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:33:10.247713] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-07T21:33:11.047617] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-07T21:33:11.126453] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T21:33:11.131758] [INFO ] [REMOTE ] SM: Full fetch complete (75471 records). [2025-10-07T21:33:11.131895] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-07T21:33:11.527501] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-07T21:33:11.527594] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-07T21:33:11.528814] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-07T21:33:11.528883] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-07T21:33:11.530804] [DEBUG] [LOCAL ] SM: Trimmed 75471 records to 52319 (keeping 200 days of data) [2025-10-07T21:33:11.849560] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-07T21:33:11.873539] [DEBUG] [LOCAL ] SM: Primary data saved (52319 records). [2025-10-07T21:33:11.873923] [INFO ] [MAIN ] SM: Full history saved. [2025-10-07T21:33:11.874116] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SM took 37.3s. Estimated remaining: 1h 0m 51s. Rate: 7.1 symbols/min [2025-10-07T21:33:12.045843] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:33:12.071166] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T21:33:12.089793] [DEBUG] [LOCAL ] SMHI: Loaded 13105 existing records from primary storage. [2025-10-07T21:33:12.090032] [INFO ] [MAIN ] SMHI: Loaded 13105 existing records. [2025-10-07T21:33:12.272939] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:33:12.273214] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-07T21:33:12.273266] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-07T21:33:12.273482] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-07T21:33:12.273539] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-07T21:33:12.642856] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:33:12.653332] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-07T21:33:12.670802] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T21:33:12.686438] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T21:33:13.447615] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-07T21:33:13.918311] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T21:33:13.963639] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-07T21:33:14.247691] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-07T21:33:15.047692] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-07T21:33:15.847669] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-07T21:33:15.913462] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T21:33:16.102167] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T21:33:16.647700] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-07T21:33:17.341237] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T21:33:17.447716] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-07T21:33:18.247678] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-07T21:33:18.465404] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T21:33:19.054087] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-07T21:33:19.073043] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T21:33:19.233942] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T21:33:19.847716] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-07T21:33:20.467912] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T21:33:20.647735] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-07T21:33:20.857987] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T21:33:21.447702] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-07T21:33:22.247689] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-07T21:33:22.378549] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T21:33:22.584071] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T21:33:23.047748] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-07T21:33:23.793115] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T21:33:23.837498] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T21:33:23.847589] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-07T21:33:24.438906] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:33:24.440409] [INFO ] [REMOTE ] SMC: Full fetch complete (16457 records). [2025-10-07T21:33:24.440486] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-07T21:33:24.655025] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-07T21:33:24.813875] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-07T21:33:24.813971] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-07T21:33:24.814437] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-07T21:33:24.814479] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-07T21:33:24.815075] [DEBUG] [LOCAL ] SMC: Trimmed 16457 records to 11308 (keeping 200 days of data) [2025-10-07T21:33:24.888436] [DEBUG] [LOCAL ] SMC: Primary data saved (11308 records). [2025-10-07T21:33:24.888598] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-07T21:33:24.888728] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMC took 32.2s. Estimated remaining: 1h 0m 44s. Rate: 7.1 symbols/min [2025-10-07T21:33:25.057027] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:33:25.079493] [DEBUG] [LOCAL ] SMP: Loaded 19113 existing records from primary storage. [2025-10-07T21:33:25.079813] [INFO ] [MAIN ] SMP: Loaded 19113 existing records. [2025-10-07T21:33:25.252635] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:33:25.252904] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-07T21:33:25.252952] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-07T21:33:25.253246] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-07T21:33:25.253302] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-07T21:33:25.453999] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-07T21:33:25.615680] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:33:26.247668] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-07T21:33:26.431190] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T21:33:26.468484] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T21:33:27.047747] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-07T21:33:27.847674] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-07T21:33:27.931937] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T21:33:28.652750] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-07T21:33:28.670363] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T21:33:28.718314] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T21:33:29.447633] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-07T21:33:29.603753] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T21:33:30.247738] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-07T21:33:31.044082] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T21:33:31.055272] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-07T21:33:31.075234] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T21:33:31.847697] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-07T21:33:32.647758] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-07T21:33:32.699405] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T21:33:32.762768] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T21:33:33.447681] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-07T21:33:34.247690] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-07T21:33:34.301629] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T21:33:35.062733] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-07T21:33:35.095180] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T21:33:35.336171] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T21:33:35.847703] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-07T21:33:36.010600] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-07T21:33:36.647750] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-07T21:33:37.235465] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T21:33:37.240946] [INFO ] [REMOTE ] SMFG: Full fetch complete (69054 records). [2025-10-07T21:33:37.241092] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-07T21:33:37.450487] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-07T21:33:37.717764] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-07T21:33:37.717922] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-07T21:33:37.719606] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-07T21:33:37.719713] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-07T21:33:37.721884] [DEBUG] [LOCAL ] SMFG: Trimmed 69054 records to 48186 (keeping 200 days of data) [2025-10-07T21:33:38.051080] [DEBUG] [LOCAL ] SMFG: Primary data saved (48186 records). [2025-10-07T21:33:38.051355] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-07T21:33:38.051512] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMFG took 38.1s. Estimated remaining: 1h 0m 36s. Rate: 7.1 symbols/min [2025-10-07T21:33:38.244675] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:33:38.256723] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-07T21:33:38.276792] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T21:33:38.320445] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T21:33:38.344144] [DEBUG] [LOCAL ] SMR: Loaded 53798 existing records from primary storage. [2025-10-07T21:33:38.344582] [INFO ] [MAIN ] SMR: Loaded 53798 existing records. [2025-10-07T21:33:38.531785] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:33:38.532110] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-07T21:33:38.532175] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-07T21:33:38.532625] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-07T21:33:38.532722] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-07T21:33:38.938095] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:33:39.047722] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-07T21:33:39.433209] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T21:33:39.847710] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-07T21:33:40.498690] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T21:33:40.647715] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-07T21:33:41.078186] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-07T21:33:41.447696] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-07T21:33:42.247673] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-07T21:33:42.487502] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T21:33:42.748419] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T21:33:42.749837] [INFO ] [REMOTE ] SMHI: Full fetch complete (22486 records). [2025-10-07T21:33:42.749917] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-07T21:33:43.052798] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-07T21:33:43.142288] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-07T21:33:43.142390] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-07T21:33:43.142998] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-07T21:33:43.143065] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-07T21:33:43.143932] [DEBUG] [LOCAL ] SMHI: Trimmed 22486 records to 13095 (keeping 200 days of data) [2025-10-07T21:33:43.223127] [DEBUG] [LOCAL ] SMHI: Primary data saved (13095 records). [2025-10-07T21:33:43.223317] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-07T21:33:43.223420] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMHI took 31.3s. Estimated remaining: 1h 0m 27s. Rate: 7.1 symbols/min [2025-10-07T21:33:43.404506] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:33:43.444112] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-10-07T21:33:43.499365] [DEBUG] [LOCAL ] SMRT: Loaded 43940 existing records from primary storage. [2025-10-07T21:33:43.499786] [INFO ] [MAIN ] SMRT: Loaded 43940 existing records. [2025-10-07T21:33:43.674119] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:33:43.674365] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-07T21:33:43.674417] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-07T21:33:43.674810] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-07T21:33:43.674889] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-07T21:33:43.859594] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-07T21:33:44.041210] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:33:44.110038] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T21:33:44.647743] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-07T21:33:44.881660] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T21:33:44.884971] [INFO ] [REMOTE ] SMG: Full fetch complete (62709 records). [2025-10-07T21:33:44.885095] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-07T21:33:45.295683] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-07T21:33:45.295802] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-07T21:33:45.297073] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-07T21:33:45.297139] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-07T21:33:45.298989] [DEBUG] [LOCAL ] SMG: Trimmed 62709 records to 43653 (keeping 200 days of data) [2025-10-07T21:33:45.494575] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-07T21:33:45.597329] [DEBUG] [LOCAL ] SMG: Primary data saved (43653 records). [2025-10-07T21:33:45.597504] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-07T21:33:45.597605] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMG took 36.7s. Estimated remaining: 1h 0m 17s. Rate: 7.1 symbols/min [2025-10-07T21:33:45.778615] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:33:45.814903] [DEBUG] [LOCAL ] SMWB: Loaded 32296 existing records from primary storage. [2025-10-07T21:33:45.815350] [INFO ] [MAIN ] SMWB: Loaded 32296 existing records. [2025-10-07T21:33:46.009624] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:33:46.010243] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-07T21:33:46.010481] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-07T21:33:46.010891] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-07T21:33:46.010961] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-07T21:33:46.236824] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T21:33:46.253254] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-07T21:33:46.433506] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:33:47.047750] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-07T21:33:47.368931] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T21:33:47.847736] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-07T21:33:48.028914] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-07T21:33:48.410612] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-07T21:33:48.647689] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-07T21:33:48.914050] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T21:33:49.447726] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-07T21:33:50.247725] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-07T21:33:50.871989] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T21:33:51.039159] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-07T21:33:51.053684] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-07T21:33:51.313035] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T21:33:51.847737] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-07T21:33:52.532614] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T21:33:52.647718] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-07T21:33:53.280872] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T21:33:53.447719] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-07T21:33:54.247721] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-07T21:33:54.433786] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T21:33:54.867811] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-07T21:33:55.047710] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-07T21:33:55.673417] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T21:33:55.827633] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T21:33:55.829155] [INFO ] [REMOTE ] SMP: Full fetch complete (26174 records). [2025-10-07T21:33:55.829225] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-07T21:33:55.852883] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-07T21:33:56.224822] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-07T21:33:56.224920] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-07T21:33:56.225489] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-07T21:33:56.225531] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-07T21:33:56.226826] [DEBUG] [LOCAL ] SMP: Trimmed 26174 records to 19030 (keeping 200 days of data) [2025-10-07T21:33:56.344246] [DEBUG] [LOCAL ] SMP: Primary data saved (19030 records). [2025-10-07T21:33:56.344410] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-07T21:33:56.344499] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMP took 31.5s. Estimated remaining: 1h 0m 9s. Rate: 7.1 symbols/min [2025-10-07T21:33:56.508724] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:33:56.557695] [DEBUG] [LOCAL ] SN: Loaded 49897 existing records from primary storage. [2025-10-07T21:33:56.558059] [INFO ] [MAIN ] SN: Loaded 49897 existing records. [2025-10-07T21:33:56.653895] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-07T21:33:56.740451] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:33:56.740740] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-07T21:33:56.740817] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-07T21:33:56.741271] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-07T21:33:56.741330] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-07T21:33:57.098389] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:33:57.447700] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-07T21:33:58.087310] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-07T21:33:58.247682] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-07T21:33:58.298071] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-07T21:33:59.047681] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-07T21:33:59.204860] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T21:33:59.685736] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T21:33:59.847637] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-07T21:34:00.585945] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T21:34:00.647612] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-07T21:34:01.226482] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T21:34:01.447675] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-07T21:34:02.247762] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-07T21:34:02.301733] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T21:34:02.946198] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T21:34:03.047711] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-07T21:34:03.638362] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T21:34:03.847693] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-07T21:34:04.647716] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-07T21:34:05.447730] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-07T21:34:05.519688] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T21:34:05.753064] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-07T21:34:05.787465] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T21:34:06.247692] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-07T21:34:07.047686] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-07T21:34:07.094025] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T21:34:07.641400] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T21:34:07.847630] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-07T21:34:08.287716] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T21:34:08.647703] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-07T21:34:09.447677] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-07T21:34:09.501601] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T21:34:09.565132] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T21:34:09.568117] [INFO ] [REMOTE ] SMWB: Full fetch complete (49507 records). [2025-10-07T21:34:09.568374] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-07T21:34:09.945189] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-07T21:34:09.945331] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-07T21:34:09.946316] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-07T21:34:09.946435] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-07T21:34:09.947626] [DEBUG] [LOCAL ] SMWB: Trimmed 49507 records to 32300 (keeping 200 days of data) [2025-10-07T21:34:10.134049] [DEBUG] [LOCAL ] SMWB: Primary data saved (32300 records). [2025-10-07T21:34:10.134206] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-07T21:34:10.134308] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMWB took 24.5s. Estimated remaining: 1h 0m 2s. Rate: 7.1 symbols/min [2025-10-07T21:34:10.252787] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-07T21:34:10.307403] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:34:10.334736] [DEBUG] [LOCAL ] SNA: Loaded 25712 existing records from primary storage. [2025-10-07T21:34:10.335019] [INFO ] [MAIN ] SNA: Loaded 25712 existing records. [2025-10-07T21:34:10.514683] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:34:10.514913] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-07T21:34:10.514968] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-07T21:34:10.516078] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-07T21:34:10.516140] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-07T21:34:10.865154] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:34:11.047684] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-07T21:34:11.798402] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-07T21:34:11.847677] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-07T21:34:11.906977] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T21:34:12.056050] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T21:34:12.647710] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-07T21:34:13.447689] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-07T21:34:14.100311] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T21:34:14.247681] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-07T21:34:14.629605] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-07T21:34:15.047761] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-07T21:34:15.334344] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T21:34:15.545957] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T21:34:15.847694] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-07T21:34:16.211137] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T21:34:16.647720] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-07T21:34:17.447725] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-07T21:34:18.088785] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T21:34:18.195949] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-07T21:34:18.247637] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-07T21:34:18.899785] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T21:34:19.047743] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-07T21:34:19.847686] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-07T21:34:20.563359] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-07T21:34:20.634056] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T21:34:20.647600] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-07T21:34:21.268555] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T21:34:21.447709] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-07T21:34:21.881544] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T21:34:22.247751] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-07T21:34:22.386790] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T21:34:22.391243] [INFO ] [REMOTE ] SMRT: Full fetch complete (62169 records). [2025-10-07T21:34:22.391444] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-07T21:34:22.832796] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-07T21:34:22.832918] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-07T21:34:22.834536] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-07T21:34:22.834617] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-07T21:34:22.836439] [DEBUG] [LOCAL ] SMRT: Trimmed 62169 records to 44033 (keeping 200 days of data) [2025-10-07T21:34:23.071855] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-07T21:34:23.144680] [DEBUG] [LOCAL ] SMRT: Primary data saved (44033 records). [2025-10-07T21:34:23.144882] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-07T21:34:23.144997] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMRT took 39.9s. Estimated remaining: 59m 55s. Rate: 7.1 symbols/min [2025-10-07T21:34:23.325844] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:34:23.381820] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-07T21:34:23.382277] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-07T21:34:23.575598] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:34:23.575905] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-07T21:34:23.575958] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-07T21:34:23.576747] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-07T21:34:23.576813] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-07T21:34:23.858077] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-07T21:34:23.990033] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:34:24.023564] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T21:34:24.647770] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-07T21:34:25.142990] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T21:34:25.210718] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-07T21:34:25.214675] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-07T21:34:25.214831] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-07T21:34:25.453418] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-07T21:34:25.607946] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-07T21:34:25.608033] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-07T21:34:25.609183] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-07T21:34:25.609293] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-07T21:34:25.611127] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 53798 (keeping 200 days of data) [2025-10-07T21:34:25.936724] [DEBUG] [LOCAL ] SMR: Primary data saved (53798 records). [2025-10-07T21:34:25.936895] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-07T21:34:25.936986] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMR took 47.9s. Estimated remaining: 59m 45s. Rate: 7.1 symbols/min [2025-10-07T21:34:26.105079] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:34:26.111033] [DEBUG] [LOCAL ] SNDA: Loaded 4441 existing records from primary storage. [2025-10-07T21:34:26.111248] [INFO ] [MAIN ] SNDA: Loaded 4441 existing records. [2025-10-07T21:34:26.255418] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-07T21:34:26.285945] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:34:26.286137] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-07T21:34:26.286184] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-07T21:34:26.286464] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-07T21:34:26.286539] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-07T21:34:26.637617] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:34:26.660687] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-07T21:34:26.926970] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-07T21:34:27.047702] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-07T21:34:27.730110] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T21:34:27.847738] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-07T21:34:28.191782] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T21:34:28.647767] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-07T21:34:28.738313] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T21:34:29.447727] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-07T21:34:29.729996] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-07T21:34:29.929892] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T21:34:30.247714] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-07T21:34:31.047728] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-07T21:34:31.847778] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-07T21:34:31.996257] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T21:34:32.033965] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T21:34:32.036225] [INFO ] [REMOTE ] SNA: Full fetch complete (38798 records). [2025-10-07T21:34:32.036300] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-07T21:34:32.402266] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-07T21:34:32.402360] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-07T21:34:32.403354] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-07T21:34:32.403418] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-07T21:34:32.404382] [DEBUG] [LOCAL ] SNA: Trimmed 38798 records to 25689 (keeping 200 days of data) [2025-10-07T21:34:32.565505] [DEBUG] [LOCAL ] SNA: Primary data saved (25689 records). [2025-10-07T21:34:32.565682] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-07T21:34:32.565786] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SNA took 22.4s. Estimated remaining: 59m 36s. Rate: 7.1 symbols/min [2025-10-07T21:34:32.654122] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-07T21:34:32.735780] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:34:32.781558] [DEBUG] [LOCAL ] SNDR: Loaded 40957 existing records from primary storage. [2025-10-07T21:34:32.781997] [INFO ] [MAIN ] SNDR: Loaded 40957 existing records. [2025-10-07T21:34:32.966009] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:34:32.966324] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-07T21:34:32.966377] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-07T21:34:32.967222] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-07T21:34:32.967284] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-07T21:34:33.325603] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:34:33.447610] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-07T21:34:34.218513] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-07T21:34:34.247677] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-07T21:34:34.453727] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T21:34:34.882615] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T21:34:35.003712] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T21:34:35.047623] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-07T21:34:35.847694] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-07T21:34:36.609966] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T21:34:36.647629] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-07T21:34:37.447740] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-07T21:34:37.854568] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-07T21:34:38.109112] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T21:34:38.247618] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-07T21:34:38.880115] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T21:34:38.887574] [INFO ] [REMOTE ] SN: Full fetch complete (71197 records). [2025-10-07T21:34:38.887939] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-07T21:34:39.059044] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-07T21:34:39.356926] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-07T21:34:39.357620] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-07T21:34:39.358890] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-07T21:34:39.358963] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-07T21:34:39.360837] [DEBUG] [LOCAL ] SN: Trimmed 71197 records to 49906 (keeping 200 days of data) [2025-10-07T21:34:39.685195] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T21:34:39.714909] [DEBUG] [LOCAL ] SN: Primary data saved (49906 records). [2025-10-07T21:34:39.715089] [INFO ] [MAIN ] SN: Full history saved. [2025-10-07T21:34:39.715184] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SN took 43.4s. Estimated remaining: 59m 27s. Rate: 7.1 symbols/min [2025-10-07T21:34:39.851860] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-07T21:34:39.841335] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-07T21:34:39.902957] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:34:39.945033] [DEBUG] [LOCAL ] SNN: Loaded 44125 existing records from primary storage. [2025-10-07T21:34:39.945373] [INFO ] [MAIN ] SNN: Loaded 44125 existing records. [2025-10-07T21:34:40.157963] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:34:40.158245] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-07T21:34:40.158295] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-07T21:34:40.158787] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-07T21:34:40.158847] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-07T21:34:40.501852] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:34:40.647612] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-07T21:34:41.447683] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-07T21:34:41.554473] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T21:34:42.086107] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-07T21:34:42.129807] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T21:34:42.247694] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-07T21:34:43.047697] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-07T21:34:43.847689] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-07T21:34:44.433751] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-07T21:34:44.640325] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T21:34:44.649840] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-07T21:34:45.355372] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T21:34:45.355165] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T21:34:45.447621] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-07T21:34:46.247723] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-07T21:34:46.932596] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T21:34:47.047704] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-07T21:34:47.687463] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T21:34:47.847630] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-07T21:34:48.653522] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-07T21:34:48.665536] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T21:34:49.286229] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T21:34:49.423812] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T21:34:49.447607] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-07T21:34:50.247709] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-07T21:34:51.047636] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-07T21:34:51.213052] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T21:34:51.726375] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-07T21:34:51.752041] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T21:34:51.847697] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-07T21:34:52.485119] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-07T21:34:52.647696] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-07T21:34:53.447685] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-07T21:34:54.211128] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T21:34:54.247683] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-07T21:34:54.867174] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-07T21:34:55.047701] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-07T21:34:55.098916] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T21:34:55.847748] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-07T21:34:56.314863] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T21:34:56.318723] [INFO ] [REMOTE ] SNDR: Full fetch complete (59516 records). [2025-10-07T21:34:56.318905] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-07T21:34:56.434603] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:34:56.449755] [INFO ] [REMOTE ] SNDA: Full fetch complete (7852 records). [2025-10-07T21:34:56.480829] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-07T21:34:56.652856] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-07T21:34:56.941680] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-07T21:34:56.999580] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-07T21:34:57.042258] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-07T21:34:57.060089] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-07T21:34:57.096817] [DEBUG] [LOCAL ] SNDR: Trimmed 59516 records to 41045 (keeping 200 days of data) [2025-10-07T21:34:57.274784] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-07T21:34:57.276113] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-07T21:34:57.281086] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-07T21:34:57.281457] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-07T21:34:57.285853] [DEBUG] [LOCAL ] SNDA: Trimmed 7852 records to 4458 (keeping 200 days of data) [2025-10-07T21:34:57.406577] [DEBUG] [LOCAL ] SNDA: Primary data saved (4458 records). [2025-10-07T21:34:57.407220] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-07T21:34:57.434911] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNDA took 31.5s. Estimated remaining: 59m 21s. Rate: 7.1 symbols/min [2025-10-07T21:34:57.494320] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-07T21:34:57.656536] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:34:57.672629] [DEBUG] [LOCAL ] SNDR: Primary data saved (41045 records). [2025-10-07T21:34:57.672945] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-07T21:34:57.673063] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNDR took 25.1s. Estimated remaining: 59m 11s. Rate: 7.1 symbols/min [2025-10-07T21:34:57.863832] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:34:57.910263] [DEBUG] [LOCAL ] SNOW: Loaded 53593 existing records from primary storage. [2025-10-07T21:34:57.910994] [INFO ] [MAIN ] SNOW: Loaded 53593 existing records. [2025-10-07T21:34:58.136440] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:34:58.138090] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-07T21:34:58.138184] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-07T21:34:58.140371] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-07T21:34:58.140706] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-07T21:34:58.140572] [DEBUG] [LOCAL ] SNV: Loaded 48866 existing records from primary storage. [2025-10-07T21:34:58.185677] [INFO ] [MAIN ] SNV: Loaded 48866 existing records. [2025-10-07T21:34:58.592616] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:34:58.632387] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-07T21:34:58.651186] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-07T21:34:58.664787] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-07T21:34:58.691577] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-07T21:34:58.775051] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:34:58.811629] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-07T21:34:58.817466] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-07T21:34:59.056246] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-07T21:34:59.199495] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:34:59.847741] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-07T21:34:59.950005] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-07T21:35:00.635095] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T21:35:00.647593] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-07T21:35:01.365254] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-07T21:35:01.447708] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-07T21:35:01.570880] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T21:35:02.247714] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-07T21:35:02.304266] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T21:35:03.047710] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-07T21:35:03.736835] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-07T21:35:03.847625] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-07T21:35:04.000369] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T21:35:04.621408] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T21:35:04.647622] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-07T21:35:05.447714] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-07T21:35:06.018247] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T21:35:06.021493] [INFO ] [REMOTE ] SNN: Full fetch complete (63053 records). [2025-10-07T21:35:06.021616] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-07T21:35:06.254764] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-07T21:35:06.482600] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-07T21:35:06.536982] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-07T21:35:06.537574] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-07T21:35:06.538874] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-07T21:35:06.538943] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-07T21:35:06.542831] [DEBUG] [LOCAL ] SNN: Trimmed 63053 records to 44165 (keeping 200 days of data) [2025-10-07T21:35:06.839587] [DEBUG] [LOCAL ] SNN: Primary data saved (44165 records). [2025-10-07T21:35:06.839801] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-07T21:35:06.839946] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNN took 27.1s. Estimated remaining: 59m 2s. Rate: 7.1 symbols/min [2025-10-07T21:35:07.041831] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:35:07.047760] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-07T21:35:07.099819] [DEBUG] [LOCAL ] SNX: Loaded 40138 existing records from primary storage. [2025-10-07T21:35:07.100286] [INFO ] [MAIN ] SNX: Loaded 40138 existing records. [2025-10-07T21:35:07.288193] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:35:07.288523] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-07T21:35:07.288587] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-07T21:35:07.288901] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-07T21:35:07.289012] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-07T21:35:07.665866] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:35:07.852459] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-07T21:35:07.877587] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-07T21:35:07.953357] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T21:35:08.647777] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-07T21:35:09.136498] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-07T21:35:09.457143] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-07T21:35:09.463741] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T21:35:10.247635] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-07T21:35:10.455372] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T21:35:11.047750] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-07T21:35:11.847752] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-07T21:35:11.904767] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-07T21:35:11.947794] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T21:35:12.647746] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-07T21:35:13.358544] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-07T21:35:13.455933] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-07T21:35:13.464260] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T21:35:14.247708] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-07T21:35:14.692263] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-07T21:35:15.047785] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-07T21:35:15.847665] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-07T21:35:16.112421] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T21:35:16.170285] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-07T21:35:16.647727] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-07T21:35:17.027521] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T21:35:17.062734] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T21:35:17.447779] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-07T21:35:18.247698] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-07T21:35:18.333472] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T21:35:19.047758] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-07T21:35:19.181553] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T21:35:19.847729] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-07T21:35:20.645179] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-07T21:35:20.656099] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-07T21:35:20.954632] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T21:35:21.447628] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-07T21:35:21.602159] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T21:35:22.247683] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-07T21:35:23.006478] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-07T21:35:23.047736] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-07T21:35:23.555221] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-07T21:35:23.694604] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T21:35:23.847709] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-07T21:35:24.647730] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-07T21:35:25.047922] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-07T21:35:25.447620] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-07T21:35:25.555480] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-07T21:35:26.247681] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-07T21:35:26.375877] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T21:35:26.553098] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T21:35:27.047775] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-07T21:35:27.847769] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-07T21:35:28.431055] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-07T21:35:28.435016] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-10-07T21:35:28.435179] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-07T21:35:28.656310] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-07T21:35:28.852636] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-07T21:35:28.852818] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-07T21:35:28.854228] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-07T21:35:28.854324] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-07T21:35:28.857320] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 53796 (keeping 200 days of data) [2025-10-07T21:35:28.891597] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-07T21:35:29.232453] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-07T21:35:29.232597] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-07T21:35:29.232728] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNAP took 1m 6s. Estimated remaining: 58m 57s. Rate: 7.1 symbols/min [2025-10-07T21:35:29.456950] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-07T21:35:29.456825] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:35:29.453095] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T21:35:29.519387] [DEBUG] [LOCAL ] SO: Loaded 53607 existing records from primary storage. [2025-10-07T21:35:29.519838] [INFO ] [MAIN ] SO: Loaded 53607 existing records. [2025-10-07T21:35:29.701670] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:35:29.701913] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-07T21:35:29.701989] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-07T21:35:29.702588] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-07T21:35:29.702686] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-07T21:35:30.060256] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:35:30.247612] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-07T21:35:30.857881] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T21:35:30.861821] [INFO ] [REMOTE ] SNV: Full fetch complete (71279 records). [2025-10-07T21:35:30.861997] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-07T21:35:31.047823] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-07T21:35:31.053188] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-07T21:35:31.320927] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-07T21:35:31.321036] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-07T21:35:31.322127] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-07T21:35:31.322214] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-07T21:35:31.323854] [DEBUG] [LOCAL ] SNV: Trimmed 71279 records to 48867 (keeping 200 days of data) [2025-10-07T21:35:31.636556] [DEBUG] [LOCAL ] SNV: Primary data saved (48867 records). [2025-10-07T21:35:31.636764] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-07T21:35:31.636874] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNV took 34.0s. Estimated remaining: 58m 47s. Rate: 7.1 symbols/min [2025-10-07T21:35:31.815815] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:35:31.855373] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-07T21:35:31.859065] [DEBUG] [LOCAL ] SOBO: Loaded 39388 existing records from primary storage. [2025-10-07T21:35:31.859585] [INFO ] [MAIN ] SOBO: Loaded 39388 existing records. [2025-10-07T21:35:32.050753] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T21:35:32.104491] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:35:32.104756] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-07T21:35:32.104813] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-07T21:35:32.105292] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-07T21:35:32.105351] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-07T21:35:32.494938] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:35:32.532082] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T21:35:32.647729] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-07T21:35:33.447699] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-07T21:35:33.813697] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-07T21:35:33.818295] [INFO ] [REMOTE ] SNOW: Full fetch complete (77652 records). [2025-10-07T21:35:33.818512] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-07T21:35:34.250492] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-07T21:35:34.255138] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-07T21:35:34.255322] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-07T21:35:34.258604] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-07T21:35:34.259122] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-07T21:35:34.288435] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T21:35:34.298309] [DEBUG] [LOCAL ] SNOW: Trimmed 77652 records to 53593 (keeping 200 days of data) [2025-10-07T21:35:34.689514] [DEBUG] [LOCAL ] SNOW: Primary data saved (53593 records). [2025-10-07T21:35:34.689756] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-07T21:35:34.689872] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNOW took 37.2s. Estimated remaining: 58m 37s. Rate: 7.1 symbols/min [2025-10-07T21:35:34.881027] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:35:34.939541] [DEBUG] [LOCAL ] SOC: Loaded 50526 existing records from primary storage. [2025-10-07T21:35:34.940047] [INFO ] [MAIN ] SOC: Loaded 50526 existing records. [2025-10-07T21:35:35.051295] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-07T21:35:35.141000] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:35:35.141426] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-07T21:35:35.141673] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-07T21:35:35.142946] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-07T21:35:35.143016] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-07T21:35:35.531421] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:35:35.570443] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-07T21:35:35.595611] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T21:35:35.599270] [INFO ] [REMOTE ] SNX: Full fetch complete (57267 records). [2025-10-07T21:35:35.599446] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-07T21:35:35.853432] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-07T21:35:36.015758] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-07T21:35:36.015882] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-07T21:35:36.020524] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-07T21:35:36.020745] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-07T21:35:36.022820] [DEBUG] [LOCAL ] SNX: Trimmed 57267 records to 40068 (keeping 200 days of data) [2025-10-07T21:35:36.366985] [DEBUG] [LOCAL ] SNX: Primary data saved (40068 records). [2025-10-07T21:35:36.367178] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-07T21:35:36.367327] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNX took 29.5s. Estimated remaining: 58m 28s. Rate: 7.1 symbols/min [2025-10-07T21:35:36.633609] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:35:36.650066] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-07T21:35:36.677535] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T21:35:36.698831] [DEBUG] [LOCAL ] SOJC: Loaded 4991 existing records from primary storage. [2025-10-07T21:35:36.699233] [INFO ] [MAIN ] SOJC: Loaded 4991 existing records. [2025-10-07T21:35:36.951257] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:35:36.951567] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-07T21:35:36.951639] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-07T21:35:36.951931] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-07T21:35:36.952005] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-07T21:35:37.328822] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:35:37.447621] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-07T21:35:37.777926] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T21:35:38.252128] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T21:35:38.251233] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-07T21:35:38.453830] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T21:35:39.047744] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-07T21:35:39.661001] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:35:39.847707] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-07T21:35:40.271497] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T21:35:40.565793] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T21:35:40.647632] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-07T21:35:41.224608] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-07T21:35:41.447762] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-07T21:35:42.247736] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-07T21:35:42.938211] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-07T21:35:42.967503] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T21:35:43.047615] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-07T21:35:43.749878] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T21:35:43.847670] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-07T21:35:44.510091] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-07T21:35:44.647677] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-07T21:35:45.447735] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-07T21:35:46.247731] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-07T21:35:46.529063] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T21:35:47.047632] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-07T21:35:47.130808] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T21:35:47.470205] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T21:35:47.847731] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-07T21:35:48.647700] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-07T21:35:48.741034] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T21:35:49.238808] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T21:35:49.354242] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T21:35:49.447670] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-07T21:35:50.247739] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-07T21:35:51.007924] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:35:51.047614] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-07T21:35:51.472585] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-07T21:35:51.732947] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T21:35:51.847624] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-07T21:35:52.647705] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-07T21:35:53.447725] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-07T21:35:53.634689] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T21:35:54.247710] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-07T21:35:54.382897] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T21:35:54.827378] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T21:35:54.856420] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T21:35:55.047698] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-07T21:35:55.847755] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-07T21:35:56.412872] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T21:35:56.647627] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-07T21:35:56.848766] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T21:35:57.447709] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-07T21:35:57.861595] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-07T21:35:57.862469] [INFO ] [REMOTE ] SOJC: Full fetch complete (7688 records). [2025-10-07T21:35:57.862537] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-07T21:35:58.220279] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-07T21:35:58.220384] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-07T21:35:58.220597] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-07T21:35:58.220637] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-07T21:35:58.221083] [DEBUG] [LOCAL ] SOJC: Trimmed 7688 records to 4996 (keeping 200 days of data) [2025-10-07T21:35:58.247619] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-07T21:35:58.254211] [DEBUG] [LOCAL ] SOJC: Primary data saved (4996 records). [2025-10-07T21:35:58.254281] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-07T21:35:58.254368] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SOJC took 21.9s. Estimated remaining: 58m 22s. Rate: 7.1 symbols/min [2025-10-07T21:35:58.470722] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T21:35:59.047696] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-07T21:35:59.646569] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T21:35:59.847696] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-07T21:36:00.647726] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-07T21:36:01.052507] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T21:36:01.378419] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T21:36:01.447694] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-07T21:36:02.253622] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-07T21:36:02.270758] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T21:36:03.047632] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-07T21:36:03.189782] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T21:36:03.555539] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T21:36:03.558730] [INFO ] [REMOTE ] SOBO: Full fetch complete (58360 records). [2025-10-07T21:36:03.558837] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-07T21:36:03.852736] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-07T21:36:03.937174] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-07T21:36:03.937266] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-07T21:36:03.938309] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-07T21:36:03.938373] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-07T21:36:03.939722] [DEBUG] [LOCAL ] SOBO: Trimmed 58360 records to 39360 (keeping 200 days of data) [2025-10-07T21:36:04.187307] [DEBUG] [LOCAL ] SOBO: Primary data saved (39360 records). [2025-10-07T21:36:04.187503] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-07T21:36:04.187611] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SOBO took 32.6s. Estimated remaining: 58m 13s. Rate: 7.1 symbols/min [2025-10-07T21:36:04.989993] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-07T21:36:05.002330] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-07T21:36:05.482616] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T21:36:05.486495] [INFO ] [REMOTE ] SO: Full fetch complete (77594 records). [2025-10-07T21:36:05.486798] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-07T21:36:05.888897] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-07T21:36:05.889015] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-07T21:36:05.890194] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-07T21:36:05.890336] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-07T21:36:05.920027] [DEBUG] [LOCAL ] SO: Trimmed 77594 records to 53607 (keeping 200 days of data) [2025-10-07T21:36:05.921669] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-07T21:36:05.934246] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-07T21:36:06.268376] [DEBUG] [LOCAL ] SO: Primary data saved (53607 records). [2025-10-07T21:36:06.268567] [INFO ] [MAIN ] SO: Full history saved. [2025-10-07T21:36:06.268688] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SO took 37.0s. Estimated remaining: 58m 3s. Rate: 7.1 symbols/min [2025-10-07T21:36:07.770728] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T21:36:07.781862] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-07T21:36:09.735821] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T21:36:09.748507] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-07T21:36:11.330569] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-07T21:36:11.334338] [INFO ] [REMOTE ] SOC: Full fetch complete (71733 records). [2025-10-07T21:36:11.334463] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-07T21:36:11.724733] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-07T21:36:11.724853] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-07T21:36:11.725899] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-07T21:36:11.725967] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-07T21:36:11.727502] [DEBUG] [LOCAL ] SOC: Trimmed 71733 records to 50620 (keeping 200 days of data) [2025-10-07T21:36:12.026586] [DEBUG] [LOCAL ] SOC: Primary data saved (50620 records). [2025-10-07T21:36:12.026793] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-07T21:36:12.026921] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 37.3s. Estimated remaining: 57m 54s. Rate: 7.1 symbols/min [2025-10-07T21:36:12.709898] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:12.800160] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:12.795883] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:12.801499] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:12.800489] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-07T21:36:12.802327] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-07T21:36:12.802700] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-07T21:36:12.802788] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-07T21:36:12.802863] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-07T21:36:12.802915] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-07T21:36:12.918471] [DEBUG] [LOCAL ] SOJE: Loaded 9191 existing records from primary storage. [2025-10-07T21:36:12.934607] [DEBUG] [LOCAL ] SOJD: Loaded 13021 existing records from primary storage. [2025-10-07T21:36:12.963760] [INFO ] [MAIN ] SOJD: Loaded 13021 existing records. [2025-10-07T21:36:12.963443] [DEBUG] [LOCAL ] SOL: Loaded 12968 existing records from primary storage. [2025-10-07T21:36:12.969870] [INFO ] [MAIN ] SOL: Loaded 12968 existing records. [2025-10-07T21:36:12.982833] [INFO ] [MAIN ] SOJE: Loaded 9191 existing records. [2025-10-07T21:36:13.783111] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:13.816222] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:13.822457] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:13.825558] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:13.826615] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-07T21:36:13.826428] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-07T21:36:13.826954] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-07T21:36:13.826810] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-07T21:36:13.828096] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-07T21:36:13.822552] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-07T21:36:13.828217] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-07T21:36:13.828730] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-07T21:36:13.828602] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-07T21:36:13.828662] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-07T21:36:13.829211] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-07T21:36:13.829101] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-07T21:36:13.829152] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-07T21:36:14.142371] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:36:14.223279] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-07T21:36:14.228604] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:36:14.273936] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-07T21:36:14.300397] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:36:14.300611] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-07T21:36:14.309927] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-07T21:36:14.322508] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-07T21:36:14.420631] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-07T21:36:14.501688] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 2.5s. Estimated remaining: 57m 44s. Rate: 7.1 symbols/min [2025-10-07T21:36:15.054958] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:15.044841] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:15.087111] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-07T21:36:15.114292] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-07T21:36:15.108723] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:15.159066] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:15.160177] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-07T21:36:15.204688] [DEBUG] [LOCAL ] SOLV: Loaded 44006 existing records from primary storage. [2025-10-07T21:36:15.205158] [INFO ] [MAIN ] SOLV: Loaded 44006 existing records. [2025-10-07T21:36:15.390304] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:15.390600] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-07T21:36:15.390676] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-07T21:36:15.391572] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-07T21:36:15.391634] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-07T21:36:15.754798] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:15.755130] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-07T21:36:16.080497] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T21:36:16.085835] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-07T21:36:16.165033] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T21:36:16.170635] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-07T21:36:16.241776] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T21:36:16.246759] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-07T21:36:16.866292] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T21:36:16.869269] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-07T21:36:17.043322] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T21:36:17.052573] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-07T21:36:17.179575] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T21:36:17.183719] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-07T21:36:17.271014] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T21:36:17.276447] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-07T21:36:17.645780] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T21:36:17.648570] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-07T21:36:17.800429] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-07T21:36:18.243075] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-07T21:36:18.247603] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-07T21:36:18.448403] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T21:36:18.630750] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T21:36:19.047736] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-07T21:36:19.356419] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-07T21:36:19.847707] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-07T21:36:20.594535] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T21:36:20.611806] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T21:36:20.647627] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-07T21:36:21.447640] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-07T21:36:21.508785] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T21:36:21.557554] [DEBUG] [REMOTE ] SOLV: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-07T21:36:21.557992] [WARN ] [REMOTE ] SOLV: No data returned for month 2025-03 [2025-10-07T21:36:21.558109] [FATAL] [REMOTE ] SOLV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:36:21.558246] [FATAL] [MAIN ] SOLV: Failed to fetch primary data. [2025-10-07T21:36:21.558336] [WARN ] [MAIN ] SOLV: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:36:21.558434] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-07T21:36:21.558526] [DEBUG] [LOCAL ] SOLV: No primary data file found to delete. [2025-10-07T21:36:21.558565] [INFO ] [LOCAL ] SOLV: Starting deletion of derivative data. [2025-10-07T21:36:21.558930] [DEBUG] [LOCAL ] SOLV: Deleted derivative data file. [2025-10-07T21:36:21.559027] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOLV took 7.0s. Estimated remaining: 57m 36s. Rate: 7.1 symbols/min [2025-10-07T21:36:21.722095] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:21.761547] [DEBUG] [LOCAL ] SON: Loaded 43043 existing records from primary storage. [2025-10-07T21:36:21.761928] [INFO ] [MAIN ] SON: Loaded 43043 existing records. [2025-10-07T21:36:21.934967] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:21.935196] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-07T21:36:21.935254] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-07T21:36:21.936251] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-07T21:36:21.936311] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-07T21:36:22.252925] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-07T21:36:22.291301] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:23.047639] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-07T21:36:23.127500] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T21:36:23.669850] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T21:36:23.847681] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-07T21:36:24.647710] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-07T21:36:24.707088] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-07T21:36:25.447761] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-07T21:36:25.572262] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T21:36:26.247701] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-07T21:36:26.905437] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T21:36:27.047723] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-07T21:36:27.059463] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T21:36:27.847708] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-07T21:36:28.388285] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T21:36:28.647770] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-07T21:36:28.698587] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-07T21:36:29.447689] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-07T21:36:30.205583] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T21:36:30.247627] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-07T21:36:30.477333] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T21:36:31.047711] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-07T21:36:31.154494] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T21:36:31.847709] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-07T21:36:32.652760] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-07T21:36:32.655781] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T21:36:32.874858] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T21:36:33.447629] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-07T21:36:33.499685] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-07T21:36:34.003727] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T21:36:34.247716] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-07T21:36:35.027821] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T21:36:35.047597] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-07T21:36:35.661696] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T21:36:35.663075] [INFO ] [REMOTE ] SOJD: Full fetch complete (19579 records). [2025-10-07T21:36:35.663151] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-07T21:36:35.857110] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-07T21:36:36.026880] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-07T21:36:36.026962] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-07T21:36:36.027382] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-07T21:36:36.027423] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-07T21:36:36.027994] [DEBUG] [LOCAL ] SOJD: Trimmed 19579 records to 12988 (keeping 200 days of data) [2025-10-07T21:36:36.107693] [DEBUG] [LOCAL ] SOJD: Primary data saved (12988 records). [2025-10-07T21:36:36.107852] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-07T21:36:36.107955] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJD took 24.1s. Estimated remaining: 57m 29s. Rate: 7.1 symbols/min [2025-10-07T21:36:36.278500] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:36.333002] [DEBUG] [LOCAL ] SONY: Loaded 53364 existing records from primary storage. [2025-10-07T21:36:36.333374] [INFO ] [MAIN ] SONY: Loaded 53364 existing records. [2025-10-07T21:36:36.511947] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:36.512211] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-07T21:36:36.512260] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-07T21:36:36.512633] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-07T21:36:36.512727] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-07T21:36:36.654075] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-07T21:36:36.873230] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:37.447630] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-07T21:36:37.536287] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-07T21:36:37.651920] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T21:36:38.247745] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-07T21:36:38.335427] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T21:36:38.990201] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-07T21:36:39.047618] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-07T21:36:39.763102] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T21:36:39.847673] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-07T21:36:40.647753] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-07T21:36:41.391889] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T21:36:41.393502] [INFO ] [REMOTE ] SOL: Full fetch complete (21433 records). [2025-10-07T21:36:41.393573] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-07T21:36:41.456094] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-07T21:36:41.768278] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-07T21:36:41.768426] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-07T21:36:41.768991] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-07T21:36:41.769101] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-07T21:36:41.770168] [DEBUG] [LOCAL ] SOL: Trimmed 21433 records to 12966 (keeping 200 days of data) [2025-10-07T21:36:41.868734] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-07T21:36:41.897707] [DEBUG] [LOCAL ] SOL: Primary data saved (12966 records). [2025-10-07T21:36:41.897860] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-07T21:36:41.897951] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOL took 29.8s. Estimated remaining: 57m 20s. Rate: 7.1 symbols/min [2025-10-07T21:36:42.064256] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:42.068879] [DEBUG] [LOCAL ] SOR: Loaded 2872 existing records from primary storage. [2025-10-07T21:36:42.069060] [INFO ] [MAIN ] SOR: Loaded 2872 existing records. [2025-10-07T21:36:42.245220] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:42.245572] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-07T21:36:42.245637] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-07T21:36:42.245980] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-07T21:36:42.246040] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-07T21:36:42.257485] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-07T21:36:42.609711] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:43.015674] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T21:36:43.044605] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T21:36:43.047598] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-07T21:36:43.625711] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T21:36:43.627055] [INFO ] [REMOTE ] SOJE: Full fetch complete (14107 records). [2025-10-07T21:36:43.627138] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-07T21:36:43.852808] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-07T21:36:44.010716] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-07T21:36:44.010815] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-07T21:36:44.011187] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-07T21:36:44.011228] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-07T21:36:44.011777] [DEBUG] [LOCAL ] SOJE: Trimmed 14107 records to 9118 (keeping 200 days of data) [2025-10-07T21:36:44.066829] [DEBUG] [LOCAL ] SOJE: Primary data saved (9118 records). [2025-10-07T21:36:44.066982] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-07T21:36:44.067079] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOJE took 32.0s. Estimated remaining: 57m 10s. Rate: 7.1 symbols/min [2025-10-07T21:36:44.230301] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:44.242377] [DEBUG] [LOCAL ] SOS: Loaded 8998 existing records from primary storage. [2025-10-07T21:36:44.242619] [INFO ] [MAIN ] SOS: Loaded 8998 existing records. [2025-10-07T21:36:44.431690] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T21:36:44.431131] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:44.434680] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-07T21:36:44.434807] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-07T21:36:44.435039] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-07T21:36:44.435098] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-07T21:36:44.652973] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-07T21:36:44.790178] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:36:45.447706] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-07T21:36:46.216007] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:36:46.237362] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T21:36:46.247593] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-07T21:36:46.902160] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-07T21:36:47.047702] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-07T21:36:47.847699] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-07T21:36:48.419204] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-07T21:36:48.647700] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-07T21:36:48.680116] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T21:36:49.447720] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-07T21:36:50.016694] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T21:36:50.247725] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-07T21:36:50.665612] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-07T21:36:51.047744] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-07T21:36:51.512558] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-07T21:36:51.770699] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T21:36:51.847689] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-07T21:36:52.321632] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-07T21:36:52.647722] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-07T21:36:53.447701] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-07T21:36:54.252923] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-07T21:36:54.280771] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-07T21:36:54.813032] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T21:36:55.047702] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-07T21:36:55.397943] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-07T21:36:55.744444] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T21:36:55.847685] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-07T21:36:56.647693] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-07T21:36:57.257997] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T21:36:57.447708] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-07T21:36:57.858745] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T21:36:58.247742] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-07T21:36:58.762440] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T21:36:58.767454] [INFO ] [REMOTE ] SON: Full fetch complete (62430 records). [2025-10-07T21:36:58.767688] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-07T21:36:59.052775] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-07T21:36:59.211021] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-07T21:36:59.211142] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-07T21:36:59.212520] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-07T21:36:59.212590] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-07T21:36:59.214332] [DEBUG] [LOCAL ] SON: Trimmed 62430 records to 43009 (keeping 200 days of data) [2025-10-07T21:36:59.500905] [DEBUG] [LOCAL ] SON: Primary data saved (43009 records). [2025-10-07T21:36:59.501170] [INFO ] [MAIN ] SON: Full history saved. [2025-10-07T21:36:59.501353] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SON took 37.9s. Estimated remaining: 57m 3s. Rate: 7.1 symbols/min [2025-10-07T21:36:59.617725] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-07T21:36:59.693486] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:36:59.736096] [DEBUG] [LOCAL ] SPB: Loaded 34161 existing records from primary storage. [2025-10-07T21:36:59.736461] [INFO ] [MAIN ] SPB: Loaded 34161 existing records. [2025-10-07T21:36:59.852780] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-07T21:36:59.932162] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:36:59.932431] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-07T21:36:59.932486] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-07T21:36:59.933422] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-07T21:36:59.933492] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-07T21:37:00.325805] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:37:00.365521] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-07T21:37:00.647747] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-07T21:37:00.697747] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T21:37:01.447735] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-07T21:37:02.004836] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T21:37:02.247635] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-07T21:37:02.408330] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T21:37:03.047669] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-07T21:37:03.847633] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-07T21:37:04.251147] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T21:37:04.368530] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-07T21:37:04.647622] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-07T21:37:05.077107] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T21:37:05.447743] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-07T21:37:06.247699] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-07T21:37:06.575095] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T21:37:06.811018] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T21:37:07.047697] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-07T21:37:07.306370] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T21:37:07.308114] [INFO ] [REMOTE ] SOS: Full fetch complete (11187 records). [2025-10-07T21:37:07.308207] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-07T21:37:07.665356] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T21:37:07.704009] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-07T21:37:07.704117] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-07T21:37:07.704441] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-07T21:37:07.704484] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-07T21:37:07.705181] [DEBUG] [LOCAL ] SOS: Trimmed 11187 records to 9086 (keeping 200 days of data) [2025-10-07T21:37:07.761727] [DEBUG] [LOCAL ] SOS: Primary data saved (9086 records). [2025-10-07T21:37:07.761897] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-07T21:37:07.761991] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SOS took 23.7s. Estimated remaining: 56m 54s. Rate: 7.1 symbols/min [2025-10-07T21:37:07.852891] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-07T21:37:07.937351] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:37:07.991892] [DEBUG] [LOCAL ] SPCE: Loaded 49925 existing records from primary storage. [2025-10-07T21:37:07.992296] [INFO ] [MAIN ] SPCE: Loaded 49925 existing records. [2025-10-07T21:37:08.202778] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:37:08.203053] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-07T21:37:08.203101] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-07T21:37:08.204053] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-07T21:37:08.204114] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-07T21:37:08.545180] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:37:08.647603] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-07T21:37:09.447754] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-07T21:37:10.125994] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-07T21:37:10.247712] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-07T21:37:10.773251] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-07T21:37:10.775029] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T21:37:11.047703] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-07T21:37:11.847684] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-07T21:37:12.270663] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-07T21:37:12.647723] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-07T21:37:12.685200] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T21:37:13.298585] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T21:37:13.447703] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-07T21:37:14.247625] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-07T21:37:14.611871] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T21:37:14.822010] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T21:37:14.835851] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T21:37:15.047741] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-07T21:37:15.847720] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-07T21:37:16.424838] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-07T21:37:16.647686] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-07T21:37:16.699232] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T21:37:17.447762] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-07T21:37:18.095014] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T21:37:18.247709] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-07T21:37:19.047621] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-07T21:37:19.504411] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-07T21:37:19.849161] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-07T21:37:19.850980] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T21:37:19.861265] [INFO ] [REMOTE ] SONY: Full fetch complete (77236 records). [2025-10-07T21:37:19.861550] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-07T21:37:20.266695] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-07T21:37:20.266815] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-07T21:37:20.268080] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-07T21:37:20.268146] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-07T21:37:20.272275] [DEBUG] [LOCAL ] SONY: Trimmed 77236 records to 53373 (keeping 200 days of data) [2025-10-07T21:37:20.367742] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T21:37:20.653185] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T21:37:20.651256] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-07T21:37:20.702206] [DEBUG] [LOCAL ] SONY: Primary data saved (53373 records). [2025-10-07T21:37:20.702458] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-07T21:37:20.702618] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SONY took 44.6s. Estimated remaining: 56m 47s. Rate: 7.1 symbols/min [2025-10-07T21:37:20.920943] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:37:20.931203] [DEBUG] [LOCAL ] SPE: Loaded 6283 existing records from primary storage. [2025-10-07T21:37:20.931494] [INFO ] [MAIN ] SPE: Loaded 6283 existing records. [2025-10-07T21:37:21.231807] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T21:37:21.231338] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:37:21.234933] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-07T21:37:21.235035] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-07T21:37:21.235279] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-07T21:37:21.235337] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-07T21:37:21.454166] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-07T21:37:21.634988] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:37:22.040090] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T21:37:22.247635] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-07T21:37:23.047740] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-07T21:37:23.716015] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T21:37:23.779842] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-07T21:37:23.847633] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-07T21:37:24.566257] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T21:37:24.647639] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-07T21:37:25.034803] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T21:37:25.035898] [INFO ] [REMOTE ] SOR: Full fetch complete (4390 records). [2025-10-07T21:37:25.035969] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-07T21:37:25.401109] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-07T21:37:25.401249] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-07T21:37:25.401513] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-07T21:37:25.401637] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-07T21:37:25.402118] [DEBUG] [LOCAL ] SOR: Trimmed 4390 records to 2872 (keeping 200 days of data) [2025-10-07T21:37:25.425699] [DEBUG] [LOCAL ] SOR: Primary data saved (2872 records). [2025-10-07T21:37:25.425896] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-07T21:37:25.426028] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SOR took 43.5s. Estimated remaining: 56m 38s. Rate: 7.1 symbols/min [2025-10-07T21:37:25.452983] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-07T21:37:25.608929] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:37:25.675248] [DEBUG] [LOCAL ] SPG: Loaded 50257 existing records from primary storage. [2025-10-07T21:37:25.675754] [INFO ] [MAIN ] SPG: Loaded 50257 existing records. [2025-10-07T21:37:25.871859] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:37:25.872162] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-07T21:37:25.872266] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-07T21:37:25.873779] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-07T21:37:25.873842] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-07T21:37:26.248015] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-07T21:37:26.252230] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:37:27.047625] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-07T21:37:27.439923] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T21:37:27.631370] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T21:37:27.825091] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T21:37:27.847591] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-07T21:37:28.575434] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T21:37:28.647677] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-07T21:37:29.376589] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T21:37:29.447716] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-07T21:37:30.247636] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-07T21:37:31.047631] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-07T21:37:31.244521] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T21:37:31.847628] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-07T21:37:32.084996] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T21:37:32.087884] [INFO ] [REMOTE ] SPB: Full fetch complete (47517 records). [2025-10-07T21:37:32.088000] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-07T21:37:32.495830] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-07T21:37:32.514259] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-07T21:37:32.515740] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-07T21:37:32.522284] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-07T21:37:32.522447] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-07T21:37:32.523288] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-07T21:37:32.537144] [DEBUG] [LOCAL ] SPB: Trimmed 47517 records to 34229 (keeping 200 days of data) [2025-10-07T21:37:32.649985] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-07T21:37:32.754345] [DEBUG] [LOCAL ] SPB: Primary data saved (34229 records). [2025-10-07T21:37:32.754521] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-07T21:37:32.754695] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SPB took 33.3s. Estimated remaining: 56m 29s. Rate: 7.1 symbols/min [2025-10-07T21:37:32.922317] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:37:32.969987] [DEBUG] [LOCAL ] SPGI: Loaded 45769 existing records from primary storage. [2025-10-07T21:37:32.970374] [INFO ] [MAIN ] SPGI: Loaded 45769 existing records. [2025-10-07T21:37:33.148955] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:37:33.149207] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-07T21:37:33.149258] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-07T21:37:33.150313] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-07T21:37:33.150372] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-07T21:37:33.433556] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-07T21:37:33.452718] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-07T21:37:33.519111] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:37:34.247717] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-07T21:37:34.867875] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T21:37:35.047635] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-07T21:37:35.236823] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T21:37:35.750399] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-07T21:37:35.847687] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-07T21:37:36.647685] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-07T21:37:37.447721] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-07T21:37:37.904419] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-07T21:37:38.190564] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T21:37:38.247626] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-07T21:37:38.358822] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T21:37:39.047698] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-07T21:37:39.849115] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-07T21:37:39.855031] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T21:37:40.340988] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T21:37:40.341978] [INFO ] [REMOTE ] SPE: Full fetch complete (9911 records). [2025-10-07T21:37:40.342046] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-07T21:37:40.653791] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-07T21:37:40.696695] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-07T21:37:40.696838] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-07T21:37:40.697166] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-07T21:37:40.697208] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-07T21:37:40.697720] [DEBUG] [LOCAL ] SPE: Trimmed 9911 records to 6284 (keeping 200 days of data) [2025-10-07T21:37:40.739776] [DEBUG] [LOCAL ] SPE: Primary data saved (6284 records). [2025-10-07T21:37:40.739969] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-07T21:37:40.740070] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPE took 20.0s. Estimated remaining: 56m 20s. Rate: 7.1 symbols/min [2025-10-07T21:37:40.918827] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:37:40.939528] [DEBUG] [LOCAL ] SPH: Loaded 17090 existing records from primary storage. [2025-10-07T21:37:40.939823] [INFO ] [MAIN ] SPH: Loaded 17090 existing records. [2025-10-07T21:37:41.117320] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:37:41.117718] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-07T21:37:41.117782] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-07T21:37:41.181466] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-07T21:37:41.201694] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-07T21:37:41.267824] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-07T21:37:41.447633] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-07T21:37:41.570826] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:37:42.247625] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-07T21:37:42.433358] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T21:37:43.047690] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-07T21:37:43.287580] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T21:37:43.331207] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T21:37:43.847719] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-07T21:37:44.551272] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T21:37:44.609182] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T21:37:44.647602] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-07T21:37:45.447693] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-07T21:37:45.800802] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T21:37:46.247704] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-07T21:37:47.047672] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-07T21:37:47.289191] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T21:37:47.331585] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-07T21:37:47.847701] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-07T21:37:48.647697] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-07T21:37:49.094770] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T21:37:49.447634] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-07T21:37:49.635825] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T21:37:50.147756] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T21:37:50.247691] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-07T21:37:50.496448] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T21:37:51.047628] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-07T21:37:51.306130] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T21:37:51.847707] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-07T21:37:52.647692] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-07T21:37:52.923292] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T21:37:53.171850] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T21:37:53.447708] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-07T21:37:54.247686] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-07T21:37:54.721604] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-07T21:37:54.921766] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-07T21:37:55.047724] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-07T21:37:55.273359] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T21:37:55.847703] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-07T21:37:56.647636] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-07T21:37:56.860855] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-07T21:37:56.864936] [INFO ] [REMOTE ] SPCE: Full fetch complete (72409 records). [2025-10-07T21:37:56.865085] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-07T21:37:57.267105] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-07T21:37:57.267222] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-07T21:37:57.268350] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-07T21:37:57.268460] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-07T21:37:57.270069] [DEBUG] [LOCAL ] SPCE: Trimmed 72409 records to 49928 (keeping 200 days of data) [2025-10-07T21:37:57.470803] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-07T21:37:57.566001] [DEBUG] [LOCAL ] SPCE: Primary data saved (49928 records). [2025-10-07T21:37:57.566166] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-07T21:37:57.566263] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPCE took 49.8s. Estimated remaining: 56m 14s. Rate: 7.1 symbols/min [2025-10-07T21:37:57.737402] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:37:57.767659] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-07T21:37:57.813737] [DEBUG] [LOCAL ] SPHR: Loaded 40196 existing records from primary storage. [2025-10-07T21:37:57.814098] [INFO ] [MAIN ] SPHR: Loaded 40196 existing records. [2025-10-07T21:37:57.994103] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:37:57.994366] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-07T21:37:57.994518] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-07T21:37:57.994850] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-07T21:37:57.994908] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-07T21:37:58.247629] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-07T21:37:58.355972] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:37:58.453047] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T21:37:58.479681] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T21:37:59.047753] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-07T21:37:59.821778] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T21:37:59.847600] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-07T21:38:00.647767] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-07T21:38:00.768353] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T21:38:01.447754] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-07T21:38:01.690593] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T21:38:02.247672] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-07T21:38:02.289231] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T21:38:02.824266] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T21:38:03.047707] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-07T21:38:03.847631] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-07T21:38:03.925513] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T21:38:03.969137] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T21:38:04.647691] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-07T21:38:05.369982] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:38:05.394894] [INFO ] [REMOTE ] SPH: Full fetch complete (28206 records). [2025-10-07T21:38:05.396210] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T21:38:05.396589] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-07T21:38:05.452859] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-07T21:38:05.813981] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-07T21:38:05.814080] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-07T21:38:05.815059] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-07T21:38:05.815129] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-07T21:38:05.816178] [DEBUG] [LOCAL ] SPH: Trimmed 28206 records to 17016 (keeping 200 days of data) [2025-10-07T21:38:05.926026] [DEBUG] [LOCAL ] SPH: Primary data saved (17016 records). [2025-10-07T21:38:05.926208] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-07T21:38:05.926303] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPH took 25.2s. Estimated remaining: 56m 5s. Rate: 7.1 symbols/min [2025-10-07T21:38:06.098841] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:38:06.139501] [DEBUG] [LOCAL ] SPIR: Loaded 37153 existing records from primary storage. [2025-10-07T21:38:06.139879] [INFO ] [MAIN ] SPIR: Loaded 37153 existing records. [2025-10-07T21:38:06.252867] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-07T21:38:06.345850] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:38:06.346313] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-07T21:38:06.346405] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-07T21:38:06.347430] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-07T21:38:06.347503] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-07T21:38:06.765915] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:38:06.981855] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T21:38:07.047702] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-07T21:38:07.847673] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-07T21:38:08.176059] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-07T21:38:08.299017] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T21:38:08.363140] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T21:38:08.367193] [INFO ] [REMOTE ] SPG: Full fetch complete (71995 records). [2025-10-07T21:38:08.367414] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-07T21:38:08.654674] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-07T21:38:08.755123] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-07T21:38:08.755222] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-07T21:38:08.756340] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-07T21:38:08.756409] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-07T21:38:08.758041] [DEBUG] [LOCAL ] SPG: Trimmed 71995 records to 50253 (keeping 200 days of data) [2025-10-07T21:38:09.089817] [DEBUG] [LOCAL ] SPG: Primary data saved (50253 records). [2025-10-07T21:38:09.090032] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-07T21:38:09.090161] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPG took 43.7s. Estimated remaining: 55m 56s. Rate: 7.1 symbols/min [2025-10-07T21:38:09.264731] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:38:09.273050] [DEBUG] [LOCAL ] SPMC: Loaded 5327 existing records from primary storage. [2025-10-07T21:38:09.273258] [INFO ] [MAIN ] SPMC: Loaded 5327 existing records. [2025-10-07T21:38:09.456531] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:38:09.452522] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-07T21:38:09.457106] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-07T21:38:09.458261] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-07T21:38:09.458505] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-07T21:38:09.458567] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-07T21:38:09.844161] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:38:10.205689] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T21:38:10.247607] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-07T21:38:11.047732] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-07T21:38:11.131381] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T21:38:11.396537] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-07T21:38:11.646408] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-07T21:38:11.847714] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-07T21:38:12.406891] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T21:38:12.647731] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-07T21:38:13.382434] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T21:38:13.447687] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-07T21:38:14.179229] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T21:38:14.247764] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-07T21:38:15.047706] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-07T21:38:15.527442] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T21:38:15.531394] [INFO ] [REMOTE ] SPGI: Full fetch complete (67063 records). [2025-10-07T21:38:15.531551] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-07T21:38:15.852826] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-07T21:38:15.942907] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-07T21:38:15.943137] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-07T21:38:15.944603] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-07T21:38:15.944869] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-07T21:38:15.946803] [DEBUG] [LOCAL ] SPGI: Trimmed 67063 records to 45765 (keeping 200 days of data) [2025-10-07T21:38:16.085285] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T21:38:16.284210] [DEBUG] [LOCAL ] SPGI: Primary data saved (45765 records). [2025-10-07T21:38:16.284392] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-07T21:38:16.284507] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPGI took 43.5s. Estimated remaining: 55m 47s. Rate: 7.1 symbols/min [2025-10-07T21:38:16.419949] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-07T21:38:16.468199] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:38:16.468446] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-07T21:38:16.468502] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-07T21:38:16.468615] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-07T21:38:16.468688] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-07T21:38:16.468749] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-07T21:38:16.468788] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-07T21:38:16.652810] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-07T21:38:16.821986] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:38:17.447758] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-07T21:38:18.247667] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-07T21:38:18.282631] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T21:38:18.945514] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T21:38:18.946383] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-07T21:38:19.047720] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-07T21:38:19.847707] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-07T21:38:20.439497] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T21:38:20.647701] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-07T21:38:21.335528] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T21:38:21.441240] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T21:38:21.449800] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-07T21:38:22.247687] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-07T21:38:22.823037] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-07T21:38:22.896460] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-07T21:38:23.047731] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-07T21:38:23.412132] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:38:23.412530] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-07T21:38:23.412631] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:38:23.412735] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-07T21:38:23.412804] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:38:23.412894] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-07T21:38:23.412979] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-07T21:38:23.413020] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-07T21:38:23.413080] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-07T21:38:23.413154] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPME took 7.1s. Estimated remaining: 55m 38s. Rate: 7.1 symbols/min [2025-10-07T21:38:23.619223] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:38:23.661359] [DEBUG] [LOCAL ] SPNT: Loaded 34818 existing records from primary storage. [2025-10-07T21:38:23.661782] [INFO ] [MAIN ] SPNT: Loaded 34818 existing records. [2025-10-07T21:38:23.849541] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-07T21:38:23.849378] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:38:23.851051] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-07T21:38:23.851142] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-07T21:38:23.851460] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-07T21:38:23.851538] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-07T21:38:24.249931] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:38:24.647677] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-07T21:38:25.284300] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T21:38:25.406793] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-07T21:38:25.447622] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-07T21:38:26.058699] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T21:38:26.247720] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-07T21:38:27.047754] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-07T21:38:27.705954] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T21:38:27.741558] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:38:27.742498] [INFO ] [REMOTE ] SPMC: Full fetch complete (8083 records). [2025-10-07T21:38:27.742568] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-07T21:38:27.852777] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-07T21:38:28.105520] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-07T21:38:28.105612] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-07T21:38:28.105840] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-07T21:38:28.105899] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-07T21:38:28.106292] [DEBUG] [LOCAL ] SPMC: Trimmed 8083 records to 5333 (keeping 200 days of data) [2025-10-07T21:38:28.139667] [DEBUG] [LOCAL ] SPMC: Primary data saved (5333 records). [2025-10-07T21:38:28.139844] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-07T21:38:28.139945] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPMC took 19.0s. Estimated remaining: 55m 29s. Rate: 7.1 symbols/min [2025-10-07T21:38:28.310130] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:38:28.361058] [DEBUG] [LOCAL ] SPOT: Loaded 50495 existing records from primary storage. [2025-10-07T21:38:28.361431] [INFO ] [MAIN ] SPOT: Loaded 50495 existing records. [2025-10-07T21:38:28.547698] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:38:28.547972] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-07T21:38:28.548024] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-07T21:38:28.549317] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-07T21:38:28.549381] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-07T21:38:28.652837] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-07T21:38:28.908898] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:38:29.447675] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-07T21:38:29.645521] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-07T21:38:29.705446] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T21:38:30.247748] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-07T21:38:30.725069] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-07T21:38:31.047636] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-07T21:38:31.394538] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T21:38:31.847748] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-07T21:38:32.399267] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T21:38:32.403317] [INFO ] [REMOTE ] SPHR: Full fetch complete (57985 records). [2025-10-07T21:38:32.403495] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-07T21:38:32.653595] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-07T21:38:32.808947] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-07T21:38:32.809051] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-07T21:38:32.810421] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-07T21:38:32.810490] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-07T21:38:32.811957] [DEBUG] [LOCAL ] SPHR: Trimmed 57985 records to 40260 (keeping 200 days of data) [2025-10-07T21:38:33.068310] [DEBUG] [LOCAL ] SPHR: Primary data saved (40260 records). [2025-10-07T21:38:33.068487] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-07T21:38:33.068615] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPHR took 35.5s. Estimated remaining: 55m 20s. Rate: 7.1 symbols/min [2025-10-07T21:38:33.243192] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:38:33.288105] [DEBUG] [LOCAL ] SPR: Loaded 41111 existing records from primary storage. [2025-10-07T21:38:33.288571] [INFO ] [MAIN ] SPR: Loaded 41111 existing records. [2025-10-07T21:38:33.451159] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-07T21:38:33.477755] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:38:33.478182] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-07T21:38:33.478237] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-07T21:38:33.479398] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-07T21:38:33.479462] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-07T21:38:33.855779] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:38:33.961135] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-07T21:38:34.071282] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T21:38:34.247716] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-07T21:38:34.726122] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T21:38:35.047711] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-07T21:38:35.587270] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T21:38:35.847688] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-07T21:38:36.578479] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T21:38:36.647729] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-07T21:38:37.437322] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T21:38:37.447594] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-07T21:38:38.047518] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T21:38:38.247736] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-07T21:38:38.526625] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T21:38:39.047751] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-07T21:38:39.602527] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-07T21:38:39.847710] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-07T21:38:40.647625] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-07T21:38:41.090857] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-07T21:38:41.153494] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-07T21:38:41.447719] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-07T21:38:42.060018] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:38:42.247725] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-07T21:38:42.749264] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T21:38:43.047708] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-07T21:38:43.604933] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T21:38:43.847719] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-07T21:38:44.468511] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-07T21:38:44.647716] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-07T21:38:45.447696] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-07T21:38:45.924477] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T21:38:45.927713] [INFO ] [REMOTE ] SPIR: Full fetch complete (53232 records). [2025-10-07T21:38:45.927841] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-07T21:38:46.255117] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-07T21:38:46.363891] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-07T21:38:46.393997] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-07T21:38:46.394549] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-07T21:38:46.396229] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-07T21:38:46.396306] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-07T21:38:46.398013] [DEBUG] [LOCAL ] SPIR: Trimmed 53232 records to 37275 (keeping 200 days of data) [2025-10-07T21:38:46.635085] [DEBUG] [LOCAL ] SPIR: Primary data saved (37275 records). [2025-10-07T21:38:46.635340] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-07T21:38:46.635703] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPIR took 40.7s. Estimated remaining: 55m 12s. Rate: 7.1 symbols/min [2025-10-07T21:38:46.819120] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:38:46.853896] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T21:38:46.871130] [DEBUG] [LOCAL ] SPRU: Loaded 9368 existing records from primary storage. [2025-10-07T21:38:46.871408] [INFO ] [MAIN ] SPRU: Loaded 9368 existing records. [2025-10-07T21:38:47.050679] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-07T21:38:47.050526] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:38:47.052021] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-07T21:38:47.052082] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-07T21:38:47.052456] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-07T21:38:47.052516] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-07T21:38:47.406225] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:38:47.724978] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-07T21:38:47.847617] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-07T21:38:48.632699] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T21:38:48.647614] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-07T21:38:49.447728] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-07T21:38:50.119525] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-07T21:38:50.187246] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T21:38:50.243686] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T21:38:50.247598] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-07T21:38:50.854001] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-07T21:38:51.047706] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-07T21:38:51.847680] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-07T21:38:52.647716] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-07T21:38:53.419618] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T21:38:53.447608] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-07T21:38:53.488585] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-07T21:38:54.113471] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T21:38:54.247725] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-07T21:38:54.807762] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T21:38:54.963288] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T21:38:55.047623] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-07T21:38:55.847729] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-07T21:38:56.490220] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T21:38:56.524723] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T21:38:56.647677] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-07T21:38:57.447714] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-07T21:38:57.950200] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T21:38:57.953880] [INFO ] [REMOTE ] SPR: Full fetch complete (60120 records). [2025-10-07T21:38:57.953999] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-07T21:38:58.252838] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-07T21:38:58.363780] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-07T21:38:58.363934] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-07T21:38:58.365157] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-07T21:38:58.365228] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-07T21:38:58.367499] [DEBUG] [LOCAL ] SPR: Trimmed 60120 records to 41108 (keeping 200 days of data) [2025-10-07T21:38:58.593724] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T21:38:58.601238] [INFO ] [REMOTE ] SPNT: Full fetch complete (49040 records). [2025-10-07T21:38:58.602059] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-07T21:38:59.043082] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-07T21:38:59.043559] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-07T21:38:59.045377] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-07T21:38:59.045470] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-07T21:38:59.047755] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-07T21:38:59.050710] [DEBUG] [LOCAL ] SPNT: Trimmed 49040 records to 34803 (keeping 200 days of data) [2025-10-07T21:38:59.160598] [DEBUG] [LOCAL ] SPR: Primary data saved (41108 records). [2025-10-07T21:38:59.161896] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-07T21:38:59.162367] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPR took 26.1s. Estimated remaining: 55m 5s. Rate: 7.1 symbols/min [2025-10-07T21:38:59.346904] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:38:59.460115] [DEBUG] [LOCAL ] SPXC: Loaded 23358 existing records from primary storage. [2025-10-07T21:38:59.461511] [INFO ] [MAIN ] SPXC: Loaded 23358 existing records. [2025-10-07T21:38:59.660773] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:38:59.663295] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-07T21:38:59.663928] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-07T21:38:59.665573] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-07T21:38:59.666241] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-07T21:38:59.865922] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-07T21:38:59.889318] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-07T21:38:59.921454] [DEBUG] [LOCAL ] SPNT: Primary data saved (34803 records). [2025-10-07T21:38:59.933819] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-07T21:38:59.933981] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPNT took 36.5s. Estimated remaining: 54m 55s. Rate: 7.1 symbols/min [2025-10-07T21:39:00.287539] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:39:00.291560] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:39:00.307194] [DEBUG] [LOCAL ] SPXX: Loaded 9334 existing records from primary storage. [2025-10-07T21:39:00.307488] [INFO ] [MAIN ] SPXX: Loaded 9334 existing records. [2025-10-07T21:39:00.493962] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:39:00.494488] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-07T21:39:00.494575] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-07T21:39:00.495034] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-07T21:39:00.495100] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-07T21:39:00.657011] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-07T21:39:00.781632] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-07T21:39:00.893137] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-07T21:39:00.958727] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:39:01.447751] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-07T21:39:01.943420] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T21:39:02.247703] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-07T21:39:03.047706] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-07T21:39:03.328134] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T21:39:03.511366] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-07T21:39:03.768406] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-07T21:39:03.847634] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-07T21:39:04.479371] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T21:39:04.647691] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-07T21:39:05.447753] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-07T21:39:06.112949] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-07T21:39:06.247761] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-07T21:39:06.971721] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-07T21:39:07.039040] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T21:39:07.047598] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-07T21:39:07.847741] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-07T21:39:07.947890] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T21:39:08.647736] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-07T21:39:09.447688] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-07T21:39:09.806243] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T21:39:09.991873] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-07T21:39:10.247753] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-07T21:39:10.334723] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T21:39:11.047672] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-07T21:39:11.389392] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T21:39:11.847739] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-07T21:39:12.622159] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-07T21:39:12.647610] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-07T21:39:13.171541] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T21:39:13.447776] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-07T21:39:13.544734] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-07T21:39:14.247635] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-07T21:39:14.698858] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T21:39:15.047676] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-07T21:39:15.293907] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T21:39:15.786259] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T21:39:15.847620] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-07T21:39:16.647719] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-07T21:39:17.447703] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-07T21:39:17.511132] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-07T21:39:17.678310] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-07T21:39:17.682094] [INFO ] [REMOTE ] SPOT: Full fetch complete (73704 records). [2025-10-07T21:39:17.682260] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-07T21:39:18.114186] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-07T21:39:18.114317] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-07T21:39:18.115733] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-07T21:39:18.115813] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-07T21:39:18.118014] [DEBUG] [LOCAL ] SPOT: Trimmed 73704 records to 50482 (keeping 200 days of data) [2025-10-07T21:39:18.247824] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-07T21:39:18.461786] [DEBUG] [LOCAL ] SPOT: Primary data saved (50482 records). [2025-10-07T21:39:18.462003] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-07T21:39:18.462119] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPOT took 50.3s. Estimated remaining: 54m 48s. Rate: 7.1 symbols/min [2025-10-07T21:39:18.639203] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:39:18.654841] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T21:39:18.698880] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-07T21:39:18.720755] [DEBUG] [LOCAL ] SQM: Loaded 48603 existing records from primary storage. [2025-10-07T21:39:18.721182] [INFO ] [MAIN ] SQM: Loaded 48603 existing records. [2025-10-07T21:39:18.907684] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:39:18.908043] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-07T21:39:18.908102] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-07T21:39:18.909796] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-07T21:39:18.909860] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-07T21:39:19.054509] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-07T21:39:19.272982] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:39:19.847625] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-07T21:39:19.934157] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T21:39:20.647715] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-07T21:39:20.666418] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T21:39:21.447727] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-07T21:39:21.991975] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T21:39:21.995007] [INFO ] [REMOTE ] SPXX: Full fetch complete (13270 records). [2025-10-07T21:39:21.995193] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-07T21:39:22.255987] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-07T21:39:22.544697] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-07T21:39:22.561144] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-07T21:39:22.584472] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-07T21:39:22.584802] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-07T21:39:22.586428] [DEBUG] [LOCAL ] SPXX: Trimmed 13270 records to 9407 (keeping 200 days of data) [2025-10-07T21:39:22.593281] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-07T21:39:22.706673] [DEBUG] [LOCAL ] SPXX: Primary data saved (9407 records). [2025-10-07T21:39:22.706929] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-07T21:39:22.707076] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPXX took 22.7s. Estimated remaining: 54m 39s. Rate: 7.1 symbols/min [2025-10-07T21:39:22.944444] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:39:22.975186] [DEBUG] [LOCAL ] SQNS: Loaded 26701 existing records from primary storage. [2025-10-07T21:39:22.975613] [INFO ] [MAIN ] SQNS: Loaded 26701 existing records. [2025-10-07T21:39:23.048388] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-07T21:39:23.188528] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:39:23.188848] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-07T21:39:23.188907] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-07T21:39:23.189756] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-07T21:39:23.189816] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-07T21:39:23.505097] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T21:39:23.573756] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:39:23.669431] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T21:39:23.671210] [INFO ] [REMOTE ] SPRU: Full fetch complete (11850 records). [2025-10-07T21:39:23.671295] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-07T21:39:23.851131] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-07T21:39:24.097359] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-07T21:39:24.097533] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-07T21:39:24.097893] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-07T21:39:24.097961] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-07T21:39:24.098834] [DEBUG] [LOCAL ] SPRU: Trimmed 11850 records to 9437 (keeping 200 days of data) [2025-10-07T21:39:24.173022] [DEBUG] [LOCAL ] SPRU: Primary data saved (9437 records). [2025-10-07T21:39:24.173241] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-07T21:39:24.173402] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPRU took 37.5s. Estimated remaining: 54m 29s. Rate: 7.1 symbols/min [2025-10-07T21:39:24.355111] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:39:24.393149] [DEBUG] [LOCAL ] SR: Loaded 32753 existing records from primary storage. [2025-10-07T21:39:24.393518] [INFO ] [MAIN ] SR: Loaded 32753 existing records. [2025-10-07T21:39:24.572111] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:39:24.572409] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-07T21:39:24.572460] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-07T21:39:24.573809] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-07T21:39:24.573873] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-07T21:39:24.650067] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-07T21:39:24.940523] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:39:24.952986] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T21:39:25.447700] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-07T21:39:25.865090] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-07T21:39:26.247671] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-07T21:39:26.384248] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T21:39:27.047707] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-07T21:39:27.847670] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-07T21:39:27.914885] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T21:39:28.376024] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T21:39:28.391933] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-07T21:39:28.647720] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-07T21:39:29.447691] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-07T21:39:29.789418] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T21:39:30.247707] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-07T21:39:30.346700] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T21:39:31.047796] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-07T21:39:31.495979] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T21:39:31.763592] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-07T21:39:31.847692] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-07T21:39:32.605229] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T21:39:32.647605] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-07T21:39:33.447668] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-07T21:39:33.627954] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T21:39:34.247667] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-07T21:39:34.936031] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T21:39:35.047605] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-07T21:39:35.164517] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T21:39:35.166691] [INFO ] [REMOTE ] SPXC: Full fetch complete (34219 records). [2025-10-07T21:39:35.166772] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-07T21:39:35.542383] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-07T21:39:35.542523] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-07T21:39:35.543456] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-07T21:39:35.543525] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-07T21:39:35.545032] [DEBUG] [LOCAL ] SPXC: Trimmed 34219 records to 23293 (keeping 200 days of data) [2025-10-07T21:39:35.698484] [DEBUG] [LOCAL ] SPXC: Primary data saved (23293 records). [2025-10-07T21:39:35.698682] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-07T21:39:35.698811] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXC took 36.5s. Estimated remaining: 54m 21s. Rate: 7.1 symbols/min [2025-10-07T21:39:35.865905] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-07T21:39:35.868807] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:39:35.923759] [DEBUG] [LOCAL ] SRE: Loaded 53416 existing records from primary storage. [2025-10-07T21:39:35.924183] [INFO ] [MAIN ] SRE: Loaded 53416 existing records. [2025-10-07T21:39:36.104039] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:39:36.104376] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-07T21:39:36.104444] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-07T21:39:36.106451] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-07T21:39:36.106535] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-07T21:39:36.462944] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:39:36.647716] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-07T21:39:36.782811] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T21:39:37.076052] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T21:39:37.447709] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-07T21:39:38.247701] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-07T21:39:38.927144] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-07T21:39:39.047668] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-07T21:39:39.247762] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T21:39:39.847627] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-07T21:39:39.970459] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T21:39:40.647624] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-07T21:39:40.718616] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T21:39:41.215345] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T21:39:41.447618] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-07T21:39:42.247692] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-07T21:39:42.397496] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T21:39:43.047637] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-07T21:39:43.111013] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T21:39:43.540831] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T21:39:43.847699] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-07T21:39:44.647700] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-07T21:39:44.781178] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T21:39:45.259705] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T21:39:45.447699] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-07T21:39:45.815343] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-07T21:39:46.247691] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-07T21:39:47.047732] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-07T21:39:47.268541] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T21:39:47.566191] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T21:39:47.568623] [INFO ] [REMOTE ] SQNS: Full fetch complete (32478 records). [2025-10-07T21:39:47.568731] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-07T21:39:47.854816] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-07T21:39:47.944769] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-07T21:39:47.944874] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-07T21:39:47.945680] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-07T21:39:47.945745] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-07T21:39:47.947241] [DEBUG] [LOCAL ] SQNS: Trimmed 32478 records to 26867 (keeping 200 days of data) [2025-10-07T21:39:48.106255] [DEBUG] [LOCAL ] SQNS: Primary data saved (26867 records). [2025-10-07T21:39:48.106427] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-07T21:39:48.106554] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SQNS took 25.4s. Estimated remaining: 54m 14s. Rate: 7.1 symbols/min [2025-10-07T21:39:48.278606] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:39:48.290254] [DEBUG] [LOCAL ] SREA: Loaded 10272 existing records from primary storage. [2025-10-07T21:39:48.290505] [INFO ] [MAIN ] SREA: Loaded 10272 existing records. [2025-10-07T21:39:48.474581] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:39:48.474930] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-07T21:39:48.475105] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-07T21:39:48.475694] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-07T21:39:48.475784] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-07T21:39:48.653471] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T21:39:48.651553] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-07T21:39:48.858949] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:39:49.447696] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-07T21:39:49.650927] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:39:50.247628] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-07T21:39:50.508121] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T21:39:50.534051] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T21:39:51.047724] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-07T21:39:51.847714] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-07T21:39:52.010415] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T21:39:52.040854] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T21:39:52.647720] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-07T21:39:53.440205] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T21:39:53.447833] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-07T21:39:54.046235] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T21:39:54.050478] [INFO ] [REMOTE ] SQM: Full fetch complete (69108 records). [2025-10-07T21:39:54.050673] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-07T21:39:54.253756] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-07T21:39:54.488007] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-07T21:39:54.488129] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-07T21:39:54.489239] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-07T21:39:54.489314] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-07T21:39:54.490976] [DEBUG] [LOCAL ] SQM: Trimmed 69108 records to 48616 (keeping 200 days of data) [2025-10-07T21:39:54.796628] [DEBUG] [LOCAL ] SQM: Primary data saved (48616 records). [2025-10-07T21:39:54.796936] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-07T21:39:54.797063] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQM took 36.3s. Estimated remaining: 54m 5s. Rate: 7.1 symbols/min [2025-10-07T21:39:54.928186] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T21:39:55.003753] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:39:55.042764] [DEBUG] [LOCAL ] SRFM: Loaded 37346 existing records from primary storage. [2025-10-07T21:39:55.043118] [INFO ] [MAIN ] SRFM: Loaded 37346 existing records. [2025-10-07T21:39:55.054388] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-07T21:39:55.237165] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:39:55.231632] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T21:39:55.241146] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-07T21:39:55.241624] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-07T21:39:55.243157] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-07T21:39:55.243218] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-07T21:39:55.589138] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:39:55.847715] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-07T21:39:56.647732] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-07T21:39:56.878363] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T21:39:57.020803] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-07T21:39:57.128616] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T21:39:57.447619] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-07T21:39:58.247632] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-07T21:39:58.274679] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T21:39:59.047751] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-07T21:39:59.633768] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-07T21:39:59.847682] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-07T21:40:00.380403] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-07T21:40:00.647713] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-07T21:40:01.447760] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-07T21:40:01.670486] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T21:40:01.978492] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-07T21:40:02.247723] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-07T21:40:03.047673] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-07T21:40:03.095977] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T21:40:03.847719] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-07T21:40:03.958085] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T21:40:04.306568] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T21:40:04.485990] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T21:40:04.647707] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-07T21:40:05.447622] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-07T21:40:05.683743] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T21:40:06.247724] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-07T21:40:06.941854] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T21:40:07.047624] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-07T21:40:07.354133] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T21:40:07.847637] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-07T21:40:08.133566] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T21:40:08.647737] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-07T21:40:09.447758] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-07T21:40:09.647417] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T21:40:09.662840] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T21:40:09.666311] [INFO ] [REMOTE ] SR: Full fetch complete (46279 records). [2025-10-07T21:40:09.666439] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-07T21:40:10.069976] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-07T21:40:10.070086] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-07T21:40:10.071701] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-07T21:40:10.071772] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-07T21:40:10.073245] [DEBUG] [LOCAL ] SR: Trimmed 46279 records to 32712 (keeping 200 days of data) [2025-10-07T21:40:10.250215] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-07T21:40:10.296431] [DEBUG] [LOCAL ] SR: Primary data saved (32712 records). [2025-10-07T21:40:10.296711] [INFO ] [MAIN ] SR: Full history saved. [2025-10-07T21:40:10.296834] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SR took 46.1s. Estimated remaining: 53m 58s. Rate: 7.1 symbols/min [2025-10-07T21:40:10.415461] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T21:40:10.496206] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:40:10.515588] [DEBUG] [LOCAL ] SRG: Loaded 15472 existing records from primary storage. [2025-10-07T21:40:10.515957] [INFO ] [MAIN ] SRG: Loaded 15472 existing records. [2025-10-07T21:40:10.710437] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:40:10.710748] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-07T21:40:10.710806] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-07T21:40:10.711553] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-07T21:40:10.711616] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-07T21:40:11.052981] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-07T21:40:11.094928] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:40:11.847748] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-07T21:40:11.874241] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T21:40:12.534916] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-07T21:40:12.647763] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-07T21:40:13.075497] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T21:40:13.447690] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-07T21:40:14.247702] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-07T21:40:14.383121] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-07T21:40:14.437962] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T21:40:15.047754] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-07T21:40:15.847718] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-07T21:40:15.961836] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T21:40:16.436024] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-07T21:40:16.647736] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-07T21:40:16.745840] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-07T21:40:17.447730] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-07T21:40:17.993566] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T21:40:17.994791] [INFO ] [REMOTE ] SREA: Full fetch complete (15544 records). [2025-10-07T21:40:17.994864] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-07T21:40:18.252919] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-07T21:40:18.353226] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-07T21:40:18.353315] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-07T21:40:18.353755] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-07T21:40:18.353817] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-07T21:40:18.354352] [DEBUG] [LOCAL ] SREA: Trimmed 15544 records to 10251 (keeping 200 days of data) [2025-10-07T21:40:18.419154] [DEBUG] [LOCAL ] SREA: Primary data saved (10251 records). [2025-10-07T21:40:18.419319] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-07T21:40:18.419417] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SREA took 30.3s. Estimated remaining: 53m 49s. Rate: 7.1 symbols/min [2025-10-07T21:40:18.597728] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:40:18.626272] [DEBUG] [LOCAL ] SRI: Loaded 26878 existing records from primary storage. [2025-10-07T21:40:18.626611] [INFO ] [MAIN ] SRI: Loaded 26878 existing records. [2025-10-07T21:40:18.803926] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-07T21:40:18.845178] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:40:18.845668] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-07T21:40:18.845745] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-07T21:40:18.849297] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-07T21:40:18.849368] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-07T21:40:19.052887] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-07T21:40:19.199110] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:40:19.452498] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T21:40:19.847720] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-07T21:40:20.647635] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-07T21:40:21.023085] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-07T21:40:21.026773] [INFO ] [REMOTE ] SRFM: Full fetch complete (49864 records). [2025-10-07T21:40:21.026867] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-07T21:40:21.365986] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T21:40:21.450244] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-07T21:40:21.463953] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-07T21:40:21.464304] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-07T21:40:21.465766] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-07T21:40:21.465991] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-07T21:40:21.469925] [DEBUG] [LOCAL ] SRFM: Trimmed 49864 records to 37579 (keeping 200 days of data) [2025-10-07T21:40:21.688604] [DEBUG] [LOCAL ] SRFM: Primary data saved (37579 records). [2025-10-07T21:40:21.688812] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-07T21:40:21.688925] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SRFM took 26.9s. Estimated remaining: 53m 40s. Rate: 7.1 symbols/min [2025-10-07T21:40:21.856012] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:40:21.856341] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-07T21:40:21.856398] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-07T21:40:21.856480] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-07T21:40:21.856555] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-07T21:40:21.856607] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-07T21:40:21.856667] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-07T21:40:22.215566] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:40:22.247599] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-07T21:40:22.354907] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T21:40:22.647364] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T21:40:22.818563] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-07T21:40:23.047738] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-07T21:40:23.847717] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-07T21:40:24.647812] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-07T21:40:24.943938] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-07T21:40:25.071130] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T21:40:25.447723] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-07T21:40:26.247726] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-07T21:40:26.749225] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T21:40:27.047708] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-07T21:40:27.127756] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T21:40:27.847708] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-07T21:40:28.408781] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T21:40:28.556088] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (3.91 seconds). [2025-10-07T21:40:28.617547] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T21:40:28.647672] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-07T21:40:28.999722] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-07T21:40:29.447709] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-07T21:40:30.247625] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-07T21:40:30.610073] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-07T21:40:30.629610] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T21:40:31.047706] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-07T21:40:31.511575] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T21:40:31.516102] [INFO ] [REMOTE ] SRE: Full fetch complete (77295 records). [2025-10-07T21:40:31.516335] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-07T21:40:31.852863] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-07T21:40:31.946738] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-07T21:40:31.946844] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-07T21:40:31.948068] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-07T21:40:31.948139] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-07T21:40:31.949788] [DEBUG] [LOCAL ] SRE: Trimmed 77295 records to 53416 (keeping 200 days of data) [2025-10-07T21:40:32.296056] [DEBUG] [LOCAL ] SRE: Primary data saved (53416 records). [2025-10-07T21:40:32.296252] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-07T21:40:32.296360] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SRE took 56.6s. Estimated remaining: 53m 32s. Rate: 7.1 symbols/min [2025-10-07T21:40:32.467299] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:40:32.477727] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T21:40:32.488316] [DEBUG] [LOCAL ] SRV: Loaded 7343 existing records from primary storage. [2025-10-07T21:40:32.488562] [INFO ] [MAIN ] SRV: Loaded 7343 existing records. [2025-10-07T21:40:32.656393] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-07T21:40:32.661332] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:40:32.662598] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-07T21:40:32.662716] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-07T21:40:32.663837] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-07T21:40:32.663901] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-07T21:40:33.024380] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:40:33.447701] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-07T21:40:33.656406] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-07T21:40:34.247708] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-07T21:40:34.450959] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T21:40:34.622691] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-07T21:40:35.047722] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-07T21:40:35.492777] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-07T21:40:35.847694] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-07T21:40:36.221069] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-07T21:40:36.647699] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-07T21:40:37.027293] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-07T21:40:37.447694] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-07T21:40:38.221711] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-07T21:40:38.247732] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-07T21:40:38.604137] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-07T21:40:39.047693] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-07T21:40:39.479539] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-07T21:40:39.847693] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-07T21:40:40.540806] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-07T21:40:40.647637] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-07T21:40:40.933629] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T21:40:40.934425] [INFO ] [REMOTE ] SRL: Full fetch complete (1956 records). [2025-10-07T21:40:40.934533] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-07T21:40:41.108519] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-07T21:40:41.108804] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:40:41.108878] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:40:41.108964] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-07T21:40:41.109077] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-07T21:40:41.109155] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-07T21:40:41.109274] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-07T21:40:41.109377] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRL took 19.4s. Estimated remaining: 53m 23s. Rate: 7.1 symbols/min [2025-10-07T21:40:41.292672] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:40:41.333176] [DEBUG] [LOCAL ] SSB: Loaded 42698 existing records from primary storage. [2025-10-07T21:40:41.333561] [INFO ] [MAIN ] SSB: Loaded 42698 existing records. [2025-10-07T21:40:41.452737] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-07T21:40:41.508555] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:40:41.508788] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-07T21:40:41.508849] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-07T21:40:41.512003] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-07T21:40:41.512099] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-07T21:40:41.857464] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:40:42.247699] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-07T21:40:42.517941] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T21:40:42.965368] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T21:40:43.047626] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-07T21:40:43.847718] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-07T21:40:43.875498] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T21:40:44.647631] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-07T21:40:45.079101] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T21:40:45.447616] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-07T21:40:46.128957] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T21:40:46.247636] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-07T21:40:46.797375] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T21:40:47.047678] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-07T21:40:47.770151] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-07T21:40:47.771583] [INFO ] [REMOTE ] SRG: Full fetch complete (24225 records). [2025-10-07T21:40:47.771702] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-07T21:40:47.852761] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-07T21:40:48.072229] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T21:40:48.203615] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-07T21:40:48.203759] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-07T21:40:48.204879] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-07T21:40:48.204949] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-07T21:40:48.205914] [DEBUG] [LOCAL ] SRG: Trimmed 24225 records to 15472 (keeping 200 days of data) [2025-10-07T21:40:48.302821] [DEBUG] [LOCAL ] SRG: Primary data saved (15472 records). [2025-10-07T21:40:48.303013] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-07T21:40:48.303124] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRG took 38.0s. Estimated remaining: 53m 15s. Rate: 7.1 symbols/min [2025-10-07T21:40:48.480121] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:40:48.506443] [DEBUG] [LOCAL ] SSD: Loaded 22478 existing records from primary storage. [2025-10-07T21:40:48.506911] [INFO ] [MAIN ] SSD: Loaded 22478 existing records. [2025-10-07T21:40:48.652845] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-07T21:40:48.713619] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:40:48.713939] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-07T21:40:48.713996] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-07T21:40:48.715243] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-07T21:40:48.715310] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-07T21:40:49.114491] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:40:49.132084] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T21:40:49.447761] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-07T21:40:50.128746] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T21:40:50.247633] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-07T21:40:50.483976] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T21:40:51.040538] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T21:40:51.047593] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-07T21:40:51.821600] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T21:40:51.847635] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-07T21:40:52.647631] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-07T21:40:52.820763] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T21:40:53.447667] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-07T21:40:53.467294] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T21:40:53.469146] [INFO ] [REMOTE ] SRI: Full fetch complete (40894 records). [2025-10-07T21:40:53.469233] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-07T21:40:53.841772] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-07T21:40:53.841869] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-07T21:40:53.842674] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-07T21:40:53.842741] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-07T21:40:53.843678] [DEBUG] [LOCAL ] SRI: Trimmed 40894 records to 26802 (keeping 200 days of data) [2025-10-07T21:40:53.995461] [DEBUG] [LOCAL ] SRI: Primary data saved (26802 records). [2025-10-07T21:40:53.995629] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-07T21:40:53.995758] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRI took 35.6s. Estimated remaining: 53m 6s. Rate: 7.1 symbols/min [2025-10-07T21:40:54.163284] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:40:54.202818] [DEBUG] [LOCAL ] SSL: Loaded 41242 existing records from primary storage. [2025-10-07T21:40:54.203405] [INFO ] [MAIN ] SSL: Loaded 41242 existing records. [2025-10-07T21:40:54.251146] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-07T21:40:54.396971] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:40:54.397583] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-07T21:40:54.397668] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-07T21:40:54.398958] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-07T21:40:54.399020] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-07T21:40:54.695671] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T21:40:54.782941] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:40:55.051241] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-07T21:40:55.052383] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-07T21:40:55.847634] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-07T21:40:56.449340] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T21:40:56.647706] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-07T21:40:57.344464] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T21:40:57.447617] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-07T21:40:57.936364] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-07T21:40:58.247702] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-07T21:40:58.990928] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T21:40:59.047605] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-07T21:40:59.237896] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T21:40:59.765074] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T21:40:59.847614] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-07T21:41:00.440936] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:41:00.442065] [INFO ] [REMOTE ] SRV: Full fetch complete (11514 records). [2025-10-07T21:41:00.442137] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-07T21:41:00.653729] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-07T21:41:00.794288] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-07T21:41:00.794377] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-07T21:41:00.794705] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-07T21:41:00.794767] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-07T21:41:00.795224] [DEBUG] [LOCAL ] SRV: Trimmed 11514 records to 7351 (keeping 200 days of data) [2025-10-07T21:41:00.841743] [DEBUG] [LOCAL ] SRV: Primary data saved (7351 records). [2025-10-07T21:41:00.841909] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-07T21:41:00.842003] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRV took 28.5s. Estimated remaining: 52m 57s. Rate: 7.1 symbols/min [2025-10-07T21:41:01.009973] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:41:01.022823] [DEBUG] [LOCAL ] SST: Loaded 11840 existing records from primary storage. [2025-10-07T21:41:01.023094] [INFO ] [MAIN ] SST: Loaded 11840 existing records. [2025-10-07T21:41:01.194230] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:41:01.194528] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-07T21:41:01.194578] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-07T21:41:01.195228] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-07T21:41:01.195288] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-07T21:41:01.454406] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-07T21:41:01.547695] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:41:01.872582] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T21:41:02.247711] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-07T21:41:03.032007] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T21:41:03.047604] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-07T21:41:03.847752] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-07T21:41:03.882917] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T21:41:04.252245] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T21:41:04.647734] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-07T21:41:04.991065] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T21:41:05.447717] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-07T21:41:06.258176] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-07T21:41:06.263958] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T21:41:06.291467] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T21:41:07.047754] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-07T21:41:07.496310] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T21:41:07.847774] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-07T21:41:08.135233] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T21:41:08.647728] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-07T21:41:09.043346] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T21:41:09.447683] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-07T21:41:10.197505] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T21:41:10.247605] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-07T21:41:10.335449] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T21:41:11.047705] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-07T21:41:11.847713] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-07T21:41:11.918116] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T21:41:12.366346] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T21:41:12.647631] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-07T21:41:12.948888] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T21:41:13.447717] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-07T21:41:13.810717] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-07T21:41:14.247699] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-07T21:41:15.056585] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-07T21:41:15.059717] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T21:41:15.774509] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T21:41:15.847714] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-07T21:41:16.220291] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T21:41:16.647720] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-07T21:41:16.691709] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-07T21:41:17.447702] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-07T21:41:17.848534] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T21:41:17.851712] [INFO ] [REMOTE ] SSB: Full fetch complete (61388 records). [2025-10-07T21:41:17.851821] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-07T21:41:18.244884] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-07T21:41:18.244973] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-07T21:41:18.245946] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-07T21:41:18.246009] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-07T21:41:18.247313] [DEBUG] [LOCAL ] SSB: Trimmed 61388 records to 42687 (keeping 200 days of data) [2025-10-07T21:41:18.247859] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-07T21:41:18.526596] [DEBUG] [LOCAL ] SSB: Primary data saved (42687 records). [2025-10-07T21:41:18.526803] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-07T21:41:18.526907] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SSB took 37.4s. Estimated remaining: 52m 50s. Rate: 7.1 symbols/min [2025-10-07T21:41:18.695837] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:41:18.723447] [DEBUG] [LOCAL ] SSTK: Loaded 25655 existing records from primary storage. [2025-10-07T21:41:18.723825] [INFO ] [MAIN ] SSTK: Loaded 25655 existing records. [2025-10-07T21:41:18.906691] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:41:18.907464] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-07T21:41:18.907691] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-07T21:41:18.909049] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-07T21:41:18.909130] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-07T21:41:19.050959] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-07T21:41:19.280712] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T21:41:19.280552] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-07T21:41:19.408973] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:41:19.847707] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-07T21:41:20.297807] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T21:41:20.647741] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-07T21:41:20.665687] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T21:41:21.447688] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-07T21:41:21.997940] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T21:41:22.247706] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-07T21:41:23.047624] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-07T21:41:23.150743] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T21:41:23.219421] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-07T21:41:23.847667] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-07T21:41:24.174559] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T21:41:24.647902] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-07T21:41:25.384172] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T21:41:25.447622] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-07T21:41:25.873673] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T21:41:26.247704] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-07T21:41:26.374221] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-07T21:41:27.047725] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-07T21:41:27.072169] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T21:41:27.847690] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-07T21:41:27.938714] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T21:41:27.940795] [INFO ] [REMOTE ] SSD: Full fetch complete (32393 records). [2025-10-07T21:41:27.940896] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-07T21:41:28.347796] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-07T21:41:28.347890] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-07T21:41:28.348579] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-07T21:41:28.348662] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-07T21:41:28.350722] [DEBUG] [LOCAL ] SSD: Trimmed 32393 records to 22498 (keeping 200 days of data) [2025-10-07T21:41:28.499448] [DEBUG] [LOCAL ] SSD: Primary data saved (22498 records). [2025-10-07T21:41:28.499614] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-07T21:41:28.499743] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSD took 40.2s. Estimated remaining: 52m 42s. Rate: 7.1 symbols/min [2025-10-07T21:41:28.647728] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-07T21:41:29.145387] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-07T21:41:29.176051] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T21:41:29.447734] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-07T21:41:30.247726] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-07T21:41:30.884528] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T21:41:31.047705] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-07T21:41:31.510921] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T21:41:31.514018] [INFO ] [REMOTE ] SSL: Full fetch complete (60032 records). [2025-10-07T21:41:31.514125] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-07T21:41:31.852826] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-07T21:41:31.905017] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-07T21:41:31.905119] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-07T21:41:31.906148] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-07T21:41:31.906250] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-07T21:41:31.912609] [DEBUG] [LOCAL ] SSL: Trimmed 60032 records to 41347 (keeping 200 days of data) [2025-10-07T21:41:32.156985] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T21:41:32.192507] [DEBUG] [LOCAL ] SSL: Primary data saved (41347 records). [2025-10-07T21:41:32.192701] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-07T21:41:32.192868] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSL took 38.2s. Estimated remaining: 52m 33s. Rate: 7.1 symbols/min [2025-10-07T21:41:32.647753] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-07T21:41:32.759852] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T21:41:33.447744] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-07T21:41:33.611923] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-07T21:41:34.001045] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T21:41:34.002176] [INFO ] [REMOTE ] SST: Full fetch complete (18713 records). [2025-10-07T21:41:34.002247] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-07T21:41:34.261789] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-07T21:41:34.419017] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-07T21:41:34.419112] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-07T21:41:34.419553] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-07T21:41:34.419594] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-07T21:41:34.420216] [DEBUG] [LOCAL ] SST: Trimmed 18713 records to 11825 (keeping 200 days of data) [2025-10-07T21:41:34.491557] [DEBUG] [LOCAL ] SST: Primary data saved (11825 records). [2025-10-07T21:41:34.491768] [INFO ] [MAIN ] SST: Full history saved. [2025-10-07T21:41:34.491870] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SST took 33.6s. Estimated remaining: 52m 23s. Rate: 7.1 symbols/min [2025-10-07T21:41:35.436862] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T21:41:35.443227] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-07T21:41:36.395378] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T21:41:36.402398] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-07T21:41:37.577180] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T21:41:37.583561] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-07T21:41:38.686390] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T21:41:38.694423] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-07T21:41:39.477720] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T21:41:39.479895] [INFO ] [REMOTE ] SSTK: Full fetch complete (41799 records). [2025-10-07T21:41:39.480098] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-07T21:41:39.879394] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-07T21:41:39.879515] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-07T21:41:39.880372] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-07T21:41:39.880439] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-07T21:41:39.881863] [DEBUG] [LOCAL ] SSTK: Trimmed 41799 records to 25665 (keeping 200 days of data) [2025-10-07T21:41:40.048937] [DEBUG] [LOCAL ] SSTK: Primary data saved (25665 records). [2025-10-07T21:41:40.049111] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-07T21:41:40.049224] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SSTK took 21.5s. Estimated remaining: 52m 14s. Rate: 7.1 symbols/min [2025-10-07T21:41:40.632882] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:41:40.697112] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:41:40.726034] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:41:40.791587] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:41:40.815255] [DEBUG] [LOCAL ] STC: Loaded 17440 existing records from primary storage. [2025-10-07T21:41:40.816067] [INFO ] [MAIN ] STC: Loaded 17440 existing records. [2025-10-07T21:41:40.977535] [DEBUG] [LOCAL ] STE: Loaded 35488 existing records from primary storage. [2025-10-07T21:41:40.984453] [INFO ] [MAIN ] STE: Loaded 35488 existing records. [2025-10-07T21:41:41.157476] [DEBUG] [LOCAL ] ST: Loaded 49761 existing records from primary storage. [2025-10-07T21:41:41.162494] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:41:41.192632] [DEBUG] [LOCAL ] STAG: Loaded 50094 existing records from primary storage. [2025-10-07T21:41:41.193475] [INFO ] [MAIN ] ST: Loaded 49761 existing records. [2025-10-07T21:41:41.193100] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-07T21:41:41.198898] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-07T21:41:41.216592] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-07T21:41:41.228880] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-07T21:41:41.234501] [INFO ] [MAIN ] STAG: Loaded 50094 existing records. [2025-10-07T21:41:41.704391] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:41:41.786360] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-07T21:41:41.956086] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:41:41.927545] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-07T21:41:41.953017] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:41:41.979995] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-07T21:41:41.995694] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-07T21:41:41.990514] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-07T21:41:42.007507] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-07T21:41:42.025341] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-07T21:41:42.030826] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-07T21:41:42.030728] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-07T21:41:42.042467] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-07T21:41:42.078298] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-07T21:41:42.097403] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-07T21:41:42.531092] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:41:42.623835] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-07T21:41:43.172073] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:41:43.207287] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-07T21:41:43.201672] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:41:43.266944] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-07T21:41:43.272590] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:41:43.274325] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-07T21:41:43.775976] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-07T21:41:43.780527] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-07T21:41:44.811819] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T21:41:44.819790] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-07T21:41:44.832625] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T21:41:44.837923] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-07T21:41:44.979085] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T21:41:44.990415] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-07T21:41:45.049231] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T21:41:45.060891] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-07T21:41:45.760820] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T21:41:45.765527] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-07T21:41:46.360517] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T21:41:46.368881] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-07T21:41:46.463837] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-07T21:41:46.507178] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T21:41:46.658047] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T21:41:47.047707] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-07T21:41:47.503275] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T21:41:47.847660] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-07T21:41:48.146720] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T21:41:48.647695] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-07T21:41:49.453829] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-07T21:41:49.460450] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T21:41:49.936860] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T21:41:50.247755] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-07T21:41:51.010045] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T21:41:51.047604] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-07T21:41:51.329373] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T21:41:51.847723] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-07T21:41:52.647712] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-07T21:41:52.831929] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T21:41:53.360455] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-07T21:41:53.447618] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-07T21:41:53.628431] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T21:41:54.247697] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-07T21:41:55.051533] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-07T21:41:55.073972] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T21:41:55.217024] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T21:41:55.847763] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-07T21:41:56.647671] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-07T21:41:56.860234] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T21:41:56.885543] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T21:41:57.447686] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-07T21:41:58.033909] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T21:41:58.247666] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-07T21:41:58.511758] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-07T21:41:59.047744] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-07T21:41:59.732151] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T21:41:59.847772] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-07T21:42:00.497543] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T21:42:00.602946] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T21:42:00.604528] [INFO ] [REMOTE ] STC: Full fetch complete (25784 records). [2025-10-07T21:42:00.604624] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-07T21:42:00.652751] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-07T21:42:00.986730] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-07T21:42:00.986852] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-07T21:42:00.987428] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-07T21:42:00.987470] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-07T21:42:00.988205] [DEBUG] [LOCAL ] STC: Trimmed 25784 records to 17406 (keeping 200 days of data) [2025-10-07T21:42:01.102413] [DEBUG] [LOCAL ] STC: Primary data saved (17406 records). [2025-10-07T21:42:01.102606] [INFO ] [MAIN ] STC: Full history saved. [2025-10-07T21:42:01.102733] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 21.0s. Estimated remaining: 52m 8s. Rate: 7.1 symbols/min [2025-10-07T21:42:01.279693] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:42:01.304181] [DEBUG] [LOCAL ] STEL: Loaded 23004 existing records from primary storage. [2025-10-07T21:42:01.304542] [INFO ] [MAIN ] STEL: Loaded 23004 existing records. [2025-10-07T21:42:01.452915] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-07T21:42:01.482236] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:42:01.484002] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-07T21:42:01.484116] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-07T21:42:01.484916] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-07T21:42:01.484991] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-07T21:42:01.867593] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:42:02.243938] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T21:42:02.251204] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-07T21:42:03.047638] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-07T21:42:03.350377] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T21:42:03.394017] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T21:42:03.847812] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-07T21:42:04.647628] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-07T21:42:04.702927] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T21:42:04.724838] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T21:42:05.447694] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-07T21:42:06.168535] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T21:42:06.247746] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-07T21:42:07.047873] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-07T21:42:07.089220] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-07T21:42:07.438459] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T21:42:07.441347] [INFO ] [REMOTE ] STE: Full fetch complete (50725 records). [2025-10-07T21:42:07.441439] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-07T21:42:07.863144] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-07T21:42:07.863004] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-07T21:42:07.889320] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-07T21:42:07.890131] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-07T21:42:07.892104] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-07T21:42:07.892178] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-07T21:42:07.893799] [DEBUG] [LOCAL ] STE: Trimmed 50725 records to 35541 (keeping 200 days of data) [2025-10-07T21:42:08.157135] [DEBUG] [LOCAL ] STE: Primary data saved (35541 records). [2025-10-07T21:42:08.157357] [INFO ] [MAIN ] STE: Full history saved. [2025-10-07T21:42:08.157485] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. STE took 28.1s. Estimated remaining: 51m 59s. Rate: 7.1 symbols/min [2025-10-07T21:42:08.342567] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:42:08.384905] [DEBUG] [LOCAL ] STEM: Loaded 39194 existing records from primary storage. [2025-10-07T21:42:08.385351] [INFO ] [MAIN ] STEM: Loaded 39194 existing records. [2025-10-07T21:42:08.600389] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:42:08.600733] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-07T21:42:08.600795] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-07T21:42:08.601799] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-07T21:42:08.601862] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-07T21:42:08.659789] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-07T21:42:09.000635] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:42:09.447672] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-07T21:42:09.655312] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T21:42:10.247628] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-07T21:42:10.270477] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T21:42:10.315242] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T21:42:11.047716] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-07T21:42:11.622610] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-07T21:42:11.847768] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-07T21:42:12.647634] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-07T21:42:12.805909] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T21:42:13.051341] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-07T21:42:13.447704] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-07T21:42:14.247760] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-07T21:42:14.587123] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T21:42:14.844217] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-07T21:42:15.047755] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-07T21:42:15.847707] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-07T21:42:16.082890] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T21:42:16.107155] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T21:42:16.647700] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-07T21:42:17.447689] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-07T21:42:17.568551] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-07T21:42:17.786091] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-07T21:42:18.247744] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-07T21:42:19.047730] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-07T21:42:19.657405] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-07T21:42:19.815398] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-07T21:42:19.847604] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-07T21:42:20.535340] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T21:42:20.647686] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-07T21:42:21.447632] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-07T21:42:21.691639] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T21:42:21.768509] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T21:42:21.772292] [INFO ] [REMOTE ] STAG: Full fetch complete (72213 records). [2025-10-07T21:42:21.772412] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-07T21:42:22.167601] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-07T21:42:22.167770] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-07T21:42:22.169013] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-07T21:42:22.169083] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-07T21:42:22.171369] [DEBUG] [LOCAL ] STAG: Trimmed 72213 records to 50117 (keeping 200 days of data) [2025-10-07T21:42:22.274158] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-07T21:42:22.517551] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T21:42:22.543539] [DEBUG] [LOCAL ] STAG: Primary data saved (50117 records). [2025-10-07T21:42:22.543726] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-07T21:42:22.543828] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. STAG took 42.5s. Estimated remaining: 51m 52s. Rate: 7.1 symbols/min [2025-10-07T21:42:22.719385] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:42:22.738617] [DEBUG] [LOCAL ] STEW: Loaded 16142 existing records from primary storage. [2025-10-07T21:42:22.738962] [INFO ] [MAIN ] STEW: Loaded 16142 existing records. [2025-10-07T21:42:22.920891] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:42:22.921178] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-07T21:42:22.921228] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-07T21:42:22.921706] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-07T21:42:22.921771] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-07T21:42:23.061213] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-07T21:42:23.290162] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:42:23.847770] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-07T21:42:24.100150] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T21:42:24.429088] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T21:42:24.433678] [INFO ] [REMOTE ] ST: Full fetch complete (71968 records). [2025-10-07T21:42:24.433863] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-07T21:42:24.666242] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-07T21:42:24.853719] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-07T21:42:24.853897] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-07T21:42:24.855996] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-07T21:42:24.855620] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-07T21:42:24.860177] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-07T21:42:24.861519] [DEBUG] [LOCAL ] ST: Trimmed 71968 records to 49790 (keeping 200 days of data) [2025-10-07T21:42:25.203828] [DEBUG] [LOCAL ] ST: Primary data saved (49790 records). [2025-10-07T21:42:25.204441] [INFO ] [MAIN ] ST: Full history saved. [2025-10-07T21:42:25.204682] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. ST took 45.1s. Estimated remaining: 51m 42s. Rate: 7.1 symbols/min [2025-10-07T21:42:25.377572] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:42:25.377861] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-07T21:42:25.377964] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-07T21:42:25.378309] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-07T21:42:25.378390] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-07T21:42:25.378467] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-07T21:42:25.378506] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-07T21:42:25.449284] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-07T21:42:25.752373] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:42:25.765980] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T21:42:26.247637] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-07T21:42:26.262233] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T21:42:26.580168] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-07T21:42:27.047712] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-07T21:42:27.847751] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-07T21:42:28.287629] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-07T21:42:28.647626] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-07T21:42:28.685964] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T21:42:29.447614] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-07T21:42:29.534598] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T21:42:29.536438] [INFO ] [REMOTE ] STEL: Full fetch complete (32099 records). [2025-10-07T21:42:29.536535] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-07T21:42:29.918837] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-07T21:42:29.918938] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-07T21:42:29.919637] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-07T21:42:29.919719] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-07T21:42:29.920533] [DEBUG] [LOCAL ] STEL: Trimmed 32099 records to 22963 (keeping 200 days of data) [2025-10-07T21:42:30.071582] [DEBUG] [LOCAL ] STEL: Primary data saved (22963 records). [2025-10-07T21:42:30.071780] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-07T21:42:30.071885] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STEL took 29.0s. Estimated remaining: 51m 33s. Rate: 7.1 symbols/min [2025-10-07T21:42:30.242977] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:42:30.249278] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-07T21:42:30.255576] [DEBUG] [LOCAL ] STK: Loaded 9525 existing records from primary storage. [2025-10-07T21:42:30.255887] [INFO ] [MAIN ] STK: Loaded 9525 existing records. [2025-10-07T21:42:30.438057] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:42:30.438386] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-07T21:42:30.438444] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-07T21:42:30.439104] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-07T21:42:30.439172] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-07T21:42:30.801909] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:42:31.047731] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-07T21:42:31.300096] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T21:42:31.327329] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T21:42:31.383629] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-07T21:42:31.847690] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-07T21:42:32.647633] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-07T21:42:32.827999] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-07T21:42:33.447683] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-07T21:42:34.247665] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-07T21:42:34.309680] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T21:42:34.521497] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T21:42:34.705365] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-07T21:42:35.047718] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-07T21:42:35.847708] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-07T21:42:36.040148] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-07T21:42:36.647633] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-07T21:42:36.678690] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T21:42:37.447625] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-07T21:42:37.562175] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-07T21:42:38.247699] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-07T21:42:38.609373] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-07T21:42:39.031797] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T21:42:39.047605] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-07T21:42:39.837434] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T21:42:39.847599] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-07T21:42:40.571702] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T21:42:40.647606] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-07T21:42:41.447712] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-07T21:42:41.469681] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T21:42:41.783843] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-07T21:42:42.247710] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-07T21:42:42.656434] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-07T21:42:43.047710] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-07T21:42:43.829153] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T21:42:43.847606] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-07T21:42:44.541916] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:42:44.543352] [INFO ] [REMOTE ] STEW: Full fetch complete (21809 records). [2025-10-07T21:42:44.543423] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-07T21:42:44.652742] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-07T21:42:44.918323] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-07T21:42:44.918432] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-07T21:42:44.918950] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-07T21:42:44.919068] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-07T21:42:44.919876] [DEBUG] [LOCAL ] STEW: Trimmed 21809 records to 16168 (keeping 200 days of data) [2025-10-07T21:42:45.022956] [DEBUG] [LOCAL ] STEW: Primary data saved (16168 records). [2025-10-07T21:42:45.023158] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-07T21:42:45.023263] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEW took 22.5s. Estimated remaining: 51m 26s. Rate: 7.1 symbols/min [2025-10-07T21:42:45.102269] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T21:42:45.198041] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:42:45.254687] [DEBUG] [LOCAL ] STLA: Loaded 53551 existing records from primary storage. [2025-10-07T21:42:45.255068] [INFO ] [MAIN ] STLA: Loaded 53551 existing records. [2025-10-07T21:42:45.429203] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:42:45.429440] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-07T21:42:45.429488] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-07T21:42:45.430745] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-07T21:42:45.430808] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-07T21:42:45.452869] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-07T21:42:45.789049] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:42:46.247712] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-07T21:42:46.335318] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T21:42:47.047915] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-07T21:42:47.102270] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T21:42:47.847740] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-07T21:42:48.647760] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-07T21:42:48.987847] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T21:42:49.299779] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T21:42:49.447634] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-07T21:42:49.608696] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-07T21:42:49.877286] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T21:42:50.247705] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-07T21:42:51.034743] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T21:42:51.047623] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-07T21:42:51.847705] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-07T21:42:52.430120] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T21:42:52.647739] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-07T21:42:52.945860] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-07T21:42:53.447717] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-07T21:42:53.882248] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-07T21:42:54.015741] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-07T21:42:54.247705] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-07T21:42:55.047732] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-07T21:42:55.803850] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-07T21:42:55.847723] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-07T21:42:56.278307] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-07T21:42:56.647714] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-07T21:42:56.918329] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-07T21:42:56.919206] [INFO ] [REMOTE ] STG: Full fetch complete (2499 records). [2025-10-07T21:42:56.919278] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-07T21:42:57.154532] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-07T21:42:57.156075] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T21:42:57.156289] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:42:57.160308] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:42:57.160491] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-07T21:42:57.160621] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-07T21:42:57.160717] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-07T21:42:57.160837] [INFO ] [REMOTE ] STEM: Full fetch complete (61806 records). [2025-10-07T21:42:57.161135] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-07T21:42:57.161291] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-07T21:42:57.161684] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STG took 32.0s. Estimated remaining: 51m 18s. Rate: 7.1 symbols/min [2025-10-07T21:42:57.452803] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-07T21:42:57.490698] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:42:57.803826] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-07T21:42:57.803945] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-07T21:42:57.805150] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-07T21:42:57.819966] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-07T21:42:57.821248] [DEBUG] [LOCAL ] STM: Loaded 53574 existing records from primary storage. [2025-10-07T21:42:57.822255] [INFO ] [MAIN ] STM: Loaded 53574 existing records. [2025-10-07T21:42:57.886261] [DEBUG] [LOCAL ] STEM: Trimmed 61806 records to 39149 (keeping 200 days of data) [2025-10-07T21:42:58.095922] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:42:58.097106] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-07T21:42:58.097188] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-07T21:42:58.098837] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-07T21:42:58.098918] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-07T21:42:58.255277] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-07T21:42:58.487284] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:42:58.621857] [DEBUG] [LOCAL ] STEM: Primary data saved (39149 records). [2025-10-07T21:42:58.622044] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-07T21:42:58.622155] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEM took 50.5s. Estimated remaining: 51m 9s. Rate: 7.1 symbols/min [2025-10-07T21:42:58.801838] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:42:58.825031] [DEBUG] [LOCAL ] STN: Loaded 22823 existing records from primary storage. [2025-10-07T21:42:58.825388] [INFO ] [MAIN ] STN: Loaded 22823 existing records. [2025-10-07T21:42:59.004530] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:42:59.004862] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-07T21:42:59.004912] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-07T21:42:59.005692] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-07T21:42:59.005752] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-07T21:42:59.070015] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-07T21:42:59.135067] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T21:42:59.387984] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:42:59.681630] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-07T21:42:59.847694] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-07T21:43:00.647723] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-07T21:43:00.911748] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T21:43:01.330588] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-07T21:43:01.447694] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-07T21:43:02.247708] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-07T21:43:02.973883] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-07T21:43:03.054893] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-07T21:43:03.088112] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T21:43:03.298634] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T21:43:03.847721] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-07T21:43:04.647727] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-07T21:43:05.253543] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-07T21:43:05.396027] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T21:43:05.444387] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-07T21:43:05.447533] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-07T21:43:06.110394] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:43:06.111817] [INFO ] [REMOTE ] STK: Full fetch complete (14108 records). [2025-10-07T21:43:06.111891] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-07T21:43:06.252779] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-07T21:43:06.476251] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-07T21:43:06.476342] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-07T21:43:06.476792] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-07T21:43:06.476867] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-07T21:43:06.477379] [DEBUG] [LOCAL ] STK: Trimmed 14108 records to 9561 (keeping 200 days of data) [2025-10-07T21:43:06.537767] [DEBUG] [LOCAL ] STK: Primary data saved (9561 records). [2025-10-07T21:43:06.537930] [INFO ] [MAIN ] STK: Full history saved. [2025-10-07T21:43:06.538023] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STK took 36.5s. Estimated remaining: 51m 0s. Rate: 7.1 symbols/min [2025-10-07T21:43:06.731101] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:43:06.776284] [DEBUG] [LOCAL ] STNG: Loaded 43684 existing records from primary storage. [2025-10-07T21:43:06.776824] [INFO ] [MAIN ] STNG: Loaded 43684 existing records. [2025-10-07T21:43:06.990170] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:43:06.990472] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-07T21:43:06.990536] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-07T21:43:06.991673] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-07T21:43:06.991766] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-07T21:43:07.055758] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-07T21:43:07.400718] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:43:07.847709] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-07T21:43:08.160608] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T21:43:08.222074] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T21:43:08.647757] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-07T21:43:09.447699] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-07T21:43:09.562607] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T21:43:09.751794] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-07T21:43:10.247751] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-07T21:43:11.047728] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-07T21:43:11.403687] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-07T21:43:11.465808] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T21:43:11.847667] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-07T21:43:12.301813] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T21:43:12.647698] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-07T21:43:13.447626] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-07T21:43:13.925241] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T21:43:13.974389] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-07T21:43:14.247627] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-07T21:43:14.660491] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T21:43:15.047690] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-07T21:43:15.847677] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-07T21:43:15.952239] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T21:43:16.647635] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-07T21:43:16.940581] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T21:43:17.303594] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-07T21:43:17.447703] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-07T21:43:18.247639] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-07T21:43:18.408505] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T21:43:18.594107] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T21:43:19.047700] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-07T21:43:19.847740] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-07T21:43:20.172734] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T21:43:20.647748] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-07T21:43:20.734201] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T21:43:21.447746] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-07T21:43:21.504298] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T21:43:22.247705] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-07T21:43:22.824788] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-07T21:43:22.945021] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T21:43:23.047718] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-07T21:43:23.847759] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-07T21:43:24.402190] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-07T21:43:24.647748] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-07T21:43:25.017696] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-07T21:43:25.063142] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-07T21:43:25.447717] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-07T21:43:26.191472] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T21:43:26.247718] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-07T21:43:27.047716] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-07T21:43:27.478966] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T21:43:27.847623] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-07T21:43:27.885586] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T21:43:28.647613] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-07T21:43:28.719685] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T21:43:28.723685] [INFO ] [REMOTE ] STLA: Full fetch complete (77535 records). [2025-10-07T21:43:28.723879] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-07T21:43:29.127373] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-07T21:43:29.127511] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-07T21:43:29.128686] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-07T21:43:29.128757] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-07T21:43:29.130599] [DEBUG] [LOCAL ] STLA: Trimmed 77535 records to 53552 (keeping 200 days of data) [2025-10-07T21:43:29.447684] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-07T21:43:29.469724] [DEBUG] [LOCAL ] STLA: Primary data saved (53552 records). [2025-10-07T21:43:29.469979] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-07T21:43:29.470094] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STLA took 44.4s. Estimated remaining: 50m 54s. Rate: 7.1 symbols/min [2025-10-07T21:43:29.654626] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:43:29.664262] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-07T21:43:29.669248] [INFO ] [REMOTE ] STM: Full fetch complete (77526 records). [2025-10-07T21:43:29.669455] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-07T21:43:29.759146] [DEBUG] [LOCAL ] STRV: Loaded 11323 existing records from primary storage. [2025-10-07T21:43:29.764852] [INFO ] [MAIN ] STRV: Loaded 11323 existing records. [2025-10-07T21:43:29.932265] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T21:43:30.235866] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:43:30.273818] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-07T21:43:30.285431] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-07T21:43:30.339443] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-07T21:43:30.339755] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-07T21:43:30.339830] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-07T21:43:30.341233] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-07T21:43:30.341179] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-07T21:43:30.341560] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-07T21:43:30.341638] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-07T21:43:30.449495] [DEBUG] [LOCAL ] STM: Trimmed 77526 records to 53573 (keeping 200 days of data) [2025-10-07T21:43:30.838887] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:43:31.058414] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-07T21:43:31.087106] [DEBUG] [LOCAL ] STM: Primary data saved (53573 records). [2025-10-07T21:43:31.087258] [INFO ] [MAIN ] STM: Full history saved. [2025-10-07T21:43:31.087348] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STM took 33.9s. Estimated remaining: 50m 44s. Rate: 7.1 symbols/min [2025-10-07T21:43:31.156639] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T21:43:31.170050] [INFO ] [REMOTE ] STN: Full fetch complete (32380 records). [2025-10-07T21:43:31.180511] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-07T21:43:31.347367] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T21:43:31.387818] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:43:31.720924] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-07T21:43:31.721042] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-07T21:43:31.721811] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-07T21:43:31.721882] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-07T21:43:31.723089] [DEBUG] [LOCAL ] STN: Trimmed 32380 records to 22825 (keeping 200 days of data) [2025-10-07T21:43:31.833005] [DEBUG] [LOCAL ] STT: Loaded 50958 existing records from primary storage. [2025-10-07T21:43:31.834680] [INFO ] [MAIN ] STT: Loaded 50958 existing records. [2025-10-07T21:43:31.851107] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-07T21:43:32.035326] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:43:32.035665] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-07T21:43:32.036325] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-07T21:43:32.037887] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-07T21:43:32.038457] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-07T21:43:32.183258] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T21:43:32.437535] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:43:32.469451] [DEBUG] [LOCAL ] STN: Primary data saved (22825 records). [2025-10-07T21:43:32.469625] [INFO ] [MAIN ] STN: Full history saved. [2025-10-07T21:43:32.469751] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STN took 33.8s. Estimated remaining: 50m 35s. Rate: 7.1 symbols/min [2025-10-07T21:43:32.638501] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:43:32.638784] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-07T21:43:32.638836] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-07T21:43:32.638948] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-07T21:43:32.638990] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-07T21:43:32.639031] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-07T21:43:32.639063] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-07T21:43:32.652768] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-07T21:43:32.992307] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:43:33.299638] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T21:43:33.447611] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-07T21:43:33.672889] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:43:33.673258] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-07T21:43:33.673351] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:43:33.673400] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-07T21:43:33.673459] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:43:33.673534] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-07T21:43:33.673604] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-07T21:43:33.673662] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-07T21:43:33.673733] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-07T21:43:33.673786] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STUB took 1.2s. Estimated remaining: 50m 25s. Rate: 7.1 symbols/min [2025-10-07T21:43:33.839586] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:43:33.867879] [DEBUG] [LOCAL ] STVN: Loaded 26428 existing records from primary storage. [2025-10-07T21:43:33.868193] [INFO ] [MAIN ] STVN: Loaded 26428 existing records. [2025-10-07T21:43:34.055932] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:43:34.056181] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-07T21:43:34.056236] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-07T21:43:34.057048] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-07T21:43:34.057106] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-07T21:43:34.252993] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-07T21:43:34.429771] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:43:34.519625] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T21:43:35.047616] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-07T21:43:35.206444] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T21:43:35.847687] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-07T21:43:36.393720] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T21:43:36.396592] [INFO ] [REMOTE ] STNG: Full fetch complete (64356 records). [2025-10-07T21:43:36.396753] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-07T21:43:36.652950] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-07T21:43:36.793451] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-07T21:43:36.793558] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-07T21:43:36.794715] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-07T21:43:36.794821] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-07T21:43:36.799318] [DEBUG] [LOCAL ] STNG: Trimmed 64356 records to 43696 (keeping 200 days of data) [2025-10-07T21:43:37.068704] [DEBUG] [LOCAL ] STNG: Primary data saved (43696 records). [2025-10-07T21:43:37.068857] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-07T21:43:37.068941] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STNG took 30.5s. Estimated remaining: 50m 16s. Rate: 7.1 symbols/min [2025-10-07T21:43:37.236615] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:43:37.288571] [DEBUG] [LOCAL ] STWD: Loaded 51917 existing records from primary storage. [2025-10-07T21:43:37.289021] [INFO ] [MAIN ] STWD: Loaded 51917 existing records. [2025-10-07T21:43:37.472934] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:43:37.467292] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-07T21:43:37.474301] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-07T21:43:37.474421] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-07T21:43:37.475744] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-07T21:43:37.475804] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-07T21:43:37.829571] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-07T21:43:37.915834] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:43:38.002876] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T21:43:38.031907] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T21:43:38.247711] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-07T21:43:39.047749] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-07T21:43:39.208110] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T21:43:39.847756] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-07T21:43:40.630445] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T21:43:40.647607] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-07T21:43:40.823960] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-07T21:43:41.447698] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-07T21:43:42.032930] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-07T21:43:42.057258] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T21:43:42.247679] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-07T21:43:43.047730] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-07T21:43:43.847723] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-07T21:43:43.886545] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-07T21:43:43.957303] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T21:43:44.647736] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-07T21:43:45.442215] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T21:43:45.453216] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-07T21:43:45.502327] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T21:43:46.199076] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T21:43:46.247719] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-07T21:43:47.047778] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-07T21:43:47.847632] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-07T21:43:47.889899] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T21:43:47.956358] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T21:43:48.647689] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-07T21:43:49.447678] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-07T21:43:49.617889] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T21:43:49.999786] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T21:43:50.247724] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-07T21:43:51.047804] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-07T21:43:51.121483] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T21:43:51.847726] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-07T21:43:51.917266] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T21:43:51.966676] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T21:43:52.647721] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-07T21:43:53.459402] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-07T21:43:53.464219] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T21:43:54.247616] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-07T21:43:54.480525] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T21:43:54.614238] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T21:43:55.047690] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-07T21:43:55.847638] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-07T21:43:55.941178] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T21:43:56.647669] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-07T21:43:56.686705] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T21:43:57.021035] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T21:43:57.447664] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-07T21:43:58.247629] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-07T21:43:58.392770] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T21:43:59.034287] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T21:43:59.047624] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-07T21:43:59.219297] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T21:43:59.847712] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-07T21:44:00.564928] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T21:44:00.658322] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-07T21:44:00.693618] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T21:44:01.397860] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T21:44:01.401483] [INFO ] [REMOTE ] STRV: Full fetch complete (18001 records). [2025-10-07T21:44:01.401802] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-07T21:44:01.452972] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-07T21:44:01.986772] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-07T21:44:01.986924] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-07T21:44:01.987530] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-07T21:44:01.987591] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-07T21:44:01.988666] [DEBUG] [LOCAL ] STRV: Trimmed 18001 records to 11304 (keeping 200 days of data) [2025-10-07T21:44:02.073055] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T21:44:02.083143] [INFO ] [REMOTE ] STT: Full fetch complete (74311 records). [2025-10-07T21:44:02.085177] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-07T21:44:02.249118] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-07T21:44:02.272607] [DEBUG] [LOCAL ] STRV: Primary data saved (11304 records). [2025-10-07T21:44:02.309281] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-07T21:44:02.315593] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STRV took 32.8s. Estimated remaining: 50m 10s. Rate: 7.1 symbols/min [2025-10-07T21:44:02.743141] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:44:02.768823] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-07T21:44:02.768977] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-07T21:44:02.770214] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-07T21:44:02.770373] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-07T21:44:02.773491] [DEBUG] [LOCAL ] STXD: Loaded 1275 existing records from primary storage. [2025-10-07T21:44:02.773818] [INFO ] [MAIN ] STXD: Loaded 1275 existing records. [2025-10-07T21:44:02.818907] [DEBUG] [LOCAL ] STT: Trimmed 74311 records to 50964 (keeping 200 days of data) [2025-10-07T21:44:03.066263] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:44:03.062915] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-07T21:44:03.067255] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-07T21:44:03.069079] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-07T21:44:03.069872] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-07T21:44:03.070994] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-07T21:44:03.475310] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:44:03.606990] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-07T21:44:03.721559] [DEBUG] [LOCAL ] STT: Primary data saved (50964 records). [2025-10-07T21:44:03.721768] [INFO ] [MAIN ] STT: Full history saved. [2025-10-07T21:44:03.721883] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STT took 32.6s. Estimated remaining: 50m 0s. Rate: 7.1 symbols/min [2025-10-07T21:44:03.852907] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-07T21:44:03.900963] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:44:03.904916] [DEBUG] [LOCAL ] STXE: Loaded 2119 existing records from primary storage. [2025-10-07T21:44:03.905116] [INFO ] [MAIN ] STXE: Loaded 2119 existing records. [2025-10-07T21:44:04.079905] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:44:04.080139] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-07T21:44:04.080242] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-07T21:44:04.080473] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-07T21:44:04.080530] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-07T21:44:04.429089] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:44:04.647702] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-07T21:44:04.785039] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T21:44:05.225530] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T21:44:05.350236] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T21:44:05.447628] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-07T21:44:06.247739] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-07T21:44:06.710730] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-07T21:44:06.783978] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T21:44:07.047701] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-07T21:44:07.847638] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-07T21:44:08.061307] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T21:44:08.064879] [INFO ] [REMOTE ] STVN: Full fetch complete (39320 records). [2025-10-07T21:44:08.064981] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-07T21:44:08.465694] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-07T21:44:08.465794] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-07T21:44:08.466601] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-07T21:44:08.466685] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-07T21:44:08.467619] [DEBUG] [LOCAL ] STVN: Trimmed 39320 records to 26531 (keeping 200 days of data) [2025-10-07T21:44:08.639160] [DEBUG] [LOCAL ] STVN: Primary data saved (26531 records). [2025-10-07T21:44:08.639351] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-07T21:44:08.639454] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STVN took 35.0s. Estimated remaining: 49m 51s. Rate: 7.1 symbols/min [2025-10-07T21:44:08.652952] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-07T21:44:08.834509] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:44:08.839173] [DEBUG] [LOCAL ] STXG: Loaded 2476 existing records from primary storage. [2025-10-07T21:44:08.839361] [INFO ] [MAIN ] STXG: Loaded 2476 existing records. [2025-10-07T21:44:09.017493] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:44:09.017789] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-07T21:44:09.017843] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-07T21:44:09.018049] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-07T21:44:09.018108] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-07T21:44:09.244176] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-07T21:44:09.402548] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:44:09.447621] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-07T21:44:09.639601] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T21:44:09.890335] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-07T21:44:10.247743] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-07T21:44:10.735448] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-07T21:44:11.047741] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-07T21:44:11.700174] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T21:44:11.847700] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-07T21:44:12.424623] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-07T21:44:12.647749] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-07T21:44:13.114850] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-07T21:44:13.447702] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-07T21:44:14.247703] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-07T21:44:14.906573] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T21:44:15.047697] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-07T21:44:15.225058] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T21:44:15.629941] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T21:44:15.847702] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-07T21:44:16.408272] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T21:44:16.647714] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-07T21:44:17.209214] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-07T21:44:17.447677] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-07T21:44:17.928685] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-07T21:44:18.247702] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-07T21:44:19.047695] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-07T21:44:19.522634] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-07T21:44:19.754680] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T21:44:19.758474] [INFO ] [REMOTE ] STWD: Full fetch complete (75194 records). [2025-10-07T21:44:19.758636] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-07T21:44:19.855717] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-07T21:44:20.190754] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-07T21:44:20.190852] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-07T21:44:20.191971] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-07T21:44:20.192038] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-07T21:44:20.193753] [DEBUG] [LOCAL ] STWD: Trimmed 75194 records to 51920 (keeping 200 days of data) [2025-10-07T21:44:20.389833] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-07T21:44:20.530330] [DEBUG] [LOCAL ] STWD: Primary data saved (51920 records). [2025-10-07T21:44:20.530521] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-07T21:44:20.530618] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STWD took 43.5s. Estimated remaining: 49m 44s. Rate: 7.1 symbols/min [2025-10-07T21:44:20.652755] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-07T21:44:20.703072] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:44:20.706361] [DEBUG] [LOCAL ] STXK: Loaded 1497 existing records from primary storage. [2025-10-07T21:44:20.706555] [INFO ] [MAIN ] STXK: Loaded 1497 existing records. [2025-10-07T21:44:20.892029] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:44:20.892434] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-07T21:44:20.892500] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-07T21:44:20.892778] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-07T21:44:20.892854] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-07T21:44:21.160724] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-07T21:44:21.256319] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:44:21.447632] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-07T21:44:22.050506] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T21:44:22.247666] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-07T21:44:22.686301] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-07T21:44:23.047633] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-07T21:44:23.573904] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-07T21:44:23.847699] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-07T21:44:24.277698] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-07T21:44:24.647691] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-07T21:44:25.000936] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-07T21:44:25.447679] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-07T21:44:25.866518] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-07T21:44:26.247701] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-07T21:44:26.691241] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-07T21:44:27.047696] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-07T21:44:27.552406] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-07T21:44:27.847695] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-07T21:44:28.273981] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T21:44:28.647698] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-07T21:44:29.148720] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-07T21:44:29.447675] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-07T21:44:29.812552] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-07T21:44:30.247698] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-07T21:44:30.696273] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T21:44:31.047697] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-07T21:44:31.397031] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-07T21:44:31.847694] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-07T21:44:32.271006] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-07T21:44:32.647691] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-07T21:44:33.092483] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T21:44:33.093396] [INFO ] [REMOTE ] STXE: Full fetch complete (3601 records). [2025-10-07T21:44:33.093472] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-07T21:44:33.459631] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-07T21:44:33.468417] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-07T21:44:33.468563] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-07T21:44:33.468762] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-07T21:44:33.468825] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-07T21:44:33.469422] [DEBUG] [LOCAL ] STXE: Trimmed 3601 records to 2102 (keeping 200 days of data) [2025-10-07T21:44:33.483018] [DEBUG] [LOCAL ] STXE: Primary data saved (2102 records). [2025-10-07T21:44:33.483124] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-07T21:44:33.483212] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STXE took 29.8s. Estimated remaining: 49m 36s. Rate: 7.1 symbols/min [2025-10-07T21:44:33.648379] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:44:33.648594] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-07T21:44:33.648632] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-07T21:44:33.648778] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-07T21:44:33.648820] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-07T21:44:33.648860] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-07T21:44:33.648892] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-07T21:44:33.986406] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-07T21:44:34.000476] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:44:34.247698] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-07T21:44:34.687083] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-07T21:44:35.047704] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-07T21:44:35.321167] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-07T21:44:35.847729] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-07T21:44:36.309873] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-07T21:44:36.647687] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-07T21:44:37.002987] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-07T21:44:37.003836] [INFO ] [REMOTE ] STXG: Full fetch complete (4126 records). [2025-10-07T21:44:37.003905] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-07T21:44:37.352193] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-07T21:44:37.352306] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-07T21:44:37.352486] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-07T21:44:37.352527] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-07T21:44:37.352916] [DEBUG] [LOCAL ] STXG: Trimmed 4126 records to 2465 (keeping 200 days of data) [2025-10-07T21:44:37.368965] [DEBUG] [LOCAL ] STXG: Primary data saved (2465 records). [2025-10-07T21:44:37.369048] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-07T21:44:37.369127] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXG took 28.7s. Estimated remaining: 49m 27s. Rate: 7.1 symbols/min [2025-10-07T21:44:37.452748] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-07T21:44:37.536322] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:44:37.541392] [DEBUG] [LOCAL ] STXT: Loaded 2508 existing records from primary storage. [2025-10-07T21:44:37.541564] [INFO ] [MAIN ] STXT: Loaded 2508 existing records. [2025-10-07T21:44:37.717901] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:44:37.718249] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-07T21:44:37.718306] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-07T21:44:37.718617] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-07T21:44:37.718713] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-07T21:44:37.994877] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-07T21:44:38.099800] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:44:38.247714] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-07T21:44:38.811598] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-07T21:44:39.047728] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-07T21:44:39.587198] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-07T21:44:39.847710] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-07T21:44:40.302847] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-07T21:44:40.647703] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-07T21:44:40.915791] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-07T21:44:40.916552] [INFO ] [REMOTE ] STXD: Full fetch complete (2038 records). [2025-10-07T21:44:40.916622] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-07T21:44:41.266040] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-07T21:44:41.266142] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-07T21:44:41.266239] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-07T21:44:41.266280] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-07T21:44:41.266660] [DEBUG] [LOCAL ] STXD: Trimmed 2038 records to 1255 (keeping 200 days of data) [2025-10-07T21:44:41.275092] [DEBUG] [LOCAL ] STXD: Primary data saved (1255 records). [2025-10-07T21:44:41.275153] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-07T21:44:41.275222] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXD took 38.9s. Estimated remaining: 49m 17s. Rate: 7.1 symbols/min [2025-10-07T21:44:41.438281] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:44:41.441928] [DEBUG] [LOCAL ] STXV: Loaded 1556 existing records from primary storage. [2025-10-07T21:44:41.442065] [INFO ] [MAIN ] STXV: Loaded 1556 existing records. [2025-10-07T21:44:41.452960] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-07T21:44:41.616853] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:44:41.617106] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-07T21:44:41.617157] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-07T21:44:41.617512] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-07T21:44:41.617596] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-07T21:44:41.974768] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:44:41.986000] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-07T21:44:42.247696] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-07T21:44:42.648622] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-07T21:44:43.047745] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-07T21:44:43.475587] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-07T21:44:43.847696] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-07T21:44:44.259860] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-07T21:44:44.647674] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-07T21:44:45.108555] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-07T21:44:45.447675] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-07T21:44:45.870137] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-07T21:44:46.247718] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-07T21:44:46.586339] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-07T21:44:47.047736] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-07T21:44:47.484275] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-07T21:44:47.847700] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-07T21:44:48.200284] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-07T21:44:48.647709] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-07T21:44:49.120434] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-07T21:44:49.447684] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-07T21:44:49.906246] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-07T21:44:50.247717] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-07T21:44:50.707281] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-07T21:44:51.047733] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-07T21:44:51.493718] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-07T21:44:51.847727] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-07T21:44:52.465354] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-07T21:44:52.647699] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-07T21:44:53.086765] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-07T21:44:53.447768] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-07T21:44:53.781082] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-07T21:44:54.247755] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-07T21:44:54.592463] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-07T21:44:55.047720] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-07T21:44:55.529358] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-07T21:44:55.847676] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-07T21:44:56.320711] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-07T21:44:56.647685] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-07T21:44:57.069931] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-07T21:44:57.447670] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-07T21:44:57.814157] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-07T21:44:58.247695] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-07T21:44:58.611763] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-07T21:44:58.612529] [INFO ] [REMOTE ] STXK: Full fetch complete (2403 records). [2025-10-07T21:44:58.612598] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-07T21:44:58.966363] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-07T21:44:58.966555] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-07T21:44:58.966731] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-07T21:44:58.966795] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-07T21:44:58.967170] [DEBUG] [LOCAL ] STXK: Trimmed 2403 records to 1500 (keeping 200 days of data) [2025-10-07T21:44:58.977144] [DEBUG] [LOCAL ] STXK: Primary data saved (1500 records). [2025-10-07T21:44:58.977209] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-07T21:44:58.977292] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXK took 38.4s. Estimated remaining: 49m 11s. Rate: 7.1 symbols/min [2025-10-07T21:44:59.052784] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-07T21:44:59.147739] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:44:59.205714] [DEBUG] [LOCAL ] STZ: Loaded 52309 existing records from primary storage. [2025-10-07T21:44:59.206096] [INFO ] [MAIN ] STZ: Loaded 52309 existing records. [2025-10-07T21:44:59.383219] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:44:59.383475] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-07T21:44:59.383526] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-07T21:44:59.384892] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-07T21:44:59.384955] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-07T21:44:59.473782] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-07T21:44:59.753413] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:44:59.847711] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-07T21:45:00.647679] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-07T21:45:01.188843] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-07T21:45:01.447670] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-07T21:45:01.929429] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T21:45:02.252839] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-07T21:45:02.268047] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-07T21:45:02.718065] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:45:02.718900] [INFO ] [REMOTE ] STXT: Full fetch complete (3935 records). [2025-10-07T21:45:02.718971] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-07T21:45:03.058819] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-07T21:45:03.106350] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-07T21:45:03.106429] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-07T21:45:03.106575] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-07T21:45:03.106636] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-07T21:45:03.107032] [DEBUG] [LOCAL ] STXT: Trimmed 3935 records to 2495 (keeping 200 days of data) [2025-10-07T21:45:03.124878] [DEBUG] [LOCAL ] STXT: Primary data saved (2495 records). [2025-10-07T21:45:03.124948] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-07T21:45:03.125033] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXT took 25.8s. Estimated remaining: 49m 1s. Rate: 7.1 symbols/min [2025-10-07T21:45:03.294639] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:45:03.349216] [DEBUG] [LOCAL ] SU: Loaded 53436 existing records from primary storage. [2025-10-07T21:45:03.349598] [INFO ] [MAIN ] SU: Loaded 53436 existing records. [2025-10-07T21:45:03.467528] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-07T21:45:03.544168] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:45:03.544416] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-07T21:45:03.544464] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-07T21:45:03.545517] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-07T21:45:03.545581] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-07T21:45:03.852839] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-07T21:45:03.934712] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:45:04.572162] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-07T21:45:04.647740] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-07T21:45:05.447697] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-07T21:45:05.814829] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-07T21:45:06.247690] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-07T21:45:06.293299] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T21:45:06.534554] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-07T21:45:07.047704] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-07T21:45:07.847704] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-07T21:45:08.170285] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-07T21:45:08.517446] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T21:45:08.647711] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-07T21:45:09.093223] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-07T21:45:09.447666] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-07T21:45:09.713808] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-07T21:45:09.714615] [INFO ] [REMOTE ] STXM: Full fetch complete (1430 records). [2025-10-07T21:45:09.714733] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-07T21:45:09.902200] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-07T21:45:09.902442] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:45:09.902511] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:45:09.902561] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-07T21:45:09.902660] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-07T21:45:09.902721] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-07T21:45:09.902767] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-07T21:45:09.902834] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXM took 36.4s. Estimated remaining: 48m 53s. Rate: 7.1 symbols/min [2025-10-07T21:45:10.066583] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:45:10.115830] [DEBUG] [LOCAL ] SUI: Loaded 41603 existing records from primary storage. [2025-10-07T21:45:10.116341] [INFO ] [MAIN ] SUI: Loaded 41603 existing records. [2025-10-07T21:45:10.263260] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-07T21:45:10.314203] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:45:10.314594] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-07T21:45:10.314695] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-07T21:45:10.315933] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-07T21:45:10.315998] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-07T21:45:10.684117] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:45:11.047700] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-07T21:45:11.505738] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-07T21:45:11.847714] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-07T21:45:12.075635] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:45:12.647769] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-07T21:45:13.164160] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T21:45:13.447707] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-07T21:45:14.247756] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-07T21:45:14.517409] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-07T21:45:15.047629] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-07T21:45:15.269914] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T21:45:15.494690] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-07T21:45:15.847631] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-07T21:45:15.896889] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T21:45:16.647689] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-07T21:45:17.447683] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-07T21:45:17.722307] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-07T21:45:17.723133] [INFO ] [REMOTE ] STXV: Full fetch complete (2588 records). [2025-10-07T21:45:17.723203] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-07T21:45:18.126382] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-07T21:45:18.127365] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-07T21:45:18.127569] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-07T21:45:18.129350] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-07T21:45:18.129475] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-07T21:45:18.141275] [DEBUG] [LOCAL ] STXV: Trimmed 2588 records to 1552 (keeping 200 days of data) [2025-10-07T21:45:18.152525] [DEBUG] [LOCAL ] STXV: Primary data saved (1552 records). [2025-10-07T21:45:18.152610] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-07T21:45:18.152736] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXV took 36.9s. Estimated remaining: 48m 44s. Rate: 7.1 symbols/min [2025-10-07T21:45:18.252541] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-07T21:45:18.331168] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:45:18.374739] [DEBUG] [LOCAL ] SUN: Loaded 37773 existing records from primary storage. [2025-10-07T21:45:18.375069] [INFO ] [MAIN ] SUN: Loaded 37773 existing records. [2025-10-07T21:45:18.558963] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:45:18.559305] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-07T21:45:18.559381] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-07T21:45:18.560217] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-07T21:45:18.560279] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-07T21:45:18.690587] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T21:45:18.957924] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:45:19.047695] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-07T21:45:19.847694] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-07T21:45:20.465792] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-07T21:45:20.504916] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-07T21:45:20.647706] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-07T21:45:21.371749] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T21:45:21.447677] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-07T21:45:22.097287] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T21:45:22.247701] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-07T21:45:23.055087] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-07T21:45:23.073895] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T21:45:23.847619] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-07T21:45:23.948509] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T21:45:24.135996] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T21:45:24.647684] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-07T21:45:25.447663] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-07T21:45:25.517277] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T21:45:26.247665] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-07T21:45:26.673268] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T21:45:26.876163] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T21:45:27.047698] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-07T21:45:27.428445] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T21:45:27.847750] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-07T21:45:28.647619] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-07T21:45:28.675012] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T21:45:29.447704] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-07T21:45:29.648419] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T21:45:30.089459] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T21:45:30.247614] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-07T21:45:30.999934] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T21:45:31.047605] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-07T21:45:31.847678] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-07T21:45:31.920141] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T21:45:32.647665] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-07T21:45:32.729844] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T21:45:33.027904] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T21:45:33.447705] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-07T21:45:34.247672] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-07T21:45:34.701529] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-07T21:45:35.047632] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-07T21:45:35.269737] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T21:45:35.751281] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T21:45:35.847676] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-07T21:45:36.343303] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T21:45:36.647702] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-07T21:45:37.447679] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-07T21:45:37.608521] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-07T21:45:38.146050] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T21:45:38.247624] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-07T21:45:39.047639] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-07T21:45:39.090061] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T21:45:39.708859] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T21:45:39.847639] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-07T21:45:40.580443] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T21:45:40.647728] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-07T21:45:41.316046] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T21:45:41.447667] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-07T21:45:41.633850] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T21:45:41.639462] [INFO ] [REMOTE ] SUI: Full fetch complete (60850 records). [2025-10-07T21:45:41.639601] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-07T21:45:42.021779] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-07T21:45:42.021878] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-07T21:45:42.022977] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-07T21:45:42.023044] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-07T21:45:42.024921] [DEBUG] [LOCAL ] SUI: Trimmed 60850 records to 41630 (keeping 200 days of data) [2025-10-07T21:45:42.255454] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-07T21:45:42.305907] [DEBUG] [LOCAL ] SUI: Primary data saved (41630 records). [2025-10-07T21:45:42.306060] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-07T21:45:42.306149] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. SUI took 32.4s. Estimated remaining: 48m 38s. Rate: 7.1 symbols/min [2025-10-07T21:45:42.507592] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:45:42.542720] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-07T21:45:42.558414] [INFO ] [REMOTE ] SUN: Full fetch complete (55157 records). [2025-10-07T21:45:42.559956] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-07T21:45:42.560978] [DEBUG] [LOCAL ] SUPV: Loaded 47383 existing records from primary storage. [2025-10-07T21:45:42.593014] [INFO ] [MAIN ] SUPV: Loaded 47383 existing records. [2025-10-07T21:45:42.953700] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:45:42.990677] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-07T21:45:43.016059] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-07T21:45:43.037270] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-07T21:45:43.054199] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-07T21:45:43.054067] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-07T21:45:43.339693] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-07T21:45:43.355915] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-07T21:45:43.357166] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-07T21:45:43.359119] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-07T21:45:43.478025] [DEBUG] [LOCAL ] SUN: Trimmed 55157 records to 37843 (keeping 200 days of data) [2025-10-07T21:45:43.621591] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:45:43.797798] [DEBUG] [LOCAL ] SUN: Primary data saved (37843 records). [2025-10-07T21:45:43.797995] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-07T21:45:43.798155] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SUN took 25.6s. Estimated remaining: 48m 29s. Rate: 7.1 symbols/min [2025-10-07T21:45:43.860259] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-07T21:45:43.969705] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:45:44.014248] [DEBUG] [LOCAL ] SUZ: Loaded 45512 existing records from primary storage. [2025-10-07T21:45:44.014659] [INFO ] [MAIN ] SUZ: Loaded 45512 existing records. [2025-10-07T21:45:44.191616] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:45:44.191900] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-07T21:45:44.192015] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-07T21:45:44.192942] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-07T21:45:44.193009] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-07T21:45:44.594048] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:45:44.596791] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-07T21:45:44.640841] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T21:45:44.644514] [INFO ] [REMOTE ] SU: Full fetch complete (77385 records). [2025-10-07T21:45:44.644665] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-07T21:45:44.656917] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-07T21:45:45.031328] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-07T21:45:45.031425] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-07T21:45:45.032535] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-07T21:45:45.032601] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-07T21:45:45.034310] [DEBUG] [LOCAL ] SU: Trimmed 77385 records to 53435 (keeping 200 days of data) [2025-10-07T21:45:45.372754] [DEBUG] [LOCAL ] SU: Primary data saved (53435 records). [2025-10-07T21:45:45.372915] [INFO ] [MAIN ] SU: Full history saved. [2025-10-07T21:45:45.373006] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. SU took 42.2s. Estimated remaining: 48m 19s. Rate: 7.1 symbols/min [2025-10-07T21:45:45.453139] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-07T21:45:45.546293] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:45:45.574702] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T21:45:45.616855] [DEBUG] [LOCAL ] SVV: Loaded 39823 existing records from primary storage. [2025-10-07T21:45:45.617224] [INFO ] [MAIN ] SVV: Loaded 39823 existing records. [2025-10-07T21:45:45.806982] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:45:45.807241] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-07T21:45:45.807291] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-07T21:45:45.808110] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-07T21:45:45.808170] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-07T21:45:46.253051] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-07T21:45:46.375924] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:45:46.415443] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T21:45:47.047773] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-07T21:45:47.523371] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-07T21:45:47.847679] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-07T21:45:48.084893] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T21:45:48.099636] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T21:45:48.647706] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-07T21:45:49.447673] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-07T21:45:49.563738] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-07T21:45:49.568258] [INFO ] [REMOTE ] STZ: Full fetch complete (75902 records). [2025-10-07T21:45:49.568407] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-07T21:45:50.014000] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-07T21:45:50.014299] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-07T21:45:50.015566] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-07T21:45:50.015681] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-07T21:45:50.020322] [DEBUG] [LOCAL ] STZ: Trimmed 75902 records to 52326 (keeping 200 days of data) [2025-10-07T21:45:50.152510] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T21:45:50.259192] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-07T21:45:50.420834] [DEBUG] [LOCAL ] STZ: Primary data saved (52326 records). [2025-10-07T21:45:50.421038] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-07T21:45:50.422307] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. STZ took 51.4s. Estimated remaining: 48m 10s. Rate: 7.1 symbols/min [2025-10-07T21:45:50.589056] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:45:50.646099] [DEBUG] [LOCAL ] SW: Loaded 53169 existing records from primary storage. [2025-10-07T21:45:50.646464] [INFO ] [MAIN ] SW: Loaded 53169 existing records. [2025-10-07T21:45:50.822685] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:45:50.822934] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-07T21:45:50.822984] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-07T21:45:50.824063] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-07T21:45:50.824123] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-07T21:45:51.065562] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-07T21:45:51.178679] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:45:51.204421] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T21:45:51.684104] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T21:45:51.847711] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-07T21:45:52.434791] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-07T21:45:52.647749] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-07T21:45:53.075751] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T21:45:53.447750] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-07T21:45:54.201843] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T21:45:54.247603] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-07T21:45:55.047611] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-07T21:45:55.079094] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T21:45:55.856026] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-07T21:45:55.862137] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T21:45:56.647726] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-07T21:45:56.819932] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T21:45:57.361080] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T21:45:57.447615] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-07T21:45:58.213582] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T21:45:58.247625] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-07T21:45:59.047681] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-07T21:45:59.289727] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T21:45:59.847631] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-07T21:45:59.983761] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-07T21:46:00.522997] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T21:46:00.647607] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-07T21:46:01.450190] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-07T21:46:01.456171] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T21:46:02.177157] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T21:46:02.247710] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-07T21:46:02.926837] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T21:46:03.047611] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-07T21:46:03.584972] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T21:46:03.847704] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-07T21:46:04.647744] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-07T21:46:04.736101] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T21:46:05.447683] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-07T21:46:05.522400] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T21:46:05.840247] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T21:46:06.247749] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-07T21:46:07.047618] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-07T21:46:07.387514] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T21:46:07.822559] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T21:46:07.847632] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-07T21:46:08.394609] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T21:46:08.647701] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-07T21:46:09.447634] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-07T21:46:09.517160] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:46:10.200415] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T21:46:10.247607] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-07T21:46:11.047755] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-07T21:46:11.307766] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T21:46:11.847699] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-07T21:46:11.935504] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T21:46:12.537623] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T21:46:12.647699] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-07T21:46:13.447636] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-07T21:46:13.505039] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T21:46:14.248251] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T21:46:14.248455] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-07T21:46:14.937435] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T21:46:14.941405] [INFO ] [REMOTE ] SUPV: Full fetch complete (68433 records). [2025-10-07T21:46:14.941690] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-07T21:46:15.052872] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-07T21:46:15.361436] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-07T21:46:15.361551] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-07T21:46:15.362746] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-07T21:46:15.362817] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-07T21:46:15.366422] [DEBUG] [LOCAL ] SUPV: Trimmed 68433 records to 47407 (keeping 200 days of data) [2025-10-07T21:46:15.663292] [DEBUG] [LOCAL ] SUPV: Primary data saved (47407 records). [2025-10-07T21:46:15.663524] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-07T21:46:15.663690] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUPV took 33.4s. Estimated remaining: 48m 4s. Rate: 7.1 symbols/min [2025-10-07T21:46:15.844296] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:46:15.847615] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-07T21:46:15.898552] [DEBUG] [LOCAL ] SWK: Loaded 52429 existing records from primary storage. [2025-10-07T21:46:15.924868] [INFO ] [MAIN ] SWK: Loaded 52429 existing records. [2025-10-07T21:46:16.002118] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T21:46:16.124117] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:46:16.124406] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-07T21:46:16.124473] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-07T21:46:16.125691] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-07T21:46:16.125760] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-07T21:46:16.453808] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T21:46:16.516754] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:46:16.516882] [INFO ] [REMOTE ] SVV: Full fetch complete (56618 records). [2025-10-07T21:46:16.517049] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-07T21:46:16.652956] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-07T21:46:16.898141] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-07T21:46:16.898252] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-07T21:46:16.899631] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-07T21:46:16.899719] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-07T21:46:16.902249] [DEBUG] [LOCAL ] SVV: Trimmed 56618 records to 39888 (keeping 200 days of data) [2025-10-07T21:46:17.163584] [DEBUG] [LOCAL ] SVV: Primary data saved (39888 records). [2025-10-07T21:46:17.163820] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-07T21:46:17.163938] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SVV took 31.8s. Estimated remaining: 47m 55s. Rate: 7.1 symbols/min [2025-10-07T21:46:17.353923] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:46:17.388454] [DEBUG] [LOCAL ] SWX: Loaded 31186 existing records from primary storage. [2025-10-07T21:46:17.388848] [INFO ] [MAIN ] SWX: Loaded 31186 existing records. [2025-10-07T21:46:17.461011] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-07T21:46:17.593221] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:46:17.593672] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-07T21:46:17.593886] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-07T21:46:17.594839] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-07T21:46:17.594909] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-07T21:46:17.827387] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T21:46:18.088846] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:46:18.247668] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-07T21:46:18.388529] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T21:46:18.428618] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T21:46:18.432576] [INFO ] [REMOTE ] SUZ: Full fetch complete (66650 records). [2025-10-07T21:46:18.432830] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-07T21:46:18.860351] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-07T21:46:18.860463] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-07T21:46:18.861797] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-07T21:46:18.861870] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-07T21:46:18.863521] [DEBUG] [LOCAL ] SUZ: Trimmed 66650 records to 45520 (keeping 200 days of data) [2025-10-07T21:46:19.069220] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-07T21:46:19.140023] [DEBUG] [LOCAL ] SUZ: Primary data saved (45520 records). [2025-10-07T21:46:19.140205] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-07T21:46:19.140322] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SUZ took 35.3s. Estimated remaining: 47m 45s. Rate: 7.1 symbols/min [2025-10-07T21:46:19.307693] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:46:19.315280] [DEBUG] [LOCAL ] SWZ: Loaded 6036 existing records from primary storage. [2025-10-07T21:46:19.315560] [INFO ] [MAIN ] SWZ: Loaded 6036 existing records. [2025-10-07T21:46:19.495420] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:46:19.495705] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-07T21:46:19.495770] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-07T21:46:19.496063] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-07T21:46:19.496122] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-07T21:46:19.847965] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-07T21:46:19.851945] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:46:20.186409] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T21:46:20.647619] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-07T21:46:20.884591] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T21:46:21.034920] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T21:46:21.447678] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-07T21:46:22.087283] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T21:46:22.247674] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-07T21:46:22.314744] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T21:46:23.047707] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-07T21:46:23.763552] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T21:46:23.847621] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-07T21:46:23.940727] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T21:46:24.458903] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-07T21:46:24.647686] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-07T21:46:25.447635] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-07T21:46:26.119698] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T21:46:26.247729] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-07T21:46:26.802005] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T21:46:26.805753] [INFO ] [REMOTE ] SW: Full fetch complete (76812 records). [2025-10-07T21:46:26.805876] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-07T21:46:27.056376] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-07T21:46:27.210015] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-07T21:46:27.210199] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-07T21:46:27.211685] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-07T21:46:27.211776] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-07T21:46:27.213537] [DEBUG] [LOCAL ] SW: Trimmed 76812 records to 53183 (keeping 200 days of data) [2025-10-07T21:46:27.357240] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T21:46:27.596860] [DEBUG] [LOCAL ] SW: Primary data saved (53183 records). [2025-10-07T21:46:27.597034] [INFO ] [MAIN ] SW: Full history saved. [2025-10-07T21:46:27.597125] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SW took 37.2s. Estimated remaining: 47m 37s. Rate: 7.1 symbols/min [2025-10-07T21:46:27.705870] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-07T21:46:27.776986] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:46:27.814468] [DEBUG] [LOCAL ] SXC: Loaded 41383 existing records from primary storage. [2025-10-07T21:46:27.814848] [INFO ] [MAIN ] SXC: Loaded 41383 existing records. [2025-10-07T21:46:27.852875] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-07T21:46:27.991801] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:46:27.992022] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-07T21:46:27.992069] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-07T21:46:27.993000] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-07T21:46:27.993060] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-07T21:46:28.338189] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:46:28.495956] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T21:46:28.647690] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-07T21:46:29.447675] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-07T21:46:29.467904] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-07T21:46:30.247706] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-07T21:46:30.979146] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T21:46:31.047674] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-07T21:46:31.516180] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-07T21:46:31.641333] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T21:46:31.847672] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-07T21:46:32.479632] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T21:46:32.647704] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-07T21:46:33.447704] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-07T21:46:34.247677] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-07T21:46:34.604858] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T21:46:34.673212] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T21:46:35.015685] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T21:46:35.047597] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-07T21:46:35.712899] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T21:46:35.847637] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-07T21:46:36.647726] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-07T21:46:37.162693] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T21:46:37.163916] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T21:46:37.172002] [INFO ] [REMOTE ] SWZ: Full fetch complete (8178 records). [2025-10-07T21:46:37.172453] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-07T21:46:37.456234] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-07T21:46:37.540589] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-07T21:46:37.540704] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-07T21:46:37.540959] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-07T21:46:37.541003] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-07T21:46:37.541474] [DEBUG] [LOCAL ] SWZ: Trimmed 8178 records to 6079 (keeping 200 days of data) [2025-10-07T21:46:37.576753] [DEBUG] [LOCAL ] SWZ: Primary data saved (6079 records). [2025-10-07T21:46:37.576927] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-07T21:46:37.577036] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWZ took 18.4s. Estimated remaining: 47m 29s. Rate: 7.1 symbols/min [2025-10-07T21:46:37.744196] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:46:37.758205] [DEBUG] [LOCAL ] SXI: Loaded 11660 existing records from primary storage. [2025-10-07T21:46:37.758468] [INFO ] [MAIN ] SXI: Loaded 11660 existing records. [2025-10-07T21:46:37.935637] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:46:37.935914] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-07T21:46:37.935964] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-07T21:46:37.936302] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-07T21:46:37.936362] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-07T21:46:38.260728] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-07T21:46:38.344431] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:46:39.047668] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-07T21:46:39.317193] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T21:46:39.717004] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T21:46:39.847731] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-07T21:46:40.557545] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T21:46:40.647606] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-07T21:46:41.228760] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T21:46:41.447689] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-07T21:46:42.225687] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T21:46:42.247619] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-07T21:46:43.038013] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T21:46:43.047600] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-07T21:46:43.847704] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-07T21:46:44.075300] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T21:46:44.496383] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-07T21:46:44.551474] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T21:46:44.647603] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-07T21:46:45.447686] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-07T21:46:46.210116] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T21:46:46.259786] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-07T21:46:46.266421] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T21:46:47.047722] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-07T21:46:47.847678] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-07T21:46:47.947543] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T21:46:48.460761] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T21:46:48.464266] [INFO ] [REMOTE ] SWK: Full fetch complete (75315 records). [2025-10-07T21:46:48.464397] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-07T21:46:48.654737] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-07T21:46:48.855463] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-07T21:46:48.855562] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-07T21:46:48.856771] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-07T21:46:48.856874] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-07T21:46:48.858605] [DEBUG] [LOCAL ] SWK: Trimmed 75315 records to 52434 (keeping 200 days of data) [2025-10-07T21:46:49.203351] [DEBUG] [LOCAL ] SWK: Primary data saved (52434 records). [2025-10-07T21:46:49.204403] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-07T21:46:49.204716] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWK took 33.5s. Estimated remaining: 47m 21s. Rate: 7.1 symbols/min [2025-10-07T21:46:49.339768] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-07T21:46:49.407713] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:46:49.438317] [DEBUG] [LOCAL ] SXT: Loaded 29788 existing records from primary storage. [2025-10-07T21:46:49.438623] [INFO ] [MAIN ] SXT: Loaded 29788 existing records. [2025-10-07T21:46:49.453581] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-07T21:46:49.615488] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:46:49.615775] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-07T21:46:49.615827] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-07T21:46:49.616863] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-07T21:46:49.616927] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-07T21:46:49.966498] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:46:50.123533] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T21:46:50.250502] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-07T21:46:50.251449] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T21:46:51.047671] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-07T21:46:51.715795] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T21:46:51.847670] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-07T21:46:52.126131] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T21:46:52.647729] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-07T21:46:53.374091] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T21:46:53.447668] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-07T21:46:53.977286] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T21:46:54.247744] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-07T21:46:54.597249] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-07T21:46:54.908928] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T21:46:55.047754] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-07T21:46:55.847696] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-07T21:46:56.440524] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-07T21:46:56.647625] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-07T21:46:57.267309] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T21:46:57.447637] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-07T21:46:57.851760] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T21:46:57.854920] [INFO ] [REMOTE ] SXC: Full fetch complete (61079 records). [2025-10-07T21:46:57.855027] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-07T21:46:58.240914] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T21:46:58.240675] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-07T21:46:58.243561] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-07T21:46:58.244560] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-07T21:46:58.244624] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-07T21:46:58.245847] [DEBUG] [LOCAL ] SXC: Trimmed 61079 records to 41436 (keeping 200 days of data) [2025-10-07T21:46:58.247602] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-07T21:46:58.497554] [DEBUG] [LOCAL ] SXC: Primary data saved (41436 records). [2025-10-07T21:46:58.497747] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-07T21:46:58.497847] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SXC took 30.9s. Estimated remaining: 47m 12s. Rate: 7.1 symbols/min [2025-10-07T21:46:58.669676] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:46:58.722050] [DEBUG] [LOCAL ] SYF: Loaded 53443 existing records from primary storage. [2025-10-07T21:46:58.722389] [INFO ] [MAIN ] SYF: Loaded 53443 existing records. [2025-10-07T21:46:58.903466] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:46:58.903691] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-07T21:46:58.903750] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-07T21:46:58.904717] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-07T21:46:58.904779] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-07T21:46:59.051109] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-07T21:46:59.177421] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T21:46:59.284067] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:46:59.847613] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-07T21:47:00.211116] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T21:47:00.647627] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-07T21:47:00.753477] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-07T21:47:01.447696] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-07T21:47:02.179253] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T21:47:02.247622] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-07T21:47:02.428410] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:47:03.047688] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-07T21:47:03.758043] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-07T21:47:03.847605] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-07T21:47:03.928557] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-07T21:47:04.647633] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-07T21:47:05.447695] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-07T21:47:05.473621] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T21:47:05.590385] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T21:47:06.247634] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-07T21:47:06.707781] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T21:47:07.047719] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-07T21:47:07.619097] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T21:47:07.847686] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-07T21:47:08.019880] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T21:47:08.022764] [INFO ] [REMOTE ] SWX: Full fetch complete (43998 records). [2025-10-07T21:47:08.022863] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-07T21:47:08.412724] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-07T21:47:08.412846] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-07T21:47:08.414348] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-07T21:47:08.414421] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-07T21:47:08.415802] [DEBUG] [LOCAL ] SWX: Trimmed 43998 records to 31242 (keeping 200 days of data) [2025-10-07T21:47:08.632060] [DEBUG] [LOCAL ] SWX: Primary data saved (31242 records). [2025-10-07T21:47:08.632274] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-07T21:47:08.632410] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SWX took 51.5s. Estimated remaining: 47m 4s. Rate: 7.1 symbols/min [2025-10-07T21:47:08.647638] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-07T21:47:08.947688] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T21:47:09.221756] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T21:47:09.447706] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-07T21:47:10.247673] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-07T21:47:10.566579] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T21:47:11.047698] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-07T21:47:11.847706] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-07T21:47:12.058918] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:47:12.485066] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-07T21:47:12.502170] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T21:47:12.647606] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-07T21:47:13.447636] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-07T21:47:13.949231] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T21:47:14.093126] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T21:47:14.094556] [INFO ] [REMOTE ] SXI: Full fetch complete (15082 records). [2025-10-07T21:47:14.094630] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-07T21:47:14.269146] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-07T21:47:14.462623] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-07T21:47:14.462734] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-07T21:47:14.463089] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-07T21:47:14.463130] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-07T21:47:14.463675] [DEBUG] [LOCAL ] SXI: Trimmed 15082 records to 11693 (keeping 200 days of data) [2025-10-07T21:47:14.540240] [DEBUG] [LOCAL ] SXI: Primary data saved (11693 records). [2025-10-07T21:47:14.540394] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-07T21:47:14.540501] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXI took 37.0s. Estimated remaining: 46m 55s. Rate: 7.1 symbols/min [2025-10-07T21:47:15.047679] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-07T21:47:15.722892] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T21:47:15.847604] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-07T21:47:16.757688] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T21:47:16.770063] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-07T21:47:17.062361] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T21:47:17.064991] [INFO ] [REMOTE ] SXT: Full fetch complete (38924 records). [2025-10-07T21:47:17.065081] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-07T21:47:17.437921] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-07T21:47:17.438021] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-07T21:47:17.438979] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-07T21:47:17.439069] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-07T21:47:17.440324] [DEBUG] [LOCAL ] SXT: Trimmed 38924 records to 29823 (keeping 200 days of data) [2025-10-07T21:47:17.664604] [DEBUG] [LOCAL ] SXT: Primary data saved (29823 records). [2025-10-07T21:47:17.664917] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-07T21:47:17.665066] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 28.5s. Estimated remaining: 46m 46s. Rate: 7.1 symbols/min [2025-10-07T21:47:18.691703] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T21:47:18.703398] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-07T21:47:20.038555] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T21:47:20.050331] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-07T21:47:21.856568] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T21:47:21.868286] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-07T21:47:23.698985] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T21:47:23.711671] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-07T21:47:25.407753] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T21:47:25.420262] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-07T21:47:27.144918] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T21:47:27.156999] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-07T21:47:27.622025] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:47:27.625860] [INFO ] [REMOTE ] SYF: Full fetch complete (77330 records). [2025-10-07T21:47:27.626014] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-07T21:47:28.014397] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-07T21:47:28.014492] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-07T21:47:28.015616] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-07T21:47:28.015708] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-07T21:47:28.017413] [DEBUG] [LOCAL ] SYF: Trimmed 77330 records to 53443 (keeping 200 days of data) [2025-10-07T21:47:28.382791] [DEBUG] [LOCAL ] SYF: Primary data saved (53443 records). [2025-10-07T21:47:28.382999] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-07T21:47:28.383153] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SYF took 29.9s. Estimated remaining: 46m 38s. Rate: 7.1 symbols/min [2025-10-07T21:47:29.069766] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:47:29.083638] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:47:29.090607] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:47:29.145075] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:47:29.251565] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-07T21:47:29.253554] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-07T21:47:29.265202] [DEBUG] [LOCAL ] SYK: Loaded 46889 existing records from primary storage. [2025-10-07T21:47:29.286207] [INFO ] [MAIN ] SYK: Loaded 46889 existing records. [2025-10-07T21:47:29.407438] [DEBUG] [LOCAL ] TAC: Loaded 42564 existing records from primary storage. [2025-10-07T21:47:29.406359] [DEBUG] [LOCAL ] SYY: Loaded 53232 existing records from primary storage. [2025-10-07T21:47:29.418414] [INFO ] [MAIN ] SYY: Loaded 53232 existing records. [2025-10-07T21:47:29.418572] [INFO ] [MAIN ] TAC: Loaded 42564 existing records. [2025-10-07T21:47:29.824797] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:47:29.875425] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-07T21:47:29.918696] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-07T21:47:29.898635] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:47:29.953997] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-07T21:47:29.965568] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-07T21:47:30.083081] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-07T21:47:30.120074] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-07T21:47:30.124137] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:47:30.156430] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-07T21:47:30.156337] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-07T21:47:30.143168] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:47:30.156759] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-07T21:47:30.157039] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-07T21:47:30.156848] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-07T21:47:30.168906] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-07T21:47:30.162539] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-07T21:47:30.169499] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-07T21:47:30.252284] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-07T21:47:30.277172] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-07T21:47:31.287389] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:47:31.358045] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-07T21:47:31.510408] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:47:31.546110] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-07T21:47:31.545734] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:47:31.570753] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:47:31.567165] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-07T21:47:31.571213] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-07T21:47:33.207040] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-07T21:47:33.218384] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-07T21:47:33.255581] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T21:47:33.268278] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-07T21:47:33.327921] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:47:33.338056] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-07T21:47:33.462353] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-07T21:47:33.473988] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-07T21:47:34.850664] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T21:47:34.861234] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-07T21:47:35.137010] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-07T21:47:35.149959] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-07T21:47:35.179826] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T21:47:35.191025] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-07T21:47:35.576512] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-07T21:47:35.589506] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-07T21:47:36.409009] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T21:47:36.419244] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-07T21:47:36.670555] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T21:47:36.681378] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-07T21:47:36.967962] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T21:47:36.977903] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-07T21:47:37.453371] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T21:47:37.464176] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-07T21:47:38.024637] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-07T21:47:38.034898] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-07T21:47:38.338005] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T21:47:38.349257] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-07T21:47:38.502495] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T21:47:38.516139] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-07T21:47:39.251887] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T21:47:39.264344] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-07T21:47:39.973878] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T21:47:39.987440] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-07T21:47:40.021761] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-07T21:47:40.034873] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-07T21:47:40.097667] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T21:47:40.109667] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-07T21:47:40.344570] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-07T21:47:40.647634] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-07T21:47:41.415038] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-07T21:47:41.459494] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-07T21:47:41.465497] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T21:47:42.247427] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T21:47:42.256707] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-07T21:47:42.475540] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-07T21:47:43.047623] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-07T21:47:43.148466] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T21:47:43.732899] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T21:47:43.847670] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-07T21:47:44.606156] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T21:47:44.647613] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-07T21:47:45.447721] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-07T21:47:46.247746] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-07T21:47:46.299834] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-07T21:47:46.587488] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-07T21:47:47.027901] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T21:47:47.047693] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-07T21:47:47.847678] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-07T21:47:48.033710] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T21:47:48.565839] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T21:47:48.647614] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-07T21:47:49.447681] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-07T21:47:49.652456] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T21:47:49.984772] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T21:47:49.988114] [INFO ] [REMOTE ] TAC: Full fetch complete (63928 records). [2025-10-07T21:47:49.988206] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-07T21:47:50.252945] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-07T21:47:50.387041] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-07T21:47:50.387119] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-07T21:47:50.388118] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-07T21:47:50.388183] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-07T21:47:50.391385] [DEBUG] [LOCAL ] TAC: Trimmed 63928 records to 42620 (keeping 200 days of data) [2025-10-07T21:47:50.654952] [DEBUG] [LOCAL ] TAC: Primary data saved (42620 records). [2025-10-07T21:47:50.655100] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-07T21:47:50.655185] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. TAC took 22.2s. Estimated remaining: 46m 32s. Rate: 7.1 symbols/min [2025-10-07T21:47:50.822543] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:47:50.869327] [DEBUG] [LOCAL ] TAK: Loaded 49941 existing records from primary storage. [2025-10-07T21:47:50.869708] [INFO ] [MAIN ] TAK: Loaded 49941 existing records. [2025-10-07T21:47:51.052971] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-07T21:47:51.059272] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:47:51.060857] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-07T21:47:51.060915] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-07T21:47:51.062167] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-07T21:47:51.062235] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-07T21:47:51.453857] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:47:51.831792] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-07T21:47:51.847597] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-07T21:47:52.167040] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-07T21:47:52.647638] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-07T21:47:52.762389] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T21:47:53.125951] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T21:47:53.131124] [INFO ] [REMOTE ] SYY: Full fetch complete (76982 records). [2025-10-07T21:47:53.131380] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-07T21:47:53.452769] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-07T21:47:53.574230] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-07T21:47:53.574368] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-07T21:47:53.575855] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-07T21:47:53.575937] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-07T21:47:53.578491] [DEBUG] [LOCAL ] SYY: Trimmed 76982 records to 53232 (keeping 200 days of data) [2025-10-07T21:47:53.926118] [DEBUG] [LOCAL ] SYY: Primary data saved (53232 records). [2025-10-07T21:47:53.926280] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-07T21:47:53.926372] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYY took 25.5s. Estimated remaining: 46m 22s. Rate: 7.1 symbols/min [2025-10-07T21:47:54.128864] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:47:54.190830] [DEBUG] [LOCAL ] TAL: Loaded 51886 existing records from primary storage. [2025-10-07T21:47:54.191252] [INFO ] [MAIN ] TAL: Loaded 51886 existing records. [2025-10-07T21:47:54.253244] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-07T21:47:54.372336] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:47:54.372690] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-07T21:47:54.372757] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-07T21:47:54.373795] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-07T21:47:54.373853] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-07T21:47:54.557758] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-07T21:47:54.774380] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:47:55.047629] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-07T21:47:55.311282] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T21:47:55.847628] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-07T21:47:55.937867] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T21:47:56.610451] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T21:47:56.647617] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-07T21:47:57.447705] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-07T21:47:57.914599] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:47:57.918255] [INFO ] [REMOTE ] SYK: Full fetch complete (68903 records). [2025-10-07T21:47:57.918394] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-07T21:47:58.260804] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-07T21:47:58.374263] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-07T21:47:58.376148] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-07T21:47:58.374952] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-07T21:47:58.389618] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-07T21:47:58.390423] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-07T21:47:58.392230] [DEBUG] [LOCAL ] SYK: Trimmed 68903 records to 46879 (keeping 200 days of data) [2025-10-07T21:47:58.539855] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T21:47:58.749265] [DEBUG] [LOCAL ] SYK: Primary data saved (46879 records). [2025-10-07T21:47:58.749446] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-07T21:47:58.749545] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. SYK took 30.4s. Estimated remaining: 46m 13s. Rate: 7.1 symbols/min [2025-10-07T21:47:58.916367] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:47:58.968822] [DEBUG] [LOCAL ] TALO: Loaded 50811 existing records from primary storage. [2025-10-07T21:47:58.969222] [INFO ] [MAIN ] TALO: Loaded 50811 existing records. [2025-10-07T21:47:59.057227] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-07T21:47:59.149981] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:47:59.150190] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-07T21:47:59.150255] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-07T21:47:59.151213] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-07T21:47:59.151272] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-07T21:47:59.522661] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:47:59.847717] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-07T21:47:59.904214] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T21:48:00.579518] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T21:48:00.647732] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-07T21:48:01.447705] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-07T21:48:01.549120] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T21:48:01.681055] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T21:48:02.247674] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-07T21:48:03.047697] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-07T21:48:03.386321] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-07T21:48:03.847632] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-07T21:48:03.943418] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T21:48:04.647693] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-07T21:48:04.696359] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T21:48:05.447867] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-07T21:48:06.247638] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-07T21:48:06.288439] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-07T21:48:06.332884] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T21:48:07.047675] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-07T21:48:07.222004] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T21:48:07.665934] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T21:48:07.847682] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-07T21:48:08.610296] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T21:48:08.647716] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-07T21:48:09.447676] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-07T21:48:09.551455] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T21:48:09.693697] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-07T21:48:09.698204] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-07T21:48:09.698338] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-07T21:48:10.094486] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-07T21:48:10.094847] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-07T21:48:10.096023] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-07T21:48:10.096202] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-07T21:48:10.098412] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-10-07T21:48:10.221733] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T21:48:10.247888] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-07T21:48:10.479916] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-07T21:48:10.480077] [INFO ] [MAIN ] T: Full history saved. [2025-10-07T21:48:10.480183] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. T took 42.1s. Estimated remaining: 46m 5s. Rate: 7.1 symbols/min [2025-10-07T21:48:10.645053] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:48:10.695695] [DEBUG] [LOCAL ] TAP: Loaded 52911 existing records from primary storage. [2025-10-07T21:48:10.696034] [INFO ] [MAIN ] TAP: Loaded 52911 existing records. [2025-10-07T21:48:10.868191] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:48:10.868440] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-07T21:48:10.868501] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-07T21:48:10.869598] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-07T21:48:10.869683] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-07T21:48:11.057902] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-07T21:48:11.223554] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:48:11.769996] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T21:48:11.847677] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-07T21:48:12.647718] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-07T21:48:12.823821] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T21:48:13.216706] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-07T21:48:13.447704] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-07T21:48:13.992764] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T21:48:14.247692] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-07T21:48:15.036461] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T21:48:15.047673] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-07T21:48:15.847713] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-07T21:48:16.004492] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T21:48:16.647694] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-07T21:48:16.858114] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T21:48:17.120894] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-07T21:48:17.447704] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-07T21:48:18.247681] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-07T21:48:18.458158] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:48:18.793919] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T21:48:19.047678] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-07T21:48:19.719297] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T21:48:19.847631] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-07T21:48:20.647691] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-07T21:48:20.801735] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T21:48:21.179445] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T21:48:21.447692] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-07T21:48:22.033970] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T21:48:22.247727] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-07T21:48:23.047693] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-07T21:48:23.374379] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T21:48:23.847621] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-07T21:48:24.024424] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T21:48:24.647699] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-07T21:48:24.790728] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T21:48:25.447670] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-07T21:48:25.550703] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T21:48:26.013821] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T21:48:26.247713] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-07T21:48:26.593833] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T21:48:26.597442] [INFO ] [REMOTE ] TAK: Full fetch complete (71712 records). [2025-10-07T21:48:26.597556] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-07T21:48:27.013020] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-07T21:48:27.013119] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-07T21:48:27.014170] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-07T21:48:27.014237] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-07T21:48:27.015868] [DEBUG] [LOCAL ] TAK: Trimmed 71712 records to 50004 (keeping 200 days of data) [2025-10-07T21:48:27.072065] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-07T21:48:27.315579] [DEBUG] [LOCAL ] TAK: Primary data saved (50004 records). [2025-10-07T21:48:27.315763] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-07T21:48:27.315912] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAK took 36.7s. Estimated remaining: 45m 58s. Rate: 7.1 symbols/min [2025-10-07T21:48:27.485572] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:48:27.499120] [DEBUG] [LOCAL ] TBB: Loaded 11690 existing records from primary storage. [2025-10-07T21:48:27.499389] [INFO ] [MAIN ] TBB: Loaded 11690 existing records. [2025-10-07T21:48:27.624532] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T21:48:27.656741] [INFO ] [REMOTE ] TALO: Full fetch complete (73268 records). [2025-10-07T21:48:27.664851] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-07T21:48:27.724111] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:48:27.768729] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-07T21:48:27.773930] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-07T21:48:27.794182] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-07T21:48:27.794299] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-07T21:48:27.857833] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-07T21:48:28.467826] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:48:28.462005] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-07T21:48:28.468026] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-07T21:48:28.469838] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-07T21:48:28.469929] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-07T21:48:28.471863] [DEBUG] [LOCAL ] TALO: Trimmed 73268 records to 50818 (keeping 200 days of data) [2025-10-07T21:48:28.651682] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-07T21:48:28.785532] [DEBUG] [LOCAL ] TALO: Primary data saved (50818 records). [2025-10-07T21:48:28.785714] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-07T21:48:28.785827] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TALO took 30.0s. Estimated remaining: 45m 49s. Rate: 7.1 symbols/min [2025-10-07T21:48:28.966487] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:48:29.006826] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T21:48:29.049801] [DEBUG] [LOCAL ] TBBB: Loaded 35724 existing records from primary storage. [2025-10-07T21:48:29.050160] [INFO ] [MAIN ] TBBB: Loaded 35724 existing records. [2025-10-07T21:48:29.234626] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:48:29.234970] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-07T21:48:29.235027] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-07T21:48:29.235269] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-07T21:48:29.235325] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-07T21:48:29.472377] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-07T21:48:29.580256] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T21:48:29.689124] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:48:29.720354] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-07T21:48:30.247706] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-07T21:48:30.671152] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T21:48:30.675797] [INFO ] [REMOTE ] TAL: Full fetch complete (75497 records). [2025-10-07T21:48:30.675939] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-07T21:48:31.073515] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-07T21:48:31.099242] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-07T21:48:31.099336] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-07T21:48:31.100765] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-07T21:48:31.100936] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-07T21:48:31.102766] [DEBUG] [LOCAL ] TAL: Trimmed 75497 records to 51852 (keeping 200 days of data) [2025-10-07T21:48:31.423973] [DEBUG] [LOCAL ] TAL: Primary data saved (51852 records). [2025-10-07T21:48:31.424165] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-07T21:48:31.424298] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAL took 37.5s. Estimated remaining: 45m 39s. Rate: 7.1 symbols/min [2025-10-07T21:48:31.595803] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:48:31.620446] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T21:48:31.647416] [DEBUG] [LOCAL ] TBI: Loaded 22537 existing records from primary storage. [2025-10-07T21:48:31.647737] [INFO ] [MAIN ] TBI: Loaded 22537 existing records. [2025-10-07T21:48:31.823086] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:48:31.823342] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-07T21:48:31.823391] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-07T21:48:31.823676] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-07T21:48:31.823738] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-07T21:48:31.853284] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-07T21:48:32.173493] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:48:32.647622] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-07T21:48:32.806601] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T21:48:33.026739] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T21:48:33.447618] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-07T21:48:33.913566] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T21:48:34.153753] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T21:48:34.247688] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-07T21:48:35.047622] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-07T21:48:35.304458] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T21:48:35.847732] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-07T21:48:35.847638] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T21:48:36.647688] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-07T21:48:37.290239] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T21:48:37.311152] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-07T21:48:37.447620] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-07T21:48:38.247628] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-07T21:48:38.269948] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T21:48:39.047688] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-07T21:48:39.281183] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T21:48:39.665228] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T21:48:39.847752] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-07T21:48:40.647731] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-07T21:48:41.447712] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-07T21:48:42.247698] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-07T21:48:43.245873] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T21:48:43.251356] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-07T21:48:43.285443] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T21:48:43.847741] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-07T21:48:44.447431] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T21:48:44.628411] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T21:48:44.647606] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-07T21:48:45.447751] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-07T21:48:45.945936] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (6.10 seconds). [2025-10-07T21:48:46.197797] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T21:48:46.201670] [INFO ] [REMOTE ] TAP: Full fetch complete (76186 records). [2025-10-07T21:48:46.201816] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-07T21:48:46.257732] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-07T21:48:46.621257] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-07T21:48:46.621348] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-07T21:48:46.622589] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-07T21:48:46.622680] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-07T21:48:46.624337] [DEBUG] [LOCAL ] TAP: Trimmed 76186 records to 52914 (keeping 200 days of data) [2025-10-07T21:48:46.748582] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T21:48:46.966547] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (6.32 seconds). [2025-10-07T21:48:46.995720] [DEBUG] [LOCAL ] TAP: Primary data saved (52914 records). [2025-10-07T21:48:46.995874] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-07T21:48:46.995960] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TAP took 36.5s. Estimated remaining: 45m 32s. Rate: 7.1 symbols/min [2025-10-07T21:48:47.052775] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-07T21:48:47.186869] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:48:47.187066] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-07T21:48:47.187105] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-07T21:48:47.187247] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-07T21:48:47.187289] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-07T21:48:47.187333] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-07T21:48:47.187365] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-07T21:48:47.554103] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:48:47.847636] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-07T21:48:48.210955] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-07T21:48:48.647715] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-07T21:48:48.984170] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-07T21:48:49.447734] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-07T21:48:49.575968] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (3.32 seconds). [2025-10-07T21:48:50.245956] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-07T21:48:50.248757] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-07T21:48:50.647066] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (3.59 seconds). [2025-10-07T21:48:51.047682] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-07T21:48:51.628853] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-07T21:48:51.693625] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-07T21:48:51.847711] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-07T21:48:52.437494] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T21:48:52.438689] [INFO ] [REMOTE ] TBB: Full fetch complete (17300 records). [2025-10-07T21:48:52.438764] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-07T21:48:52.652952] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-07T21:48:52.834825] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-07T21:48:52.834930] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-07T21:48:52.835361] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-07T21:48:52.835404] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-07T21:48:52.835997] [DEBUG] [LOCAL ] TBB: Trimmed 17300 records to 11674 (keeping 200 days of data) [2025-10-07T21:48:52.911867] [DEBUG] [LOCAL ] TBB: Primary data saved (11674 records). [2025-10-07T21:48:52.912083] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-07T21:48:52.912226] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TBB took 25.6s. Estimated remaining: 45m 23s. Rate: 7.1 symbols/min [2025-10-07T21:48:53.092938] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:48:53.099869] [DEBUG] [LOCAL ] TBN: Loaded 3788 existing records from primary storage. [2025-10-07T21:48:53.100113] [INFO ] [MAIN ] TBN: Loaded 3788 existing records. [2025-10-07T21:48:53.278421] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:48:53.278708] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-07T21:48:53.278767] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-07T21:48:53.278986] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-07T21:48:53.279045] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-07T21:48:53.460566] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-07T21:48:53.657299] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:48:53.782899] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T21:48:53.898339] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-07T21:48:54.247696] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-07T21:48:55.047670] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-07T21:48:55.311385] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-07T21:48:55.847684] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-07T21:48:56.208397] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-07T21:48:56.391565] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T21:48:56.647734] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-07T21:48:57.447681] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-07T21:48:58.247673] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-07T21:48:58.291992] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T21:48:58.447850] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T21:48:58.729696] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T21:48:59.047680] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-07T21:48:59.847635] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-07T21:49:00.052003] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T21:49:00.647764] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-07T21:49:01.256249] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T21:49:01.278561] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T21:49:01.447728] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-07T21:49:02.212355] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T21:49:02.214523] [INFO ] [REMOTE ] TBI: Full fetch complete (31764 records). [2025-10-07T21:49:02.214639] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-07T21:49:02.252895] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-07T21:49:02.616900] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-07T21:49:02.617023] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-07T21:49:02.617945] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-07T21:49:02.618014] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-07T21:49:02.618946] [DEBUG] [LOCAL ] TBI: Trimmed 31764 records to 22538 (keeping 200 days of data) [2025-10-07T21:49:02.746498] [DEBUG] [LOCAL ] TBI: Primary data saved (22538 records). [2025-10-07T21:49:02.746681] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-07T21:49:02.746819] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBI took 31.3s. Estimated remaining: 45m 15s. Rate: 7.1 symbols/min [2025-10-07T21:49:02.925742] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:02.926016] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-07T21:49:02.926076] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-07T21:49:02.926198] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-07T21:49:02.926242] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-07T21:49:02.926287] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-07T21:49:02.926322] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-07T21:49:03.052851] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-07T21:49:03.305819] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:03.686309] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T21:49:03.847684] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-07T21:49:03.894924] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T21:49:04.414868] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-07T21:49:04.647710] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-07T21:49:05.066976] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-07T21:49:05.447633] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-07T21:49:05.811267] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-07T21:49:06.247695] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-07T21:49:06.655602] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-07T21:49:07.047686] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-07T21:49:07.267173] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:49:07.267600] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-07T21:49:07.267727] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:49:07.267777] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-07T21:49:07.267839] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:49:07.267916] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-07T21:49:07.267988] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-07T21:49:07.268026] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-07T21:49:07.268067] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-07T21:49:07.268119] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TCAI took 4.5s. Estimated remaining: 45m 6s. Rate: 7.1 symbols/min [2025-10-07T21:49:07.434483] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:07.446716] [DEBUG] [LOCAL ] TCBX: Loaded 10223 existing records from primary storage. [2025-10-07T21:49:07.446930] [INFO ] [MAIN ] TCBX: Loaded 10223 existing records. [2025-10-07T21:49:07.619563] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:49:07.619789] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-07T21:49:07.619837] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-07T21:49:07.620074] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-07T21:49:07.620132] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-07T21:49:07.852870] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-07T21:49:07.971889] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:08.247189] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-07T21:49:08.647691] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-07T21:49:09.069067] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-07T21:49:09.447685] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-07T21:49:10.247690] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-07T21:49:10.518324] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T21:49:11.047680] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-07T21:49:11.148182] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-07T21:49:11.403558] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-07T21:49:11.847681] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-07T21:49:12.194152] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-07T21:49:12.647695] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-07T21:49:13.096083] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-07T21:49:13.447696] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-07T21:49:13.786345] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-07T21:49:13.787226] [INFO ] [REMOTE ] TBLU: Full fetch complete (1176 records). [2025-10-07T21:49:13.787322] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-07T21:49:14.011305] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-07T21:49:14.011523] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-07T21:49:14.011593] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-07T21:49:14.011692] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-07T21:49:14.011772] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-07T21:49:14.011811] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-07T21:49:14.011852] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-07T21:49:14.011911] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBLU took 27.0s. Estimated remaining: 44m 57s. Rate: 7.1 symbols/min [2025-10-07T21:49:14.221869] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:14.256086] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-07T21:49:14.280865] [DEBUG] [LOCAL ] TD: Loaded 52331 existing records from primary storage. [2025-10-07T21:49:14.281237] [INFO ] [MAIN ] TD: Loaded 52331 existing records. [2025-10-07T21:49:14.513740] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:49:14.513980] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-07T21:49:14.514068] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-07T21:49:14.514696] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-07T21:49:14.514758] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-07T21:49:14.927056] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:15.047711] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-07T21:49:15.130636] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T21:49:15.133530] [INFO ] [REMOTE ] TBBB: Full fetch complete (51469 records). [2025-10-07T21:49:15.133635] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-07T21:49:15.518670] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-07T21:49:15.518796] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-07T21:49:15.519869] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-07T21:49:15.519939] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-07T21:49:15.521302] [DEBUG] [LOCAL ] TBBB: Trimmed 51469 records to 35662 (keeping 200 days of data) [2025-10-07T21:49:15.736992] [DEBUG] [LOCAL ] TBBB: Primary data saved (35662 records). [2025-10-07T21:49:15.737163] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-07T21:49:15.737255] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBBB took 47.0s. Estimated remaining: 44m 48s. Rate: 7.1 symbols/min [2025-10-07T21:49:15.852745] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-07T21:49:15.910911] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:15.953601] [DEBUG] [LOCAL ] TDC: Loaded 46567 existing records from primary storage. [2025-10-07T21:49:15.953962] [INFO ] [MAIN ] TDC: Loaded 46567 existing records. [2025-10-07T21:49:16.128942] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:49:16.129215] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-07T21:49:16.129269] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-07T21:49:16.129522] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-07T21:49:16.129580] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-07T21:49:16.492120] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:16.508277] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T21:49:16.647673] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-07T21:49:16.882254] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-07T21:49:17.447608] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-07T21:49:17.899423] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T21:49:18.051172] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-07T21:49:18.247690] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-07T21:49:19.047708] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-07T21:49:19.847681] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-07T21:49:19.896989] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T21:49:19.914722] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-07T21:49:20.647715] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-07T21:49:20.756785] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-07T21:49:21.426902] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-07T21:49:21.447616] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-07T21:49:22.247628] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-07T21:49:22.321103] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T21:49:22.987179] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-07T21:49:22.988897] [INFO ] [REMOTE ] TBN: Full fetch complete (5665 records). [2025-10-07T21:49:22.988970] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-07T21:49:23.052727] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-07T21:49:23.346019] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-07T21:49:23.346104] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-07T21:49:23.346305] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-07T21:49:23.346345] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-07T21:49:23.346845] [DEBUG] [LOCAL ] TBN: Trimmed 5665 records to 3840 (keeping 200 days of data) [2025-10-07T21:49:23.370511] [DEBUG] [LOCAL ] TBN: Primary data saved (3840 records). [2025-10-07T21:49:23.370635] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-07T21:49:23.370779] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TBN took 30.5s. Estimated remaining: 44m 39s. Rate: 7.1 symbols/min [2025-10-07T21:49:23.548991] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:23.559025] [DEBUG] [LOCAL ] TDF: Loaded 6274 existing records from primary storage. [2025-10-07T21:49:23.559264] [INFO ] [MAIN ] TDF: Loaded 6274 existing records. [2025-10-07T21:49:23.756923] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:49:23.757265] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-07T21:49:23.757342] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-07T21:49:23.757533] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-07T21:49:23.757593] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-07T21:49:23.854414] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-07T21:49:24.149997] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:24.649169] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-07T21:49:24.654890] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T21:49:25.447676] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-07T21:49:25.456866] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T21:49:25.660287] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T21:49:26.088050] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T21:49:26.247749] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-07T21:49:27.047763] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-07T21:49:27.847629] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-07T21:49:27.982866] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T21:49:28.283076] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-07T21:49:28.647626] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-07T21:49:28.777418] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T21:49:29.406669] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T21:49:29.447674] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-07T21:49:30.247688] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-07T21:49:30.273380] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T21:49:31.047729] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-07T21:49:31.779811] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-07T21:49:31.847744] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-07T21:49:32.427026] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-07T21:49:32.647687] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-07T21:49:33.447710] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-07T21:49:33.547605] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T21:49:34.247724] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-07T21:49:34.423203] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T21:49:34.469251] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T21:49:35.047689] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-07T21:49:35.847710] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-07T21:49:35.886313] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T21:49:36.584535] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T21:49:36.647617] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-07T21:49:36.916337] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T21:49:37.008724] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-07T21:49:37.447699] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-07T21:49:38.225460] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-07T21:49:38.247633] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-07T21:49:38.994311] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-07T21:49:39.047725] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-07T21:49:39.847714] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-07T21:49:40.647732] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-07T21:49:40.721396] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T21:49:41.258736] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T21:49:41.447672] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-07T21:49:41.606265] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T21:49:42.247725] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-07T21:49:43.053451] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-07T21:49:43.081006] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T21:49:43.847760] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-07T21:49:43.887683] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T21:49:44.135216] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-07T21:49:44.647701] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-07T21:49:45.447680] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-07T21:49:45.536164] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T21:49:46.247721] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-07T21:49:46.375144] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T21:49:46.414495] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T21:49:47.047709] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-07T21:49:47.807583] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T21:49:47.852788] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-07T21:49:47.876065] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T21:49:48.541586] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:49:48.542841] [INFO ] [REMOTE ] TCBX: Full fetch complete (15879 records). [2025-10-07T21:49:48.542910] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-07T21:49:48.652791] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-07T21:49:48.902367] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-07T21:49:48.902447] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-07T21:49:48.902954] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-07T21:49:48.903019] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-07T21:49:48.903674] [DEBUG] [LOCAL ] TCBX: Trimmed 15879 records to 10211 (keeping 200 days of data) [2025-10-07T21:49:48.965287] [DEBUG] [LOCAL ] TCBX: Primary data saved (10211 records). [2025-10-07T21:49:48.965444] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-07T21:49:48.965548] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TCBX took 41.7s. Estimated remaining: 44m 33s. Rate: 7.1 symbols/min [2025-10-07T21:49:49.130310] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:49.157742] [DEBUG] [LOCAL ] TDG: Loaded 22087 existing records from primary storage. [2025-10-07T21:49:49.158025] [INFO ] [MAIN ] TDG: Loaded 22087 existing records. [2025-10-07T21:49:49.336290] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:49:49.336554] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-07T21:49:49.336621] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-07T21:49:49.337094] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-07T21:49:49.337163] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-07T21:49:49.452757] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-07T21:49:49.730724] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:49.991016] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T21:49:49.992136] [INFO ] [REMOTE ] TDF: Full fetch complete (10372 records). [2025-10-07T21:49:49.992224] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-07T21:49:50.249111] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-07T21:49:50.360477] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-07T21:49:50.360582] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-07T21:49:50.360961] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-07T21:49:50.361046] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-07T21:49:50.361843] [DEBUG] [LOCAL ] TDF: Trimmed 10372 records to 6251 (keeping 200 days of data) [2025-10-07T21:49:50.401535] [DEBUG] [LOCAL ] TDF: Primary data saved (6251 records). [2025-10-07T21:49:50.401736] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-07T21:49:50.401841] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDF took 27.0s. Estimated remaining: 44m 24s. Rate: 7.1 symbols/min [2025-10-07T21:49:50.602301] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:50.609389] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T21:49:50.674930] [DEBUG] [LOCAL ] TDOC: Loaded 53348 existing records from primary storage. [2025-10-07T21:49:50.675396] [INFO ] [MAIN ] TDOC: Loaded 53348 existing records. [2025-10-07T21:49:50.851835] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:49:50.852080] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-07T21:49:50.852129] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-07T21:49:50.852584] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-07T21:49:50.852671] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-07T21:49:51.060167] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-07T21:49:51.212437] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:51.660757] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T21:49:51.847630] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-07T21:49:52.521732] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T21:49:52.525406] [INFO ] [REMOTE ] TD: Full fetch complete (75793 records). [2025-10-07T21:49:52.525528] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-07T21:49:52.662887] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-07T21:49:52.929893] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-07T21:49:52.930174] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-07T21:49:52.931315] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-07T21:49:52.931712] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-07T21:49:52.933333] [DEBUG] [LOCAL ] TD: Trimmed 75793 records to 52350 (keeping 200 days of data) [2025-10-07T21:49:53.047855] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T21:49:53.283155] [DEBUG] [LOCAL ] TD: Primary data saved (52350 records). [2025-10-07T21:49:53.283309] [INFO ] [MAIN ] TD: Full history saved. [2025-10-07T21:49:53.283392] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TD took 39.3s. Estimated remaining: 44m 14s. Rate: 7.1 symbols/min [2025-10-07T21:49:53.449991] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-07T21:49:53.449911] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:53.491391] [DEBUG] [LOCAL ] TDS: Loaded 42760 existing records from primary storage. [2025-10-07T21:49:53.491732] [INFO ] [MAIN ] TDS: Loaded 42760 existing records. [2025-10-07T21:49:53.666184] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:49:53.666433] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-07T21:49:53.666504] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-07T21:49:53.666801] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-07T21:49:53.666859] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-07T21:49:54.055660] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:54.247630] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-07T21:49:54.514878] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T21:49:54.829439] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-07T21:49:55.047691] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-07T21:49:55.786032] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T21:49:55.847619] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-07T21:49:56.557877] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T21:49:56.647669] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-07T21:49:57.233425] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T21:49:57.237048] [INFO ] [REMOTE ] TDC: Full fetch complete (67192 records). [2025-10-07T21:49:57.237167] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-07T21:49:57.452838] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-07T21:49:57.636877] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-07T21:49:57.636980] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-07T21:49:57.638145] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-07T21:49:57.638271] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-07T21:49:57.639858] [DEBUG] [LOCAL ] TDC: Trimmed 67192 records to 46588 (keeping 200 days of data) [2025-10-07T21:49:57.947058] [DEBUG] [LOCAL ] TDC: Primary data saved (46588 records). [2025-10-07T21:49:57.947291] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-07T21:49:57.947432] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDC took 42.2s. Estimated remaining: 44m 5s. Rate: 7.1 symbols/min [2025-10-07T21:49:58.147220] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:49:58.205838] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T21:49:58.232881] [DEBUG] [LOCAL ] TDW: Loaded 45112 existing records from primary storage. [2025-10-07T21:49:58.233333] [INFO ] [MAIN ] TDW: Loaded 45112 existing records. [2025-10-07T21:49:58.255206] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-07T21:49:58.427163] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:49:58.427594] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-07T21:49:58.427694] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-07T21:49:58.428459] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-07T21:49:58.428522] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-07T21:49:58.841021] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:49:59.047710] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-07T21:49:59.574168] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T21:49:59.619941] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-07T21:49:59.847672] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-07T21:50:00.588564] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T21:50:00.647673] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-07T21:50:01.250716] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T21:50:01.447704] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-07T21:50:02.247738] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-07T21:50:02.445632] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T21:50:02.638423] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T21:50:03.047700] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-07T21:50:03.847734] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-07T21:50:04.310291] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T21:50:04.626179] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-07T21:50:04.647632] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-07T21:50:05.447724] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-07T21:50:05.602009] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T21:50:06.247692] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-07T21:50:06.392285] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T21:50:06.490075] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T21:50:07.047697] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-07T21:50:07.656710] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:50:07.847719] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-07T21:50:08.647729] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-07T21:50:09.227078] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-07T21:50:09.447680] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-07T21:50:09.569194] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T21:50:09.662236] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T21:50:10.247703] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-07T21:50:11.047718] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-07T21:50:11.198930] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T21:50:11.847720] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-07T21:50:11.901494] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T21:50:12.013598] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-07T21:50:12.647722] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-07T21:50:13.019860] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-07T21:50:13.022215] [INFO ] [REMOTE ] TDG: Full fetch complete (31991 records). [2025-10-07T21:50:13.022302] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-07T21:50:13.398215] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-07T21:50:13.398399] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-07T21:50:13.399302] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-07T21:50:13.399384] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-07T21:50:13.400608] [DEBUG] [LOCAL ] TDG: Trimmed 31991 records to 22105 (keeping 200 days of data) [2025-10-07T21:50:13.459570] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-07T21:50:13.572704] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T21:50:13.625288] [DEBUG] [LOCAL ] TDG: Primary data saved (22105 records). [2025-10-07T21:50:13.625478] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-07T21:50:13.625615] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDG took 24.7s. Estimated remaining: 43m 58s. Rate: 7.1 symbols/min [2025-10-07T21:50:13.794905] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:50:13.819845] [DEBUG] [LOCAL ] TDY: Loaded 22512 existing records from primary storage. [2025-10-07T21:50:13.820131] [INFO ] [MAIN ] TDY: Loaded 22512 existing records. [2025-10-07T21:50:13.995745] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:50:13.995986] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-07T21:50:13.996034] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-07T21:50:13.996246] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-07T21:50:13.996303] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-07T21:50:14.256313] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-07T21:50:14.356769] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:50:15.047680] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-07T21:50:15.557483] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-07T21:50:15.847721] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-07T21:50:15.903909] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T21:50:16.159307] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T21:50:16.647752] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-07T21:50:17.447740] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-07T21:50:18.055051] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-07T21:50:18.172961] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T21:50:18.247673] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-07T21:50:19.047618] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-07T21:50:19.075235] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T21:50:19.681363] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T21:50:19.852739] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-07T21:50:19.864282] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-07T21:50:20.647742] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-07T21:50:21.447631] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-07T21:50:21.524514] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:50:22.247637] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-07T21:50:22.532304] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-07T21:50:22.727529] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-07T21:50:23.047696] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-07T21:50:23.594152] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T21:50:23.847705] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-07T21:50:24.647699] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-07T21:50:24.739993] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T21:50:25.028446] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-07T21:50:25.447758] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-07T21:50:26.247636] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-07T21:50:26.625778] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-07T21:50:26.947385] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T21:50:27.047614] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-07T21:50:27.490489] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-07T21:50:27.847684] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-07T21:50:28.392848] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T21:50:28.647684] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-07T21:50:29.447639] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-07T21:50:29.776855] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T21:50:29.880577] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-07T21:50:30.247769] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-07T21:50:30.435236] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T21:50:30.438410] [INFO ] [REMOTE ] TDS: Full fetch complete (61676 records). [2025-10-07T21:50:30.438514] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-07T21:50:30.834928] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-07T21:50:30.835030] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-07T21:50:30.836304] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-07T21:50:30.836370] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-07T21:50:30.839781] [DEBUG] [LOCAL ] TDS: Trimmed 61676 records to 42731 (keeping 200 days of data) [2025-10-07T21:50:31.074968] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-07T21:50:31.138689] [DEBUG] [LOCAL ] TDS: Primary data saved (42731 records). [2025-10-07T21:50:31.138931] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-07T21:50:31.139077] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDS took 37.9s. Estimated remaining: 43m 51s. Rate: 7.1 symbols/min [2025-10-07T21:50:31.325417] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:50:31.325848] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-07T21:50:31.325971] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-07T21:50:31.340950] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-07T21:50:31.341716] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-07T21:50:31.342338] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T21:50:31.347545] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-07T21:50:31.348523] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-07T21:50:31.731827] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:50:31.847705] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-07T21:50:32.395271] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T21:50:32.647734] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-07T21:50:32.775160] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T21:50:33.447725] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-07T21:50:33.658444] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:50:33.658845] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-07T21:50:33.658960] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:50:33.659055] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-07T21:50:33.659141] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:50:33.659246] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-07T21:50:33.659346] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-07T21:50:33.659419] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-07T21:50:33.659496] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-07T21:50:33.659588] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TE took 2.5s. Estimated remaining: 43m 42s. Rate: 7.1 symbols/min [2025-10-07T21:50:33.843315] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:50:33.854344] [DEBUG] [LOCAL ] TEAF: Loaded 7509 existing records from primary storage. [2025-10-07T21:50:33.854584] [INFO ] [MAIN ] TEAF: Loaded 7509 existing records. [2025-10-07T21:50:34.035738] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:50:34.045811] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-07T21:50:34.046137] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T21:50:34.046394] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-07T21:50:34.050038] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-07T21:50:34.050114] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-07T21:50:34.073845] [INFO ] [REMOTE ] TDW: Full fetch complete (67035 records). [2025-10-07T21:50:34.114233] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-07T21:50:34.256560] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-07T21:50:34.777515] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:50:34.832478] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-07T21:50:34.832577] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-07T21:50:34.833697] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-07T21:50:34.833766] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-07T21:50:34.835276] [DEBUG] [LOCAL ] TDW: Trimmed 67035 records to 45134 (keeping 200 days of data) [2025-10-07T21:50:35.047853] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-07T21:50:35.111134] [DEBUG] [LOCAL ] TDW: Primary data saved (45134 records). [2025-10-07T21:50:35.111323] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-07T21:50:35.111422] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDW took 37.2s. Estimated remaining: 43m 32s. Rate: 7.1 symbols/min [2025-10-07T21:50:35.293595] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:50:35.350295] [DEBUG] [LOCAL ] TECK: Loaded 53440 existing records from primary storage. [2025-10-07T21:50:35.350795] [INFO ] [MAIN ] TECK: Loaded 53440 existing records. [2025-10-07T21:50:35.489458] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T21:50:35.581890] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:50:35.582199] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-07T21:50:35.582253] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-07T21:50:35.582495] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-07T21:50:35.582554] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-07T21:50:35.856565] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-07T21:50:35.941487] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:50:36.616537] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T21:50:36.647593] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-07T21:50:36.763018] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-07T21:50:36.767069] [INFO ] [REMOTE ] TDOC: Full fetch complete (77294 records). [2025-10-07T21:50:36.767218] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-07T21:50:37.156050] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-07T21:50:37.156142] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-07T21:50:37.157314] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-07T21:50:37.157385] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-07T21:50:37.160015] [DEBUG] [LOCAL ] TDOC: Trimmed 77294 records to 53349 (keeping 200 days of data) [2025-10-07T21:50:37.379014] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-07T21:50:37.452841] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-07T21:50:37.495439] [DEBUG] [LOCAL ] TDOC: Primary data saved (53349 records). [2025-10-07T21:50:37.495612] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-07T21:50:37.495748] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TDOC took 47.1s. Estimated remaining: 43m 23s. Rate: 7.1 symbols/min [2025-10-07T21:50:37.660435] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:50:37.696922] [DEBUG] [LOCAL ] TEF: Loaded 37269 existing records from primary storage. [2025-10-07T21:50:37.697274] [INFO ] [MAIN ] TEF: Loaded 37269 existing records. [2025-10-07T21:50:37.875244] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:50:37.875504] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-07T21:50:37.875553] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-07T21:50:37.875910] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-07T21:50:37.875986] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-07T21:50:38.177164] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T21:50:38.256864] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-07T21:50:38.262469] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:50:39.047629] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-07T21:50:39.365760] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-07T21:50:39.847742] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-07T21:50:40.287254] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T21:50:40.647869] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T21:50:40.647955] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-07T21:50:41.447727] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-07T21:50:42.064170] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T21:50:42.247636] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-07T21:50:43.047731] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-07T21:50:43.412697] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T21:50:43.542205] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-07T21:50:43.671118] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-07T21:50:43.847669] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-07T21:50:44.466946] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-07T21:50:44.647676] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-07T21:50:45.357502] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T21:50:45.447608] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-07T21:50:46.234277] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T21:50:46.247594] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-07T21:50:46.936199] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-07T21:50:47.047695] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-07T21:50:47.847687] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-07T21:50:48.210513] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-07T21:50:48.213240] [INFO ] [REMOTE ] TDY: Full fetch complete (32059 records). [2025-10-07T21:50:48.213339] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-07T21:50:48.613807] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-07T21:50:48.614070] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-07T21:50:48.614964] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-07T21:50:48.615077] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-07T21:50:48.645044] [DEBUG] [LOCAL ] TDY: Trimmed 32059 records to 22459 (keeping 200 days of data) [2025-10-07T21:50:48.648318] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-07T21:50:48.648182] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T21:50:48.807313] [DEBUG] [LOCAL ] TDY: Primary data saved (22459 records). [2025-10-07T21:50:48.807467] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-07T21:50:48.807598] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TDY took 35.2s. Estimated remaining: 43m 15s. Rate: 7.1 symbols/min [2025-10-07T21:50:48.972747] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:50:48.994410] [DEBUG] [LOCAL ] TEI: Loaded 21220 existing records from primary storage. [2025-10-07T21:50:48.994765] [INFO ] [MAIN ] TEI: Loaded 21220 existing records. [2025-10-07T21:50:49.167912] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:50:49.168133] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-07T21:50:49.168181] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-07T21:50:49.168438] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-07T21:50:49.168495] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-07T21:50:49.452873] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-07T21:50:49.519287] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:50:50.239356] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T21:50:50.247589] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-07T21:50:50.487019] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T21:50:50.760509] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T21:50:50.761581] [INFO ] [REMOTE ] TEAF: Full fetch complete (10011 records). [2025-10-07T21:50:50.761701] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-07T21:50:51.052817] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-07T21:50:51.115013] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-07T21:50:51.115092] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-07T21:50:51.115343] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-07T21:50:51.115382] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-07T21:50:51.115867] [DEBUG] [LOCAL ] TEAF: Trimmed 10011 records to 7527 (keeping 200 days of data) [2025-10-07T21:50:51.162673] [DEBUG] [LOCAL ] TEAF: Primary data saved (7527 records). [2025-10-07T21:50:51.162840] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-07T21:50:51.162946] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEAF took 17.5s. Estimated remaining: 43m 5s. Rate: 7.1 symbols/min [2025-10-07T21:50:51.331427] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:50:51.381897] [DEBUG] [LOCAL ] TEL: Loaded 51119 existing records from primary storage. [2025-10-07T21:50:51.382250] [INFO ] [MAIN ] TEL: Loaded 51119 existing records. [2025-10-07T21:50:51.558286] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:50:51.558547] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-07T21:50:51.558607] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-07T21:50:51.558855] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-07T21:50:51.558912] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-07T21:50:51.852749] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-07T21:50:51.945420] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:50:52.647622] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-07T21:50:52.675787] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T21:50:53.447681] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-07T21:50:53.655063] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T21:50:54.247765] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-07T21:50:54.339287] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T21:50:54.382925] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T21:50:55.047713] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-07T21:50:55.847694] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-07T21:50:55.897835] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T21:50:56.647620] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-07T21:50:56.740772] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-07T21:50:56.924786] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T21:50:57.447687] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-07T21:50:58.247743] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-07T21:50:58.496590] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T21:50:58.804793] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T21:50:58.914920] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-07T21:50:59.047715] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-07T21:50:59.847704] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-07T21:51:00.336386] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T21:51:00.647739] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-07T21:51:01.447692] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-07T21:51:01.511099] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T21:51:01.643843] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T21:51:02.247715] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-07T21:51:03.047670] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-07T21:51:03.145763] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T21:51:03.350244] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T21:51:03.847678] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-07T21:51:04.456429] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:51:04.536150] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-07T21:51:04.647600] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-07T21:51:05.447633] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-07T21:51:05.675670] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-07T21:51:06.247711] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-07T21:51:07.053799] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-07T21:51:07.057115] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T21:51:07.847687] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-07T21:51:08.078817] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T21:51:08.456306] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-07T21:51:08.647619] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-07T21:51:08.889173] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T21:51:09.447633] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-07T21:51:09.908809] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T21:51:10.247668] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-07T21:51:10.499936] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-07T21:51:11.047693] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-07T21:51:11.847624] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-07T21:51:12.083916] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T21:51:12.578345] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T21:51:12.647617] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-07T21:51:12.818805] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T21:51:12.821761] [INFO ] [REMOTE ] TEF: Full fetch complete (54905 records). [2025-10-07T21:51:12.821878] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-07T21:51:13.197334] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-07T21:51:13.197422] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-07T21:51:13.198364] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-07T21:51:13.198429] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-07T21:51:13.199687] [DEBUG] [LOCAL ] TEF: Trimmed 54905 records to 37196 (keeping 200 days of data) [2025-10-07T21:51:13.424259] [DEBUG] [LOCAL ] TEF: Primary data saved (37196 records). [2025-10-07T21:51:13.424471] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-07T21:51:13.424598] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TEF took 35.9s. Estimated remaining: 42m 59s. Rate: 7.1 symbols/min [2025-10-07T21:51:13.456522] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-07T21:51:13.600106] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:51:13.631075] [DEBUG] [LOCAL ] TEN: Loaded 30442 existing records from primary storage. [2025-10-07T21:51:13.631395] [INFO ] [MAIN ] TEN: Loaded 30442 existing records. [2025-10-07T21:51:13.806984] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:51:13.807294] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-07T21:51:13.807358] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-07T21:51:13.807588] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-07T21:51:13.807673] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-07T21:51:14.173077] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:51:14.205575] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T21:51:14.247633] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-07T21:51:15.047622] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-07T21:51:15.288684] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T21:51:15.847618] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-07T21:51:16.148229] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-07T21:51:16.192044] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-07T21:51:16.561370] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T21:51:16.647760] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-07T21:51:17.447693] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-07T21:51:18.205772] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T21:51:18.209466] [INFO ] [REMOTE ] TECK: Full fetch complete (77311 records). [2025-10-07T21:51:18.209601] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-07T21:51:18.252914] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-07T21:51:18.486799] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T21:51:18.515604] [INFO ] [REMOTE ] TEI: Full fetch complete (30709 records). [2025-10-07T21:51:18.526297] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-07T21:51:18.714915] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-07T21:51:18.720463] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-07T21:51:18.726882] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-07T21:51:18.732060] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-07T21:51:18.835282] [DEBUG] [LOCAL ] TECK: Trimmed 77311 records to 53438 (keeping 200 days of data) [2025-10-07T21:51:19.053725] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-07T21:51:19.084467] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-07T21:51:19.085840] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-07T21:51:19.086883] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-07T21:51:19.087546] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-07T21:51:19.091831] [DEBUG] [LOCAL ] TEI: Trimmed 30709 records to 21350 (keeping 200 days of data) [2025-10-07T21:51:19.233309] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T21:51:19.384408] [DEBUG] [LOCAL ] TEI: Primary data saved (21350 records). [2025-10-07T21:51:19.386355] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-07T21:51:19.386774] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEI took 30.6s. Estimated remaining: 42m 50s. Rate: 7.1 symbols/min [2025-10-07T21:51:19.566238] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:51:19.657693] [DEBUG] [LOCAL ] TEO: Loaded 22228 existing records from primary storage. [2025-10-07T21:51:19.659533] [INFO ] [MAIN ] TEO: Loaded 22228 existing records. [2025-10-07T21:51:19.852470] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-07T21:51:19.860674] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:51:19.863223] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-07T21:51:19.863893] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-07T21:51:19.865106] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-07T21:51:19.865190] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-07T21:51:19.899555] [DEBUG] [LOCAL ] TECK: Primary data saved (53438 records). [2025-10-07T21:51:19.940934] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-07T21:51:19.970684] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TECK took 44.9s. Estimated remaining: 42m 41s. Rate: 7.1 symbols/min [2025-10-07T21:51:20.325968] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:51:20.407258] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:51:20.452548] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-10-07T21:51:20.452915] [INFO ] [MAIN ] TEVA: Loaded 53633 existing records. [2025-10-07T21:51:20.630738] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:51:20.631063] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-07T21:51:20.631123] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-07T21:51:20.632224] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-07T21:51:20.632284] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-07T21:51:20.663340] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-07T21:51:20.992719] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:51:21.009098] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T21:51:21.043626] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T21:51:21.447689] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-07T21:51:21.897232] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T21:51:22.247719] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-07T21:51:22.487432] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T21:51:23.047709] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-07T21:51:23.855245] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-07T21:51:23.858602] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T21:51:24.196686] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T21:51:24.647673] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-07T21:51:25.248349] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T21:51:25.447731] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-07T21:51:26.220203] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T21:51:26.253895] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-07T21:51:26.255111] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-07T21:51:27.047695] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-07T21:51:27.847621] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-07T21:51:28.067474] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T21:51:28.187685] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T21:51:28.546883] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T21:51:28.647692] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-07T21:51:28.754804] [DEBUG] [REMOTE ] TEVA: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-07T21:51:28.755123] [WARN ] [REMOTE ] TEVA: No data returned for month 2025-01 [2025-10-07T21:51:28.755211] [FATAL] [REMOTE ] TEVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:51:28.755294] [FATAL] [MAIN ] TEVA: Failed to fetch primary data. [2025-10-07T21:51:28.755357] [WARN ] [MAIN ] TEVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:51:28.755432] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-07T21:51:28.755501] [DEBUG] [LOCAL ] TEVA: No primary data file found to delete. [2025-10-07T21:51:28.755539] [INFO ] [LOCAL ] TEVA: Starting deletion of derivative data. [2025-10-07T21:51:28.755913] [DEBUG] [LOCAL ] TEVA: Deleted derivative data file. [2025-10-07T21:51:28.756007] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEVA took 8.8s. Estimated remaining: 42m 32s. Rate: 7.1 symbols/min [2025-10-07T21:51:28.922823] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:51:28.962947] [DEBUG] [LOCAL ] TEX: Loaded 44084 existing records from primary storage. [2025-10-07T21:51:28.963315] [INFO ] [MAIN ] TEX: Loaded 44084 existing records. [2025-10-07T21:51:29.138122] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:51:29.138417] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-07T21:51:29.138466] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-07T21:51:29.139515] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-07T21:51:29.139574] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-07T21:51:29.458245] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-07T21:51:29.500196] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:51:30.247637] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-07T21:51:30.563245] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T21:51:31.047705] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-07T21:51:31.847719] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-07T21:51:32.017313] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T21:51:32.120072] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T21:51:32.647765] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-07T21:51:33.457448] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-07T21:51:33.480758] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T21:51:33.536750] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-07T21:51:34.247711] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-07T21:51:34.867778] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T21:51:35.047682] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-07T21:51:35.261920] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-07T21:51:35.847751] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-07T21:51:36.315742] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:51:36.320946] [INFO ] [REMOTE ] TEL: Full fetch complete (73428 records). [2025-10-07T21:51:36.321154] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-07T21:51:36.657027] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-07T21:51:36.764837] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T21:51:36.771706] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-07T21:51:36.772252] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-07T21:51:36.773539] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-07T21:51:36.773690] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-07T21:51:36.775538] [DEBUG] [LOCAL ] TEL: Trimmed 73428 records to 51095 (keeping 200 days of data) [2025-10-07T21:51:37.106740] [DEBUG] [LOCAL ] TEL: Primary data saved (51095 records). [2025-10-07T21:51:37.106904] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-07T21:51:37.107029] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEL took 45.9s. Estimated remaining: 42m 24s. Rate: 7.1 symbols/min [2025-10-07T21:51:37.274968] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:51:37.325120] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-07T21:51:37.325452] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-07T21:51:37.460856] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-07T21:51:37.502970] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:51:37.503365] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-07T21:51:37.503431] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-07T21:51:37.505229] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-07T21:51:37.505289] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-07T21:51:37.876801] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:51:37.878412] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-07T21:51:38.247740] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-07T21:51:38.800448] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T21:51:39.047720] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-07T21:51:39.750061] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T21:51:39.847634] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-07T21:51:40.040384] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T21:51:40.647755] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-07T21:51:41.203075] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T21:51:41.447710] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-07T21:51:42.241571] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T21:51:42.252761] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-07T21:51:42.720854] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T21:51:43.047623] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-07T21:51:43.238593] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T21:51:43.240827] [INFO ] [REMOTE ] TEN: Full fetch complete (44018 records). [2025-10-07T21:51:43.240911] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-07T21:51:43.634237] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-07T21:51:43.634344] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-07T21:51:43.635247] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-07T21:51:43.635315] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-07T21:51:43.636586] [DEBUG] [LOCAL ] TEN: Trimmed 44018 records to 30447 (keeping 200 days of data) [2025-10-07T21:51:43.835452] [DEBUG] [LOCAL ] TEN: Primary data saved (30447 records). [2025-10-07T21:51:43.835617] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-07T21:51:43.835744] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEN took 30.4s. Estimated remaining: 42m 15s. Rate: 7.1 symbols/min [2025-10-07T21:51:43.856387] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-07T21:51:43.944999] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-07T21:51:43.985900] [INFO ] [REMOTE ] TEO: Full fetch complete (32574 records). [2025-10-07T21:51:43.998704] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-07T21:51:44.017354] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:51:44.342129] [DEBUG] [LOCAL ] TFII: Loaded 33524 existing records from primary storage. [2025-10-07T21:51:44.353402] [INFO ] [MAIN ] TFII: Loaded 33524 existing records. [2025-10-07T21:51:44.548329] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-07T21:51:44.555853] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-07T21:51:44.562673] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-07T21:51:44.562766] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-07T21:51:44.601386] [DEBUG] [LOCAL ] TEO: Trimmed 32574 records to 22300 (keeping 200 days of data) [2025-10-07T21:51:44.709197] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-07T21:51:44.737812] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:51:44.739326] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-07T21:51:44.765833] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-07T21:51:44.767735] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-07T21:51:44.768243] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-07T21:51:45.172449] [DEBUG] [LOCAL ] TEO: Primary data saved (22300 records). [2025-10-07T21:51:45.184198] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-07T21:51:45.184374] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEO took 25.8s. Estimated remaining: 42m 5s. Rate: 7.1 symbols/min [2025-10-07T21:51:45.243023] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:51:45.397825] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:51:45.422773] [DEBUG] [LOCAL ] TFIN: Loaded 23423 existing records from primary storage. [2025-10-07T21:51:45.423138] [INFO ] [MAIN ] TFIN: Loaded 23423 existing records. [2025-10-07T21:51:45.455246] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-07T21:51:45.628061] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:51:45.628396] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-07T21:51:45.628463] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-07T21:51:45.629369] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-07T21:51:45.629429] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-07T21:51:45.802036] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-07T21:51:46.033833] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:51:46.106097] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-07T21:51:46.247678] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-07T21:51:46.640272] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T21:51:47.047628] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-07T21:51:47.139993] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T21:51:47.847670] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-07T21:51:48.265864] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T21:51:48.647668] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-07T21:51:48.910258] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T21:51:49.447771] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-07T21:51:50.053346] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:51:50.247668] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-07T21:51:51.047626] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-07T21:51:51.131904] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T21:51:51.860128] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-07T21:51:51.862897] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T21:51:51.906397] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T21:51:52.647690] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-07T21:51:53.447631] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-07T21:51:53.590383] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T21:51:54.247636] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-07T21:51:54.339741] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T21:51:55.047633] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-07T21:51:55.064381] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T21:51:55.781162] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T21:51:55.847630] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-07T21:51:56.623020] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T21:51:56.647597] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-07T21:51:57.177482] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-07T21:51:57.447672] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-07T21:51:58.247635] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-07T21:51:59.040851] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T21:51:59.050451] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-07T21:51:59.305349] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-07T21:51:59.814828] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T21:51:59.847605] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-07T21:52:00.162175] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T21:52:00.647685] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-07T21:52:01.447616] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-07T21:52:01.801538] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T21:52:02.247623] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-07T21:52:02.424638] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T21:52:02.968120] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T21:52:03.047607] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-07T21:52:03.264482] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T21:52:03.847685] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-07T21:52:04.647688] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-07T21:52:05.315044] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T21:52:05.363542] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-07T21:52:05.447602] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-07T21:52:06.247619] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-07T21:52:06.400056] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T21:52:06.759575] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T21:52:06.762753] [INFO ] [REMOTE ] TEX: Full fetch complete (64578 records). [2025-10-07T21:52:06.762887] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-07T21:52:07.050600] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-07T21:52:07.151375] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-07T21:52:07.151523] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-07T21:52:07.152553] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-07T21:52:07.152625] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-07T21:52:07.154160] [DEBUG] [LOCAL ] TEX: Trimmed 64578 records to 44018 (keeping 200 days of data) [2025-10-07T21:52:07.424851] [DEBUG] [LOCAL ] TEX: Primary data saved (44018 records). [2025-10-07T21:52:07.425005] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-07T21:52:07.425106] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TEX took 38.7s. Estimated remaining: 41m 59s. Rate: 7.1 symbols/min [2025-10-07T21:52:07.593946] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:52:07.633494] [DEBUG] [LOCAL ] TFPM: Loaded 38273 existing records from primary storage. [2025-10-07T21:52:07.633815] [INFO ] [MAIN ] TFPM: Loaded 38273 existing records. [2025-10-07T21:52:07.778822] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T21:52:07.848088] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-07T21:52:07.851814] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:52:07.852116] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-07T21:52:07.852197] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-07T21:52:07.854576] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-07T21:52:07.854638] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-07T21:52:08.215881] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:52:08.255342] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T21:52:08.647756] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-07T21:52:09.326142] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T21:52:09.447635] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-07T21:52:10.044808] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-07T21:52:10.247619] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-07T21:52:10.419567] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T21:52:10.422092] [INFO ] [REMOTE ] TFII: Full fetch complete (47951 records). [2025-10-07T21:52:10.422187] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-07T21:52:10.808939] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-07T21:52:10.809077] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-07T21:52:10.810082] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-07T21:52:10.810150] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-07T21:52:10.811312] [DEBUG] [LOCAL ] TFII: Trimmed 47951 records to 33427 (keeping 200 days of data) [2025-10-07T21:52:11.024721] [DEBUG] [LOCAL ] TFII: Primary data saved (33427 records). [2025-10-07T21:52:11.024894] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-07T21:52:11.024988] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 27.2s. Estimated remaining: 41m 50s. Rate: 7.1 symbols/min [2025-10-07T21:52:11.053945] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-07T21:52:11.198594] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:52:11.241393] [DEBUG] [LOCAL ] TFX: Loaded 36998 existing records from primary storage. [2025-10-07T21:52:11.241738] [INFO ] [MAIN ] TFX: Loaded 36998 existing records. [2025-10-07T21:52:11.425695] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:52:11.427005] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-07T21:52:11.427237] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-07T21:52:11.428950] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-07T21:52:11.429015] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-07T21:52:11.630044] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-07T21:52:11.825491] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:52:11.847711] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-07T21:52:12.647688] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-07T21:52:13.044272] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T21:52:13.192868] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T21:52:13.447619] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-07T21:52:13.534973] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T21:52:14.247740] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-07T21:52:15.047629] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-07T21:52:15.099131] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T21:52:15.101768] [INFO ] [REMOTE ] TFIN: Full fetch complete (31555 records). [2025-10-07T21:52:15.101853] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-07T21:52:15.485070] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-07T21:52:15.485185] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-07T21:52:15.486135] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-07T21:52:15.486206] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-07T21:52:15.487865] [DEBUG] [LOCAL ] TFIN: Trimmed 31555 records to 23508 (keeping 200 days of data) [2025-10-07T21:52:15.630324] [DEBUG] [LOCAL ] TFIN: Primary data saved (23508 records). [2025-10-07T21:52:15.630471] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-07T21:52:15.630590] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFIN took 30.4s. Estimated remaining: 41m 41s. Rate: 7.1 symbols/min [2025-10-07T21:52:15.808473] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:52:15.821893] [DEBUG] [LOCAL ] TG: Loaded 10390 existing records from primary storage. [2025-10-07T21:52:15.822129] [INFO ] [MAIN ] TG: Loaded 10390 existing records. [2025-10-07T21:52:15.854233] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-07T21:52:16.010843] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:52:16.011065] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-07T21:52:16.011114] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-07T21:52:16.011600] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-07T21:52:16.011691] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-07T21:52:16.383878] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-07T21:52:16.432418] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:52:16.455715] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T21:52:16.647722] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-07T21:52:17.288368] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T21:52:17.447693] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-07T21:52:17.529611] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T21:52:18.247762] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-07T21:52:19.047737] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-07T21:52:19.396558] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-07T21:52:19.847701] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-07T21:52:19.898143] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T21:52:20.124142] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T21:52:20.647674] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-07T21:52:21.379982] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T21:52:21.447634] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-07T21:52:21.528278] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T21:52:22.247730] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-07T21:52:22.800978] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-07T21:52:23.044081] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T21:52:23.047587] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-07T21:52:23.847620] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-07T21:52:23.856949] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T21:52:24.647708] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-07T21:52:25.131637] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-07T21:52:25.157181] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T21:52:25.161941] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-10-07T21:52:25.162162] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-07T21:52:25.465430] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-07T21:52:25.749990] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-07T21:52:25.750095] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-07T21:52:25.751261] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-07T21:52:25.751342] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-07T21:52:25.755253] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 53667 (keeping 200 days of data) [2025-10-07T21:52:26.097125] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-07T21:52:26.097385] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-07T21:52:26.097826] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFC took 49.0s. Estimated remaining: 41m 33s. Rate: 7.1 symbols/min [2025-10-07T21:52:26.261129] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-07T21:52:26.264301] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:52:26.265781] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-07T21:52:26.265846] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-07T21:52:26.265979] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-07T21:52:26.266022] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-07T21:52:26.266065] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-07T21:52:26.266098] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-07T21:52:26.611538] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:52:27.047731] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-07T21:52:27.323288] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T21:52:27.374974] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:52:27.381980] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-07T21:52:27.382695] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:52:27.382985] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T21:52:27.383978] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-07T21:52:27.385911] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:52:27.386280] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-07T21:52:27.386355] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-07T21:52:27.386393] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-07T21:52:27.386487] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-07T21:52:27.386568] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TGE took 1.3s. Estimated remaining: 41m 23s. Rate: 7.1 symbols/min [2025-10-07T21:52:27.847691] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-07T21:52:28.643334] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T21:52:28.647590] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-07T21:52:29.440374] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T21:52:29.447603] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-07T21:52:30.247737] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-07T21:52:30.267037] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T21:52:31.047683] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-07T21:52:31.685467] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-07T21:52:31.841580] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T21:52:31.847589] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-07T21:52:32.461725] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T21:52:32.463033] [INFO ] [REMOTE ] TG: Full fetch complete (15044 records). [2025-10-07T21:52:32.463119] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-07T21:52:32.655763] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-07T21:52:32.870601] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-07T21:52:32.870703] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-07T21:52:32.871048] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-07T21:52:32.871088] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-07T21:52:32.871595] [DEBUG] [LOCAL ] TG: Trimmed 15044 records to 10390 (keeping 200 days of data) [2025-10-07T21:52:32.932001] [DEBUG] [LOCAL ] TG: Primary data saved (10390 records). [2025-10-07T21:52:32.932148] [INFO ] [MAIN ] TG: Full history saved. [2025-10-07T21:52:32.932253] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TG took 17.3s. Estimated remaining: 41m 14s. Rate: 7.1 symbols/min [2025-10-07T21:52:33.447705] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-07T21:52:34.323500] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-07T21:52:34.332449] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-07T21:52:34.988587] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T21:52:35.047732] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-07T21:52:36.181729] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T21:52:36.192497] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-07T21:52:36.548923] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T21:52:36.647702] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-07T21:52:37.780600] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T21:52:37.789956] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-07T21:52:38.236028] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T21:52:38.247593] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-07T21:52:39.206060] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T21:52:39.215130] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-07T21:52:39.572065] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T21:52:39.576490] [INFO ] [REMOTE ] TFPM: Full fetch complete (51657 records). [2025-10-07T21:52:39.576603] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-07T21:52:39.986594] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-07T21:52:39.986769] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-07T21:52:39.987895] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-07T21:52:39.987977] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-07T21:52:39.989523] [DEBUG] [LOCAL ] TFPM: Trimmed 51657 records to 38362 (keeping 200 days of data) [2025-10-07T21:52:40.269441] [DEBUG] [LOCAL ] TFPM: Primary data saved (38362 records). [2025-10-07T21:52:40.269661] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-07T21:52:40.269793] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TFPM took 32.8s. Estimated remaining: 41m 6s. Rate: 7.1 symbols/min [2025-10-07T21:52:40.539146] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T21:52:40.546626] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-07T21:52:42.061162] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T21:52:42.072258] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-07T21:52:43.572782] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T21:52:43.586230] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-07T21:52:45.114542] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-07T21:52:45.123612] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-07T21:52:46.341364] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T21:52:46.344246] [INFO ] [REMOTE ] TFX: Full fetch complete (54679 records). [2025-10-07T21:52:46.344332] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-07T21:52:46.729898] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-07T21:52:46.729986] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-07T21:52:46.730901] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-07T21:52:46.730965] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-07T21:52:46.732346] [DEBUG] [LOCAL ] TFX: Trimmed 54679 records to 36913 (keeping 200 days of data) [2025-10-07T21:52:46.977182] [DEBUG] [LOCAL ] TFX: Primary data saved (36913 records). [2025-10-07T21:52:46.977352] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-07T21:52:46.977441] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TFX took 36.0s. Estimated remaining: 40m 57s. Rate: 7.1 symbols/min [2025-10-07T21:52:47.584005] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:52:47.666415] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:52:47.700027] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:52:47.726764] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:52:47.779284] [DEBUG] [LOCAL ] TGS: Loaded 32864 existing records from primary storage. [2025-10-07T21:52:47.778259] [DEBUG] [LOCAL ] TGLS: Loaded 27798 existing records from primary storage. [2025-10-07T21:52:47.779981] [INFO ] [MAIN ] TGS: Loaded 32864 existing records. [2025-10-07T21:52:47.780168] [INFO ] [MAIN ] TGLS: Loaded 27798 existing records. [2025-10-07T21:52:48.056416] [DEBUG] [LOCAL ] TGNA: Loaded 48647 existing records from primary storage. [2025-10-07T21:52:48.132351] [INFO ] [MAIN ] TGNA: Loaded 48647 existing records. [2025-10-07T21:52:48.244801] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:52:48.251542] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-07T21:52:48.251042] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:52:48.281555] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-07T21:52:48.307904] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-07T21:52:48.313314] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-07T21:52:48.281466] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-07T21:52:48.362734] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-07T21:52:48.324335] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-07T21:52:48.406527] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-10-07T21:52:48.426256] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-07T21:52:48.457623] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-07T21:52:48.815966] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:52:48.877530] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-07T21:52:48.935534] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-07T21:52:49.034052] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-07T21:52:49.050562] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-07T21:52:49.141251] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:52:49.242496] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-07T21:52:49.278423] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-07T21:52:49.387385] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-07T21:52:49.408442] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-07T21:52:49.652113] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:52:49.786362] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-07T21:52:49.878284] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:52:49.924235] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-07T21:52:50.214322] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:52:50.243562] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-07T21:52:50.336915] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:52:50.337302] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-07T21:52:51.141728] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T21:52:51.148093] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-07T21:52:51.228222] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-07T21:52:51.235377] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-07T21:52:51.601859] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T21:52:51.612495] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-07T21:52:52.120038] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:52:52.133128] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-07T21:52:52.534262] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T21:52:52.541376] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-07T21:52:52.684948] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T21:52:52.693290] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-07T21:52:53.035235] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T21:52:53.045094] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-07T21:52:53.683374] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T21:52:53.689818] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-07T21:52:53.974730] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T21:52:53.981758] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-07T21:52:54.199494] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-07T21:52:54.211265] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-07T21:52:54.272475] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-07T21:52:54.282725] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-07T21:52:54.946548] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-07T21:52:55.047633] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-07T21:52:55.099969] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T21:52:55.847625] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-07T21:52:55.971583] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T21:52:56.073534] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T21:52:56.105962] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T21:52:56.647696] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-07T21:52:57.235999] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-07T21:52:57.447689] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-07T21:52:58.256607] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-07T21:52:58.263257] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T21:52:58.849780] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T21:52:59.047709] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-07T21:52:59.847705] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-07T21:53:00.647705] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-07T21:53:00.718360] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T21:53:00.771244] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-07T21:53:00.828134] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T21:53:01.447738] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-07T21:53:02.067584] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T21:53:02.247697] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-07T21:53:03.046842] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-07T21:53:03.056183] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-07T21:53:03.742749] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T21:53:03.847639] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-07T21:53:04.271817] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T21:53:04.647692] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-07T21:53:05.266176] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-07T21:53:05.447777] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-07T21:53:06.247707] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-07T21:53:07.058692] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-07T21:53:07.066927] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-07T21:53:07.116625] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T21:53:07.852746] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-07T21:53:07.871735] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T21:53:08.244809] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T21:53:08.647742] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-07T21:53:09.452728] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-07T21:53:09.475078] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T21:53:10.012777] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T21:53:10.247699] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-07T21:53:11.047738] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-07T21:53:11.489397] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T21:53:11.847874] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-07T21:53:11.852869] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-07T21:53:12.386246] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T21:53:12.647703] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-07T21:53:12.994579] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T21:53:12.997760] [INFO ] [REMOTE ] TGS: Full fetch complete (47964 records). [2025-10-07T21:53:12.997876] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-07T21:53:13.404268] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-07T21:53:13.404403] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-07T21:53:13.405830] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-07T21:53:13.405905] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-07T21:53:13.407538] [DEBUG] [LOCAL ] TGS: Trimmed 47964 records to 32906 (keeping 200 days of data) [2025-10-07T21:53:13.460104] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-07T21:53:13.623313] [DEBUG] [LOCAL ] TGS: Primary data saved (32906 records). [2025-10-07T21:53:13.623539] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-07T21:53:13.623675] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGS took 26.6s. Estimated remaining: 40m 51s. Rate: 7.1 symbols/min [2025-10-07T21:53:13.799512] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:53:13.854081] [DEBUG] [LOCAL ] THC: Loaded 47514 existing records from primary storage. [2025-10-07T21:53:13.854530] [INFO ] [MAIN ] THC: Loaded 47514 existing records. [2025-10-07T21:53:14.041422] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:53:14.041798] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-07T21:53:14.041924] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-07T21:53:14.043779] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-07T21:53:14.043942] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-07T21:53:14.160130] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-07T21:53:14.183905] [INFO ] [REMOTE ] TGNA: Full fetch complete (69981 records). [2025-10-07T21:53:14.194493] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-07T21:53:14.252785] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-07T21:53:14.772790] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:53:14.787193] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T21:53:14.815811] [INFO ] [REMOTE ] TGLS: Full fetch complete (40549 records). [2025-10-07T21:53:14.841060] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-07T21:53:14.938301] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-07T21:53:14.959545] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-07T21:53:14.972603] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-07T21:53:14.997191] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-07T21:53:15.052264] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-07T21:53:15.080336] [DEBUG] [LOCAL ] TGNA: Trimmed 69981 records to 48672 (keeping 200 days of data) [2025-10-07T21:53:15.398790] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-07T21:53:15.399315] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-07T21:53:15.401198] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-07T21:53:15.401283] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-07T21:53:15.405014] [DEBUG] [LOCAL ] TGLS: Trimmed 40549 records to 27698 (keeping 200 days of data) [2025-10-07T21:53:15.728963] [DEBUG] [LOCAL ] TGLS: Primary data saved (27698 records). [2025-10-07T21:53:15.730492] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-07T21:53:15.730956] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGLS took 28.8s. Estimated remaining: 40m 42s. Rate: 7.1 symbols/min [2025-10-07T21:53:15.984349] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:53:16.018705] [DEBUG] [LOCAL ] TGNA: Primary data saved (48672 records). [2025-10-07T21:53:16.020098] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-07T21:53:16.020247] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 29.0s. Estimated remaining: 40m 32s. Rate: 7.1 symbols/min [2025-10-07T21:53:16.054059] [DEBUG] [LOCAL ] THG: Loaded 21672 existing records from primary storage. [2025-10-07T21:53:16.088949] [INFO ] [MAIN ] THG: Loaded 21672 existing records. [2025-10-07T21:53:16.315876] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:53:16.402967] [DEBUG] [LOCAL ] THIR: Loaded 2258 existing records from primary storage. [2025-10-07T21:53:16.407208] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:53:16.408168] [INFO ] [MAIN ] THIR: Loaded 2258 existing records. [2025-10-07T21:53:16.408297] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-07T21:53:16.408453] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-07T21:53:16.425673] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-07T21:53:16.448312] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-07T21:53:16.767176] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:53:16.770186] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-07T21:53:16.856873] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-07T21:53:16.895582] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-07T21:53:16.912804] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-07T21:53:17.264047] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (3.01 seconds). [2025-10-07T21:53:17.476793] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-07T21:53:17.605674] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-07T21:53:17.785113] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-07T21:53:17.834766] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:53:17.853945] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-07T21:53:17.927202] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:53:18.247718] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-07T21:53:18.579406] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-07T21:53:18.967995] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T21:53:19.047629] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-07T21:53:19.394990] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-07T21:53:19.513783] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T21:53:19.563592] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-07T21:53:19.847708] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-07T21:53:20.647707] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-07T21:53:21.447636] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-07T21:53:21.802846] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-07T21:53:21.803806] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T21:53:21.984963] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-07T21:53:22.247775] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-07T21:53:22.676943] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-07T21:53:23.047892] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-07T21:53:23.847709] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-07T21:53:24.647668] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-07T21:53:25.032627] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T21:53:25.100316] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-07T21:53:25.206444] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-07T21:53:25.447755] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-07T21:53:25.912932] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:53:25.916839] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-10-07T21:53:25.916966] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-07T21:53:26.252882] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-07T21:53:26.374212] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-07T21:53:26.374329] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-07T21:53:26.375534] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-07T21:53:26.375659] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-07T21:53:26.377443] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-10-07T21:53:26.741627] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-10-07T21:53:26.741881] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-07T21:53:26.742040] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 39.8s. Estimated remaining: 40m 24s. Rate: 7.1 symbols/min [2025-10-07T21:53:26.922484] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:53:26.926052] [DEBUG] [LOCAL ] THLV: Loaded 1539 existing records from primary storage. [2025-10-07T21:53:26.926206] [INFO ] [MAIN ] THLV: Loaded 1539 existing records. [2025-10-07T21:53:27.052760] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-07T21:53:27.110737] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:53:27.111017] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-07T21:53:27.111088] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-07T21:53:27.111403] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-07T21:53:27.111467] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-07T21:53:27.478831] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:53:27.847693] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-07T21:53:28.251558] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T21:53:28.305948] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-07T21:53:28.647698] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-07T21:53:29.106194] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-07T21:53:29.447752] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-07T21:53:29.922045] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-07T21:53:30.247728] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-07T21:53:30.763627] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-07T21:53:31.047697] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-07T21:53:31.456894] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (5.20 seconds). [2025-10-07T21:53:31.847697] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-07T21:53:32.585895] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T21:53:32.647620] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-07T21:53:33.447692] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-07T21:53:34.247711] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-07T21:53:34.686784] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-07T21:53:35.047625] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-07T21:53:35.210063] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T21:53:35.480287] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-07T21:53:35.686513] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (3.84 seconds). [2025-10-07T21:53:35.847690] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-07T21:53:36.167598] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-07T21:53:36.647731] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-07T21:53:37.197918] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (4.55 seconds). [2025-10-07T21:53:37.447736] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-07T21:53:38.178000] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T21:53:38.247673] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-07T21:53:38.444321] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T21:53:38.635018] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T21:53:38.636212] [INFO ] [REMOTE ] THIR: Full fetch complete (2811 records). [2025-10-07T21:53:38.636311] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-07T21:53:39.020966] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-07T21:53:39.021088] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-07T21:53:39.021293] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-07T21:53:39.021366] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-07T21:53:39.021844] [DEBUG] [LOCAL ] THIR: Trimmed 2811 records to 2271 (keeping 200 days of data) [2025-10-07T21:53:39.036639] [DEBUG] [LOCAL ] THIR: Primary data saved (2271 records). [2025-10-07T21:53:39.036777] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-07T21:53:39.036869] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THIR took 23.0s. Estimated remaining: 40m 16s. Rate: 7.1 symbols/min [2025-10-07T21:53:39.052811] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-07T21:53:39.225704] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:53:39.269034] [DEBUG] [LOCAL ] THO: Loaded 41813 existing records from primary storage. [2025-10-07T21:53:39.269391] [INFO ] [MAIN ] THO: Loaded 41813 existing records. [2025-10-07T21:53:39.451750] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:53:39.452026] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-07T21:53:39.452081] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-07T21:53:39.453363] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-07T21:53:39.453423] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-07T21:53:39.607268] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-07T21:53:39.814221] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:53:39.847625] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-07T21:53:40.647732] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-07T21:53:41.084396] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-07T21:53:41.399539] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T21:53:41.447635] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-07T21:53:42.247731] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-07T21:53:42.757783] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-07T21:53:42.960942] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T21:53:43.047696] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-07T21:53:43.847752] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-07T21:53:44.186249] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-07T21:53:44.647699] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-07T21:53:44.827427] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T21:53:44.993139] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-07T21:53:45.447714] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-07T21:53:46.247696] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-07T21:53:46.662131] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-07T21:53:47.047618] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-07T21:53:47.241973] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T21:53:47.847709] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-07T21:53:48.498143] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T21:53:48.647694] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-07T21:53:48.695448] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T21:53:49.447683] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-07T21:53:49.802664] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-07T21:53:50.247670] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-07T21:53:50.431860] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T21:53:51.047680] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-07T21:53:51.302681] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T21:53:51.333507] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-07T21:53:51.334234] [INFO ] [REMOTE ] THLV: Full fetch complete (2634 records). [2025-10-07T21:53:51.334306] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-07T21:53:51.683049] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-07T21:53:51.683137] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-07T21:53:51.683246] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-07T21:53:51.683284] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-07T21:53:51.683634] [DEBUG] [LOCAL ] THLV: Trimmed 2634 records to 1542 (keeping 200 days of data) [2025-10-07T21:53:51.693223] [DEBUG] [LOCAL ] THLV: Primary data saved (1542 records). [2025-10-07T21:53:51.693292] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-07T21:53:51.693393] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THLV took 25.0s. Estimated remaining: 40m 8s. Rate: 7.1 symbols/min [2025-10-07T21:53:51.857531] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:53:51.853935] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-07T21:53:51.884451] [DEBUG] [LOCAL ] THQ: Loaded 25145 existing records from primary storage. [2025-10-07T21:53:51.884760] [INFO ] [MAIN ] THQ: Loaded 25145 existing records. [2025-10-07T21:53:52.083937] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:53:52.084310] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-07T21:53:52.084371] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-07T21:53:52.085706] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-07T21:53:52.085774] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-07T21:53:52.494560] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:53:52.647624] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-07T21:53:52.729712] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T21:53:53.447693] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-07T21:53:54.247715] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-07T21:53:54.288745] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T21:53:55.047719] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-07T21:53:55.091872] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-07T21:53:55.310449] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-07T21:53:55.847716] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-07T21:53:56.657389] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-07T21:53:56.660025] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T21:53:57.130079] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T21:53:57.447671] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-07T21:53:57.585407] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T21:53:57.587281] [INFO ] [REMOTE ] THG: Full fetch complete (31119 records). [2025-10-07T21:53:57.587358] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-07T21:53:57.954524] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-07T21:53:57.954606] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-07T21:53:57.955321] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-07T21:53:57.955386] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-07T21:53:57.956533] [DEBUG] [LOCAL ] THG: Trimmed 31119 records to 21623 (keeping 200 days of data) [2025-10-07T21:53:58.093416] [DEBUG] [LOCAL ] THG: Primary data saved (21623 records). [2025-10-07T21:53:58.093556] [INFO ] [MAIN ] THG: Full history saved. [2025-10-07T21:53:58.093679] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THG took 42.4s. Estimated remaining: 39m 60s. Rate: 7.1 symbols/min [2025-10-07T21:53:58.256681] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-07T21:53:58.259426] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:53:58.281011] [DEBUG] [LOCAL ] THR: Loaded 19831 existing records from primary storage. [2025-10-07T21:53:58.281309] [INFO ] [MAIN ] THR: Loaded 19831 existing records. [2025-10-07T21:53:58.485781] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:53:58.486064] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-07T21:53:58.486116] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-07T21:53:58.486856] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-07T21:53:58.486924] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-07T21:53:58.859760] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:53:59.059020] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-07T21:53:59.062438] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T21:53:59.395763] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-07T21:53:59.847708] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-07T21:54:00.132980] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-07T21:54:00.647693] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-07T21:54:01.107846] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-07T21:54:01.447633] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-07T21:54:01.715155] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T21:54:02.247680] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-07T21:54:02.954415] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T21:54:03.047733] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-07T21:54:03.431456] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T21:54:03.771871] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T21:54:03.847693] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-07T21:54:04.647721] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-07T21:54:05.455679] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-07T21:54:05.461936] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-07T21:54:05.781309] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-07T21:54:06.247627] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-07T21:54:06.471186] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-07T21:54:07.047696] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-07T21:54:07.121077] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-07T21:54:07.847692] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-07T21:54:08.474163] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T21:54:08.647626] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-07T21:54:08.850323] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T21:54:08.853161] [INFO ] [REMOTE ] THO: Full fetch complete (60232 records). [2025-10-07T21:54:08.853264] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-07T21:54:09.233566] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-07T21:54:09.233696] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-07T21:54:09.234697] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-07T21:54:09.234763] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-07T21:54:09.236212] [DEBUG] [LOCAL ] THO: Trimmed 60232 records to 41733 (keeping 200 days of data) [2025-10-07T21:54:09.449985] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-07T21:54:09.499909] [DEBUG] [LOCAL ] THO: Primary data saved (41733 records). [2025-10-07T21:54:09.500060] [INFO ] [MAIN ] THO: Full history saved. [2025-10-07T21:54:09.500150] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THO took 30.5s. Estimated remaining: 39m 52s. Rate: 7.1 symbols/min [2025-10-07T21:54:09.675024] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:54:09.712891] [DEBUG] [LOCAL ] THS: Loaded 38439 existing records from primary storage. [2025-10-07T21:54:09.713224] [INFO ] [MAIN ] THS: Loaded 38439 existing records. [2025-10-07T21:54:09.890783] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:54:09.891156] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-07T21:54:09.891211] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-07T21:54:09.892611] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-07T21:54:09.892705] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-07T21:54:10.001450] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T21:54:10.015852] [INFO ] [REMOTE ] THC: Full fetch complete (69012 records). [2025-10-07T21:54:10.031414] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-07T21:54:10.268326] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-07T21:54:10.522273] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:54:10.656723] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T21:54:10.705913] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-07T21:54:10.705997] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-07T21:54:10.707118] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-07T21:54:10.707188] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-07T21:54:10.708784] [DEBUG] [LOCAL ] THC: Trimmed 69012 records to 47471 (keeping 200 days of data) [2025-10-07T21:54:11.003111] [DEBUG] [LOCAL ] THC: Primary data saved (47471 records). [2025-10-07T21:54:11.003271] [INFO ] [MAIN ] THC: Full history saved. [2025-10-07T21:54:11.003362] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THC took 57.4s. Estimated remaining: 39m 42s. Rate: 7.1 symbols/min [2025-10-07T21:54:11.057580] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-07T21:54:11.178560] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:54:11.198383] [DEBUG] [LOCAL ] THW: Loaded 19586 existing records from primary storage. [2025-10-07T21:54:11.198723] [INFO ] [MAIN ] THW: Loaded 19586 existing records. [2025-10-07T21:54:11.389568] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:54:11.389948] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-07T21:54:11.390056] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-07T21:54:11.390857] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-07T21:54:11.390937] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-07T21:54:11.674352] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T21:54:11.788893] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:54:11.847626] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-07T21:54:12.493474] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-07T21:54:12.576074] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-07T21:54:12.647611] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-07T21:54:13.447731] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-07T21:54:13.867188] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T21:54:14.247633] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-07T21:54:14.572447] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T21:54:15.047621] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-07T21:54:15.530269] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T21:54:15.847732] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-07T21:54:16.129858] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T21:54:16.647774] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-07T21:54:16.910514] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T21:54:17.371068] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T21:54:17.447701] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-07T21:54:18.247702] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-07T21:54:18.861490] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T21:54:19.047638] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-07T21:54:19.368581] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T21:54:19.847732] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-07T21:54:19.983715] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T21:54:20.556113] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T21:54:20.647748] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-07T21:54:21.447733] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-07T21:54:22.092666] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T21:54:22.247622] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-07T21:54:22.451037] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T21:54:23.047767] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-07T21:54:23.691949] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T21:54:23.847639] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-07T21:54:24.001904] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-07T21:54:24.647714] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-07T21:54:25.048849] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T21:54:25.447747] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-07T21:54:25.533351] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-07T21:54:25.535176] [INFO ] [REMOTE ] THR: Full fetch complete (28744 records). [2025-10-07T21:54:25.535261] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-07T21:54:26.131358] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-07T21:54:26.131534] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-07T21:54:26.132361] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-07T21:54:26.132430] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-07T21:54:26.133589] [DEBUG] [LOCAL ] THR: Trimmed 28744 records to 19876 (keeping 200 days of data) [2025-10-07T21:54:26.249069] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-07T21:54:26.278975] [DEBUG] [LOCAL ] THR: Primary data saved (19876 records). [2025-10-07T21:54:26.279191] [INFO ] [MAIN ] THR: Full history saved. [2025-10-07T21:54:26.279325] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THR took 28.2s. Estimated remaining: 39m 35s. Rate: 7.1 symbols/min [2025-10-07T21:54:26.466553] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:54:26.466845] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-07T21:54:26.466888] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-07T21:54:26.467040] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-07T21:54:26.467112] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-07T21:54:26.467155] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-07T21:54:26.467187] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-07T21:54:26.845928] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:54:26.977387] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-07T21:54:27.047747] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-07T21:54:27.269414] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T21:54:27.847610] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-07T21:54:28.068241] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:54:28.068513] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T21:54:28.070744] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-07T21:54:28.071190] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:54:28.071279] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-07T21:54:28.071478] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:54:28.071571] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-07T21:54:28.071680] [INFO ] [REMOTE ] THQ: Full fetch complete (35161 records). [2025-10-07T21:54:28.071810] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-07T21:54:28.071943] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-07T21:54:28.072159] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-07T21:54:28.101453] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-07T21:54:28.124427] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. TIC took 1.8s. Estimated remaining: 39m 25s. Rate: 7.1 symbols/min [2025-10-07T21:54:28.533508] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:54:28.649026] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-07T21:54:28.679412] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-07T21:54:28.679604] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-07T21:54:28.680433] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-07T21:54:28.680501] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-07T21:54:28.692603] [DEBUG] [LOCAL ] THQ: Trimmed 35161 records to 25172 (keeping 200 days of data) [2025-10-07T21:54:28.794238] [DEBUG] [LOCAL ] TIMB: Loaded 35773 existing records from primary storage. [2025-10-07T21:54:28.795321] [INFO ] [MAIN ] TIMB: Loaded 35773 existing records. [2025-10-07T21:54:29.001080] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:54:29.002219] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-07T21:54:29.002615] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-07T21:54:29.005605] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-07T21:54:29.006840] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-07T21:54:29.456940] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-07T21:54:29.463131] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:54:29.474859] [DEBUG] [LOCAL ] THQ: Primary data saved (25172 records). [2025-10-07T21:54:29.475015] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-07T21:54:29.475140] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THQ took 37.8s. Estimated remaining: 39m 16s. Rate: 7.1 symbols/min [2025-10-07T21:54:29.680352] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:54:29.686119] [DEBUG] [LOCAL ] TISI: Loaded 3590 existing records from primary storage. [2025-10-07T21:54:29.686312] [INFO ] [MAIN ] TISI: Loaded 3590 existing records. [2025-10-07T21:54:29.861849] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:54:29.862246] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-07T21:54:29.862403] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-07T21:54:29.867854] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-07T21:54:29.875345] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-07T21:54:29.908034] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T21:54:30.235861] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:54:30.247633] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-07T21:54:30.915119] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T21:54:30.952408] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T21:54:31.047690] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-07T21:54:31.537598] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-07T21:54:31.847628] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-07T21:54:32.647673] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-07T21:54:32.949749] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T21:54:33.447720] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-07T21:54:34.010571] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T21:54:34.247690] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-07T21:54:35.033845] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T21:54:35.047698] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-07T21:54:35.545975] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-07T21:54:35.549036] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T21:54:35.847702] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-07T21:54:36.647679] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-07T21:54:37.304804] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-07T21:54:37.310768] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T21:54:37.447689] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-07T21:54:38.210962] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T21:54:38.247621] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-07T21:54:39.047698] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-07T21:54:39.474482] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-07T21:54:39.847721] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-07T21:54:40.647240] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T21:54:40.656038] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-07T21:54:40.886107] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T21:54:41.246962] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T21:54:41.447687] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-07T21:54:42.247697] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-07T21:54:43.042215] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-07T21:54:43.051218] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-07T21:54:43.260301] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T21:54:43.847678] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-07T21:54:44.459065] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T21:54:44.647665] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-07T21:54:44.869871] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T21:54:45.447687] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-07T21:54:45.877181] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T21:54:45.880800] [INFO ] [REMOTE ] THS: Full fetch complete (54345 records). [2025-10-07T21:54:45.880926] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-07T21:54:46.254852] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-07T21:54:46.273174] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-07T21:54:46.277924] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-07T21:54:46.278615] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T21:54:46.279705] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-07T21:54:46.281290] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-07T21:54:46.282314] [INFO ] [REMOTE ] THW: Full fetch complete (29331 records). [2025-10-07T21:54:46.282493] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-07T21:54:46.295781] [DEBUG] [LOCAL ] THS: Trimmed 54345 records to 38487 (keeping 200 days of data) [2025-10-07T21:54:46.872439] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-07T21:54:46.881094] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-07T21:54:46.906005] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-07T21:54:46.906707] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-07T21:54:46.920388] [DEBUG] [LOCAL ] THW: Trimmed 29331 records to 19643 (keeping 200 days of data) [2025-10-07T21:54:47.009981] [DEBUG] [LOCAL ] THS: Primary data saved (38487 records). [2025-10-07T21:54:47.010524] [INFO ] [MAIN ] THS: Full history saved. [2025-10-07T21:54:47.037436] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THS took 37.5s. Estimated remaining: 39m 9s. Rate: 7.1 symbols/min [2025-10-07T21:54:47.063611] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-07T21:54:47.235032] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:54:47.274312] [DEBUG] [LOCAL ] THW: Primary data saved (19643 records). [2025-10-07T21:54:47.275536] [INFO ] [MAIN ] THW: Full history saved. [2025-10-07T21:54:47.275705] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. THW took 36.3s. Estimated remaining: 38m 59s. Rate: 7.1 symbols/min [2025-10-07T21:54:47.276294] [DEBUG] [LOCAL ] TIXT: Loaded 31721 existing records from primary storage. [2025-10-07T21:54:47.332841] [INFO ] [MAIN ] TIXT: Loaded 31721 existing records. [2025-10-07T21:54:47.581968] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:54:47.647598] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:54:47.648290] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-07T21:54:47.648774] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-07T21:54:47.649774] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-07T21:54:47.649857] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-07T21:54:47.779824] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-07T21:54:47.856247] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-07T21:54:47.982840] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T21:54:48.059166] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-07T21:54:48.060024] [INFO ] [MAIN ] TJX: Loaded 53668 existing records. [2025-10-07T21:54:48.303494] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:54:48.347962] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:54:48.348238] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-07T21:54:48.348307] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-07T21:54:48.350104] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-07T21:54:48.350168] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-07T21:54:48.462127] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T21:54:48.652771] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-07T21:54:48.745084] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:54:49.447688] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-07T21:54:50.008236] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-07T21:54:50.247697] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-07T21:54:51.047681] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-07T21:54:51.457532] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-07T21:54:51.489003] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-07T21:54:51.654252] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T21:54:51.847689] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-07T21:54:52.647686] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-07T21:54:53.449794] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-07T21:54:53.452461] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T21:54:53.911017] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-07T21:54:54.238138] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T21:54:54.247826] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-07T21:54:55.047681] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-07T21:54:55.682094] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T21:54:55.847614] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-07T21:54:56.274694] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-07T21:54:56.289760] [INFO ] [REMOTE ] TISI: Full fetch complete (4944 records). [2025-10-07T21:54:56.292718] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-07T21:54:56.292178] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-07T21:54:56.663018] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-07T21:54:56.671354] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-07T21:54:56.671414] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-07T21:54:56.671582] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-07T21:54:56.671622] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-07T21:54:56.672084] [DEBUG] [LOCAL ] TISI: Trimmed 4944 records to 3531 (keeping 200 days of data) [2025-10-07T21:54:56.695477] [DEBUG] [LOCAL ] TISI: Primary data saved (3531 records). [2025-10-07T21:54:56.695671] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-07T21:54:56.695834] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TISI took 27.2s. Estimated remaining: 38m 51s. Rate: 7.1 symbols/min [2025-10-07T21:54:56.864984] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:54:56.915379] [DEBUG] [LOCAL ] TK: Loaded 39303 existing records from primary storage. [2025-10-07T21:54:56.915861] [INFO ] [MAIN ] TK: Loaded 39303 existing records. [2025-10-07T21:54:57.089966] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:54:57.090212] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-07T21:54:57.090261] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-07T21:54:57.091444] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-07T21:54:57.091506] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-07T21:54:57.452977] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-07T21:54:57.458588] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:54:58.247704] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-07T21:54:58.566184] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-07T21:54:58.828816] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T21:54:59.047672] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-07T21:54:59.240695] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T21:54:59.847682] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-07T21:55:00.613235] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T21:55:00.647709] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-07T21:55:01.447638] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-07T21:55:01.609481] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T21:55:01.612114] [INFO ] [REMOTE ] TIMB: Full fetch complete (53888 records). [2025-10-07T21:55:01.612270] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-07T21:55:02.048497] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-07T21:55:02.048626] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-07T21:55:02.050248] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-07T21:55:02.050471] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-07T21:55:02.052703] [DEBUG] [LOCAL ] TIMB: Trimmed 53888 records to 35692 (keeping 200 days of data) [2025-10-07T21:55:02.204396] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-07T21:55:02.288039] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-07T21:55:02.358876] [DEBUG] [LOCAL ] TIMB: Primary data saved (35692 records). [2025-10-07T21:55:02.359081] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-07T21:55:02.359237] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TIMB took 34.2s. Estimated remaining: 38m 42s. Rate: 7.1 symbols/min [2025-10-07T21:55:02.585459] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:55:02.613750] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T21:55:02.656633] [DEBUG] [LOCAL ] TKC: Loaded 39044 existing records from primary storage. [2025-10-07T21:55:02.657011] [INFO ] [MAIN ] TKC: Loaded 39044 existing records. [2025-10-07T21:55:02.830996] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:55:02.831262] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-07T21:55:02.831339] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-07T21:55:02.832478] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-07T21:55:02.832540] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-07T21:55:03.052900] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-07T21:55:03.199488] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:55:03.567081] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T21:55:03.847760] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-07T21:55:04.589459] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T21:55:04.647623] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-07T21:55:05.447730] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-07T21:55:05.949578] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-07T21:55:06.192334] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T21:55:06.224347] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T21:55:06.247622] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-07T21:55:07.047682] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-07T21:55:07.390784] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T21:55:07.847615] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-07T21:55:07.942244] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T21:55:08.647634] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-07T21:55:08.950049] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-07T21:55:09.447715] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-07T21:55:10.021815] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T21:55:10.247624] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-07T21:55:10.863026] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T21:55:11.047697] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-07T21:55:11.429709] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T21:55:11.847748] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-07T21:55:12.254392] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-07T21:55:12.647707] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-07T21:55:13.330913] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T21:55:13.447700] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-07T21:55:14.247736] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-07T21:55:14.432928] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T21:55:15.052737] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-07T21:55:15.070189] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T21:55:15.539221] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-07T21:55:15.847760] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-07T21:55:16.647747] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-07T21:55:16.921911] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-07T21:55:17.196247] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T21:55:17.447731] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-07T21:55:17.816601] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-07T21:55:18.247740] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-07T21:55:19.047758] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-07T21:55:19.570147] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-07T21:55:19.668621] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T21:55:19.847725] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-07T21:55:20.647706] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-07T21:55:20.712549] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T21:55:21.448335] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-07T21:55:21.453832] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T21:55:22.252795] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-07T21:55:22.271523] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T21:55:22.863204] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T21:55:23.047696] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-07T21:55:23.746886] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T21:55:23.847690] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-07T21:55:24.541953] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T21:55:24.647690] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-07T21:55:24.770789] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T21:55:24.773405] [INFO ] [REMOTE ] TIXT: Full fetch complete (46150 records). [2025-10-07T21:55:24.773484] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-07T21:55:25.154774] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-07T21:55:25.154861] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-07T21:55:25.155721] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-07T21:55:25.155785] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-07T21:55:25.156891] [DEBUG] [LOCAL ] TIXT: Trimmed 46150 records to 31839 (keeping 200 days of data) [2025-10-07T21:55:25.336181] [DEBUG] [LOCAL ] TIXT: Primary data saved (31839 records). [2025-10-07T21:55:25.336353] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-07T21:55:25.336539] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TIXT took 38.3s. Estimated remaining: 38m 35s. Rate: 7.1 symbols/min [2025-10-07T21:55:25.452778] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-07T21:55:25.515968] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:55:25.563256] [DEBUG] [LOCAL ] TKO: Loaded 43958 existing records from primary storage. [2025-10-07T21:55:25.563570] [INFO ] [MAIN ] TKO: Loaded 43958 existing records. [2025-10-07T21:55:25.751027] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:55:25.751263] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-07T21:55:25.751312] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-07T21:55:25.751552] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-07T21:55:25.751611] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-07T21:55:26.113996] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:55:26.175478] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T21:55:26.247754] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-07T21:55:26.720759] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T21:55:26.723404] [INFO ] [REMOTE ] TK: Full fetch complete (56464 records). [2025-10-07T21:55:26.723495] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-07T21:55:27.052944] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-07T21:55:27.143420] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-07T21:55:27.143524] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-07T21:55:27.144497] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-07T21:55:27.144565] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-07T21:55:27.145896] [DEBUG] [LOCAL ] TK: Trimmed 56464 records to 39309 (keeping 200 days of data) [2025-10-07T21:55:27.377196] [DEBUG] [LOCAL ] TK: Primary data saved (39309 records). [2025-10-07T21:55:27.377349] [INFO ] [MAIN ] TK: Full history saved. [2025-10-07T21:55:27.377437] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 30.7s. Estimated remaining: 38m 26s. Rate: 7.1 symbols/min [2025-10-07T21:55:27.564159] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:55:27.603115] [DEBUG] [LOCAL ] TKR: Loaded 39996 existing records from primary storage. [2025-10-07T21:55:27.603706] [INFO ] [MAIN ] TKR: Loaded 39996 existing records. [2025-10-07T21:55:27.792048] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:55:27.792378] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-07T21:55:27.792590] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-07T21:55:27.813348] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-07T21:55:27.813481] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-07T21:55:27.855096] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-07T21:55:27.886897] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T21:55:28.174196] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:55:28.647629] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-07T21:55:29.093825] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-07T21:55:29.447676] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-07T21:55:29.639763] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T21:55:29.712310] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-07T21:55:29.916151] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T21:55:29.919984] [INFO ] [REMOTE ] TJX: Full fetch complete (77682 records). [2025-10-07T21:55:29.920117] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-07T21:55:30.257464] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-07T21:55:30.432426] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-07T21:55:30.432554] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-07T21:55:30.433865] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-07T21:55:30.433937] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-07T21:55:30.435612] [DEBUG] [LOCAL ] TJX: Trimmed 77682 records to 53668 (keeping 200 days of data) [2025-10-07T21:55:30.793633] [DEBUG] [LOCAL ] TJX: Primary data saved (53668 records). [2025-10-07T21:55:30.793811] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-07T21:55:30.793900] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TJX took 43.5s. Estimated remaining: 38m 17s. Rate: 7.1 symbols/min [2025-10-07T21:55:30.965770] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:55:31.003466] [DEBUG] [LOCAL ] TLK: Loaded 38913 existing records from primary storage. [2025-10-07T21:55:31.003804] [INFO ] [MAIN ] TLK: Loaded 38913 existing records. [2025-10-07T21:55:31.057540] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-07T21:55:31.219604] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:55:31.219867] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-07T21:55:31.219913] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-07T21:55:31.220120] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-07T21:55:31.220175] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-07T21:55:31.569469] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:55:31.847629] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-07T21:55:31.936029] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T21:55:31.951181] [DEBUG] [REMOTE ] TKO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-07T21:55:31.951502] [WARN ] [REMOTE ] TKO: No data returned for month 2025-01 [2025-10-07T21:55:31.951600] [FATAL] [REMOTE ] TKO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:55:31.951722] [FATAL] [MAIN ] TKO: Failed to fetch primary data. [2025-10-07T21:55:31.951807] [WARN ] [MAIN ] TKO: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:55:31.951903] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-07T21:55:31.952014] [DEBUG] [LOCAL ] TKO: No primary data file found to delete. [2025-10-07T21:55:31.952093] [INFO ] [LOCAL ] TKO: Starting deletion of derivative data. [2025-10-07T21:55:31.952493] [DEBUG] [LOCAL ] TKO: Deleted derivative data file. [2025-10-07T21:55:31.952583] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKO took 6.6s. Estimated remaining: 38m 8s. Rate: 7.1 symbols/min [2025-10-07T21:55:32.154000] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:55:32.171866] [DEBUG] [LOCAL ] TLYS: Loaded 16492 existing records from primary storage. [2025-10-07T21:55:32.172125] [INFO ] [MAIN ] TLYS: Loaded 16492 existing records. [2025-10-07T21:55:32.351973] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:55:32.352435] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-07T21:55:32.352519] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-07T21:55:32.352957] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-07T21:55:32.353073] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-07T21:55:32.551772] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T21:55:32.652928] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-07T21:55:32.744902] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:55:33.447701] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-07T21:55:34.207718] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T21:55:34.247611] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-07T21:55:35.047622] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-07T21:55:35.110988] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T21:55:35.683587] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T21:55:35.847638] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-07T21:55:36.186842] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-07T21:55:36.190617] [INFO ] [REMOTE ] TKC: Full fetch complete (52635 records). [2025-10-07T21:55:36.190744] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-07T21:55:36.652743] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-07T21:55:36.670966] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-07T21:55:36.671025] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-07T21:55:36.671939] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-07T21:55:36.672090] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-07T21:55:36.673262] [DEBUG] [LOCAL ] TKC: Trimmed 52635 records to 38994 (keeping 200 days of data) [2025-10-07T21:55:36.871810] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T21:55:36.908778] [DEBUG] [LOCAL ] TKC: Primary data saved (38994 records). [2025-10-07T21:55:36.908914] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-07T21:55:36.909017] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKC took 34.5s. Estimated remaining: 37m 59s. Rate: 7.1 symbols/min [2025-10-07T21:55:37.077585] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:55:37.112827] [DEBUG] [LOCAL ] TM: Loaded 36326 existing records from primary storage. [2025-10-07T21:55:37.113135] [INFO ] [MAIN ] TM: Loaded 36326 existing records. [2025-10-07T21:55:37.285810] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:55:37.286020] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-07T21:55:37.286067] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-07T21:55:37.286303] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-07T21:55:37.286359] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-07T21:55:37.454638] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-07T21:55:37.634479] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:55:38.151207] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T21:55:38.247617] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-07T21:55:39.047728] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-07T21:55:39.168938] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T21:55:39.847638] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-07T21:55:39.949193] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T21:55:40.494780] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-07T21:55:40.647673] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-07T21:55:41.447703] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-07T21:55:41.514565] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T21:55:42.228861] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T21:55:42.235436] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T21:55:42.248128] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-07T21:55:43.047695] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-07T21:55:43.766547] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T21:55:43.847630] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-07T21:55:44.624267] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T21:55:44.647622] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-07T21:55:45.229431] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T21:55:45.447680] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-07T21:55:46.138819] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T21:55:46.247707] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-07T21:55:47.002145] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T21:55:47.047608] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-07T21:55:47.847638] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-07T21:55:47.892236] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T21:55:48.289279] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-07T21:55:48.458433] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T21:55:48.647623] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-07T21:55:49.447690] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-07T21:55:50.119869] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T21:55:50.247638] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-07T21:55:51.047731] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-07T21:55:51.307406] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T21:55:51.720236] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-07T21:55:51.847602] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-07T21:55:52.632165] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T21:55:52.647601] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-07T21:55:52.862602] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T21:55:53.447634] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-07T21:55:53.873389] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T21:55:53.876001] [INFO ] [REMOTE ] TKR: Full fetch complete (57714 records). [2025-10-07T21:55:53.876245] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-07T21:55:54.253736] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-07T21:55:54.252965] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-07T21:55:54.253860] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-07T21:55:54.255871] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-07T21:55:54.256061] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-07T21:55:54.258144] [DEBUG] [LOCAL ] TKR: Trimmed 57714 records to 39915 (keeping 200 days of data) [2025-10-07T21:55:54.536925] [DEBUG] [LOCAL ] TKR: Primary data saved (39915 records). [2025-10-07T21:55:54.537088] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-07T21:55:54.537195] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 27.2s. Estimated remaining: 37m 52s. Rate: 7.1 symbols/min [2025-10-07T21:55:54.720423] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:55:54.775586] [DEBUG] [LOCAL ] TME: Loaded 53181 existing records from primary storage. [2025-10-07T21:55:54.776047] [INFO ] [MAIN ] TME: Loaded 53181 existing records. [2025-10-07T21:55:54.993416] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:55:54.994235] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-07T21:55:54.994360] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-07T21:55:54.994972] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-07T21:55:54.995152] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-07T21:55:55.049846] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-07T21:55:55.241023] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T21:55:55.322462] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T21:55:55.412634] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:55:55.847686] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-07T21:55:56.576183] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T21:55:56.647697] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-07T21:55:57.447633] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-07T21:55:57.698680] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T21:55:57.711506] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T21:55:58.247697] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-07T21:55:58.630072] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T21:55:59.047773] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-07T21:55:59.760774] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T21:55:59.847613] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-07T21:56:00.647689] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-07T21:56:00.879528] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T21:56:01.447785] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-07T21:56:01.673099] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T21:56:02.247624] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-07T21:56:02.269463] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T21:56:03.047620] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-07T21:56:03.185160] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T21:56:03.847617] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-07T21:56:04.164041] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T21:56:04.224873] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T21:56:04.647667] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-07T21:56:05.192555] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T21:56:05.447617] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-07T21:56:05.986620] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T21:56:06.247708] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-07T21:56:07.047635] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-07T21:56:07.333786] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T21:56:07.388773] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T21:56:07.847691] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-07T21:56:08.312096] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T21:56:08.315490] [INFO ] [REMOTE ] TLK: Full fetch complete (57316 records). [2025-10-07T21:56:08.315639] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-07T21:56:08.652723] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-07T21:56:08.787044] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-07T21:56:08.787131] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-07T21:56:08.788211] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-07T21:56:08.788302] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-07T21:56:08.789752] [DEBUG] [LOCAL ] TLK: Trimmed 57316 records to 38847 (keeping 200 days of data) [2025-10-07T21:56:09.055201] [DEBUG] [LOCAL ] TLK: Primary data saved (38847 records). [2025-10-07T21:56:09.055367] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-07T21:56:09.055462] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLK took 38.3s. Estimated remaining: 37m 44s. Rate: 7.1 symbols/min [2025-10-07T21:56:09.268170] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:56:09.308238] [DEBUG] [LOCAL ] TMHC: Loaded 45310 existing records from primary storage. [2025-10-07T21:56:09.308574] [INFO ] [MAIN ] TMHC: Loaded 45310 existing records. [2025-10-07T21:56:09.449899] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-07T21:56:09.487021] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:56:09.487474] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-07T21:56:09.487583] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-07T21:56:09.487847] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-07T21:56:09.487905] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-07T21:56:09.901112] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:56:09.979748] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T21:56:09.992363] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-07T21:56:10.247739] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-07T21:56:10.382461] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-07T21:56:11.047739] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-07T21:56:11.437772] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-07T21:56:11.440272] [INFO ] [REMOTE ] TM: Full fetch complete (52782 records). [2025-10-07T21:56:11.440385] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-07T21:56:11.841690] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-07T21:56:11.841797] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-07T21:56:11.842729] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-07T21:56:11.842817] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-07T21:56:11.844137] [DEBUG] [LOCAL ] TM: Trimmed 52782 records to 36326 (keeping 200 days of data) [2025-10-07T21:56:11.896611] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-07T21:56:12.073979] [DEBUG] [LOCAL ] TM: Primary data saved (36326 records). [2025-10-07T21:56:12.074130] [INFO ] [MAIN ] TM: Full history saved. [2025-10-07T21:56:12.074218] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TM took 35.2s. Estimated remaining: 37m 35s. Rate: 7.1 symbols/min [2025-10-07T21:56:12.253337] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:56:12.309315] [DEBUG] [LOCAL ] TMO: Loaded 52412 existing records from primary storage. [2025-10-07T21:56:12.309695] [INFO ] [MAIN ] TMO: Loaded 52412 existing records. [2025-10-07T21:56:12.502702] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:56:12.503040] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-07T21:56:12.503098] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-07T21:56:12.503507] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-07T21:56:12.503564] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-07T21:56:12.657239] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-07T21:56:12.862265] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T21:56:12.933684] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:56:13.447601] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-07T21:56:13.727029] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T21:56:13.796225] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T21:56:14.247770] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-07T21:56:14.695091] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T21:56:15.047747] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-07T21:56:15.664761] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T21:56:15.665908] [INFO ] [REMOTE ] TLYS: Full fetch complete (21767 records). [2025-10-07T21:56:15.665983] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-07T21:56:15.851913] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-07T21:56:16.064437] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-07T21:56:16.064621] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-07T21:56:16.065306] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-07T21:56:16.065373] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-07T21:56:16.066135] [DEBUG] [LOCAL ] TLYS: Trimmed 21767 records to 16491 (keeping 200 days of data) [2025-10-07T21:56:16.186124] [DEBUG] [LOCAL ] TLYS: Primary data saved (16491 records). [2025-10-07T21:56:16.186497] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-07T21:56:16.186702] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TLYS took 44.2s. Estimated remaining: 37m 26s. Rate: 7.1 symbols/min [2025-10-07T21:56:16.430078] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:56:16.433432] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-07T21:56:16.462392] [DEBUG] [LOCAL ] TNC: Loaded 14740 existing records from primary storage. [2025-10-07T21:56:16.462700] [INFO ] [MAIN ] TNC: Loaded 14740 existing records. [2025-10-07T21:56:16.636788] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:56:16.637026] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-07T21:56:16.637076] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-07T21:56:16.637282] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-07T21:56:16.637319] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-07T21:56:16.652876] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-07T21:56:17.056951] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:56:17.447630] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-07T21:56:17.559559] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T21:56:18.247724] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-07T21:56:18.478771] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-07T21:56:18.650163] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-07T21:56:19.047738] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-07T21:56:19.847679] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-07T21:56:20.124857] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T21:56:20.647668] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-07T21:56:21.065583] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-07T21:56:21.132985] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T21:56:21.447622] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-07T21:56:21.730294] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T21:56:22.247717] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-07T21:56:23.047708] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-07T21:56:23.286472] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-07T21:56:23.847797] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-07T21:56:24.263722] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-07T21:56:24.305853] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T21:56:24.647675] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-07T21:56:25.447686] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-07T21:56:25.641839] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T21:56:25.773466] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T21:56:26.247739] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-07T21:56:27.020032] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T21:56:27.047617] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-07T21:56:27.847639] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-07T21:56:28.278547] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T21:56:28.606286] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-07T21:56:28.610153] [INFO ] [REMOTE ] TME: Full fetch complete (76919 records). [2025-10-07T21:56:28.610321] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-07T21:56:28.657559] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-07T21:56:29.020623] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-07T21:56:29.020755] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-07T21:56:29.022043] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-07T21:56:29.022114] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-07T21:56:29.023832] [DEBUG] [LOCAL ] TME: Trimmed 76919 records to 53178 (keeping 200 days of data) [2025-10-07T21:56:29.376027] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-07T21:56:29.392040] [DEBUG] [LOCAL ] TME: Primary data saved (53178 records). [2025-10-07T21:56:29.392233] [INFO ] [MAIN ] TME: Full history saved. [2025-10-07T21:56:29.392335] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TME took 34.9s. Estimated remaining: 37m 18s. Rate: 7.1 symbols/min [2025-10-07T21:56:29.459772] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-07T21:56:29.575388] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:56:29.606071] [DEBUG] [LOCAL ] TNET: Loaded 28367 existing records from primary storage. [2025-10-07T21:56:29.606405] [INFO ] [MAIN ] TNET: Loaded 28367 existing records. [2025-10-07T21:56:29.786792] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:56:29.787024] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-07T21:56:29.787073] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-07T21:56:29.787303] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-07T21:56:29.787361] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-07T21:56:30.150594] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:56:30.247671] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-07T21:56:30.415535] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T21:56:30.594333] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-07T21:56:31.047792] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-07T21:56:31.847723] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-07T21:56:32.025230] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T21:56:32.647610] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-07T21:56:32.928522] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-07T21:56:33.035515] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T21:56:33.408463] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T21:56:33.447613] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-07T21:56:34.247634] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-07T21:56:34.469734] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-07T21:56:35.047704] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-07T21:56:35.847694] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-07T21:56:35.950087] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-07T21:56:36.194463] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T21:56:36.647688] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-07T21:56:37.447633] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-07T21:56:37.546253] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T21:56:37.602609] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T21:56:38.247627] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-07T21:56:38.566288] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T21:56:39.047699] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-07T21:56:39.539205] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T21:56:39.847734] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-07T21:56:39.945958] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T21:56:40.647687] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-07T21:56:41.139500] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-07T21:56:41.143164] [INFO ] [REMOTE ] TMHC: Full fetch complete (65976 records). [2025-10-07T21:56:41.143331] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-07T21:56:41.452773] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-07T21:56:41.539824] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-07T21:56:41.539936] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-07T21:56:41.541149] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-07T21:56:41.541218] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-07T21:56:41.542700] [DEBUG] [LOCAL ] TMHC: Trimmed 65976 records to 45302 (keeping 200 days of data) [2025-10-07T21:56:41.827200] [DEBUG] [LOCAL ] TMHC: Primary data saved (45302 records). [2025-10-07T21:56:41.827361] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-07T21:56:41.827453] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TMHC took 32.8s. Estimated remaining: 37m 10s. Rate: 7.1 symbols/min [2025-10-07T21:56:41.994129] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:56:41.994369] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-07T21:56:41.994424] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-07T21:56:41.994562] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-07T21:56:41.994604] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-07T21:56:41.994671] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-07T21:56:41.994725] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-07T21:56:42.256973] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-07T21:56:42.374175] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T21:56:42.436994] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:56:42.579671] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-07T21:56:43.047705] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-07T21:56:43.415787] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T21:56:43.416138] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-07T21:56:43.416234] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T21:56:43.416291] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-07T21:56:43.416364] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T21:56:43.416492] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-07T21:56:43.416624] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-07T21:56:43.416728] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-07T21:56:43.416842] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-07T21:56:43.416985] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TNGY took 1.6s. Estimated remaining: 37m 1s. Rate: 7.1 symbols/min [2025-10-07T21:56:43.598061] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:56:43.637979] [DEBUG] [LOCAL ] TNK: Loaded 35140 existing records from primary storage. [2025-10-07T21:56:43.638328] [INFO ] [MAIN ] TNK: Loaded 35140 existing records. [2025-10-07T21:56:43.776469] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T21:56:43.852199] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-07T21:56:43.852077] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:56:43.852666] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-07T21:56:43.853541] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-07T21:56:43.854067] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-07T21:56:43.854129] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-07T21:56:44.222189] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:56:44.647674] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-07T21:56:45.447690] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-07T21:56:45.731575] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T21:56:46.074668] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T21:56:46.158911] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T21:56:46.160270] [INFO ] [REMOTE ] TNC: Full fetch complete (22717 records). [2025-10-07T21:56:46.160346] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-07T21:56:46.252814] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-07T21:56:46.528345] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-07T21:56:46.528444] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-07T21:56:46.529004] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-07T21:56:46.529067] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-07T21:56:46.530009] [DEBUG] [LOCAL ] TNC: Trimmed 22717 records to 14698 (keeping 200 days of data) [2025-10-07T21:56:46.624298] [DEBUG] [LOCAL ] TNC: Primary data saved (14698 records). [2025-10-07T21:56:46.624461] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-07T21:56:46.624566] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNC took 30.4s. Estimated remaining: 36m 52s. Rate: 7.1 symbols/min [2025-10-07T21:56:46.789800] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:56:46.830862] [DEBUG] [LOCAL ] TNL: Loaded 41732 existing records from primary storage. [2025-10-07T21:56:46.831188] [INFO ] [MAIN ] TNL: Loaded 41732 existing records. [2025-10-07T21:56:47.013318] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:56:47.013557] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-07T21:56:47.013609] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-07T21:56:47.013853] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-07T21:56:47.013910] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-07T21:56:47.055048] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-07T21:56:47.359969] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:56:47.693189] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T21:56:47.710064] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T21:56:47.713821] [INFO ] [REMOTE ] TMO: Full fetch complete (75490 records). [2025-10-07T21:56:47.713945] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-07T21:56:47.852755] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-07T21:56:48.105764] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-07T21:56:48.105883] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-07T21:56:48.107111] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-07T21:56:48.107179] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-07T21:56:48.108747] [DEBUG] [LOCAL ] TMO: Trimmed 75490 records to 52414 (keeping 200 days of data) [2025-10-07T21:56:48.446182] [DEBUG] [LOCAL ] TMO: Primary data saved (52414 records). [2025-10-07T21:56:48.446348] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-07T21:56:48.446436] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TMO took 36.4s. Estimated remaining: 36m 42s. Rate: 7.1 symbols/min [2025-10-07T21:56:48.611431] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:56:48.647730] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-07T21:56:48.664440] [DEBUG] [LOCAL ] TOL: Loaded 50761 existing records from primary storage. [2025-10-07T21:56:48.664972] [INFO ] [MAIN ] TOL: Loaded 50761 existing records. [2025-10-07T21:56:48.845713] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:56:48.845970] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-07T21:56:48.846019] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-07T21:56:48.846240] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-07T21:56:48.846297] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-07T21:56:49.222008] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:56:49.426747] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T21:56:49.447606] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-07T21:56:50.190745] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-07T21:56:50.247712] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-07T21:56:51.047636] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-07T21:56:51.244564] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T21:56:51.332255] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T21:56:51.847689] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-07T21:56:52.457576] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-07T21:56:52.647628] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-07T21:56:53.356054] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T21:56:53.435149] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T21:56:53.447591] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-07T21:56:54.247625] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-07T21:56:54.610400] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T21:56:55.047756] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-07T21:56:55.645007] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T21:56:55.847704] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-07T21:56:55.949306] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T21:56:56.647673] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-07T21:56:57.447759] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-07T21:56:57.584994] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T21:56:57.963335] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-07T21:56:58.247692] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-07T21:56:58.871921] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-07T21:56:59.047767] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-07T21:56:59.595406] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T21:56:59.847698] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-07T21:57:00.647627] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-07T21:57:00.829990] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T21:57:00.832411] [INFO ] [REMOTE ] TNET: Full fetch complete (41627 records). [2025-10-07T21:57:00.832507] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-07T21:57:01.232694] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-07T21:57:01.232863] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-07T21:57:01.233855] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-07T21:57:01.233939] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-07T21:57:01.235432] [DEBUG] [LOCAL ] TNET: Trimmed 41627 records to 28339 (keeping 200 days of data) [2025-10-07T21:57:01.266899] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-07T21:57:01.448142] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-07T21:57:01.461538] [DEBUG] [LOCAL ] TNET: Primary data saved (28339 records). [2025-10-07T21:57:01.462070] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-07T21:57:01.462181] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNET took 32.1s. Estimated remaining: 36m 34s. Rate: 7.1 symbols/min [2025-10-07T21:57:01.630869] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:57:01.683441] [DEBUG] [LOCAL ] TOST: Loaded 53682 existing records from primary storage. [2025-10-07T21:57:01.683799] [INFO ] [MAIN ] TOST: Loaded 53682 existing records. [2025-10-07T21:57:01.875583] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:57:01.875968] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-07T21:57:01.876029] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-07T21:57:01.876233] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-07T21:57:01.876290] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-07T21:57:02.266274] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-07T21:57:02.363373] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:57:02.366940] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T21:57:03.045751] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T21:57:03.054313] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-07T21:57:03.847626] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-07T21:57:04.284493] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-07T21:57:04.492559] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T21:57:04.647698] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-07T21:57:05.053328] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T21:57:05.447710] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-07T21:57:06.247669] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-07T21:57:06.513286] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T21:57:07.047723] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-07T21:57:07.097963] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T21:57:07.847630] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-07T21:57:08.092373] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T21:57:08.647632] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-07T21:57:08.921602] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-07T21:57:09.350388] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T21:57:09.447673] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-07T21:57:10.074815] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T21:57:10.247719] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-07T21:57:10.515155] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T21:57:11.047739] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-07T21:57:11.847638] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-07T21:57:12.128222] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T21:57:12.647711] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-07T21:57:12.881951] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-07T21:57:12.940487] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T21:57:13.447715] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-07T21:57:14.247667] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-07T21:57:14.329895] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T21:57:14.793082] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T21:57:15.047669] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-07T21:57:15.847684] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-07T21:57:15.959282] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T21:57:16.398973] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-07T21:57:16.647715] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-07T21:57:17.447715] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-07T21:57:17.889761] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T21:57:17.935301] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-07T21:57:18.247716] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-07T21:57:18.961866] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T21:57:19.047710] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-07T21:57:19.412859] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-07T21:57:19.847722] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-07T21:57:20.424698] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T21:57:20.647721] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-07T21:57:21.447699] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-07T21:57:21.814599] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T21:57:21.994604] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T21:57:21.997835] [INFO ] [REMOTE ] TNL: Full fetch complete (59084 records). [2025-10-07T21:57:21.997955] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-07T21:57:22.252915] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-07T21:57:22.383207] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-07T21:57:22.383296] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-07T21:57:22.384253] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-07T21:57:22.384316] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-07T21:57:22.385511] [DEBUG] [LOCAL ] TNL: Trimmed 59084 records to 41746 (keeping 200 days of data) [2025-10-07T21:57:22.652586] [DEBUG] [LOCAL ] TNL: Primary data saved (41746 records). [2025-10-07T21:57:22.652769] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-07T21:57:22.652922] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNL took 36.0s. Estimated remaining: 36m 28s. Rate: 7.1 symbols/min [2025-10-07T21:57:22.830466] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:57:22.857791] [DEBUG] [LOCAL ] TPB: Loaded 25415 existing records from primary storage. [2025-10-07T21:57:22.858143] [INFO ] [MAIN ] TPB: Loaded 25415 existing records. [2025-10-07T21:57:23.036920] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:57:23.045796] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-07T21:57:23.046250] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-07T21:57:23.046105] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T21:57:23.049248] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-07T21:57:23.049695] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-07T21:57:23.049939] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-07T21:57:23.070420] [INFO ] [REMOTE ] TOL: Full fetch complete (73693 records). [2025-10-07T21:57:23.081401] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-07T21:57:23.825125] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:57:23.847890] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-07T21:57:23.924511] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-07T21:57:23.924631] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-07T21:57:23.926081] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-07T21:57:23.926170] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-07T21:57:23.928028] [DEBUG] [LOCAL ] TOL: Trimmed 73693 records to 50749 (keeping 200 days of data) [2025-10-07T21:57:24.269305] [DEBUG] [LOCAL ] TOL: Primary data saved (50749 records). [2025-10-07T21:57:24.269453] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-07T21:57:24.269544] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TOL took 35.8s. Estimated remaining: 36m 18s. Rate: 7.1 symbols/min [2025-10-07T21:57:24.385830] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T21:57:24.414758] [INFO ] [REMOTE ] TNK: Full fetch complete (51804 records). [2025-10-07T21:57:24.437803] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-07T21:57:24.483343] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:57:24.619297] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-07T21:57:24.728336] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-07T21:57:24.899288] [DEBUG] [LOCAL ] TPC: Loaded 38891 existing records from primary storage. [2025-10-07T21:57:24.920259] [INFO ] [MAIN ] TPC: Loaded 38891 existing records. [2025-10-07T21:57:25.060588] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-07T21:57:25.065970] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-07T21:57:25.086074] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-07T21:57:25.109549] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-07T21:57:25.114088] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T21:57:25.167841] [DEBUG] [LOCAL ] TNK: Trimmed 51804 records to 35156 (keeping 200 days of data) [2025-10-07T21:57:25.218224] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:57:25.218560] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-07T21:57:25.218668] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-07T21:57:25.220153] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-07T21:57:25.220218] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-07T21:57:25.447944] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-07T21:57:25.758762] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:57:25.873902] [DEBUG] [LOCAL ] TNK: Primary data saved (35156 records). [2025-10-07T21:57:25.874071] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-07T21:57:25.874165] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TNK took 42.5s. Estimated remaining: 36m 9s. Rate: 7.1 symbols/min [2025-10-07T21:57:26.040704] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:57:26.085454] [DEBUG] [LOCAL ] TPH: Loaded 44873 existing records from primary storage. [2025-10-07T21:57:26.085862] [INFO ] [MAIN ] TPH: Loaded 44873 existing records. [2025-10-07T21:57:26.249897] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-07T21:57:26.272622] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:57:26.272957] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-07T21:57:26.273008] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-07T21:57:26.273964] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-07T21:57:26.274023] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-07T21:57:26.679175] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T21:57:26.686186] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:57:26.888796] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-07T21:57:27.047609] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-07T21:57:27.656769] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T21:57:27.847680] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-07T21:57:28.647749] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-07T21:57:29.019184] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T21:57:29.102352] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T21:57:29.341674] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-07T21:57:29.447679] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-07T21:57:30.247614] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-07T21:57:30.649885] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T21:57:31.047764] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-07T21:57:31.815227] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T21:57:31.847597] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-07T21:57:32.111941] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T21:57:32.647702] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-07T21:57:33.062727] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-07T21:57:33.447700] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-07T21:57:33.586172] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-07T21:57:34.247702] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-07T21:57:34.936811] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T21:57:35.047623] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-07T21:57:35.667236] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-07T21:57:35.847678] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-07T21:57:36.524929] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T21:57:36.553153] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-07T21:57:36.647706] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-07T21:57:37.447676] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-07T21:57:37.756784] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T21:57:38.247707] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-07T21:57:38.808518] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T21:57:39.047688] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-07T21:57:39.847687] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-07T21:57:39.904569] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-07T21:57:40.538670] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-07T21:57:40.647696] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-07T21:57:41.447637] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-07T21:57:41.815041] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-07T21:57:41.925405] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T21:57:42.247635] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-07T21:57:42.987448] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T21:57:43.047609] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-07T21:57:43.132074] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T21:57:43.847713] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-07T21:57:44.524667] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T21:57:44.647676] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-07T21:57:45.221453] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T21:57:45.447693] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-07T21:57:46.247726] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-07T21:57:46.308147] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T21:57:46.816256] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T21:57:47.047698] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-07T21:57:47.402823] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T21:57:47.847680] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-07T21:57:48.647667] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-07T21:57:48.977023] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T21:57:49.406402] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T21:57:49.441136] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-07T21:57:49.444749] [INFO ] [REMOTE ] TPB: Full fetch complete (35495 records). [2025-10-07T21:57:49.444859] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-07T21:57:49.456664] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-07T21:57:49.812844] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-07T21:57:49.812929] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-07T21:57:49.813704] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-07T21:57:49.813767] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-07T21:57:49.814578] [DEBUG] [LOCAL ] TPB: Trimmed 35495 records to 25450 (keeping 200 days of data) [2025-10-07T21:57:49.968727] [DEBUG] [LOCAL ] TPB: Primary data saved (25450 records). [2025-10-07T21:57:49.968873] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-07T21:57:49.968964] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TPB took 27.3s. Estimated remaining: 36m 2s. Rate: 7.1 symbols/min [2025-10-07T21:57:50.143269] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:57:50.157334] [DEBUG] [LOCAL ] TPL: Loaded 12376 existing records from primary storage. [2025-10-07T21:57:50.157596] [INFO ] [MAIN ] TPL: Loaded 12376 existing records. [2025-10-07T21:57:50.253186] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-07T21:57:50.337824] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:57:50.338093] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-07T21:57:50.338152] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-07T21:57:50.338766] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-07T21:57:50.338829] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-07T21:57:50.687623] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:57:51.047674] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-07T21:57:51.151774] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-07T21:57:51.156184] [INFO ] [REMOTE ] TOST: Full fetch complete (77700 records). [2025-10-07T21:57:51.156313] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-07T21:57:51.542998] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-07T21:57:51.543097] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-07T21:57:51.544219] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-07T21:57:51.544286] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-07T21:57:51.545839] [DEBUG] [LOCAL ] TOST: Trimmed 77700 records to 53683 (keeping 200 days of data) [2025-10-07T21:57:51.860348] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-07T21:57:51.897034] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T21:57:51.923566] [DEBUG] [LOCAL ] TOST: Primary data saved (53683 records). [2025-10-07T21:57:51.923727] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-07T21:57:51.923837] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TOST took 50.5s. Estimated remaining: 35m 53s. Rate: 7.1 symbols/min [2025-10-07T21:57:52.096727] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:57:52.152234] [DEBUG] [LOCAL ] TPR: Loaded 53453 existing records from primary storage. [2025-10-07T21:57:52.152714] [INFO ] [MAIN ] TPR: Loaded 53453 existing records. [2025-10-07T21:57:52.311435] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-07T21:57:52.384414] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:57:52.384630] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-07T21:57:52.384782] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-07T21:57:52.386497] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-07T21:57:52.386559] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-07T21:57:52.656120] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-07T21:57:52.753619] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:57:53.319217] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T21:57:53.358854] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-07T21:57:53.447676] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-07T21:57:54.247686] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-07T21:57:54.328917] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T21:57:55.047695] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-07T21:57:55.453990] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T21:57:55.457524] [INFO ] [REMOTE ] TPC: Full fetch complete (55306 records). [2025-10-07T21:57:55.457705] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-07T21:57:55.841373] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-07T21:57:55.841463] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-07T21:57:55.842408] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-07T21:57:55.842473] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-07T21:57:55.843664] [DEBUG] [LOCAL ] TPC: Trimmed 55306 records to 38914 (keeping 200 days of data) [2025-10-07T21:57:55.892568] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-07T21:57:56.086183] [DEBUG] [LOCAL ] TPC: Primary data saved (38914 records). [2025-10-07T21:57:56.086352] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-07T21:57:56.086467] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPC took 31.8s. Estimated remaining: 35m 44s. Rate: 7.1 symbols/min [2025-10-07T21:57:56.549860] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-07T21:57:56.647611] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-07T21:57:57.447701] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-07T21:57:57.626987] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T21:57:57.631150] [INFO ] [REMOTE ] TPH: Full fetch complete (64932 records). [2025-10-07T21:57:57.631288] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-07T21:57:58.065730] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-07T21:57:58.065537] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-07T21:57:58.065950] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-07T21:57:58.078120] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-07T21:57:58.079052] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-07T21:57:58.080741] [DEBUG] [LOCAL ] TPH: Trimmed 64932 records to 44886 (keeping 200 days of data) [2025-10-07T21:57:58.253265] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-07T21:57:58.343469] [DEBUG] [LOCAL ] TPH: Primary data saved (44886 records). [2025-10-07T21:57:58.343631] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-07T21:57:58.343775] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPH took 32.5s. Estimated remaining: 35m 35s. Rate: 7.1 symbols/min [2025-10-07T21:57:58.399002] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-07T21:57:59.047710] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-07T21:58:00.023177] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T21:58:00.036102] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-07T21:58:00.046588] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-07T21:58:00.647678] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-07T21:58:01.576269] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-07T21:58:01.579458] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-07T21:58:01.843462] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-07T21:58:02.247763] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-07T21:58:02.307346] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-07T21:58:03.047717] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-07T21:58:04.090420] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-07T21:58:04.094495] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-07T21:58:04.164799] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T21:58:04.647767] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-07T21:58:05.071490] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-07T21:58:05.447697] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-07T21:58:06.341347] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T21:58:06.344427] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-07T21:58:06.499145] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T21:58:06.544432] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.20 seconds). [2025-10-07T21:58:06.545753] [INFO ] [REMOTE ] TPL: Full fetch complete (17693 records). [2025-10-07T21:58:06.545828] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-07T21:58:06.918925] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-07T21:58:06.919016] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-07T21:58:06.919466] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-07T21:58:06.919504] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-07T21:58:06.920097] [DEBUG] [LOCAL ] TPL: Trimmed 17693 records to 12376 (keeping 200 days of data) [2025-10-07T21:58:07.003677] [DEBUG] [LOCAL ] TPL: Primary data saved (12376 records). [2025-10-07T21:58:07.003847] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-07T21:58:07.003937] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPL took 17.0s. Estimated remaining: 35m 27s. Rate: 7.1 symbols/min [2025-10-07T21:58:07.047759] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-07T21:58:08.977420] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T21:58:08.991047] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-07T21:58:10.922472] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T21:58:10.939733] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-07T21:58:12.885506] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T21:58:12.898256] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-07T21:58:14.942278] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-07T21:58:14.954344] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-07T21:58:16.844065] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T21:58:16.856171] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-07T21:58:18.442507] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T21:58:18.446351] [INFO ] [REMOTE ] TPR: Full fetch complete (77410 records). [2025-10-07T21:58:18.446509] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-07T21:58:18.846669] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-07T21:58:18.846767] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-07T21:58:18.847918] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-07T21:58:18.847984] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-07T21:58:18.849488] [DEBUG] [LOCAL ] TPR: Trimmed 77410 records to 53452 (keeping 200 days of data) [2025-10-07T21:58:19.186784] [DEBUG] [LOCAL ] TPR: Primary data saved (53452 records). [2025-10-07T21:58:19.186943] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-07T21:58:19.187039] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 27.3s. Estimated remaining: 35m 19s. Rate: 7.1 symbols/min [2025-10-07T21:58:19.807613] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:58:19.868357] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:58:19.894847] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:58:19.931631] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:58:19.940899] [DEBUG] [LOCAL ] TPZ: Loaded 4838 existing records from primary storage. [2025-10-07T21:58:19.949459] [DEBUG] [LOCAL ] TPYP: Loaded 7900 existing records from primary storage. [2025-10-07T21:58:19.949149] [INFO ] [MAIN ] TPZ: Loaded 4838 existing records. [2025-10-07T21:58:19.963629] [INFO ] [MAIN ] TPYP: Loaded 7900 existing records. [2025-10-07T21:58:20.107318] [DEBUG] [LOCAL ] TR: Loaded 18711 existing records from primary storage. [2025-10-07T21:58:20.139058] [INFO ] [MAIN ] TR: Loaded 18711 existing records. [2025-10-07T21:58:20.255081] [DEBUG] [LOCAL ] TPVG: Loaded 26934 existing records from primary storage. [2025-10-07T21:58:20.318906] [INFO ] [MAIN ] TPVG: Loaded 26934 existing records. [2025-10-07T21:58:20.360429] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:58:20.388061] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-07T21:58:20.409419] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-07T21:58:20.454576] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-07T21:58:20.464479] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-07T21:58:20.613799] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:58:20.702851] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-07T21:58:20.734385] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-07T21:58:20.815618] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-07T21:58:20.845281] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-07T21:58:20.867005] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:58:20.930545] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-07T21:58:20.899094] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:58:20.964355] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-07T21:58:20.964243] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-07T21:58:20.985118] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-07T21:58:21.014581] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-07T21:58:21.020377] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-07T21:58:21.056216] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-07T21:58:21.056136] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-07T21:58:21.745095] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:58:21.820909] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-07T21:58:22.224520] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:58:22.294365] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-07T21:58:22.376020] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:58:22.382953] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:58:22.383560] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-07T21:58:22.384189] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-07T21:58:22.751329] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-07T21:58:22.753855] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-07T21:58:23.171282] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-07T21:58:23.173915] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-07T21:58:23.251921] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T21:58:23.255307] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-07T21:58:23.325516] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-07T21:58:23.328631] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-07T21:58:23.692941] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-07T21:58:23.697478] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-07T21:58:23.877839] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-07T21:58:23.886018] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-07T21:58:23.914877] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T21:58:23.917279] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-07T21:58:24.285384] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T21:58:24.289378] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-07T21:58:24.467341] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T21:58:24.470200] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-07T21:58:24.681101] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-07T21:58:24.683612] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-07T21:58:25.029296] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T21:58:25.035933] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-07T21:58:25.050023] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T21:58:25.053813] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-07T21:58:25.232494] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-07T21:58:25.235425] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-07T21:58:25.305734] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T21:58:25.447740] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-07T21:58:25.922895] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-07T21:58:26.005054] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-07T21:58:26.069736] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T21:58:26.133594] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-07T21:58:26.247726] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-07T21:58:26.999074] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T21:58:27.047699] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-07T21:58:27.756251] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T21:58:27.847709] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-07T21:58:28.647723] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-07T21:58:28.666367] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T21:58:29.447693] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-07T21:58:29.634393] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-07T21:58:30.216462] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T21:58:30.247700] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-07T21:58:31.047614] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-07T21:58:31.432249] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T21:58:31.819675] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T21:58:31.847601] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-07T21:58:32.463338] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-07T21:58:32.464393] [INFO ] [REMOTE ] TPYP: Full fetch complete (12498 records). [2025-10-07T21:58:32.464475] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-07T21:58:32.652777] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-07T21:58:32.838739] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-07T21:58:32.838821] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-07T21:58:32.839168] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-07T21:58:32.839229] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-07T21:58:32.839701] [DEBUG] [LOCAL ] TPYP: Trimmed 12498 records to 7898 (keeping 200 days of data) [2025-10-07T21:58:32.888399] [DEBUG] [LOCAL ] TPYP: Primary data saved (7898 records). [2025-10-07T21:58:32.888527] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-07T21:58:32.888705] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPYP took 13.7s. Estimated remaining: 35m 11s. Rate: 7.1 symbols/min [2025-10-07T21:58:33.054323] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:58:33.064426] [DEBUG] [LOCAL ] TRAK: Loaded 9451 existing records from primary storage. [2025-10-07T21:58:33.064660] [INFO ] [MAIN ] TRAK: Loaded 9451 existing records. [2025-10-07T21:58:33.238598] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:58:33.238853] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-07T21:58:33.238920] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-07T21:58:33.239526] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-07T21:58:33.239599] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-07T21:58:33.453899] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-07T21:58:33.589700] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:58:34.010187] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T21:58:34.247618] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-07T21:58:34.615020] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T21:58:35.047709] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-07T21:58:35.506960] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-07T21:58:35.677221] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T21:58:35.847694] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-07T21:58:36.647695] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-07T21:58:36.972294] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T21:58:37.352357] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-07T21:58:37.447684] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-07T21:58:38.247723] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-07T21:58:38.742841] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-07T21:58:38.846910] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-07T21:58:39.047741] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-07T21:58:39.628237] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T21:58:39.847687] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-07T21:58:40.647629] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-07T21:58:40.980351] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-07T21:58:41.447699] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-07T21:58:41.818938] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T21:58:42.191844] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T21:58:42.247612] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-07T21:58:43.039113] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T21:58:43.047605] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-07T21:58:43.847693] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-07T21:58:44.310400] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-07T21:58:44.478798] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-07T21:58:44.647712] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-07T21:58:45.447713] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-07T21:58:45.466431] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T21:58:46.247631] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-07T21:58:46.477498] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T21:58:46.924402] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-07T21:58:47.047682] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-07T21:58:47.839863] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T21:58:47.847590] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-07T21:58:48.584102] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T21:58:48.647636] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-07T21:58:49.447624] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-07T21:58:49.665318] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T21:58:49.795758] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-07T21:58:49.797087] [INFO ] [REMOTE ] TPZ: Full fetch complete (9215 records). [2025-10-07T21:58:49.797176] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-07T21:58:50.172765] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-07T21:58:50.172857] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-07T21:58:50.173057] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-07T21:58:50.173096] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-07T21:58:50.173485] [DEBUG] [LOCAL ] TPZ: Trimmed 9215 records to 4876 (keeping 200 days of data) [2025-10-07T21:58:50.203964] [DEBUG] [LOCAL ] TPZ: Primary data saved (4876 records). [2025-10-07T21:58:50.204033] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-07T21:58:50.204106] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TPZ took 31.0s. Estimated remaining: 35m 3s. Rate: 7.1 symbols/min [2025-10-07T21:58:50.257167] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-07T21:58:50.380212] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:58:50.396959] [DEBUG] [LOCAL ] TRC: Loaded 15620 existing records from primary storage. [2025-10-07T21:58:50.397201] [INFO ] [MAIN ] TRC: Loaded 15620 existing records. [2025-10-07T21:58:50.571097] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:58:50.571303] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-07T21:58:50.571350] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-07T21:58:50.572037] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-07T21:58:50.572114] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-07T21:58:50.921812] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:58:51.047631] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-07T21:58:51.131461] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-07T21:58:51.847681] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-07T21:58:51.896376] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T21:58:51.898290] [INFO ] [REMOTE ] TR: Full fetch complete (25325 records). [2025-10-07T21:58:51.898422] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-07T21:58:52.270396] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-07T21:58:52.270491] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-07T21:58:52.271261] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-07T21:58:52.271328] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-07T21:58:52.272201] [DEBUG] [LOCAL ] TR: Trimmed 25325 records to 18745 (keeping 200 days of data) [2025-10-07T21:58:52.395530] [DEBUG] [LOCAL ] TR: Primary data saved (18745 records). [2025-10-07T21:58:52.395746] [INFO ] [MAIN ] TR: Full history saved. [2025-10-07T21:58:52.395855] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TR took 33.2s. Estimated remaining: 34m 54s. Rate: 7.1 symbols/min [2025-10-07T21:58:52.569007] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:58:52.614252] [DEBUG] [LOCAL ] TREX: Loaded 49941 existing records from primary storage. [2025-10-07T21:58:52.614738] [INFO ] [MAIN ] TREX: Loaded 49941 existing records. [2025-10-07T21:58:52.652840] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-07T21:58:52.720703] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T21:58:52.811923] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:58:52.812185] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-07T21:58:52.812236] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-07T21:58:52.813693] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-07T21:58:52.813754] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-07T21:58:53.190673] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:58:53.447761] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-07T21:58:53.473139] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-07T21:58:54.247742] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-07T21:58:55.033725] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-07T21:58:55.052720] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-07T21:58:55.069465] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T21:58:55.763594] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T21:58:55.765150] [INFO ] [REMOTE ] TRAK: Full fetch complete (13606 records). [2025-10-07T21:58:55.765227] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-07T21:58:55.852777] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-07T21:58:56.205050] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-07T21:58:56.205133] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-07T21:58:56.205457] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-07T21:58:56.205498] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-07T21:58:56.206026] [DEBUG] [LOCAL ] TRAK: Trimmed 13606 records to 9557 (keeping 200 days of data) [2025-10-07T21:58:56.266011] [DEBUG] [LOCAL ] TRAK: Primary data saved (9557 records). [2025-10-07T21:58:56.266151] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-07T21:58:56.266238] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TRAK took 23.4s. Estimated remaining: 34m 45s. Rate: 7.1 symbols/min [2025-10-07T21:58:56.433092] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:58:56.487659] [DEBUG] [LOCAL ] TRGP: Loaded 50742 existing records from primary storage. [2025-10-07T21:58:56.488082] [INFO ] [MAIN ] TRGP: Loaded 50742 existing records. [2025-10-07T21:58:56.648414] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-07T21:58:56.671240] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:58:56.672596] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-07T21:58:56.672669] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-07T21:58:56.673140] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-07T21:58:56.673269] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-07T21:58:56.784499] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-07T21:58:57.058274] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:58:57.447732] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-07T21:58:57.880897] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T21:58:58.247696] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-07T21:58:58.794967] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T21:58:59.047748] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-07T21:58:59.847672] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-07T21:58:59.923852] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T21:58:59.962587] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T21:59:00.647705] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-07T21:59:01.447637] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-07T21:59:01.486467] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T21:59:02.247631] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-07T21:59:02.378414] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-07T21:59:02.445708] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-07T21:59:03.047740] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-07T21:59:03.847771] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-07T21:59:04.072503] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-07T21:59:04.070817] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T21:59:04.085751] [INFO ] [REMOTE ] TPVG: Full fetch complete (39971 records). [2025-10-07T21:59:04.086251] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-07T21:59:04.501374] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-07T21:59:04.501493] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-07T21:59:04.503135] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-07T21:59:04.503210] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-07T21:59:04.504631] [DEBUG] [LOCAL ] TPVG: Trimmed 39971 records to 26934 (keeping 200 days of data) [2025-10-07T21:59:04.649125] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-07T21:59:04.675664] [DEBUG] [LOCAL ] TPVG: Primary data saved (26934 records). [2025-10-07T21:59:04.675833] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-07T21:59:04.675943] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TPVG took 45.5s. Estimated remaining: 34m 37s. Rate: 7.1 symbols/min [2025-10-07T21:59:04.843361] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:59:04.882096] [DEBUG] [LOCAL ] TRN: Loaded 36817 existing records from primary storage. [2025-10-07T21:59:04.882449] [INFO ] [MAIN ] TRN: Loaded 36817 existing records. [2025-10-07T21:59:05.058683] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:59:05.059213] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-07T21:59:05.059266] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-07T21:59:05.059604] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-07T21:59:05.059700] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-07T21:59:05.433252] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:59:05.447606] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-07T21:59:05.491618] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T21:59:06.247633] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-07T21:59:06.437016] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T21:59:06.876906] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T21:59:07.047619] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-07T21:59:07.847624] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-07T21:59:07.992986] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T21:59:08.647670] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-07T21:59:08.752897] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T21:59:09.228958] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T21:59:09.447674] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-07T21:59:10.239974] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T21:59:10.250790] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-07T21:59:10.442925] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T21:59:11.047755] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-07T21:59:11.847733] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-07T21:59:11.912361] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T21:59:12.647631] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-07T21:59:12.838018] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-07T21:59:13.053124] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T21:59:13.447732] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-07T21:59:14.247703] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-07T21:59:14.311229] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T21:59:15.016619] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T21:59:15.047691] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-07T21:59:15.820805] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T21:59:15.847724] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-07T21:59:16.082311] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-07T21:59:16.647706] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-07T21:59:17.447623] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-07T21:59:17.639836] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T21:59:17.769584] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-07T21:59:18.247735] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-07T21:59:18.988605] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T21:59:19.047603] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-07T21:59:19.273308] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-07T21:59:19.847733] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-07T21:59:20.647723] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-07T21:59:20.865259] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T21:59:21.447672] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-07T21:59:21.533371] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T21:59:21.574077] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T21:59:22.247717] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-07T21:59:22.810234] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T21:59:23.047692] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-07T21:59:23.635796] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T21:59:23.640971] [INFO ] [REMOTE ] TREX: Full fetch complete (71129 records). [2025-10-07T21:59:23.641214] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-07T21:59:23.857733] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-07T21:59:24.056282] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-07T21:59:24.056877] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-07T21:59:24.062185] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-07T21:59:24.062376] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-07T21:59:24.063972] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-07T21:59:24.069428] [DEBUG] [LOCAL ] TREX: Trimmed 71129 records to 49939 (keeping 200 days of data) [2025-10-07T21:59:24.372815] [DEBUG] [LOCAL ] TREX: Primary data saved (49939 records). [2025-10-07T21:59:24.372963] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-07T21:59:24.373069] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TREX took 32.0s. Estimated remaining: 34m 30s. Rate: 7.1 symbols/min [2025-10-07T21:59:24.542385] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:59:24.582345] [DEBUG] [LOCAL ] TRNO: Loaded 43997 existing records from primary storage. [2025-10-07T21:59:24.582677] [INFO ] [MAIN ] TRNO: Loaded 43997 existing records. [2025-10-07T21:59:24.654579] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-07T21:59:24.757978] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:59:24.758218] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-07T21:59:24.758290] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-07T21:59:24.758849] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-07T21:59:24.758924] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-07T21:59:25.109114] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:59:25.436730] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T21:59:25.447592] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-07T21:59:25.593775] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T21:59:26.247726] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-07T21:59:27.057893] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-07T21:59:27.060436] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T21:59:27.854347] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-07T21:59:27.872256] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T21:59:28.054411] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T21:59:28.647724] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-07T21:59:29.188417] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T21:59:29.447691] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-07T21:59:30.048775] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T21:59:30.247716] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-07T21:59:30.941137] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T21:59:31.047740] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-07T21:59:31.411579] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T21:59:31.414618] [INFO ] [REMOTE ] TRN: Full fetch complete (52818 records). [2025-10-07T21:59:31.414818] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-07T21:59:31.802593] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-07T21:59:31.802712] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-07T21:59:31.803751] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-07T21:59:31.803817] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-07T21:59:31.805045] [DEBUG] [LOCAL ] TRN: Trimmed 52818 records to 36812 (keeping 200 days of data) [2025-10-07T21:59:31.858787] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-07T21:59:32.028781] [DEBUG] [LOCAL ] TRN: Primary data saved (36812 records). [2025-10-07T21:59:32.028938] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-07T21:59:32.029030] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TRN took 27.4s. Estimated remaining: 34m 21s. Rate: 7.1 symbols/min [2025-10-07T21:59:32.202795] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:59:32.253952] [DEBUG] [LOCAL ] TROX: Loaded 51930 existing records from primary storage. [2025-10-07T21:59:32.254324] [INFO ] [MAIN ] TROX: Loaded 51930 existing records. [2025-10-07T21:59:32.439669] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:59:32.440055] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-07T21:59:32.440187] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-07T21:59:32.441528] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-07T21:59:32.441590] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-07T21:59:32.547905] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T21:59:32.550204] [INFO ] [REMOTE ] TRC: Full fetch complete (22017 records). [2025-10-07T21:59:32.551003] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-07T21:59:32.650901] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-07T21:59:32.975166] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-07T21:59:33.156296] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:59:33.328909] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-07T21:59:33.329511] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-07T21:59:33.329857] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T21:59:33.333325] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-07T21:59:33.333694] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-07T21:59:33.334362] [INFO ] [REMOTE ] TRGP: Full fetch complete (73529 records). [2025-10-07T21:59:33.334593] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-07T21:59:33.335091] [DEBUG] [LOCAL ] TRC: Trimmed 22017 records to 15658 (keeping 200 days of data) [2025-10-07T21:59:33.458051] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-07T21:59:33.803001] [DEBUG] [LOCAL ] TRC: Primary data saved (15658 records). [2025-10-07T21:59:33.825411] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-07T21:59:33.821962] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-07T21:59:33.825637] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRC took 43.6s. Estimated remaining: 34m 12s. Rate: 7.1 symbols/min [2025-10-07T21:59:33.825531] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-07T21:59:33.827123] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-07T21:59:33.858072] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-07T21:59:33.926266] [DEBUG] [LOCAL ] TRGP: Trimmed 73529 records to 50761 (keeping 200 days of data) [2025-10-07T21:59:34.062367] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:59:34.154237] [DEBUG] [LOCAL ] TRP: Loaded 52121 existing records from primary storage. [2025-10-07T21:59:34.155541] [INFO ] [MAIN ] TRP: Loaded 52121 existing records. [2025-10-07T21:59:34.252933] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-07T21:59:34.432075] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:59:34.432843] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-07T21:59:34.433149] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-07T21:59:34.435883] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-07T21:59:34.436187] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-07T21:59:34.829420] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:59:34.907890] [DEBUG] [LOCAL ] TRGP: Primary data saved (50761 records). [2025-10-07T21:59:34.908039] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-07T21:59:34.908127] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRGP took 38.6s. Estimated remaining: 34m 3s. Rate: 7.1 symbols/min [2025-10-07T21:59:35.054694] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-07T21:59:35.075541] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:59:35.106160] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T21:59:35.145580] [DEBUG] [LOCAL ] TRTX: Loaded 37492 existing records from primary storage. [2025-10-07T21:59:35.145927] [INFO ] [MAIN ] TRTX: Loaded 37492 existing records. [2025-10-07T21:59:35.316298] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:59:35.316509] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-07T21:59:35.316562] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-07T21:59:35.316833] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-07T21:59:35.316890] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-07T21:59:35.667086] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:59:35.847688] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-07T21:59:36.088027] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T21:59:36.647612] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-07T21:59:36.852436] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-07T21:59:37.447626] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-07T21:59:37.478290] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T21:59:37.890018] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-07T21:59:38.247695] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-07T21:59:38.913272] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T21:59:39.047728] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-07T21:59:39.848502] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-07T21:59:39.854841] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-07T21:59:40.271326] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T21:59:40.647669] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-07T21:59:41.447638] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-07T21:59:41.497296] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T21:59:42.078113] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T21:59:42.247694] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-07T21:59:43.047637] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-07T21:59:43.190103] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T21:59:43.550279] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T21:59:43.847635] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-07T21:59:44.426025] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T21:59:44.647674] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-07T21:59:45.407983] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T21:59:45.447603] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-07T21:59:45.972703] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-07T21:59:46.247682] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-07T21:59:47.055047] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-07T21:59:47.058058] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T21:59:47.847630] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-07T21:59:48.086665] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T21:59:48.647678] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-07T21:59:49.002201] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T21:59:49.429116] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T21:59:49.447600] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-07T21:59:50.023368] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T21:59:50.247712] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-07T21:59:51.047670] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-07T21:59:51.084120] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T21:59:51.847637] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-07T21:59:51.986348] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T21:59:52.647674] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-07T21:59:52.785296] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T21:59:53.173451] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T21:59:53.176576] [INFO ] [REMOTE ] TRNO: Full fetch complete (63488 records). [2025-10-07T21:59:53.176727] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-07T21:59:53.452749] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-07T21:59:53.574460] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-07T21:59:53.574566] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-07T21:59:53.575587] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-07T21:59:53.575678] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-07T21:59:53.577243] [DEBUG] [LOCAL ] TRNO: Trimmed 63488 records to 43993 (keeping 200 days of data) [2025-10-07T21:59:53.865523] [DEBUG] [LOCAL ] TRNO: Primary data saved (43993 records). [2025-10-07T21:59:53.865693] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-07T21:59:53.865806] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRNO took 29.5s. Estimated remaining: 33m 55s. Rate: 7.1 symbols/min [2025-10-07T21:59:54.040543] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T21:59:54.070793] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T21:59:54.127248] [DEBUG] [LOCAL ] TRU: Loaded 51302 existing records from primary storage. [2025-10-07T21:59:54.127603] [INFO ] [MAIN ] TRU: Loaded 51302 existing records. [2025-10-07T21:59:54.252786] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-07T21:59:54.330536] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T21:59:54.330801] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-07T21:59:54.330855] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-07T21:59:54.332795] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-07T21:59:54.333084] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-07T21:59:54.682534] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T21:59:55.047680] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-07T21:59:55.241805] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T21:59:55.847780] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-07T21:59:55.954261] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-07T21:59:56.550156] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T21:59:56.647695] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-07T21:59:57.447746] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-07T21:59:57.527392] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T21:59:57.753398] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T21:59:58.247673] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-07T21:59:59.047638] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-07T21:59:59.106817] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T21:59:59.199043] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-07T21:59:59.847669] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-07T22:00:00.647759] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-07T22:00:00.922195] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T22:00:01.078300] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-07T22:00:01.447767] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-07T22:00:02.257823] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-07T22:00:02.263954] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T22:00:03.047761] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-07T22:00:03.434163] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T22:00:03.847686] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-07T22:00:04.030772] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T22:00:04.647672] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-07T22:00:04.799072] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T22:00:05.294557] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T22:00:05.447739] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-07T22:00:06.247623] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-07T22:00:06.606479] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T22:00:07.047673] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-07T22:00:07.101419] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T22:00:07.847695] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-07T22:00:08.176223] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T22:00:08.647687] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-07T22:00:08.837748] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T22:00:09.032161] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T22:00:09.034994] [INFO ] [REMOTE ] TRTX: Full fetch complete (53358 records). [2025-10-07T22:00:09.035086] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-07T22:00:09.416393] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-07T22:00:09.416538] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-07T22:00:09.417605] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-07T22:00:09.417697] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-07T22:00:09.418844] [DEBUG] [LOCAL ] TRTX: Trimmed 53358 records to 37568 (keeping 200 days of data) [2025-10-07T22:00:09.469895] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-07T22:00:09.646419] [DEBUG] [LOCAL ] TRTX: Primary data saved (37568 records). [2025-10-07T22:00:09.646606] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-07T22:00:09.646759] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TRTX took 34.7s. Estimated remaining: 33m 48s. Rate: 7.1 symbols/min [2025-10-07T22:00:09.814837] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:00:09.857343] [DEBUG] [LOCAL ] TRV: Loaded 47616 existing records from primary storage. [2025-10-07T22:00:09.857687] [INFO ] [MAIN ] TRV: Loaded 47616 existing records. [2025-10-07T22:00:10.033547] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:00:10.033773] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-07T22:00:10.033867] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-07T22:00:10.035493] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-07T22:00:10.035554] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-07T22:00:10.193408] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T22:00:10.252767] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-07T22:00:10.261150] [INFO ] [REMOTE ] TROX: Full fetch complete (73318 records). [2025-10-07T22:00:10.287938] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-07T22:00:10.582219] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:00:10.817638] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-07T22:00:10.817768] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-07T22:00:10.818924] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-07T22:00:10.818990] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-07T22:00:10.820568] [DEBUG] [LOCAL ] TROX: Trimmed 73318 records to 51959 (keeping 200 days of data) [2025-10-07T22:00:10.936367] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-07T22:00:10.942056] [INFO ] [REMOTE ] TRP: Full fetch complete (75546 records). [2025-10-07T22:00:10.942984] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-07T22:00:11.048994] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-07T22:00:11.449436] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-07T22:00:11.450065] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-07T22:00:11.452757] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-07T22:00:11.453071] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-07T22:00:11.458567] [DEBUG] [LOCAL ] TRP: Trimmed 75546 records to 52123 (keeping 200 days of data) [2025-10-07T22:00:11.791781] [DEBUG] [LOCAL ] TROX: Primary data saved (51959 records). [2025-10-07T22:00:11.797155] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-07T22:00:11.798739] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TROX took 39.8s. Estimated remaining: 33m 39s. Rate: 7.1 symbols/min [2025-10-07T22:00:12.055396] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:00:12.073770] [DEBUG] [LOCAL ] TRP: Primary data saved (52123 records). [2025-10-07T22:00:12.073931] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-07T22:00:12.074025] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRP took 38.2s. Estimated remaining: 33m 29s. Rate: 7.1 symbols/min [2025-10-07T22:00:12.275680] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:00:12.276951] [DEBUG] [LOCAL ] TS: Loaded 51681 existing records from primary storage. [2025-10-07T22:00:12.277295] [INFO ] [MAIN ] TS: Loaded 51681 existing records. [2025-10-07T22:00:12.445631] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-07T22:00:12.524463] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:00:12.525173] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-07T22:00:12.526700] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-07T22:00:12.526579] [DEBUG] [LOCAL ] TSE: Loaded 28026 existing records from primary storage. [2025-10-07T22:00:12.526967] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-07T22:00:12.528208] [INFO ] [MAIN ] TSE: Loaded 28026 existing records. [2025-10-07T22:00:12.534734] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-07T22:00:12.543295] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-07T22:00:12.855822] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:00:12.874777] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-07T22:00:12.893878] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-07T22:00:12.952665] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-07T22:00:12.970079] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-07T22:00:13.200259] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:00:13.216847] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-07T22:00:13.508294] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:00:13.508794] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-07T22:00:13.511168] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-07T22:00:13.885529] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T22:00:14.247725] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-07T22:00:14.528906] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T22:00:15.047625] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-07T22:00:15.159280] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-07T22:00:15.795428] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-07T22:00:15.847636] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-07T22:00:16.048145] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T22:00:16.647695] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-07T22:00:17.447627] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-07T22:00:17.574545] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T22:00:18.247633] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-07T22:00:18.448672] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T22:00:19.047629] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-07T22:00:19.269448] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T22:00:19.758934] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-07T22:00:19.847620] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-07T22:00:20.647699] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-07T22:00:20.799403] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T22:00:21.375472] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T22:00:21.379667] [INFO ] [REMOTE ] TRU: Full fetch complete (73577 records). [2025-10-07T22:00:21.379837] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-07T22:00:21.456210] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-07T22:00:21.819427] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-07T22:00:21.819514] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-07T22:00:21.821523] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-07T22:00:21.821591] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-07T22:00:21.823260] [DEBUG] [LOCAL ] TRU: Trimmed 73577 records to 51320 (keeping 200 days of data) [2025-10-07T22:00:22.145826] [DEBUG] [LOCAL ] TRU: Primary data saved (51320 records). [2025-10-07T22:00:22.145977] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-07T22:00:22.146096] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 28.3s. Estimated remaining: 33m 21s. Rate: 7.1 symbols/min [2025-10-07T22:00:22.252168] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-07T22:00:22.317895] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:00:22.327553] [DEBUG] [LOCAL ] TSI: Loaded 7300 existing records from primary storage. [2025-10-07T22:00:22.328022] [INFO ] [MAIN ] TSI: Loaded 7300 existing records. [2025-10-07T22:00:22.469364] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T22:00:22.530631] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:00:22.530822] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-07T22:00:22.530870] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-07T22:00:22.531351] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-07T22:00:22.531409] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-07T22:00:22.879075] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:00:23.047703] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-07T22:00:23.257150] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T22:00:23.719806] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T22:00:23.847674] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-07T22:00:24.009263] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T22:00:24.478574] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-07T22:00:24.647684] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-07T22:00:25.447631] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-07T22:00:26.247622] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-07T22:00:26.317433] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-07T22:00:26.563921] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T22:00:27.047678] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-07T22:00:27.234552] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-07T22:00:27.847704] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-07T22:00:28.647684] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-07T22:00:28.757845] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T22:00:28.897303] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T22:00:29.447754] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-07T22:00:29.587988] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T22:00:30.247690] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-07T22:00:31.047632] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-07T22:00:31.096983] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T22:00:31.619348] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-07T22:00:31.786152] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-07T22:00:31.847608] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-07T22:00:32.423902] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T22:00:32.647685] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-07T22:00:33.447690] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-07T22:00:34.028377] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T22:00:34.247618] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-07T22:00:34.706174] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-07T22:00:35.047700] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-07T22:00:35.072512] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-07T22:00:35.847696] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-07T22:00:36.327506] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T22:00:36.647674] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-07T22:00:37.447704] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-07T22:00:37.725569] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T22:00:37.900479] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-07T22:00:38.247692] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-07T22:00:38.959334] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T22:00:39.047699] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-07T22:00:39.451321] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T22:00:39.847674] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-07T22:00:40.647624] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-07T22:00:40.784577] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T22:00:41.413479] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T22:00:41.415618] [INFO ] [REMOTE ] TSE: Full fetch complete (40765 records). [2025-10-07T22:00:41.415801] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-07T22:00:41.457407] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-07T22:00:41.855473] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-07T22:00:41.855631] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-07T22:00:41.857018] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-07T22:00:41.857548] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-07T22:00:41.859424] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T22:00:41.872474] [DEBUG] [LOCAL ] TSE: Trimmed 40765 records to 27970 (keeping 200 days of data) [2025-10-07T22:00:42.037201] [DEBUG] [LOCAL ] TSE: Primary data saved (27970 records). [2025-10-07T22:00:42.037359] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-07T22:00:42.037471] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TSE took 30.0s. Estimated remaining: 33m 14s. Rate: 7.1 symbols/min [2025-10-07T22:00:42.225864] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:00:42.249570] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-07T22:00:42.265044] [DEBUG] [LOCAL ] TSLX: Loaded 35340 existing records from primary storage. [2025-10-07T22:00:42.265341] [INFO ] [MAIN ] TSLX: Loaded 35340 existing records. [2025-10-07T22:00:42.373447] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-07T22:00:42.452690] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:00:42.452917] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-07T22:00:42.452965] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-07T22:00:42.454274] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-07T22:00:42.454335] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-07T22:00:42.799157] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:00:43.047622] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-07T22:00:43.847615] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-07T22:00:44.026489] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T22:00:44.321185] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T22:00:44.647717] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-07T22:00:45.110284] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T22:00:45.113634] [INFO ] [REMOTE ] TRV: Full fetch complete (69644 records). [2025-10-07T22:00:45.113854] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-07T22:00:45.449019] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-07T22:00:45.519870] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-07T22:00:45.520030] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-07T22:00:45.521133] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-07T22:00:45.521211] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-07T22:00:45.549634] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T22:00:45.548229] [DEBUG] [LOCAL ] TRV: Trimmed 69644 records to 47572 (keeping 200 days of data) [2025-10-07T22:00:45.867366] [DEBUG] [LOCAL ] TRV: Primary data saved (47572 records). [2025-10-07T22:00:45.867516] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-07T22:00:45.867616] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TRV took 36.2s. Estimated remaining: 33m 5s. Rate: 7.1 symbols/min [2025-10-07T22:00:46.035202] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:00:46.088595] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-07T22:00:46.089040] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-07T22:00:46.250443] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-07T22:00:46.280956] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:00:46.281627] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-07T22:00:46.281872] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-07T22:00:46.290936] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T22:00:46.293704] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-07T22:00:46.293999] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-07T22:00:46.663689] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:00:47.047875] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-07T22:00:47.798462] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T22:00:47.847713] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-07T22:00:48.066508] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T22:00:48.647712] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-07T22:00:49.112176] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-07T22:00:49.237928] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T22:00:49.239191] [INFO ] [REMOTE ] TSI: Full fetch complete (13439 records). [2025-10-07T22:00:49.239285] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-07T22:00:49.455773] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-07T22:00:49.612876] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-07T22:00:49.612989] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-07T22:00:49.613382] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-07T22:00:49.613425] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-07T22:00:49.613944] [DEBUG] [LOCAL ] TSI: Trimmed 13439 records to 7438 (keeping 200 days of data) [2025-10-07T22:00:49.658067] [DEBUG] [LOCAL ] TSI: Primary data saved (7438 records). [2025-10-07T22:00:49.658215] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-07T22:00:49.658301] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSI took 27.5s. Estimated remaining: 32m 56s. Rate: 7.1 symbols/min [2025-10-07T22:00:49.824207] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:00:49.874536] [DEBUG] [LOCAL ] TSN: Loaded 52935 existing records from primary storage. [2025-10-07T22:00:49.874942] [INFO ] [MAIN ] TSN: Loaded 52935 existing records. [2025-10-07T22:00:50.048467] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:00:50.048735] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-07T22:00:50.048792] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-07T22:00:50.050231] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-07T22:00:50.050291] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-07T22:00:50.256953] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-07T22:00:50.417859] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:00:51.047729] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-07T22:00:51.696592] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T22:00:51.847622] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-07T22:00:52.338888] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-10-07T22:00:52.647678] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-07T22:00:52.746759] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T22:00:53.332006] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-07T22:00:53.447740] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-07T22:00:54.247694] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-07T22:00:55.035265] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T22:00:55.047589] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-07T22:00:55.664005] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (3.02 seconds). [2025-10-07T22:00:55.847755] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-07T22:00:56.054189] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T22:00:56.441821] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T22:00:56.647710] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-07T22:00:57.447736] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-07T22:00:58.247671] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-07T22:00:58.412362] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-07T22:00:58.455843] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T22:00:59.047771] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-07T22:00:59.105849] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T22:00:59.650901] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T22:00:59.847687] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-07T22:01:00.647676] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-07T22:01:00.784069] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T22:01:01.256277] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T22:01:01.260056] [INFO ] [REMOTE ] TS: Full fetch complete (74556 records). [2025-10-07T22:01:01.260185] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-07T22:01:01.452910] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-07T22:01:01.692843] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-07T22:01:01.692946] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-07T22:01:01.694095] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-07T22:01:01.694170] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-07T22:01:01.695863] [DEBUG] [LOCAL ] TS: Trimmed 74556 records to 51687 (keeping 200 days of data) [2025-10-07T22:01:01.943326] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-07T22:01:02.054158] [DEBUG] [LOCAL ] TS: Primary data saved (51687 records). [2025-10-07T22:01:02.054338] [INFO ] [MAIN ] TS: Full history saved. [2025-10-07T22:01:02.054438] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TS took 50.3s. Estimated remaining: 32m 48s. Rate: 7.1 symbols/min [2025-10-07T22:01:02.235213] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:01:02.251181] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-07T22:01:02.251843] [DEBUG] [LOCAL ] TSQ: Loaded 11828 existing records from primary storage. [2025-10-07T22:01:02.253116] [INFO ] [MAIN ] TSQ: Loaded 11828 existing records. [2025-10-07T22:01:02.468277] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:01:02.468594] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-07T22:01:02.468675] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-07T22:01:02.468947] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-07T22:01:02.469027] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-07T22:01:02.824426] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:01:03.047692] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-07T22:01:03.708755] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T22:01:03.842732] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T22:01:03.847593] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-07T22:01:03.907456] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-07T22:01:04.647692] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-07T22:01:04.745023] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-07T22:01:05.447738] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-07T22:01:06.247710] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-07T22:01:06.553626] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-07T22:01:06.899596] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T22:01:07.047625] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-07T22:01:07.847749] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-07T22:01:08.243790] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T22:01:08.252237] [INFO ] [REMOTE ] TSLX: Full fetch complete (49609 records). [2025-10-07T22:01:08.252458] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-07T22:01:08.636251] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-07T22:01:08.636341] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-07T22:01:08.637269] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-07T22:01:08.637336] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-07T22:01:08.638531] [DEBUG] [LOCAL ] TSLX: Trimmed 49609 records to 35356 (keeping 200 days of data) [2025-10-07T22:01:08.691860] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-07T22:01:08.869553] [DEBUG] [LOCAL ] TSLX: Primary data saved (35356 records). [2025-10-07T22:01:08.869767] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-07T22:01:08.869889] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSLX took 26.8s. Estimated remaining: 32m 39s. Rate: 7.1 symbols/min [2025-10-07T22:01:09.048469] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:01:09.084482] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-10-07T22:01:09.143432] [DEBUG] [LOCAL ] TT: Loaded 47541 existing records from primary storage. [2025-10-07T22:01:09.143864] [INFO ] [MAIN ] TT: Loaded 47541 existing records. [2025-10-07T22:01:09.325675] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:01:09.325999] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-07T22:01:09.326069] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-07T22:01:09.327349] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-07T22:01:09.327445] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-07T22:01:09.452783] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-07T22:01:09.651541] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T22:01:09.744965] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:01:09.776844] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T22:01:10.247722] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-07T22:01:11.047748] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-07T22:01:11.109199] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-07T22:01:11.847721] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-07T22:01:12.647738] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-07T22:01:12.747184] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T22:01:12.768733] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T22:01:13.447673] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-07T22:01:14.247704] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-07T22:01:14.442126] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-07T22:01:14.578637] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (5.13 seconds). [2025-10-07T22:01:15.047749] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-07T22:01:15.847634] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-07T22:01:16.017958] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-07T22:01:16.091570] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T22:01:16.442020] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (3.79 seconds). [2025-10-07T22:01:16.647690] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-07T22:01:17.447775] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-07T22:01:18.247632] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-07T22:01:18.295501] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T22:01:18.532698] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-07T22:01:18.635461] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-10-07T22:01:19.047720] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-07T22:01:19.751579] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-07T22:01:19.847634] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-07T22:01:20.647697] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-07T22:01:21.447639] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-07T22:01:21.527842] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T22:01:21.759429] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T22:01:21.968109] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-07T22:01:22.247680] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-07T22:01:22.965817] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T22:01:23.058250] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-07T22:01:23.065465] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-07T22:01:23.692263] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T22:01:23.693448] [INFO ] [REMOTE ] TSQ: Full fetch complete (16407 records). [2025-10-07T22:01:23.693531] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-07T22:01:23.857251] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-07T22:01:24.136046] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-07T22:01:24.136130] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-07T22:01:24.136639] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-07T22:01:24.136726] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-07T22:01:24.137295] [DEBUG] [LOCAL ] TSQ: Trimmed 16407 records to 11798 (keeping 200 days of data) [2025-10-07T22:01:24.218100] [DEBUG] [LOCAL ] TSQ: Primary data saved (11798 records). [2025-10-07T22:01:24.218261] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-07T22:01:24.218364] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSQ took 22.2s. Estimated remaining: 32m 32s. Rate: 7.1 symbols/min [2025-10-07T22:01:24.396422] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:01:24.396636] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-07T22:01:24.396715] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-07T22:01:24.396827] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-07T22:01:24.396871] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-07T22:01:24.396913] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-07T22:01:24.396946] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-07T22:01:24.652932] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-07T22:01:24.751928] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:01:25.447684] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-07T22:01:26.247704] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-07T22:01:26.450181] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T22:01:26.450499] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-07T22:01:26.450599] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T22:01:26.450673] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-07T22:01:26.450741] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T22:01:26.450830] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-07T22:01:26.450912] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-07T22:01:26.450950] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-07T22:01:26.451006] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-07T22:01:26.451088] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TTAM took 2.2s. Estimated remaining: 32m 23s. Rate: 7.1 symbols/min [2025-10-07T22:01:26.625776] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:01:26.666973] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-07T22:01:26.714735] [DEBUG] [LOCAL ] TTC: Loaded 42038 existing records from primary storage. [2025-10-07T22:01:26.715450] [INFO ] [MAIN ] TTC: Loaded 42038 existing records. [2025-10-07T22:01:26.843920] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-07T22:01:26.939138] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:01:26.939521] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-07T22:01:26.939702] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-07T22:01:26.940001] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-07T22:01:26.940078] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-07T22:01:27.050244] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-07T22:01:27.348359] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:01:27.383458] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-07T22:01:27.847699] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-07T22:01:28.647731] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-07T22:01:29.211853] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T22:01:29.447639] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-07T22:01:29.548738] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T22:01:29.591982] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-07T22:01:29.750603] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-07T22:01:29.755051] [INFO ] [REMOTE ] TSN: Full fetch complete (76371 records). [2025-10-07T22:01:29.755223] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-07T22:01:30.144451] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-07T22:01:30.144543] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-07T22:01:30.145717] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-07T22:01:30.145810] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-07T22:01:30.148658] [DEBUG] [LOCAL ] TSN: Trimmed 76371 records to 52938 (keeping 200 days of data) [2025-10-07T22:01:30.251687] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-07T22:01:30.501032] [DEBUG] [LOCAL ] TSN: Primary data saved (52938 records). [2025-10-07T22:01:30.501206] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-07T22:01:30.501318] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSN took 40.8s. Estimated remaining: 32m 14s. Rate: 7.1 symbols/min [2025-10-07T22:01:30.710006] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:01:30.760043] [DEBUG] [LOCAL ] TTE: Loaded 51598 existing records from primary storage. [2025-10-07T22:01:30.760419] [INFO ] [MAIN ] TTE: Loaded 51598 existing records. [2025-10-07T22:01:30.943777] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:01:30.944184] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-07T22:01:30.944256] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-07T22:01:30.944516] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-07T22:01:30.944575] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-07T22:01:31.052759] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-07T22:01:31.311275] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:01:31.847691] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-07T22:01:32.647702] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-07T22:01:32.694499] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-07T22:01:32.696554] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T22:01:32.711889] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-07T22:01:32.712153] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-07T22:01:33.131072] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-07T22:01:33.131168] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-07T22:01:33.132345] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-07T22:01:33.132411] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-07T22:01:33.134030] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-10-07T22:01:33.451730] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-07T22:01:33.501219] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-07T22:01:33.501939] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-07T22:01:33.502088] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TSM took 47.6s. Estimated remaining: 32m 5s. Rate: 7.1 symbols/min [2025-10-07T22:01:33.715150] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T22:01:33.718975] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:01:33.776990] [DEBUG] [LOCAL ] TTI: Loaded 45750 existing records from primary storage. [2025-10-07T22:01:33.777356] [INFO ] [MAIN ] TTI: Loaded 45750 existing records. [2025-10-07T22:01:33.957318] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:01:33.958238] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-07T22:01:33.958292] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-07T22:01:33.958609] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-07T22:01:33.958737] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-07T22:01:34.255274] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-07T22:01:34.356111] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:01:34.524741] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-07T22:01:34.569217] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T22:01:35.047725] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-07T22:01:35.847725] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-07T22:01:36.098240] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T22:01:36.647629] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-07T22:01:37.447630] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-07T22:01:37.631483] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-07T22:01:38.247719] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-07T22:01:38.379351] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-07T22:01:38.643940] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T22:01:38.730294] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-10-07T22:01:39.047706] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-07T22:01:39.735918] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T22:01:39.847687] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-07T22:01:40.647639] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-07T22:01:40.925019] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T22:01:41.448470] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-07T22:01:41.451900] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T22:01:42.032576] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T22:01:42.247732] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-07T22:01:43.047685] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-07T22:01:43.094934] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T22:01:43.847714] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-07T22:01:43.919633] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T22:01:44.647706] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-07T22:01:44.924829] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T22:01:45.447757] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-07T22:01:45.516402] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T22:01:46.213261] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T22:01:46.247617] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-07T22:01:47.011382] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T22:01:47.047769] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-07T22:01:47.791740] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T22:01:47.847688] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-07T22:01:48.621076] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T22:01:48.647609] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-07T22:01:49.447733] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-07T22:01:49.526981] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T22:01:50.146383] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T22:01:50.247707] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-07T22:01:51.047754] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-07T22:01:51.494988] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-07T22:01:51.847720] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-07T22:01:51.996003] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-07T22:01:52.655014] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-07T22:01:52.675951] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T22:01:53.447723] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-07T22:01:53.681548] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T22:01:53.915994] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T22:01:53.920795] [INFO ] [REMOTE ] TT: Full fetch complete (69798 records). [2025-10-07T22:01:53.920944] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-07T22:01:54.257464] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-07T22:01:54.404961] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-07T22:01:54.418669] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-07T22:01:54.431143] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-07T22:01:54.433253] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T22:01:54.433360] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-07T22:01:54.444967] [DEBUG] [LOCAL ] TT: Trimmed 69798 records to 47532 (keeping 200 days of data) [2025-10-07T22:01:54.757394] [DEBUG] [LOCAL ] TT: Primary data saved (47532 records). [2025-10-07T22:01:54.757552] [INFO ] [MAIN ] TT: Full history saved. [2025-10-07T22:01:54.757668] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TT took 45.9s. Estimated remaining: 31m 57s. Rate: 7.1 symbols/min [2025-10-07T22:01:54.922982] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:01:54.971145] [DEBUG] [LOCAL ] TU: Loaded 49840 existing records from primary storage. [2025-10-07T22:01:54.971615] [INFO ] [MAIN ] TU: Loaded 49840 existing records. [2025-10-07T22:01:55.052802] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-07T22:01:55.148753] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:01:55.148992] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-07T22:01:55.149042] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-07T22:01:55.149433] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-07T22:01:55.149490] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-07T22:01:55.523353] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:01:55.847692] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-07T22:01:55.918609] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T22:01:56.647708] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-07T22:01:56.952813] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-07T22:01:57.447696] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-07T22:01:57.697173] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T22:01:58.247763] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-07T22:01:58.356770] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T22:01:59.047773] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-07T22:01:59.407198] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-07T22:01:59.847629] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-07T22:01:59.954756] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T22:02:00.647638] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-07T22:02:00.703806] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T22:02:01.311802] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T22:02:01.316080] [INFO ] [REMOTE ] TTE: Full fetch complete (74974 records). [2025-10-07T22:02:01.316272] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-07T22:02:01.462342] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-07T22:02:01.736485] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-07T22:02:01.736623] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-07T22:02:01.738003] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-07T22:02:01.738076] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-07T22:02:01.739866] [DEBUG] [LOCAL ] TTE: Trimmed 74974 records to 51602 (keeping 200 days of data) [2025-10-07T22:02:01.970161] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-07T22:02:01.976507] [INFO ] [REMOTE ] TTC: Full fetch complete (62213 records). [2025-10-07T22:02:01.977393] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-07T22:02:02.257913] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-07T22:02:02.486069] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-07T22:02:02.486471] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-07T22:02:02.487720] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-07T22:02:02.488049] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-07T22:02:02.492968] [DEBUG] [LOCAL ] TTC: Trimmed 62213 records to 42053 (keeping 200 days of data) [2025-10-07T22:02:02.701990] [DEBUG] [LOCAL ] TTE: Primary data saved (51602 records). [2025-10-07T22:02:02.702687] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-07T22:02:02.703331] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTE took 32.2s. Estimated remaining: 31m 49s. Rate: 7.1 symbols/min [2025-10-07T22:02:02.883675] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:02:03.021084] [DEBUG] [LOCAL ] TUYA: Loaded 46148 existing records from primary storage. [2025-10-07T22:02:03.022145] [INFO ] [MAIN ] TUYA: Loaded 46148 existing records. [2025-10-07T22:02:03.179080] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T22:02:03.254100] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:02:03.254974] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-07T22:02:03.255288] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-07T22:02:03.255821] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-07T22:02:03.256469] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-07T22:02:03.256806] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-07T22:02:03.665626] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:02:03.685784] [DEBUG] [LOCAL ] TTC: Primary data saved (42053 records). [2025-10-07T22:02:03.685964] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-07T22:02:03.686071] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTC took 37.2s. Estimated remaining: 31m 40s. Rate: 7.1 symbols/min [2025-10-07T22:02:03.854005] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-07T22:02:03.857128] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:02:03.900754] [DEBUG] [LOCAL ] TV: Loaded 42263 existing records from primary storage. [2025-10-07T22:02:03.901074] [INFO ] [MAIN ] TV: Loaded 42263 existing records. [2025-10-07T22:02:04.085480] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:02:04.085910] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-07T22:02:04.085982] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-07T22:02:04.086244] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-07T22:02:04.086457] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-07T22:02:04.216198] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-07T22:02:04.532473] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:02:04.647698] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-07T22:02:04.721037] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T22:02:04.726529] [INFO ] [REMOTE ] TTI: Full fetch complete (65522 records). [2025-10-07T22:02:04.726740] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-07T22:02:05.178513] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-07T22:02:05.178765] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-07T22:02:05.180180] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-07T22:02:05.180296] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-07T22:02:05.205025] [DEBUG] [LOCAL ] TTI: Trimmed 65522 records to 45892 (keeping 200 days of data) [2025-10-07T22:02:05.206448] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-07T22:02:05.458781] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-07T22:02:05.481484] [DEBUG] [LOCAL ] TTI: Primary data saved (45892 records). [2025-10-07T22:02:05.481614] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-07T22:02:05.481762] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTI took 32.0s. Estimated remaining: 31m 31s. Rate: 7.1 symbols/min [2025-10-07T22:02:05.659662] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:02:05.666132] [DEBUG] [LOCAL ] TVC: Loaded 3311 existing records from primary storage. [2025-10-07T22:02:05.666314] [INFO ] [MAIN ] TVC: Loaded 3311 existing records. [2025-10-07T22:02:05.842600] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:02:05.842917] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-07T22:02:05.842976] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-07T22:02:05.843209] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-07T22:02:05.843270] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-07T22:02:06.194184] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:02:06.227613] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T22:02:06.247601] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-07T22:02:07.017004] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T22:02:07.047604] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-07T22:02:07.847626] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-07T22:02:08.034719] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T22:02:08.609702] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-07T22:02:08.647718] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-07T22:02:08.823421] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T22:02:09.304419] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T22:02:09.447717] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-07T22:02:10.110566] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T22:02:10.247703] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-07T22:02:11.047696] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-07T22:02:11.449685] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-07T22:02:11.847715] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-07T22:02:12.043746] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-07T22:02:12.647677] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-07T22:02:13.447666] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-07T22:02:13.493384] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T22:02:14.247635] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-07T22:02:14.308812] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T22:02:14.825375] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-07T22:02:15.047632] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-07T22:02:15.182264] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T22:02:15.847684] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-07T22:02:16.647687] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-07T22:02:16.727267] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T22:02:17.224251] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T22:02:17.447703] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-07T22:02:17.651737] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T22:02:18.087234] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-07T22:02:18.247685] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-07T22:02:19.047741] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-07T22:02:19.709256] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T22:02:19.847687] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-07T22:02:19.909578] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T22:02:20.325211] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-07T22:02:20.647690] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-07T22:02:21.447692] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-07T22:02:22.236547] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T22:02:22.247595] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-07T22:02:23.059791] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-07T22:02:23.066728] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T22:02:23.612623] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-07T22:02:23.811901] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T22:02:23.847617] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-07T22:02:24.647686] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-07T22:02:25.455822] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-07T22:02:25.460066] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-07T22:02:26.247686] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-07T22:02:26.317566] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T22:02:26.639231] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-07T22:02:26.640352] [INFO ] [REMOTE ] TVC: Full fetch complete (5451 records). [2025-10-07T22:02:26.640424] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-07T22:02:27.048741] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-07T22:02:27.050478] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-07T22:02:27.050835] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-07T22:02:27.051348] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-07T22:02:27.051710] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-07T22:02:27.053223] [DEBUG] [LOCAL ] TVC: Trimmed 5451 records to 3323 (keeping 200 days of data) [2025-10-07T22:02:27.109216] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T22:02:27.127057] [DEBUG] [LOCAL ] TVC: Primary data saved (3323 records). [2025-10-07T22:02:27.127238] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-07T22:02:27.127423] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TVC took 21.6s. Estimated remaining: 31m 24s. Rate: 7.1 symbols/min [2025-10-07T22:02:27.326975] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:02:27.332733] [DEBUG] [LOCAL ] TVE: Loaded 2786 existing records from primary storage. [2025-10-07T22:02:27.332966] [INFO ] [MAIN ] TVE: Loaded 2786 existing records. [2025-10-07T22:02:27.522934] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:02:27.523212] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-07T22:02:27.523299] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-07T22:02:27.523612] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-07T22:02:27.523716] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-07T22:02:27.856751] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-07T22:02:27.952415] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:02:28.647620] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-07T22:02:28.767867] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-07T22:02:29.161416] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-07T22:02:29.447677] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-07T22:02:29.608703] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T22:02:30.247707] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-07T22:02:30.812347] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-07T22:02:31.047630] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-07T22:02:31.131533] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-07T22:02:31.642579] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T22:02:31.847680] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-07T22:02:32.647638] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-07T22:02:33.447691] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-07T22:02:33.588752] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-07T22:02:34.089731] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T22:02:34.090417] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T22:02:34.097474] [INFO ] [REMOTE ] TU: Full fetch complete (72804 records). [2025-10-07T22:02:34.097803] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-07T22:02:34.250915] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-07T22:02:34.497528] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-07T22:02:34.497615] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-07T22:02:34.498718] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-07T22:02:34.498787] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-07T22:02:34.500248] [DEBUG] [LOCAL ] TU: Trimmed 72804 records to 49853 (keeping 200 days of data) [2025-10-07T22:02:34.826820] [DEBUG] [LOCAL ] TU: Primary data saved (49853 records). [2025-10-07T22:02:34.826994] [INFO ] [MAIN ] TU: Full history saved. [2025-10-07T22:02:34.827104] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TU took 40.1s. Estimated remaining: 31m 15s. Rate: 7.1 symbols/min [2025-10-07T22:02:35.008317] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:02:35.008536] [DEBUG] [LOCAL ] TWI: No existing data file found in primary storage. [2025-10-07T22:02:35.008592] [WARN ] [MAIN ] TWI: No existing data found, performing full refresh instead. [2025-10-07T22:02:35.008876] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-07T22:02:35.008920] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-07T22:02:35.008962] [DEBUG] [LOCAL ] TWI: No primary data file found to delete. [2025-10-07T22:02:35.008994] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-07T22:02:35.052846] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-07T22:02:35.415257] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:02:35.853260] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-07T22:02:35.866144] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T22:02:36.647710] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-07T22:02:36.786452] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T22:02:37.416514] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-07T22:02:37.442945] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T22:02:37.452533] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-07T22:02:38.247717] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-07T22:02:38.987365] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T22:02:39.047608] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-07T22:02:39.809087] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T22:02:39.847680] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-07T22:02:40.041456] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T22:02:40.647682] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-07T22:02:41.380760] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T22:02:41.447701] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-07T22:02:41.920779] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T22:02:42.247724] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-07T22:02:42.708360] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-07T22:02:43.047730] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-07T22:02:43.249972] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T22:02:43.847682] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-07T22:02:44.439090] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T22:02:44.571452] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T22:02:44.647617] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-07T22:02:45.447746] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-07T22:02:45.930804] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-07T22:02:46.075234] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T22:02:46.247683] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-07T22:02:46.710813] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-07T22:02:47.047751] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-07T22:02:47.705743] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-07T22:02:47.847707] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-07T22:02:48.647743] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-07T22:02:49.022410] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T22:02:49.026781] [INFO ] [REMOTE ] TV: Full fetch complete (61733 records). [2025-10-07T22:02:49.027033] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-07T22:02:49.105071] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T22:02:49.122824] [INFO ] [REMOTE ] TVE: Full fetch complete (4401 records). [2025-10-07T22:02:49.133860] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-07T22:02:49.456409] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-07T22:02:49.751204] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-07T22:02:49.752013] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-07T22:02:49.779577] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-07T22:02:49.790031] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-07T22:02:49.849869] [DEBUG] [LOCAL ] TV: Trimmed 61733 records to 42192 (keeping 200 days of data) [2025-10-07T22:02:49.877600] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-07T22:02:49.878016] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-07T22:02:49.878177] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-07T22:02:49.878221] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-07T22:02:49.878832] [DEBUG] [LOCAL ] TVE: Trimmed 4401 records to 2782 (keeping 200 days of data) [2025-10-07T22:02:50.000890] [DEBUG] [LOCAL ] TVE: Primary data saved (2782 records). [2025-10-07T22:02:50.001841] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-07T22:02:50.002277] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TVE took 22.9s. Estimated remaining: 31m 7s. Rate: 7.1 symbols/min [2025-10-07T22:02:50.258217] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-07T22:02:50.278136] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:02:50.488579] [DEBUG] [LOCAL ] TWLO: Loaded 52735 existing records from primary storage. [2025-10-07T22:02:50.490918] [INFO ] [MAIN ] TWLO: Loaded 52735 existing records. [2025-10-07T22:02:50.719008] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:02:50.720765] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-07T22:02:50.721921] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-07T22:02:50.723017] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-07T22:02:50.723424] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-07T22:02:51.029874] [DEBUG] [LOCAL ] TV: Primary data saved (42192 records). [2025-10-07T22:02:51.059030] [INFO ] [MAIN ] TV: Full history saved. [2025-10-07T22:02:51.092454] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TV took 47.4s. Estimated remaining: 30m 58s. Rate: 7.1 symbols/min [2025-10-07T22:02:51.307850] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:02:51.370495] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-07T22:02:51.346175] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-07T22:02:51.436823] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:02:51.444334] [DEBUG] [LOCAL ] TWN: Loaded 3201 existing records from primary storage. [2025-10-07T22:02:51.444619] [INFO ] [MAIN ] TWN: Loaded 3201 existing records. [2025-10-07T22:02:51.628835] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:02:51.629229] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-07T22:02:51.637103] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-07T22:02:51.638235] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-07T22:02:51.638169] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T22:02:51.638349] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-07T22:02:51.711620] [INFO ] [REMOTE ] TUYA: Full fetch complete (65877 records). [2025-10-07T22:02:51.734384] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-07T22:02:51.870244] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-07T22:02:52.248213] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:02:52.543105] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-07T22:02:52.543203] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-07T22:02:52.544287] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-07T22:02:52.544353] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-07T22:02:52.545840] [DEBUG] [LOCAL ] TUYA: Trimmed 65877 records to 46045 (keeping 200 days of data) [2025-10-07T22:02:52.647808] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-07T22:02:52.825343] [DEBUG] [LOCAL ] TUYA: Primary data saved (46045 records). [2025-10-07T22:02:52.825493] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-07T22:02:52.825586] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TUYA took 50.1s. Estimated remaining: 30m 49s. Rate: 7.1 symbols/min [2025-10-07T22:02:53.013106] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:02:53.060097] [DEBUG] [LOCAL ] TWO: Loaded 48448 existing records from primary storage. [2025-10-07T22:02:53.060477] [INFO ] [MAIN ] TWO: Loaded 48448 existing records. [2025-10-07T22:02:53.250829] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:02:53.251560] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-07T22:02:53.251681] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-07T22:02:53.252161] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-07T22:02:53.252221] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-07T22:02:53.399965] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T22:02:53.423423] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-07T22:02:53.450501] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-07T22:02:53.663496] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T22:02:53.758930] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:02:54.107908] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-07T22:02:54.247745] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-07T22:02:55.047683] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-07T22:02:55.644505] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-07T22:02:55.847711] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-07T22:02:56.314706] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-07T22:02:56.647687] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-07T22:02:56.812973] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T22:02:57.447705] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-07T22:02:58.084967] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-07T22:02:58.247691] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-07T22:02:58.406983] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-07T22:02:59.047705] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-07T22:02:59.325947] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-07T22:02:59.659872] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-07T22:02:59.847684] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-07T22:03:00.647688] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-07T22:03:01.099339] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T22:03:01.102304] [INFO ] [REMOTE ] TWI: Full fetch complete (52570 records). [2025-10-07T22:03:01.102476] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-07T22:03:01.457435] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-07T22:03:01.520599] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-07T22:03:01.520761] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-07T22:03:01.521791] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-07T22:03:01.521865] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-07T22:03:01.523292] [DEBUG] [LOCAL ] TWI: Trimmed 52570 records to 34116 (keeping 200 days of data) [2025-10-07T22:03:01.723688] [DEBUG] [LOCAL ] TWI: Primary data saved (34116 records). [2025-10-07T22:03:01.723919] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-07T22:03:01.724018] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWI took 26.9s. Estimated remaining: 30m 41s. Rate: 7.1 symbols/min [2025-10-07T22:03:01.898912] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:03:01.899778] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-07T22:03:01.899835] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-07T22:03:01.899965] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-07T22:03:01.900009] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-07T22:03:01.900053] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-07T22:03:01.900087] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-07T22:03:02.194303] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-07T22:03:02.252113] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-07T22:03:02.281067] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:03:02.723231] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-07T22:03:02.764830] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-07T22:03:03.047705] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-07T22:03:03.262343] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T22:03:03.262785] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-07T22:03:03.262879] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T22:03:03.262931] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-07T22:03:03.262994] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T22:03:03.263078] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-07T22:03:03.263149] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-07T22:03:03.263192] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-07T22:03:03.263259] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-07T22:03:03.263332] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWOD took 1.5s. Estimated remaining: 30m 31s. Rate: 7.1 symbols/min [2025-10-07T22:03:03.444890] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:03:03.470668] [DEBUG] [LOCAL ] TX: Loaded 23453 existing records from primary storage. [2025-10-07T22:03:03.470977] [INFO ] [MAIN ] TX: Loaded 23453 existing records. [2025-10-07T22:03:03.653257] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:03:03.653489] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-07T22:03:03.653538] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-07T22:03:03.653797] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-07T22:03:03.653856] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-07T22:03:03.857587] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-07T22:03:04.011834] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:03:04.522073] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T22:03:04.647680] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-07T22:03:05.447754] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-07T22:03:06.247680] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-07T22:03:06.307736] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T22:03:06.739499] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-07T22:03:07.047758] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-07T22:03:07.365103] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T22:03:07.847708] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-07T22:03:08.242634] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T22:03:08.647681] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-07T22:03:08.763989] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-07T22:03:09.447730] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-07T22:03:10.020092] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-07T22:03:10.247732] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-07T22:03:10.643440] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T22:03:10.658584] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-07T22:03:10.659842] [INFO ] [REMOTE ] TWN: Full fetch complete (5407 records). [2025-10-07T22:03:10.660223] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-07T22:03:11.031767] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-07T22:03:11.032083] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-07T22:03:11.032298] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-07T22:03:11.032342] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-07T22:03:11.032898] [DEBUG] [LOCAL ] TWN: Trimmed 5407 records to 3192 (keeping 200 days of data) [2025-10-07T22:03:11.047686] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-07T22:03:11.054467] [DEBUG] [LOCAL ] TWN: Primary data saved (3192 records). [2025-10-07T22:03:11.054551] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-07T22:03:11.054661] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWN took 20.0s. Estimated remaining: 30m 23s. Rate: 7.1 symbols/min [2025-10-07T22:03:11.233447] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:03:11.276522] [DEBUG] [LOCAL ] TXNM: Loaded 43375 existing records from primary storage. [2025-10-07T22:03:11.276940] [INFO ] [MAIN ] TXNM: Loaded 43375 existing records. [2025-10-07T22:03:11.461002] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:03:11.461245] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-07T22:03:11.461307] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-07T22:03:11.461716] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-07T22:03:11.461787] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-07T22:03:11.843706] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:03:11.847608] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-07T22:03:12.647617] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-07T22:03:12.926393] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-07T22:03:13.381749] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T22:03:13.447684] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-07T22:03:14.247628] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-07T22:03:14.313006] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T22:03:14.614395] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T22:03:15.047695] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-07T22:03:15.847623] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-07T22:03:15.987508] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T22:03:16.647672] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-07T22:03:16.721443] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T22:03:17.447625] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-07T22:03:17.739634] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-07T22:03:18.247704] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-07T22:03:18.406533] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-07T22:03:18.860532] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T22:03:19.047698] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-07T22:03:19.847679] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-07T22:03:20.561120] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-07T22:03:20.647619] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-07T22:03:20.895876] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T22:03:21.447637] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-07T22:03:21.535460] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T22:03:22.247680] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-07T22:03:22.790516] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-07T22:03:23.047623] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-07T22:03:23.292293] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T22:03:23.832103] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T22:03:23.847597] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-07T22:03:24.647692] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-07T22:03:24.981810] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T22:03:25.447637] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-07T22:03:25.494627] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T22:03:26.247695] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-07T22:03:26.448312] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T22:03:27.047690] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-07T22:03:27.104189] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T22:03:27.107950] [INFO ] [REMOTE ] TWLO: Full fetch complete (76457 records). [2025-10-07T22:03:27.108093] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-07T22:03:27.528310] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-07T22:03:27.528429] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-07T22:03:27.529877] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-07T22:03:27.529960] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-07T22:03:27.533675] [DEBUG] [LOCAL ] TWLO: Trimmed 76457 records to 52746 (keeping 200 days of data) [2025-10-07T22:03:27.808028] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T22:03:27.859512] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-07T22:03:27.908937] [DEBUG] [LOCAL ] TWLO: Primary data saved (52746 records). [2025-10-07T22:03:27.909102] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-07T22:03:27.909229] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWLO took 37.9s. Estimated remaining: 30m 15s. Rate: 7.1 symbols/min [2025-10-07T22:03:28.080519] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:03:28.102189] [DEBUG] [LOCAL ] TXO: Loaded 19114 existing records from primary storage. [2025-10-07T22:03:28.102481] [INFO ] [MAIN ] TXO: Loaded 19114 existing records. [2025-10-07T22:03:28.288150] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:03:28.288405] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-07T22:03:28.288457] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-07T22:03:28.288681] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-07T22:03:28.288742] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-07T22:03:28.651381] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-07T22:03:28.758762] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:03:28.788224] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T22:03:29.444119] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T22:03:29.453342] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-07T22:03:29.987020] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T22:03:30.247690] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-07T22:03:30.903890] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-07T22:03:30.909138] [INFO ] [REMOTE ] TWO: Full fetch complete (69147 records). [2025-10-07T22:03:30.909425] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-07T22:03:31.052807] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-07T22:03:31.299691] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-07T22:03:31.299789] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-07T22:03:31.300881] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-07T22:03:31.300947] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-07T22:03:31.302338] [DEBUG] [LOCAL ] TWO: Trimmed 69147 records to 48513 (keeping 200 days of data) [2025-10-07T22:03:31.459995] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-07T22:03:31.671999] [DEBUG] [LOCAL ] TWO: Primary data saved (48513 records). [2025-10-07T22:03:31.672187] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-07T22:03:31.672399] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TWO took 38.8s. Estimated remaining: 30m 6s. Rate: 7.1 symbols/min [2025-10-07T22:03:31.847628] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-07T22:03:32.613152] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T22:03:32.647607] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-07T22:03:32.864305] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T22:03:33.447749] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-07T22:03:34.085567] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-07T22:03:34.247698] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-07T22:03:34.518760] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-07T22:03:35.047694] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-07T22:03:35.213970] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-07T22:03:35.847689] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-07T22:03:36.105754] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T22:03:36.647699] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-07T22:03:36.705615] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-07T22:03:37.447611] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-07T22:03:37.850533] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-07T22:03:38.247704] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-07T22:03:38.424159] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T22:03:39.047682] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-07T22:03:39.244468] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-07T22:03:39.847699] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-07T22:03:40.268711] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T22:03:40.271819] [INFO ] [REMOTE ] TXNM: Full fetch complete (62830 records). [2025-10-07T22:03:40.271925] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-07T22:03:40.652985] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-07T22:03:40.653146] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-07T22:03:40.653428] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-07T22:03:40.655250] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-07T22:03:40.655315] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-07T22:03:40.658638] [DEBUG] [LOCAL ] TXNM: Trimmed 62830 records to 43424 (keeping 200 days of data) [2025-10-07T22:03:40.901840] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T22:03:40.962345] [DEBUG] [LOCAL ] TXNM: Primary data saved (43424 records). [2025-10-07T22:03:40.962503] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-07T22:03:40.962612] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXNM took 29.9s. Estimated remaining: 29m 58s. Rate: 7.1 symbols/min [2025-10-07T22:03:41.447768] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-07T22:03:41.624703] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T22:03:42.247744] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-07T22:03:42.413366] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T22:03:42.416983] [INFO ] [REMOTE ] TX: Full fetch complete (35767 records). [2025-10-07T22:03:42.417157] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-07T22:03:42.962392] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-07T22:03:42.980363] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-07T22:03:42.980421] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-07T22:03:42.981269] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-07T22:03:42.981343] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-07T22:03:42.982224] [DEBUG] [LOCAL ] TX: Trimmed 35767 records to 23434 (keeping 200 days of data) [2025-10-07T22:03:43.071284] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-07T22:03:43.131080] [DEBUG] [LOCAL ] TX: Primary data saved (23434 records). [2025-10-07T22:03:43.131222] [INFO ] [MAIN ] TX: Full history saved. [2025-10-07T22:03:43.131319] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TX took 39.9s. Estimated remaining: 29m 49s. Rate: 7.1 symbols/min [2025-10-07T22:03:44.247264] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T22:03:44.253094] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-07T22:03:45.381068] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T22:03:45.387374] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-07T22:03:46.030159] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-07T22:03:46.034688] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-07T22:03:47.062199] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T22:03:47.067754] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-07T22:03:48.133510] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-07T22:03:48.138286] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-07T22:03:48.999995] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T22:03:49.001737] [INFO ] [REMOTE ] TXO: Full fetch complete (26347 records). [2025-10-07T22:03:49.001813] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-07T22:03:49.400071] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-07T22:03:49.400168] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-07T22:03:49.400781] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-07T22:03:49.400852] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-07T22:03:49.401770] [DEBUG] [LOCAL ] TXO: Trimmed 26347 records to 19125 (keeping 200 days of data) [2025-10-07T22:03:49.528638] [DEBUG] [LOCAL ] TXO: Primary data saved (19125 records). [2025-10-07T22:03:49.528907] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-07T22:03:49.529044] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TXO took 21.6s. Estimated remaining: 29m 40s. Rate: 7.1 symbols/min [2025-10-07T22:03:50.101823] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:03:50.283394] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:03:50.305109] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:03:50.327443] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:03:50.346093] [DEBUG] [LOCAL ] TY: Loaded 7552 existing records from primary storage. [2025-10-07T22:03:50.346800] [INFO ] [MAIN ] TY: Loaded 7552 existing records. [2025-10-07T22:03:50.401271] [DEBUG] [LOCAL ] TYG: Loaded 13929 existing records from primary storage. [2025-10-07T22:03:50.469180] [INFO ] [MAIN ] TYG: Loaded 13929 existing records. [2025-10-07T22:03:50.485866] [DEBUG] [LOCAL ] TYL: Loaded 22200 existing records from primary storage. [2025-10-07T22:03:50.540328] [INFO ] [MAIN ] TYL: Loaded 22200 existing records. [2025-10-07T22:03:50.739408] [DEBUG] [LOCAL ] TXT: Loaded 49722 existing records from primary storage. [2025-10-07T22:03:50.799839] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:03:50.811167] [INFO ] [MAIN ] TXT: Loaded 49722 existing records. [2025-10-07T22:03:50.827108] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-07T22:03:50.863600] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-07T22:03:50.938724] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-07T22:03:50.944249] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-07T22:03:51.094489] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:03:51.152247] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-07T22:03:51.146014] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:03:51.200864] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-07T22:03:51.215579] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-07T22:03:51.278826] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-07T22:03:51.278748] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-07T22:03:51.314556] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-07T22:03:51.323828] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-07T22:03:51.381028] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-07T22:03:51.818322] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:03:51.907413] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-07T22:03:52.121005] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-07T22:03:52.264136] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-07T22:03:52.325525] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-07T22:03:52.337307] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:03:52.409933] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-07T22:03:52.541492] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:03:52.555074] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-07T22:03:52.795146] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:03:52.812798] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-07T22:03:52.962521] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:03:52.962939] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-07T22:03:53.345847] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T22:03:53.348787] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-07T22:03:53.540664] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-07T22:03:53.544228] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-07T22:03:53.747891] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T22:03:53.752884] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-07T22:03:54.111065] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T22:03:54.113807] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-07T22:03:54.679911] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T22:03:54.690881] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-07T22:03:54.742327] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-07T22:03:54.754392] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T22:03:54.769714] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-07T22:03:55.047690] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-07T22:03:55.781746] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-07T22:03:55.847640] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-07T22:03:56.366460] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T22:03:56.615263] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-07T22:03:56.647597] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-07T22:03:57.378143] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T22:03:57.447609] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-07T22:03:58.247763] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-07T22:03:59.047636] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-07T22:03:59.163541] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T22:03:59.195097] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T22:03:59.847635] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-07T22:04:00.164238] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T22:04:00.647610] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-07T22:04:00.897712] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-07T22:04:01.443950] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-07T22:04:01.447585] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-07T22:04:02.247693] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-07T22:04:02.346532] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-07T22:04:03.047675] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-07T22:04:03.788437] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-07T22:04:03.847635] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-07T22:04:04.137476] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T22:04:04.520544] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-07T22:04:04.647604] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-07T22:04:05.447698] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-07T22:04:05.631032] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T22:04:06.247747] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-07T22:04:06.714016] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T22:04:07.001228] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-07T22:04:07.047695] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-07T22:04:07.847630] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-07T22:04:07.973477] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T22:04:08.647717] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-07T22:04:09.447674] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-07T22:04:09.693745] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T22:04:10.110574] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T22:04:10.247631] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-07T22:04:10.439926] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-07T22:04:11.047706] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-07T22:04:11.420940] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T22:04:11.563959] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T22:04:11.565236] [INFO ] [REMOTE ] TY: Full fetch complete (11598 records). [2025-10-07T22:04:11.565310] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-07T22:04:11.853252] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-07T22:04:11.946387] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-07T22:04:11.946556] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-07T22:04:11.946957] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-07T22:04:11.947034] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-07T22:04:11.947662] [DEBUG] [LOCAL ] TY: Trimmed 11598 records to 7612 (keeping 200 days of data) [2025-10-07T22:04:12.006604] [DEBUG] [LOCAL ] TY: Primary data saved (7612 records). [2025-10-07T22:04:12.006854] [INFO ] [MAIN ] TY: Full history saved. [2025-10-07T22:04:12.006971] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 22.5s. Estimated remaining: 29m 33s. Rate: 7.1 symbols/min [2025-10-07T22:04:12.187404] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:04:12.250587] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-07T22:04:12.251219] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-07T22:04:12.439914] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:04:12.440245] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-07T22:04:12.440298] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-07T22:04:12.441817] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-07T22:04:12.441888] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-07T22:04:12.652810] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-07T22:04:12.817264] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:04:13.447730] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-07T22:04:13.673423] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T22:04:13.709615] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-07T22:04:14.247678] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-07T22:04:14.382753] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T22:04:15.047713] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-07T22:04:15.597709] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-07T22:04:15.847682] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-07T22:04:16.405756] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-07T22:04:16.647628] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-07T22:04:16.972206] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T22:04:17.447679] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-07T22:04:18.247611] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-07T22:04:18.427255] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T22:04:18.598676] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T22:04:18.784030] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-07T22:04:19.047681] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-07T22:04:19.417901] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-07T22:04:19.419945] [INFO ] [REMOTE ] TYL: Full fetch complete (31441 records). [2025-10-07T22:04:19.420024] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-07T22:04:19.789675] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-07T22:04:19.789771] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-07T22:04:19.790432] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-07T22:04:19.790527] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-07T22:04:19.791413] [DEBUG] [LOCAL ] TYL: Trimmed 31441 records to 22251 (keeping 200 days of data) [2025-10-07T22:04:19.853843] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-07T22:04:19.935705] [DEBUG] [LOCAL ] TYL: Primary data saved (22251 records). [2025-10-07T22:04:19.935851] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-07T22:04:19.935952] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYL took 30.4s. Estimated remaining: 29m 25s. Rate: 7.1 symbols/min [2025-10-07T22:04:20.108421] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:04:20.152205] [DEBUG] [LOCAL ] UA: Loaded 50458 existing records from primary storage. [2025-10-07T22:04:20.152558] [INFO ] [MAIN ] UA: Loaded 50458 existing records. [2025-10-07T22:04:20.329864] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:04:20.330148] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-07T22:04:20.330203] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-07T22:04:20.331459] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-07T22:04:20.331521] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-07T22:04:20.657165] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-07T22:04:20.688596] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:04:21.328044] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T22:04:21.329278] [INFO ] [REMOTE ] TYG: Full fetch complete (22425 records). [2025-10-07T22:04:21.329349] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-07T22:04:21.449942] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-07T22:04:21.715231] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-07T22:04:21.715354] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-07T22:04:21.715925] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-07T22:04:21.716065] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-07T22:04:21.726728] [DEBUG] [LOCAL ] TYG: Trimmed 22425 records to 13917 (keeping 200 days of data) [2025-10-07T22:04:21.745189] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-07T22:04:21.847609] [DEBUG] [LOCAL ] TYG: Primary data saved (13917 records). [2025-10-07T22:04:21.847798] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-07T22:04:21.847895] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYG took 32.3s. Estimated remaining: 29m 16s. Rate: 7.1 symbols/min [2025-10-07T22:04:22.020717] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:04:22.072093] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-10-07T22:04:22.072474] [INFO ] [MAIN ] UAA: Loaded 53509 existing records. [2025-10-07T22:04:22.257047] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-07T22:04:22.263366] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:04:22.263999] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-07T22:04:22.264789] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-07T22:04:22.266452] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-07T22:04:22.266518] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-07T22:04:22.629785] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:04:23.050954] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-07T22:04:23.054086] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T22:04:23.847684] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-07T22:04:24.647624] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-07T22:04:24.704349] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T22:04:24.753593] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-07T22:04:25.361762] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T22:04:25.447719] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-07T22:04:26.248689] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-07T22:04:26.250298] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T22:04:27.047690] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-07T22:04:27.287435] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-07T22:04:27.847687] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-07T22:04:28.378542] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-07T22:04:28.647724] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-07T22:04:28.698548] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T22:04:29.135624] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T22:04:29.139040] [INFO ] [REMOTE ] TXT: Full fetch complete (72286 records). [2025-10-07T22:04:29.139149] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-07T22:04:29.449147] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-07T22:04:29.525125] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-07T22:04:29.525214] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-07T22:04:29.526286] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-07T22:04:29.526354] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-07T22:04:29.527861] [DEBUG] [LOCAL ] TXT: Trimmed 72286 records to 49726 (keeping 200 days of data) [2025-10-07T22:04:29.801345] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-07T22:04:29.891179] [DEBUG] [LOCAL ] TXT: Primary data saved (49726 records). [2025-10-07T22:04:29.891332] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-07T22:04:29.891432] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TXT took 40.4s. Estimated remaining: 29m 7s. Rate: 7.1 symbols/min [2025-10-07T22:04:30.064130] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:04:30.071549] [DEBUG] [LOCAL ] UAN: Loaded 5444 existing records from primary storage. [2025-10-07T22:04:30.071792] [INFO ] [MAIN ] UAN: Loaded 5444 existing records. [2025-10-07T22:04:30.248631] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-07T22:04:30.252574] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:04:30.252847] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-07T22:04:30.252948] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-07T22:04:30.253968] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-07T22:04:30.254030] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-07T22:04:30.597339] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:04:31.047745] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-07T22:04:31.847709] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-07T22:04:31.922175] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-07T22:04:32.224254] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T22:04:32.240503] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T22:04:32.647726] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-07T22:04:33.447628] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-07T22:04:33.770036] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T22:04:34.153696] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-07T22:04:34.247767] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-07T22:04:34.481992] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T22:04:35.047743] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-07T22:04:35.847723] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-07T22:04:36.519754] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-07T22:04:36.647752] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-07T22:04:37.080727] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-07T22:04:37.447638] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-07T22:04:37.552076] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T22:04:38.247682] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-07T22:04:38.930434] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-07T22:04:39.047725] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-07T22:04:39.266275] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T22:04:39.690865] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T22:04:39.730788] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T22:04:39.847616] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-07T22:04:40.330212] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T22:04:40.647693] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-07T22:04:41.447727] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-07T22:04:42.247687] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-07T22:04:42.323630] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T22:04:43.047704] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-07T22:04:43.855604] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-07T22:04:43.859791] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-07T22:04:43.972328] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T22:04:44.647434] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T22:04:44.648323] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-07T22:04:45.015698] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-07T22:04:45.447746] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-07T22:04:46.247747] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-07T22:04:46.267171] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-07T22:04:47.012231] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-07T22:04:47.047665] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-07T22:04:47.847669] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-07T22:04:48.417081] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-07T22:04:48.647748] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-07T22:04:49.447707] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-07T22:04:49.582698] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-07T22:04:49.690209] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T22:04:50.058975] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T22:04:50.204255] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T22:04:50.247634] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-07T22:04:51.047699] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-07T22:04:51.839688] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-07T22:04:51.844212] [INFO ] [REMOTE ] UAA: Full fetch complete (77485 records). [2025-10-07T22:04:51.844487] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-07T22:04:51.858000] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-07T22:04:52.269781] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-07T22:04:52.269888] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-07T22:04:52.271562] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-07T22:04:52.271665] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-07T22:04:52.273726] [DEBUG] [LOCAL ] UAA: Trimmed 77485 records to 53509 (keeping 200 days of data) [2025-10-07T22:04:52.518542] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-07T22:04:52.633274] [DEBUG] [LOCAL ] UAA: Primary data saved (53509 records). [2025-10-07T22:04:52.633477] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-07T22:04:52.633577] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UAA took 30.8s. Estimated remaining: 29m 0s. Rate: 7.1 symbols/min [2025-10-07T22:04:52.654937] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-07T22:04:52.814683] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:04:52.875747] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-07T22:04:52.876328] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-07T22:04:53.113175] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:04:53.117049] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-07T22:04:53.128889] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-07T22:04:53.129584] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-07T22:04:53.130226] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-07T22:04:53.130304] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-07T22:04:53.452856] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-07T22:04:53.531698] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:04:54.247729] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-07T22:04:54.888234] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-07T22:04:55.047628] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-07T22:04:55.071840] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-07T22:04:55.076002] [INFO ] [REMOTE ] UA: Full fetch complete (72976 records). [2025-10-07T22:04:55.076188] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-07T22:04:55.439002] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-10-07T22:04:55.524662] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-07T22:04:55.557183] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-07T22:04:55.557275] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-07T22:04:55.558379] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-07T22:04:55.558446] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-07T22:04:55.560007] [DEBUG] [LOCAL ] UA: Trimmed 72976 records to 50453 (keeping 200 days of data) [2025-10-07T22:04:55.847839] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-07T22:04:55.865479] [DEBUG] [LOCAL ] UA: Primary data saved (50453 records). [2025-10-07T22:04:55.865621] [INFO ] [MAIN ] UA: Full history saved. [2025-10-07T22:04:55.865744] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UA took 35.9s. Estimated remaining: 28m 51s. Rate: 7.1 symbols/min [2025-10-07T22:04:56.036915] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:04:56.089547] [DEBUG] [LOCAL ] UBS: Loaded 52358 existing records from primary storage. [2025-10-07T22:04:56.089955] [INFO ] [MAIN ] UBS: Loaded 52358 existing records. [2025-10-07T22:04:56.270140] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:04:56.270363] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-07T22:04:56.270411] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-07T22:04:56.271799] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-07T22:04:56.271860] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-07T22:04:56.621484] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:04:56.647602] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-07T22:04:57.447707] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-07T22:04:58.247706] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-07T22:04:58.301393] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-07T22:04:58.459048] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-07T22:04:58.703002] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T22:04:58.703955] [INFO ] [REMOTE ] UAN: Full fetch complete (8088 records). [2025-10-07T22:04:58.704024] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-07T22:04:59.051383] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-07T22:04:59.051108] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-07T22:04:59.051510] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-07T22:04:59.051982] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-07T22:04:59.052057] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-07T22:04:59.053629] [DEBUG] [LOCAL ] UAN: Trimmed 8088 records to 5439 (keeping 200 days of data) [2025-10-07T22:04:59.090310] [DEBUG] [LOCAL ] UAN: Primary data saved (5439 records). [2025-10-07T22:04:59.090446] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-07T22:04:59.090540] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UAN took 29.2s. Estimated remaining: 28m 42s. Rate: 7.1 symbols/min [2025-10-07T22:04:59.254115] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:04:59.254356] [DEBUG] [LOCAL ] UCB: No existing data file found in primary storage. [2025-10-07T22:04:59.254422] [WARN ] [MAIN ] UCB: No existing data found, performing full refresh instead. [2025-10-07T22:04:59.254622] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-07T22:04:59.254702] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-07T22:04:59.254787] [DEBUG] [LOCAL ] UCB: No primary data file found to delete. [2025-10-07T22:04:59.254832] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-07T22:04:59.618446] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:04:59.655247] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-07T22:04:59.847684] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-07T22:05:00.647692] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-07T22:05:01.447758] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-07T22:05:01.664221] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-07T22:05:02.048178] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-07T22:05:02.052892] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-07T22:05:02.053089] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-07T22:05:02.247706] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-07T22:05:02.559424] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-07T22:05:02.559784] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-07T22:05:02.561048] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-07T22:05:02.561126] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-07T22:05:02.563020] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-10-07T22:05:02.907801] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-07T22:05:02.907986] [INFO ] [MAIN ] U: Full history saved. [2025-10-07T22:05:02.908080] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. U took 50.9s. Estimated remaining: 28m 33s. Rate: 7.1 symbols/min [2025-10-07T22:05:03.084900] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:05:03.158446] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T22:05:03.168284] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-07T22:05:03.172348] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-07T22:05:03.225454] [DEBUG] [LOCAL ] UDR: Loaded 51872 existing records from primary storage. [2025-10-07T22:05:03.225824] [INFO ] [MAIN ] UDR: Loaded 51872 existing records. [2025-10-07T22:05:03.400174] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:05:03.400453] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-07T22:05:03.400505] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-07T22:05:03.402169] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-07T22:05:03.402234] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-07T22:05:03.748862] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:05:03.847600] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-07T22:05:04.647751] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-07T22:05:04.753694] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T22:05:04.833286] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-07T22:05:05.077197] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-07T22:05:05.447710] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-07T22:05:06.133870] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T22:05:06.247613] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-07T22:05:06.429285] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-07T22:05:07.047710] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-07T22:05:07.847709] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-07T22:05:08.297276] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-07T22:05:08.647711] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-07T22:05:08.716332] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T22:05:09.447692] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-07T22:05:10.169777] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-07T22:05:10.247604] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-07T22:05:10.531994] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T22:05:11.047675] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-07T22:05:11.110203] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T22:05:11.847717] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-07T22:05:12.573616] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T22:05:12.647623] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-07T22:05:12.718472] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-07T22:05:13.447609] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-07T22:05:13.720426] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T22:05:14.103202] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-07T22:05:14.247717] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-07T22:05:15.047711] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-07T22:05:15.141442] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T22:05:15.667810] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-07T22:05:15.847719] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-07T22:05:16.647729] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-07T22:05:17.447685] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-07T22:05:17.515694] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-07T22:05:17.631090] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T22:05:18.156199] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T22:05:18.247617] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-07T22:05:19.012153] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T22:05:19.047627] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-07T22:05:19.726008] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-07T22:05:19.847734] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-07T22:05:20.647730] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-07T22:05:20.951029] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T22:05:21.447715] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-07T22:05:21.822850] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-07T22:05:22.247686] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-07T22:05:22.357506] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-07T22:05:23.047625] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-07T22:05:23.366255] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-07T22:05:23.847622] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-07T22:05:23.898498] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T22:05:24.331436] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T22:05:24.647727] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-07T22:05:25.447701] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-07T22:05:25.544942] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T22:05:26.247635] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-07T22:05:27.047697] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-07T22:05:27.433549] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-10-07T22:05:27.793113] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-07T22:05:27.796840] [INFO ] [REMOTE ] UBS: Full fetch complete (75719 records). [2025-10-07T22:05:27.797012] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-07T22:05:27.861034] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-07T22:05:28.217115] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-07T22:05:28.213304] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T22:05:28.217588] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-07T22:05:28.219706] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-07T22:05:28.221381] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-07T22:05:28.222732] [INFO ] [REMOTE ] UCB: Full fetch complete (54782 records). [2025-10-07T22:05:28.222973] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-07T22:05:28.305916] [DEBUG] [LOCAL ] UBS: Trimmed 75719 records to 52354 (keeping 200 days of data) [2025-10-07T22:05:28.480343] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-07T22:05:28.650021] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-07T22:05:28.796488] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-07T22:05:28.799665] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-07T22:05:28.802114] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-07T22:05:28.802220] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-07T22:05:28.808959] [DEBUG] [LOCAL ] UCB: Trimmed 54782 records to 37828 (keeping 200 days of data) [2025-10-07T22:05:29.230570] [DEBUG] [LOCAL ] UBS: Primary data saved (52354 records). [2025-10-07T22:05:29.231492] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-07T22:05:29.231881] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBS took 33.4s. Estimated remaining: 28m 27s. Rate: 7.1 symbols/min [2025-10-07T22:05:29.412486] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:05:29.441218] [DEBUG] [LOCAL ] UCB: Primary data saved (37828 records). [2025-10-07T22:05:29.441373] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-07T22:05:29.441455] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UCB took 30.4s. Estimated remaining: 28m 17s. Rate: 7.1 symbols/min [2025-10-07T22:05:29.532811] [DEBUG] [LOCAL ] UE: Loaded 42666 existing records from primary storage. [2025-10-07T22:05:29.571176] [INFO ] [MAIN ] UE: Loaded 42666 existing records. [2025-10-07T22:05:29.700025] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:05:29.801697] [DEBUG] [LOCAL ] UFI: Loaded 8150 existing records from primary storage. [2025-10-07T22:05:29.822924] [INFO ] [MAIN ] UFI: Loaded 8150 existing records. [2025-10-07T22:05:29.912410] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:05:29.948954] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-07T22:05:29.966192] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-07T22:05:30.003195] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-07T22:05:30.049237] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-07T22:05:30.083571] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-07T22:05:30.133341] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:05:30.226026] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-07T22:05:30.233805] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-07T22:05:30.237637] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-07T22:05:30.244852] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-07T22:05:30.293944] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-07T22:05:30.710687] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:05:30.778213] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-07T22:05:30.921964] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:05:31.047625] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-07T22:05:31.175972] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-07T22:05:31.856163] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-07T22:05:31.879024] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T22:05:31.910577] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T22:05:32.398070] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T22:05:32.647700] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-07T22:05:33.420272] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T22:05:33.447617] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-07T22:05:33.923207] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T22:05:33.926951] [INFO ] [REMOTE ] UDR: Full fetch complete (74686 records). [2025-10-07T22:05:33.927081] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-07T22:05:34.249912] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-07T22:05:34.333615] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-07T22:05:34.333807] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-07T22:05:34.334911] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-07T22:05:34.334993] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-07T22:05:34.336743] [DEBUG] [LOCAL ] UDR: Trimmed 74686 records to 51890 (keeping 200 days of data) [2025-10-07T22:05:34.469802] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-07T22:05:34.709218] [DEBUG] [LOCAL ] UDR: Primary data saved (51890 records). [2025-10-07T22:05:34.709372] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-07T22:05:34.709489] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UDR took 31.8s. Estimated remaining: 28m 9s. Rate: 7.1 symbols/min [2025-10-07T22:05:34.878220] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:05:34.928369] [DEBUG] [LOCAL ] UGI: Loaded 50537 existing records from primary storage. [2025-10-07T22:05:34.928869] [INFO ] [MAIN ] UGI: Loaded 50537 existing records. [2025-10-07T22:05:35.052759] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-07T22:05:35.110849] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:05:35.111139] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-07T22:05:35.111205] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-07T22:05:35.111425] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-07T22:05:35.111485] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-07T22:05:35.483674] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:05:35.774406] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T22:05:35.847611] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-07T22:05:35.977698] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-07T22:05:36.647714] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-07T22:05:37.149106] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T22:05:37.152797] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-07T22:05:37.152942] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-07T22:05:37.452692] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-07T22:05:37.480126] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T22:05:37.593929] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-07T22:05:37.594014] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-07T22:05:37.595135] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-07T22:05:37.595203] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-07T22:05:37.596765] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-10-07T22:05:37.927876] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-07T22:05:37.928023] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-07T22:05:37.928134] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UBER took 45.3s. Estimated remaining: 27m 60s. Rate: 7.1 symbols/min [2025-10-07T22:05:38.128507] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:05:38.167839] [DEBUG] [LOCAL ] UGP: Loaded 42832 existing records from primary storage. [2025-10-07T22:05:38.168155] [INFO ] [MAIN ] UGP: Loaded 42832 existing records. [2025-10-07T22:05:38.252836] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-07T22:05:38.350778] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:05:38.351107] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-07T22:05:38.357089] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-07T22:05:38.357913] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T22:05:38.357950] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-07T22:05:38.358097] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-07T22:05:38.709727] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:05:39.047690] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-07T22:05:39.692103] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T22:05:39.847635] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-07T22:05:40.647744] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-07T22:05:40.726486] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T22:05:41.447711] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-07T22:05:41.601860] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T22:05:42.197826] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-07T22:05:42.247744] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-07T22:05:42.389129] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T22:05:43.047698] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-07T22:05:43.770429] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T22:05:43.847635] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-07T22:05:43.930963] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-07T22:05:44.647734] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-07T22:05:45.101322] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T22:05:45.118330] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-07T22:05:45.447744] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-07T22:05:46.247694] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-07T22:05:46.957002] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T22:05:47.047629] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-07T22:05:47.123438] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T22:05:47.847686] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-07T22:05:48.378165] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-07T22:05:48.647733] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-07T22:05:49.352563] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T22:05:49.447702] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-07T22:05:50.247689] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-07T22:05:50.291831] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T22:05:51.015461] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T22:05:51.047610] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-07T22:05:51.847721] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-07T22:05:51.915369] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-07T22:05:52.360458] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-07T22:05:52.647710] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-07T22:05:53.295750] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T22:05:53.447639] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-07T22:05:54.255939] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-07T22:05:54.273839] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T22:05:55.047709] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-07T22:05:55.260112] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T22:05:55.705010] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T22:05:55.847634] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-07T22:05:56.446070] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T22:05:56.647717] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-07T22:05:57.045964] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T22:05:57.050909] [INFO ] [REMOTE ] UE: Full fetch complete (61289 records). [2025-10-07T22:05:57.051055] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-07T22:05:57.448299] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-07T22:05:57.448735] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-07T22:05:57.450031] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-07T22:05:57.451050] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-07T22:05:57.451212] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-07T22:05:57.452497] [DEBUG] [LOCAL ] UE: Trimmed 61289 records to 42693 (keeping 200 days of data) [2025-10-07T22:05:57.723315] [DEBUG] [LOCAL ] UE: Primary data saved (42693 records). [2025-10-07T22:05:57.723461] [INFO ] [MAIN ] UE: Full history saved. [2025-10-07T22:05:57.723552] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UE took 28.5s. Estimated remaining: 27m 52s. Rate: 7.1 symbols/min [2025-10-07T22:05:57.887393] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:05:57.906728] [DEBUG] [LOCAL ] UHAL: Loaded 16673 existing records from primary storage. [2025-10-07T22:05:57.907004] [INFO ] [MAIN ] UHAL: Loaded 16673 existing records. [2025-10-07T22:05:58.090547] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:05:58.090892] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-07T22:05:58.090943] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-07T22:05:58.091155] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-07T22:05:58.091212] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-07T22:05:58.196203] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T22:05:58.253889] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-07T22:05:58.456278] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:05:58.486271] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T22:05:59.031393] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-07T22:05:59.047609] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-07T22:05:59.808321] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T22:05:59.847670] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-07T22:06:00.647623] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-07T22:06:00.866068] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T22:06:01.447741] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-07T22:06:02.247625] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-07T22:06:02.601206] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-07T22:06:03.047622] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-07T22:06:03.101520] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T22:06:03.250798] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-07T22:06:03.622665] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T22:06:03.623930] [INFO ] [REMOTE ] UFI: Full fetch complete (12478 records). [2025-10-07T22:06:03.624000] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-07T22:06:03.857888] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-07T22:06:03.994823] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-07T22:06:03.994907] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-07T22:06:03.995238] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-07T22:06:03.995279] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-07T22:06:03.995774] [DEBUG] [LOCAL ] UFI: Trimmed 12478 records to 8117 (keeping 200 days of data) [2025-10-07T22:06:04.045681] [DEBUG] [LOCAL ] UFI: Primary data saved (8117 records). [2025-10-07T22:06:04.045807] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-07T22:06:04.045888] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UFI took 34.6s. Estimated remaining: 27m 44s. Rate: 7.1 symbols/min [2025-10-07T22:06:04.215468] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:06:04.264339] [DEBUG] [LOCAL ] UHS: Loaded 40758 existing records from primary storage. [2025-10-07T22:06:04.264677] [INFO ] [MAIN ] UHS: Loaded 40758 existing records. [2025-10-07T22:06:04.443867] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:06:04.444203] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-07T22:06:04.444257] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-07T22:06:04.445188] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-07T22:06:04.445249] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-07T22:06:04.652762] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-07T22:06:04.811731] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-07T22:06:04.817233] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:06:05.447688] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-07T22:06:06.247705] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-07T22:06:06.497547] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T22:06:06.947905] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T22:06:07.047729] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-07T22:06:07.828994] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T22:06:07.847620] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-07T22:06:07.961042] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T22:06:08.647694] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-07T22:06:09.400614] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-07T22:06:09.447605] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-07T22:06:09.591364] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-07T22:06:10.247695] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-07T22:06:11.011943] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T22:06:11.047606] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-07T22:06:11.261891] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T22:06:11.847693] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-07T22:06:12.647623] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-07T22:06:12.745677] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T22:06:12.864485] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T22:06:13.447701] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-07T22:06:14.247763] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-07T22:06:14.289289] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T22:06:15.047633] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-07T22:06:15.225157] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T22:06:15.847631] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-07T22:06:15.920127] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T22:06:16.180622] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T22:06:16.647698] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-07T22:06:17.447640] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-07T22:06:17.619664] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-07T22:06:18.151023] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T22:06:18.247683] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-07T22:06:18.467339] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T22:06:18.471475] [INFO ] [REMOTE ] UGP: Full fetch complete (62181 records). [2025-10-07T22:06:18.471694] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-07T22:06:18.863991] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-07T22:06:18.864075] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-07T22:06:18.865151] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-07T22:06:18.865214] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-07T22:06:18.866460] [DEBUG] [LOCAL ] UGP: Trimmed 62181 records to 42867 (keeping 200 days of data) [2025-10-07T22:06:19.049849] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-07T22:06:19.129083] [DEBUG] [LOCAL ] UGP: Primary data saved (42867 records). [2025-10-07T22:06:19.129214] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-07T22:06:19.129296] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGP took 41.2s. Estimated remaining: 27m 36s. Rate: 7.1 symbols/min [2025-10-07T22:06:19.306274] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:06:19.319034] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T22:06:19.332015] [DEBUG] [LOCAL ] UHT: Loaded 9990 existing records from primary storage. [2025-10-07T22:06:19.332216] [INFO ] [MAIN ] UHT: Loaded 9990 existing records. [2025-10-07T22:06:19.504558] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:06:19.504877] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-07T22:06:19.504936] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-07T22:06:19.505159] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-07T22:06:19.505215] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-07T22:06:19.849987] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-07T22:06:19.853713] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:06:20.482831] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T22:06:20.487228] [INFO ] [REMOTE ] UGI: Full fetch complete (73311 records). [2025-10-07T22:06:20.487381] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-07T22:06:20.660854] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-07T22:06:20.819730] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-07T22:06:20.919191] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-07T22:06:20.919298] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-07T22:06:20.920363] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-07T22:06:20.920428] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-07T22:06:20.922165] [DEBUG] [LOCAL ] UGI: Trimmed 73311 records to 50531 (keeping 200 days of data) [2025-10-07T22:06:21.237392] [DEBUG] [LOCAL ] UGI: Primary data saved (50531 records). [2025-10-07T22:06:21.237551] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-07T22:06:21.237678] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UGI took 46.5s. Estimated remaining: 27m 27s. Rate: 7.1 symbols/min [2025-10-07T22:06:21.407467] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:06:21.422770] [DEBUG] [LOCAL ] UI: Loaded 13266 existing records from primary storage. [2025-10-07T22:06:21.423014] [INFO ] [MAIN ] UI: Loaded 13266 existing records. [2025-10-07T22:06:21.453500] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-07T22:06:21.614543] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T22:06:21.619736] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:06:21.620046] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-07T22:06:21.623608] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-07T22:06:21.623926] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-07T22:06:21.623987] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-07T22:06:21.990897] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:06:22.247712] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-07T22:06:23.058045] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-07T22:06:23.077927] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T22:06:23.126108] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T22:06:23.847912] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-07T22:06:23.851788] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T22:06:24.647631] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-07T22:06:24.715249] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-07T22:06:25.447671] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-07T22:06:25.516273] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-07T22:06:25.517906] [INFO ] [REMOTE ] UHAL: Full fetch complete (23267 records). [2025-10-07T22:06:25.517976] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-07T22:06:25.895628] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-07T22:06:25.895739] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-07T22:06:25.896243] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-07T22:06:25.896284] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-07T22:06:25.896963] [DEBUG] [LOCAL ] UHAL: Trimmed 23267 records to 16716 (keeping 200 days of data) [2025-10-07T22:06:25.999324] [DEBUG] [LOCAL ] UHAL: Primary data saved (16716 records). [2025-10-07T22:06:25.999504] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-07T22:06:25.999661] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UHAL took 28.3s. Estimated remaining: 27m 18s. Rate: 7.1 symbols/min [2025-10-07T22:06:26.172739] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:06:26.206614] [DEBUG] [LOCAL ] UIS: Loaded 37035 existing records from primary storage. [2025-10-07T22:06:26.206957] [INFO ] [MAIN ] UIS: Loaded 37035 existing records. [2025-10-07T22:06:26.249350] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-07T22:06:26.389507] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:06:26.389813] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-07T22:06:26.389865] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-07T22:06:26.390103] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-07T22:06:26.390161] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-07T22:06:26.546118] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T22:06:26.769613] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:06:27.047691] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-07T22:06:27.847626] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-07T22:06:27.885544] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-07T22:06:27.975955] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-07T22:06:28.608853] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T22:06:28.647611] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-07T22:06:29.447697] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-07T22:06:30.064791] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T22:06:30.247636] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-07T22:06:31.030744] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T22:06:31.047640] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-07T22:06:31.560520] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-07T22:06:31.649605] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-07T22:06:31.847639] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-07T22:06:32.647630] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-07T22:06:32.891437] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-07T22:06:33.007415] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-07T22:06:33.447623] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-07T22:06:34.247613] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-07T22:06:34.664542] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-07T22:06:34.677514] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-07T22:06:34.680158] [INFO ] [REMOTE ] UHS: Full fetch complete (58305 records). [2025-10-07T22:06:34.680247] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-07T22:06:35.051851] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-07T22:06:35.073146] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-07T22:06:35.073222] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-07T22:06:35.074458] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-07T22:06:35.074624] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-07T22:06:35.077355] [DEBUG] [LOCAL ] UHS: Trimmed 58305 records to 40668 (keeping 200 days of data) [2025-10-07T22:06:35.436320] [DEBUG] [LOCAL ] UHS: Primary data saved (40668 records). [2025-10-07T22:06:35.436548] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-07T22:06:35.436801] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 31.4s. Estimated remaining: 27m 10s. Rate: 7.1 symbols/min [2025-10-07T22:06:35.657115] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:06:35.717954] [DEBUG] [LOCAL ] UL: Loaded 53070 existing records from primary storage. [2025-10-07T22:06:35.718477] [INFO ] [MAIN ] UL: Loaded 53070 existing records. [2025-10-07T22:06:35.853046] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-07T22:06:35.940418] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:06:35.941231] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-07T22:06:35.941495] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-07T22:06:35.941847] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-07T22:06:35.941911] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-07T22:06:36.091149] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T22:06:36.328847] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:06:36.647749] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-07T22:06:36.820377] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T22:06:37.447704] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-07T22:06:38.168785] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T22:06:38.247665] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-07T22:06:38.328058] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-07T22:06:39.033832] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-07T22:06:39.047610] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-07T22:06:39.847724] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-07T22:06:40.010146] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-07T22:06:40.647744] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-07T22:06:41.447729] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-07T22:06:41.456601] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T22:06:41.687456] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T22:06:42.247682] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-07T22:06:42.583062] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-07T22:06:43.047704] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-07T22:06:43.731479] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-07T22:06:43.847747] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-07T22:06:44.647759] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-07T22:06:44.805963] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T22:06:45.310204] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-07T22:06:45.416605] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T22:06:45.447609] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-07T22:06:46.247627] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-07T22:06:47.047750] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-07T22:06:47.082131] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-07T22:06:47.390447] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-07T22:06:47.847707] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-07T22:06:48.445112] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T22:06:48.635108] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T22:06:48.647663] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-07T22:06:49.418834] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T22:06:49.447616] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-07T22:06:50.161562] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-07T22:06:50.247677] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-07T22:06:50.917393] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T22:06:50.919189] [INFO ] [REMOTE ] UHT: Full fetch complete (15031 records). [2025-10-07T22:06:50.919269] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-07T22:06:51.052780] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-07T22:06:51.312893] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-07T22:06:51.313009] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-07T22:06:51.313747] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-07T22:06:51.313818] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-07T22:06:51.314590] [DEBUG] [LOCAL ] UHT: Trimmed 15031 records to 10020 (keeping 200 days of data) [2025-10-07T22:06:51.386156] [DEBUG] [LOCAL ] UHT: Primary data saved (10020 records). [2025-10-07T22:06:51.386379] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-07T22:06:51.386580] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UHT took 32.3s. Estimated remaining: 27m 2s. Rate: 7.1 symbols/min [2025-10-07T22:06:51.616998] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:06:51.663079] [DEBUG] [LOCAL ] ULS: Loaded 39399 existing records from primary storage. [2025-10-07T22:06:51.663550] [INFO ] [MAIN ] ULS: Loaded 39399 existing records. [2025-10-07T22:06:51.847447] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:06:51.847634] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-07T22:06:51.848179] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-07T22:06:51.849405] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-07T22:06:51.849941] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-07T22:06:51.850007] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-07T22:06:52.014227] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-07T22:06:52.083331] [INFO ] [REMOTE ] UI: Full fetch complete (18682 records). [2025-10-07T22:06:52.096075] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-07T22:06:52.422963] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:06:52.626298] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-07T22:06:52.626377] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-07T22:06:52.626901] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-07T22:06:52.626978] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-07T22:06:52.627518] [DEBUG] [LOCAL ] UI: Trimmed 18682 records to 13335 (keeping 200 days of data) [2025-10-07T22:06:52.664136] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-07T22:06:52.719171] [DEBUG] [LOCAL ] UI: Primary data saved (13335 records). [2025-10-07T22:06:52.719337] [INFO ] [MAIN ] UI: Full history saved. [2025-10-07T22:06:52.719434] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UI took 31.5s. Estimated remaining: 26m 53s. Rate: 7.1 symbols/min [2025-10-07T22:06:52.882484] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:06:52.935766] [DEBUG] [LOCAL ] UMC: Loaded 52712 existing records from primary storage. [2025-10-07T22:06:52.936100] [INFO ] [MAIN ] UMC: Loaded 52712 existing records. [2025-10-07T22:06:53.109169] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:06:53.109418] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-07T22:06:53.109466] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-07T22:06:53.109880] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-07T22:06:53.109937] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-07T22:06:53.456744] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-07T22:06:53.460457] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:06:53.894704] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-07T22:06:54.032815] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-07T22:06:54.247684] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-07T22:06:54.592397] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-07T22:06:55.047691] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-07T22:06:55.819605] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T22:06:55.847617] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-07T22:06:56.477730] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T22:06:56.647693] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-07T22:06:57.447666] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-07T22:06:57.726852] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T22:06:57.783424] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T22:06:58.247708] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-07T22:06:58.326360] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T22:06:59.047695] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-07T22:06:59.373020] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T22:06:59.377622] [INFO ] [REMOTE ] UIS: Full fetch complete (51898 records). [2025-10-07T22:06:59.378151] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-07T22:06:59.771334] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-07T22:06:59.771495] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-07T22:06:59.772493] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-07T22:06:59.772559] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-07T22:06:59.773767] [DEBUG] [LOCAL ] UIS: Trimmed 51898 records to 36972 (keeping 200 days of data) [2025-10-07T22:06:59.855624] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-07T22:06:59.990151] [DEBUG] [LOCAL ] UIS: Primary data saved (36972 records). [2025-10-07T22:06:59.990304] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-07T22:06:59.990418] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 34.0s. Estimated remaining: 26m 44s. Rate: 7.1 symbols/min [2025-10-07T22:07:00.155112] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:07:00.192826] [DEBUG] [LOCAL ] UMH: Loaded 33730 existing records from primary storage. [2025-10-07T22:07:00.193196] [INFO ] [MAIN ] UMH: Loaded 33730 existing records. [2025-10-07T22:07:00.387302] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:07:00.387534] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-07T22:07:00.387581] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-07T22:07:00.387943] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-07T22:07:00.388002] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-07T22:07:00.650402] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-07T22:07:00.755173] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:07:00.795811] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-07T22:07:01.343883] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T22:07:01.447680] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-07T22:07:02.247688] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-07T22:07:02.813527] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-07T22:07:02.935598] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T22:07:03.047699] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-07T22:07:03.847630] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-07T22:07:04.169501] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T22:07:04.254334] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T22:07:04.647698] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-07T22:07:05.447633] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-07T22:07:05.712084] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T22:07:06.247625] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-07T22:07:06.301984] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T22:07:07.047623] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-07T22:07:07.377963] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T22:07:07.847688] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-07T22:07:08.216988] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T22:07:08.434532] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-07T22:07:08.647706] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-07T22:07:09.361285] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T22:07:09.447604] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-07T22:07:10.247687] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-07T22:07:10.514336] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T22:07:10.930740] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-07T22:07:11.047631] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-07T22:07:11.855969] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-07T22:07:11.878010] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T22:07:12.250723] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T22:07:12.647700] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-07T22:07:13.370360] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T22:07:13.447747] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-07T22:07:14.051828] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T22:07:14.247680] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-07T22:07:14.963223] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T22:07:15.047678] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-07T22:07:15.847708] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-07T22:07:16.157454] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T22:07:16.248271] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T22:07:16.647708] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-07T22:07:17.447675] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-07T22:07:17.672799] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T22:07:17.990317] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T22:07:18.247696] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-07T22:07:18.376508] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T22:07:18.379112] [INFO ] [REMOTE ] ULS: Full fetch complete (54227 records). [2025-10-07T22:07:18.379310] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-07T22:07:18.766690] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-07T22:07:18.766812] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-07T22:07:18.767872] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-07T22:07:18.767937] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-07T22:07:18.769231] [DEBUG] [LOCAL ] ULS: Trimmed 54227 records to 39452 (keeping 200 days of data) [2025-10-07T22:07:19.021337] [DEBUG] [LOCAL ] ULS: Primary data saved (39452 records). [2025-10-07T22:07:19.021500] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-07T22:07:19.021714] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. ULS took 27.6s. Estimated remaining: 26m 37s. Rate: 7.1 symbols/min [2025-10-07T22:07:19.052866] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-07T22:07:19.193832] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:07:19.209806] [DEBUG] [LOCAL ] UNF: Loaded 12103 existing records from primary storage. [2025-10-07T22:07:19.210040] [INFO ] [MAIN ] UNF: Loaded 12103 existing records. [2025-10-07T22:07:19.383961] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:07:19.384184] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-07T22:07:19.384231] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-07T22:07:19.384552] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-07T22:07:19.384611] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-07T22:07:19.745826] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:07:19.847631] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-07T22:07:20.117144] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-07T22:07:20.645727] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-07T22:07:20.647924] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-07T22:07:20.892681] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T22:07:21.447695] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-07T22:07:22.053795] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T22:07:22.247639] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-07T22:07:22.481559] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-07T22:07:23.047682] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-07T22:07:23.775951] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T22:07:23.779994] [INFO ] [REMOTE ] UL: Full fetch complete (76891 records). [2025-10-07T22:07:23.780190] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-07T22:07:23.848151] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-07T22:07:23.968977] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T22:07:24.187513] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-07T22:07:24.187605] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-07T22:07:24.188742] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-07T22:07:24.188813] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-07T22:07:24.192728] [DEBUG] [LOCAL ] UL: Trimmed 76891 records to 53074 (keeping 200 days of data) [2025-10-07T22:07:24.529714] [DEBUG] [LOCAL ] UL: Primary data saved (53074 records). [2025-10-07T22:07:24.529868] [INFO ] [MAIN ] UL: Full history saved. [2025-10-07T22:07:24.529972] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. UL took 49.1s. Estimated remaining: 26m 28s. Rate: 7.1 symbols/min [2025-10-07T22:07:24.654477] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-07T22:07:24.733167] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:07:24.776561] [DEBUG] [LOCAL ] UNFI: Loaded 42224 existing records from primary storage. [2025-10-07T22:07:24.776931] [INFO ] [MAIN ] UNFI: Loaded 42224 existing records. [2025-10-07T22:07:24.997930] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:07:24.998173] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-07T22:07:24.998256] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-07T22:07:24.998723] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-07T22:07:24.998797] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-07T22:07:25.365439] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:07:25.447679] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-07T22:07:25.563107] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T22:07:26.058057] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T22:07:26.247748] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-07T22:07:27.047835] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-07T22:07:27.049441] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T22:07:27.184566] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T22:07:27.847759] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-07T22:07:28.647682] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-07T22:07:28.703225] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-07T22:07:28.708631] [INFO ] [REMOTE ] UMC: Full fetch complete (76578 records). [2025-10-07T22:07:28.708893] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-07T22:07:29.097231] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T22:07:29.170831] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-07T22:07:29.170974] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-07T22:07:29.172959] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-07T22:07:29.173035] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-07T22:07:29.177066] [DEBUG] [LOCAL ] UMC: Trimmed 76578 records to 52716 (keeping 200 days of data) [2025-10-07T22:07:29.457937] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-07T22:07:29.509571] [DEBUG] [LOCAL ] UMC: Primary data saved (52716 records). [2025-10-07T22:07:29.509810] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-07T22:07:29.509972] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMC took 36.8s. Estimated remaining: 26m 19s. Rate: 7.1 symbols/min [2025-10-07T22:07:29.687612] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:07:29.747149] [DEBUG] [LOCAL ] UNH: Loaded 53801 existing records from primary storage. [2025-10-07T22:07:29.747636] [INFO ] [MAIN ] UNH: Loaded 53801 existing records. [2025-10-07T22:07:29.941772] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:07:29.942234] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-07T22:07:29.942387] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-07T22:07:29.942816] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-07T22:07:29.942877] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-07T22:07:30.068238] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T22:07:30.254837] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-07T22:07:30.344366] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:07:30.944610] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-07T22:07:31.047719] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-07T22:07:31.597239] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T22:07:31.847696] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-07T22:07:32.403212] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-07T22:07:32.632745] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T22:07:32.647609] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-07T22:07:33.447708] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-07T22:07:33.491218] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-07T22:07:34.247707] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-07T22:07:34.859079] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-07T22:07:35.047713] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-07T22:07:35.552038] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T22:07:35.847713] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-07T22:07:36.647709] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-07T22:07:37.367985] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T22:07:37.393268] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-07T22:07:37.452877] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-07T22:07:37.474470] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-07T22:07:38.247761] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-07T22:07:38.671919] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-07T22:07:38.674797] [INFO ] [REMOTE ] UMH: Full fetch complete (46834 records). [2025-10-07T22:07:38.674905] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-07T22:07:39.055420] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-07T22:07:39.077281] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-07T22:07:39.077446] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-07T22:07:39.078606] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-07T22:07:39.088490] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-07T22:07:39.089003] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T22:07:39.093203] [DEBUG] [LOCAL ] UMH: Trimmed 46834 records to 33804 (keeping 200 days of data) [2025-10-07T22:07:39.312279] [DEBUG] [LOCAL ] UMH: Primary data saved (33804 records). [2025-10-07T22:07:39.312466] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-07T22:07:39.312570] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMH took 39.3s. Estimated remaining: 26m 11s. Rate: 7.1 symbols/min [2025-10-07T22:07:39.479312] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:07:39.522245] [DEBUG] [LOCAL ] UNM: Loaded 48326 existing records from primary storage. [2025-10-07T22:07:39.522576] [INFO ] [MAIN ] UNM: Loaded 48326 existing records. [2025-10-07T22:07:39.693409] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:07:39.693628] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-07T22:07:39.693721] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-07T22:07:39.693994] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-07T22:07:39.694056] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-07T22:07:39.852502] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-07T22:07:40.040219] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:07:40.647677] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-07T22:07:40.680493] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-07T22:07:40.842080] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T22:07:41.447740] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-07T22:07:42.150828] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-07T22:07:42.152152] [INFO ] [REMOTE ] UNF: Full fetch complete (17371 records). [2025-10-07T22:07:42.152227] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-07T22:07:42.251147] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-07T22:07:42.530890] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-07T22:07:42.530990] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-07T22:07:42.548225] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-07T22:07:42.561691] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-07T22:07:42.563738] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T22:07:42.563947] [DEBUG] [LOCAL ] UNF: Trimmed 17371 records to 12129 (keeping 200 days of data) [2025-10-07T22:07:42.652149] [DEBUG] [LOCAL ] UNF: Primary data saved (12129 records). [2025-10-07T22:07:42.652289] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-07T22:07:42.652367] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNF took 23.6s. Estimated remaining: 26m 2s. Rate: 7.1 symbols/min [2025-10-07T22:07:42.819749] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:07:42.826054] [DEBUG] [LOCAL ] UNMA: Loaded 3501 existing records from primary storage. [2025-10-07T22:07:42.826229] [INFO ] [MAIN ] UNMA: Loaded 3501 existing records. [2025-10-07T22:07:42.997735] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:07:42.997939] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-07T22:07:42.997990] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-07T22:07:42.998173] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-07T22:07:42.998236] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-07T22:07:43.059264] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-07T22:07:43.351340] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:07:43.847685] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-07T22:07:44.462608] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-07T22:07:44.550978] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-07T22:07:44.596969] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T22:07:44.647622] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-07T22:07:45.447779] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-07T22:07:46.034459] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-07T22:07:46.247683] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-07T22:07:46.330299] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-07T22:07:47.047723] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-07T22:07:47.673505] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T22:07:47.847634] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-07T22:07:47.953168] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-07T22:07:48.647920] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-07T22:07:49.306814] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-07T22:07:49.447731] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-07T22:07:50.037952] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-07T22:07:50.040212] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-07T22:07:50.247701] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-07T22:07:50.802427] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-07T22:07:51.047712] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-07T22:07:51.641854] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T22:07:51.847725] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-07T22:07:52.647706] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-07T22:07:53.426243] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T22:07:53.447613] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-07T22:07:54.247719] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-07T22:07:54.289949] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T22:07:55.047635] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-07T22:07:55.167398] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-07T22:07:55.847712] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-07T22:07:56.402759] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-07T22:07:56.647629] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-07T22:07:56.676702] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-07T22:07:57.368539] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T22:07:57.447636] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-07T22:07:58.247709] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-07T22:07:58.951206] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-07T22:07:59.034433] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T22:07:59.056634] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-07T22:07:59.081391] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T22:07:59.631818] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-07T22:07:59.847702] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-07T22:08:00.647715] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-07T22:08:01.447687] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-07T22:08:01.554004] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T22:08:02.247709] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-07T22:08:02.381412] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T22:08:03.047707] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-07T22:08:03.621405] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T22:08:03.625041] [INFO ] [REMOTE ] UNFI: Full fetch complete (59411 records). [2025-10-07T22:08:03.625183] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-07T22:08:03.855696] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-07T22:08:04.017956] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-07T22:08:04.018049] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-07T22:08:04.019012] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-07T22:08:04.019078] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-07T22:08:04.020253] [DEBUG] [LOCAL ] UNFI: Trimmed 59411 records to 42313 (keeping 200 days of data) [2025-10-07T22:08:04.280512] [DEBUG] [LOCAL ] UNFI: Primary data saved (42313 records). [2025-10-07T22:08:04.281683] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-07T22:08:04.282249] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNFI took 39.8s. Estimated remaining: 25m 55s. Rate: 7.1 symbols/min [2025-10-07T22:08:04.350777] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-07T22:08:04.375886] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-07T22:08:04.522462] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:08:04.557850] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T22:08:04.614294] [DEBUG] [LOCAL ] UNP: Loaded 53295 existing records from primary storage. [2025-10-07T22:08:04.614637] [INFO ] [MAIN ] UNP: Loaded 53295 existing records. [2025-10-07T22:08:04.653090] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-07T22:08:04.801535] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:08:04.801732] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-07T22:08:04.801785] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-07T22:08:04.802097] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-07T22:08:04.802154] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-07T22:08:05.179362] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T22:08:05.185092] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:08:05.186296] [INFO ] [REMOTE ] UNMA: Full fetch complete (5727 records). [2025-10-07T22:08:05.186373] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-07T22:08:05.452757] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-07T22:08:05.548750] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-07T22:08:05.548832] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-07T22:08:05.549012] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-07T22:08:05.549053] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-07T22:08:05.549429] [DEBUG] [LOCAL ] UNMA: Trimmed 5727 records to 3517 (keeping 200 days of data) [2025-10-07T22:08:05.570969] [DEBUG] [LOCAL ] UNMA: Primary data saved (3517 records). [2025-10-07T22:08:05.571036] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-07T22:08:05.571120] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNMA took 22.9s. Estimated remaining: 25m 46s. Rate: 7.1 symbols/min [2025-10-07T22:08:05.740834] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:08:05.781425] [DEBUG] [LOCAL ] UP: Loaded 43406 existing records from primary storage. [2025-10-07T22:08:05.781755] [INFO ] [MAIN ] UP: Loaded 43406 existing records. [2025-10-07T22:08:05.961058] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:08:05.961369] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-07T22:08:05.961449] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-07T22:08:05.961739] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-07T22:08:05.961812] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-07T22:08:06.252817] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-07T22:08:06.325033] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:08:07.047676] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-07T22:08:07.847695] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-07T22:08:08.059012] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T22:08:08.199059] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-10-07T22:08:08.647732] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-07T22:08:08.767081] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T22:08:09.447639] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-07T22:08:09.685906] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T22:08:10.247739] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-07T22:08:10.986521] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T22:08:11.047601] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-07T22:08:11.343146] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-07T22:08:11.847729] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-07T22:08:12.142213] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-07T22:08:12.491420] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-07T22:08:12.647752] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-07T22:08:13.295920] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T22:08:13.447608] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-07T22:08:14.247690] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-07T22:08:14.807778] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T22:08:14.811233] [INFO ] [REMOTE ] UNM: Full fetch complete (69905 records). [2025-10-07T22:08:14.811343] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-07T22:08:15.049541] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-07T22:08:15.202521] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-07T22:08:15.202834] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-07T22:08:15.203937] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-07T22:08:15.204002] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-07T22:08:15.205396] [DEBUG] [LOCAL ] UNM: Trimmed 69905 records to 48288 (keeping 200 days of data) [2025-10-07T22:08:15.515778] [DEBUG] [LOCAL ] UNM: Primary data saved (48288 records). [2025-10-07T22:08:15.516009] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-07T22:08:15.516130] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNM took 36.2s. Estimated remaining: 25m 37s. Rate: 7.1 symbols/min [2025-10-07T22:08:15.696372] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:08:15.746868] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (3.10 seconds). [2025-10-07T22:08:15.800959] [DEBUG] [LOCAL ] UPS: Loaded 53714 existing records from primary storage. [2025-10-07T22:08:15.801316] [INFO ] [MAIN ] UPS: Loaded 53714 existing records. [2025-10-07T22:08:15.863621] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-07T22:08:15.984577] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:08:15.985039] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-07T22:08:15.985151] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-07T22:08:15.985605] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-07T22:08:15.985706] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-07T22:08:16.413474] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-07T22:08:16.473728] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:08:16.508565] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T22:08:16.647608] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-07T22:08:17.447744] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-07T22:08:18.213495] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-07T22:08:18.247611] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-07T22:08:18.710061] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-07T22:08:19.047720] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-07T22:08:19.285563] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T22:08:19.853012] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-07T22:08:19.877005] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T22:08:20.647748] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-07T22:08:21.141061] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-07T22:08:21.185378] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T22:08:21.189382] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-10-07T22:08:21.189494] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-07T22:08:21.450383] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-07T22:08:21.598735] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-07T22:08:21.598887] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-07T22:08:21.600258] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-07T22:08:21.600378] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-07T22:08:21.602090] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 53802 (keeping 200 days of data) [2025-10-07T22:08:21.889248] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-07T22:08:21.995473] [DEBUG] [LOCAL ] UNH: Primary data saved (53802 records). [2025-10-07T22:08:21.995616] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-07T22:08:21.995737] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNH took 52.5s. Estimated remaining: 25m 29s. Rate: 7.1 symbols/min [2025-10-07T22:08:22.163193] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:08:22.163373] [DEBUG] [LOCAL ] URI: No existing data file found in primary storage. [2025-10-07T22:08:22.163429] [WARN ] [MAIN ] URI: No existing data found, performing full refresh instead. [2025-10-07T22:08:22.163542] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-07T22:08:22.163585] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-07T22:08:22.163628] [DEBUG] [LOCAL ] URI: No primary data file found to delete. [2025-10-07T22:08:22.163700] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-07T22:08:22.252935] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-07T22:08:22.512508] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:08:23.047697] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-07T22:08:23.117572] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T22:08:23.847706] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-07T22:08:24.623366] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-07T22:08:24.647599] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-07T22:08:24.892140] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T22:08:25.447696] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-07T22:08:26.245965] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-07T22:08:26.257097] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-07T22:08:26.963086] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-07T22:08:27.047603] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-07T22:08:27.261583] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T22:08:27.847635] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-07T22:08:27.921407] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-07T22:08:28.647727] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-07T22:08:29.229758] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-07T22:08:29.336358] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T22:08:29.447630] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-07T22:08:30.247620] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-07T22:08:30.616044] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-07T22:08:30.739452] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T22:08:31.047688] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-07T22:08:31.847622] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-07T22:08:31.954570] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T22:08:32.647701] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-07T22:08:33.417376] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-07T22:08:33.447602] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-07T22:08:33.856445] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-07T22:08:34.247693] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-07T22:08:34.803676] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-07T22:08:35.047682] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-07T22:08:35.478094] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-07T22:08:35.848152] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-07T22:08:36.400217] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-07T22:08:36.647624] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-07T22:08:36.863754] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-07T22:08:36.867988] [INFO ] [REMOTE ] UP: Full fetch complete (62608 records). [2025-10-07T22:08:36.868124] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-07T22:08:37.348890] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-07T22:08:37.349003] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-07T22:08:37.350184] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-07T22:08:37.350252] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-07T22:08:37.352333] [DEBUG] [LOCAL ] UP: Trimmed 62608 records to 43547 (keeping 200 days of data) [2025-10-07T22:08:37.448037] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-07T22:08:37.635122] [DEBUG] [LOCAL ] UP: Primary data saved (43547 records). [2025-10-07T22:08:37.635310] [INFO ] [MAIN ] UP: Full history saved. [2025-10-07T22:08:37.635427] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UP took 32.1s. Estimated remaining: 25m 21s. Rate: 7.1 symbols/min [2025-10-07T22:08:37.836802] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:08:37.838613] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-07T22:08:37.884864] [DEBUG] [LOCAL ] USA: Loaded 35963 existing records from primary storage. [2025-10-07T22:08:37.885177] [INFO ] [MAIN ] USA: Loaded 35963 existing records. [2025-10-07T22:08:38.064448] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:08:38.064733] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-07T22:08:38.064802] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-07T22:08:38.065054] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-07T22:08:38.065147] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-07T22:08:38.253847] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-07T22:08:38.422748] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:08:38.624859] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-07T22:08:39.047699] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-07T22:08:39.538781] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-07T22:08:39.659723] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-07T22:08:39.847631] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-07T22:08:40.521270] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-07T22:08:40.647702] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-07T22:08:41.447712] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-07T22:08:42.029949] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T22:08:42.246776] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-07T22:08:42.251166] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-07T22:08:42.442479] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-07T22:08:42.762258] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-07T22:08:42.766061] [INFO ] [REMOTE ] UNP: Full fetch complete (76913 records). [2025-10-07T22:08:42.766169] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-07T22:08:43.055603] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-07T22:08:43.159762] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-07T22:08:43.159857] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-07T22:08:43.160965] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-07T22:08:43.161031] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-07T22:08:43.162539] [DEBUG] [LOCAL ] UNP: Trimmed 76913 records to 53301 (keeping 200 days of data) [2025-10-07T22:08:43.500381] [DEBUG] [LOCAL ] UNP: Primary data saved (53301 records). [2025-10-07T22:08:43.500528] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-07T22:08:43.501728] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. UNP took 39.2s. Estimated remaining: 25m 12s. Rate: 7.1 symbols/min [2025-10-07T22:08:43.673914] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:08:43.695533] [DEBUG] [LOCAL ] USAC: Loaded 21843 existing records from primary storage. [2025-10-07T22:08:43.695820] [INFO ] [MAIN ] USAC: Loaded 21843 existing records. [2025-10-07T22:08:43.849931] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-07T22:08:43.875770] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:08:43.876923] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-07T22:08:43.876977] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-07T22:08:43.877181] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-07T22:08:43.877236] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-07T22:08:44.230431] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:08:44.647706] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-07T22:08:45.447637] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-07T22:08:45.573870] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-07T22:08:45.620404] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T22:08:45.833352] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T22:08:46.247700] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-07T22:08:46.463525] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-07T22:08:47.047632] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-07T22:08:47.429723] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-07T22:08:47.847709] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-07T22:08:48.482970] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-07T22:08:48.647785] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-07T22:08:49.447687] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-07T22:08:50.186816] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T22:08:50.259431] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-07T22:08:50.268826] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-07T22:08:50.754537] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-07T22:08:51.047691] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-07T22:08:51.535808] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T22:08:51.540116] [INFO ] [REMOTE ] UPS: Full fetch complete (77756 records). [2025-10-07T22:08:51.540259] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-07T22:08:51.853888] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-07T22:08:52.046271] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-07T22:08:52.046564] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-07T22:08:52.048941] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-07T22:08:52.049696] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-07T22:08:52.052663] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T22:08:52.072519] [DEBUG] [LOCAL ] UPS: Trimmed 77756 records to 53717 (keeping 200 days of data) [2025-10-07T22:08:52.472019] [DEBUG] [LOCAL ] UPS: Primary data saved (53717 records). [2025-10-07T22:08:52.472231] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-07T22:08:52.472364] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. UPS took 37.0s. Estimated remaining: 25m 4s. Rate: 7.1 symbols/min [2025-10-07T22:08:52.647518] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:08:52.647753] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-07T22:08:52.705331] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-07T22:08:52.705852] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-07T22:08:52.903747] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:08:52.904269] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-07T22:08:52.904329] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-07T22:08:52.904595] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-07T22:08:52.904697] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-07T22:08:53.147629] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-07T22:08:53.193511] [INFO ] [REMOTE ] URI: Full fetch complete (53150 records). [2025-10-07T22:08:53.205841] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-07T22:08:53.357515] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T22:08:53.433378] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:08:53.452753] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-07T22:08:53.749171] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-07T22:08:53.749271] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-07T22:08:53.750511] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-07T22:08:53.750576] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-07T22:08:53.751732] [DEBUG] [LOCAL ] URI: Trimmed 53150 records to 35287 (keeping 200 days of data) [2025-10-07T22:08:53.978566] [DEBUG] [LOCAL ] URI: Primary data saved (35287 records). [2025-10-07T22:08:53.978754] [INFO ] [MAIN ] URI: Full history saved. [2025-10-07T22:08:53.978856] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. URI took 32.0s. Estimated remaining: 24m 55s. Rate: 7.1 symbols/min [2025-10-07T22:08:54.146927] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:08:54.194216] [DEBUG] [LOCAL ] USFD: Loaded 51207 existing records from primary storage. [2025-10-07T22:08:54.194543] [INFO ] [MAIN ] USFD: Loaded 51207 existing records. [2025-10-07T22:08:54.249019] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-07T22:08:54.377413] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:08:54.377617] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-07T22:08:54.377713] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-07T22:08:54.377982] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-07T22:08:54.378039] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-07T22:08:54.751435] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:08:54.753324] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T22:08:55.047684] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-07T22:08:55.830354] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-07T22:08:55.847587] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-07T22:08:56.213373] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-07T22:08:56.647694] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-07T22:08:57.284249] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T22:08:57.447601] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-07T22:08:57.778598] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T22:08:58.247686] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-07T22:08:58.529967] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T22:08:59.047690] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-07T22:08:59.570368] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T22:08:59.847619] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-07T22:09:00.154993] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T22:09:00.647699] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-07T22:09:01.403176] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T22:09:01.447635] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-07T22:09:02.113902] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T22:09:02.247631] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-07T22:09:02.950217] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T22:09:03.047703] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-07T22:09:03.143455] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-07T22:09:03.847695] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-07T22:09:04.652857] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-07T22:09:04.668817] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T22:09:05.304200] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-07T22:09:05.447697] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-07T22:09:06.247689] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-07T22:09:06.487836] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T22:09:07.047701] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-07T22:09:07.227419] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T22:09:07.414205] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-07T22:09:07.847724] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-07T22:09:08.647621] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-07T22:09:08.791872] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T22:09:08.793573] [INFO ] [REMOTE ] USAC: Full fetch complete (35302 records). [2025-10-07T22:09:08.793701] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-07T22:09:09.143718] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-07T22:09:09.257722] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-07T22:09:09.257815] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-07T22:09:09.258538] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-07T22:09:09.258581] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-07T22:09:09.259346] [DEBUG] [LOCAL ] USAC: Trimmed 35302 records to 21747 (keeping 200 days of data) [2025-10-07T22:09:09.390978] [DEBUG] [LOCAL ] USAC: Primary data saved (21747 records). [2025-10-07T22:09:09.391116] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-07T22:09:09.391197] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USAC took 25.9s. Estimated remaining: 24m 47s. Rate: 7.1 symbols/min [2025-10-07T22:09:09.454015] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-07T22:09:09.562361] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:09:09.580811] [DEBUG] [LOCAL ] USNA: Loaded 17731 existing records from primary storage. [2025-10-07T22:09:09.581067] [INFO ] [MAIN ] USNA: Loaded 17731 existing records. [2025-10-07T22:09:09.762475] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:09:09.762996] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-07T22:09:09.763135] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-07T22:09:09.763569] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-07T22:09:09.763798] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-07T22:09:09.910583] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T22:09:10.205760] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:09:10.247600] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-07T22:09:11.047693] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-07T22:09:11.269095] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T22:09:11.468510] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T22:09:11.847690] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-07T22:09:12.328066] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T22:09:12.330903] [INFO ] [REMOTE ] USA: Full fetch complete (52034 records). [2025-10-07T22:09:12.330988] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-07T22:09:12.652801] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-07T22:09:12.702623] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-07T22:09:12.702730] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-07T22:09:12.703637] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-07T22:09:12.703727] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-07T22:09:12.704953] [DEBUG] [LOCAL ] USA: Trimmed 52034 records to 35975 (keeping 200 days of data) [2025-10-07T22:09:12.916512] [DEBUG] [LOCAL ] USA: Primary data saved (35975 records). [2025-10-07T22:09:12.916731] [INFO ] [MAIN ] USA: Full history saved. [2025-10-07T22:09:12.916923] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USA took 35.3s. Estimated remaining: 24m 38s. Rate: 7.1 symbols/min [2025-10-07T22:09:13.084295] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:09:13.103735] [DEBUG] [LOCAL ] USPH: Loaded 16926 existing records from primary storage. [2025-10-07T22:09:13.104017] [INFO ] [MAIN ] USPH: Loaded 16926 existing records. [2025-10-07T22:09:13.281822] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:09:13.282067] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-07T22:09:13.282118] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-07T22:09:13.282379] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-07T22:09:13.282439] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-07T22:09:13.447720] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-07T22:09:13.651703] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:09:13.906236] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-07T22:09:14.247719] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-07T22:09:14.583160] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-07T22:09:14.605619] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T22:09:15.047626] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-07T22:09:15.264800] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-07T22:09:15.847681] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-07T22:09:16.508869] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T22:09:16.647625] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-07T22:09:16.877370] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T22:09:17.447612] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-07T22:09:17.477493] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-07T22:09:18.247689] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-07T22:09:18.895631] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-07T22:09:19.006519] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T22:09:19.047630] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-07T22:09:19.610471] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-07T22:09:19.847674] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-07T22:09:20.647735] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-07T22:09:20.886472] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T22:09:21.447711] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-07T22:09:22.254108] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-07T22:09:22.273818] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-07T22:09:22.501998] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T22:09:23.047619] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-07T22:09:23.447944] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-07T22:09:23.847670] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-07T22:09:24.025278] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T22:09:24.647699] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-07T22:09:25.447623] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-07T22:09:25.600276] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T22:09:25.626803] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-07T22:09:26.247727] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-07T22:09:27.047763] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-07T22:09:27.187167] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T22:09:27.459059] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T22:09:27.847713] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-07T22:09:28.148594] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T22:09:28.647730] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-07T22:09:29.447690] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-07T22:09:29.509786] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T22:09:29.537025] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-07T22:09:30.247733] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-07T22:09:31.047682] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-07T22:09:31.257416] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-07T22:09:31.523387] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-07T22:09:31.674706] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-07T22:09:31.847719] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-07T22:09:32.647683] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-07T22:09:32.981592] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-07T22:09:33.447629] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-07T22:09:33.523337] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-07T22:09:34.247715] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-07T22:09:35.047683] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-07T22:09:35.109379] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T22:09:35.111319] [INFO ] [REMOTE ] USPH: Full fetch complete (22937 records). [2025-10-07T22:09:35.111421] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-07T22:09:35.401545] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-07T22:09:35.527081] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-07T22:09:35.527186] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-07T22:09:35.527720] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-07T22:09:35.527782] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-07T22:09:35.528451] [DEBUG] [LOCAL ] USPH: Trimmed 22937 records to 17004 (keeping 200 days of data) [2025-10-07T22:09:35.635998] [DEBUG] [LOCAL ] USPH: Primary data saved (17004 records). [2025-10-07T22:09:35.636145] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-07T22:09:35.636231] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USPH took 22.7s. Estimated remaining: 24m 31s. Rate: 7.1 symbols/min [2025-10-07T22:09:35.847716] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-07T22:09:36.647737] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-07T22:09:36.953928] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-07T22:09:37.311854] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-07T22:09:37.318415] [INFO ] [REMOTE ] USFD: Full fetch complete (74023 records). [2025-10-07T22:09:37.318546] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-07T22:09:37.458685] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-07T22:09:37.662098] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T22:09:37.743879] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-07T22:09:37.743963] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-07T22:09:37.745351] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-07T22:09:37.745419] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-07T22:09:37.747234] [DEBUG] [LOCAL ] USFD: Trimmed 74023 records to 51191 (keeping 200 days of data) [2025-10-07T22:09:38.060289] [DEBUG] [LOCAL ] USFD: Primary data saved (51191 records). [2025-10-07T22:09:38.060435] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-07T22:09:38.060575] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USFD took 44.1s. Estimated remaining: 24m 22s. Rate: 7.1 symbols/min [2025-10-07T22:09:38.247716] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-07T22:09:39.014318] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-07T22:09:39.017066] [INFO ] [REMOTE ] USNA: Full fetch complete (26586 records). [2025-10-07T22:09:39.017214] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-07T22:09:39.390616] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-07T22:09:39.390845] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-07T22:09:39.391488] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-07T22:09:39.391577] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-07T22:09:39.392323] [DEBUG] [LOCAL ] USNA: Trimmed 26586 records to 17715 (keeping 200 days of data) [2025-10-07T22:09:39.503803] [DEBUG] [LOCAL ] USNA: Primary data saved (17715 records). [2025-10-07T22:09:39.504007] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-07T22:09:39.504122] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USNA took 30.1s. Estimated remaining: 24m 13s. Rate: 7.1 symbols/min [2025-10-07T22:09:39.554814] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-07T22:09:39.567482] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-07T22:09:40.044301] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T22:09:40.048487] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-07T22:09:40.048698] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-07T22:09:40.451862] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-07T22:09:40.451940] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-07T22:09:40.453062] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-07T22:09:40.453126] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-07T22:09:40.454706] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 53688 (keeping 200 days of data) [2025-10-07T22:09:40.791719] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-07T22:09:40.791956] [INFO ] [MAIN ] USB: Full history saved. [2025-10-07T22:09:40.792073] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USB took 48.3s. Estimated remaining: 24m 4s. Rate: 7.1 symbols/min [2025-10-07T22:09:41.409305] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:09:41.463947] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:09:41.465460] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:09:41.493785] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:09:41.525440] [DEBUG] [LOCAL ] UTL: Loaded 11483 existing records from primary storage. [2025-10-07T22:09:41.526074] [INFO ] [MAIN ] UTL: Loaded 11483 existing records. [2025-10-07T22:09:41.665720] [DEBUG] [LOCAL ] UTF: Loaded 29779 existing records from primary storage. [2025-10-07T22:09:41.681509] [INFO ] [MAIN ] UTF: Loaded 29779 existing records. [2025-10-07T22:09:41.682418] [DEBUG] [LOCAL ] UTI: Loaded 40526 existing records from primary storage. [2025-10-07T22:09:41.699103] [INFO ] [MAIN ] UTI: Loaded 40526 existing records. [2025-10-07T22:09:41.862798] [DEBUG] [LOCAL ] UTZ: Loaded 44696 existing records from primary storage. [2025-10-07T22:09:41.945997] [INFO ] [MAIN ] UTZ: Loaded 44696 existing records. [2025-10-07T22:09:41.983744] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:09:42.056880] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-07T22:09:42.119086] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-07T22:09:42.176492] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:09:42.202957] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-07T22:09:42.244792] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-07T22:09:42.254241] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-07T22:09:42.253970] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-07T22:09:42.315467] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:09:42.322444] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-07T22:09:42.360028] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-07T22:09:42.383947] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-07T22:09:42.437417] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-07T22:09:42.462370] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-07T22:09:42.498280] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-07T22:09:42.501409] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:09:42.549892] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-07T22:09:42.619807] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-07T22:09:42.785837] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-07T22:09:42.860000] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-07T22:09:43.484721] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:09:43.746999] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-07T22:09:43.764785] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:09:43.780517] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-07T22:09:43.839638] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:09:43.857921] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-07T22:09:43.921575] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:09:43.921882] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-07T22:09:44.637200] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T22:09:44.640210] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-07T22:09:45.101036] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-07T22:09:45.107502] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-07T22:09:45.260830] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T22:09:45.272636] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-07T22:09:45.329616] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T22:09:45.447724] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-07T22:09:45.492287] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T22:09:46.247623] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-07T22:09:46.319277] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-07T22:09:46.544873] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-07T22:09:47.037940] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T22:09:47.047594] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-07T22:09:47.223301] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T22:09:47.816783] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-07T22:09:47.847687] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-07T22:09:48.647683] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-07T22:09:48.710341] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-07T22:09:49.447693] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-07T22:09:49.804155] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T22:09:50.247682] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-07T22:09:50.990847] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T22:09:51.047617] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-07T22:09:51.509268] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-07T22:09:51.847678] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-07T22:09:52.580976] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T22:09:52.644694] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T22:09:52.647554] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-07T22:09:53.396295] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-07T22:09:53.447609] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-07T22:09:54.247686] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-07T22:09:55.047710] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-07T22:09:55.320000] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T22:09:55.350728] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-07T22:09:55.847677] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-07T22:09:55.867550] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T22:09:56.647699] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-07T22:09:56.728736] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-07T22:09:57.270950] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T22:09:57.447700] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-07T22:09:58.247688] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-07T22:09:59.035064] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T22:09:59.047595] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-07T22:09:59.180844] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-07T22:09:59.847635] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-07T22:10:00.647704] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-07T22:10:00.696815] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T22:10:01.455039] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-07T22:10:01.467759] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T22:10:01.468855] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-07T22:10:01.484845] [INFO ] [REMOTE ] UTL: Full fetch complete (15534 records). [2025-10-07T22:10:01.485069] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-07T22:10:01.864038] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-07T22:10:01.864159] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-07T22:10:01.864597] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-07T22:10:01.865184] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-07T22:10:01.865792] [DEBUG] [LOCAL ] UTL: Trimmed 15534 records to 11505 (keeping 200 days of data) [2025-10-07T22:10:01.939264] [DEBUG] [LOCAL ] UTL: Primary data saved (11505 records). [2025-10-07T22:10:01.939429] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-07T22:10:01.939520] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 21.1s. Estimated remaining: 23m 56s. Rate: 7.1 symbols/min [2025-10-07T22:10:02.108405] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:10:02.174982] [DEBUG] [LOCAL ] UVE: Loaded 21954 existing records from primary storage. [2025-10-07T22:10:02.175374] [INFO ] [MAIN ] UVE: Loaded 21954 existing records. [2025-10-07T22:10:02.259156] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-07T22:10:02.382466] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:10:02.382767] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-07T22:10:02.382822] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-07T22:10:02.383016] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-07T22:10:02.383073] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-07T22:10:02.747250] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:10:02.763442] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T22:10:03.047701] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-07T22:10:03.847628] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-07T22:10:03.926189] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T22:10:04.330416] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T22:10:04.647613] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-07T22:10:04.830081] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-07T22:10:05.447680] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-07T22:10:06.247738] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-07T22:10:06.310593] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T22:10:06.766075] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-07T22:10:06.965670] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T22:10:07.047686] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-07T22:10:07.847735] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-07T22:10:08.207551] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T22:10:08.647751] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-07T22:10:09.447692] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-07T22:10:09.591879] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T22:10:09.891150] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T22:10:10.247690] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-07T22:10:10.926861] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T22:10:11.047730] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-07T22:10:11.451844] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-07T22:10:11.847676] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-07T22:10:12.417218] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T22:10:12.420373] [INFO ] [REMOTE ] UTI: Full fetch complete (58485 records). [2025-10-07T22:10:12.420474] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-07T22:10:12.656391] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-07T22:10:12.812209] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-07T22:10:12.812307] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-07T22:10:12.813341] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-07T22:10:12.813410] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-07T22:10:12.814745] [DEBUG] [LOCAL ] UTI: Trimmed 58485 records to 40611 (keeping 200 days of data) [2025-10-07T22:10:12.927756] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-07T22:10:13.095285] [DEBUG] [LOCAL ] UTI: Primary data saved (40611 records). [2025-10-07T22:10:13.095429] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-07T22:10:13.095568] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTI took 32.3s. Estimated remaining: 23m 48s. Rate: 7.1 symbols/min [2025-10-07T22:10:13.269540] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:10:13.303013] [DEBUG] [LOCAL ] UVV: Loaded 22592 existing records from primary storage. [2025-10-07T22:10:13.303433] [INFO ] [MAIN ] UVV: Loaded 22592 existing records. [2025-10-07T22:10:13.452772] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-07T22:10:13.485302] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:10:13.485561] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-07T22:10:13.485612] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-07T22:10:13.486280] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-07T22:10:13.486342] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-07T22:10:13.845265] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:10:14.020419] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T22:10:14.023893] [INFO ] [REMOTE ] UTF: Full fetch complete (42488 records). [2025-10-07T22:10:14.024042] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-07T22:10:14.257479] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-07T22:10:14.404741] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-07T22:10:14.404842] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-07T22:10:14.405724] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-07T22:10:14.405789] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-07T22:10:14.406989] [DEBUG] [LOCAL ] UTF: Trimmed 42488 records to 29954 (keeping 200 days of data) [2025-10-07T22:10:14.590626] [DEBUG] [LOCAL ] UTF: Primary data saved (29954 records). [2025-10-07T22:10:14.590802] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-07T22:10:14.590892] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTF took 33.8s. Estimated remaining: 23m 39s. Rate: 7.1 symbols/min [2025-10-07T22:10:14.787966] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:10:14.785620] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-07T22:10:14.843706] [DEBUG] [LOCAL ] UWMC: Loaded 52835 existing records from primary storage. [2025-10-07T22:10:14.844060] [INFO ] [MAIN ] UWMC: Loaded 52835 existing records. [2025-10-07T22:10:15.015679] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:10:15.015906] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-07T22:10:15.015954] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-07T22:10:15.016483] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-07T22:10:15.016541] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-07T22:10:15.057024] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-07T22:10:15.360774] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:10:15.847713] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-07T22:10:15.966380] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T22:10:16.117408] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T22:10:16.647763] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-07T22:10:17.447634] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-07T22:10:17.640714] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T22:10:17.784207] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T22:10:18.247685] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-07T22:10:18.744078] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-07T22:10:19.047719] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-07T22:10:19.312887] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T22:10:19.847631] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-07T22:10:20.145247] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T22:10:20.560740] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-07T22:10:20.647764] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-07T22:10:21.447709] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-07T22:10:22.247627] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-07T22:10:22.460542] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T22:10:22.461249] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T22:10:23.047700] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-07T22:10:23.848913] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-07T22:10:23.855174] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T22:10:24.647688] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-07T22:10:24.680748] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-07T22:10:25.111020] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-07T22:10:25.447731] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-07T22:10:26.239309] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T22:10:26.248151] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-07T22:10:27.047748] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-07T22:10:27.173994] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-07T22:10:27.368895] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-07T22:10:27.847717] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-07T22:10:28.268007] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-07T22:10:28.647621] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-07T22:10:28.945784] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T22:10:29.447692] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-07T22:10:29.572551] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T22:10:29.575711] [INFO ] [REMOTE ] UTZ: Full fetch complete (64432 records). [2025-10-07T22:10:29.575814] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-07T22:10:29.970461] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-07T22:10:29.970612] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-07T22:10:29.971724] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-07T22:10:29.971790] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-07T22:10:29.974104] [DEBUG] [LOCAL ] UTZ: Trimmed 64432 records to 44644 (keeping 200 days of data) [2025-10-07T22:10:30.247695] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-07T22:10:30.254978] [DEBUG] [LOCAL ] UTZ: Primary data saved (44644 records). [2025-10-07T22:10:30.255093] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-07T22:10:30.255216] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTZ took 49.5s. Estimated remaining: 23m 31s. Rate: 7.1 symbols/min [2025-10-07T22:10:30.423891] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:10:30.432039] [DEBUG] [LOCAL ] UZD: Loaded 6429 existing records from primary storage. [2025-10-07T22:10:30.432246] [INFO ] [MAIN ] UZD: Loaded 6429 existing records. [2025-10-07T22:10:30.605354] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:10:30.605606] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-07T22:10:30.605681] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-07T22:10:30.606124] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-07T22:10:30.606197] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-07T22:10:30.976430] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:10:31.047615] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-07T22:10:31.123247] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T22:10:31.299983] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-07T22:10:31.847630] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-07T22:10:31.862409] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-07T22:10:32.647703] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-07T22:10:33.447751] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-07T22:10:33.688109] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-07T22:10:33.691844] [INFO ] [REMOTE ] UVE: Full fetch complete (30169 records). [2025-10-07T22:10:33.692132] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-07T22:10:34.062422] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-07T22:10:34.170436] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-07T22:10:34.117439] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T22:10:34.170860] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-07T22:10:34.174002] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-07T22:10:34.175362] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-07T22:10:34.176431] [DEBUG] [LOCAL ] UVE: Trimmed 30169 records to 21933 (keeping 200 days of data) [2025-10-07T22:10:34.263899] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-07T22:10:34.316229] [DEBUG] [LOCAL ] UVE: Primary data saved (21933 records). [2025-10-07T22:10:34.316372] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-07T22:10:34.316515] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 32.4s. Estimated remaining: 23m 23s. Rate: 7.1 symbols/min [2025-10-07T22:10:34.499555] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:10:34.511487] [DEBUG] [LOCAL ] UZE: Loaded 7430 existing records from primary storage. [2025-10-07T22:10:34.511851] [INFO ] [MAIN ] UZE: Loaded 7430 existing records. [2025-10-07T22:10:34.701123] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:10:34.701338] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-07T22:10:34.701385] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-07T22:10:34.701633] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-07T22:10:34.701741] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-07T22:10:35.050003] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-07T22:10:35.049870] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:10:35.847704] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-07T22:10:36.033622] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-07T22:10:36.085815] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T22:10:36.563481] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-07T22:10:36.647680] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-07T22:10:37.447691] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-07T22:10:37.958557] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-07T22:10:38.247712] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-07T22:10:39.028019] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-07T22:10:39.047596] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-07T22:10:39.295934] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T22:10:39.595489] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-07T22:10:39.847673] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-07T22:10:40.551562] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T22:10:40.647695] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-07T22:10:41.447732] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-07T22:10:41.455574] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-07T22:10:42.247684] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-07T22:10:42.877569] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-07T22:10:43.047627] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-07T22:10:43.312890] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T22:10:43.820958] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T22:10:43.847693] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-07T22:10:44.583234] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T22:10:44.647708] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-07T22:10:45.447693] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-07T22:10:45.812277] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T22:10:46.073146] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T22:10:46.247607] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-07T22:10:47.047633] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-07T22:10:47.108906] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T22:10:47.110797] [INFO ] [REMOTE ] UVV: Full fetch complete (30102 records). [2025-10-07T22:10:47.110877] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-07T22:10:47.495043] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-07T22:10:47.495134] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-07T22:10:47.495906] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-07T22:10:47.495973] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-07T22:10:47.497294] [DEBUG] [LOCAL ] UVV: Trimmed 30102 records to 22653 (keeping 200 days of data) [2025-10-07T22:10:47.641966] [DEBUG] [LOCAL ] UVV: Primary data saved (22653 records). [2025-10-07T22:10:47.642106] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-07T22:10:47.642185] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UVV took 34.5s. Estimated remaining: 23m 14s. Rate: 7.1 symbols/min [2025-10-07T22:10:47.828677] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:10:47.837684] [DEBUG] [LOCAL ] UZF: Loaded 6382 existing records from primary storage. [2025-10-07T22:10:47.837902] [INFO ] [MAIN ] UZF: Loaded 6382 existing records. [2025-10-07T22:10:47.858023] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-07T22:10:48.029146] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:10:48.029344] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-07T22:10:48.029411] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-07T22:10:48.029629] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-07T22:10:48.029734] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-07T22:10:48.405112] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:10:48.551204] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-07T22:10:48.647606] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-07T22:10:48.932477] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-07T22:10:49.285979] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-07T22:10:49.447611] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-07T22:10:50.247693] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-07T22:10:50.356756] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T22:10:50.925700] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-07T22:10:51.047625] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-07T22:10:51.716427] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T22:10:51.847710] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-07T22:10:52.647682] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-07T22:10:52.794245] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T22:10:53.447696] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-07T22:10:53.487697] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-07T22:10:54.114040] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T22:10:54.247686] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-07T22:10:54.813070] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-07T22:10:55.047693] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-07T22:10:55.847637] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-07T22:10:55.952837] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-07T22:10:56.647721] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-07T22:10:57.257849] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-07T22:10:57.351608] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-07T22:10:57.357447] [INFO ] [REMOTE ] UWMC: Full fetch complete (75652 records). [2025-10-07T22:10:57.357589] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-07T22:10:57.452967] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-07T22:10:57.747707] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-07T22:10:57.747809] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-07T22:10:57.748948] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-07T22:10:57.749013] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-07T22:10:57.750476] [DEBUG] [LOCAL ] UWMC: Trimmed 75652 records to 52849 (keeping 200 days of data) [2025-10-07T22:10:58.075177] [DEBUG] [LOCAL ] UWMC: Primary data saved (52849 records). [2025-10-07T22:10:58.075349] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-07T22:10:58.075482] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UWMC took 43.5s. Estimated remaining: 23m 6s. Rate: 7.1 symbols/min [2025-10-07T22:10:58.250870] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:10:58.248477] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-07T22:10:58.251912] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T22:10:58.311387] [DEBUG] [LOCAL ] V: Loaded 53754 existing records from primary storage. [2025-10-07T22:10:58.311793] [INFO ] [MAIN ] V: Loaded 53754 existing records. [2025-10-07T22:10:58.484541] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:10:58.484773] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-07T22:10:58.484822] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-07T22:10:58.485204] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-07T22:10:58.485264] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-07T22:10:58.833897] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:10:58.921706] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-07T22:10:59.047616] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-07T22:10:59.847757] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-07T22:11:00.369741] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-07T22:11:00.647706] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-07T22:11:01.288830] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T22:11:01.377446] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-07T22:11:01.447632] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-07T22:11:02.247750] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-07T22:11:03.047630] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-07T22:11:03.089734] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T22:11:03.346922] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T22:11:03.653216] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T22:11:03.847693] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-07T22:11:04.288451] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-07T22:11:04.289406] [INFO ] [REMOTE ] UZE: Full fetch complete (10040 records). [2025-10-07T22:11:04.289482] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-07T22:11:04.653528] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-07T22:11:04.664873] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-07T22:11:04.665562] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-07T22:11:04.665903] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-07T22:11:04.666014] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-07T22:11:04.666762] [DEBUG] [LOCAL ] UZE: Trimmed 10040 records to 7430 (keeping 200 days of data) [2025-10-07T22:11:04.717239] [DEBUG] [LOCAL ] UZE: Primary data saved (7430 records). [2025-10-07T22:11:04.717374] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-07T22:11:04.717464] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZE took 30.4s. Estimated remaining: 22m 58s. Rate: 7.1 symbols/min [2025-10-07T22:11:04.887435] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:11:04.920132] [DEBUG] [LOCAL ] VAC: Loaded 34336 existing records from primary storage. [2025-10-07T22:11:04.920419] [INFO ] [MAIN ] VAC: Loaded 34336 existing records. [2025-10-07T22:11:05.093230] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:11:05.093433] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-07T22:11:05.093481] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-07T22:11:05.093716] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-07T22:11:05.093779] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-07T22:11:05.443850] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:11:05.447607] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-07T22:11:06.247607] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-07T22:11:06.653600] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-07T22:11:06.841300] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T22:11:07.035137] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-07T22:11:07.047722] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-07T22:11:07.847707] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-07T22:11:08.647715] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-07T22:11:09.140470] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-07T22:11:09.221153] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T22:11:09.435165] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-07T22:11:09.447631] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-07T22:11:10.247690] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-07T22:11:10.646949] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-07T22:11:10.647871] [INFO ] [REMOTE ] UZD: Full fetch complete (9386 records). [2025-10-07T22:11:10.647945] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-07T22:11:11.009831] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-07T22:11:11.016432] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-07T22:11:11.027954] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-07T22:11:11.028053] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-07T22:11:11.030753] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T22:11:11.031156] [DEBUG] [LOCAL ] UZD: Trimmed 9386 records to 6429 (keeping 200 days of data) [2025-10-07T22:11:11.055759] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-07T22:11:11.081909] [DEBUG] [LOCAL ] UZD: Primary data saved (6429 records). [2025-10-07T22:11:11.082365] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-07T22:11:11.082578] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UZD took 40.8s. Estimated remaining: 22m 49s. Rate: 7.1 symbols/min [2025-10-07T22:11:11.246694] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:11:11.295128] [DEBUG] [LOCAL ] VAL: Loaded 50256 existing records from primary storage. [2025-10-07T22:11:11.295469] [INFO ] [MAIN ] VAL: Loaded 50256 existing records. [2025-10-07T22:11:11.473327] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:11:11.473537] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-07T22:11:11.473585] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-07T22:11:11.474055] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-07T22:11:11.474112] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-07T22:11:11.851753] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:11:11.848184] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-07T22:11:12.584966] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-07T22:11:12.647714] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-07T22:11:12.741493] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-07T22:11:13.447745] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-07T22:11:14.200374] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T22:11:14.247606] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-07T22:11:15.047683] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-07T22:11:15.822683] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T22:11:15.848992] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-07T22:11:15.852602] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-07T22:11:16.406203] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T22:11:16.443638] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-07T22:11:16.647673] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-07T22:11:17.447709] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-07T22:11:18.247725] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-07T22:11:18.725182] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T22:11:18.726276] [INFO ] [REMOTE ] UZF: Full fetch complete (8816 records). [2025-10-07T22:11:18.726350] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-07T22:11:19.050966] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-07T22:11:19.126133] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-07T22:11:19.126296] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-07T22:11:19.126822] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-07T22:11:19.126908] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-07T22:11:19.127700] [DEBUG] [LOCAL ] UZF: Trimmed 8816 records to 6344 (keeping 200 days of data) [2025-10-07T22:11:19.197019] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-07T22:11:19.245452] [DEBUG] [LOCAL ] UZF: Primary data saved (6344 records). [2025-10-07T22:11:19.248388] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-07T22:11:19.248278] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-07T22:11:19.248673] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 31.6s. Estimated remaining: 22m 40s. Rate: 7.1 symbols/min [2025-10-07T22:11:19.425922] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:11:19.482950] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-07T22:11:19.483320] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-07T22:11:19.654224] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:11:19.654456] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-07T22:11:19.654502] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-07T22:11:19.655008] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-07T22:11:19.655067] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-07T22:11:19.852920] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-07T22:11:20.007565] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:11:20.607479] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-07T22:11:20.647621] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-07T22:11:21.447701] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-07T22:11:21.637419] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T22:11:22.066111] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-07T22:11:22.247684] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-07T22:11:23.047735] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-07T22:11:23.500021] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-07T22:11:23.583106] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T22:11:23.847671] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-07T22:11:24.647686] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-07T22:11:25.289778] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-07T22:11:25.447607] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-07T22:11:25.987120] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-07T22:11:26.247625] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-07T22:11:26.494566] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T22:11:27.047688] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-07T22:11:27.474010] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-07T22:11:27.847612] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-07T22:11:28.273323] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-07T22:11:28.647670] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-07T22:11:28.938853] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T22:11:29.177173] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T22:11:29.447673] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-07T22:11:30.247719] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-07T22:11:30.809356] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T22:11:30.934833] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-07T22:11:31.047729] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-07T22:11:31.847616] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-07T22:11:31.887348] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T22:11:32.201417] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T22:11:32.204143] [INFO ] [REMOTE ] VAC: Full fetch complete (48519 records). [2025-10-07T22:11:32.204238] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-07T22:11:32.604730] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-07T22:11:32.605062] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-07T22:11:32.605943] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-07T22:11:32.606005] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-07T22:11:32.607081] [DEBUG] [LOCAL ] VAC: Trimmed 48519 records to 34356 (keeping 200 days of data) [2025-10-07T22:11:32.661835] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-07T22:11:32.819821] [DEBUG] [LOCAL ] VAC: Primary data saved (34356 records). [2025-10-07T22:11:32.819965] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-07T22:11:32.820049] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. VAC took 28.1s. Estimated remaining: 22m 32s. Rate: 7.1 symbols/min [2025-10-07T22:11:32.984774] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:11:32.992889] [DEBUG] [LOCAL ] VATE: Loaded 5258 existing records from primary storage. [2025-10-07T22:11:32.993098] [INFO ] [MAIN ] VATE: Loaded 5258 existing records. [2025-10-07T22:11:33.170796] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:11:33.171005] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-07T22:11:33.171055] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-07T22:11:33.171410] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-07T22:11:33.171473] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-07T22:11:33.452710] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-07T22:11:33.524569] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:11:33.733716] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T22:11:34.247607] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-07T22:11:34.433514] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T22:11:34.914210] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T22:11:35.047706] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-07T22:11:35.847666] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-07T22:11:35.908153] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-07T22:11:36.100275] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T22:11:36.647698] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-07T22:11:37.447633] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-07T22:11:37.535786] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T22:11:37.958258] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-07T22:11:38.001896] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T22:11:38.005921] [INFO ] [REMOTE ] V: Full fetch complete (77819 records). [2025-10-07T22:11:38.006120] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-07T22:11:38.252732] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-07T22:11:38.407301] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-07T22:11:38.407390] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-07T22:11:38.408546] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-07T22:11:38.408613] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-07T22:11:38.410237] [DEBUG] [LOCAL ] V: Trimmed 77819 records to 53752 (keeping 200 days of data) [2025-10-07T22:11:38.762858] [DEBUG] [LOCAL ] V: Primary data saved (53752 records). [2025-10-07T22:11:38.763028] [INFO ] [MAIN ] V: Full history saved. [2025-10-07T22:11:38.763149] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. V took 40.7s. Estimated remaining: 22m 24s. Rate: 7.1 symbols/min [2025-10-07T22:11:38.929731] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:11:38.939422] [DEBUG] [LOCAL ] VBF: Loaded 6830 existing records from primary storage. [2025-10-07T22:11:38.939660] [INFO ] [MAIN ] VBF: Loaded 6830 existing records. [2025-10-07T22:11:39.052874] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-07T22:11:39.115925] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:11:39.116173] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-07T22:11:39.116233] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-07T22:11:39.116430] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-07T22:11:39.116491] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-07T22:11:39.475023] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:11:39.847672] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-07T22:11:40.023737] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-07T22:11:40.472862] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-07T22:11:40.647708] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-07T22:11:41.215462] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-07T22:11:41.386860] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T22:11:41.447617] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-07T22:11:42.247730] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-07T22:11:42.857634] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-07T22:11:43.047619] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-07T22:11:43.440441] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-07T22:11:43.523277] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-07T22:11:43.847708] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-07T22:11:44.647715] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-07T22:11:45.447618] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-07T22:11:45.584195] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T22:11:46.247602] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-07T22:11:46.291731] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-07T22:11:46.421347] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T22:11:46.657407] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-07T22:11:47.047740] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-07T22:11:47.672082] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T22:11:47.847620] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-07T22:11:48.433987] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-07T22:11:48.647690] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-07T22:11:49.360057] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-07T22:11:49.447694] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-07T22:11:50.247702] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-07T22:11:50.875698] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-07T22:11:50.881789] [INFO ] [REMOTE ] VAL: Full fetch complete (73180 records). [2025-10-07T22:11:50.881944] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-07T22:11:51.048275] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-07T22:11:51.304153] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-07T22:11:51.304347] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-07T22:11:51.305834] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-07T22:11:51.305914] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-07T22:11:51.308133] [DEBUG] [LOCAL ] VAL: Trimmed 73180 records to 50229 (keeping 200 days of data) [2025-10-07T22:11:51.634789] [DEBUG] [LOCAL ] VAL: Primary data saved (50229 records). [2025-10-07T22:11:51.634969] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-07T22:11:51.635174] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VAL took 40.6s. Estimated remaining: 22m 16s. Rate: 7.1 symbols/min [2025-10-07T22:11:51.809372] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:11:51.810376] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T22:11:51.826388] [DEBUG] [LOCAL ] VCV: Loaded 13605 existing records from primary storage. [2025-10-07T22:11:51.826690] [INFO ] [MAIN ] VCV: Loaded 13605 existing records. [2025-10-07T22:11:51.855496] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-07T22:11:52.008812] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:11:52.009111] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-07T22:11:52.009167] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-07T22:11:52.009460] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-07T22:11:52.009517] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-07T22:11:52.373910] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:11:52.406097] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-07T22:11:52.487582] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-07T22:11:52.647634] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-07T22:11:53.447700] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-07T22:11:53.690517] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T22:11:53.962284] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-07T22:11:54.247678] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-07T22:11:55.047714] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-07T22:11:55.067456] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T22:11:55.669209] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-07T22:11:55.847706] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-07T22:11:56.647758] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-07T22:11:57.447720] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-07T22:11:57.506356] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-07T22:11:57.828522] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-07T22:11:58.143590] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-07T22:11:58.247706] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-07T22:11:58.720486] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T22:11:58.721408] [INFO ] [REMOTE ] VATE: Full fetch complete (10518 records). [2025-10-07T22:11:58.721478] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-07T22:11:59.052495] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-07T22:11:59.081597] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-07T22:11:59.081724] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-07T22:11:59.082020] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-07T22:11:59.082062] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-07T22:11:59.082589] [DEBUG] [LOCAL ] VATE: Trimmed 10518 records to 5256 (keeping 200 days of data) [2025-10-07T22:11:59.122113] [DEBUG] [LOCAL ] VATE: Primary data saved (5256 records). [2025-10-07T22:11:59.122337] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-07T22:11:59.122488] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VATE took 26.3s. Estimated remaining: 22m 7s. Rate: 7.1 symbols/min [2025-10-07T22:11:59.291281] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:11:59.340629] [DEBUG] [LOCAL ] VEEV: Loaded 47135 existing records from primary storage. [2025-10-07T22:11:59.340971] [INFO ] [MAIN ] VEEV: Loaded 47135 existing records. [2025-10-07T22:11:59.516726] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:11:59.517009] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-07T22:11:59.517073] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-07T22:11:59.517494] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-07T22:11:59.517552] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-07T22:11:59.856271] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-07T22:11:59.861183] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:00.647732] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-07T22:12:00.735278] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-07T22:12:00.875532] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-07T22:12:00.879309] [INFO ] [REMOTE ] VALE: Full fetch complete (77763 records). [2025-10-07T22:12:00.879419] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-07T22:12:01.274557] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-07T22:12:01.274671] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-07T22:12:01.275786] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-07T22:12:01.275849] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-07T22:12:01.279418] [DEBUG] [LOCAL ] VALE: Trimmed 77763 records to 53693 (keeping 200 days of data) [2025-10-07T22:12:01.462913] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-07T22:12:01.622697] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-07T22:12:01.622854] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-07T22:12:01.622945] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VALE took 42.4s. Estimated remaining: 21m 58s. Rate: 7.1 symbols/min [2025-10-07T22:12:01.837522] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:01.856999] [DEBUG] [LOCAL ] VEL: Loaded 12584 existing records from primary storage. [2025-10-07T22:12:01.857328] [INFO ] [MAIN ] VEL: Loaded 12584 existing records. [2025-10-07T22:12:02.045977] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:12:02.046177] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-07T22:12:02.046224] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-07T22:12:02.046388] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-07T22:12:02.046476] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-07T22:12:02.259414] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-07T22:12:02.406898] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-07T22:12:02.428631] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:02.464473] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T22:12:03.047632] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-07T22:12:03.184748] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-07T22:12:03.847708] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-07T22:12:04.647617] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-07T22:12:04.698610] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T22:12:04.765974] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T22:12:05.399052] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-07T22:12:05.447734] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-07T22:12:06.247746] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-07T22:12:06.978908] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T22:12:07.047608] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-07T22:12:07.302439] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T22:12:07.773508] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-07T22:12:07.847666] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-07T22:12:08.647634] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-07T22:12:08.848235] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-07T22:12:09.447692] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-07T22:12:10.242304] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-07T22:12:10.247590] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-07T22:12:10.427152] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T22:12:10.972815] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-07T22:12:11.047727] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-07T22:12:11.847764] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-07T22:12:11.997027] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T22:12:12.558473] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-07T22:12:12.559672] [INFO ] [REMOTE ] VBF: Full fetch complete (10544 records). [2025-10-07T22:12:12.559764] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-07T22:12:12.652751] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-07T22:12:12.946552] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-07T22:12:12.946697] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-07T22:12:12.946970] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-07T22:12:12.947011] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-07T22:12:12.947465] [DEBUG] [LOCAL ] VBF: Trimmed 10544 records to 6876 (keeping 200 days of data) [2025-10-07T22:12:12.990658] [DEBUG] [LOCAL ] VBF: Primary data saved (6876 records). [2025-10-07T22:12:12.990781] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-07T22:12:12.990862] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VBF took 34.2s. Estimated remaining: 21m 50s. Rate: 7.1 symbols/min [2025-10-07T22:12:13.159561] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:13.202004] [DEBUG] [LOCAL ] VET: Loaded 43963 existing records from primary storage. [2025-10-07T22:12:13.202334] [INFO ] [MAIN ] VET: Loaded 43963 existing records. [2025-10-07T22:12:13.382379] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:12:13.382606] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-07T22:12:13.382687] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-07T22:12:13.382927] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-07T22:12:13.382984] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-07T22:12:13.455015] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-07T22:12:13.768471] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T22:12:13.790597] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:14.247678] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-07T22:12:14.412268] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T22:12:15.047736] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-07T22:12:15.155570] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-07T22:12:15.847614] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-07T22:12:16.066064] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-07T22:12:16.647699] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-07T22:12:17.202537] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T22:12:17.325835] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T22:12:17.326982] [INFO ] [REMOTE ] VCV: Full fetch complete (19158 records). [2025-10-07T22:12:17.327053] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-07T22:12:17.452827] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-07T22:12:17.695812] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-07T22:12:17.695897] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-07T22:12:17.696367] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-07T22:12:17.696456] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-07T22:12:17.697057] [DEBUG] [LOCAL ] VCV: Trimmed 19158 records to 13606 (keeping 200 days of data) [2025-10-07T22:12:17.781970] [DEBUG] [LOCAL ] VCV: Primary data saved (13606 records). [2025-10-07T22:12:17.782123] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-07T22:12:17.782234] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VCV took 26.1s. Estimated remaining: 21m 41s. Rate: 7.1 symbols/min [2025-10-07T22:12:17.951279] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:18.008680] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-07T22:12:18.009203] [INFO ] [MAIN ] VFC: Loaded 53607 existing records. [2025-10-07T22:12:18.190219] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:12:18.190455] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-07T22:12:18.190504] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-07T22:12:18.190776] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-07T22:12:18.190833] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-07T22:12:18.256308] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-07T22:12:18.641147] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:19.047620] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-07T22:12:19.163539] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T22:12:19.263950] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T22:12:19.847695] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-07T22:12:20.647634] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-07T22:12:20.775839] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T22:12:20.812674] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T22:12:21.447706] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-07T22:12:22.247730] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-07T22:12:22.324613] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T22:12:22.382027] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-07T22:12:23.047748] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-07T22:12:23.847746] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-07T22:12:23.873850] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-07T22:12:24.160567] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-07T22:12:24.647685] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-07T22:12:25.447634] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-07T22:12:25.564527] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-07T22:12:26.061518] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T22:12:26.247711] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-07T22:12:26.640761] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T22:12:27.047742] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-07T22:12:27.847630] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-07T22:12:28.202610] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-07T22:12:28.594554] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T22:12:28.647609] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-07T22:12:28.723907] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-07T22:12:29.447693] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-07T22:12:30.247729] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-07T22:12:30.321179] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T22:12:30.353054] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-07T22:12:30.354267] [INFO ] [REMOTE ] VEL: Full fetch complete (17222 records). [2025-10-07T22:12:30.354382] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-07T22:12:30.704859] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-07T22:12:30.704940] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-07T22:12:30.705315] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-07T22:12:30.705354] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-07T22:12:30.705899] [DEBUG] [LOCAL ] VEL: Trimmed 17222 records to 12530 (keeping 200 days of data) [2025-10-07T22:12:30.783225] [DEBUG] [LOCAL ] VEL: Primary data saved (12530 records). [2025-10-07T22:12:30.783334] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-07T22:12:30.783418] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 29.2s. Estimated remaining: 21m 33s. Rate: 7.1 symbols/min [2025-10-07T22:12:30.946135] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:30.946287] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-07T22:12:30.946323] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-07T22:12:30.946476] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-07T22:12:30.946523] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-07T22:12:30.946565] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-07T22:12:30.946598] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-07T22:12:31.052823] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-07T22:12:31.299134] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:31.738539] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T22:12:31.847715] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-07T22:12:32.647704] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-07T22:12:32.864738] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T22:12:32.865072] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-07T22:12:32.865159] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T22:12:32.865214] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-07T22:12:32.865276] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T22:12:32.865353] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-07T22:12:32.865420] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-07T22:12:32.865456] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-07T22:12:32.865543] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-07T22:12:32.865615] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VG took 2.1s. Estimated remaining: 21m 24s. Rate: 7.1 symbols/min [2025-10-07T22:12:33.037609] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:33.045533] [DEBUG] [LOCAL ] VGI: Loaded 5152 existing records from primary storage. [2025-10-07T22:12:33.045770] [INFO ] [MAIN ] VGI: Loaded 5152 existing records. [2025-10-07T22:12:33.227003] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:12:33.227414] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-07T22:12:33.227667] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-07T22:12:33.227877] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-07T22:12:33.228072] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-07T22:12:33.342195] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-07T22:12:33.449689] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-07T22:12:33.654009] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:33.680848] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T22:12:34.247717] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-07T22:12:35.047692] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-07T22:12:35.331528] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T22:12:35.847705] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-07T22:12:36.185574] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T22:12:36.465787] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-07T22:12:36.647614] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-07T22:12:36.743066] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T22:12:37.447696] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-07T22:12:37.924980] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T22:12:38.247709] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-07T22:12:38.632124] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T22:12:38.860107] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-07T22:12:39.047731] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-07T22:12:39.719403] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-07T22:12:39.847637] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-07T22:12:40.647713] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-07T22:12:41.447620] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-07T22:12:41.852233] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-07T22:12:42.247637] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-07T22:12:42.348230] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T22:12:43.047623] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-07T22:12:43.138516] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T22:12:43.847613] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-07T22:12:44.486243] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T22:12:44.489753] [INFO ] [REMOTE ] VEEV: Full fetch complete (68240 records). [2025-10-07T22:12:44.489886] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-07T22:12:44.653489] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-07T22:12:44.817987] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-07T22:12:44.940875] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-07T22:12:44.940984] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-07T22:12:44.942145] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-07T22:12:44.942213] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-07T22:12:44.943714] [DEBUG] [LOCAL ] VEEV: Trimmed 68240 records to 47173 (keeping 200 days of data) [2025-10-07T22:12:45.265278] [DEBUG] [LOCAL ] VEEV: Primary data saved (47173 records). [2025-10-07T22:12:45.265550] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-07T22:12:45.265817] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VEEV took 46.1s. Estimated remaining: 21m 16s. Rate: 7.1 symbols/min [2025-10-07T22:12:45.446251] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:45.453249] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T22:12:45.452422] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-07T22:12:45.482713] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-07T22:12:45.504551] [DEBUG] [LOCAL ] VGM: Loaded 18356 existing records from primary storage. [2025-10-07T22:12:45.504839] [INFO ] [MAIN ] VGM: Loaded 18356 existing records. [2025-10-07T22:12:45.678514] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:12:45.678821] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-07T22:12:45.678871] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-07T22:12:45.679102] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-07T22:12:45.679168] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-07T22:12:46.052899] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:46.247679] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-07T22:12:47.047723] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-07T22:12:47.307375] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-07T22:12:47.346282] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T22:12:47.847677] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-07T22:12:48.523414] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T22:12:48.541455] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-07T22:12:48.647690] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-07T22:12:49.447716] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-07T22:12:50.029177] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-07T22:12:50.247630] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-07T22:12:50.274250] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-07T22:12:50.277999] [INFO ] [REMOTE ] VFC: Full fetch complete (77590 records). [2025-10-07T22:12:50.278122] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-07T22:12:50.676322] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-07T22:12:50.676444] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-07T22:12:50.677796] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-07T22:12:50.677869] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-07T22:12:50.679437] [DEBUG] [LOCAL ] VFC: Trimmed 77590 records to 53607 (keeping 200 days of data) [2025-10-07T22:12:50.904977] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-07T22:12:51.028963] [DEBUG] [LOCAL ] VFC: Primary data saved (53607 records). [2025-10-07T22:12:51.029121] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-07T22:12:51.029209] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VFC took 33.2s. Estimated remaining: 21m 7s. Rate: 7.1 symbols/min [2025-10-07T22:12:51.052738] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-07T22:12:51.203281] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:51.208585] [DEBUG] [LOCAL ] VHI: Loaded 2741 existing records from primary storage. [2025-10-07T22:12:51.208780] [INFO ] [MAIN ] VHI: Loaded 2741 existing records. [2025-10-07T22:12:51.391824] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:12:51.392067] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-07T22:12:51.392136] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-07T22:12:51.392363] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-07T22:12:51.392421] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-07T22:12:51.770369] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:51.776736] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-07T22:12:51.847714] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-07T22:12:52.414059] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-07T22:12:52.647639] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-07T22:12:53.447735] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-07T22:12:54.114222] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-07T22:12:54.247681] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-07T22:12:54.327590] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T22:12:54.988614] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T22:12:55.047625] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-07T22:12:55.577418] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-07T22:12:55.578466] [INFO ] [REMOTE ] VGI: Full fetch complete (7655 records). [2025-10-07T22:12:55.578541] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-07T22:12:55.852900] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-07T22:12:55.954905] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-07T22:12:55.954992] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-07T22:12:55.955277] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-07T22:12:55.955338] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-07T22:12:55.955762] [DEBUG] [LOCAL ] VGI: Trimmed 7655 records to 5160 (keeping 200 days of data) [2025-10-07T22:12:55.986849] [DEBUG] [LOCAL ] VGI: Primary data saved (5160 records). [2025-10-07T22:12:55.986948] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-07T22:12:55.987031] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VGI took 23.1s. Estimated remaining: 20m 59s. Rate: 7.1 symbols/min [2025-10-07T22:12:56.152483] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:56.152707] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-07T22:12:56.152761] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-07T22:12:56.152895] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-07T22:12:56.152938] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-07T22:12:56.152979] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-07T22:12:56.153011] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-07T22:12:56.494712] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:56.647703] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-07T22:12:56.862337] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T22:12:56.862748] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-07T22:12:56.862837] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T22:12:56.862887] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-07T22:12:56.862946] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T22:12:56.863018] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-07T22:12:56.863085] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-07T22:12:56.863121] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-07T22:12:56.863160] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-07T22:12:56.863209] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VIA took 0.9s. Estimated remaining: 20m 50s. Rate: 7.1 symbols/min [2025-10-07T22:12:57.044149] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:57.097477] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-10-07T22:12:57.097886] [INFO ] [MAIN ] VICI: Loaded 53647 existing records. [2025-10-07T22:12:57.270590] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:12:57.270823] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-07T22:12:57.270870] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-07T22:12:57.271127] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-07T22:12:57.271185] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-07T22:12:57.377246] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-07T22:12:57.456607] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-07T22:12:57.440933] [INFO ] [REMOTE ] VET: Full fetch complete (64619 records). [2025-10-07T22:12:57.461214] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-07T22:12:57.807028] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:58.037473] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-07T22:12:58.037568] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-07T22:12:58.038717] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-07T22:12:58.038786] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-07T22:12:58.040256] [DEBUG] [LOCAL ] VET: Trimmed 64619 records to 43950 (keeping 200 days of data) [2025-10-07T22:12:58.138729] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-07T22:12:58.256004] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-07T22:12:58.317231] [DEBUG] [LOCAL ] VET: Primary data saved (43950 records). [2025-10-07T22:12:58.317392] [INFO ] [MAIN ] VET: Full history saved. [2025-10-07T22:12:58.317492] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VET took 45.3s. Estimated remaining: 20m 41s. Rate: 7.1 symbols/min [2025-10-07T22:12:58.481966] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:12:58.540015] [DEBUG] [LOCAL ] VIK: Loaded 52458 existing records from primary storage. [2025-10-07T22:12:58.540393] [INFO ] [MAIN ] VIK: Loaded 52458 existing records. [2025-10-07T22:12:58.719807] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:12:58.720032] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-07T22:12:58.720081] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-07T22:12:58.720286] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-07T22:12:58.720382] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-07T22:12:58.979083] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T22:12:59.052733] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-07T22:12:59.081718] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:12:59.847627] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-07T22:13:00.115437] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T22:13:00.543472] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-07T22:13:00.647726] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-07T22:13:01.447629] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-07T22:13:01.664784] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-07T22:13:02.247691] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-07T22:13:02.801937] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-07T22:13:03.047635] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-07T22:13:03.498401] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-07T22:13:03.847668] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-07T22:13:04.647716] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-07T22:13:04.790010] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T22:13:05.213342] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T22:13:05.447713] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-07T22:13:05.898982] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-07T22:13:06.066588] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T22:13:06.247624] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-07T22:13:06.885825] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-07T22:13:07.047675] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-07T22:13:07.847669] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-07T22:13:08.647711] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-07T22:13:08.866137] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T22:13:08.948503] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-07T22:13:09.192221] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-07T22:13:09.447625] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-07T22:13:10.247720] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-07T22:13:10.975603] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T22:13:11.021920] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T22:13:11.047603] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-07T22:13:11.847677] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-07T22:13:12.242163] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T22:13:12.624547] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-07T22:13:12.647593] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-07T22:13:13.067320] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-07T22:13:13.068128] [INFO ] [REMOTE ] VHI: Full fetch complete (4419 records). [2025-10-07T22:13:13.068242] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-07T22:13:13.454532] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-07T22:13:13.499132] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-07T22:13:13.499217] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-07T22:13:13.499365] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-07T22:13:13.499403] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-07T22:13:13.499831] [DEBUG] [LOCAL ] VHI: Trimmed 4419 records to 2686 (keeping 200 days of data) [2025-10-07T22:13:13.518968] [DEBUG] [LOCAL ] VHI: Primary data saved (2686 records). [2025-10-07T22:13:13.519094] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-07T22:13:13.519193] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VHI took 22.5s. Estimated remaining: 20m 33s. Rate: 7.1 symbols/min [2025-10-07T22:13:13.705520] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:13:13.763209] [DEBUG] [LOCAL ] VIPS: Loaded 51264 existing records from primary storage. [2025-10-07T22:13:13.763718] [INFO ] [MAIN ] VIPS: Loaded 51264 existing records. [2025-10-07T22:13:13.982158] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:13:13.982474] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-07T22:13:13.982550] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-07T22:13:13.982880] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-07T22:13:13.982962] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-07T22:13:14.252963] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-07T22:13:14.451436] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:13:15.047727] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-07T22:13:15.413575] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T22:13:15.473726] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-07T22:13:15.847776] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-07T22:13:16.647637] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-07T22:13:16.729883] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T22:13:17.309892] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T22:13:17.447637] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-07T22:13:18.247639] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-07T22:13:18.519662] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T22:13:19.047727] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-07T22:13:19.295117] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T22:13:19.854309] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-07T22:13:19.879309] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T22:13:20.647630] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-07T22:13:20.860823] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-07T22:13:21.122288] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-07T22:13:21.447693] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-07T22:13:22.247637] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-07T22:13:22.386542] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T22:13:22.447897] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-07T22:13:23.047690] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-07T22:13:23.854759] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-07T22:13:23.857847] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-07T22:13:24.647703] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-07T22:13:24.746866] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-07T22:13:25.447734] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-07T22:13:25.504231] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-07T22:13:25.506390] [INFO ] [REMOTE ] VGM: Full fetch complete (26192 records). [2025-10-07T22:13:25.506516] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-07T22:13:25.924790] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-07T22:13:25.925097] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-07T22:13:25.926212] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-07T22:13:25.926382] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-07T22:13:25.927775] [DEBUG] [LOCAL ] VGM: Trimmed 26192 records to 18411 (keeping 200 days of data) [2025-10-07T22:13:26.081432] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-07T22:13:26.119768] [DEBUG] [LOCAL ] VGM: Primary data saved (18411 records). [2025-10-07T22:13:26.119952] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-07T22:13:26.120100] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VGM took 40.9s. Estimated remaining: 20m 25s. Rate: 7.1 symbols/min [2025-10-07T22:13:26.252823] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-07T22:13:26.307347] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:13:26.350231] [DEBUG] [LOCAL ] VIRT: Loaded 46743 existing records from primary storage. [2025-10-07T22:13:26.350561] [INFO ] [MAIN ] VIRT: Loaded 46743 existing records. [2025-10-07T22:13:26.532171] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:13:26.532391] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-07T22:13:26.532442] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-07T22:13:26.532747] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-07T22:13:26.532810] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-07T22:13:26.929476] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:13:27.047634] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-07T22:13:27.500831] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T22:13:27.847755] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-07T22:13:28.064902] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T22:13:28.580714] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-07T22:13:28.647722] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-07T22:13:29.447734] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-07T22:13:29.617472] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T22:13:30.182497] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T22:13:30.247724] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-07T22:13:30.831336] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T22:13:31.047694] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-07T22:13:31.735535] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T22:13:31.847712] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-07T22:13:32.647717] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-07T22:13:32.981195] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-07T22:13:33.447626] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-07T22:13:33.827966] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T22:13:34.247621] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-07T22:13:34.315716] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T22:13:35.047677] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-07T22:13:35.190510] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T22:13:35.847696] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-07T22:13:36.068010] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-07T22:13:36.647624] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-07T22:13:36.737006] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T22:13:37.447676] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-07T22:13:37.658582] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T22:13:38.247618] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-07T22:13:38.294055] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T22:13:39.025052] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-07T22:13:39.047621] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-07T22:13:39.852840] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-07T22:13:39.867720] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T22:13:40.598504] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T22:13:40.647672] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-07T22:13:41.447631] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-07T22:13:41.968766] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-07T22:13:42.005185] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T22:13:42.009133] [INFO ] [REMOTE ] VIK: Full fetch complete (75921 records). [2025-10-07T22:13:42.009266] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-07T22:13:42.260143] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-07T22:13:42.393720] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-07T22:13:42.393812] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-07T22:13:42.394935] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-07T22:13:42.395001] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-07T22:13:42.396500] [DEBUG] [LOCAL ] VIK: Trimmed 75921 records to 52468 (keeping 200 days of data) [2025-10-07T22:13:42.707306] [DEBUG] [LOCAL ] VIK: Primary data saved (52468 records). [2025-10-07T22:13:42.707474] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-07T22:13:42.707564] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VIK took 44.4s. Estimated remaining: 20m 17s. Rate: 7.1 symbols/min [2025-10-07T22:13:42.877278] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:13:42.923327] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T22:13:42.975608] [DEBUG] [LOCAL ] VIST: Loaded 46052 existing records from primary storage. [2025-10-07T22:13:42.976086] [INFO ] [MAIN ] VIST: Loaded 46052 existing records. [2025-10-07T22:13:43.052777] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-07T22:13:43.151941] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:13:43.152170] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-07T22:13:43.152220] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-07T22:13:43.152742] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-07T22:13:43.152800] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-07T22:13:43.508785] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:13:43.588353] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T22:13:43.592816] [INFO ] [REMOTE ] VICI: Full fetch complete (77658 records). [2025-10-07T22:13:43.592941] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-07T22:13:43.857878] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-07T22:13:43.987903] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-07T22:13:43.988091] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-07T22:13:43.989288] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-07T22:13:43.989371] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-07T22:13:44.001884] [DEBUG] [LOCAL ] VICI: Trimmed 77658 records to 53649 (keeping 200 days of data) [2025-10-07T22:13:44.020157] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T22:13:44.367262] [DEBUG] [LOCAL ] VICI: Primary data saved (53649 records). [2025-10-07T22:13:44.367435] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-07T22:13:44.367616] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VICI took 47.5s. Estimated remaining: 20m 8s. Rate: 7.1 symbols/min [2025-10-07T22:13:44.532515] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:13:44.577919] [DEBUG] [LOCAL ] VIV: Loaded 44822 existing records from primary storage. [2025-10-07T22:13:44.578227] [INFO ] [MAIN ] VIV: Loaded 44822 existing records. [2025-10-07T22:13:44.652938] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-07T22:13:44.839627] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:13:44.839951] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-07T22:13:44.840036] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-07T22:13:44.840527] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-07T22:13:44.840610] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-07T22:13:45.200092] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:13:45.250474] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T22:13:45.254031] [INFO ] [REMOTE ] VIPS: Full fetch complete (74567 records). [2025-10-07T22:13:45.254138] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-07T22:13:45.452888] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-07T22:13:45.663723] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-07T22:13:45.663824] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-07T22:13:45.665000] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-07T22:13:45.665109] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-07T22:13:45.666730] [DEBUG] [LOCAL ] VIPS: Trimmed 74567 records to 51250 (keeping 200 days of data) [2025-10-07T22:13:45.991353] [DEBUG] [LOCAL ] VIPS: Primary data saved (51250 records). [2025-10-07T22:13:45.991607] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-07T22:13:45.991762] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIPS took 32.5s. Estimated remaining: 19m 59s. Rate: 7.1 symbols/min [2025-10-07T22:13:46.175815] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:13:46.194541] [DEBUG] [LOCAL ] VKQ: Loaded 17502 existing records from primary storage. [2025-10-07T22:13:46.194950] [INFO ] [MAIN ] VKQ: Loaded 17502 existing records. [2025-10-07T22:13:46.255338] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-07T22:13:46.395251] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:13:46.395748] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-07T22:13:46.395894] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-07T22:13:46.396237] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-07T22:13:46.396299] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-07T22:13:46.551463] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-07T22:13:46.846458] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:13:47.047637] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-07T22:13:47.153125] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-07T22:13:47.840704] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-07T22:13:47.851153] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-07T22:13:48.044455] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-07T22:13:48.647692] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-07T22:13:49.452930] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-07T22:13:49.471046] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-07T22:13:50.249950] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-07T22:13:50.255992] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-07T22:13:50.489124] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T22:13:51.047731] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-07T22:13:51.847729] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-07T22:13:51.950430] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T22:13:52.578235] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-07T22:13:52.647630] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-07T22:13:52.678721] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-07T22:13:53.447738] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-07T22:13:54.247881] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-07T22:13:54.250937] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-07T22:13:54.995156] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T22:13:55.041003] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-07T22:13:55.047597] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-07T22:13:55.847750] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-07T22:13:56.058535] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-07T22:13:56.647772] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-07T22:13:57.149352] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T22:13:57.153388] [INFO ] [REMOTE ] VIRT: Full fetch complete (67218 records). [2025-10-07T22:13:57.153564] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-07T22:13:57.450705] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-07T22:13:57.595591] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-07T22:13:57.597192] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T22:13:57.597306] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-07T22:13:57.603173] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-07T22:13:57.604023] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-07T22:13:57.606533] [DEBUG] [LOCAL ] VIRT: Trimmed 67218 records to 46744 (keeping 200 days of data) [2025-10-07T22:13:57.904295] [DEBUG] [LOCAL ] VIRT: Primary data saved (46744 records). [2025-10-07T22:13:57.904447] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-07T22:13:57.904539] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIRT took 31.8s. Estimated remaining: 19m 51s. Rate: 7.1 symbols/min [2025-10-07T22:13:58.069947] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:13:58.100561] [DEBUG] [LOCAL ] VLN: Loaded 29417 existing records from primary storage. [2025-10-07T22:13:58.100869] [INFO ] [MAIN ] VLN: Loaded 29417 existing records. [2025-10-07T22:13:58.252811] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-07T22:13:58.286195] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:13:58.286955] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-07T22:13:58.287023] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-07T22:13:58.287252] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-07T22:13:58.287319] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-07T22:13:58.638613] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:13:59.047700] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-07T22:13:59.475122] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-07T22:13:59.760356] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T22:13:59.847707] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-07T22:14:00.085800] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T22:14:00.647736] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-07T22:14:01.447621] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-07T22:14:01.556031] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T22:14:01.676103] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-07T22:14:02.247709] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-07T22:14:03.012022] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T22:14:03.047589] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-07T22:14:03.278252] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T22:14:03.847706] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-07T22:14:04.428236] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-07T22:14:04.647636] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-07T22:14:04.857340] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-07T22:14:05.447684] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-07T22:14:05.555955] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-07T22:14:06.247739] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-07T22:14:07.053022] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-07T22:14:07.079232] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T22:14:07.082691] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T22:14:07.085837] [INFO ] [REMOTE ] VKQ: Full fetch complete (24678 records). [2025-10-07T22:14:07.096828] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-07T22:14:07.501052] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-07T22:14:07.501168] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-07T22:14:07.501787] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-07T22:14:07.501855] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-07T22:14:07.502833] [DEBUG] [LOCAL ] VKQ: Trimmed 24678 records to 17408 (keeping 200 days of data) [2025-10-07T22:14:07.613359] [DEBUG] [LOCAL ] VKQ: Primary data saved (17408 records). [2025-10-07T22:14:07.613549] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-07T22:14:07.613676] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VKQ took 21.6s. Estimated remaining: 19m 42s. Rate: 7.1 symbols/min [2025-10-07T22:14:07.789768] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:14:07.841491] [DEBUG] [LOCAL ] VLO: Loaded 53078 existing records from primary storage. [2025-10-07T22:14:07.841915] [INFO ] [MAIN ] VLO: Loaded 53078 existing records. [2025-10-07T22:14:07.853599] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-07T22:14:08.036800] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:14:08.037341] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-07T22:14:08.037549] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-07T22:14:08.050169] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-07T22:14:08.050782] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-07T22:14:08.050703] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-07T22:14:08.403920] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:14:08.647696] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-07T22:14:09.257463] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T22:14:09.447724] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-07T22:14:10.221740] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T22:14:10.247613] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-07T22:14:11.048879] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-07T22:14:11.048691] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-07T22:14:11.628808] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T22:14:11.847701] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-07T22:14:12.321695] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T22:14:12.647681] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-07T22:14:13.447754] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-07T22:14:13.526177] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T22:14:13.828406] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-07T22:14:14.247707] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-07T22:14:14.496888] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T22:14:15.047703] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-07T22:14:15.824455] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T22:14:15.847606] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-07T22:14:16.647631] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-07T22:14:16.772938] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T22:14:17.447629] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-07T22:14:17.652407] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T22:14:17.838943] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T22:14:18.247704] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-07T22:14:19.047691] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-07T22:14:19.336922] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-07T22:14:19.400937] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-07T22:14:19.847698] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-07T22:14:20.467855] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-07T22:14:20.471241] [INFO ] [REMOTE ] VIST: Full fetch complete (66786 records). [2025-10-07T22:14:20.471358] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-07T22:14:20.660855] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-07T22:14:20.879079] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-07T22:14:20.879168] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-07T22:14:20.880196] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-07T22:14:20.880261] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-07T22:14:20.881726] [DEBUG] [LOCAL ] VIST: Trimmed 66786 records to 46125 (keeping 200 days of data) [2025-10-07T22:14:21.176516] [DEBUG] [LOCAL ] VIST: Primary data saved (46125 records). [2025-10-07T22:14:21.176699] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-07T22:14:21.176834] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIST took 38.5s. Estimated remaining: 19m 34s. Rate: 7.1 symbols/min [2025-10-07T22:14:21.358845] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:14:21.398589] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-07T22:14:21.439591] [DEBUG] [LOCAL ] VLRS: Loaded 40255 existing records from primary storage. [2025-10-07T22:14:21.439983] [INFO ] [MAIN ] VLRS: Loaded 40255 existing records. [2025-10-07T22:14:21.452908] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-07T22:14:21.616872] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:14:21.617133] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-07T22:14:21.617184] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-07T22:14:21.617401] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-07T22:14:21.617457] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-07T22:14:21.973361] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:14:22.247721] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-07T22:14:22.545805] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-07T22:14:23.007450] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T22:14:23.047637] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-07T22:14:23.299633] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-07T22:14:23.847732] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-07T22:14:24.647686] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-07T22:14:24.814838] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T22:14:25.104754] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T22:14:25.107966] [INFO ] [REMOTE ] VIV: Full fetch complete (64573 records). [2025-10-07T22:14:25.108075] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-07T22:14:25.453679] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-07T22:14:25.494071] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-07T22:14:25.494135] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-07T22:14:25.495168] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-07T22:14:25.495389] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-07T22:14:25.497326] [DEBUG] [LOCAL ] VIV: Trimmed 64573 records to 44825 (keeping 200 days of data) [2025-10-07T22:14:25.744592] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T22:14:25.813815] [DEBUG] [LOCAL ] VIV: Primary data saved (44825 records). [2025-10-07T22:14:25.813981] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-07T22:14:25.814073] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VIV took 41.4s. Estimated remaining: 19m 26s. Rate: 7.1 symbols/min [2025-10-07T22:14:25.987088] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:14:25.994903] [DEBUG] [LOCAL ] VLT: Loaded 4567 existing records from primary storage. [2025-10-07T22:14:25.995143] [INFO ] [MAIN ] VLT: Loaded 4567 existing records. [2025-10-07T22:14:26.177858] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:14:26.178081] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-07T22:14:26.178130] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-07T22:14:26.178371] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-07T22:14:26.178429] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-07T22:14:26.255004] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-07T22:14:26.555600] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:14:26.976607] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-07T22:14:27.047694] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-07T22:14:27.774214] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-07T22:14:27.847606] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-07T22:14:28.017385] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-07T22:14:28.020173] [INFO ] [REMOTE ] VLN: Full fetch complete (43136 records). [2025-10-07T22:14:28.020257] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-07T22:14:28.402675] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-07T22:14:28.402802] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-07T22:14:28.403624] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-07T22:14:28.403699] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-07T22:14:28.404573] [DEBUG] [LOCAL ] VLN: Trimmed 43136 records to 29562 (keeping 200 days of data) [2025-10-07T22:14:28.572182] [DEBUG] [LOCAL ] VLN: Primary data saved (29562 records). [2025-10-07T22:14:28.572367] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-07T22:14:28.572478] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 30.7s. Estimated remaining: 19m 17s. Rate: 7.1 symbols/min [2025-10-07T22:14:28.653125] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-07T22:14:28.746752] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:14:28.791475] [DEBUG] [LOCAL ] VLTO: Loaded 46078 existing records from primary storage. [2025-10-07T22:14:28.791811] [INFO ] [MAIN ] VLTO: Loaded 46078 existing records. [2025-10-07T22:14:28.965312] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:14:28.965703] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-07T22:14:28.965863] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-07T22:14:28.966233] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-07T22:14:28.966291] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-07T22:14:29.345794] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:14:29.392337] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T22:14:29.447617] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-07T22:14:30.247722] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-07T22:14:30.444038] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-07T22:14:30.559112] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-07T22:14:31.047686] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-07T22:14:31.652983] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-07T22:14:31.844187] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T22:14:31.852847] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-07T22:14:32.647721] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-07T22:14:33.447675] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-07T22:14:33.769680] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-07T22:14:34.252784] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-07T22:14:34.270458] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T22:14:34.604958] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T22:14:35.015990] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-07T22:14:35.047740] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-07T22:14:35.847685] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-07T22:14:36.248271] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-07T22:14:36.626108] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T22:14:36.647608] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-07T22:14:37.447688] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-07T22:14:38.103417] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T22:14:38.247633] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-07T22:14:39.047624] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-07T22:14:39.456702] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T22:14:39.847615] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-07T22:14:39.956330] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T22:14:40.472224] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-07T22:14:40.647713] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-07T22:14:41.447667] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-07T22:14:41.876870] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-07T22:14:41.956158] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-07T22:14:42.065952] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-07T22:14:42.247698] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-07T22:14:43.047635] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-07T22:14:43.499752] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T22:14:43.847636] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-07T22:14:44.647632] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-07T22:14:44.993138] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-07T22:14:45.447718] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-07T22:14:45.767366] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T22:14:45.799727] [INFO ] [REMOTE ] VLRS: Full fetch complete (58512 records). [2025-10-07T22:14:45.803402] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-07T22:14:45.849038] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-07T22:14:46.239918] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-07T22:14:46.240008] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-07T22:14:46.240994] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-07T22:14:46.241062] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-07T22:14:46.242386] [DEBUG] [LOCAL ] VLRS: Trimmed 58512 records to 40224 (keeping 200 days of data) [2025-10-07T22:14:46.287202] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-07T22:14:46.492448] [DEBUG] [LOCAL ] VLRS: Primary data saved (40224 records). [2025-10-07T22:14:46.492594] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-07T22:14:46.492708] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLRS took 25.3s. Estimated remaining: 19m 9s. Rate: 7.1 symbols/min [2025-10-07T22:14:46.703014] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:14:46.753388] [DEBUG] [LOCAL ] VMC: Loaded 43049 existing records from primary storage. [2025-10-07T22:14:46.753935] [INFO ] [MAIN ] VMC: Loaded 43049 existing records. [2025-10-07T22:14:46.980126] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:14:46.980799] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-07T22:14:46.980977] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-07T22:14:46.981500] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-07T22:14:46.981558] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-07T22:14:47.051938] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-07T22:14:47.088481] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-07T22:14:47.410493] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:14:47.404575] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T22:14:47.847690] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-07T22:14:48.647623] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-07T22:14:48.869342] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-07T22:14:49.319542] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T22:14:49.350134] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-07T22:14:49.447684] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-07T22:14:50.247721] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-07T22:14:51.047741] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-07T22:14:51.137820] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-07T22:14:51.423452] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-07T22:14:51.847680] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-07T22:14:51.909038] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T22:14:52.647765] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-07T22:14:53.447767] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-07T22:14:53.477859] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T22:14:53.508949] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T22:14:54.103609] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T22:14:54.108006] [INFO ] [REMOTE ] VLO: Full fetch complete (76914 records). [2025-10-07T22:14:54.108218] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-07T22:14:54.252758] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-07T22:14:54.527217] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-07T22:14:54.527303] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-07T22:14:54.528456] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-07T22:14:54.528524] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-07T22:14:54.530087] [DEBUG] [LOCAL ] VLO: Trimmed 76914 records to 53084 (keeping 200 days of data) [2025-10-07T22:14:54.870184] [DEBUG] [LOCAL ] VLO: Primary data saved (53084 records). [2025-10-07T22:14:54.870348] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-07T22:14:54.870441] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLO took 47.3s. Estimated remaining: 19m 1s. Rate: 7.1 symbols/min [2025-10-07T22:14:55.042774] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:14:55.047816] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-07T22:14:55.062127] [DEBUG] [LOCAL ] VMI: Loaded 15475 existing records from primary storage. [2025-10-07T22:14:55.062555] [INFO ] [MAIN ] VMI: Loaded 15475 existing records. [2025-10-07T22:14:55.239492] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:14:55.239768] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-07T22:14:55.239824] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-07T22:14:55.240036] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-07T22:14:55.240097] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-07T22:14:55.603634] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:14:55.652972] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T22:14:55.723084] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-07T22:14:55.847635] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-07T22:14:56.647701] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-07T22:14:57.230303] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-07T22:14:57.447696] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-07T22:14:58.247712] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-07T22:14:58.291558] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T22:14:58.339729] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-07T22:14:58.916137] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-07T22:14:59.047845] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-07T22:14:59.847750] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-07T22:15:00.024994] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-07T22:15:00.278297] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-07T22:15:00.280295] [INFO ] [REMOTE ] VLT: Full fetch complete (7536 records). [2025-10-07T22:15:00.280541] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-07T22:15:00.649241] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-07T22:15:00.649905] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-07T22:15:00.650087] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-07T22:15:00.651488] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-07T22:15:00.651567] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-07T22:15:00.652775] [DEBUG] [LOCAL ] VLT: Trimmed 7536 records to 4609 (keeping 200 days of data) [2025-10-07T22:15:00.685486] [DEBUG] [LOCAL ] VLT: Primary data saved (4609 records). [2025-10-07T22:15:00.685681] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-07T22:15:00.685840] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLT took 34.9s. Estimated remaining: 18m 52s. Rate: 7.1 symbols/min [2025-10-07T22:15:01.447724] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-07T22:15:02.247696] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-07T22:15:02.462842] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-07T22:15:03.047628] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-07T22:15:03.142801] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T22:15:03.320829] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T22:15:03.357926] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-07T22:15:03.361298] [INFO ] [REMOTE ] VLTO: Full fetch complete (66997 records). [2025-10-07T22:15:03.361414] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-07T22:15:03.796485] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-07T22:15:03.796580] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-07T22:15:03.798076] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-07T22:15:03.798141] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-07T22:15:03.799459] [DEBUG] [LOCAL ] VLTO: Trimmed 66997 records to 46108 (keeping 200 days of data) [2025-10-07T22:15:03.853986] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-07T22:15:04.093759] [DEBUG] [LOCAL ] VLTO: Primary data saved (46108 records). [2025-10-07T22:15:04.093904] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-07T22:15:04.093988] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 35.5s. Estimated remaining: 18m 43s. Rate: 7.1 symbols/min [2025-10-07T22:15:04.647710] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-07T22:15:04.943684] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T22:15:05.447701] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-07T22:15:06.280100] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-07T22:15:06.285115] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-07T22:15:06.488977] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T22:15:07.047756] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-07T22:15:07.232456] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-07T22:15:07.847696] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-07T22:15:08.829785] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-07T22:15:08.840322] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-07T22:15:08.916066] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T22:15:09.447748] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-07T22:15:10.400178] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-07T22:15:10.406732] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-07T22:15:10.458031] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T22:15:11.047681] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-07T22:15:11.393537] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-07T22:15:11.847752] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-07T22:15:12.874120] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T22:15:12.885056] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-07T22:15:12.907029] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-07T22:15:13.447729] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-07T22:15:14.388365] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T22:15:14.389756] [INFO ] [REMOTE ] VMI: Full fetch complete (21236 records). [2025-10-07T22:15:14.389826] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-07T22:15:14.587492] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T22:15:14.672918] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-07T22:15:14.786127] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-07T22:15:14.786200] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-07T22:15:14.786685] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-07T22:15:14.786748] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-07T22:15:14.787297] [DEBUG] [LOCAL ] VMI: Trimmed 21236 records to 15480 (keeping 200 days of data) [2025-10-07T22:15:14.883786] [DEBUG] [LOCAL ] VMI: Primary data saved (15480 records). [2025-10-07T22:15:14.883929] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-07T22:15:14.884012] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMI took 20.0s. Estimated remaining: 18m 35s. Rate: 7.1 symbols/min [2025-10-07T22:15:16.236086] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T22:15:16.245390] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-07T22:15:16.765433] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-07T22:15:16.769064] [INFO ] [REMOTE ] VMC: Full fetch complete (62461 records). [2025-10-07T22:15:16.769216] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-07T22:15:17.197183] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-07T22:15:17.197311] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-07T22:15:17.199411] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-07T22:15:17.199490] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-07T22:15:17.201561] [DEBUG] [LOCAL ] VMC: Trimmed 62461 records to 43009 (keeping 200 days of data) [2025-10-07T22:15:17.506452] [DEBUG] [LOCAL ] VMC: Primary data saved (43009 records). [2025-10-07T22:15:17.506670] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-07T22:15:17.506802] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 31.0s. Estimated remaining: 18m 26s. Rate: 7.1 symbols/min [2025-10-07T22:15:18.137281] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:15:18.194014] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:15:18.199760] [DEBUG] [LOCAL ] VMO: No existing data file found in primary storage. [2025-10-07T22:15:18.304737] [WARN ] [MAIN ] VMO: No existing data found, performing full refresh instead. [2025-10-07T22:15:18.359939] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:15:18.360423] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-07T22:15:18.363390] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-07T22:15:18.365336] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:15:18.366250] [DEBUG] [LOCAL ] VMO: No primary data file found to delete. [2025-10-07T22:15:18.366517] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-07T22:15:18.394926] [DEBUG] [LOCAL ] VNCE: Loaded 8381 existing records from primary storage. [2025-10-07T22:15:18.416139] [INFO ] [MAIN ] VNCE: Loaded 8381 existing records. [2025-10-07T22:15:18.960957] [DEBUG] [LOCAL ] VNT: Loaded 43570 existing records from primary storage. [2025-10-07T22:15:18.990134] [DEBUG] [LOCAL ] VNO: Loaded 48836 existing records from primary storage. [2025-10-07T22:15:18.999966] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:15:19.015778] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-07T22:15:18.995327] [INFO ] [MAIN ] VNT: Loaded 43570 existing records. [2025-10-07T22:15:19.015921] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-07T22:15:19.046714] [INFO ] [MAIN ] VNO: Loaded 48836 existing records. [2025-10-07T22:15:19.168783] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:15:19.143684] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-07T22:15:19.211303] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-07T22:15:19.211205] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-07T22:15:19.449187] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:15:19.497860] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-07T22:15:19.516583] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-07T22:15:19.559443] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-07T22:15:19.591047] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:15:19.591251] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-07T22:15:19.612518] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-07T22:15:19.628002] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-07T22:15:19.661697] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-07T22:15:19.677588] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-07T22:15:20.336263] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:15:20.483752] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-07T22:15:20.611207] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:15:20.649102] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-07T22:15:20.658443] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T22:15:20.690226] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:15:20.700876] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-07T22:15:20.700447] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-07T22:15:21.656101] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-07T22:15:21.660762] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-07T22:15:21.742025] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-07T22:15:21.746819] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-07T22:15:22.215226] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-07T22:15:22.224344] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-07T22:15:22.351510] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-07T22:15:22.364033] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-07T22:15:22.635012] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-07T22:15:22.718828] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T22:15:23.047661] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-07T22:15:23.808715] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-07T22:15:23.847664] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-07T22:15:23.867407] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T22:15:24.007419] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-07T22:15:24.647691] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-07T22:15:25.448960] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-07T22:15:25.450552] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T22:15:26.247613] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-07T22:15:26.302327] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-07T22:15:26.350533] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T22:15:27.047674] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-07T22:15:27.673159] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-07T22:15:27.847622] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-07T22:15:27.881367] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-07T22:15:28.448281] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T22:15:28.647679] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-07T22:15:29.305104] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-07T22:15:29.447694] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-07T22:15:30.247695] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-07T22:15:31.047626] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-07T22:15:31.090186] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T22:15:31.806784] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T22:15:31.847622] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-07T22:15:31.917987] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T22:15:32.647608] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-07T22:15:32.744115] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T22:15:33.315136] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-07T22:15:33.447685] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-07T22:15:34.247633] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-07T22:15:34.456590] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T22:15:35.047704] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-07T22:15:35.767610] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-07T22:15:35.847706] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-07T22:15:36.405780] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-07T22:15:36.647670] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-07T22:15:36.796798] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-07T22:15:37.447616] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-07T22:15:37.720207] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-07T22:15:38.247632] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-07T22:15:38.822279] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T22:15:39.047673] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-07T22:15:39.847625] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-07T22:15:39.969730] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T22:15:40.123192] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-07T22:15:40.647702] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-07T22:15:41.069862] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-07T22:15:41.447707] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-07T22:15:42.247732] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-07T22:15:42.349779] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T22:15:42.624529] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T22:15:42.626375] [INFO ] [REMOTE ] VNCE: Full fetch complete (16403 records). [2025-10-07T22:15:42.626489] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-07T22:15:42.986788] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-07T22:15:42.986867] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-07T22:15:42.987220] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-07T22:15:42.987259] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-07T22:15:42.987800] [DEBUG] [LOCAL ] VNCE: Trimmed 16403 records to 8460 (keeping 200 days of data) [2025-10-07T22:15:43.039325] [DEBUG] [LOCAL ] VNCE: Primary data saved (8460 records). [2025-10-07T22:15:43.039478] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-07T22:15:43.039585] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 25.5s. Estimated remaining: 18m 19s. Rate: 7.1 symbols/min [2025-10-07T22:15:43.052767] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-07T22:15:43.212949] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:15:43.223931] [DEBUG] [LOCAL ] VOC: Loaded 8980 existing records from primary storage. [2025-10-07T22:15:43.224173] [INFO ] [MAIN ] VOC: Loaded 8980 existing records. [2025-10-07T22:15:43.380325] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-07T22:15:43.426006] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:15:43.426226] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-07T22:15:43.426278] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-07T22:15:43.426520] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-07T22:15:43.426578] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-07T22:15:43.772441] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:15:43.847616] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-07T22:15:44.647611] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-07T22:15:44.685316] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-07T22:15:44.700742] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T22:15:45.447626] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-07T22:15:45.690034] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T22:15:46.247709] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-07T22:15:47.019245] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T22:15:47.047707] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-07T22:15:47.075361] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T22:15:47.847697] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-07T22:15:48.607987] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-07T22:15:48.647685] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-07T22:15:48.679488] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T22:15:48.681988] [INFO ] [REMOTE ] VMO: Full fetch complete (31273 records). [2025-10-07T22:15:48.682098] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-07T22:15:49.170314] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-07T22:15:49.170457] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-07T22:15:49.171854] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-07T22:15:49.171924] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-07T22:15:49.173420] [DEBUG] [LOCAL ] VMO: Trimmed 31273 records to 20921 (keeping 200 days of data) [2025-10-07T22:15:49.323339] [DEBUG] [LOCAL ] VMO: Primary data saved (20921 records). [2025-10-07T22:15:49.323534] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-07T22:15:49.323664] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VMO took 31.8s. Estimated remaining: 18m 10s. Rate: 7.1 symbols/min [2025-10-07T22:15:49.449678] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-07T22:15:49.505240] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T22:15:49.550498] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:15:49.613939] [DEBUG] [LOCAL ] VOYA: Loaded 42371 existing records from primary storage. [2025-10-07T22:15:49.614399] [INFO ] [MAIN ] VOYA: Loaded 42371 existing records. [2025-10-07T22:15:49.833609] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:15:49.833966] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-07T22:15:49.834021] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-07T22:15:49.834303] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-07T22:15:49.834363] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-07T22:15:50.220935] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:15:50.247639] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-07T22:15:50.716518] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T22:15:50.720754] [INFO ] [REMOTE ] VNT: Full fetch complete (63478 records). [2025-10-07T22:15:50.720916] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-07T22:15:51.051124] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-07T22:15:51.067022] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-07T22:15:51.164109] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-07T22:15:51.164220] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-07T22:15:51.165461] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-07T22:15:51.165532] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-07T22:15:51.167184] [DEBUG] [LOCAL ] VNT: Trimmed 63478 records to 43576 (keeping 200 days of data) [2025-10-07T22:15:51.505202] [DEBUG] [LOCAL ] VNT: Primary data saved (43576 records). [2025-10-07T22:15:51.505499] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-07T22:15:51.505724] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNT took 34.0s. Estimated remaining: 18m 1s. Rate: 7.1 symbols/min [2025-10-07T22:15:51.770305] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:15:51.770560] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-07T22:15:51.770607] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-07T22:15:51.770771] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-07T22:15:51.770841] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-07T22:15:51.770927] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-07T22:15:51.770988] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-07T22:15:51.851707] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-07T22:15:52.337184] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:15:52.647666] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-07T22:15:52.725692] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T22:15:53.447630] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-07T22:15:53.519673] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T22:15:53.538161] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-07T22:15:54.247695] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-07T22:15:55.052924] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-07T22:15:55.068339] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-07T22:15:55.277888] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T22:15:55.278282] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-07T22:15:55.278397] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T22:15:55.278458] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-07T22:15:55.278536] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T22:15:55.278625] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-07T22:15:55.278748] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-07T22:15:55.278807] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-07T22:15:55.278865] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-07T22:15:55.278947] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VOYG took 3.8s. Estimated remaining: 17m 53s. Rate: 7.1 symbols/min [2025-10-07T22:15:55.462818] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:15:55.480180] [DEBUG] [LOCAL ] VPG: Loaded 17118 existing records from primary storage. [2025-10-07T22:15:55.480428] [INFO ] [MAIN ] VPG: Loaded 17118 existing records. [2025-10-07T22:15:55.654943] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:15:55.655141] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-07T22:15:55.655189] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-07T22:15:55.655377] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-07T22:15:55.655432] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-07T22:15:55.855335] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-07T22:15:56.029392] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-07T22:15:56.042619] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:15:56.647723] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-07T22:15:57.447752] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-07T22:15:57.483124] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T22:15:57.618181] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T22:15:58.247710] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-07T22:15:58.989919] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T22:15:59.047763] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-07T22:15:59.550919] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T22:15:59.554450] [INFO ] [REMOTE ] VNO: Full fetch complete (70435 records). [2025-10-07T22:15:59.554569] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-07T22:15:59.730436] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-07T22:15:59.852725] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-07T22:15:59.984523] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-07T22:15:59.984618] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-07T22:15:59.985751] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-07T22:15:59.985854] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-07T22:15:59.987297] [DEBUG] [LOCAL ] VNO: Trimmed 70435 records to 48869 (keeping 200 days of data) [2025-10-07T22:16:00.284179] [DEBUG] [LOCAL ] VNO: Primary data saved (48869 records). [2025-10-07T22:16:00.284346] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-07T22:16:00.284491] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VNO took 42.8s. Estimated remaining: 17m 44s. Rate: 7.1 symbols/min [2025-10-07T22:16:00.450687] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:16:00.458194] [DEBUG] [LOCAL ] VPV: Loaded 5347 existing records from primary storage. [2025-10-07T22:16:00.458378] [INFO ] [MAIN ] VPV: Loaded 5347 existing records. [2025-10-07T22:16:00.634710] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:16:00.635104] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-07T22:16:00.635151] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-07T22:16:00.635375] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-07T22:16:00.635432] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-07T22:16:00.655670] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-07T22:16:00.941591] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T22:16:01.005091] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:16:01.447712] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-07T22:16:02.254405] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-07T22:16:02.259101] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-07T22:16:02.451818] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T22:16:03.047626] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-07T22:16:03.162792] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T22:16:03.847728] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-07T22:16:04.652755] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-07T22:16:04.658992] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-07T22:16:04.694168] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T22:16:05.447672] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-07T22:16:05.458152] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T22:16:06.247758] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-07T22:16:06.990420] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-07T22:16:07.016487] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T22:16:07.047614] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-07T22:16:07.847674] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-07T22:16:08.510418] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T22:16:08.647626] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-07T22:16:08.743597] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T22:16:09.447700] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-07T22:16:10.198625] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-07T22:16:10.252571] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-07T22:16:10.263846] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T22:16:11.047711] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-07T22:16:11.171544] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-07T22:16:11.591880] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-07T22:16:11.847700] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-07T22:16:12.647691] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-07T22:16:13.032052] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-07T22:16:13.316569] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-07T22:16:13.318216] [INFO ] [REMOTE ] VOC: Full fetch complete (13139 records). [2025-10-07T22:16:13.318308] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-07T22:16:13.452739] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-07T22:16:13.691574] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-07T22:16:13.691690] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-07T22:16:13.692063] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-07T22:16:13.692106] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-07T22:16:13.692594] [DEBUG] [LOCAL ] VOC: Trimmed 13139 records to 9003 (keeping 200 days of data) [2025-10-07T22:16:13.751395] [DEBUG] [LOCAL ] VOC: Primary data saved (9003 records). [2025-10-07T22:16:13.751540] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-07T22:16:13.751625] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VOC took 30.7s. Estimated remaining: 17m 36s. Rate: 7.1 symbols/min [2025-10-07T22:16:13.917982] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:16:13.966530] [DEBUG] [LOCAL ] VRE: Loaded 35130 existing records from primary storage. [2025-10-07T22:16:13.966894] [INFO ] [MAIN ] VRE: Loaded 35130 existing records. [2025-10-07T22:16:14.157670] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:16:14.157929] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-07T22:16:14.157986] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-07T22:16:14.158182] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-07T22:16:14.158259] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-07T22:16:14.261813] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-07T22:16:14.267547] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T22:16:14.537952] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:16:15.047708] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-07T22:16:15.847679] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-07T22:16:15.918178] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T22:16:16.425855] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-07T22:16:16.609346] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-07T22:16:16.647607] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-07T22:16:17.255737] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T22:16:17.447727] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-07T22:16:18.055742] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T22:16:18.247624] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-07T22:16:18.861167] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-07T22:16:19.047720] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-07T22:16:19.847717] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-07T22:16:20.350096] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T22:16:20.647620] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-07T22:16:20.976545] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T22:16:21.447682] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-07T22:16:22.254228] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-07T22:16:22.272242] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T22:16:22.322003] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T22:16:23.047686] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-07T22:16:23.492240] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T22:16:23.655339] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T22:16:23.847695] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-07T22:16:24.574414] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T22:16:24.647683] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-07T22:16:25.186883] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T22:16:25.187992] [INFO ] [REMOTE ] VPV: Full fetch complete (9141 records). [2025-10-07T22:16:25.188085] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-07T22:16:25.452870] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-07T22:16:25.583826] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-07T22:16:25.583953] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-07T22:16:25.584249] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-07T22:16:25.584290] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-07T22:16:25.584782] [DEBUG] [LOCAL ] VPV: Trimmed 9141 records to 5390 (keeping 200 days of data) [2025-10-07T22:16:25.620680] [DEBUG] [LOCAL ] VPV: Primary data saved (5390 records). [2025-10-07T22:16:25.620829] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-07T22:16:25.620944] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VPV took 25.3s. Estimated remaining: 17m 27s. Rate: 7.1 symbols/min [2025-10-07T22:16:25.797183] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:16:25.854422] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-07T22:16:25.854831] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-07T22:16:26.030828] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:16:26.031092] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-07T22:16:26.031143] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-07T22:16:26.031521] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-07T22:16:26.031580] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-07T22:16:26.252825] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-07T22:16:26.400226] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:16:26.836032] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T22:16:27.047717] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-07T22:16:27.323404] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-07T22:16:27.847702] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-07T22:16:28.647674] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-07T22:16:28.672066] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-07T22:16:29.186216] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-07T22:16:29.189382] [INFO ] [REMOTE ] VOYA: Full fetch complete (61703 records). [2025-10-07T22:16:29.189715] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-07T22:16:29.456448] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-07T22:16:29.598382] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-07T22:16:29.598473] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-07T22:16:29.599487] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-07T22:16:29.599557] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-07T22:16:29.601008] [DEBUG] [LOCAL ] VOYA: Trimmed 61703 records to 42301 (keeping 200 days of data) [2025-10-07T22:16:29.869289] [DEBUG] [LOCAL ] VOYA: Primary data saved (42301 records). [2025-10-07T22:16:29.869427] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-07T22:16:29.869513] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VOYA took 40.5s. Estimated remaining: 17m 19s. Rate: 7.1 symbols/min [2025-10-07T22:16:30.062046] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:16:30.075205] [DEBUG] [LOCAL ] VRTS: Loaded 9309 existing records from primary storage. [2025-10-07T22:16:30.075482] [INFO ] [MAIN ] VRTS: Loaded 9309 existing records. [2025-10-07T22:16:30.253690] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-07T22:16:30.277593] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:16:30.278076] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-07T22:16:30.278960] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-07T22:16:30.279347] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-07T22:16:30.279437] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-07T22:16:30.495717] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-07T22:16:30.709185] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:16:30.768631] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-07T22:16:31.047684] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-07T22:16:31.688265] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T22:16:31.847700] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-07T22:16:32.647706] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-07T22:16:33.447632] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-07T22:16:33.555365] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-07T22:16:33.589388] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T22:16:34.089716] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-07T22:16:34.247716] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-07T22:16:34.979358] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T22:16:34.980744] [INFO ] [REMOTE ] VPG: Full fetch complete (22827 records). [2025-10-07T22:16:34.980815] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-07T22:16:35.052949] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-07T22:16:35.347129] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-07T22:16:35.347224] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-07T22:16:35.347730] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-07T22:16:35.347791] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-07T22:16:35.348426] [DEBUG] [LOCAL ] VPG: Trimmed 22827 records to 17127 (keeping 200 days of data) [2025-10-07T22:16:35.447921] [DEBUG] [LOCAL ] VPG: Primary data saved (17127 records). [2025-10-07T22:16:35.448068] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-07T22:16:35.448154] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VPG took 40.2s. Estimated remaining: 17m 10s. Rate: 7.1 symbols/min [2025-10-07T22:16:35.626892] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:16:35.677993] [DEBUG] [LOCAL ] VSCO: Loaded 52754 existing records from primary storage. [2025-10-07T22:16:35.678350] [INFO ] [MAIN ] VSCO: Loaded 52754 existing records. [2025-10-07T22:16:35.852860] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:16:35.849308] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-07T22:16:35.853835] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-07T22:16:35.853890] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-07T22:16:35.854135] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-07T22:16:35.854192] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-07T22:16:36.207955] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:16:36.605442] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (4.76 seconds). [2025-10-07T22:16:36.647601] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-07T22:16:36.761916] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-07T22:16:37.184261] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-07T22:16:37.447730] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-07T22:16:38.190212] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T22:16:38.247638] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-07T22:16:39.047707] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-07T22:16:39.585481] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T22:16:39.681700] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-07T22:16:39.847627] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-07T22:16:40.092128] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-07T22:16:40.647674] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-07T22:16:41.426188] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-07T22:16:41.447608] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-07T22:16:42.157311] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T22:16:42.247667] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-07T22:16:42.608821] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-07T22:16:42.611830] [INFO ] [REMOTE ] VRE: Full fetch complete (48473 records). [2025-10-07T22:16:42.611927] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-07T22:16:42.994372] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-07T22:16:42.994493] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-07T22:16:42.995467] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-07T22:16:42.995536] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-07T22:16:42.996765] [DEBUG] [LOCAL ] VRE: Trimmed 48473 records to 35134 (keeping 200 days of data) [2025-10-07T22:16:43.053713] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-07T22:16:43.225449] [DEBUG] [LOCAL ] VRE: Primary data saved (35134 records). [2025-10-07T22:16:43.225614] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-07T22:16:43.225747] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRE took 29.5s. Estimated remaining: 17m 2s. Rate: 7.1 symbols/min [2025-10-07T22:16:43.392559] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:16:43.436163] [DEBUG] [LOCAL ] VSH: Loaded 48303 existing records from primary storage. [2025-10-07T22:16:43.436528] [INFO ] [MAIN ] VSH: Loaded 48303 existing records. [2025-10-07T22:16:43.613106] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:16:43.613385] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-07T22:16:43.613433] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-07T22:16:43.613694] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-07T22:16:43.613753] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-07T22:16:43.855407] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-07T22:16:43.977624] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:16:44.006960] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T22:16:44.330699] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-07T22:16:44.647685] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-07T22:16:45.447694] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-07T22:16:45.828867] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-07T22:16:46.247681] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-07T22:16:46.366447] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-07T22:16:47.047696] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-07T22:16:47.226185] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-07T22:16:47.847735] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-07T22:16:48.655755] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-07T22:16:48.678715] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-07T22:16:49.056528] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T22:16:49.447726] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-07T22:16:49.499862] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-07T22:16:49.542605] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T22:16:50.247702] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-07T22:16:50.890184] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T22:16:51.047728] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-07T22:16:51.847631] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-07T22:16:51.881571] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-07T22:16:52.647727] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-07T22:16:53.221498] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-07T22:16:53.447630] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-07T22:16:53.484240] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T22:16:54.247790] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-07T22:16:55.047738] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-07T22:16:55.306006] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-07T22:16:55.470124] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-07T22:16:55.847719] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-07T22:16:55.904016] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T22:16:55.976317] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-07T22:16:56.647704] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-07T22:16:57.447703] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-07T22:16:57.489172] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-07T22:16:58.247627] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-07T22:16:58.311554] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-07T22:16:59.047626] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-07T22:16:59.181934] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T22:16:59.541245] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-07T22:16:59.720748] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-07T22:16:59.847672] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-07T22:17:00.647716] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-07T22:17:01.447777] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-07T22:17:01.571831] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-07T22:17:01.749662] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T22:17:02.247696] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-07T22:17:03.057183] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-07T22:17:03.077821] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-07T22:17:03.733993] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T22:17:03.847700] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-07T22:17:04.647705] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-07T22:17:05.279454] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T22:17:05.281491] [INFO ] [REMOTE ] VRTS: Full fetch complete (11507 records). [2025-10-07T22:17:05.281595] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-07T22:17:05.455757] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-07T22:17:05.743598] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-07T22:17:05.743922] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-07T22:17:05.744577] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-07T22:17:05.744747] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-07T22:17:05.746288] [DEBUG] [LOCAL ] VRTS: Trimmed 11507 records to 9316 (keeping 200 days of data) [2025-10-07T22:17:05.826544] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T22:17:05.895583] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-07T22:17:05.920563] [DEBUG] [LOCAL ] VRTS: Primary data saved (9316 records). [2025-10-07T22:17:05.920766] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-07T22:17:05.920865] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRTS took 36.1s. Estimated remaining: 16m 54s. Rate: 7.1 symbols/min [2025-10-07T22:17:06.090785] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:17:06.146788] [DEBUG] [LOCAL ] VST: Loaded 53718 existing records from primary storage. [2025-10-07T22:17:06.147155] [INFO ] [MAIN ] VST: Loaded 53718 existing records. [2025-10-07T22:17:06.252905] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-07T22:17:06.328604] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:17:06.328868] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-07T22:17:06.328918] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-07T22:17:06.329565] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-07T22:17:06.329626] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-07T22:17:06.689253] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:17:07.047685] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-07T22:17:07.460804] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-07T22:17:07.847628] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-07T22:17:08.088416] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-07T22:17:08.647708] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-07T22:17:09.447679] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-07T22:17:09.481807] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-07T22:17:09.485515] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-07T22:17:09.485634] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-07T22:17:09.896320] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-07T22:17:09.896460] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-07T22:17:09.898262] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-07T22:17:09.898367] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-07T22:17:09.900116] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-10-07T22:17:10.161305] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-07T22:17:10.250251] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-07T22:17:10.306349] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-07T22:17:10.306538] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-07T22:17:10.306632] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VRT took 44.7s. Estimated remaining: 16m 45s. Rate: 7.1 symbols/min [2025-10-07T22:17:10.521846] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:17:10.527942] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-07T22:17:10.584145] [DEBUG] [LOCAL ] VSTS: Loaded 49025 existing records from primary storage. [2025-10-07T22:17:10.584545] [INFO ] [MAIN ] VSTS: Loaded 49025 existing records. [2025-10-07T22:17:10.771894] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:17:10.772173] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-07T22:17:10.772225] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-07T22:17:10.773352] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-07T22:17:10.773455] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-07T22:17:10.939097] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-07T22:17:10.968742] [INFO ] [REMOTE ] VSCO: Full fetch complete (76208 records). [2025-10-07T22:17:10.978716] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-07T22:17:11.053836] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-07T22:17:11.332446] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:17:11.568603] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-07T22:17:11.568752] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-07T22:17:11.570379] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-07T22:17:11.570454] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-07T22:17:11.572084] [DEBUG] [LOCAL ] VSCO: Trimmed 76208 records to 52750 (keeping 200 days of data) [2025-10-07T22:17:11.848505] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-07T22:17:11.901821] [DEBUG] [LOCAL ] VSCO: Primary data saved (52750 records). [2025-10-07T22:17:11.902097] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-07T22:17:11.902324] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VSCO took 36.5s. Estimated remaining: 16m 37s. Rate: 7.1 symbols/min [2025-10-07T22:17:12.078802] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:17:12.122957] [DEBUG] [LOCAL ] VTEX: Loaded 43018 existing records from primary storage. [2025-10-07T22:17:12.123373] [INFO ] [MAIN ] VTEX: Loaded 43018 existing records. [2025-10-07T22:17:12.338784] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:17:12.339090] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-07T22:17:12.339143] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-07T22:17:12.339456] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-07T22:17:12.339517] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-07T22:17:12.763114] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:17:12.763759] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-07T22:17:12.793600] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T22:17:12.834726] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-07T22:17:13.357157] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-07T22:17:13.447719] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-07T22:17:14.247629] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-07T22:17:14.284001] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T22:17:14.761736] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T22:17:14.765111] [INFO ] [REMOTE ] VSH: Full fetch complete (70898 records). [2025-10-07T22:17:14.765234] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-07T22:17:15.052753] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-07T22:17:15.164299] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-07T22:17:15.164413] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-07T22:17:15.165611] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-07T22:17:15.165702] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-07T22:17:15.167123] [DEBUG] [LOCAL ] VSH: Trimmed 70898 records to 48274 (keeping 200 days of data) [2025-10-07T22:17:15.486564] [DEBUG] [LOCAL ] VSH: Primary data saved (48274 records). [2025-10-07T22:17:15.486731] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-07T22:17:15.486826] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 32.3s. Estimated remaining: 16m 28s. Rate: 7.1 symbols/min [2025-10-07T22:17:15.653301] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:17:15.698071] [DEBUG] [LOCAL ] VTLE: Loaded 48355 existing records from primary storage. [2025-10-07T22:17:15.698389] [INFO ] [MAIN ] VTLE: Loaded 48355 existing records. [2025-10-07T22:17:15.852886] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-07T22:17:15.882840] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:17:15.883831] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-07T22:17:15.883881] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-07T22:17:15.884301] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-07T22:17:15.884359] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-07T22:17:16.254188] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:17:16.424626] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T22:17:16.534561] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-07T22:17:16.647753] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-07T22:17:17.443976] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T22:17:17.452807] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-07T22:17:17.824172] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-07T22:17:18.247688] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-07T22:17:19.047715] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-07T22:17:19.792096] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-07T22:17:19.847603] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-07T22:17:20.064394] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-07T22:17:20.575601] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-07T22:17:20.647620] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-07T22:17:21.030167] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T22:17:21.447736] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-07T22:17:22.247714] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-07T22:17:22.915594] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T22:17:23.013063] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-07T22:17:23.047627] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-07T22:17:23.536265] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T22:17:23.847625] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-07T22:17:24.647730] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-07T22:17:25.190393] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T22:17:25.447691] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-07T22:17:25.561193] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-07T22:17:26.220423] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T22:17:26.247615] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-07T22:17:27.049780] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T22:17:27.048088] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-07T22:17:27.767447] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-07T22:17:27.847688] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-07T22:17:28.647618] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-07T22:17:28.771493] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T22:17:29.447631] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-07T22:17:29.503665] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-07T22:17:30.251488] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-07T22:17:30.262991] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-07T22:17:31.047735] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-07T22:17:31.552446] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-07T22:17:31.847673] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-07T22:17:32.060584] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-07T22:17:32.495611] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-07T22:17:32.647690] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-07T22:17:33.447686] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-07T22:17:34.247626] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-07T22:17:34.361746] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-07T22:17:34.385314] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T22:17:35.047618] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-07T22:17:35.215325] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-07T22:17:35.512821] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-07T22:17:35.847674] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-07T22:17:36.647723] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-07T22:17:37.447672] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-07T22:17:37.553947] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-07T22:17:37.593964] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T22:17:38.247710] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-07T22:17:38.306329] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T22:17:38.819283] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-07T22:17:39.047696] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-07T22:17:39.847676] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-07T22:17:40.647628] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-07T22:17:40.712333] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-07T22:17:40.755569] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T22:17:41.417302] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T22:17:41.447603] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-07T22:17:42.130958] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T22:17:42.247612] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-07T22:17:43.043305] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-07T22:17:43.046538] [INFO ] [REMOTE ] VTLE: Full fetch complete (68817 records). [2025-10-07T22:17:43.046660] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-07T22:17:43.058489] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-07T22:17:43.444271] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-07T22:17:43.444397] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-07T22:17:43.445497] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-07T22:17:43.445675] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-07T22:17:43.447144] [DEBUG] [LOCAL ] VTLE: Trimmed 68817 records to 48329 (keeping 200 days of data) [2025-10-07T22:17:43.543445] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T22:17:43.549476] [INFO ] [REMOTE ] VTEX: Full fetch complete (60604 records). [2025-10-07T22:17:43.550139] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-07T22:17:43.849731] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-07T22:17:43.973446] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-07T22:17:43.974875] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-07T22:17:43.976201] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-07T22:17:43.976541] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-07T22:17:43.980897] [DEBUG] [LOCAL ] VTEX: Trimmed 60604 records to 43025 (keeping 200 days of data) [2025-10-07T22:17:44.354926] [DEBUG] [LOCAL ] VTLE: Primary data saved (48329 records). [2025-10-07T22:17:44.355559] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-07T22:17:44.355972] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VTLE took 28.9s. Estimated remaining: 16m 20s. Rate: 7.1 symbols/min [2025-10-07T22:17:44.447967] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T22:17:44.473014] [INFO ] [REMOTE ] VST: Full fetch complete (77805 records). [2025-10-07T22:17:44.477943] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-07T22:17:44.597441] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:17:44.807674] [DEBUG] [LOCAL ] VTMX: Loaded 17569 existing records from primary storage. [2025-10-07T22:17:44.833002] [INFO ] [MAIN ] VTMX: Loaded 17569 existing records. [2025-10-07T22:17:44.905883] [DEBUG] [LOCAL ] VTEX: Primary data saved (43025 records). [2025-10-07T22:17:44.945531] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-07T22:17:44.996173] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VTEX took 33.1s. Estimated remaining: 16m 12s. Rate: 7.1 symbols/min [2025-10-07T22:17:45.231911] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-07T22:17:45.337783] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-07T22:17:45.360841] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:17:45.362496] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-07T22:17:45.363492] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-07T22:17:45.364404] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-07T22:17:45.366504] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-07T22:17:45.366194] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-07T22:17:45.394038] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-07T22:17:45.405172] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-07T22:17:45.405626] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-07T22:17:45.428413] [DEBUG] [LOCAL ] VST: Trimmed 77805 records to 53716 (keeping 200 days of data) [2025-10-07T22:17:45.527763] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:17:45.767835] [DEBUG] [LOCAL ] VTN: Loaded 7017 existing records from primary storage. [2025-10-07T22:17:45.788759] [INFO ] [MAIN ] VTN: Loaded 7017 existing records. [2025-10-07T22:17:46.086663] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:17:46.099757] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-07T22:17:46.184664] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:17:46.186825] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-07T22:17:46.187269] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-07T22:17:46.188589] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-07T22:17:46.189377] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-07T22:17:46.775091] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:17:46.776001] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-07T22:17:46.912506] [DEBUG] [LOCAL ] VST: Primary data saved (53716 records). [2025-10-07T22:17:46.912734] [INFO ] [MAIN ] VST: Full history saved. [2025-10-07T22:17:46.912863] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VST took 41.0s. Estimated remaining: 16m 3s. Rate: 7.1 symbols/min [2025-10-07T22:17:47.131280] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:17:47.166737] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T22:17:47.185056] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-07T22:17:47.194214] [DEBUG] [LOCAL ] VTOL: Loaded 19528 existing records from primary storage. [2025-10-07T22:17:47.194461] [INFO ] [MAIN ] VTOL: Loaded 19528 existing records. [2025-10-07T22:17:47.391840] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:17:47.393859] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-07T22:17:47.400393] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-07T22:17:47.400588] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-07T22:17:47.401138] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-07T22:17:47.410327] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-07T22:17:47.453775] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-07T22:17:47.757720] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:17:47.847610] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-07T22:17:48.444114] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T22:17:48.450746] [INFO ] [REMOTE ] VSTS: Full fetch complete (69764 records). [2025-10-07T22:17:48.450901] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-07T22:17:48.650279] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-07T22:17:48.923722] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-07T22:17:48.997905] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-07T22:17:48.997993] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-07T22:17:48.999227] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-07T22:17:48.999333] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-07T22:17:49.000911] [DEBUG] [LOCAL ] VSTS: Trimmed 69764 records to 49012 (keeping 200 days of data) [2025-10-07T22:17:49.337811] [DEBUG] [LOCAL ] VSTS: Primary data saved (49012 records). [2025-10-07T22:17:49.337979] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-07T22:17:49.338089] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VSTS took 39.0s. Estimated remaining: 15m 54s. Rate: 7.1 symbols/min [2025-10-07T22:17:49.453023] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-07T22:17:49.500834] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-07T22:17:49.570546] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:17:49.628276] [DEBUG] [LOCAL ] VTR: Loaded 52807 existing records from primary storage. [2025-10-07T22:17:49.628674] [INFO ] [MAIN ] VTR: Loaded 52807 existing records. [2025-10-07T22:17:49.850162] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:17:49.850443] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-07T22:17:49.850518] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-07T22:17:49.850778] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-07T22:17:49.850837] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-07T22:17:50.252886] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-07T22:17:50.322525] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:17:50.512398] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T22:17:51.047633] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-07T22:17:51.441492] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-07T22:17:51.847679] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-07T22:17:52.647744] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-07T22:17:52.783316] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T22:17:52.851040] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T22:17:53.447805] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-07T22:17:53.692192] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T22:17:54.247689] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-07T22:17:54.990513] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T22:17:55.047614] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-07T22:17:55.136348] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-07T22:17:55.847615] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-07T22:17:56.198632] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-07T22:17:56.647613] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-07T22:17:56.880910] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-07T22:17:57.447683] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-07T22:17:58.247608] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-07T22:17:58.319766] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T22:17:58.414344] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-07T22:17:59.047634] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-07T22:17:59.390976] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T22:17:59.847685] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-07T22:18:00.647617] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-07T22:18:01.025073] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-07T22:18:01.212895] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-07T22:18:01.411603] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T22:18:01.447596] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-07T22:18:02.189985] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-07T22:18:02.247622] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-07T22:18:03.041070] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-07T22:18:03.047614] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-07T22:18:03.847699] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-07T22:18:04.492135] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-07T22:18:04.647706] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-07T22:18:05.017743] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-07T22:18:05.391634] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T22:18:05.447667] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-07T22:18:06.247635] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-07T22:18:06.607781] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T22:18:07.047743] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-07T22:18:07.847702] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-07T22:18:08.099512] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-07T22:18:08.162464] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T22:18:08.647720] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-07T22:18:08.943950] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-07T22:18:09.447744] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-07T22:18:09.667997] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-07T22:18:10.247714] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-07T22:18:10.551941] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T22:18:11.010781] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-07T22:18:11.047629] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-07T22:18:11.847701] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-07T22:18:11.864316] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-07T22:18:12.636560] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-07T22:18:12.647607] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-07T22:18:13.447626] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-07T22:18:13.590110] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-07T22:18:14.247737] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-07T22:18:15.047664] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-07T22:18:15.084566] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T22:18:15.086151] [INFO ] [REMOTE ] VTOL: Full fetch complete (26067 records). [2025-10-07T22:18:15.086285] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-07T22:18:15.423276] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-07T22:18:15.513428] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-07T22:18:15.513508] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-07T22:18:15.514069] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-07T22:18:15.514133] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-07T22:18:15.514984] [DEBUG] [LOCAL ] VTOL: Trimmed 26067 records to 19549 (keeping 200 days of data) [2025-10-07T22:18:15.637823] [DEBUG] [LOCAL ] VTOL: Primary data saved (19549 records). [2025-10-07T22:18:15.638065] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-07T22:18:15.638194] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTOL took 28.7s. Estimated remaining: 15m 47s. Rate: 7.1 symbols/min [2025-10-07T22:18:15.839011] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:18:15.847636] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-07T22:18:15.874023] [DEBUG] [LOCAL ] VTS: Loaded 30296 existing records from primary storage. [2025-10-07T22:18:15.874316] [INFO ] [MAIN ] VTS: Loaded 30296 existing records. [2025-10-07T22:18:15.979523] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-07T22:18:15.992757] [INFO ] [REMOTE ] VTMX: Full fetch complete (25708 records). [2025-10-07T22:18:16.008354] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-07T22:18:16.146560] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:18:16.167599] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-07T22:18:16.167740] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-07T22:18:16.168028] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-07T22:18:16.173428] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-07T22:18:16.648980] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-07T22:18:16.777376] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-07T22:18:16.777857] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-07T22:18:16.790678] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-07T22:18:16.811797] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-07T22:18:16.846672] [DEBUG] [LOCAL ] VTMX: Trimmed 25708 records to 17599 (keeping 200 days of data) [2025-10-07T22:18:16.866771] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:18:16.986231] [DEBUG] [LOCAL ] VTMX: Primary data saved (17599 records). [2025-10-07T22:18:16.986431] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-07T22:18:16.986556] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTMX took 32.6s. Estimated remaining: 15m 38s. Rate: 7.1 symbols/min [2025-10-07T22:18:17.162440] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:18:17.195415] [DEBUG] [LOCAL ] VVR: Loaded 31678 existing records from primary storage. [2025-10-07T22:18:17.195726] [INFO ] [MAIN ] VVR: Loaded 31678 existing records. [2025-10-07T22:18:17.369858] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:18:17.370104] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-07T22:18:17.370151] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-07T22:18:17.370360] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-07T22:18:17.370416] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-07T22:18:17.449297] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-07T22:18:17.605366] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-07T22:18:17.759392] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:18:17.794667] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-07T22:18:18.253906] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-07T22:18:18.256099] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-07T22:18:19.019633] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T22:18:19.047631] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-07T22:18:19.847667] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-07T22:18:20.119317] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T22:18:20.411989] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T22:18:20.413127] [INFO ] [REMOTE ] VTN: Full fetch complete (11120 records). [2025-10-07T22:18:20.413201] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-07T22:18:20.652765] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-07T22:18:20.774590] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-07T22:18:20.774700] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-07T22:18:20.775032] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-07T22:18:20.775076] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-07T22:18:20.775533] [DEBUG] [LOCAL ] VTN: Trimmed 11120 records to 7010 (keeping 200 days of data) [2025-10-07T22:18:20.817603] [DEBUG] [LOCAL ] VTN: Primary data saved (7010 records). [2025-10-07T22:18:20.817750] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-07T22:18:20.817844] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTN took 35.8s. Estimated remaining: 15m 29s. Rate: 7.1 symbols/min [2025-10-07T22:18:20.995760] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:18:21.049838] [DEBUG] [LOCAL ] VVV: Loaded 50235 existing records from primary storage. [2025-10-07T22:18:21.050326] [INFO ] [MAIN ] VVV: Loaded 50235 existing records. [2025-10-07T22:18:21.238752] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:18:21.239058] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-07T22:18:21.239114] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-07T22:18:21.239372] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-07T22:18:21.239433] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-07T22:18:21.454310] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-07T22:18:21.629738] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:18:22.059226] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-07T22:18:22.247672] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-07T22:18:23.047701] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-07T22:18:23.625663] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-07T22:18:23.847621] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-07T22:18:23.985921] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T22:18:24.495198] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T22:18:24.647610] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-07T22:18:25.447671] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-07T22:18:25.541473] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T22:18:26.021854] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T22:18:26.204398] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-07T22:18:26.247666] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-07T22:18:27.047692] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-07T22:18:27.521998] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T22:18:27.526760] [INFO ] [REMOTE ] VTR: Full fetch complete (76355 records). [2025-10-07T22:18:27.526948] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-07T22:18:27.847943] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-07T22:18:27.976456] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T22:18:27.983964] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-07T22:18:27.984926] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-07T22:18:27.986508] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-07T22:18:27.986614] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-07T22:18:27.988674] [DEBUG] [LOCAL ] VTR: Trimmed 76355 records to 52793 (keeping 200 days of data) [2025-10-07T22:18:28.336308] [DEBUG] [LOCAL ] VTR: Primary data saved (52793 records). [2025-10-07T22:18:28.336491] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-07T22:18:28.336603] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTR took 39.0s. Estimated remaining: 15m 21s. Rate: 7.1 symbols/min [2025-10-07T22:18:28.512662] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:18:28.535007] [DEBUG] [LOCAL ] VVX: Loaded 23022 existing records from primary storage. [2025-10-07T22:18:28.535289] [INFO ] [MAIN ] VVX: Loaded 23022 existing records. [2025-10-07T22:18:28.652785] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-07T22:18:28.722169] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:18:28.722394] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-07T22:18:28.722442] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-07T22:18:28.722669] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-07T22:18:28.722729] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-07T22:18:29.105588] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:18:29.144858] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T22:18:29.447695] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-07T22:18:30.236561] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T22:18:30.247597] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-07T22:18:30.607462] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T22:18:31.047673] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-07T22:18:31.715629] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T22:18:31.847702] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-07T22:18:32.385840] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-07T22:18:32.647707] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-07T22:18:32.983548] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T22:18:33.447720] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-07T22:18:34.245297] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-07T22:18:34.254435] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-07T22:18:34.736818] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-07T22:18:35.047717] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-07T22:18:35.324343] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-07T22:18:35.847624] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-07T22:18:36.261134] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-07T22:18:36.647716] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-07T22:18:37.165060] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-07T22:18:37.447719] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-07T22:18:37.918677] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-07T22:18:38.247707] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-07T22:18:39.047666] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-07T22:18:39.138063] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-07T22:18:39.313106] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-07T22:18:39.847692] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-07T22:18:39.962447] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T22:18:40.647695] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-07T22:18:41.055030] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T22:18:41.447665] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-07T22:18:41.781565] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T22:18:42.247704] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-07T22:18:43.047625] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-07T22:18:43.114212] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-07T22:18:43.362922] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-07T22:18:43.847609] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-07T22:18:43.931635] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T22:18:44.647748] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-07T22:18:45.447788] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-07T22:18:45.595315] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T22:18:45.741325] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T22:18:46.247702] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-07T22:18:46.774938] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-07T22:18:47.047746] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-07T22:18:47.819976] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-07T22:18:47.847624] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-07T22:18:48.417542] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T22:18:48.647697] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-07T22:18:49.190817] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-07T22:18:49.447635] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-07T22:18:49.518316] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-07T22:18:50.247750] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-07T22:18:51.047670] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-07T22:18:51.223996] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T22:18:51.357423] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T22:18:51.360495] [INFO ] [REMOTE ] VTS: Full fetch complete (41390 records). [2025-10-07T22:18:51.360587] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-07T22:18:51.768894] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-07T22:18:51.768978] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-07T22:18:51.769824] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-07T22:18:51.769888] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-07T22:18:51.770819] [DEBUG] [LOCAL ] VTS: Trimmed 41390 records to 30231 (keeping 200 days of data) [2025-10-07T22:18:51.860737] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-07T22:18:51.965032] [DEBUG] [LOCAL ] VTS: Primary data saved (30231 records). [2025-10-07T22:18:51.965189] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-07T22:18:51.965278] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTS took 36.3s. Estimated remaining: 15m 13s. Rate: 7.1 symbols/min [2025-10-07T22:18:52.133363] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:18:52.180048] [DEBUG] [LOCAL ] VYX: Loaded 48663 existing records from primary storage. [2025-10-07T22:18:52.180407] [INFO ] [MAIN ] VYX: Loaded 48663 existing records. [2025-10-07T22:18:52.328869] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T22:18:52.395409] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:18:52.395732] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-07T22:18:52.395791] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-07T22:18:52.396178] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-07T22:18:52.396237] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-07T22:18:52.657898] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-07T22:18:52.688163] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T22:18:52.711706] [INFO ] [REMOTE ] VVX: Full fetch complete (33431 records). [2025-10-07T22:18:52.741110] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-07T22:18:52.772511] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:18:53.134992] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-07T22:18:53.135079] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-07T22:18:53.135816] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-07T22:18:53.135880] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-07T22:18:53.136786] [DEBUG] [LOCAL ] VVX: Trimmed 33431 records to 22950 (keeping 200 days of data) [2025-10-07T22:18:53.275039] [DEBUG] [LOCAL ] VVX: Primary data saved (22950 records). [2025-10-07T22:18:53.275182] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-07T22:18:53.275267] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVX took 24.9s. Estimated remaining: 15m 4s. Rate: 7.1 symbols/min [2025-10-07T22:18:53.441146] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:18:53.447618] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-07T22:18:53.495810] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-07T22:18:53.496188] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-07T22:18:53.709428] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:18:53.709696] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-07T22:18:53.709770] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-07T22:18:53.709980] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-07T22:18:53.710038] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-07T22:18:54.009271] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T22:18:54.033461] [INFO ] [REMOTE ] VVR: Full fetch complete (46655 records). [2025-10-07T22:18:54.052737] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-07T22:18:54.169055] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:18:54.253551] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-07T22:18:54.488871] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-07T22:18:54.488962] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-07T22:18:54.489916] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-07T22:18:54.489982] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-07T22:18:54.491031] [DEBUG] [LOCAL ] VVR: Trimmed 46655 records to 31655 (keeping 200 days of data) [2025-10-07T22:18:54.687796] [DEBUG] [LOCAL ] VVR: Primary data saved (31655 records). [2025-10-07T22:18:54.687954] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-07T22:18:54.688045] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVR took 37.7s. Estimated remaining: 14m 55s. Rate: 7.1 symbols/min [2025-10-07T22:18:54.857664] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:18:54.915751] [DEBUG] [LOCAL ] W: Loaded 53449 existing records from primary storage. [2025-10-07T22:18:54.916421] [INFO ] [MAIN ] W: Loaded 53449 existing records. [2025-10-07T22:18:55.052688] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-07T22:18:55.122682] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:18:55.122987] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-07T22:18:55.123161] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-07T22:18:55.123465] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-07T22:18:55.123543] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-07T22:18:55.313309] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T22:18:55.522263] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:18:55.847622] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-07T22:18:55.888020] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T22:18:56.647736] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-07T22:18:57.452766] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-07T22:18:57.468576] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-07T22:18:57.713910] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T22:18:58.238273] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-07T22:18:58.248624] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-07T22:18:59.048784] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-07T22:18:59.054074] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-07T22:18:59.847679] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-07T22:18:59.998225] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T22:19:00.647698] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-07T22:19:01.447733] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-07T22:19:01.526779] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-07T22:19:01.650723] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T22:19:02.225427] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-07T22:19:02.247614] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-07T22:19:03.047629] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-07T22:19:03.296128] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T22:19:03.847624] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-07T22:19:03.981966] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-07T22:19:04.373966] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-07T22:19:04.377513] [INFO ] [REMOTE ] VVV: Full fetch complete (72404 records). [2025-10-07T22:19:04.377677] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-07T22:19:04.652885] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-07T22:19:04.768393] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-07T22:19:04.768499] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-07T22:19:04.769639] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-07T22:19:04.769726] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-07T22:19:04.771258] [DEBUG] [LOCAL ] VVV: Trimmed 72404 records to 50285 (keeping 200 days of data) [2025-10-07T22:19:05.067272] [DEBUG] [LOCAL ] VVV: Primary data saved (50285 records). [2025-10-07T22:19:05.067427] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-07T22:19:05.067552] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVV took 44.2s. Estimated remaining: 14m 47s. Rate: 7.1 symbols/min [2025-10-07T22:19:05.248939] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:19:05.302931] [DEBUG] [LOCAL ] WAB: Loaded 44071 existing records from primary storage. [2025-10-07T22:19:05.303353] [INFO ] [MAIN ] WAB: Loaded 44071 existing records. [2025-10-07T22:19:05.452837] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-07T22:19:05.491308] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:19:05.491796] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-07T22:19:05.491906] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-07T22:19:05.492344] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-07T22:19:05.492413] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-07T22:19:05.918759] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:19:06.165388] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-07T22:19:06.247602] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-07T22:19:06.362533] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-07T22:19:07.047633] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-07T22:19:07.468536] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-07T22:19:07.847684] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-07T22:19:08.630448] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-07T22:19:08.647593] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-07T22:19:08.833877] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-07T22:19:09.447676] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-07T22:19:09.562411] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T22:19:10.247697] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-07T22:19:11.047628] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-07T22:19:11.095044] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-07T22:19:11.140364] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T22:19:11.792546] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T22:19:11.847639] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-07T22:19:12.647634] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-07T22:19:12.749731] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T22:19:13.447694] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-07T22:19:13.649720] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T22:19:14.247712] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-07T22:19:14.662326] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-07T22:19:15.047627] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-07T22:19:15.139082] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-07T22:19:15.847630] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-07T22:19:16.252489] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-07T22:19:16.350813] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-07T22:19:16.647698] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-07T22:19:17.447724] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-07T22:19:18.247754] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-07T22:19:18.459230] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-07T22:19:18.760003] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-07T22:19:19.047709] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-07T22:19:19.349549] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T22:19:19.847685] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-07T22:19:19.899260] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T22:19:20.647618] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-07T22:19:20.787457] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T22:19:21.447686] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-07T22:19:22.247731] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-07T22:19:22.289754] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-07T22:19:22.507611] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-07T22:19:23.047704] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-07T22:19:23.311866] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-07T22:19:23.338751] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-07T22:19:23.342099] [INFO ] [REMOTE ] VYX: Full fetch complete (70191 records). [2025-10-07T22:19:23.342201] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-07T22:19:23.723606] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-07T22:19:23.723716] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-07T22:19:23.724770] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-07T22:19:23.724835] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-07T22:19:23.726264] [DEBUG] [LOCAL ] VYX: Trimmed 70191 records to 48640 (keeping 200 days of data) [2025-10-07T22:19:23.893759] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-07T22:19:24.015436] [DEBUG] [LOCAL ] VYX: Primary data saved (48640 records). [2025-10-07T22:19:24.015573] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-07T22:19:24.015678] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 32.1s. Estimated remaining: 14m 39s. Rate: 7.1 symbols/min [2025-10-07T22:19:24.187499] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:19:24.229215] [DEBUG] [LOCAL ] WAL: Loaded 45159 existing records from primary storage. [2025-10-07T22:19:24.229515] [INFO ] [MAIN ] WAL: Loaded 45159 existing records. [2025-10-07T22:19:24.405293] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:19:24.405547] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-07T22:19:24.405597] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-07T22:19:24.405868] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-07T22:19:24.405929] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-07T22:19:24.657365] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-07T22:19:24.763357] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:19:25.178379] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-07T22:19:25.447624] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-07T22:19:25.574297] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-07T22:19:26.247632] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-07T22:19:26.356044] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T22:19:27.047678] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-07T22:19:27.662577] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-07T22:19:27.666581] [INFO ] [REMOTE ] W: Full fetch complete (77393 records). [2025-10-07T22:19:27.666909] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-07T22:19:27.862756] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-07T22:19:28.053414] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-07T22:19:28.175108] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-07T22:19:28.175195] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-07T22:19:28.176323] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-07T22:19:28.176406] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-07T22:19:28.178124] [DEBUG] [LOCAL ] W: Trimmed 77393 records to 53447 (keeping 200 days of data) [2025-10-07T22:19:28.443998] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-07T22:19:28.541595] [DEBUG] [LOCAL ] W: Primary data saved (53447 records). [2025-10-07T22:19:28.541794] [INFO ] [MAIN ] W: Full history saved. [2025-10-07T22:19:28.541894] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. W took 33.9s. Estimated remaining: 14m 30s. Rate: 7.1 symbols/min [2025-10-07T22:19:28.652831] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-07T22:19:28.715948] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:19:28.752183] [DEBUG] [LOCAL ] WAT: Loaded 35451 existing records from primary storage. [2025-10-07T22:19:28.752490] [INFO ] [MAIN ] WAT: Loaded 35451 existing records. [2025-10-07T22:19:28.935338] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:19:28.935553] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-07T22:19:28.935625] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-07T22:19:28.936419] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-07T22:19:28.936484] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-07T22:19:29.283690] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-07T22:19:29.352462] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-07T22:19:29.358281] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:19:29.358667] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-07T22:19:29.450139] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-07T22:19:29.737537] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-07T22:19:29.795630] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-07T22:19:29.795760] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-07T22:19:29.796949] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-07T22:19:29.797019] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-07T22:19:29.798626] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-10-07T22:19:30.151439] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-07T22:19:30.151607] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-07T22:19:30.151756] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. VZ took 36.9s. Estimated remaining: 14m 22s. Rate: 7.1 symbols/min [2025-10-07T22:19:30.252884] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-07T22:19:30.358719] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:19:30.359537] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-07T22:19:30.359598] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-07T22:19:30.359745] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-07T22:19:30.359799] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-07T22:19:30.359893] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-07T22:19:30.359970] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-07T22:19:30.796183] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:19:30.837300] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T22:19:31.047696] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-07T22:19:31.847623] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-07T22:19:32.133857] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T22:19:32.134221] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-07T22:19:32.134495] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T22:19:32.134782] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-07T22:19:32.134854] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T22:19:32.134908] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-07T22:19:32.161326] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-07T22:19:32.162147] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-07T22:19:32.163158] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T22:19:32.163314] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-07T22:19:32.163493] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WBI took 2.0s. Estimated remaining: 14m 13s. Rate: 7.1 symbols/min [2025-10-07T22:19:32.348268] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:19:32.395338] [DEBUG] [LOCAL ] WBS: Loaded 48718 existing records from primary storage. [2025-10-07T22:19:32.395742] [INFO ] [MAIN ] WBS: Loaded 48718 existing records. [2025-10-07T22:19:32.570468] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:19:32.570837] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-07T22:19:32.570900] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-07T22:19:32.571229] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-07T22:19:32.571305] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-07T22:19:32.648322] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-07T22:19:32.879069] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T22:19:32.964466] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:19:33.447710] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-07T22:19:34.247676] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-07T22:19:34.481372] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T22:19:34.996347] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T22:19:35.047622] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-07T22:19:35.813706] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T22:19:35.847636] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-07T22:19:36.605901] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T22:19:36.647711] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-07T22:19:36.800343] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T22:19:37.447741] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-07T22:19:38.023353] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T22:19:38.247704] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-07T22:19:38.857099] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-07T22:19:39.047716] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-07T22:19:39.842697] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T22:19:39.851457] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-07T22:19:40.328729] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-07T22:19:40.339703] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T22:19:40.343807] [INFO ] [REMOTE ] WAB: Full fetch complete (64250 records). [2025-10-07T22:19:40.343949] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-07T22:19:40.652759] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-07T22:19:40.738517] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-07T22:19:40.738777] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-07T22:19:40.739860] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-07T22:19:40.739989] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-07T22:19:40.741407] [DEBUG] [LOCAL ] WAB: Trimmed 64250 records to 44063 (keeping 200 days of data) [2025-10-07T22:19:41.017423] [DEBUG] [LOCAL ] WAB: Primary data saved (44063 records). [2025-10-07T22:19:41.017558] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-07T22:19:41.017639] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAB took 35.9s. Estimated remaining: 14m 4s. Rate: 7.1 symbols/min [2025-10-07T22:19:41.184152] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:19:41.197014] [DEBUG] [LOCAL ] WBX: Loaded 11130 existing records from primary storage. [2025-10-07T22:19:41.197271] [INFO ] [MAIN ] WBX: Loaded 11130 existing records. [2025-10-07T22:19:41.373536] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:19:41.373815] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-07T22:19:41.373869] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-07T22:19:41.374058] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-07T22:19:41.374121] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-07T22:19:41.452912] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-07T22:19:41.720375] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:19:42.247681] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-07T22:19:42.394848] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T22:19:42.894528] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T22:19:43.047617] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-07T22:19:43.663673] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T22:19:43.847607] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-07T22:19:44.482763] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-07T22:19:44.647707] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-07T22:19:45.447623] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-07T22:19:45.628303] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-07T22:19:45.925118] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T22:19:46.247685] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-07T22:19:47.033559] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-07T22:19:47.047624] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-07T22:19:47.287877] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-07T22:19:47.847666] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-07T22:19:48.419187] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T22:19:48.647681] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-07T22:19:49.152854] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-07T22:19:49.444916] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-07T22:19:49.450602] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-07T22:19:50.247704] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-07T22:19:51.047676] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-07T22:19:51.102363] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-07T22:19:51.342427] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-07T22:19:51.847727] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-07T22:19:52.647620] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-07T22:19:52.834384] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-07T22:19:52.858734] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-07T22:19:53.447747] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-07T22:19:53.841687] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-07T22:19:54.114941] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-07T22:19:54.247700] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-07T22:19:55.047623] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-07T22:19:55.079349] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-07T22:19:55.847709] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-07T22:19:56.459185] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-07T22:19:56.509728] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T22:19:56.647620] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-07T22:19:57.210759] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-07T22:19:57.447719] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-07T22:19:57.907765] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-07T22:19:57.911673] [INFO ] [REMOTE ] WAT: Full fetch complete (50134 records). [2025-10-07T22:19:57.911816] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-07T22:19:58.252793] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-07T22:19:58.293900] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-07T22:19:58.293990] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-07T22:19:58.294953] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-07T22:19:58.295020] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-07T22:19:58.296718] [DEBUG] [LOCAL ] WAT: Trimmed 50134 records to 35443 (keeping 200 days of data) [2025-10-07T22:19:58.518205] [DEBUG] [LOCAL ] WAT: Primary data saved (35443 records). [2025-10-07T22:19:58.518363] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-07T22:19:58.518453] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAT took 30.0s. Estimated remaining: 13m 56s. Rate: 7.1 symbols/min [2025-10-07T22:19:58.684322] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:19:58.725787] [DEBUG] [LOCAL ] WCC: Loaded 39285 existing records from primary storage. [2025-10-07T22:19:58.726090] [INFO ] [MAIN ] WCC: Loaded 39285 existing records. [2025-10-07T22:19:58.830523] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-07T22:19:58.846052] [INFO ] [REMOTE ] WBX: Full fetch complete (24201 records). [2025-10-07T22:19:58.856462] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-07T22:19:58.948435] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:19:58.998097] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-07T22:19:59.016206] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-07T22:19:59.018989] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-07T22:19:59.029554] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-07T22:19:59.054988] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-07T22:19:59.692914] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-07T22:19:59.692668] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:19:59.693101] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-07T22:19:59.694087] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-07T22:19:59.694157] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-07T22:19:59.695299] [DEBUG] [LOCAL ] WBX: Trimmed 24201 records to 11031 (keeping 200 days of data) [2025-10-07T22:19:59.760822] [DEBUG] [LOCAL ] WBX: Primary data saved (11031 records). [2025-10-07T22:19:59.760978] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-07T22:19:59.761103] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WBX took 18.7s. Estimated remaining: 13m 48s. Rate: 7.1 symbols/min [2025-10-07T22:19:59.852791] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-07T22:19:59.944966] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:19:59.997397] [DEBUG] [LOCAL ] WCN: Loaded 47931 existing records from primary storage. [2025-10-07T22:19:59.997774] [INFO ] [MAIN ] WCN: Loaded 47931 existing records. [2025-10-07T22:20:00.181760] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:20:00.182045] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-07T22:20:00.182094] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-07T22:20:00.182948] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-07T22:20:00.183008] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-07T22:20:00.561014] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:20:00.647679] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-07T22:20:00.734369] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T22:20:01.447638] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-07T22:20:01.472306] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-07T22:20:02.247692] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-07T22:20:02.298972] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-07T22:20:03.047712] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-07T22:20:03.159454] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T22:20:03.817024] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T22:20:03.847713] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-07T22:20:04.647703] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-07T22:20:05.174784] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-07T22:20:05.433849] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T22:20:05.447598] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-07T22:20:06.247633] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-07T22:20:06.407162] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T22:20:06.679448] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-07T22:20:07.047724] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-07T22:20:07.722264] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-07T22:20:07.847715] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-07T22:20:08.649184] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-07T22:20:08.652432] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T22:20:09.447622] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-07T22:20:09.559226] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T22:20:10.250059] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-07T22:20:10.255499] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-07T22:20:11.023238] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T22:20:11.047616] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-07T22:20:11.847719] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-07T22:20:12.004795] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-07T22:20:12.647624] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-07T22:20:12.851827] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-07T22:20:13.360067] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T22:20:13.447692] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-07T22:20:14.253327] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-07T22:20:14.268578] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T22:20:15.047629] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-07T22:20:15.301867] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-07T22:20:15.848505] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-07T22:20:15.855322] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-07T22:20:16.405581] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-07T22:20:16.409536] [INFO ] [REMOTE ] WAL: Full fetch complete (66632 records). [2025-10-07T22:20:16.409732] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-07T22:20:16.659172] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-07T22:20:16.838587] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-07T22:20:16.838738] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-07T22:20:16.839839] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-07T22:20:16.839909] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-07T22:20:16.844730] [DEBUG] [LOCAL ] WAL: Trimmed 66632 records to 45135 (keeping 200 days of data) [2025-10-07T22:20:17.131506] [DEBUG] [LOCAL ] WAL: Primary data saved (45135 records). [2025-10-07T22:20:17.131678] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-07T22:20:17.131786] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WAL took 53.1s. Estimated remaining: 13m 40s. Rate: 7.1 symbols/min [2025-10-07T22:20:17.320593] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:20:17.329324] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T22:20:17.333163] [INFO ] [REMOTE ] WBS: Full fetch complete (69833 records). [2025-10-07T22:20:17.333350] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-07T22:20:17.447808] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-07T22:20:17.562947] [DEBUG] [LOCAL ] WD: Loaded 23201 existing records from primary storage. [2025-10-07T22:20:17.629115] [INFO ] [MAIN ] WD: Loaded 23201 existing records. [2025-10-07T22:20:17.951950] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-07T22:20:17.959722] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-07T22:20:17.961244] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-07T22:20:17.961835] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-07T22:20:17.984902] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:20:17.985329] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-07T22:20:17.985460] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-07T22:20:17.985951] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-07T22:20:17.986026] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-07T22:20:17.991763] [DEBUG] [LOCAL ] WBS: Trimmed 69833 records to 48692 (keeping 200 days of data) [2025-10-07T22:20:18.494267] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:20:18.495524] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-07T22:20:18.639868] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-07T22:20:18.731228] [DEBUG] [LOCAL ] WBS: Primary data saved (48692 records). [2025-10-07T22:20:18.731388] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-07T22:20:18.731523] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBS took 46.6s. Estimated remaining: 13m 31s. Rate: 7.1 symbols/min [2025-10-07T22:20:18.899399] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:20:18.921250] [DEBUG] [LOCAL ] WDH: Loaded 17903 existing records from primary storage. [2025-10-07T22:20:18.921540] [INFO ] [MAIN ] WDH: Loaded 17903 existing records. [2025-10-07T22:20:19.052730] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-07T22:20:19.133244] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:20:19.133473] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-07T22:20:19.133547] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-07T22:20:19.133828] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-07T22:20:19.133886] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-07T22:20:19.479604] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-07T22:20:19.527768] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:20:19.539109] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T22:20:19.847716] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-07T22:20:20.647707] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-07T22:20:20.938244] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-07T22:20:21.386885] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T22:20:21.436556] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T22:20:21.447605] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-07T22:20:22.218484] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-07T22:20:22.247604] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-07T22:20:23.047687] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-07T22:20:23.105377] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-07T22:20:23.847694] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-07T22:20:24.292879] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-07T22:20:24.296206] [INFO ] [REMOTE ] WCC: Full fetch complete (57517 records). [2025-10-07T22:20:24.296369] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-07T22:20:24.656477] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-07T22:20:24.696784] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-07T22:20:24.696861] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-07T22:20:24.697910] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-07T22:20:24.698082] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-07T22:20:24.699473] [DEBUG] [LOCAL ] WCC: Trimmed 57517 records to 39191 (keeping 200 days of data) [2025-10-07T22:20:24.971127] [DEBUG] [LOCAL ] WCC: Primary data saved (39191 records). [2025-10-07T22:20:24.971295] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-07T22:20:24.971384] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WCC took 26.5s. Estimated remaining: 13m 22s. Rate: 7.1 symbols/min [2025-10-07T22:20:25.146662] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:20:25.167730] [DEBUG] [LOCAL ] WDI: Loaded 21121 existing records from primary storage. [2025-10-07T22:20:25.167986] [INFO ] [MAIN ] WDI: Loaded 21121 existing records. [2025-10-07T22:20:25.349669] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:20:25.350430] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-07T22:20:25.350539] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-07T22:20:25.351352] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-07T22:20:25.351413] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-07T22:20:25.455087] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-07T22:20:25.794346] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T22:20:25.793256] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:20:25.804203] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T22:20:26.247595] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-07T22:20:26.284718] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-07T22:20:27.047628] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-07T22:20:27.408588] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T22:20:27.847632] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-07T22:20:27.996674] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-07T22:20:28.647615] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-07T22:20:28.974071] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-07T22:20:29.409439] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-07T22:20:29.447669] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-07T22:20:30.247727] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-07T22:20:31.019874] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-07T22:20:31.047625] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-07T22:20:31.302817] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-07T22:20:31.847702] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-07T22:20:32.647622] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-07T22:20:32.717854] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-07T22:20:32.843574] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T22:20:33.431003] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-07T22:20:33.447600] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-07T22:20:34.247615] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-07T22:20:34.617461] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-07T22:20:35.047618] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-07T22:20:35.333833] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-07T22:20:35.847721] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-07T22:20:36.647750] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-07T22:20:36.699214] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T22:20:36.915297] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T22:20:37.447708] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-07T22:20:37.935473] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-07T22:20:38.247700] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-07T22:20:39.047628] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-07T22:20:39.087337] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T22:20:39.150277] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T22:20:39.847705] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-07T22:20:40.448465] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T22:20:40.647680] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-07T22:20:40.937358] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T22:20:41.447742] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-07T22:20:41.793558] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-07T22:20:41.795981] [INFO ] [REMOTE ] WDH: Full fetch complete (23712 records). [2025-10-07T22:20:41.796053] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-07T22:20:42.195541] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-07T22:20:42.195636] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-07T22:20:42.196238] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-07T22:20:42.196287] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-07T22:20:42.197071] [DEBUG] [LOCAL ] WDH: Trimmed 23712 records to 17899 (keeping 200 days of data) [2025-10-07T22:20:42.249052] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-07T22:20:42.306455] [DEBUG] [LOCAL ] WDH: Primary data saved (17899 records). [2025-10-07T22:20:42.306792] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-07T22:20:42.306900] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WDH took 23.6s. Estimated remaining: 13m 14s. Rate: 7.1 symbols/min [2025-10-07T22:20:42.635719] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T22:20:43.047749] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-07T22:20:43.725075] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-07T22:20:43.728474] [INFO ] [REMOTE ] WCN: Full fetch complete (69384 records). [2025-10-07T22:20:43.728632] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-07T22:20:43.852766] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-07T22:20:44.132036] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-07T22:20:44.132239] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-07T22:20:44.133344] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-07T22:20:44.133431] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-07T22:20:44.147355] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T22:20:44.153331] [DEBUG] [LOCAL ] WCN: Trimmed 69384 records to 47941 (keeping 200 days of data) [2025-10-07T22:20:44.459975] [DEBUG] [LOCAL ] WCN: Primary data saved (47941 records). [2025-10-07T22:20:44.460117] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-07T22:20:44.460199] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WCN took 44.7s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-07T22:20:44.647741] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-07T22:20:45.216042] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-07T22:20:45.447619] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-07T22:20:45.717040] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-07T22:20:46.247627] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-07T22:20:46.564992] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T22:20:47.019528] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-07T22:20:47.047601] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-07T22:20:47.847729] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-07T22:20:47.990140] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T22:20:47.991980] [INFO ] [REMOTE ] WDI: Full fetch complete (30767 records). [2025-10-07T22:20:47.992058] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-07T22:20:48.353900] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-07T22:20:48.353983] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-07T22:20:48.354587] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-07T22:20:48.354626] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-07T22:20:48.355336] [DEBUG] [LOCAL ] WDI: Trimmed 30767 records to 21117 (keeping 200 days of data) [2025-10-07T22:20:48.489075] [DEBUG] [LOCAL ] WDI: Primary data saved (21117 records). [2025-10-07T22:20:48.489250] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-07T22:20:48.489376] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WDI took 23.5s. Estimated remaining: 12m 57s. Rate: 7.1 symbols/min [2025-10-07T22:20:48.991585] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T22:20:48.997301] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-07T22:20:50.250185] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-07T22:20:50.256847] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-07T22:20:51.773906] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T22:20:51.779675] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-07T22:20:52.915141] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-07T22:20:52.921076] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-07T22:20:53.576263] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T22:20:53.578089] [INFO ] [REMOTE ] WD: Full fetch complete (33317 records). [2025-10-07T22:20:53.578182] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-07T22:20:53.961164] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-07T22:20:53.961256] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-07T22:20:53.961995] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-07T22:20:53.962060] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-07T22:20:53.963164] [DEBUG] [LOCAL ] WD: Trimmed 33317 records to 23197 (keeping 200 days of data) [2025-10-07T22:20:54.113570] [DEBUG] [LOCAL ] WD: Primary data saved (23197 records). [2025-10-07T22:20:54.113741] [INFO ] [MAIN ] WD: Full history saved. [2025-10-07T22:20:54.113840] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WD took 37.0s. Estimated remaining: 12m 48s. Rate: 7.1 symbols/min [2025-10-07T22:20:54.709425] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:20:54.803002] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:20:54.817196] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:20:54.886666] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:20:54.903071] [DEBUG] [LOCAL ] WEA: Loaded 7348 existing records from primary storage. [2025-10-07T22:20:54.903469] [INFO ] [MAIN ] WEA: Loaded 7348 existing records. [2025-10-07T22:20:55.075296] [DEBUG] [LOCAL ] WDS: Loaded 43125 existing records from primary storage. [2025-10-07T22:20:55.129677] [INFO ] [MAIN ] WDS: Loaded 43125 existing records. [2025-10-07T22:20:55.131164] [DEBUG] [LOCAL ] WEC: Loaded 52183 existing records from primary storage. [2025-10-07T22:20:55.130394] [DEBUG] [LOCAL ] WEAV: Loaded 41857 existing records from primary storage. [2025-10-07T22:20:55.147145] [INFO ] [MAIN ] WEC: Loaded 52183 existing records. [2025-10-07T22:20:55.177176] [INFO ] [MAIN ] WEAV: Loaded 41857 existing records. [2025-10-07T22:20:55.251360] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:20:55.328271] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-07T22:20:55.346232] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-07T22:20:55.430114] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-07T22:20:55.444941] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-07T22:20:55.791841] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:20:55.815391] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:20:55.818577] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-07T22:20:55.847205] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-07T22:20:55.880100] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-07T22:20:55.923843] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:20:55.933422] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-07T22:20:55.941352] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-07T22:20:55.964715] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-07T22:20:55.964973] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-07T22:20:55.970361] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-07T22:20:55.970530] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-07T22:20:55.975817] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-07T22:20:56.023998] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-07T22:20:56.034472] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-07T22:20:56.402064] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:20:56.495889] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-07T22:20:57.047584] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:20:57.087887] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-07T22:20:57.161423] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:20:57.172111] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-07T22:20:57.202778] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:20:57.203057] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-07T22:20:57.320626] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-07T22:20:57.322916] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-07T22:20:58.032691] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-07T22:20:58.034784] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-07T22:20:58.752530] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-07T22:20:58.754168] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-07T22:20:58.780757] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T22:20:58.790083] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-07T22:20:59.175784] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-07T22:20:59.186197] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-07T22:20:59.382254] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-07T22:20:59.392856] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-07T22:20:59.436840] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-07T22:20:59.847766] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-07T22:21:00.292781] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T22:21:00.546325] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-07T22:21:00.647727] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-07T22:21:00.998335] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-07T22:21:01.219862] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T22:21:01.447701] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-07T22:21:01.708920] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T22:21:02.247750] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-07T22:21:03.026019] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-07T22:21:03.047616] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-07T22:21:03.158065] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T22:21:03.487523] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-07T22:21:03.847694] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-07T22:21:04.647687] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-07T22:21:05.385623] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-07T22:21:05.447610] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-07T22:21:06.189032] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T22:21:06.247698] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-07T22:21:06.919158] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-07T22:21:07.047671] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-07T22:21:07.847634] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-07T22:21:08.002302] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-07T22:21:08.158051] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-07T22:21:08.647684] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-07T22:21:09.447639] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-07T22:21:09.707396] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T22:21:09.774998] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T22:21:10.247689] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-07T22:21:11.047685] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-07T22:21:11.093095] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-07T22:21:11.214034] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-07T22:21:11.847704] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-07T22:21:12.580018] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T22:21:12.647635] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-07T22:21:13.406537] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-07T22:21:13.447605] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-07T22:21:14.167031] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T22:21:14.247696] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-07T22:21:14.973388] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-07T22:21:15.001048] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-07T22:21:15.047612] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-07T22:21:15.847687] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-07T22:21:16.576789] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-07T22:21:16.647608] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-07T22:21:16.807084] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-07T22:21:17.189482] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T22:21:17.190460] [INFO ] [REMOTE ] WEA: Full fetch complete (9783 records). [2025-10-07T22:21:17.190529] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-07T22:21:17.452888] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-07T22:21:17.564766] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-07T22:21:17.564869] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-07T22:21:17.565158] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-07T22:21:17.565199] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-07T22:21:17.565832] [DEBUG] [LOCAL ] WEA: Trimmed 9783 records to 7396 (keeping 200 days of data) [2025-10-07T22:21:17.614004] [DEBUG] [LOCAL ] WEA: Primary data saved (7396 records). [2025-10-07T22:21:17.614156] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-07T22:21:17.614284] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 23.5s. Estimated remaining: 12m 40s. Rate: 7.1 symbols/min [2025-10-07T22:21:17.779752] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:21:17.832710] [DEBUG] [LOCAL ] WELL: Loaded 52352 existing records from primary storage. [2025-10-07T22:21:17.833060] [INFO ] [MAIN ] WELL: Loaded 52352 existing records. [2025-10-07T22:21:18.024008] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:21:18.024240] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-07T22:21:18.024316] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-07T22:21:18.024616] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-07T22:21:18.024736] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-07T22:21:18.253772] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-07T22:21:18.388800] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:21:19.047670] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-07T22:21:19.159935] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-07T22:21:19.847630] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-07T22:21:20.251086] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T22:21:20.288261] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T22:21:20.647678] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-07T22:21:21.324773] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T22:21:21.447595] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-07T22:21:22.247628] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-07T22:21:22.299002] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T22:21:23.047686] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-07T22:21:23.277232] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-07T22:21:23.847621] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-07T22:21:23.966375] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T22:21:24.356152] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-07T22:21:24.359979] [INFO ] [REMOTE ] WEAV: Full fetch complete (61621 records). [2025-10-07T22:21:24.360125] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-07T22:21:24.655785] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-07T22:21:24.793573] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-07T22:21:24.793680] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-07T22:21:24.794671] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-07T22:21:24.794736] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-07T22:21:24.795958] [DEBUG] [LOCAL ] WEAV: Trimmed 61621 records to 41854 (keeping 200 days of data) [2025-10-07T22:21:25.040083] [DEBUG] [LOCAL ] WEAV: Primary data saved (41854 records). [2025-10-07T22:21:25.040232] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-07T22:21:25.040325] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 30.9s. Estimated remaining: 12m 32s. Rate: 7.1 symbols/min [2025-10-07T22:21:25.208922] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:21:25.251529] [DEBUG] [LOCAL ] WES: Loaded 48203 existing records from primary storage. [2025-10-07T22:21:25.251919] [INFO ] [MAIN ] WES: Loaded 48203 existing records. [2025-10-07T22:21:25.435620] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:21:25.435912] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-07T22:21:25.436021] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-07T22:21:25.436438] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-07T22:21:25.436502] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-07T22:21:25.457558] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-07T22:21:25.819020] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-07T22:21:25.843117] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:21:26.009333] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T22:21:26.012436] [INFO ] [REMOTE ] WDS: Full fetch complete (64339 records). [2025-10-07T22:21:26.012560] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-07T22:21:26.254185] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-07T22:21:26.390339] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-07T22:21:26.390417] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-07T22:21:26.391435] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-07T22:21:26.391501] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-07T22:21:26.392708] [DEBUG] [LOCAL ] WDS: Trimmed 64339 records to 43122 (keeping 200 days of data) [2025-10-07T22:21:26.655635] [DEBUG] [LOCAL ] WDS: Primary data saved (43122 records). [2025-10-07T22:21:26.655808] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-07T22:21:26.655901] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 32.5s. Estimated remaining: 12m 23s. Rate: 7.1 symbols/min [2025-10-07T22:21:26.826686] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:21:26.860385] [DEBUG] [LOCAL ] WEX: Loaded 34032 existing records from primary storage. [2025-10-07T22:21:26.860684] [INFO ] [MAIN ] WEX: Loaded 34032 existing records. [2025-10-07T22:21:27.065219] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T22:21:27.050627] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-07T22:21:27.081970] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:21:27.083957] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-07T22:21:27.084019] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-07T22:21:27.084959] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-07T22:21:27.085035] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-07T22:21:27.434386] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:21:27.847626] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-07T22:21:27.963093] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T22:21:28.647620] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-07T22:21:28.979588] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-07T22:21:29.094455] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-07T22:21:29.447713] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-07T22:21:30.247629] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-07T22:21:30.443442] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T22:21:30.996046] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T22:21:31.047686] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-07T22:21:31.596078] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-07T22:21:31.847711] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-07T22:21:32.569246] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T22:21:32.647673] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-07T22:21:33.385518] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-07T22:21:33.447604] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-07T22:21:34.247674] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-07T22:21:34.385417] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T22:21:35.047627] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-07T22:21:35.153828] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-07T22:21:35.282227] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T22:21:35.847688] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-07T22:21:36.605262] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-07T22:21:36.647595] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-07T22:21:37.146453] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T22:21:37.447734] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-07T22:21:38.247640] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-07T22:21:38.358519] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-07T22:21:39.047746] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-07T22:21:39.084193] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-07T22:21:39.847705] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-07T22:21:39.993755] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T22:21:40.371115] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-07T22:21:40.647692] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-07T22:21:41.355461] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-07T22:21:41.447753] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-07T22:21:42.247775] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-07T22:21:42.387371] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T22:21:43.047758] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-07T22:21:43.259631] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-07T22:21:43.290934] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-07T22:21:43.294754] [INFO ] [REMOTE ] WEC: Full fetch complete (75541 records). [2025-10-07T22:21:43.294884] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-07T22:21:43.679738] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-07T22:21:43.679825] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-07T22:21:43.680951] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-07T22:21:43.681017] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-07T22:21:43.683064] [DEBUG] [LOCAL ] WEC: Trimmed 75541 records to 52184 (keeping 200 days of data) [2025-10-07T22:21:43.870504] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-07T22:21:44.029599] [DEBUG] [LOCAL ] WEC: Primary data saved (52184 records). [2025-10-07T22:21:44.029800] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-07T22:21:44.029905] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 49.9s. Estimated remaining: 12m 15s. Rate: 7.1 symbols/min [2025-10-07T22:21:44.208772] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:21:44.243316] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-07T22:21:44.258921] [DEBUG] [LOCAL ] WF: Loaded 10717 existing records from primary storage. [2025-10-07T22:21:44.259414] [INFO ] [MAIN ] WF: Loaded 10717 existing records. [2025-10-07T22:21:44.436721] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:21:44.436940] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-07T22:21:44.436991] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-07T22:21:44.437162] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-07T22:21:44.437220] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-07T22:21:44.657377] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-07T22:21:44.797537] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:21:45.447730] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-07T22:21:45.565896] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-07T22:21:45.651675] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-07T22:21:46.247754] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-07T22:21:46.566873] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-07T22:21:47.047743] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-07T22:21:47.651956] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-07T22:21:47.847729] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-07T22:21:48.647635] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-07T22:21:48.986940] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-07T22:21:49.049690] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-07T22:21:49.447723] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-07T22:21:50.247680] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-07T22:21:50.365096] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T22:21:50.786815] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-07T22:21:51.047629] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-07T22:21:51.148772] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-07T22:21:51.286351] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-07T22:21:51.290232] [INFO ] [REMOTE ] WELL: Full fetch complete (75744 records). [2025-10-07T22:21:51.290347] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-07T22:21:51.673579] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-07T22:21:51.673695] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-07T22:21:51.674808] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-07T22:21:51.674873] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-07T22:21:51.676269] [DEBUG] [LOCAL ] WELL: Trimmed 75744 records to 52351 (keeping 200 days of data) [2025-10-07T22:21:51.862589] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-07T22:21:52.015540] [DEBUG] [LOCAL ] WELL: Primary data saved (52351 records). [2025-10-07T22:21:52.015750] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-07T22:21:52.015855] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 34.4s. Estimated remaining: 12m 7s. Rate: 7.1 symbols/min [2025-10-07T22:21:52.186444] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:21:52.235013] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-07T22:21:52.235338] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-07T22:21:52.408497] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:21:52.408749] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-07T22:21:52.408806] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-07T22:21:52.409003] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-07T22:21:52.409044] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-07T22:21:52.653544] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-07T22:21:52.759741] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:21:53.183196] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T22:21:53.197326] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-07T22:21:53.447664] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-07T22:21:54.247631] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-07T22:21:54.432783] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-07T22:21:54.434879] [INFO ] [REMOTE ] WEX: Full fetch complete (50320 records). [2025-10-07T22:21:54.434973] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-07T22:21:54.802504] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-07T22:21:54.802587] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-07T22:21:54.803494] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-07T22:21:54.803562] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-07T22:21:54.804630] [DEBUG] [LOCAL ] WEX: Trimmed 50320 records to 33836 (keeping 200 days of data) [2025-10-07T22:21:55.014825] [DEBUG] [LOCAL ] WEX: Primary data saved (33836 records). [2025-10-07T22:21:55.014976] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-07T22:21:55.015065] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WEX took 28.4s. Estimated remaining: 11m 58s. Rate: 7.1 symbols/min [2025-10-07T22:21:55.057830] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-07T22:21:55.194839] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:21:55.218554] [DEBUG] [LOCAL ] WFG: Loaded 24705 existing records from primary storage. [2025-10-07T22:21:55.218866] [INFO ] [MAIN ] WFG: Loaded 24705 existing records. [2025-10-07T22:21:55.330984] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-07T22:21:55.413491] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:21:55.413757] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-07T22:21:55.413813] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-07T22:21:55.414079] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-07T22:21:55.414139] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-07T22:21:55.766792] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:21:55.847608] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-07T22:21:56.645260] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-07T22:21:56.648014] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-07T22:21:57.242668] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-07T22:21:57.447676] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-07T22:21:58.247630] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-07T22:21:58.460048] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T22:21:58.483233] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-07T22:21:59.047687] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-07T22:21:59.847619] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-07T22:22:00.117733] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-07T22:22:00.267269] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-07T22:22:00.647703] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-07T22:22:01.320127] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T22:22:01.447731] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-07T22:22:01.584721] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-07T22:22:02.247735] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-07T22:22:03.047639] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-07T22:22:03.309882] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-07T22:22:03.420880] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-07T22:22:03.424313] [INFO ] [REMOTE ] WES: Full fetch complete (70050 records). [2025-10-07T22:22:03.424416] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-07T22:22:03.803980] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-07T22:22:03.804065] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-07T22:22:03.805106] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-07T22:22:03.805170] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-07T22:22:03.806541] [DEBUG] [LOCAL ] WES: Trimmed 70050 records to 48242 (keeping 200 days of data) [2025-10-07T22:22:03.863684] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-07T22:22:04.117935] [DEBUG] [LOCAL ] WES: Primary data saved (48242 records). [2025-10-07T22:22:04.118076] [INFO ] [MAIN ] WES: Full history saved. [2025-10-07T22:22:04.118161] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WES took 39.1s. Estimated remaining: 11m 50s. Rate: 7.1 symbols/min [2025-10-07T22:22:04.235321] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T22:22:04.304092] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:22:04.341765] [DEBUG] [LOCAL ] WGO: Loaded 38647 existing records from primary storage. [2025-10-07T22:22:04.342080] [INFO ] [MAIN ] WGO: Loaded 38647 existing records. [2025-10-07T22:22:04.518307] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:22:04.518532] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-07T22:22:04.518579] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-07T22:22:04.518803] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-07T22:22:04.518859] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-07T22:22:04.652756] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-07T22:22:04.881619] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:22:05.447685] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-07T22:22:05.919687] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T22:22:05.977124] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-07T22:22:06.087582] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-07T22:22:06.247706] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-07T22:22:07.047696] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-07T22:22:07.847706] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-07T22:22:07.877000] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T22:22:08.398976] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-07T22:22:08.647784] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-07T22:22:09.452946] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-07T22:22:09.455604] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T22:22:09.935251] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-07T22:22:10.045605] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-07T22:22:10.046872] [INFO ] [REMOTE ] WF: Full fetch complete (16195 records). [2025-10-07T22:22:10.046944] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-07T22:22:10.254482] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-07T22:22:10.435426] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-07T22:22:10.435553] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-07T22:22:10.436130] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-07T22:22:10.436198] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-07T22:22:10.437175] [DEBUG] [LOCAL ] WF: Trimmed 16195 records to 10762 (keeping 200 days of data) [2025-10-07T22:22:10.510814] [DEBUG] [LOCAL ] WF: Primary data saved (10762 records). [2025-10-07T22:22:10.510969] [INFO ] [MAIN ] WF: Full history saved. [2025-10-07T22:22:10.511070] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WF took 26.5s. Estimated remaining: 11m 41s. Rate: 7.1 symbols/min [2025-10-07T22:22:10.685804] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:22:10.731922] [DEBUG] [LOCAL ] WH: Loaded 45361 existing records from primary storage. [2025-10-07T22:22:10.732258] [INFO ] [MAIN ] WH: Loaded 45361 existing records. [2025-10-07T22:22:10.909583] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:22:10.909851] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-07T22:22:10.909902] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-07T22:22:10.910266] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-07T22:22:10.910324] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-07T22:22:11.054102] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-07T22:22:11.285413] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:22:11.847688] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-07T22:22:12.482113] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-07T22:22:12.647612] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-07T22:22:12.727701] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-07T22:22:13.448088] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-07T22:22:13.453432] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-07T22:22:14.247622] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-07T22:22:14.751693] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-07T22:22:14.853678] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-07T22:22:15.047695] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-07T22:22:15.707747] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T22:22:15.847695] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-07T22:22:16.134896] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T22:22:16.647696] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-07T22:22:17.447624] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-07T22:22:17.729365] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T22:22:18.230575] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-07T22:22:18.247599] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-07T22:22:19.047624] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-07T22:22:19.092626] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T22:22:19.847622] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-07T22:22:20.030459] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T22:22:20.164760] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-07T22:22:20.647728] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-07T22:22:21.447666] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-07T22:22:21.586432] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T22:22:22.161738] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T22:22:22.247636] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-07T22:22:23.047628] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-07T22:22:23.598811] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-07T22:22:23.852731] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-07T22:22:23.865393] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-07T22:22:24.452181] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-07T22:22:24.647663] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-07T22:22:25.011782] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T22:22:25.447686] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-07T22:22:26.247639] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-07T22:22:26.473824] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-07T22:22:26.674099] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-07T22:22:27.047724] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-07T22:22:27.847727] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-07T22:22:27.985087] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T22:22:28.581839] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-07T22:22:28.583950] [INFO ] [REMOTE ] WFG: Full fetch complete (35950 records). [2025-10-07T22:22:28.584070] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-07T22:22:28.652918] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-07T22:22:28.770086] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T22:22:29.022278] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-07T22:22:29.022384] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-07T22:22:29.023232] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-07T22:22:29.023297] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-07T22:22:29.024710] [DEBUG] [LOCAL ] WFG: Trimmed 35950 records to 24810 (keeping 200 days of data) [2025-10-07T22:22:29.187954] [DEBUG] [LOCAL ] WFG: Primary data saved (24810 records). [2025-10-07T22:22:29.188095] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-07T22:22:29.188182] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFG took 34.2s. Estimated remaining: 11m 33s. Rate: 7.1 symbols/min [2025-10-07T22:22:29.356500] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:22:29.396583] [DEBUG] [LOCAL ] WHD: Loaded 40133 existing records from primary storage. [2025-10-07T22:22:29.396917] [INFO ] [MAIN ] WHD: Loaded 40133 existing records. [2025-10-07T22:22:29.458027] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-07T22:22:29.574543] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:22:29.574765] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-07T22:22:29.574816] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-07T22:22:29.575024] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-07T22:22:29.575080] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-07T22:22:29.935983] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:22:30.062174] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-07T22:22:30.066627] [INFO ] [REMOTE ] WFC: Full fetch complete (77792 records). [2025-10-07T22:22:30.066841] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-07T22:22:30.250607] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-07T22:22:30.473351] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-07T22:22:30.473470] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-07T22:22:30.474790] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-07T22:22:30.474934] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-07T22:22:30.476996] [DEBUG] [LOCAL ] WFC: Trimmed 77792 records to 53748 (keeping 200 days of data) [2025-10-07T22:22:30.502989] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T22:22:30.852960] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-07T22:22:30.853114] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-07T22:22:30.853226] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFC took 38.8s. Estimated remaining: 11m 24s. Rate: 7.1 symbols/min [2025-10-07T22:22:31.019611] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:22:31.025659] [DEBUG] [LOCAL ] WHG: Loaded 3259 existing records from primary storage. [2025-10-07T22:22:31.025862] [INFO ] [MAIN ] WHG: Loaded 3259 existing records. [2025-10-07T22:22:31.055700] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-07T22:22:31.211041] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:22:31.211323] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-07T22:22:31.211419] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-07T22:22:31.211616] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-07T22:22:31.211712] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-07T22:22:31.574799] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:22:31.787833] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T22:22:31.847693] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-07T22:22:32.423967] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T22:22:32.647634] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-07T22:22:32.890457] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T22:22:33.447709] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-07T22:22:33.753154] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-07T22:22:34.247772] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-07T22:22:34.730911] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-07T22:22:34.847319] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-07T22:22:35.047718] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-07T22:22:35.847701] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-07T22:22:36.418266] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T22:22:36.433961] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-07T22:22:36.647723] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-07T22:22:37.240919] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-07T22:22:37.447693] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-07T22:22:38.247690] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-07T22:22:38.706284] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-07T22:22:38.709010] [INFO ] [REMOTE ] WGO: Full fetch complete (57564 records). [2025-10-07T22:22:38.709140] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-07T22:22:39.052877] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-07T22:22:39.179333] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-07T22:22:39.179437] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-07T22:22:39.180582] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-07T22:22:39.180701] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-07T22:22:39.182131] [DEBUG] [LOCAL ] WGO: Trimmed 57564 records to 38584 (keeping 200 days of data) [2025-10-07T22:22:39.459430] [DEBUG] [LOCAL ] WGO: Primary data saved (38584 records). [2025-10-07T22:22:39.459589] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-07T22:22:39.459734] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WGO took 35.3s. Estimated remaining: 11m 16s. Rate: 7.1 symbols/min [2025-10-07T22:22:39.700754] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:22:39.721785] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T22:22:39.776454] [DEBUG] [LOCAL ] WHR: Loaded 48229 existing records from primary storage. [2025-10-07T22:22:39.776873] [INFO ] [MAIN ] WHR: Loaded 48229 existing records. [2025-10-07T22:22:39.848014] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-07T22:22:39.996446] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:22:39.997175] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-07T22:22:39.997233] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-07T22:22:39.997520] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-07T22:22:39.997579] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-07T22:22:40.368025] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:22:40.647723] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-07T22:22:40.714103] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-07T22:22:41.247131] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T22:22:41.447635] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-07T22:22:41.522216] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T22:22:42.015718] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-07T22:22:42.247675] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-07T22:22:43.047670] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-07T22:22:43.667410] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-07T22:22:43.831955] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T22:22:43.847599] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-07T22:22:44.647691] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-07T22:22:45.447622] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-07T22:22:45.522794] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T22:22:46.237699] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-07T22:22:46.247535] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-07T22:22:46.948813] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T22:22:47.047687] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-07T22:22:47.447322] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-07T22:22:47.639796] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-07T22:22:47.847704] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-07T22:22:48.647701] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-07T22:22:49.447680] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-07T22:22:49.628207] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T22:22:50.249661] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-07T22:22:50.252031] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-07T22:22:50.525125] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-07T22:22:50.770662] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-07T22:22:51.047749] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-07T22:22:51.577348] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-07T22:22:51.847757] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-07T22:22:52.647702] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-07T22:22:53.447724] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-07T22:22:54.247737] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-07T22:23:04.711558] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (10.46 seconds). [2025-10-07T22:23:04.712466] [INFO ] [REMOTE ] WHG: Full fetch complete (4593 records). [2025-10-07T22:23:04.712741] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-07T22:23:05.074826] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-07T22:23:05.074919] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-07T22:23:05.075065] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-07T22:23:05.075104] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-07T22:23:05.075511] [DEBUG] [LOCAL ] WHG: Trimmed 4593 records to 3250 (keeping 200 days of data) [2025-10-07T22:23:05.096461] [DEBUG] [LOCAL ] WHG: Primary data saved (3250 records). [2025-10-07T22:23:05.096580] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-07T22:23:05.096696] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WHG took 34.2s. Estimated remaining: 11m 8s. Rate: 7.1 symbols/min [2025-10-07T22:23:05.262622] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:23:05.270180] [DEBUG] [LOCAL ] WIA: Loaded 4878 existing records from primary storage. [2025-10-07T22:23:05.270390] [INFO ] [MAIN ] WIA: Loaded 4878 existing records. [2025-10-07T22:23:05.452321] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:23:05.452594] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-07T22:23:05.452665] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-07T22:23:05.452889] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-07T22:23:05.452946] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-07T22:23:05.823013] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:23:05.823530] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-07T22:23:06.181369] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (12.73 seconds). [2025-10-07T22:23:06.191406] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-07T22:23:06.265972] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (13.62 seconds). [2025-10-07T22:23:06.278873] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-07T22:23:06.281339] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-07T22:23:06.283004] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-07T22:23:06.513083] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (14.67 seconds). [2025-10-07T22:23:06.523546] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-07T22:23:06.669176] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-07T22:23:06.671158] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-07T22:23:07.049737] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-07T22:23:07.051436] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-07T22:23:07.112033] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T22:23:07.115053] [INFO ] [REMOTE ] WH: Full fetch complete (64927 records). [2025-10-07T22:23:07.115162] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-07T22:23:07.506342] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-07T22:23:07.506450] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-07T22:23:07.507487] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-07T22:23:07.507552] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-07T22:23:07.510630] [DEBUG] [LOCAL ] WH: Trimmed 64927 records to 45319 (keeping 200 days of data) [2025-10-07T22:23:07.632578] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-07T22:23:07.636561] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-07T22:23:07.817313] [DEBUG] [LOCAL ] WH: Primary data saved (45319 records). [2025-10-07T22:23:07.817455] [INFO ] [MAIN ] WH: Full history saved. [2025-10-07T22:23:07.817538] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WH took 57.3s. Estimated remaining: 10m 59s. Rate: 7.1 symbols/min [2025-10-07T22:23:07.998883] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:23:08.029527] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T22:23:08.047632] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-07T22:23:08.047867] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-07T22:23:08.052358] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-07T22:23:08.057410] [DEBUG] [LOCAL ] WINN: Loaded 11587 existing records from primary storage. [2025-10-07T22:23:08.058610] [INFO ] [MAIN ] WINN: Loaded 11587 existing records. [2025-10-07T22:23:08.256016] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T22:23:08.286435] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:23:08.287784] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-07T22:23:08.287357] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-07T22:23:08.287932] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-07T22:23:08.289015] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-07T22:23:08.289098] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-07T22:23:08.645981] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:23:08.646357] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-07T22:23:08.720041] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-07T22:23:08.721718] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-07T22:23:09.329711] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-07T22:23:09.331744] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-07T22:23:09.509999] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-07T22:23:09.513285] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-07T22:23:09.583895] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T22:23:09.592901] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-07T22:23:09.959333] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-07T22:23:09.961252] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-07T22:23:10.246697] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-07T22:23:10.257687] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-07T22:23:10.403448] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-07T22:23:10.407015] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-07T22:23:10.609450] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-07T22:23:10.613133] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-07T22:23:10.768526] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T22:23:10.771950] [INFO ] [REMOTE ] WHD: Full fetch complete (57626 records). [2025-10-07T22:23:10.772110] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-07T22:23:11.106686] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-07T22:23:11.129487] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-07T22:23:11.220477] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-07T22:23:11.220607] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-07T22:23:11.222399] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-07T22:23:11.222482] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-07T22:23:11.224633] [DEBUG] [LOCAL ] WHD: Trimmed 57626 records to 40105 (keeping 200 days of data) [2025-10-07T22:23:11.337565] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-07T22:23:11.517820] [DEBUG] [LOCAL ] WHD: Primary data saved (40105 records). [2025-10-07T22:23:11.517985] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-07T22:23:11.518082] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 42.3s. Estimated remaining: 10m 51s. Rate: 7.1 symbols/min [2025-10-07T22:23:11.691586] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:23:11.738959] [DEBUG] [LOCAL ] WIT: Loaded 52389 existing records from primary storage. [2025-10-07T22:23:11.739336] [INFO ] [MAIN ] WIT: Loaded 52389 existing records. [2025-10-07T22:23:11.852095] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-07T22:23:11.945535] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:23:11.946477] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-07T22:23:11.946632] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-07T22:23:11.947191] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-07T22:23:11.947328] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-07T22:23:12.101346] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-07T22:23:12.218704] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-07T22:23:12.375263] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:23:12.507356] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T22:23:12.508350] [INFO ] [REMOTE ] WIA: Full fetch complete (7277 records). [2025-10-07T22:23:12.508420] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-07T22:23:12.655813] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-07T22:23:12.869983] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-07T22:23:12.870062] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-07T22:23:12.870263] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-07T22:23:12.870302] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-07T22:23:12.870729] [DEBUG] [LOCAL ] WIA: Trimmed 7277 records to 4903 (keeping 200 days of data) [2025-10-07T22:23:12.902214] [DEBUG] [LOCAL ] WIA: Primary data saved (4903 records). [2025-10-07T22:23:12.902346] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-07T22:23:12.902433] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WIA took 7.8s. Estimated remaining: 10m 42s. Rate: 7.1 symbols/min [2025-10-07T22:23:13.074598] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:23:13.095269] [DEBUG] [LOCAL ] WIW: Loaded 20445 existing records from primary storage. [2025-10-07T22:23:13.095575] [INFO ] [MAIN ] WIW: Loaded 20445 existing records. [2025-10-07T22:23:13.276351] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:23:13.276621] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-07T22:23:13.276701] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-07T22:23:13.276929] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-07T22:23:13.276981] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-07T22:23:13.448378] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-07T22:23:13.629679] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:23:14.247621] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-07T22:23:14.492542] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T22:23:14.503233] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T22:23:15.047693] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-07T22:23:15.847615] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-07T22:23:15.993882] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-07T22:23:16.246790] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-07T22:23:16.647702] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-07T22:23:17.447704] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-07T22:23:17.592477] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-07T22:23:17.767372] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T22:23:18.247734] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-07T22:23:19.041155] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-07T22:23:19.047593] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-07T22:23:19.250953] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T22:23:19.818024] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T22:23:19.847605] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-07T22:23:20.632179] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-07T22:23:20.647603] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-07T22:23:21.447716] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-07T22:23:22.247627] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-07T22:23:22.448396] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-07T22:23:22.533181] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-07T22:23:23.023850] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-07T22:23:23.047635] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-07T22:23:23.847632] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-07T22:23:23.873101] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-07T22:23:24.647707] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-07T22:23:25.436315] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-07T22:23:25.447591] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-07T22:23:25.494372] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-07T22:23:26.247732] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-07T22:23:26.906484] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-07T22:23:26.907762] [INFO ] [REMOTE ] WINN: Full fetch complete (17459 records). [2025-10-07T22:23:26.907835] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-07T22:23:27.048744] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-07T22:23:27.342475] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-07T22:23:27.353460] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-07T22:23:27.364600] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-07T22:23:27.365098] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-07T22:23:27.365179] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-07T22:23:27.366636] [DEBUG] [LOCAL ] WINN: Trimmed 17459 records to 11566 (keeping 200 days of data) [2025-10-07T22:23:27.440611] [DEBUG] [LOCAL ] WINN: Primary data saved (11566 records). [2025-10-07T22:23:27.440808] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-07T22:23:27.440915] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 19.6s. Estimated remaining: 10m 34s. Rate: 7.1 symbols/min [2025-10-07T22:23:27.613554] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:23:27.650166] [DEBUG] [LOCAL ] WK: Loaded 37239 existing records from primary storage. [2025-10-07T22:23:27.650497] [INFO ] [MAIN ] WK: Loaded 37239 existing records. [2025-10-07T22:23:27.835472] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:23:27.835712] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-07T22:23:27.835768] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-07T22:23:27.836043] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-07T22:23:27.836100] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-07T22:23:27.855784] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-07T22:23:28.190414] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:23:28.347846] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T22:23:28.351271] [INFO ] [REMOTE ] WHR: Full fetch complete (68774 records). [2025-10-07T22:23:28.351391] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-07T22:23:28.650872] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-07T22:23:28.750053] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-07T22:23:28.750147] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-07T22:23:28.751247] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-07T22:23:28.751314] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-07T22:23:28.752741] [DEBUG] [LOCAL ] WHR: Trimmed 68774 records to 48284 (keeping 200 days of data) [2025-10-07T22:23:29.075421] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-07T22:23:29.094167] [DEBUG] [LOCAL ] WHR: Primary data saved (48284 records). [2025-10-07T22:23:29.094291] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-07T22:23:29.094399] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 49.6s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-07T22:23:29.262808] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:23:29.296445] [DEBUG] [LOCAL ] WKC: Loaded 34752 existing records from primary storage. [2025-10-07T22:23:29.296866] [INFO ] [MAIN ] WKC: Loaded 34752 existing records. [2025-10-07T22:23:29.455339] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-07T22:23:29.480330] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:23:29.480683] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-07T22:23:29.480756] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-07T22:23:29.481016] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-07T22:23:29.481094] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-07T22:23:29.839071] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:23:30.247633] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-07T22:23:30.391460] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-07T22:23:30.849006] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-07T22:23:31.047713] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-07T22:23:31.701725] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-07T22:23:31.847728] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-07T22:23:32.647632] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-07T22:23:32.795798] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-07T22:23:32.872835] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-07T22:23:33.447693] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-07T22:23:34.097357] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T22:23:34.247687] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-07T22:23:35.047629] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-07T22:23:35.140565] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-07T22:23:35.591345] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-07T22:23:35.847685] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-07T22:23:36.031852] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-07T22:23:36.647675] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-07T22:23:37.295224] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T22:23:37.447695] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-07T22:23:37.748975] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-07T22:23:38.247711] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-07T22:23:39.047733] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-07T22:23:39.316136] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-07T22:23:39.402870] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T22:23:39.847696] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-07T22:23:40.590049] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-07T22:23:40.647672] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-07T22:23:41.447635] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-07T22:23:41.630491] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T22:23:42.247630] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-07T22:23:42.330280] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T22:23:42.726881] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-07T22:23:43.047684] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-07T22:23:43.854383] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-07T22:23:43.886162] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-07T22:23:43.888629] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-07T22:23:43.901749] [INFO ] [REMOTE ] WIW: Full fetch complete (29770 records). [2025-10-07T22:23:43.902990] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-07T22:23:44.297044] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-07T22:23:44.297196] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-07T22:23:44.298227] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-07T22:23:44.298313] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-07T22:23:44.299491] [DEBUG] [LOCAL ] WIW: Trimmed 29770 records to 20492 (keeping 200 days of data) [2025-10-07T22:23:44.439233] [DEBUG] [LOCAL ] WIW: Primary data saved (20492 records). [2025-10-07T22:23:44.439374] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-07T22:23:44.439473] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIW took 31.5s. Estimated remaining: 10m 17s. Rate: 7.1 symbols/min [2025-10-07T22:23:44.619594] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:23:44.647686] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-07T22:23:44.663699] [DEBUG] [LOCAL ] WLK: Loaded 45531 existing records from primary storage. [2025-10-07T22:23:44.664006] [INFO ] [MAIN ] WLK: Loaded 45531 existing records. [2025-10-07T22:23:44.844676] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:23:44.844882] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-07T22:23:44.844951] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-07T22:23:44.845203] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-07T22:23:44.845260] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-07T22:23:45.203498] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:23:45.221335] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T22:23:45.447695] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-07T22:23:46.091239] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T22:23:46.094943] [INFO ] [REMOTE ] WIT: Full fetch complete (75699 records). [2025-10-07T22:23:46.095128] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-07T22:23:46.256927] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-07T22:23:46.508764] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-07T22:23:46.508884] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-07T22:23:46.510179] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-07T22:23:46.510244] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-07T22:23:46.511930] [DEBUG] [LOCAL ] WIT: Trimmed 75699 records to 52389 (keeping 200 days of data) [2025-10-07T22:23:46.825896] [DEBUG] [LOCAL ] WIT: Primary data saved (52389 records). [2025-10-07T22:23:46.826032] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-07T22:23:46.826114] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIT took 35.3s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-07T22:23:46.989433] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T22:23:47.015972] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:23:47.031805] [DEBUG] [LOCAL ] WLKP: Loaded 6895 existing records from primary storage. [2025-10-07T22:23:47.031994] [INFO ] [MAIN ] WLKP: Loaded 6895 existing records. [2025-10-07T22:23:47.052828] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-07T22:23:47.241035] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:23:47.241274] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-07T22:23:47.241385] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-07T22:23:47.241607] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-07T22:23:47.241697] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-07T22:23:47.586595] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:23:47.847625] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-07T22:23:48.010631] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-07T22:23:48.545295] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T22:23:48.640128] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-07T22:23:48.647601] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-07T22:23:49.444340] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-07T22:23:49.447595] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-07T22:23:50.242169] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-07T22:23:50.247598] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-07T22:23:50.897688] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-07T22:23:51.047665] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-07T22:23:51.847727] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-07T22:23:52.539707] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-07T22:23:52.647695] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-07T22:23:53.188009] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-07T22:23:53.447693] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-07T22:23:54.147686] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T22:23:54.247749] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-07T22:23:54.830494] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-07T22:23:55.047695] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-07T22:23:55.794264] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T22:23:55.847610] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-07T22:23:56.211691] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-07T22:23:56.647708] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-07T22:23:57.348013] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-07T22:23:57.447680] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-07T22:23:58.037557] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-07T22:23:58.247744] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-07T22:23:59.004409] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-07T22:23:59.047705] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-07T22:23:59.796558] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-07T22:23:59.847723] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-07T22:24:00.647637] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-07T22:24:00.758692] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T22:24:01.268966] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T22:24:01.281598] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-07T22:24:01.447690] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-07T22:24:02.247739] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-07T22:24:03.052820] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-07T22:24:03.070410] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T22:24:03.660173] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T22:24:03.799780] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-07T22:24:03.847690] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-07T22:24:04.647686] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-07T22:24:05.240070] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T22:24:05.414429] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-07T22:24:05.447618] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-07T22:24:06.247703] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-07T22:24:06.962437] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-07T22:24:07.047715] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-07T22:24:07.187275] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-07T22:24:07.847686] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-07T22:24:07.988942] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T22:24:07.991833] [INFO ] [REMOTE ] WK: Full fetch complete (52856 records). [2025-10-07T22:24:07.991935] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-07T22:24:08.367572] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-07T22:24:08.367684] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-07T22:24:08.368613] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-07T22:24:08.368684] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-07T22:24:08.369777] [DEBUG] [LOCAL ] WK: Trimmed 52856 records to 37238 (keeping 200 days of data) [2025-10-07T22:24:08.595013] [DEBUG] [LOCAL ] WK: Primary data saved (37238 records). [2025-10-07T22:24:08.595171] [INFO ] [MAIN ] WK: Full history saved. [2025-10-07T22:24:08.595290] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 41.2s. Estimated remaining: 10m 0s. Rate: 7.1 symbols/min [2025-10-07T22:24:08.656874] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-07T22:24:08.771055] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:24:08.771385] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-07T22:24:08.771437] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-07T22:24:08.771514] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-07T22:24:08.771551] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-07T22:24:08.771594] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-07T22:24:08.771627] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-07T22:24:09.126948] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:24:09.337239] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-07T22:24:09.447705] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-07T22:24:10.247717] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-07T22:24:10.457455] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T22:24:10.581881] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T22:24:10.584291] [INFO ] [REMOTE ] WKC: Full fetch complete (50731 records). [2025-10-07T22:24:10.584372] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-07T22:24:10.961087] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-07T22:24:10.961168] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-07T22:24:10.962032] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-07T22:24:10.962116] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-07T22:24:10.963420] [DEBUG] [LOCAL ] WKC: Trimmed 50731 records to 34750 (keeping 200 days of data) [2025-10-07T22:24:10.969849] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T22:24:11.059079] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-07T22:24:11.187776] [DEBUG] [LOCAL ] WKC: Primary data saved (34750 records). [2025-10-07T22:24:11.187916] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-07T22:24:11.187998] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 42.1s. Estimated remaining: 9m 52s. Rate: 7.1 symbols/min [2025-10-07T22:24:11.353458] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:24:11.381902] [DEBUG] [LOCAL ] WLY: Loaded 29517 existing records from primary storage. [2025-10-07T22:24:11.382168] [INFO ] [MAIN ] WLY: Loaded 29517 existing records. [2025-10-07T22:24:11.474845] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-07T22:24:11.563680] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:24:11.563923] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-07T22:24:11.563970] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-07T22:24:11.564212] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-07T22:24:11.564268] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-07T22:24:11.852756] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-07T22:24:11.914537] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:24:12.247359] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-07T22:24:12.647695] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-07T22:24:13.447681] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-07T22:24:13.961166] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-07T22:24:13.973820] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-07T22:24:14.247619] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-07T22:24:14.819244] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T22:24:14.820736] [INFO ] [REMOTE ] WLKP: Full fetch complete (10300 records). [2025-10-07T22:24:14.820813] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-07T22:24:15.052924] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-07T22:24:15.188663] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-07T22:24:15.188765] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-07T22:24:15.189092] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-07T22:24:15.189179] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-07T22:24:15.190258] [DEBUG] [LOCAL ] WLKP: Trimmed 10300 records to 6905 (keeping 200 days of data) [2025-10-07T22:24:15.233884] [DEBUG] [LOCAL ] WLKP: Primary data saved (6905 records). [2025-10-07T22:24:15.233977] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-07T22:24:15.234056] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 28.4s. Estimated remaining: 9m 43s. Rate: 7.1 symbols/min [2025-10-07T22:24:15.404486] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:24:15.455802] [DEBUG] [LOCAL ] WM: Loaded 50929 existing records from primary storage. [2025-10-07T22:24:15.456132] [INFO ] [MAIN ] WM: Loaded 50929 existing records. [2025-10-07T22:24:15.629190] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:24:15.629356] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-07T22:24:15.629403] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-07T22:24:15.629689] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-07T22:24:15.629747] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-07T22:24:15.853417] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-07T22:24:15.984506] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:24:16.257121] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-07T22:24:16.355841] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-07T22:24:16.647700] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-07T22:24:17.447771] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-07T22:24:17.806339] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-07T22:24:17.932620] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-07T22:24:18.247626] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-07T22:24:19.047734] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-07T22:24:19.847740] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-07T22:24:20.169240] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-07T22:24:20.622183] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T22:24:20.647595] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-07T22:24:20.888009] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-07T22:24:21.447737] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-07T22:24:21.882732] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-07T22:24:22.217364] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-07T22:24:22.220605] [INFO ] [REMOTE ] WLK: Full fetch complete (63226 records). [2025-10-07T22:24:22.220747] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-07T22:24:22.252857] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-07T22:24:22.607180] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-07T22:24:22.607501] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-07T22:24:22.608557] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-07T22:24:22.608623] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-07T22:24:22.610136] [DEBUG] [LOCAL ] WLK: Trimmed 63226 records to 45565 (keeping 200 days of data) [2025-10-07T22:24:22.704243] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-07T22:24:22.899396] [DEBUG] [LOCAL ] WLK: Primary data saved (45565 records). [2025-10-07T22:24:22.899537] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-07T22:24:22.899633] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 38.5s. Estimated remaining: 9m 35s. Rate: 7.1 symbols/min [2025-10-07T22:24:23.066015] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:24:23.062821] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-07T22:24:23.117737] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-10-07T22:24:23.118082] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-10-07T22:24:23.299623] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:24:23.299903] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-07T22:24:23.299951] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-07T22:24:23.300515] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-07T22:24:23.300573] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-07T22:24:23.554516] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-07T22:24:23.652964] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:24:23.847700] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-07T22:24:24.647730] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-07T22:24:25.447690] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-07T22:24:25.688513] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-07T22:24:25.880371] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-07T22:24:25.946776] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-07T22:24:26.247612] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-07T22:24:27.047862] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-07T22:24:27.847632] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-07T22:24:28.146251] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-07T22:24:28.611042] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-07T22:24:28.647613] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-07T22:24:29.276842] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T22:24:29.447606] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-07T22:24:29.875311] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-07T22:24:30.247638] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-07T22:24:30.462820] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-07T22:24:31.047695] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-07T22:24:31.679154] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-07T22:24:31.847620] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-07T22:24:32.214719] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-07T22:24:32.596831] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T22:24:32.647597] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-07T22:24:32.909942] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-07T22:24:32.910629] [INFO ] [REMOTE ] WLTG: Full fetch complete (1673 records). [2025-10-07T22:24:32.910740] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-07T22:24:33.083550] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T22:24:33.083806] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-07T22:24:33.083896] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-07T22:24:33.083995] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-07T22:24:33.084098] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-07T22:24:33.084137] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-07T22:24:33.084177] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-07T22:24:33.084231] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLTG took 24.5s. Estimated remaining: 9m 26s. Rate: 7.1 symbols/min [2025-10-07T22:24:33.253347] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:24:33.272091] [DEBUG] [LOCAL ] WMK: Loaded 14518 existing records from primary storage. [2025-10-07T22:24:33.272350] [INFO ] [MAIN ] WMK: Loaded 14518 existing records. [2025-10-07T22:24:33.452981] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-07T22:24:33.457791] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:24:33.458667] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-07T22:24:33.458731] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-07T22:24:33.459387] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-07T22:24:33.459446] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-07T22:24:33.800811] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:24:34.247738] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-07T22:24:35.047711] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-07T22:24:35.546343] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-07T22:24:35.626573] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-07T22:24:35.847737] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-07T22:24:36.647612] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-07T22:24:36.722424] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-07T22:24:37.447716] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-07T22:24:37.719349] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T22:24:37.753077] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T22:24:38.247754] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-07T22:24:39.047622] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-07T22:24:39.113485] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-07T22:24:39.446200] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-07T22:24:39.763857] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-07T22:24:39.847686] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-07T22:24:40.647618] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-07T22:24:41.099554] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-07T22:24:41.447697] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-07T22:24:42.247623] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-07T22:24:42.329304] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T22:24:42.452310] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T22:24:43.047671] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-07T22:24:43.847708] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-07T22:24:44.322580] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-07T22:24:44.647621] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-07T22:24:44.859408] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-07T22:24:44.861632] [INFO ] [REMOTE ] WLY: Full fetch complete (42711 records). [2025-10-07T22:24:44.861746] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-07T22:24:45.291074] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-07T22:24:45.291202] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-07T22:24:45.292833] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-07T22:24:45.292960] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-07T22:24:45.295233] [DEBUG] [LOCAL ] WLY: Trimmed 42711 records to 29501 (keeping 200 days of data) [2025-10-07T22:24:45.430996] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-07T22:24:45.447710] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-07T22:24:45.544222] [DEBUG] [LOCAL ] WLY: Primary data saved (29501 records). [2025-10-07T22:24:45.544384] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-07T22:24:45.544498] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 34.4s. Estimated remaining: 9m 18s. Rate: 7.1 symbols/min [2025-10-07T22:24:45.709735] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:24:45.752637] [DEBUG] [LOCAL ] WMS: Loaded 39588 existing records from primary storage. [2025-10-07T22:24:45.753020] [INFO ] [MAIN ] WMS: Loaded 39588 existing records. [2025-10-07T22:24:45.939718] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:24:45.939960] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-07T22:24:45.940009] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-07T22:24:45.941228] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-07T22:24:45.941291] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-07T22:24:46.250678] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-07T22:24:46.304533] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:24:46.435316] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T22:24:47.047616] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-07T22:24:47.290090] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-07T22:24:47.433453] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T22:24:47.847699] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-07T22:24:48.565574] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T22:24:48.647711] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-07T22:24:49.447690] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-07T22:24:49.969943] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-07T22:24:50.247728] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-07T22:24:50.344005] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-07T22:24:50.634540] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-07T22:24:51.047699] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-07T22:24:51.413135] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T22:24:51.847636] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-07T22:24:52.105199] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T22:24:52.647721] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-07T22:24:53.391200] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-07T22:24:53.447633] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-07T22:24:54.247687] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-07T22:24:54.522248] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-07T22:24:54.601743] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-07T22:24:54.893960] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T22:24:54.901347] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-10-07T22:24:54.901599] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-07T22:24:55.052550] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-07T22:24:55.300340] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-07T22:24:55.300431] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-07T22:24:55.301570] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-07T22:24:55.301635] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-07T22:24:55.303145] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53672 (keeping 200 days of data) [2025-10-07T22:24:55.639091] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-07T22:24:55.639229] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-07T22:24:55.639340] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMB took 32.7s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-07T22:24:55.812755] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:24:55.847687] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-07T22:24:55.867813] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-07T22:24:55.868147] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-07T22:24:56.047057] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:24:56.047321] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-07T22:24:56.047381] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-07T22:24:56.047888] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-07T22:24:56.047953] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-07T22:24:56.425051] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:24:56.591799] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-07T22:24:56.617321] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T22:24:56.647603] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-07T22:24:57.447705] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-07T22:24:58.097979] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T22:24:58.247724] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-07T22:24:59.047724] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-07T22:24:59.530839] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-07T22:24:59.782595] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T22:24:59.847599] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-07T22:25:00.647670] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-07T22:25:01.271469] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T22:25:01.361273] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-07T22:25:01.447710] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-07T22:25:01.591558] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-07T22:25:02.247697] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-07T22:25:02.960985] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-07T22:25:03.047635] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-07T22:25:03.265266] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T22:25:03.847745] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-07T22:25:04.414058] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-07T22:25:04.417535] [INFO ] [REMOTE ] WM: Full fetch complete (73772 records). [2025-10-07T22:25:04.417693] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-07T22:25:04.652767] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-07T22:25:04.827743] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-07T22:25:04.840109] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-07T22:25:04.841471] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-07T22:25:04.844284] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-07T22:25:04.847399] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-07T22:25:04.857777] [DEBUG] [LOCAL ] WM: Trimmed 73772 records to 50967 (keeping 200 days of data) [2025-10-07T22:25:05.198081] [DEBUG] [LOCAL ] WM: Primary data saved (50967 records). [2025-10-07T22:25:05.198224] [INFO ] [MAIN ] WM: Full history saved. [2025-10-07T22:25:05.198319] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WM took 50.0s. Estimated remaining: 9m 1s. Rate: 7.1 symbols/min [2025-10-07T22:25:05.363924] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:25:05.401771] [DEBUG] [LOCAL ] WNC: Loaded 39061 existing records from primary storage. [2025-10-07T22:25:05.402087] [INFO ] [MAIN ] WNC: Loaded 39061 existing records. [2025-10-07T22:25:05.454951] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-07T22:25:05.584538] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:25:05.584811] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-07T22:25:05.584871] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-07T22:25:05.585195] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-07T22:25:05.585252] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-07T22:25:05.933324] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:25:06.247686] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-07T22:25:06.492264] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-07T22:25:07.047684] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-07T22:25:07.109833] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-07T22:25:07.580325] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-07T22:25:07.843512] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-07T22:25:07.845338] [INFO ] [REMOTE ] WMK: Full fetch complete (19714 records). [2025-10-07T22:25:07.845411] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-07T22:25:07.856528] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-07T22:25:08.236618] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-07T22:25:08.236795] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-07T22:25:08.237233] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-07T22:25:08.237275] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-07T22:25:08.237864] [DEBUG] [LOCAL ] WMK: Trimmed 19714 records to 14558 (keeping 200 days of data) [2025-10-07T22:25:08.328938] [DEBUG] [LOCAL ] WMK: Primary data saved (14558 records). [2025-10-07T22:25:08.329078] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-07T22:25:08.329161] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMK took 35.2s. Estimated remaining: 8m 52s. Rate: 7.1 symbols/min [2025-10-07T22:25:08.493142] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:25:08.537075] [DEBUG] [LOCAL ] WNS: Loaded 39934 existing records from primary storage. [2025-10-07T22:25:08.537392] [INFO ] [MAIN ] WNS: Loaded 39934 existing records. [2025-10-07T22:25:08.652792] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-07T22:25:08.714969] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:25:08.715217] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-07T22:25:08.715267] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-07T22:25:08.715458] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-07T22:25:08.715515] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-07T22:25:09.066366] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:25:09.447679] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-07T22:25:10.170818] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-07T22:25:10.247612] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-07T22:25:10.557585] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-10-07T22:25:11.053066] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-07T22:25:11.069338] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-07T22:25:11.847625] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-07T22:25:11.911710] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T22:25:12.484862] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T22:25:12.647622] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-07T22:25:13.084492] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T22:25:13.087315] [INFO ] [REMOTE ] WMS: Full fetch complete (57158 records). [2025-10-07T22:25:13.087433] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-07T22:25:13.448787] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-07T22:25:13.464109] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-07T22:25:13.464201] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-07T22:25:13.465227] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-07T22:25:13.465407] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-07T22:25:13.466667] [DEBUG] [LOCAL ] WMS: Trimmed 57158 records to 39589 (keeping 200 days of data) [2025-10-07T22:25:13.734798] [DEBUG] [LOCAL ] WMS: Primary data saved (39589 records). [2025-10-07T22:25:13.734956] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-07T22:25:13.735053] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMS took 28.2s. Estimated remaining: 8m 44s. Rate: 7.1 symbols/min [2025-10-07T22:25:13.899629] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:25:13.949529] [DEBUG] [LOCAL ] WOLF: Loaded 53177 existing records from primary storage. [2025-10-07T22:25:13.949918] [INFO ] [MAIN ] WOLF: Loaded 53177 existing records. [2025-10-07T22:25:14.123911] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:25:14.124109] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-07T22:25:14.124155] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-07T22:25:14.124366] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-07T22:25:14.124422] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-07T22:25:14.248153] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-07T22:25:14.512895] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:25:14.515391] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T22:25:14.869938] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-07T22:25:15.047638] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-07T22:25:15.847670] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-07T22:25:16.296111] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-07T22:25:16.647639] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-07T22:25:16.997540] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-07T22:25:17.447760] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-07T22:25:17.948863] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-07T22:25:18.025413] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T22:25:18.247702] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-07T22:25:19.047672] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-07T22:25:19.847702] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-07T22:25:20.054377] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-07T22:25:20.470617] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-07T22:25:20.597930] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T22:25:20.647715] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-07T22:25:20.985996] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-07T22:25:21.447727] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-07T22:25:22.247705] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-07T22:25:22.870298] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-07T22:25:22.905037] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-07T22:25:23.047683] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-07T22:25:23.847764] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-07T22:25:24.647672] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-07T22:25:24.868134] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-07T22:25:25.272175] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-07T22:25:25.343090] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-07T22:25:25.447732] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-07T22:25:25.742174] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T22:25:26.247742] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-07T22:25:26.890080] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T22:25:27.047713] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-07T22:25:27.847774] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-07T22:25:28.471395] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-07T22:25:28.647752] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-07T22:25:28.719848] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-07T22:25:28.923479] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T22:25:29.447729] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-07T22:25:30.247635] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-07T22:25:30.429416] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T22:25:30.782670] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-07T22:25:31.047639] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-07T22:25:31.847686] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-07T22:25:32.647633] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-07T22:25:32.844052] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-07T22:25:32.843612] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-07T22:25:32.858585] [INFO ] [REMOTE ] WNC: Full fetch complete (57562 records). [2025-10-07T22:25:32.858812] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-07T22:25:33.247855] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-07T22:25:33.248024] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-07T22:25:33.249248] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-07T22:25:33.249392] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-07T22:25:33.251076] [DEBUG] [LOCAL ] WNC: Trimmed 57562 records to 38981 (keeping 200 days of data) [2025-10-07T22:25:33.370692] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-07T22:25:33.470955] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-07T22:25:33.546678] [DEBUG] [LOCAL ] WNC: Primary data saved (38981 records). [2025-10-07T22:25:33.546879] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-07T22:25:33.547009] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 28.3s. Estimated remaining: 8m 36s. Rate: 7.1 symbols/min [2025-10-07T22:25:33.718275] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:25:33.745173] [DEBUG] [LOCAL ] WOR: Loaded 24870 existing records from primary storage. [2025-10-07T22:25:33.745457] [INFO ] [MAIN ] WOR: Loaded 24870 existing records. [2025-10-07T22:25:33.920528] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:25:33.920758] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-07T22:25:33.920808] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-07T22:25:33.921150] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-07T22:25:33.921207] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-07T22:25:34.270352] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-07T22:25:34.343416] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-07T22:25:34.357215] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:25:35.047709] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-07T22:25:35.557083] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-07T22:25:35.847692] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-07T22:25:36.145975] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-07T22:25:36.647624] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-07T22:25:36.907771] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-07T22:25:37.316876] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-07T22:25:37.447629] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-07T22:25:37.794303] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-07T22:25:38.247691] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-07T22:25:39.047698] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-07T22:25:39.377847] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-07T22:25:39.380784] [INFO ] [REMOTE ] WNS: Full fetch complete (55021 records). [2025-10-07T22:25:39.380899] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-07T22:25:39.795284] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-07T22:25:39.795465] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-07T22:25:39.796532] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-07T22:25:39.796617] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-07T22:25:39.797907] [DEBUG] [LOCAL ] WNS: Trimmed 55021 records to 39883 (keeping 200 days of data) [2025-10-07T22:25:39.849357] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-07T22:25:40.075798] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-07T22:25:40.085037] [DEBUG] [LOCAL ] WNS: Primary data saved (39883 records). [2025-10-07T22:25:40.085404] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-07T22:25:40.098109] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNS took 31.8s. Estimated remaining: 8m 27s. Rate: 7.1 symbols/min [2025-10-07T22:25:40.273979] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:25:40.290724] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-07T22:25:40.321436] [DEBUG] [LOCAL ] WOW: Loaded 30471 existing records from primary storage. [2025-10-07T22:25:40.321785] [INFO ] [MAIN ] WOW: Loaded 30471 existing records. [2025-10-07T22:25:40.495161] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:25:40.495431] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-07T22:25:40.495480] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-07T22:25:40.495730] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-07T22:25:40.495789] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-07T22:25:40.651152] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-07T22:25:40.847805] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:25:41.447675] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-07T22:25:42.247630] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-07T22:25:42.563320] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-07T22:25:42.602956] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-07T22:25:42.782247] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-07T22:25:43.047683] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-07T22:25:43.694859] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-07T22:25:43.847677] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-07T22:25:44.385171] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-07T22:25:44.388899] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-07T22:25:44.389011] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-07T22:25:44.655396] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-07T22:25:44.781460] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-07T22:25:44.781664] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-07T22:25:44.782833] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-07T22:25:44.782925] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-07T22:25:44.784615] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-10-07T22:25:45.037055] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-07T22:25:45.173178] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-07T22:25:45.173340] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-07T22:25:45.173432] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WMT took 49.5s. Estimated remaining: 8m 19s. Rate: 7.1 symbols/min [2025-10-07T22:25:45.344484] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:25:45.387134] [DEBUG] [LOCAL ] WPC: Loaded 48342 existing records from primary storage. [2025-10-07T22:25:45.387454] [INFO ] [MAIN ] WPC: Loaded 48342 existing records. [2025-10-07T22:25:45.452868] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-07T22:25:45.565131] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:25:45.565313] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-07T22:25:45.565361] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-07T22:25:45.565584] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-07T22:25:45.565681] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-07T22:25:45.931123] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:25:46.058378] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-07T22:25:46.247676] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-07T22:25:47.047627] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-07T22:25:47.370414] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-07T22:25:47.847619] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-07T22:25:47.894132] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-07T22:25:48.647626] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-07T22:25:48.741329] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T22:25:48.803383] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-07T22:25:49.447639] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-07T22:25:49.766442] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T22:25:50.247702] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-07T22:25:51.047737] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-07T22:25:51.168732] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T22:25:51.847637] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-07T22:25:52.250858] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-07T22:25:52.267454] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-07T22:25:52.271286] [INFO ] [REMOTE ] WOLF: Full fetch complete (77240 records). [2025-10-07T22:25:52.271410] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-07T22:25:52.655078] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-07T22:25:52.654299] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-07T22:25:52.655215] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-07T22:25:52.657556] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-07T22:25:52.657822] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-07T22:25:52.659753] [DEBUG] [LOCAL ] WOLF: Trimmed 77240 records to 53173 (keeping 200 days of data) [2025-10-07T22:25:52.986798] [DEBUG] [LOCAL ] WOLF: Primary data saved (53173 records). [2025-10-07T22:25:52.986961] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-07T22:25:52.987074] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOLF took 39.3s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-07T22:25:53.166932] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:25:53.216379] [DEBUG] [LOCAL ] WPM: Loaded 52735 existing records from primary storage. [2025-10-07T22:25:53.216800] [INFO ] [MAIN ] WPM: Loaded 52735 existing records. [2025-10-07T22:25:53.404527] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:25:53.404883] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-07T22:25:53.404990] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-07T22:25:53.405348] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-07T22:25:53.405420] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-07T22:25:53.464217] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-07T22:25:53.557735] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T22:25:53.825103] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:25:53.950216] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-07T22:25:54.247696] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-07T22:25:54.894521] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-07T22:25:55.047611] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-07T22:25:55.497989] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T22:25:55.847623] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-07T22:25:56.064519] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-07T22:25:56.647696] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-07T22:25:57.444275] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-07T22:25:57.454343] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-07T22:25:57.733305] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T22:25:58.247626] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-07T22:25:58.346134] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-07T22:25:59.047689] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-07T22:25:59.847630] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-07T22:26:00.022263] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-07T22:26:00.147927] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T22:26:00.647624] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-07T22:26:00.829804] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-07T22:26:00.831790] [INFO ] [REMOTE ] WOR: Full fetch complete (36620 records). [2025-10-07T22:26:00.831865] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-07T22:26:01.210058] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-07T22:26:01.210141] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-07T22:26:01.210921] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-07T22:26:01.210985] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-07T22:26:01.211843] [DEBUG] [LOCAL ] WOR: Trimmed 36620 records to 24817 (keeping 200 days of data) [2025-10-07T22:26:01.368285] [DEBUG] [LOCAL ] WOR: Primary data saved (24817 records). [2025-10-07T22:26:01.368454] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-07T22:26:01.368618] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOR took 27.8s. Estimated remaining: 8m 2s. Rate: 7.1 symbols/min [2025-10-07T22:26:01.457092] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-07T22:26:01.559349] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:26:01.592226] [DEBUG] [LOCAL ] WPP: Loaded 33995 existing records from primary storage. [2025-10-07T22:26:01.592554] [INFO ] [MAIN ] WPP: Loaded 33995 existing records. [2025-10-07T22:26:01.769678] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:26:01.769930] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-07T22:26:01.769980] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-07T22:26:01.770196] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-07T22:26:01.770253] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-07T22:26:02.131918] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:26:02.247615] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-07T22:26:02.410772] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T22:26:03.047610] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-07T22:26:03.100073] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-07T22:26:03.275800] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-07T22:26:03.847692] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-07T22:26:04.097426] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T22:26:04.647679] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-07T22:26:05.316355] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-07T22:26:05.447681] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-07T22:26:06.247696] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-07T22:26:06.350719] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-07T22:26:07.047677] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-07T22:26:07.468306] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-07T22:26:07.847624] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-07T22:26:08.089525] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T22:26:08.486119] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-07T22:26:08.647611] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-07T22:26:09.418221] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T22:26:09.447594] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-07T22:26:09.650007] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T22:26:10.247721] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-07T22:26:10.891320] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-07T22:26:11.047759] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-07T22:26:11.477723] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-07T22:26:11.847693] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-07T22:26:12.647682] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-07T22:26:12.982464] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-07T22:26:13.272892] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-07T22:26:13.447714] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-07T22:26:14.247739] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-07T22:26:14.529823] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-07T22:26:15.052805] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-07T22:26:15.071315] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-07T22:26:15.698382] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-07T22:26:15.847725] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-07T22:26:16.647635] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-07T22:26:16.798495] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-07T22:26:17.079090] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T22:26:17.082126] [INFO ] [REMOTE ] WOW: Full fetch complete (42505 records). [2025-10-07T22:26:17.082229] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-07T22:26:17.455497] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-07T22:26:17.512503] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-07T22:26:17.512618] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-07T22:26:17.514504] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-07T22:26:17.514579] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-07T22:26:17.515908] [DEBUG] [LOCAL ] WOW: Trimmed 42505 records to 30449 (keeping 200 days of data) [2025-10-07T22:26:17.695971] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T22:26:17.740427] [DEBUG] [LOCAL ] WOW: Primary data saved (30449 records). [2025-10-07T22:26:17.740713] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-07T22:26:17.740845] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WOW took 37.6s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-07T22:26:17.923581] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:26:17.979361] [DEBUG] [LOCAL ] WRB: Loaded 50616 existing records from primary storage. [2025-10-07T22:26:17.979893] [INFO ] [MAIN ] WRB: Loaded 50616 existing records. [2025-10-07T22:26:18.166982] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:26:18.167198] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-07T22:26:18.167248] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-07T22:26:18.167529] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-07T22:26:18.167586] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-07T22:26:18.253602] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-07T22:26:18.527520] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:26:19.047620] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-07T22:26:19.167519] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T22:26:19.847622] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-07T22:26:20.158813] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-07T22:26:20.647777] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-07T22:26:20.728707] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-07T22:26:21.200636] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-07T22:26:21.204092] [INFO ] [REMOTE ] WPC: Full fetch complete (70704 records). [2025-10-07T22:26:21.204201] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-07T22:26:21.455183] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-07T22:26:21.596029] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-07T22:26:21.596119] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-07T22:26:21.597126] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-07T22:26:21.597202] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-07T22:26:21.598601] [DEBUG] [LOCAL ] WPC: Trimmed 70704 records to 48338 (keeping 200 days of data) [2025-10-07T22:26:21.895391] [DEBUG] [LOCAL ] WPC: Primary data saved (48338 records). [2025-10-07T22:26:21.895530] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-07T22:26:21.895612] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPC took 36.7s. Estimated remaining: 7m 45s. Rate: 7.1 symbols/min [2025-10-07T22:26:22.060306] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:26:22.107035] [DEBUG] [LOCAL ] WRBY: Loaded 50718 existing records from primary storage. [2025-10-07T22:26:22.107352] [INFO ] [MAIN ] WRBY: Loaded 50718 existing records. [2025-10-07T22:26:22.258553] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-07T22:26:22.286193] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:26:22.287733] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-07T22:26:22.287865] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-07T22:26:22.288133] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-07T22:26:22.288191] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-07T22:26:22.657749] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:26:22.675462] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-07T22:26:23.047720] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-07T22:26:23.103899] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T22:26:23.686895] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-07T22:26:23.847721] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-07T22:26:24.647720] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-07T22:26:24.770343] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T22:26:25.431398] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-07T22:26:25.447601] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-07T22:26:26.247630] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-07T22:26:26.345220] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T22:26:26.961947] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-07T22:26:27.047669] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-07T22:26:27.731622] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-07T22:26:27.847687] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-07T22:26:28.392156] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T22:26:28.647726] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-07T22:26:28.945478] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T22:26:29.447712] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-07T22:26:30.247625] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-07T22:26:30.282980] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T22:26:31.047622] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-07T22:26:31.195593] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-07T22:26:31.199245] [INFO ] [REMOTE ] WPM: Full fetch complete (75950 records). [2025-10-07T22:26:31.199361] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-07T22:26:31.583929] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-07T22:26:31.584036] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-07T22:26:31.585314] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-07T22:26:31.585534] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-07T22:26:31.587307] [DEBUG] [LOCAL ] WPM: Trimmed 75950 records to 52727 (keeping 200 days of data) [2025-10-07T22:26:31.715800] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-07T22:26:31.848412] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-07T22:26:31.963797] [DEBUG] [LOCAL ] WPM: Primary data saved (52727 records). [2025-10-07T22:26:31.963933] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-07T22:26:31.964029] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPM took 39.0s. Estimated remaining: 7m 37s. Rate: 7.1 symbols/min [2025-10-07T22:26:32.262430] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-07T22:26:32.265534] [INFO ] [REMOTE ] WPP: Full fetch complete (45964 records). [2025-10-07T22:26:32.265624] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-07T22:26:32.653105] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-07T22:26:32.746501] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-07T22:26:32.746633] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-07T22:26:32.747799] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-07T22:26:32.747865] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-07T22:26:32.748939] [DEBUG] [LOCAL ] WPP: Trimmed 45964 records to 34096 (keeping 200 days of data) [2025-10-07T22:26:32.956690] [DEBUG] [LOCAL ] WPP: Primary data saved (34096 records). [2025-10-07T22:26:32.956847] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-07T22:26:32.956934] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPP took 31.6s. Estimated remaining: 7m 28s. Rate: 7.1 symbols/min [2025-10-07T22:26:33.674719] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T22:26:33.687469] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-07T22:26:34.411800] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T22:26:34.424748] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-07T22:26:35.394445] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T22:26:35.405486] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-07T22:26:36.145781] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T22:26:36.160073] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-07T22:26:37.139352] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T22:26:37.150984] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-07T22:26:37.485836] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T22:26:37.497591] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-07T22:26:38.923069] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-07T22:26:38.935111] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-07T22:26:39.171873] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T22:26:39.183744] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-07T22:26:40.585841] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T22:26:40.599867] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-07T22:26:40.985548] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T22:26:40.998865] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-07T22:26:41.885841] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-07T22:26:41.897584] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-07T22:26:42.372791] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-07T22:26:42.376537] [INFO ] [REMOTE ] WRB: Full fetch complete (73390 records). [2025-10-07T22:26:42.376735] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-07T22:26:42.783280] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-07T22:26:42.783439] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-07T22:26:42.784580] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-07T22:26:42.784687] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-07T22:26:42.813526] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-07T22:26:42.824143] [DEBUG] [LOCAL ] WRB: Trimmed 73390 records to 50663 (keeping 200 days of data) [2025-10-07T22:26:42.826024] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-07T22:26:43.142605] [DEBUG] [LOCAL ] WRB: Primary data saved (50663 records). [2025-10-07T22:26:43.142791] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-07T22:26:43.142883] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 25.4s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-07T22:26:44.566959] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-07T22:26:44.578285] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-07T22:26:45.976852] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-07T22:26:45.980803] [INFO ] [REMOTE ] WRBY: Full fetch complete (73548 records). [2025-10-07T22:26:45.980989] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-07T22:26:46.393197] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-07T22:26:46.393291] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-07T22:26:46.394423] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-07T22:26:46.394493] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-07T22:26:46.396109] [DEBUG] [LOCAL ] WRBY: Trimmed 73548 records to 50721 (keeping 200 days of data) [2025-10-07T22:26:46.702872] [DEBUG] [LOCAL ] WRBY: Primary data saved (50721 records). [2025-10-07T22:26:46.703309] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-07T22:26:46.703433] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 24.8s. Estimated remaining: 7m 11s. Rate: 7.1 symbols/min [2025-10-07T22:26:47.275824] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:26:47.387706] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:26:47.393075] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:26:47.417265] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:26:47.453975] [DEBUG] [LOCAL ] WSR: Loaded 22909 existing records from primary storage. [2025-10-07T22:26:47.454426] [DEBUG] [LOCAL ] WS: Loaded 23846 existing records from primary storage. [2025-10-07T22:26:47.455336] [INFO ] [MAIN ] WSR: Loaded 22909 existing records. [2025-10-07T22:26:47.455523] [INFO ] [MAIN ] WS: Loaded 23846 existing records. [2025-10-07T22:26:47.684616] [DEBUG] [LOCAL ] WSO: Loaded 24867 existing records from primary storage. [2025-10-07T22:26:47.699837] [INFO ] [MAIN ] WSO: Loaded 24867 existing records. [2025-10-07T22:26:47.861913] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:26:47.933981] [DEBUG] [LOCAL ] WSM: Loaded 49433 existing records from primary storage. [2025-10-07T22:26:47.972068] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-07T22:26:47.972202] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-07T22:26:47.972445] [INFO ] [MAIN ] WSM: Loaded 49433 existing records. [2025-10-07T22:26:47.981826] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-07T22:26:47.985518] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-07T22:26:47.985398] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:26:48.105333] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-07T22:26:48.145030] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-07T22:26:48.201361] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-07T22:26:48.260336] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:26:48.269905] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-07T22:26:48.302623] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-07T22:26:48.313927] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-07T22:26:48.407233] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-07T22:26:48.450110] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-07T22:26:48.610906] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:26:48.681749] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-07T22:26:48.775267] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-07T22:26:48.840266] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-07T22:26:48.912258] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-07T22:26:49.360572] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:26:49.473980] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-07T22:26:49.666523] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:26:49.662995] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:26:49.680422] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-07T22:26:49.680208] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-07T22:26:49.779197] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:26:49.779467] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-07T22:26:50.774226] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T22:26:50.779310] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-07T22:26:50.873281] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T22:26:50.877374] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-07T22:26:50.906136] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T22:26:50.912630] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-07T22:26:51.761368] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-07T22:26:51.772059] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-07T22:26:51.879254] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-07T22:26:51.884384] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-07T22:26:51.965406] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-07T22:26:51.969776] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-07T22:26:52.187719] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-07T22:26:52.193478] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-07T22:26:52.944849] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-07T22:26:52.949872] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-07T22:26:52.963817] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T22:26:53.139665] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T22:26:53.311728] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-07T22:26:53.447691] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-07T22:26:53.717143] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-07T22:26:54.247750] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-07T22:26:54.782758] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-07T22:26:55.047692] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-07T22:26:55.496993] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-07T22:26:55.847678] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-07T22:26:56.216173] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-07T22:26:56.647707] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-07T22:26:56.894378] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T22:26:57.447618] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-07T22:26:57.701628] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-07T22:26:58.247676] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-07T22:26:59.047637] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-07T22:26:59.128047] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-07T22:26:59.333593] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T22:26:59.847622] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-07T22:27:00.251232] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-07T22:27:00.647715] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-07T22:27:01.447674] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-07T22:27:01.807593] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T22:27:01.855034] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-07T22:27:02.247610] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-07T22:27:02.330445] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-07T22:27:03.047711] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-07T22:27:03.847624] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-07T22:27:04.128716] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-07T22:27:04.208241] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-07T22:27:04.647679] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-07T22:27:04.896193] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-07T22:27:05.447629] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-07T22:27:05.674377] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T22:27:06.247675] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-07T22:27:06.524015] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-07T22:27:07.047594] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-07T22:27:07.510419] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T22:27:07.847675] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-07T22:27:08.647701] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-07T22:27:08.885003] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-07T22:27:08.990816] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-07T22:27:09.447625] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-07T22:27:09.744812] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-07T22:27:10.247691] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-07T22:27:10.599467] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-07T22:27:11.047679] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-07T22:27:11.847708] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-07T22:27:11.929393] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-07T22:27:11.931329] [INFO ] [REMOTE ] WSR: Full fetch complete (32870 records). [2025-10-07T22:27:11.931425] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-07T22:27:12.277589] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-07T22:27:12.367323] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-07T22:27:12.367410] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-07T22:27:12.368255] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-07T22:27:12.368322] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-07T22:27:12.369174] [DEBUG] [LOCAL ] WSR: Trimmed 32870 records to 22960 (keeping 200 days of data) [2025-10-07T22:27:12.525031] [DEBUG] [LOCAL ] WSR: Primary data saved (22960 records). [2025-10-07T22:27:12.525277] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-07T22:27:12.525682] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSR took 25.8s. Estimated remaining: 7m 3s. Rate: 7.1 symbols/min [2025-10-07T22:27:12.652901] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-07T22:27:12.743869] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:27:12.784057] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-07T22:27:12.787364] [INFO ] [REMOTE ] WS: Full fetch complete (36723 records). [2025-10-07T22:27:12.787562] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-07T22:27:12.934239] [DEBUG] [LOCAL ] WST: Loaded 37060 existing records from primary storage. [2025-10-07T22:27:12.934816] [INFO ] [MAIN ] WST: Loaded 37060 existing records. [2025-10-07T22:27:13.480287] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-07T22:27:13.472258] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:27:13.487761] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-07T22:27:13.498801] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-07T22:27:13.511876] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-07T22:27:13.512398] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-07T22:27:13.723431] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-07T22:27:13.723885] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-07T22:27:13.730065] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-07T22:27:13.740466] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-07T22:27:13.838779] [DEBUG] [LOCAL ] WS: Trimmed 36723 records to 23733 (keeping 200 days of data) [2025-10-07T22:27:14.086485] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:27:14.110633] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T22:27:14.170184] [DEBUG] [LOCAL ] WS: Primary data saved (23733 records). [2025-10-07T22:27:14.170325] [INFO ] [MAIN ] WS: Full history saved. [2025-10-07T22:27:14.170422] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WS took 27.5s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-07T22:27:14.252764] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-07T22:27:14.341969] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:27:14.385119] [DEBUG] [LOCAL ] WT: Loaded 47859 existing records from primary storage. [2025-10-07T22:27:14.385471] [INFO ] [MAIN ] WT: Loaded 47859 existing records. [2025-10-07T22:27:14.565839] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:27:14.566065] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-07T22:27:14.566113] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-07T22:27:14.566352] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-07T22:27:14.566408] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-07T22:27:14.922247] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:27:15.047620] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-07T22:27:15.326708] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-07T22:27:15.484063] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-07T22:27:15.847713] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-07T22:27:16.647708] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-07T22:27:16.706332] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-07T22:27:17.447629] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-07T22:27:17.582151] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-07T22:27:18.071894] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T22:27:18.247791] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-07T22:27:18.810962] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-07T22:27:19.047684] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-07T22:27:19.847614] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-07T22:27:19.850487] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T22:27:20.156488] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T22:27:20.158837] [INFO ] [REMOTE ] WSO: Full fetch complete (34758 records). [2025-10-07T22:27:20.158932] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-07T22:27:20.541030] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-07T22:27:20.541138] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-07T22:27:20.541951] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-07T22:27:20.542020] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-07T22:27:20.543155] [DEBUG] [LOCAL ] WSO: Trimmed 34758 records to 24962 (keeping 200 days of data) [2025-10-07T22:27:20.655852] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-07T22:27:20.709385] [DEBUG] [LOCAL ] WSO: Primary data saved (24962 records). [2025-10-07T22:27:20.709542] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-07T22:27:20.709677] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSO took 34.0s. Estimated remaining: 6m 46s. Rate: 7.1 symbols/min [2025-10-07T22:27:20.878443] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:27:20.922782] [DEBUG] [LOCAL ] WTI: Loaded 43945 existing records from primary storage. [2025-10-07T22:27:20.923130] [INFO ] [MAIN ] WTI: Loaded 43945 existing records. [2025-10-07T22:27:21.110752] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:27:21.111054] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-07T22:27:21.111117] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-07T22:27:21.111362] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-07T22:27:21.111421] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-07T22:27:21.220832] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-07T22:27:21.265747] [INFO ] [REMOTE ] WSM: Full fetch complete (71769 records). [2025-10-07T22:27:21.296185] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-07T22:27:21.451871] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-07T22:27:21.758386] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:27:21.892972] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-07T22:27:22.033500] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-07T22:27:22.033583] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-07T22:27:22.034699] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-07T22:27:22.034765] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-07T22:27:22.036157] [DEBUG] [LOCAL ] WSM: Trimmed 71769 records to 49404 (keeping 200 days of data) [2025-10-07T22:27:22.258048] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-07T22:27:22.360923] [DEBUG] [LOCAL ] WSM: Primary data saved (49404 records). [2025-10-07T22:27:22.361079] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-07T22:27:22.361182] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 35.6s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-07T22:27:22.539710] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:27:22.539912] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-07T22:27:22.539950] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-07T22:27:22.540089] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-07T22:27:22.540165] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-07T22:27:22.540227] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-07T22:27:22.540261] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-07T22:27:22.904384] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:27:23.024576] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-07T22:27:23.047605] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-07T22:27:23.760122] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-07T22:27:23.847625] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-07T22:27:24.647695] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-07T22:27:24.689329] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-07T22:27:25.393628] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T22:27:25.447631] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-07T22:27:25.862591] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-07T22:27:26.247699] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-07T22:27:26.329984] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T22:27:27.047711] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-07T22:27:27.814019] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-07T22:27:27.847610] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-07T22:27:28.597969] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T22:27:28.647619] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-07T22:27:29.161551] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-07T22:27:29.447673] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-07T22:27:29.572097] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T22:27:29.857609] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-07T22:27:30.247724] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-07T22:27:31.047738] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-07T22:27:31.768506] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-07T22:27:31.847617] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-07T22:27:32.647719] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-07T22:27:32.700040] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-07T22:27:33.142014] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-07T22:27:33.447732] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-07T22:27:33.579920] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-07T22:27:34.247675] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-07T22:27:35.030114] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-07T22:27:35.047597] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-07T22:27:35.832081] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T22:27:35.847601] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-07T22:27:36.649097] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-07T22:27:36.655349] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T22:27:37.187092] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-07T22:27:37.447620] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-07T22:27:37.785668] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-07T22:27:38.247696] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-07T22:27:38.724487] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-07T22:27:39.047786] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-07T22:27:39.243124] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-07T22:27:39.847685] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-07T22:27:40.579930] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T22:27:40.647620] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-07T22:27:41.447673] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-07T22:27:41.661573] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-07T22:27:41.791205] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-07T22:27:41.792815] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-07T22:27:42.247680] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-07T22:27:43.047675] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-07T22:27:43.847623] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-07T22:27:43.965512] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-07T22:27:44.187111] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-07T22:27:44.647675] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-07T22:27:45.342923] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-07T22:27:45.447692] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-07T22:27:45.962458] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-07T22:27:46.095597] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-07T22:27:46.247620] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-07T22:27:47.047678] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-07T22:27:47.580084] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-07T22:27:47.847632] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-07T22:27:47.908829] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T22:27:48.090399] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-07T22:27:48.647683] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-07T22:27:49.098555] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-07T22:27:49.101235] [INFO ] [REMOTE ] WST: Full fetch complete (53909 records). [2025-10-07T22:27:49.101347] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-07T22:27:49.452740] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-07T22:27:49.517393] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-07T22:27:49.517475] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-07T22:27:49.518423] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-07T22:27:49.518487] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-07T22:27:49.519588] [DEBUG] [LOCAL ] WST: Trimmed 53909 records to 36985 (keeping 200 days of data) [2025-10-07T22:27:49.756184] [DEBUG] [LOCAL ] WST: Primary data saved (36985 records). [2025-10-07T22:27:49.756344] [INFO ] [MAIN ] WST: Full history saved. [2025-10-07T22:27:49.756484] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 37.2s. Estimated remaining: 6m 29s. Rate: 7.1 symbols/min [2025-10-07T22:27:49.921355] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:27:49.968042] [DEBUG] [LOCAL ] WTRG: Loaded 50948 existing records from primary storage. [2025-10-07T22:27:49.968386] [INFO ] [MAIN ] WTRG: Loaded 50948 existing records. [2025-10-07T22:27:50.141916] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:27:50.142148] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-07T22:27:50.142200] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-07T22:27:50.142438] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-07T22:27:50.142495] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-07T22:27:50.252744] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-07T22:27:50.506268] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:27:50.908873] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-07T22:27:51.047670] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-07T22:27:51.157843] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T22:27:51.847672] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-07T22:27:52.647679] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-07T22:27:52.738488] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-07T22:27:53.162774] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-07T22:27:53.332045] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-07T22:27:53.333072] [INFO ] [REMOTE ] WTM: Full fetch complete (2570 records). [2025-10-07T22:27:53.333141] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-07T22:27:53.452777] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-07T22:27:53.517422] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-07T22:27:53.517610] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-07T22:27:53.517705] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-07T22:27:53.517782] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-07T22:27:53.517847] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-07T22:27:53.517885] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-07T22:27:53.517943] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-07T22:27:53.518027] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WTM took 31.2s. Estimated remaining: 6m 21s. Rate: 7.1 symbols/min [2025-10-07T22:27:53.681262] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:27:53.700849] [DEBUG] [LOCAL ] WTS: Loaded 17987 existing records from primary storage. [2025-10-07T22:27:53.701095] [INFO ] [MAIN ] WTS: Loaded 17987 existing records. [2025-10-07T22:27:53.872242] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:27:53.872413] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-07T22:27:53.872459] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-07T22:27:53.872730] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-07T22:27:53.872788] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-07T22:27:54.218530] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:27:54.247601] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-07T22:27:54.694515] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T22:27:54.698312] [INFO ] [REMOTE ] WT: Full fetch complete (69315 records). [2025-10-07T22:27:54.698421] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-07T22:27:55.053227] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-07T22:27:55.104453] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-07T22:27:55.104681] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-07T22:27:55.105806] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-07T22:27:55.105890] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-07T22:27:55.107464] [DEBUG] [LOCAL ] WT: Trimmed 69315 records to 47866 (keeping 200 days of data) [2025-10-07T22:27:55.341878] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-07T22:27:55.427726] [DEBUG] [LOCAL ] WT: Primary data saved (47866 records). [2025-10-07T22:27:55.427866] [INFO ] [MAIN ] WT: Full history saved. [2025-10-07T22:27:55.427949] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WT took 41.3s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-07T22:27:55.601798] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:27:55.645958] [DEBUG] [LOCAL ] WTTR: Loaded 44812 existing records from primary storage. [2025-10-07T22:27:55.646292] [INFO ] [MAIN ] WTTR: Loaded 44812 existing records. [2025-10-07T22:27:55.821637] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:27:55.821868] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-07T22:27:55.821918] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-07T22:27:55.822372] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-07T22:27:55.822430] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-07T22:27:55.852806] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-07T22:27:56.177475] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:27:56.647617] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-07T22:27:56.686440] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T22:27:56.927842] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-07T22:27:56.931446] [INFO ] [REMOTE ] WTI: Full fetch complete (64021 records). [2025-10-07T22:27:56.931589] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-07T22:27:57.310509] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-07T22:27:57.310601] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-07T22:27:57.311683] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-07T22:27:57.311748] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-07T22:27:57.313128] [DEBUG] [LOCAL ] WTI: Trimmed 64021 records to 44045 (keeping 200 days of data) [2025-10-07T22:27:57.485997] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-07T22:27:57.584314] [DEBUG] [LOCAL ] WTI: Primary data saved (44045 records). [2025-10-07T22:27:57.584468] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-07T22:27:57.584587] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTI took 36.9s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-07T22:27:57.700560] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T22:27:57.776839] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:27:57.828612] [DEBUG] [LOCAL ] WU: Loaded 53462 existing records from primary storage. [2025-10-07T22:27:57.829028] [INFO ] [MAIN ] WU: Loaded 53462 existing records. [2025-10-07T22:27:58.005236] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:27:58.005463] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-07T22:27:58.005513] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-07T22:27:58.006501] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-07T22:27:58.006561] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-07T22:27:58.253203] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-07T22:27:58.373204] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:27:59.047668] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-07T22:27:59.116134] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T22:27:59.170131] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-07T22:27:59.847685] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-07T22:28:00.647629] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-07T22:28:00.755681] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T22:28:01.351003] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-07T22:28:01.447683] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-07T22:28:02.198522] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-07T22:28:02.247704] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-07T22:28:02.974556] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-07T22:28:03.047687] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-07T22:28:03.847693] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-07T22:28:04.092839] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-07T22:28:04.647710] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-07T22:28:04.791360] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T22:28:05.177162] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-07T22:28:05.451162] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-07T22:28:05.459147] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-07T22:28:06.247698] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-07T22:28:07.047710] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-07T22:28:07.303624] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-07T22:28:07.517176] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T22:28:07.847679] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-07T22:28:08.647640] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-07T22:28:08.687998] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-07T22:28:09.447637] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-07T22:28:09.749243] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-07T22:28:09.987451] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-07T22:28:10.218908] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-07T22:28:10.247634] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-07T22:28:11.047688] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-07T22:28:11.847707] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-07T22:28:12.052892] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T22:28:12.053756] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T22:28:12.647758] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-07T22:28:13.447750] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-07T22:28:13.526240] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T22:28:14.059704] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-07T22:28:14.247717] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-07T22:28:15.047704] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-07T22:28:15.315740] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T22:28:15.435520] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-07T22:28:15.847703] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-07T22:28:16.162442] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-07T22:28:16.647709] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-07T22:28:17.416992] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-07T22:28:17.447613] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-07T22:28:17.770341] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-07T22:28:18.247762] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-07T22:28:18.941900] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-07T22:28:19.047620] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-07T22:28:19.847698] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-07T22:28:20.039763] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T22:28:20.647729] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-07T22:28:20.782397] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T22:28:20.822925] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-07T22:28:21.447741] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-07T22:28:21.732734] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-07T22:28:22.247686] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-07T22:28:22.895130] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-07T22:28:22.896912] [INFO ] [REMOTE ] WTS: Full fetch complete (25984 records). [2025-10-07T22:28:22.897034] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-07T22:28:23.052833] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-07T22:28:23.305830] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-07T22:28:23.305938] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-07T22:28:23.306526] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-07T22:28:23.306725] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-07T22:28:23.307573] [DEBUG] [LOCAL ] WTS: Trimmed 25984 records to 17856 (keeping 200 days of data) [2025-10-07T22:28:23.452005] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-07T22:28:23.481130] [DEBUG] [LOCAL ] WTS: Primary data saved (17856 records). [2025-10-07T22:28:23.481293] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-07T22:28:23.481404] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTS took 30.0s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-07T22:28:23.645814] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:28:23.692258] [DEBUG] [LOCAL ] WWW: Loaded 49236 existing records from primary storage. [2025-10-07T22:28:23.692589] [INFO ] [MAIN ] WWW: Loaded 49236 existing records. [2025-10-07T22:28:23.852854] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-07T22:28:23.877009] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:28:23.877243] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-07T22:28:23.877293] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-07T22:28:23.878184] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-07T22:28:23.878245] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-07T22:28:24.243006] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:28:24.583695] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-07T22:28:24.587381] [INFO ] [REMOTE ] WTRG: Full fetch complete (73520 records). [2025-10-07T22:28:24.587497] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-07T22:28:24.658020] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-07T22:28:24.991934] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-07T22:28:24.992022] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-07T22:28:24.993126] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-07T22:28:24.993194] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-07T22:28:24.994725] [DEBUG] [LOCAL ] WTRG: Trimmed 73520 records to 50967 (keeping 200 days of data) [2025-10-07T22:28:25.313377] [DEBUG] [LOCAL ] WTRG: Primary data saved (50967 records). [2025-10-07T22:28:25.313549] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-07T22:28:25.313679] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTRG took 35.6s. Estimated remaining: 5m 47s. Rate: 7.1 symbols/min [2025-10-07T22:28:25.458569] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-07T22:28:25.491693] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:28:25.544190] [DEBUG] [LOCAL ] WY: Loaded 53136 existing records from primary storage. [2025-10-07T22:28:25.544518] [INFO ] [MAIN ] WY: Loaded 53136 existing records. [2025-10-07T22:28:25.725195] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:28:25.725731] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-07T22:28:25.725937] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-07T22:28:25.726409] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-07T22:28:25.726499] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-07T22:28:26.114438] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-07T22:28:26.172174] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:28:26.201331] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-07T22:28:26.247672] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-07T22:28:27.035439] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-07T22:28:27.047598] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-07T22:28:27.847682] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-07T22:28:27.898818] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T22:28:28.647682] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-07T22:28:28.692624] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T22:28:29.447678] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-07T22:28:29.710215] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-07T22:28:30.063728] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-07T22:28:30.247690] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-07T22:28:30.634791] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-07T22:28:31.047691] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-07T22:28:31.847684] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-07T22:28:32.011686] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T22:28:32.607139] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-07T22:28:32.647605] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-07T22:28:33.383288] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-07T22:28:33.447616] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-07T22:28:34.247621] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-07T22:28:34.428054] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-07T22:28:34.473260] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-07T22:28:34.476606] [INFO ] [REMOTE ] WTTR: Full fetch complete (65556 records). [2025-10-07T22:28:34.476755] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-07T22:28:34.882423] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-07T22:28:34.882519] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-07T22:28:34.883840] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-07T22:28:34.883956] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-07T22:28:34.885454] [DEBUG] [LOCAL ] WTTR: Trimmed 65556 records to 44737 (keeping 200 days of data) [2025-10-07T22:28:35.059101] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-07T22:28:35.164025] [DEBUG] [LOCAL ] WTTR: Primary data saved (44737 records). [2025-10-07T22:28:35.164188] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-07T22:28:35.164302] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTTR took 39.7s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-07T22:28:35.348434] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:28:35.377056] [DEBUG] [LOCAL ] XFLT: Loaded 29684 existing records from primary storage. [2025-10-07T22:28:35.377366] [INFO ] [MAIN ] XFLT: Loaded 29684 existing records. [2025-10-07T22:28:35.557748] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:28:35.558091] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-07T22:28:35.558144] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-07T22:28:35.558390] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-07T22:28:35.558449] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-07T22:28:35.852983] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-07T22:28:35.938932] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:28:36.052576] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-07T22:28:36.647735] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-07T22:28:36.758459] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-07T22:28:36.762581] [INFO ] [REMOTE ] WU: Full fetch complete (77357 records). [2025-10-07T22:28:36.762741] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-07T22:28:37.189909] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-07T22:28:37.190094] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-07T22:28:37.191281] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-07T22:28:37.191349] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-07T22:28:37.193088] [DEBUG] [LOCAL ] WU: Trimmed 77357 records to 53464 (keeping 200 days of data) [2025-10-07T22:28:37.480335] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-07T22:28:37.533541] [DEBUG] [LOCAL ] WU: Primary data saved (53464 records). [2025-10-07T22:28:37.533728] [INFO ] [MAIN ] WU: Full history saved. [2025-10-07T22:28:37.533828] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WU took 39.9s. Estimated remaining: 5m 30s. Rate: 7.1 symbols/min [2025-10-07T22:28:37.708637] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:28:37.738623] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-07T22:28:37.785838] [DEBUG] [LOCAL ] XHR: Loaded 43728 existing records from primary storage. [2025-10-07T22:28:37.786199] [INFO ] [MAIN ] XHR: Loaded 43728 existing records. [2025-10-07T22:28:37.956614] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:28:37.956849] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-07T22:28:37.956897] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-07T22:28:37.957158] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-07T22:28:37.957214] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-07T22:28:38.266980] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-07T22:28:38.308455] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:28:38.605271] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-07T22:28:38.654892] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-07T22:28:39.047673] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-07T22:28:39.847630] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-07T22:28:39.932760] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-07T22:28:40.647678] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-07T22:28:40.862227] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T22:28:40.928698] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-07T22:28:41.447685] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-07T22:28:42.075949] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T22:28:42.247679] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-07T22:28:42.932617] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T22:28:43.047671] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-07T22:28:43.616961] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-07T22:28:43.847671] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-07T22:28:44.373857] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T22:28:44.647670] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-07T22:28:45.331805] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-07T22:28:45.447602] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-07T22:28:46.247714] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-07T22:28:46.592193] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-07T22:28:47.047724] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-07T22:28:47.257278] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-07T22:28:47.847701] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-07T22:28:48.035814] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-07T22:28:48.419116] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-07T22:28:48.647700] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-07T22:28:49.447625] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-07T22:28:49.530743] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-07T22:28:50.247629] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-07T22:28:50.334423] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T22:28:50.579052] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-07T22:28:51.047638] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-07T22:28:51.491033] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-07T22:28:51.847683] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-07T22:28:52.299917] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T22:28:52.647684] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-07T22:28:53.213264] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-07T22:28:53.447697] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-07T22:28:54.247637] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-07T22:28:54.289448] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-07T22:28:55.047661] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-07T22:28:55.490264] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-07T22:28:55.847626] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-07T22:28:56.027033] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-07T22:28:56.241132] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-07T22:28:56.647730] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-07T22:28:57.182832] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-07T22:28:57.447702] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-07T22:28:58.013471] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-07T22:28:58.017049] [INFO ] [REMOTE ] WWW: Full fetch complete (70349 records). [2025-10-07T22:28:58.017160] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-07T22:28:58.252743] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-07T22:28:58.408207] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-07T22:28:58.408373] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-07T22:28:58.409483] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-07T22:28:58.409547] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-07T22:28:58.410956] [DEBUG] [LOCAL ] WWW: Trimmed 70349 records to 49242 (keeping 200 days of data) [2025-10-07T22:28:58.729067] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-07T22:28:58.755228] [DEBUG] [LOCAL ] WWW: Primary data saved (49242 records). [2025-10-07T22:28:58.755366] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-07T22:28:58.755456] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WWW took 35.3s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-07T22:28:58.919616] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:28:58.919809] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-07T22:28:58.919852] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-07T22:28:58.920018] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-07T22:28:58.920092] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-07T22:28:58.920178] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-07T22:28:58.920222] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-07T22:28:59.058082] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-07T22:28:59.269070] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:28:59.847601] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-07T22:28:59.898034] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-07T22:29:00.059113] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T22:29:00.059426] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-07T22:29:00.059531] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T22:29:00.059602] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-07T22:29:00.059687] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T22:29:00.059766] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-07T22:29:00.059836] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-07T22:29:00.059872] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-07T22:29:00.059928] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-07T22:29:00.059998] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XIFR took 1.3s. Estimated remaining: 5m 13s. Rate: 7.1 symbols/min [2025-10-07T22:29:00.224398] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:29:00.275854] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-07T22:29:00.276250] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-07T22:29:00.455708] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:29:00.456075] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-07T22:29:00.456134] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-07T22:29:00.456501] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-07T22:29:00.456559] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-07T22:29:00.648685] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-07T22:29:00.825473] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:29:00.850024] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-07T22:29:01.447630] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-07T22:29:01.832224] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-07T22:29:02.247756] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-07T22:29:03.047719] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-07T22:29:03.861397] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-07T22:29:03.864250] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T22:29:03.912603] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T22:29:04.647629] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-07T22:29:04.884182] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (3.44 seconds). [2025-10-07T22:29:04.950114] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-07T22:29:04.953727] [INFO ] [REMOTE ] WY: Full fetch complete (76846 records). [2025-10-07T22:29:04.953835] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-07T22:29:05.061310] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T22:29:05.075005] [INFO ] [REMOTE ] XFLT: Full fetch complete (44202 records). [2025-10-07T22:29:05.085394] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-07T22:29:05.454582] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-07T22:29:05.685939] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-07T22:29:05.697424] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-07T22:29:05.704698] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-07T22:29:05.715171] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-07T22:29:05.791599] [DEBUG] [LOCAL ] WY: Trimmed 76846 records to 53141 (keeping 200 days of data) [2025-10-07T22:29:05.803636] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-07T22:29:05.803790] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-07T22:29:05.804868] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-07T22:29:05.804975] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-07T22:29:05.870122] [DEBUG] [LOCAL ] XFLT: Trimmed 44202 records to 29908 (keeping 200 days of data) [2025-10-07T22:29:06.237259] [DEBUG] [LOCAL ] XFLT: Primary data saved (29908 records). [2025-10-07T22:29:06.237948] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-07T22:29:06.238596] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XFLT took 31.1s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-07T22:29:06.253771] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-07T22:29:06.494698] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:29:06.514147] [DEBUG] [LOCAL ] WY: Primary data saved (53141 records). [2025-10-07T22:29:06.514358] [INFO ] [MAIN ] WY: Full history saved. [2025-10-07T22:29:06.514507] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. WY took 41.2s. Estimated remaining: 4m 56s. Rate: 7.1 symbols/min [2025-10-07T22:29:06.637478] [DEBUG] [LOCAL ] XPER: Loaded 30037 existing records from primary storage. [2025-10-07T22:29:06.643451] [INFO ] [MAIN ] XPER: Loaded 30037 existing records. [2025-10-07T22:29:06.839906] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:29:06.903231] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:29:06.903512] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-07T22:29:06.903564] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-07T22:29:06.903949] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-07T22:29:06.904009] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-07T22:29:07.236156] [DEBUG] [LOCAL ] XPEV: Loaded 53634 existing records from primary storage. [2025-10-07T22:29:07.252104] [INFO ] [MAIN ] XPEV: Loaded 53634 existing records. [2025-10-07T22:29:07.414077] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:29:07.414398] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-07T22:29:07.504067] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:29:07.504265] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-07T22:29:07.504314] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-07T22:29:07.504738] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-07T22:29:07.504805] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-07T22:29:07.637799] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-07T22:29:07.662435] [INFO ] [REMOTE ] XHR: Full fetch complete (61829 records). [2025-10-07T22:29:07.674359] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-07T22:29:08.042807] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:29:08.109954] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-07T22:29:08.296011] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-07T22:29:08.296142] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-07T22:29:08.297332] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-07T22:29:08.297452] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-07T22:29:08.310863] [DEBUG] [LOCAL ] XHR: Trimmed 61829 records to 43731 (keeping 200 days of data) [2025-10-07T22:29:08.332279] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-07T22:29:08.624678] [DEBUG] [LOCAL ] XHR: Primary data saved (43731 records). [2025-10-07T22:29:08.624847] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-07T22:29:08.624978] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XHR took 31.1s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-07T22:29:08.655894] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-07T22:29:08.817780] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:29:08.844091] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-07T22:29:08.908834] [DEBUG] [LOCAL ] XPO: Loaded 47822 existing records from primary storage. [2025-10-07T22:29:08.909353] [INFO ] [MAIN ] XPO: Loaded 47822 existing records. [2025-10-07T22:29:09.096788] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:29:09.097111] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-07T22:29:09.097165] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-07T22:29:09.097614] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-07T22:29:09.097721] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-07T22:29:09.463018] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-07T22:29:09.467720] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:29:10.247620] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-07T22:29:10.361131] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-07T22:29:10.711213] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-07T22:29:10.973571] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-07T22:29:11.047680] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-07T22:29:11.847615] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-07T22:29:11.989536] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-07T22:29:12.315697] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-07T22:29:12.647703] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-07T22:29:13.447747] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-07T22:29:14.247688] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-07T22:29:14.300246] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-07T22:29:14.354504] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-07T22:29:14.388788] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-07T22:29:15.047673] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-07T22:29:15.847770] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-07T22:29:16.361212] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-07T22:29:16.469153] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-07T22:29:16.647696] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-07T22:29:17.447638] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-07T22:29:17.873173] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-07T22:29:18.247738] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-07T22:29:18.452927] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-07T22:29:18.621771] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-07T22:29:19.047628] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-07T22:29:19.847756] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-07T22:29:20.479530] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-07T22:29:20.647702] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-07T22:29:20.788303] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-07T22:29:21.447814] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-07T22:29:21.840792] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-07T22:29:22.247616] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-07T22:29:22.288436] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-07T22:29:23.047752] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-07T22:29:23.847618] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-07T22:29:23.894898] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-07T22:29:24.084784] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-07T22:29:24.647702] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-07T22:29:24.757090] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-07T22:29:25.004893] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-07T22:29:25.447737] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-07T22:29:26.078695] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-07T22:29:26.247673] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-07T22:29:27.047693] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-07T22:29:27.765590] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-07T22:29:27.832229] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-07T22:29:27.847590] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-07T22:29:28.478494] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-07T22:29:28.647670] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-07T22:29:29.207370] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-07T22:29:29.447677] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-07T22:29:30.018159] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-07T22:29:30.247712] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-07T22:29:31.047755] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-07T22:29:31.855775] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-07T22:29:31.876005] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-07T22:29:31.925235] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T22:29:32.647678] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-07T22:29:32.979737] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-07T22:29:32.982468] [INFO ] [REMOTE ] XPER: Full fetch complete (43303 records). [2025-10-07T22:29:32.982567] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-07T22:29:33.365486] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-07T22:29:33.365713] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-07T22:29:33.366625] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-07T22:29:33.366733] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-07T22:29:33.368593] [DEBUG] [LOCAL ] XPER: Trimmed 43303 records to 30096 (keeping 200 days of data) [2025-10-07T22:29:33.470339] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-07T22:29:33.489613] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-07T22:29:33.592869] [DEBUG] [LOCAL ] XPER: Primary data saved (30096 records). [2025-10-07T22:29:33.593016] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-07T22:29:33.593133] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPER took 27.4s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-07T22:29:33.760396] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:29:33.795006] [DEBUG] [LOCAL ] XPOF: Loaded 37750 existing records from primary storage. [2025-10-07T22:29:33.795347] [INFO ] [MAIN ] XPOF: Loaded 37750 existing records. [2025-10-07T22:29:33.971844] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:29:33.972099] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-07T22:29:33.972146] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-07T22:29:33.972347] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-07T22:29:33.972404] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-07T22:29:34.249468] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-07T22:29:34.333708] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:29:35.047613] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-07T22:29:35.117167] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-07T22:29:35.167084] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-07T22:29:35.847694] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-07T22:29:36.265931] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-07T22:29:36.406763] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-07T22:29:36.647709] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-07T22:29:37.447723] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-07T22:29:37.966891] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-07T22:29:37.994524] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-07T22:29:37.998795] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-07T22:29:37.998940] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-07T22:29:38.252854] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-07T22:29:38.344464] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-07T22:29:38.453800] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-07T22:29:38.453902] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-07T22:29:38.455123] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-07T22:29:38.455204] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-07T22:29:38.456865] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-10-07T22:29:38.822606] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-07T22:29:38.822799] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-07T22:29:38.822911] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XOM took 38.8s. Estimated remaining: 4m 31s. Rate: 7.1 symbols/min [2025-10-07T22:29:38.995090] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:29:39.038830] [DEBUG] [LOCAL ] XPRO: Loaded 45841 existing records from primary storage. [2025-10-07T22:29:39.039208] [INFO ] [MAIN ] XPRO: Loaded 45841 existing records. [2025-10-07T22:29:39.052812] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-07T22:29:39.218731] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:29:39.218946] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-07T22:29:39.219013] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-07T22:29:39.219254] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-07T22:29:39.219312] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-07T22:29:39.569552] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:29:39.688863] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-07T22:29:39.693008] [INFO ] [REMOTE ] XPO: Full fetch complete (69817 records). [2025-10-07T22:29:39.693179] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-07T22:29:39.852915] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-07T22:29:40.148682] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-07T22:29:40.148793] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-07T22:29:40.149917] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-07T22:29:40.149981] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-07T22:29:40.151410] [DEBUG] [LOCAL ] XPO: Trimmed 69817 records to 47792 (keeping 200 days of data) [2025-10-07T22:29:40.451727] [DEBUG] [LOCAL ] XPO: Primary data saved (47792 records). [2025-10-07T22:29:40.451877] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-07T22:29:40.451978] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPO took 31.8s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-07T22:29:40.619270] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:29:40.656056] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-07T22:29:40.658883] [DEBUG] [LOCAL ] XYF: Loaded 28488 existing records from primary storage. [2025-10-07T22:29:40.659118] [INFO ] [MAIN ] XYF: Loaded 28488 existing records. [2025-10-07T22:29:40.852132] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:29:40.852361] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-07T22:29:40.852409] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-07T22:29:40.852840] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-07T22:29:40.852901] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-07T22:29:41.223319] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:29:41.368796] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-07T22:29:41.439535] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-07T22:29:41.449477] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-07T22:29:41.947681] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T22:29:42.247750] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-07T22:29:43.047723] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-07T22:29:43.672143] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-07T22:29:43.847622] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-07T22:29:43.889197] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-07T22:29:43.924842] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-07T22:29:44.452519] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-07T22:29:44.647619] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-07T22:29:45.289730] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-07T22:29:45.447735] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-07T22:29:46.247669] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-07T22:29:46.867881] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-07T22:29:47.047684] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-07T22:29:47.837911] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-07T22:29:47.847796] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-07T22:29:48.374346] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-07T22:29:48.647692] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-07T22:29:49.252315] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-07T22:29:49.447622] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-07T22:29:50.126212] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-07T22:29:50.247684] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-07T22:29:50.684175] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-07T22:29:51.047625] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-07T22:29:51.493263] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-07T22:29:51.847709] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-07T22:29:52.426177] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-07T22:29:52.647618] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-07T22:29:53.447686] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-07T22:29:54.212763] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-07T22:29:54.247609] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-07T22:29:54.325885] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-07T22:29:54.947331] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-07T22:29:55.047613] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-07T22:29:55.757212] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-07T22:29:55.847706] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-07T22:29:56.182736] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-07T22:29:56.647687] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-07T22:29:57.447688] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-07T22:29:57.908322] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-07T22:29:58.114069] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-07T22:29:58.117832] [INFO ] [REMOTE ] XPEV: Full fetch complete (77678 records). [2025-10-07T22:29:58.117953] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-07T22:29:58.259459] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-07T22:29:58.563933] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-07T22:29:58.564204] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-07T22:29:58.565685] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-07T22:29:58.565794] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-07T22:29:58.567979] [DEBUG] [LOCAL ] XPEV: Trimmed 77678 records to 53634 (keeping 200 days of data) [2025-10-07T22:29:58.689737] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-07T22:29:58.934681] [DEBUG] [LOCAL ] XPEV: Primary data saved (53634 records). [2025-10-07T22:29:58.934834] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-07T22:29:58.934934] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPEV took 52.4s. Estimated remaining: 4m 14s. Rate: 7.1 symbols/min [2025-10-07T22:29:59.052800] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-07T22:29:59.114460] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:29:59.164891] [DEBUG] [LOCAL ] XYL: Loaded 47926 existing records from primary storage. [2025-10-07T22:29:59.165216] [INFO ] [MAIN ] XYL: Loaded 47926 existing records. [2025-10-07T22:29:59.348398] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:29:59.348702] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-07T22:29:59.348762] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-07T22:29:59.349177] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-07T22:29:59.349234] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-07T22:29:59.725137] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:29:59.847606] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-07T22:30:00.035487] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-07T22:30:00.445196] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-07T22:30:00.647740] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-07T22:30:01.447634] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-07T22:30:01.564509] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-07T22:30:02.247669] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-07T22:30:02.287719] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T22:30:02.892692] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T22:30:03.047631] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-07T22:30:03.700218] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-07T22:30:03.847708] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-07T22:30:03.896047] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-07T22:30:03.898592] [INFO ] [REMOTE ] XPOF: Full fetch complete (52454 records). [2025-10-07T22:30:03.898706] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-07T22:30:04.271732] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-07T22:30:04.271820] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-07T22:30:04.272760] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-07T22:30:04.272824] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-07T22:30:04.273992] [DEBUG] [LOCAL ] XPOF: Trimmed 52454 records to 37710 (keeping 200 days of data) [2025-10-07T22:30:04.498783] [DEBUG] [LOCAL ] XPOF: Primary data saved (37710 records). [2025-10-07T22:30:04.498927] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-07T22:30:04.499010] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPOF took 30.9s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-07T22:30:04.648139] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-07T22:30:04.671410] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:30:04.671619] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-07T22:30:04.671699] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-07T22:30:04.671836] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-07T22:30:04.671880] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-07T22:30:04.671924] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-07T22:30:04.671956] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-07T22:30:05.046164] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:30:05.447700] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-07T22:30:05.548838] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-07T22:30:06.252881] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-07T22:30:06.267593] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-07T22:30:07.047843] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-07T22:30:07.048014] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-07T22:30:07.847695] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-07T22:30:08.062176] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-07T22:30:08.076724] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-07T22:30:08.078619] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-07T22:30:08.077228] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-07T22:30:08.078825] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-07T22:30:08.091460] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-07T22:30:08.091707] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-07T22:30:08.092152] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-07T22:30:08.092211] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-07T22:30:08.092270] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-07T22:30:08.092339] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYZ took 3.6s. Estimated remaining: 3m 57s. Rate: 7.1 symbols/min [2025-10-07T22:30:08.262546] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:30:08.297179] [DEBUG] [LOCAL ] YALA: Loaded 37065 existing records from primary storage. [2025-10-07T22:30:08.297485] [INFO ] [MAIN ] YALA: Loaded 37065 existing records. [2025-10-07T22:30:08.479131] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:30:08.479541] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-07T22:30:08.479721] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-07T22:30:08.488080] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-07T22:30:08.497074] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-07T22:30:08.569383] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-07T22:30:08.657954] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-07T22:30:08.899474] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:30:09.447683] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-07T22:30:10.247698] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-07T22:30:10.723518] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-07T22:30:10.727325] [INFO ] [REMOTE ] XPRO: Full fetch complete (66447 records). [2025-10-07T22:30:10.727535] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-07T22:30:11.068816] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-07T22:30:11.195280] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-07T22:30:11.197108] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-07T22:30:11.196700] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-07T22:30:11.205250] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-07T22:30:11.212915] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-07T22:30:11.212766] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-07T22:30:11.232610] [DEBUG] [LOCAL ] XPRO: Trimmed 66447 records to 45854 (keeping 200 days of data) [2025-10-07T22:30:11.531375] [DEBUG] [LOCAL ] XPRO: Primary data saved (45854 records). [2025-10-07T22:30:11.531602] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-07T22:30:11.531750] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XPRO took 32.7s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-07T22:30:11.730204] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:30:11.779019] [DEBUG] [LOCAL ] YELP: Loaded 45396 existing records from primary storage. [2025-10-07T22:30:11.779362] [INFO ] [MAIN ] YELP: Loaded 45396 existing records. [2025-10-07T22:30:11.855805] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-07T22:30:11.976912] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:30:11.977268] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-07T22:30:11.977333] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-07T22:30:11.977609] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-07T22:30:11.977714] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-07T22:30:12.389332] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-07T22:30:12.387678] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:30:12.647712] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-07T22:30:13.188292] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-07T22:30:13.447686] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-07T22:30:14.203779] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-07T22:30:14.205838] [INFO ] [REMOTE ] XYF: Full fetch complete (32354 records). [2025-10-07T22:30:14.205937] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-07T22:30:14.259900] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-07T22:30:14.497337] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-07T22:30:14.623348] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-07T22:30:14.623451] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-07T22:30:14.624139] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-07T22:30:14.624202] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-07T22:30:14.625604] [DEBUG] [LOCAL ] XYF: Trimmed 32354 records to 28404 (keeping 200 days of data) [2025-10-07T22:30:14.803467] [DEBUG] [LOCAL ] XYF: Primary data saved (28404 records). [2025-10-07T22:30:14.803611] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-07T22:30:14.803737] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. XYF took 34.4s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-07T22:30:14.982593] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:30:15.033754] [DEBUG] [LOCAL ] YETI: Loaded 52473 existing records from primary storage. [2025-10-07T22:30:15.034140] [INFO ] [MAIN ] YETI: Loaded 52473 existing records. [2025-10-07T22:30:15.054402] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-07T22:30:15.212079] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:30:15.212378] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-07T22:30:15.212442] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-07T22:30:15.212845] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-07T22:30:15.212907] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-07T22:30:15.562516] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:30:15.847639] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-07T22:30:16.037908] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-07T22:30:16.647631] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-07T22:30:16.687615] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-07T22:30:17.447739] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-07T22:30:17.672515] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-07T22:30:18.247618] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-07T22:30:18.317173] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-07T22:30:18.499081] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T22:30:19.047697] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-07T22:30:19.589072] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-07T22:30:19.847688] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-07T22:30:20.210859] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-07T22:30:20.647680] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-07T22:30:21.447624] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-07T22:30:21.622816] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-07T22:30:21.679798] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-07T22:30:22.247686] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-07T22:30:23.047687] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-07T22:30:23.110714] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-07T22:30:23.595052] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-07T22:30:23.847714] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-07T22:30:24.165014] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-07T22:30:24.647706] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-07T22:30:25.285128] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-07T22:30:25.288850] [INFO ] [REMOTE ] XYL: Full fetch complete (69740 records). [2025-10-07T22:30:25.289002] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-07T22:30:25.447658] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-07T22:30:25.706248] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-07T22:30:25.715764] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-07T22:30:25.719288] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-07T22:30:25.717855] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-07T22:30:25.729407] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-07T22:30:25.731456] [DEBUG] [LOCAL ] XYL: Trimmed 69740 records to 47930 (keeping 200 days of data) [2025-10-07T22:30:26.031596] [DEBUG] [LOCAL ] XYL: Primary data saved (47930 records). [2025-10-07T22:30:26.031766] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-07T22:30:26.031887] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. XYL took 27.1s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-07T22:30:26.195854] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:30:26.234199] [DEBUG] [LOCAL ] YEXT: Loaded 43092 existing records from primary storage. [2025-10-07T22:30:26.234498] [INFO ] [MAIN ] YEXT: Loaded 43092 existing records. [2025-10-07T22:30:26.255455] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-07T22:30:26.411357] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:30:26.411546] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-07T22:30:26.411592] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-07T22:30:26.411912] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-07T22:30:26.411969] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-07T22:30:26.760982] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:30:27.047638] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-07T22:30:27.223441] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-07T22:30:27.590110] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-07T22:30:27.847681] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-07T22:30:28.625633] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T22:30:28.647603] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-07T22:30:29.447626] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-07T22:30:29.610808] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-07T22:30:30.189095] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-07T22:30:30.247622] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-07T22:30:31.047678] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-07T22:30:31.080723] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-07T22:30:31.740850] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-07T22:30:31.847714] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-07T22:30:32.647634] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-07T22:30:32.730256] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-07T22:30:33.447695] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-07T22:30:33.491933] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-07T22:30:34.199320] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-07T22:30:34.247634] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-07T22:30:34.964931] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T22:30:35.047681] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-07T22:30:35.847692] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-07T22:30:36.069497] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T22:30:36.219561] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-07T22:30:36.647685] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-07T22:30:36.820324] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-07T22:30:37.447697] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-07T22:30:38.247615] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-07T22:30:38.348891] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T22:30:39.047622] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-07T22:30:39.204548] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-07T22:30:39.472726] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T22:30:39.476293] [INFO ] [REMOTE ] YELP: Full fetch complete (64603 records). [2025-10-07T22:30:39.476401] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-07T22:30:39.860247] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-07T22:30:39.883876] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-07T22:30:39.883990] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-07T22:30:39.885249] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-07T22:30:39.885325] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-07T22:30:39.887080] [DEBUG] [LOCAL ] YELP: Trimmed 64603 records to 45418 (keeping 200 days of data) [2025-10-07T22:30:40.192189] [DEBUG] [LOCAL ] YELP: Primary data saved (45418 records). [2025-10-07T22:30:40.195288] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-07T22:30:40.195480] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YELP took 28.7s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-07T22:30:40.229879] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-07T22:30:40.378628] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:30:40.431908] [DEBUG] [LOCAL ] YMM: Loaded 52621 existing records from primary storage. [2025-10-07T22:30:40.432305] [INFO ] [MAIN ] YMM: Loaded 52621 existing records. [2025-10-07T22:30:40.604170] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:30:40.604421] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-07T22:30:40.604469] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-07T22:30:40.604873] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-07T22:30:40.604932] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-07T22:30:40.657126] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-07T22:30:40.955436] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:30:41.423683] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-07T22:30:41.447611] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-07T22:30:42.089582] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-07T22:30:42.247639] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-07T22:30:42.966199] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-07T22:30:43.047694] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-07T22:30:43.340404] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-07T22:30:43.847683] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-07T22:30:44.647692] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-07T22:30:44.745874] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-07T22:30:45.447755] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-07T22:30:45.745827] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-07T22:30:46.026748] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-07T22:30:46.247700] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-07T22:30:46.939298] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-07T22:30:47.047714] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-07T22:30:47.732213] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-07T22:30:47.847634] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-07T22:30:48.069140] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T22:30:48.071907] [INFO ] [REMOTE ] YALA: Full fetch complete (46700 records). [2025-10-07T22:30:48.072020] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-07T22:30:48.450316] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-07T22:30:48.450394] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-07T22:30:48.451258] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-07T22:30:48.451321] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-07T22:30:48.452345] [DEBUG] [LOCAL ] YALA: Trimmed 46700 records to 37001 (keeping 200 days of data) [2025-10-07T22:30:48.648859] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-07T22:30:48.656163] [DEBUG] [LOCAL ] YALA: Primary data saved (37001 records). [2025-10-07T22:30:48.656304] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-07T22:30:48.656442] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YALA took 40.6s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-07T22:30:48.824209] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:30:48.869711] [DEBUG] [LOCAL ] YOU: Loaded 49674 existing records from primary storage. [2025-10-07T22:30:48.870027] [INFO ] [MAIN ] YOU: Loaded 49674 existing records. [2025-10-07T22:30:49.046359] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:30:49.046597] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-07T22:30:49.046670] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-07T22:30:49.047043] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-07T22:30:49.047098] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-07T22:30:49.397427] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:30:49.447593] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-07T22:30:49.576591] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-07T22:30:50.247614] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-07T22:30:50.513494] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-07T22:30:51.047622] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-07T22:30:51.116126] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-07T22:30:51.847629] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-07T22:30:51.885244] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-07T22:30:51.888859] [INFO ] [REMOTE ] YETI: Full fetch complete (75424 records). [2025-10-07T22:30:51.888958] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-07T22:30:52.304603] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-07T22:30:52.304762] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-07T22:30:52.306013] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-07T22:30:52.306095] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-07T22:30:52.307821] [DEBUG] [LOCAL ] YETI: Trimmed 75424 records to 52471 (keeping 200 days of data) [2025-10-07T22:30:52.544592] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-07T22:30:52.647944] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-07T22:30:52.661840] [DEBUG] [LOCAL ] YETI: Primary data saved (52471 records). [2025-10-07T22:30:52.661949] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-07T22:30:52.662031] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 37.9s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-07T22:30:52.827260] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:30:52.873024] [DEBUG] [LOCAL ] YPF: Loaded 50487 existing records from primary storage. [2025-10-07T22:30:52.873361] [INFO ] [MAIN ] YPF: Loaded 50487 existing records. [2025-10-07T22:30:53.046625] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:30:53.046879] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-07T22:30:53.046926] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-07T22:30:53.047138] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-07T22:30:53.047197] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-07T22:30:53.398522] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:30:53.447616] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-07T22:30:53.657423] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-07T22:30:54.247630] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-07T22:30:54.465803] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-07T22:30:54.610522] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-07T22:30:55.047673] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-07T22:30:55.847703] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-07T22:30:55.964747] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-07T22:30:56.346597] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-07T22:30:56.647689] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-07T22:30:56.938349] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-07T22:30:57.447710] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-07T22:30:58.247777] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-07T22:30:58.337502] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T22:30:59.047716] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-07T22:30:59.284989] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-07T22:30:59.785161] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-07T22:30:59.847694] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-07T22:31:00.647778] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-07T22:31:00.807886] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-07T22:31:01.447707] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-07T22:31:01.503586] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T22:31:02.247770] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-07T22:31:02.472199] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-07T22:31:03.047697] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-07T22:31:03.156169] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-07T22:31:03.599070] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-07T22:31:03.847736] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-07T22:31:04.611441] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-07T22:31:04.647704] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-07T22:31:05.447634] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-07T22:31:05.650142] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-07T22:31:06.247635] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-07T22:31:06.484960] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T22:31:07.047631] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-07T22:31:07.281746] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T22:31:07.546639] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-07T22:31:07.552338] [INFO ] [REMOTE ] YEXT: Full fetch complete (63199 records). [2025-10-07T22:31:07.552565] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-07T22:31:07.858785] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-07T22:31:08.007481] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-07T22:31:08.007619] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-07T22:31:08.009679] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-07T22:31:08.009886] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-07T22:31:08.012254] [DEBUG] [LOCAL ] YEXT: Trimmed 63199 records to 43125 (keeping 200 days of data) [2025-10-07T22:31:08.287956] [DEBUG] [LOCAL ] YEXT: Primary data saved (43125 records). [2025-10-07T22:31:08.288262] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-07T22:31:08.288388] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YEXT took 42.3s. Estimated remaining: 2m 58s. Rate: 7.1 symbols/min [2025-10-07T22:31:08.485536] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:31:08.501318] [DEBUG] [LOCAL ] YRD: Loaded 12286 existing records from primary storage. [2025-10-07T22:31:08.501693] [INFO ] [MAIN ] YRD: Loaded 12286 existing records. [2025-10-07T22:31:08.652891] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-07T22:31:08.713370] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:31:08.714263] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-07T22:31:08.714336] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-07T22:31:08.714699] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-07T22:31:08.714764] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-07T22:31:09.110894] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:31:09.147377] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-07T22:31:09.447639] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-07T22:31:09.607423] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-07T22:31:10.247702] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-07T22:31:10.636227] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-07T22:31:10.674706] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T22:31:10.678779] [INFO ] [REMOTE ] YMM: Full fetch complete (76379 records). [2025-10-07T22:31:10.678935] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-07T22:31:11.052850] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-07T22:31:11.142504] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-07T22:31:11.142624] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-07T22:31:11.144133] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-07T22:31:11.144231] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-07T22:31:11.146054] [DEBUG] [LOCAL ] YMM: Trimmed 76379 records to 52632 (keeping 200 days of data) [2025-10-07T22:31:11.470267] [DEBUG] [LOCAL ] YMM: Primary data saved (52632 records). [2025-10-07T22:31:11.470418] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-07T22:31:11.470506] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 31.3s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-07T22:31:11.638504] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:31:11.664367] [DEBUG] [LOCAL ] YSG: Loaded 25288 existing records from primary storage. [2025-10-07T22:31:11.664660] [INFO ] [MAIN ] YSG: Loaded 25288 existing records. [2025-10-07T22:31:11.845750] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:31:11.846060] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-07T22:31:11.846174] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-07T22:31:11.846538] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-07T22:31:11.846603] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-07T22:31:11.861485] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-07T22:31:11.961880] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-07T22:31:12.260559] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:31:12.630331] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-07T22:31:12.647601] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-07T22:31:12.801905] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-07T22:31:13.447684] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-07T22:31:14.256168] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-07T22:31:14.259204] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-07T22:31:14.811350] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-07T22:31:15.000083] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-07T22:31:15.047724] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-07T22:31:15.847692] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-07T22:31:16.403202] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-07T22:31:16.647625] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-07T22:31:16.804382] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-07T22:31:17.447732] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-07T22:31:18.247599] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-07T22:31:18.294121] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-07T22:31:18.332487] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-07T22:31:19.047701] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-07T22:31:19.383295] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-07T22:31:19.708599] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-07T22:31:19.847683] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-07T22:31:20.647693] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-07T22:31:20.942977] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-07T22:31:21.447723] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-07T22:31:22.038722] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-07T22:31:22.042418] [INFO ] [REMOTE ] YOU: Full fetch complete (72164 records). [2025-10-07T22:31:22.042559] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-07T22:31:22.249414] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-07T22:31:22.470080] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-07T22:31:22.471098] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-07T22:31:22.473696] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-07T22:31:22.473874] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-07T22:31:22.472152] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-07T22:31:22.480572] [DEBUG] [LOCAL ] YOU: Trimmed 72164 records to 49694 (keeping 200 days of data) [2025-10-07T22:31:22.800258] [DEBUG] [LOCAL ] YOU: Primary data saved (49694 records). [2025-10-07T22:31:22.800433] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-07T22:31:22.800562] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 34.1s. Estimated remaining: 2m 41s. Rate: 7.1 symbols/min [2025-10-07T22:31:22.971430] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:31:23.033509] [DEBUG] [LOCAL ] YUM: Loaded 51208 existing records from primary storage. [2025-10-07T22:31:23.034456] [INFO ] [MAIN ] YUM: Loaded 51208 existing records. [2025-10-07T22:31:23.054581] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-07T22:31:23.166114] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-07T22:31:23.234324] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:31:23.234561] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-07T22:31:23.234609] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-07T22:31:23.234901] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-07T22:31:23.234960] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-07T22:31:23.588111] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:31:23.847702] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-07T22:31:24.647707] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-07T22:31:24.713628] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-07T22:31:24.851191] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T22:31:25.447620] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-07T22:31:25.706402] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-07T22:31:26.247704] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-07T22:31:27.047630] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-07T22:31:27.102926] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-07T22:31:27.103919] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-07T22:31:27.847702] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-07T22:31:28.647669] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-07T22:31:28.813117] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-07T22:31:29.447704] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-07T22:31:29.655103] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-07T22:31:29.779020] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-07T22:31:30.242569] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-07T22:31:30.247602] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-07T22:31:31.047633] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-07T22:31:31.092038] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T22:31:31.847689] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-07T22:31:32.525142] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-07T22:31:32.647677] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-07T22:31:33.307067] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T22:31:33.451569] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-07T22:31:34.247621] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-07T22:31:34.325008] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-07T22:31:34.411454] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-07T22:31:35.047674] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-07T22:31:35.159871] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-07T22:31:35.739750] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-07T22:31:35.741157] [INFO ] [REMOTE ] YRD: Full fetch complete (19082 records). [2025-10-07T22:31:35.741240] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-07T22:31:35.852797] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-07T22:31:36.114737] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-07T22:31:36.114846] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-07T22:31:36.115288] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-07T22:31:36.115345] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-07T22:31:36.115949] [DEBUG] [LOCAL ] YRD: Trimmed 19082 records to 12101 (keeping 200 days of data) [2025-10-07T22:31:36.190129] [DEBUG] [LOCAL ] YRD: Primary data saved (12101 records). [2025-10-07T22:31:36.190269] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-07T22:31:36.190364] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YRD took 27.9s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-07T22:31:36.358430] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:31:36.409708] [DEBUG] [LOCAL ] YUMC: Loaded 52614 existing records from primary storage. [2025-10-07T22:31:36.410043] [INFO ] [MAIN ] YUMC: Loaded 52614 existing records. [2025-10-07T22:31:36.586526] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:31:36.586809] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-07T22:31:36.586859] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-07T22:31:36.587068] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-07T22:31:36.587125] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-07T22:31:36.656154] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-07T22:31:36.996769] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:31:37.447681] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-07T22:31:37.822609] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-07T22:31:37.881613] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-07T22:31:37.886692] [INFO ] [REMOTE ] YPF: Full fetch complete (73467 records). [2025-10-07T22:31:37.886860] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-07T22:31:38.252242] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-07T22:31:38.276406] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-07T22:31:38.276526] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-07T22:31:38.277697] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-07T22:31:38.277764] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-07T22:31:38.281889] [DEBUG] [LOCAL ] YPF: Trimmed 73467 records to 50491 (keeping 200 days of data) [2025-10-07T22:31:38.583386] [DEBUG] [LOCAL ] YPF: Primary data saved (50491 records). [2025-10-07T22:31:38.583565] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-07T22:31:38.583717] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YPF took 45.9s. Estimated remaining: 2m 24s. Rate: 7.1 symbols/min [2025-10-07T22:31:38.753758] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:31:38.806790] [DEBUG] [LOCAL ] ZBH: Loaded 50961 existing records from primary storage. [2025-10-07T22:31:38.807126] [INFO ] [MAIN ] ZBH: Loaded 50961 existing records. [2025-10-07T22:31:38.990243] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:31:38.990543] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-07T22:31:38.990702] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-07T22:31:38.991011] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-07T22:31:38.991071] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-07T22:31:39.053118] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-07T22:31:39.401037] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:31:39.403429] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-07T22:31:39.847710] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-07T22:31:40.077362] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T22:31:40.311283] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-07T22:31:40.647725] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-07T22:31:41.447734] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-07T22:31:41.538706] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-07T22:31:42.247685] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-07T22:31:42.388229] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-07T22:31:43.047626] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-07T22:31:43.103863] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-07T22:31:43.305541] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-07T22:31:43.308119] [INFO ] [REMOTE ] YSG: Full fetch complete (32417 records). [2025-10-07T22:31:43.308217] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-07T22:31:43.724965] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-07T22:31:43.725075] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-07T22:31:43.725760] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-07T22:31:43.725823] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-07T22:31:43.726859] [DEBUG] [LOCAL ] YSG: Trimmed 32417 records to 25368 (keeping 200 days of data) [2025-10-07T22:31:43.847791] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-07T22:31:43.884869] [DEBUG] [LOCAL ] YSG: Primary data saved (25368 records). [2025-10-07T22:31:43.885017] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-07T22:31:43.885124] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 32.4s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-07T22:31:44.051606] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:31:44.070987] [DEBUG] [LOCAL ] ZEPP: Loaded 17976 existing records from primary storage. [2025-10-07T22:31:44.071289] [INFO ] [MAIN ] ZEPP: Loaded 17976 existing records. [2025-10-07T22:31:44.250921] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:31:44.251193] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-07T22:31:44.251271] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-07T22:31:44.251501] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-07T22:31:44.251561] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-07T22:31:44.605397] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:31:44.647607] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-07T22:31:44.894727] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T22:31:45.131097] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-07T22:31:45.447629] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-07T22:31:45.642398] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-07T22:31:46.247685] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-07T22:31:47.047676] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-07T22:31:47.249946] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-07T22:31:47.847675] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-07T22:31:48.116960] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-07T22:31:48.647703] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-07T22:31:48.766398] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T22:31:48.991006] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-07T22:31:49.447683] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-07T22:31:49.688031] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-07T22:31:50.247674] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-07T22:31:50.790042] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-07T22:31:51.047618] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-07T22:31:51.187219] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-07T22:31:51.430974] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-07T22:31:51.847730] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-07T22:31:52.647677] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-07T22:31:53.447634] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-07T22:31:53.612137] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-07T22:31:54.063373] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-07T22:31:54.141404] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-07T22:31:54.247703] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-07T22:31:55.047712] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-07T22:31:55.847635] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-07T22:31:56.073339] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-07T22:31:56.242556] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-07T22:31:56.647728] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-07T22:31:56.890789] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-07T22:31:56.927500] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-07T22:31:56.931208] [INFO ] [REMOTE ] YUM: Full fetch complete (74514 records). [2025-10-07T22:31:56.931354] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-07T22:31:57.389349] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-07T22:31:57.389493] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-07T22:31:57.392244] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-07T22:31:57.392360] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-07T22:31:57.394237] [DEBUG] [LOCAL ] YUM: Trimmed 74514 records to 51221 (keeping 200 days of data) [2025-10-07T22:31:57.457075] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-07T22:31:57.752856] [DEBUG] [LOCAL ] YUM: Primary data saved (51221 records). [2025-10-07T22:31:57.753025] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-07T22:31:57.754362] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 35.0s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-07T22:31:57.954386] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:31:58.021851] [DEBUG] [LOCAL ] ZETA: Loaded 53601 existing records from primary storage. [2025-10-07T22:31:58.022405] [INFO ] [MAIN ] ZETA: Loaded 53601 existing records. [2025-10-07T22:31:58.220352] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:31:58.220610] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-07T22:31:58.220690] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-07T22:31:58.220935] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-07T22:31:58.220993] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-07T22:31:58.253206] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-07T22:31:58.646621] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:31:59.047677] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-07T22:31:59.288859] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-07T22:31:59.419112] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-07T22:31:59.847634] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-07T22:32:00.120225] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-07T22:32:00.647687] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-07T22:32:01.124249] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-07T22:32:01.447633] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-07T22:32:02.247728] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-07T22:32:02.376036] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-07T22:32:03.047622] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-07T22:32:03.302247] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-07T22:32:03.847723] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-07T22:32:03.928535] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T22:32:04.647630] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-07T22:32:04.873771] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-07T22:32:05.447689] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-07T22:32:06.172906] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-07T22:32:06.247613] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-07T22:32:06.552365] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-07T22:32:07.047703] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-07T22:32:07.280552] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-07T22:32:07.704315] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-07T22:32:07.847753] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-07T22:32:08.647698] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-07T22:32:09.237633] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-07T22:32:09.447677] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-07T22:32:09.479134] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-07T22:32:09.481182] [INFO ] [REMOTE ] ZEPP: Full fetch complete (19637 records). [2025-10-07T22:32:09.481260] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-07T22:32:09.857971] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-07T22:32:09.858090] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-07T22:32:09.858754] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-07T22:32:09.858833] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-07T22:32:09.892005] [DEBUG] [LOCAL ] ZEPP: Trimmed 19637 records to 18118 (keeping 200 days of data) [2025-10-07T22:32:09.894291] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-07T22:32:10.011735] [DEBUG] [LOCAL ] ZEPP: Primary data saved (18118 records). [2025-10-07T22:32:10.011884] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-07T22:32:10.011967] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. ZEPP took 26.1s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-07T22:32:10.247681] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-07T22:32:11.010370] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-07T22:32:11.047608] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-07T22:32:11.519202] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-07T22:32:11.522903] [INFO ] [REMOTE ] ZBH: Full fetch complete (73766 records). [2025-10-07T22:32:11.523033] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-07T22:32:11.861322] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-07T22:32:12.019608] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-07T22:32:12.019826] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-07T22:32:12.029790] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-07T22:32:12.031189] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-07T22:32:12.031697] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-07T22:32:12.033666] [DEBUG] [LOCAL ] ZBH: Trimmed 73766 records to 50905 (keeping 200 days of data) [2025-10-07T22:32:12.405163] [DEBUG] [LOCAL ] ZBH: Primary data saved (50905 records). [2025-10-07T22:32:12.405312] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-07T22:32:12.405395] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. ZBH took 33.8s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-07T22:32:12.647682] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-07T22:32:13.709497] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-07T22:32:13.721433] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-07T22:32:14.726822] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-07T22:32:14.738344] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-07T22:32:14.901683] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-07T22:32:14.905759] [INFO ] [REMOTE ] YUMC: Full fetch complete (76147 records). [2025-10-07T22:32:14.905946] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-07T22:32:15.307363] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-07T22:32:15.307477] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-07T22:32:15.308629] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-07T22:32:15.308716] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-07T22:32:15.310268] [DEBUG] [LOCAL ] YUMC: Trimmed 76147 records to 52606 (keeping 200 days of data) [2025-10-07T22:32:15.639879] [DEBUG] [LOCAL ] YUMC: Primary data saved (52606 records). [2025-10-07T22:32:15.640045] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-07T22:32:15.640136] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. YUMC took 39.4s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-07T22:32:16.960884] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-07T22:32:16.974409] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-07T22:32:19.124997] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-07T22:32:19.137380] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-07T22:32:21.316012] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-07T22:32:21.328714] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-07T22:32:23.751866] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-07T22:32:23.765027] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-07T22:32:26.245241] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-07T22:32:26.257335] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-07T22:32:28.673580] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-07T22:32:28.687191] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-07T22:32:30.798902] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-07T22:32:30.802590] [INFO ] [REMOTE ] ZETA: Full fetch complete (77680 records). [2025-10-07T22:32:30.802791] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-07T22:32:31.200126] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-07T22:32:31.200322] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-07T22:32:31.201558] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-07T22:32:31.201630] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-07T22:32:31.203278] [DEBUG] [LOCAL ] ZETA: Trimmed 77680 records to 53603 (keeping 200 days of data) [2025-10-07T22:32:31.536895] [DEBUG] [LOCAL ] ZETA: Primary data saved (53603 records). [2025-10-07T22:32:31.537089] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-07T22:32:31.537217] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 33.8s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-07T22:32:32.179747] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:32:32.249500] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:32:32.323288] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:32:32.319194] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:32:32.367271] [DEBUG] [LOCAL ] ZH: Loaded 26140 existing records from primary storage. [2025-10-07T22:32:32.367828] [INFO ] [MAIN ] ZH: Loaded 26140 existing records. [2025-10-07T22:32:32.464047] [DEBUG] [LOCAL ] ZIM: Loaded 53507 existing records from primary storage. [2025-10-07T22:32:32.490271] [INFO ] [MAIN ] ZIM: Loaded 53507 existing records. [2025-10-07T22:32:32.635898] [DEBUG] [LOCAL ] ZGN: Loaded 40770 existing records from primary storage. [2025-10-07T22:32:32.725062] [INFO ] [MAIN ] ZGN: Loaded 40770 existing records. [2025-10-07T22:32:32.721970] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:32:32.762975] [DEBUG] [LOCAL ] ZIP: Loaded 43976 existing records from primary storage. [2025-10-07T22:32:32.773521] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-07T22:32:32.796921] [INFO ] [MAIN ] ZIP: Loaded 43976 existing records. [2025-10-07T22:32:32.848826] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-07T22:32:32.980831] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-07T22:32:33.033146] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:32:33.062174] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-07T22:32:33.099089] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-07T22:32:33.150984] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:32:33.147697] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-07T22:32:33.173685] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-07T22:32:33.218560] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-07T22:32:33.218790] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-07T22:32:33.285805] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-07T22:32:33.396234] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:32:33.406774] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-07T22:32:33.407114] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-07T22:32:33.427836] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-07T22:32:33.438184] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-07T22:32:33.508863] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-07T22:32:33.509010] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-07T22:32:34.362329] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:32:34.536689] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:32:34.494056] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-07T22:32:34.582729] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-07T22:32:34.638986] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:32:34.656608] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-07T22:32:34.722417] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:32:34.722955] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-07T22:32:35.764360] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-07T22:32:35.770008] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-07T22:32:35.912818] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-07T22:32:35.919976] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-07T22:32:36.206687] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-07T22:32:36.216759] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-07T22:32:36.650457] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-07T22:32:36.661921] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-07T22:32:36.872069] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-07T22:32:36.879080] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-07T22:32:36.934581] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-07T22:32:36.939313] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-07T22:32:37.391145] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-07T22:32:37.400065] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-07T22:32:38.165515] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-07T22:32:38.172762] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-07T22:32:38.389764] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-07T22:32:38.397321] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-07T22:32:38.508687] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-07T22:32:38.518916] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-07T22:32:38.873373] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-07T22:32:38.885035] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-07T22:32:39.419594] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-07T22:32:39.429978] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-07T22:32:39.858381] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-07T22:32:39.867600] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-07T22:32:40.071637] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-07T22:32:40.079938] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-07T22:32:40.922623] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-07T22:32:40.933596] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-07T22:32:40.982253] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-07T22:32:40.991311] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-07T22:32:41.152207] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T22:32:41.164616] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-07T22:32:41.914011] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-07T22:32:41.923977] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-07T22:32:41.984306] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-07T22:32:41.988899] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-07T22:32:42.830093] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-07T22:32:42.840874] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-07T22:32:42.947389] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-07T22:32:42.959978] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-07T22:32:43.093639] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-07T22:32:43.099691] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-07T22:32:43.364408] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-07T22:32:43.373767] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-07T22:32:43.953256] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-07T22:32:43.962577] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-07T22:32:44.032007] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-07T22:32:44.038946] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-07T22:32:44.506227] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-07T22:32:44.514978] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-07T22:32:44.812486] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-07T22:32:44.818376] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-07T22:32:45.351388] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-07T22:32:45.363009] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-07T22:32:45.482760] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-07T22:32:45.492137] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-07T22:32:45.757071] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-07T22:32:46.063150] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-07T22:32:46.247634] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-07T22:32:47.047738] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-07T22:32:47.179220] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-07T22:32:47.639847] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-07T22:32:47.725449] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-07T22:32:47.847626] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-07T22:32:48.065777] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T22:32:48.068072] [INFO ] [REMOTE ] ZH: Full fetch complete (40113 records). [2025-10-07T22:32:48.068184] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-07T22:32:48.460266] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-07T22:32:48.460366] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-07T22:32:48.461539] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-07T22:32:48.461605] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-07T22:32:48.462635] [DEBUG] [LOCAL ] ZH: Trimmed 40113 records to 26008 (keeping 200 days of data) [2025-10-07T22:32:48.616205] [DEBUG] [LOCAL ] ZH: Primary data saved (26008 records). [2025-10-07T22:32:48.616376] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-07T22:32:48.616516] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 17.1s. Estimated remaining: 1m 25s. Rate: 7.1 symbols/min [2025-10-07T22:32:48.649671] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-07T22:32:48.797466] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:32:48.835073] [DEBUG] [LOCAL ] ZK: Loaded 39361 existing records from primary storage. [2025-10-07T22:32:48.835403] [INFO ] [MAIN ] ZK: Loaded 39361 existing records. [2025-10-07T22:32:49.015752] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:32:49.015973] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-07T22:32:49.016023] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-07T22:32:49.016268] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-07T22:32:49.016327] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-07T22:32:49.399705] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:32:49.447637] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-07T22:32:49.504041] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-07T22:32:50.247681] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-07T22:32:50.869832] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-07T22:32:50.929525] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-07T22:32:51.047614] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-07T22:32:51.166532] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-07T22:32:51.169598] [INFO ] [REMOTE ] ZIP: Full fetch complete (59903 records). [2025-10-07T22:32:51.169736] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-07T22:32:51.586367] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-07T22:32:51.586487] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-07T22:32:51.587535] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-07T22:32:51.587601] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-07T22:32:51.588884] [DEBUG] [LOCAL ] ZIP: Trimmed 59903 records to 43958 (keeping 200 days of data) [2025-10-07T22:32:51.839220] [DEBUG] [LOCAL ] ZIP: Primary data saved (43958 records). [2025-10-07T22:32:51.839359] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-07T22:32:51.839447] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZIP took 20.3s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-07T22:32:51.852768] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-07T22:32:52.017534] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:32:52.030938] [DEBUG] [LOCAL ] ZKH: Loaded 7634 existing records from primary storage. [2025-10-07T22:32:52.031186] [INFO ] [MAIN ] ZKH: Loaded 7634 existing records. [2025-10-07T22:32:52.213919] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:32:52.214221] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-07T22:32:52.214278] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-07T22:32:52.214453] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-07T22:32:52.214513] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-07T22:32:52.321464] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-07T22:32:52.374621] [INFO ] [REMOTE ] ZGN: Full fetch complete (57986 records). [2025-10-07T22:32:52.383810] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-07T22:32:52.650864] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-07T22:32:52.780292] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:32:52.990881] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-07T22:32:52.990965] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-07T22:32:52.992018] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-07T22:32:52.992083] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-07T22:32:52.993261] [DEBUG] [LOCAL ] ZGN: Trimmed 57986 records to 40715 (keeping 200 days of data) [2025-10-07T22:32:53.237097] [DEBUG] [LOCAL ] ZGN: Primary data saved (40715 records). [2025-10-07T22:32:53.237232] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-07T22:32:53.237313] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZGN took 21.7s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-07T22:32:53.406939] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:32:53.450627] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-07T22:32:53.454467] [DEBUG] [LOCAL ] ZTO: Loaded 49704 existing records from primary storage. [2025-10-07T22:32:53.455220] [INFO ] [MAIN ] ZTO: Loaded 49704 existing records. [2025-10-07T22:32:53.559716] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T22:32:53.674038] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:32:53.674340] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-07T22:32:53.674400] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-07T22:32:53.674800] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-07T22:32:53.674859] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-07T22:32:54.023073] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:32:54.032776] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-07T22:32:54.247639] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-07T22:32:55.047629] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-07T22:32:55.082901] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-07T22:32:55.847678] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-07T22:32:55.960505] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-07T22:32:56.475441] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-07T22:32:56.647717] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-07T22:32:57.447697] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-07T22:32:58.084083] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-07T22:32:58.247627] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-07T22:32:58.323716] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-07T22:32:58.906373] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-07T22:32:58.965422] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-07T22:32:59.047702] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-07T22:32:59.847738] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-07T22:33:00.647770] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-07T22:33:01.337428] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-07T22:33:01.447704] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-07T22:33:01.509385] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-07T22:33:02.221227] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-07T22:33:02.247625] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-07T22:33:02.300972] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T22:33:03.020555] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-07T22:33:03.047665] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-07T22:33:03.847687] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-07T22:33:04.445010] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-07T22:33:04.647703] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-07T22:33:04.716173] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-07T22:33:04.719891] [INFO ] [REMOTE ] ZIM: Full fetch complete (77500 records). [2025-10-07T22:33:04.720033] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-07T22:33:05.116213] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-07T22:33:05.116319] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-07T22:33:05.117584] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-07T22:33:05.117688] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-07T22:33:05.119290] [DEBUG] [LOCAL ] ZIM: Trimmed 77500 records to 53506 (keeping 200 days of data) [2025-10-07T22:33:05.447961] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-07T22:33:05.479037] [DEBUG] [LOCAL ] ZIM: Primary data saved (53506 records). [2025-10-07T22:33:05.479201] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-07T22:33:05.479291] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 33.9s. Estimated remaining: 59.2s. Rate: 7.1 symbols/min [2025-10-07T22:33:05.650862] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:33:05.668907] [DEBUG] [LOCAL ] ZTR: Loaded 16726 existing records from primary storage. [2025-10-07T22:33:05.669199] [INFO ] [MAIN ] ZTR: Loaded 16726 existing records. [2025-10-07T22:33:05.854851] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:33:05.855102] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-07T22:33:05.855152] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-07T22:33:05.855374] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-07T22:33:05.855435] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-07T22:33:06.053446] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-07T22:33:06.233294] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:33:06.247597] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-07T22:33:06.296964] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-07T22:33:06.958300] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-07T22:33:07.047668] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-07T22:33:07.847710] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-07T22:33:08.647634] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-07T22:33:08.845528] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-07T22:33:08.895904] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-07T22:33:09.242474] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-07T22:33:09.447634] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-07T22:33:10.247617] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-07T22:33:10.539924] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-07T22:33:11.047622] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-07T22:33:11.211612] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-07T22:33:11.847702] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-07T22:33:12.059281] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-07T22:33:12.647622] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-07T22:33:12.686157] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-07T22:33:13.447710] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-07T22:33:14.249566] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-07T22:33:14.252391] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-07T22:33:14.441208] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-07T22:33:15.047678] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-07T22:33:15.310521] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-07T22:33:15.847727] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-07T22:33:16.647673] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-07T22:33:16.955124] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-07T22:33:17.447669] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-07T22:33:17.489353] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-07T22:33:17.559106] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-07T22:33:17.934362] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-07T22:33:17.935814] [INFO ] [REMOTE ] ZKH: Full fetch complete (11881 records). [2025-10-07T22:33:17.935934] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-07T22:33:18.252803] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-07T22:33:18.329956] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-07T22:33:18.330071] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-07T22:33:18.330365] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-07T22:33:18.330408] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-07T22:33:18.331206] [DEBUG] [LOCAL ] ZKH: Trimmed 11881 records to 7612 (keeping 200 days of data) [2025-10-07T22:33:18.375921] [DEBUG] [LOCAL ] ZKH: Primary data saved (7612 records). [2025-10-07T22:33:18.376098] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-07T22:33:18.376191] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZKH took 26.5s. Estimated remaining: 50.7s. Rate: 7.1 symbols/min [2025-10-07T22:33:18.554040] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:33:18.609226] [DEBUG] [LOCAL ] ZTS: Loaded 53037 existing records from primary storage. [2025-10-07T22:33:18.609737] [INFO ] [MAIN ] ZTS: Loaded 53037 existing records. [2025-10-07T22:33:18.789626] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:33:18.789967] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-07T22:33:18.790099] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-07T22:33:18.790804] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-07T22:33:18.790863] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-07T22:33:19.053078] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-07T22:33:19.162828] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:33:19.599732] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-07T22:33:19.847699] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-07T22:33:20.072295] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-07T22:33:20.647698] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-07T22:33:21.447634] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-07T22:33:21.687349] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-07T22:33:21.773633] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-07T22:33:22.247637] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-07T22:33:22.855562] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-07T22:33:23.047697] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-07T22:33:23.605312] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-07T22:33:23.847725] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-07T22:33:24.461256] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-07T22:33:24.647699] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-07T22:33:25.447633] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-07T22:33:25.570910] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-07T22:33:25.693759] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-07T22:33:26.247699] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-07T22:33:26.605539] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-07T22:33:27.047624] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-07T22:33:27.273339] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-07T22:33:27.847689] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-07T22:33:28.249547] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-07T22:33:28.252123] [INFO ] [REMOTE ] ZK: Full fetch complete (56843 records). [2025-10-07T22:33:28.252214] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-07T22:33:28.648293] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-07T22:33:28.667155] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-07T22:33:28.669001] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-07T22:33:28.673029] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-07T22:33:28.674398] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-07T22:33:28.674949] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-07T22:33:28.677222] [DEBUG] [LOCAL ] ZK: Trimmed 56843 records to 39203 (keeping 200 days of data) [2025-10-07T22:33:28.913591] [DEBUG] [LOCAL ] ZK: Primary data saved (39203 records). [2025-10-07T22:33:28.913777] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-07T22:33:28.913869] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 40.3s. Estimated remaining: 42.3s. Rate: 7.1 symbols/min [2025-10-07T22:33:29.091381] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:33:29.128993] [DEBUG] [LOCAL ] ZVIA: Loaded 35380 existing records from primary storage. [2025-10-07T22:33:29.129282] [INFO ] [MAIN ] ZVIA: Loaded 35380 existing records. [2025-10-07T22:33:29.305253] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:33:29.305553] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-07T22:33:29.305608] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-07T22:33:29.305846] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-07T22:33:29.305903] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-07T22:33:29.452814] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-07T22:33:29.658639] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:33:30.247719] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-07T22:33:30.551199] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-07T22:33:31.025906] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-07T22:33:31.027764] [INFO ] [REMOTE ] ZTR: Full fetch complete (27014 records). [2025-10-07T22:33:31.027837] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-07T22:33:31.057127] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-07T22:33:31.429664] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-07T22:33:31.429958] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-07T22:33:31.430706] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-07T22:33:31.430817] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-07T22:33:31.449007] [DEBUG] [LOCAL ] ZTR: Trimmed 27014 records to 16783 (keeping 200 days of data) [2025-10-07T22:33:31.463431] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-07T22:33:31.574970] [DEBUG] [LOCAL ] ZTR: Primary data saved (16783 records). [2025-10-07T22:33:31.575108] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-07T22:33:31.575203] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTR took 26.1s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-07T22:33:31.745852] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-29 to 2025-10-07. [2025-10-07T22:33:31.787012] [DEBUG] [LOCAL ] ZWS: Loaded 42305 existing records from primary storage. [2025-10-07T22:33:31.787389] [INFO ] [MAIN ] ZWS: Loaded 42305 existing records. [2025-10-07T22:33:31.852778] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-07T22:33:31.968388] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-20, but need from 2024-12-18 for 200 day retention. Performing full refresh. [2025-10-07T22:33:31.968772] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-07T22:33:31.968842] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-07T22:33:31.969093] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-07T22:33:31.969175] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-07T22:33:32.322753] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-18 to 2025-10-07 (requires 11 months of data pull). [2025-10-07T22:33:32.614800] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-07T22:33:32.647598] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-07T22:33:33.447685] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-07T22:33:33.561981] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T22:33:34.157713] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-07T22:33:34.247611] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-07T22:33:35.047638] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-07T22:33:35.354354] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-07T22:33:35.357708] [INFO ] [REMOTE ] ZTO: Full fetch complete (72766 records). [2025-10-07T22:33:35.357829] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-07T22:33:35.768666] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-07T22:33:35.786485] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-07T22:33:35.800415] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-07T22:33:35.800768] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-07T22:33:35.803144] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-07T22:33:35.815514] [DEBUG] [LOCAL ] ZTO: Trimmed 72766 records to 49596 (keeping 200 days of data) [2025-10-07T22:33:35.874465] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-07T22:33:36.133361] [DEBUG] [LOCAL ] ZTO: Primary data saved (49596 records). [2025-10-07T22:33:36.133496] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-07T22:33:36.133578] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTO took 42.9s. Estimated remaining: 25.4s. Rate: 7.1 symbols/min [2025-10-07T22:33:36.414188] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-07T22:33:36.647766] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-07T22:33:37.447625] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-07T22:33:37.565381] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-07T22:33:38.030245] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-07T22:33:38.247680] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-07T22:33:38.925853] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-07T22:33:39.047611] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-07T22:33:39.847716] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-07T22:33:40.069287] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-07T22:33:40.171581] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-07T22:33:40.647695] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-07T22:33:41.121615] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-07T22:33:41.447631] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-07T22:33:42.247618] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-07T22:33:42.434633] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-07T22:33:42.957478] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-07T22:33:43.047671] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-07T22:33:43.332873] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-07T22:33:43.847674] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-07T22:33:44.647684] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-07T22:33:45.022723] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-07T22:33:45.363964] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-07T22:33:45.447628] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-07T22:33:46.010371] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-07T22:33:46.247679] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-07T22:33:46.908431] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-07T22:33:47.047624] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-07T22:33:47.847775] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-07T22:33:47.972259] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-07T22:33:48.162452] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-07T22:33:48.647706] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-07T22:33:49.447620] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-07T22:33:50.064169] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-07T22:33:50.175141] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-07T22:33:50.247601] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-07T22:33:50.894632] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-07T22:33:51.047614] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-07T22:33:51.579820] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-07T22:33:51.847730] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-07T22:33:52.647714] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-07T22:33:52.759350] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-07T22:33:53.454784] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-07T22:33:53.458400] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-07T22:33:53.663089] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-07T22:33:53.666237] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52726 records). [2025-10-07T22:33:53.666399] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-07T22:33:54.068511] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-07T22:33:54.068820] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-07T22:33:54.072534] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-07T22:33:54.073627] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-07T22:33:54.073888] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-07T22:33:54.074407] [INFO ] [REMOTE ] ZTS: Full fetch complete (76718 records). [2025-10-07T22:33:54.074962] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-07T22:33:54.109057] [DEBUG] [LOCAL ] ZVIA: Trimmed 52726 records to 35376 (keeping 200 days of data) [2025-10-07T22:33:54.256006] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-07T22:33:54.588396] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-07T22:33:54.588818] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-07T22:33:54.591091] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-07T22:33:54.591947] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-07T22:33:54.597670] [DEBUG] [LOCAL ] ZTS: Trimmed 76718 records to 53058 (keeping 200 days of data) [2025-10-07T22:33:54.844896] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35376 records). [2025-10-07T22:33:54.845511] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-07T22:33:54.845971] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZVIA took 25.9s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-07T22:33:55.058458] [DEBUG] [LOCAL ] ZTS: Primary data saved (53058 records). [2025-10-07T22:33:55.058611] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-07T22:33:55.059690] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZTS took 36.7s. Estimated remaining: 8.5s. Rate: 7.1 symbols/min [2025-10-07T22:33:55.936771] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-07T22:33:55.948779] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-07T22:33:57.517220] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-07T22:33:57.527182] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-07T22:33:58.771788] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-07T22:33:58.774920] [INFO ] [REMOTE ] ZWS: Full fetch complete (62063 records). [2025-10-07T22:33:58.775017] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-07T22:33:59.157796] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-07T22:33:59.157898] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-07T22:33:59.158958] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-07T22:33:59.159023] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-07T22:33:59.160532] [DEBUG] [LOCAL ] ZWS: Trimmed 62063 records to 42335 (keeping 200 days of data) [2025-10-07T22:33:59.423208] [DEBUG] [LOCAL ] ZWS: Primary data saved (42335 records). [2025-10-07T22:33:59.423342] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-07T22:33:59.423441] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 27.8s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-07T22:33:59.424566] [INFO ] [MAIN ] Parallel update completed in 5h 33m 55s [2025-10-07T22:33:59.424741] [WARN ] [MAIN ] Failed symbols (623): AAMI, AAM, AAUC, ABCB, ACCO, ACI, ACN, ACP, AD, ACRE... [2025-10-07T22:33:59.424818] [INFO ] [MAIN ] Update success rate: 73.7% (1748/2371 symbols) [2025-10-07T22:34:00.081589] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1748/2371 @ 73.72%)' [2025-10-07T22:34:00.082136] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-07T22:34:00.082195] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-07T22:34:00.082230] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-07T22:34:00.082327] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-07T22:34:00.082364] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-07T22:34:01.145152] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-07T22:34:01.145496] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-07T22:34:01.145751] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-07T22:34:01.146368] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-07T22:34:01.146485] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-07T22:34:01.146553] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-07T22:34:01.146675] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-07T22:34:01.146787] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-07T22:34:01.146849] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-07T22:34:01.147368] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-07T22:34:01.147455] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-07T22:34:01.147760] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-07T22:34:01.147853] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-07T22:34:01.147922] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-07T22:34:01.148000] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-07T22:34:01.170546] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-07T22:34:01.191887] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-07T22:34:01.191951] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-07T22:34:01.191986] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-07T22:34:01.192053] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-07T22:34:01.192130] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-07T22:34:01.192165] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-07T22:34:01.192201] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-07T22:34:01.193268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-07T22:34:01.193464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-07T22:34:01.193693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-07T22:34:01.193863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-07T22:34:01.194026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-07T22:34:01.194214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-07T22:34:01.194373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-07T22:34:01.194561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-07T22:34:01.194761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-07T22:34:01.194954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-07T22:34:01.195108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-07T22:34:01.195287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-07T22:34:01.195461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-07T22:34:01.195683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-07T22:34:01.195862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-07T22:34:01.196019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-07T22:34:01.196177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-07T22:34:01.196329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-07T22:34:01.200159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-07T22:34:01.200382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-07T22:34:01.200563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-07T22:34:01.200726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-07T22:34:01.200881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-07T22:34:01.201042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-07T22:34:01.201192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-07T22:34:01.201336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-07T22:34:01.201475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-07T22:34:01.201599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-07T22:34:01.201777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-07T22:34:01.201932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-07T22:34:01.202080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-07T22:34:01.202225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-07T22:34:01.202409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-07T22:34:01.202592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-07T22:34:01.202775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-07T22:34:01.202962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-07T22:34:01.203101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-07T22:34:01.203257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-07T22:34:01.203440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-07T22:34:01.203601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-07T22:34:01.203790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-07T22:34:01.203907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-07T22:34:01.204058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-07T22:34:01.204170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-07T22:34:01.204311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-07T22:34:01.204429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-07T22:34:01.204584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-07T22:34:01.204774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-07T22:34:01.204913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-07T22:34:01.205051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-07T22:34:01.205170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-07T22:34:01.205315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-07T22:34:01.205481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-07T22:34:01.205636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-07T22:34:01.205849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-07T22:34:01.206018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-07T22:34:01.206213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-07T22:34:01.206411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-07T22:34:01.206597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-07T22:34:01.206779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-07T22:34:01.206976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-07T22:34:01.207189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-07T22:34:01.207344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-07T22:34:01.207497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-07T22:34:01.207724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-07T22:34:01.207913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-07T22:34:01.208075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-07T22:34:01.208250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-07T22:34:01.208441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-07T22:34:01.208602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-07T22:34:01.208820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-07T22:34:01.208956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-07T22:34:01.209099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-07T22:34:01.209324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-07T22:34:01.209521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-10-07T22:34:01.209755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-07T22:34:01.209925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-07T22:34:01.210130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-07T22:34:01.210319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-07T22:34:01.210498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-07T22:34:01.210689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-07T22:34:01.210866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-07T22:34:01.211031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-07T22:34:01.211203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-07T22:34:01.211359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-07T22:34:01.211460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-07T22:34:01.211582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-07T22:34:01.211758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-07T22:34:01.211913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-07T22:34:01.212060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-07T22:34:01.212150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-07T22:34:01.212281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-07T22:34:01.212405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-07T22:34:01.212536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-07T22:34:01.212753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-07T22:34:01.212889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-07T22:34:01.212995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-07T22:34:01.213138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-07T22:34:01.213275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-07T22:34:01.213433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-07T22:34:01.213583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-07T22:34:01.213753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-07T22:34:01.213874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-07T22:34:01.214000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-07T22:34:01.214149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-07T22:34:01.214285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-07T22:34:01.214402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-07T22:34:01.214506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-07T22:34:01.214612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-07T22:34:01.214748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-07T22:34:01.214916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-07T22:34:01.215059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-07T22:34:01.215184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-07T22:34:01.215322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-07T22:34:01.215439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-07T22:34:01.215558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-07T22:34:01.215728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-07T22:34:01.215841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-07T22:34:01.215996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-07T22:34:01.216130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-07T22:34:01.216243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-07T22:34:01.216367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-07T22:34:01.216504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-07T22:34:01.216630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-07T22:34:01.216795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-07T22:34:01.216951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-07T22:34:01.217123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-07T22:34:01.217314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-07T22:34:01.217490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-07T22:34:01.217702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-07T22:34:01.217882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-07T22:34:01.218067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-07T22:34:01.218206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-07T22:34:01.218347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-07T22:34:01.218492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-07T22:34:01.218639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-07T22:34:01.218838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-07T22:34:01.219001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-07T22:34:01.219129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-07T22:34:01.219289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-07T22:34:01.219453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-07T22:34:01.219624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-07T22:34:01.219827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-07T22:34:01.220009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-07T22:34:01.220204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-07T22:34:01.220392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-07T22:34:01.220528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-07T22:34:01.220846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-07T22:34:01.220986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-07T22:34:01.221155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-07T22:34:01.221314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-07T22:34:01.221440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-07T22:34:01.221558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-07T22:34:01.221721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-07T22:34:01.221884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-07T22:34:01.222014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-07T22:34:01.222104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-07T22:34:01.222208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-07T22:34:01.222325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-07T22:34:01.222445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-07T22:34:01.222563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-07T22:34:01.222699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-07T22:34:01.222817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-07T22:34:01.222928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-07T22:34:01.223183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-07T22:34:01.223317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-07T22:34:01.223432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-07T22:34:01.223545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-07T22:34:01.223691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-07T22:34:01.223806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-07T22:34:01.223922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-07T22:34:01.224045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-07T22:34:01.224177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-07T22:34:01.224304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-07T22:34:01.224432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-07T22:34:01.224560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-07T22:34:01.224702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-07T22:34:01.224820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-07T22:34:01.224943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-07T22:34:01.225074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-07T22:34:01.225205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-07T22:34:01.225319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-07T22:34:01.225443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-07T22:34:01.225577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-07T22:34:01.225726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-07T22:34:01.225844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-07T22:34:01.225955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-07T22:34:01.226083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-07T22:34:01.226195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-07T22:34:01.226308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-07T22:34:01.226461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-07T22:34:01.226611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-07T22:34:01.226772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-07T22:34:01.226918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-07T22:34:01.227034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-07T22:34:01.227172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-07T22:34:01.227346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-07T22:34:01.227518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-07T22:34:01.227693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-07T22:34:01.227835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-07T22:34:01.227968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-10-07T22:34:01.228111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-07T22:34:01.228281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-07T22:34:01.228444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-07T22:34:01.228617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-07T22:34:01.228788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-07T22:34:01.228983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-07T22:34:01.229153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-07T22:34:01.229296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-07T22:34:01.229467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-07T22:34:01.229608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-07T22:34:01.229969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-07T22:34:01.230104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-07T22:34:01.230270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-07T22:34:01.230445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-07T22:34:01.230593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-07T22:34:01.230801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-07T22:34:01.230939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-07T22:34:01.231112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-07T22:34:01.231271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-07T22:34:01.231426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-07T22:34:01.231561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-07T22:34:01.231727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-07T22:34:01.231864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-07T22:34:01.231987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-10-07T22:34:01.232096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-07T22:34:01.232246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-07T22:34:01.232339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-07T22:34:01.232438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-07T22:34:01.232561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-07T22:34:01.232687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-07T22:34:01.232820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-07T22:34:01.232962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-07T22:34:01.233098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-07T22:34:01.233222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-07T22:34:01.233346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-07T22:34:01.233457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-07T22:34:01.233597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-07T22:34:01.233761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-07T22:34:01.233898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-07T22:34:01.234013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-07T22:34:01.234133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-07T22:34:01.234253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-07T22:34:01.234372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-07T22:34:01.234476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-07T22:34:01.234613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-07T22:34:01.234734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-07T22:34:01.234834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-07T22:34:01.234940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-07T22:34:01.235061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-07T22:34:01.235186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-07T22:34:01.235331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-07T22:34:01.235427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-07T22:34:01.235527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-07T22:34:01.235703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-07T22:34:01.235816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-07T22:34:01.235934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-07T22:34:01.236027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-07T22:34:01.236120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-07T22:34:01.236229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-07T22:34:01.236333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-07T22:34:01.236454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-07T22:34:01.236575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-07T22:34:01.236843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-07T22:34:01.236987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-07T22:34:01.237106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-07T22:34:01.237225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-07T22:34:01.237372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-07T22:34:01.237524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-07T22:34:01.237705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-07T22:34:01.237869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-07T22:34:01.238039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-07T22:34:01.238215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-07T22:34:01.238381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-07T22:34:01.238551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-07T22:34:01.238743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-07T22:34:01.238899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-07T22:34:01.239038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-07T22:34:01.239174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-07T22:34:01.239321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-07T22:34:01.239481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-07T22:34:01.239633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-07T22:34:01.239834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-07T22:34:01.239989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-07T22:34:01.240130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-07T22:34:01.240288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-07T22:34:01.240453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-07T22:34:01.240586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-07T22:34:01.240776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-07T22:34:01.240923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-07T22:34:01.241082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-07T22:34:01.241230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-07T22:34:01.241365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-07T22:34:01.241517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-07T22:34:01.241677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-07T22:34:01.241810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-07T22:34:01.241915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-07T22:34:01.242031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-07T22:34:01.242157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-07T22:34:01.242276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-07T22:34:01.242405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-07T22:34:01.242514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-07T22:34:01.242635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-07T22:34:01.242775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-07T22:34:01.242864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-07T22:34:01.242930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-07T22:34:01.243026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-10-07T22:34:01.243148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-07T22:34:01.243286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-07T22:34:01.243397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-07T22:34:01.243505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-07T22:34:01.243628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-07T22:34:01.243773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-07T22:34:01.243866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-07T22:34:01.243946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-07T22:34:01.244049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-07T22:34:01.244159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-07T22:34:01.244249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-07T22:34:01.244345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-07T22:34:01.244471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-07T22:34:01.244610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-07T22:34:01.244790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-10-07T22:34:01.244886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-07T22:34:01.244991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-07T22:34:01.245101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-07T22:34:01.245202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-07T22:34:01.245304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-07T22:34:01.245412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-07T22:34:01.245515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-07T22:34:01.245619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-07T22:34:01.245770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-07T22:34:01.245893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-07T22:34:01.245983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-07T22:34:01.246074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-07T22:34:01.246196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-07T22:34:01.246302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-07T22:34:01.246415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-07T22:34:01.246546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-07T22:34:01.246731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-07T22:34:01.246880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-07T22:34:01.247077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-07T22:34:01.247203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-07T22:34:01.247343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-07T22:34:01.247471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-07T22:34:01.247599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-07T22:34:01.247769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-07T22:34:01.247923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-07T22:34:01.248055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-07T22:34:01.248212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-07T22:34:01.248359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-07T22:34:01.248544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-07T22:34:01.248821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-07T22:34:01.248963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-07T22:34:01.249107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-07T22:34:01.249249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-07T22:34:01.249386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-07T22:34:01.249527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-07T22:34:01.249681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-07T22:34:01.249845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-07T22:34:01.249985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-07T22:34:01.250119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-07T22:34:01.250257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-07T22:34:01.250396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-07T22:34:01.250534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-07T22:34:01.250687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-07T22:34:01.250797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-07T22:34:01.250923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-07T22:34:01.251034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-07T22:34:01.251145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-07T22:34:01.251256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-07T22:34:01.251366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-07T22:34:01.251456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-07T22:34:01.251552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-07T22:34:01.251699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-07T22:34:01.251793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-07T22:34:01.251877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-07T22:34:01.251991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-07T22:34:01.252097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-07T22:34:01.252267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-07T22:34:01.252425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-07T22:34:01.252518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-07T22:34:01.252588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-07T22:34:01.252693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-07T22:34:01.252808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-07T22:34:01.252922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-07T22:34:01.253033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-07T22:34:01.253143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-07T22:34:01.253307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-07T22:34:01.253413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-07T22:34:01.253520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-07T22:34:01.253628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-07T22:34:01.253746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-07T22:34:01.253844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-07T22:34:01.253963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-07T22:34:01.254060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-07T22:34:01.254153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-07T22:34:01.254273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-07T22:34:01.254388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-07T22:34:01.254503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-07T22:34:01.254594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-07T22:34:01.254727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-07T22:34:01.254836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-07T22:34:01.254948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-07T22:34:01.255051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-07T22:34:01.255152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-10-07T22:34:01.255272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-07T22:34:01.255375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-07T22:34:01.255483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-10-07T22:34:01.255573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-07T22:34:01.255741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-07T22:34:01.255881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-07T22:34:01.256017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-07T22:34:01.256162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-07T22:34:01.256319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-07T22:34:01.256494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-07T22:34:01.256633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-07T22:34:01.256878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-10-07T22:34:01.257041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-07T22:34:01.257204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-07T22:34:01.257340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-10-07T22:34:01.257492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-07T22:34:01.257634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-07T22:34:01.257867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-07T22:34:01.258038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-07T22:34:01.258270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-07T22:34:01.258410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-07T22:34:01.258540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-07T22:34:01.258716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-07T22:34:01.258867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-07T22:34:01.258982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-07T22:34:01.259102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-07T22:34:01.259243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-07T22:34:01.259378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-07T22:34:01.259504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-07T22:34:01.259682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-07T22:34:01.259831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-07T22:34:01.259937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-07T22:34:01.260025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-07T22:34:01.260105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-07T22:34:01.260238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-07T22:34:01.260342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-07T22:34:01.260433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-07T22:34:01.260513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-07T22:34:01.260624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-07T22:34:01.260780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-07T22:34:01.260883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-07T22:34:01.260983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-07T22:34:01.261107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-07T22:34:01.261195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-07T22:34:01.261284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-07T22:34:01.261372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-07T22:34:01.261456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-07T22:34:01.261545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-07T22:34:01.261622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-07T22:34:01.261752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-07T22:34:01.261882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-07T22:34:01.262001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-07T22:34:01.262117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-07T22:34:01.262207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-07T22:34:01.262288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-07T22:34:01.262409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-07T22:34:01.262545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-07T22:34:01.262673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-07T22:34:01.262780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-07T22:34:01.262868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-07T22:34:01.262952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-07T22:34:01.263059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-07T22:34:01.263149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-07T22:34:01.263236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-07T22:34:01.263326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-07T22:34:01.263405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-07T22:34:01.263543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-07T22:34:01.263683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-07T22:34:01.263810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-07T22:34:01.263911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-07T22:34:01.264013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-07T22:34:01.264109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-07T22:34:01.264218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-07T22:34:01.264356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-07T22:34:01.264444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-07T22:34:01.264590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-07T22:34:01.264780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-07T22:34:01.264920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-10-07T22:34:01.265079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-07T22:34:01.265212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-07T22:34:01.265342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-07T22:34:01.265485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-07T22:34:01.265621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-07T22:34:01.265813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-07T22:34:01.265938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-07T22:34:01.266077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-07T22:34:01.266203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-07T22:34:01.266357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-07T22:34:01.266538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-07T22:34:01.266727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-07T22:34:01.266877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-07T22:34:01.266997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-07T22:34:01.267155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-07T22:34:01.267288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-07T22:34:01.267417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-07T22:34:01.267566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-07T22:34:01.267719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-07T22:34:01.267853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-07T22:34:01.268014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-07T22:34:01.268164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-07T22:34:01.268303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-07T22:34:01.268432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-07T22:34:01.268565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-07T22:34:01.268846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-07T22:34:01.268947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-07T22:34:01.269059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-07T22:34:01.269164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-07T22:34:01.269268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-07T22:34:01.269373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-07T22:34:01.269463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-07T22:34:01.269545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-07T22:34:01.269672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-07T22:34:01.269769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-07T22:34:01.269849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-07T22:34:01.269960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-07T22:34:01.270071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-07T22:34:01.270175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-07T22:34:01.270266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-07T22:34:01.270353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-07T22:34:01.270468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-07T22:34:01.270560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-07T22:34:01.270626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-07T22:34:01.270735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-07T22:34:01.270834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-07T22:34:01.270939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-07T22:34:01.271039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-07T22:34:01.271162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-07T22:34:01.271253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-07T22:34:01.271333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-07T22:34:01.271429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-07T22:34:01.271597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-07T22:34:01.271727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-07T22:34:01.271829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-07T22:34:01.271916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-07T22:34:01.272006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-07T22:34:01.272110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-07T22:34:01.272212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-07T22:34:01.272312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-07T22:34:01.272417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-07T22:34:01.272526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-07T22:34:01.272635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-07T22:34:01.272862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-07T22:34:01.272965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-07T22:34:01.273054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-07T22:34:01.273164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-07T22:34:01.273257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-07T22:34:01.273416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-07T22:34:01.273561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-07T22:34:01.273726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-07T22:34:01.273886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-07T22:34:01.274011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-07T22:34:01.274146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-07T22:34:01.274283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-07T22:34:01.274399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-07T22:34:01.274554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-07T22:34:01.274731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-07T22:34:01.274856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-07T22:34:01.274998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-07T22:34:01.275115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-07T22:34:01.275274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-07T22:34:01.275435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-07T22:34:01.275581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-07T22:34:01.275736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-07T22:34:01.275860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-07T22:34:01.276016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-07T22:34:01.276144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-07T22:34:01.276273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-07T22:34:01.276404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-07T22:34:01.276559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-07T22:34:01.276703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-07T22:34:01.276835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-07T22:34:01.276954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-07T22:34:01.277072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-07T22:34:01.277161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-07T22:34:01.277240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-07T22:34:01.277340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-07T22:34:01.277449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-07T22:34:01.277557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-07T22:34:01.277702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-07T22:34:01.277808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-07T22:34:01.277895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-07T22:34:01.277974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-07T22:34:01.278088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-07T22:34:01.278190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-07T22:34:01.278301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-07T22:34:01.278411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-07T22:34:01.278499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-07T22:34:01.278593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-07T22:34:01.278717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-07T22:34:01.278829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-07T22:34:01.278920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-07T22:34:01.278989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-07T22:34:01.279076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-07T22:34:01.279181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-07T22:34:01.279291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-07T22:34:01.279383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-07T22:34:01.279450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-07T22:34:01.279514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-07T22:34:01.279574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-07T22:34:01.279635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-07T22:34:01.279757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-07T22:34:01.279854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-07T22:34:01.279956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-07T22:34:01.280080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-07T22:34:01.280172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-07T22:34:01.280236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-07T22:34:01.280316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-07T22:34:01.280405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-07T22:34:01.280472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-07T22:34:01.280546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-07T22:34:01.280698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-07T22:34:01.280808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-07T22:34:01.280945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-07T22:34:01.281037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-07T22:34:01.281134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-07T22:34:01.281238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-07T22:34:01.281325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-07T22:34:01.281468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-07T22:34:01.281594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-07T22:34:01.281749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-07T22:34:01.281889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-07T22:34:01.282003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-07T22:34:01.282124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-07T22:34:01.282224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-07T22:34:01.282456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-07T22:34:01.282581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-07T22:34:01.282714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-07T22:34:01.282847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-07T22:34:01.283010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-07T22:34:01.283138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-07T22:34:01.283254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-07T22:34:01.283369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-07T22:34:01.283519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-07T22:34:01.283636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-07T22:34:01.283792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-07T22:34:01.283959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-07T22:34:01.284089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-07T22:34:01.284215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-07T22:34:01.284353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-07T22:34:01.284487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-07T22:34:01.284619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-07T22:34:01.284801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-07T22:34:01.284908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-07T22:34:01.285003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-07T22:34:01.285113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-07T22:34:01.285221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-07T22:34:01.285333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-07T22:34:01.285434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-07T22:34:01.285524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-07T22:34:01.285604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-07T22:34:01.285788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-07T22:34:01.285869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-07T22:34:01.285956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-07T22:34:01.286059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-07T22:34:01.286161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-07T22:34:01.286271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-07T22:34:01.286367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-07T22:34:01.286451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-07T22:34:01.286545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-10-07T22:34:01.286612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-07T22:34:01.286708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-07T22:34:01.286815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-07T22:34:01.286903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-07T22:34:01.286984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-07T22:34:01.287073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-07T22:34:01.287137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-07T22:34:01.287198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-07T22:34:01.287262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-07T22:34:01.287325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-07T22:34:01.287386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-07T22:34:01.287447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-07T22:34:01.287519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-07T22:34:01.287622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-07T22:34:01.287771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-07T22:34:01.287861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-07T22:34:01.287940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-07T22:34:01.288028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-07T22:34:01.288091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-07T22:34:01.288152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-07T22:34:01.288234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-07T22:34:01.288322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-07T22:34:01.288408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-07T22:34:01.288510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-07T22:34:01.288609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-07T22:34:01.288731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-07T22:34:01.288821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-07T22:34:01.288925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-07T22:34:01.289042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-07T22:34:01.289178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-07T22:34:01.289297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-07T22:34:01.289437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-07T22:34:01.289575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-07T22:34:01.289741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-07T22:34:01.289898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-07T22:34:01.290023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-07T22:34:01.290153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-07T22:34:01.290298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-07T22:34:01.290438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-07T22:34:01.290563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-07T22:34:01.290717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-07T22:34:01.290848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-07T22:34:01.290969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-07T22:34:01.291073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-07T22:34:01.291192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-07T22:34:01.291318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-07T22:34:01.291450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-07T22:34:01.291578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-07T22:34:01.291722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-07T22:34:01.291847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-07T22:34:01.291985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-07T22:34:01.292103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-07T22:34:01.292205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-07T22:34:01.292334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-07T22:34:01.292454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-07T22:34:01.292547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-07T22:34:01.292616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-07T22:34:01.292798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-07T22:34:01.292889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-07T22:34:01.292958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-07T22:34:01.293019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-07T22:34:01.293086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-07T22:34:01.293159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-07T22:34:01.293255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-07T22:34:01.293344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-07T22:34:01.293419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-07T22:34:01.293485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-07T22:34:01.293549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-07T22:34:01.293626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-07T22:34:01.293747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-07T22:34:01.293832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-07T22:34:01.293913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-07T22:34:01.294015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-07T22:34:01.294106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-07T22:34:01.294186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-07T22:34:01.294304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-07T22:34:01.294409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-07T22:34:01.294504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-07T22:34:01.294571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-07T22:34:01.294635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-07T22:34:01.294747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-07T22:34:01.294817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-07T22:34:01.294897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-07T22:34:01.294987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-07T22:34:01.295053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-07T22:34:01.295118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-07T22:34:01.295183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-07T22:34:01.295267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-07T22:34:01.295358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-07T22:34:01.295445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-07T22:34:01.295536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-07T22:34:01.295612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-07T22:34:01.295740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-07T22:34:01.295819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-07T22:34:01.295885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-07T22:34:01.295976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-07T22:34:01.296100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-07T22:34:01.296187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-07T22:34:01.296252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-07T22:34:01.296329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-07T22:34:01.296521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-07T22:34:01.296676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-07T22:34:01.296819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-07T22:34:01.296953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-07T22:34:01.297066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-07T22:34:01.297191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-07T22:34:01.297340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-07T22:34:01.297486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-07T22:34:01.297604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-07T22:34:01.297762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-07T22:34:01.297877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-07T22:34:01.297989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-07T22:34:01.298111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-07T22:34:01.298216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-07T22:34:01.298312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-07T22:34:01.298443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-07T22:34:01.298584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-07T22:34:01.298743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-07T22:34:01.298878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-07T22:34:01.298992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-07T22:34:01.299136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-07T22:34:01.299267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-07T22:34:01.299386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-07T22:34:01.299529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-07T22:34:01.299683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-07T22:34:01.299782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-07T22:34:01.299871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-07T22:34:01.299962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-07T22:34:01.300042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-07T22:34:01.300130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-07T22:34:01.300195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-07T22:34:01.300267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-07T22:34:01.300370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-07T22:34:01.300457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-07T22:34:01.300521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-07T22:34:01.300624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-07T22:34:01.300830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-07T22:34:01.300919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-07T22:34:01.301008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-07T22:34:01.301078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-07T22:34:01.301147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-07T22:34:01.301213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-07T22:34:01.301298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-07T22:34:01.301415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-07T22:34:01.301510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-07T22:34:01.301581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-07T22:34:01.301671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-07T22:34:01.301786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-07T22:34:01.301880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-07T22:34:01.301968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-07T22:34:01.302061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-07T22:34:01.302145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-07T22:34:01.302249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-07T22:34:01.302383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-07T22:34:01.302490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-07T22:34:01.302578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-10-07T22:34:01.302667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-07T22:34:01.302771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-07T22:34:01.302858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-07T22:34:01.302939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-07T22:34:01.303038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-07T22:34:01.303131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-07T22:34:01.303199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-07T22:34:01.303283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-07T22:34:01.303374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-07T22:34:01.303469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-07T22:34:01.303572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-07T22:34:01.303707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-07T22:34:01.303835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-07T22:34:01.303928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-07T22:34:01.304012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-07T22:34:01.304149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-07T22:34:01.304269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-07T22:34:01.304417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-07T22:34:01.304572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-07T22:34:01.304730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-07T22:34:01.304845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-07T22:34:01.304951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-07T22:34:01.305074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-07T22:34:01.305194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-07T22:34:01.305312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-07T22:34:01.305445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-07T22:34:01.305577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-07T22:34:01.305736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-07T22:34:01.305864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-07T22:34:01.305979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-07T22:34:01.306156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-07T22:34:01.306284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-07T22:34:01.306409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-07T22:34:01.306555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-07T22:34:01.306701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-07T22:34:01.306825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-07T22:34:01.306956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-07T22:34:01.307071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-07T22:34:01.307188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-07T22:34:01.307310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-07T22:34:01.307412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-07T22:34:01.307501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-07T22:34:01.307581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-07T22:34:01.307722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-07T22:34:01.307834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-07T22:34:01.307922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-07T22:34:01.307988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-07T22:34:01.308065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-07T22:34:01.308155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-07T22:34:01.308269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-07T22:34:01.308358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-07T22:34:01.308458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-07T22:34:01.308548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-07T22:34:01.308636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-07T22:34:01.308887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-07T22:34:01.309012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-07T22:34:01.309101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-07T22:34:01.309166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-07T22:34:01.309229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-07T22:34:01.309290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-07T22:34:01.309353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-07T22:34:01.309432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-07T22:34:01.309519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-07T22:34:01.309581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-07T22:34:01.309665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-07T22:34:01.309760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-07T22:34:01.309825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-07T22:34:01.309902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-07T22:34:01.309990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-07T22:34:01.310070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-07T22:34:01.310134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-07T22:34:01.310196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-07T22:34:01.310255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-07T22:34:01.310315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-07T22:34:01.310375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-07T22:34:01.310437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-07T22:34:01.310511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-07T22:34:01.310599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-07T22:34:01.310689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-07T22:34:01.310797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-07T22:34:01.310899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-07T22:34:01.310987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-07T22:34:01.311050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-07T22:34:01.311136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-07T22:34:01.311224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-07T22:34:01.311289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-07T22:34:01.311417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-07T22:34:01.311551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-07T22:34:01.311704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-07T22:34:01.311838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-07T22:34:01.311958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-07T22:34:01.312077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-07T22:34:01.312215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-07T22:34:01.312378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-07T22:34:01.312502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-07T22:34:01.312615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-07T22:34:01.312819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-07T22:34:01.312945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-07T22:34:01.313067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-07T22:34:01.313188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-07T22:34:01.313314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-07T22:34:01.313431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-07T22:34:01.313547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-07T22:34:01.313707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-07T22:34:01.313839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-07T22:34:01.313958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-07T22:34:01.314084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-07T22:34:01.314201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-07T22:34:01.314329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-07T22:34:01.314448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-07T22:34:01.314551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-07T22:34:01.314638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-07T22:34:01.314774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-07T22:34:01.314844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-07T22:34:01.314906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-07T22:34:01.314972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-07T22:34:01.315036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-07T22:34:01.315102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-07T22:34:01.315190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-07T22:34:01.315285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-07T22:34:01.315365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-07T22:34:01.315456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-07T22:34:01.315536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-07T22:34:01.315626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-10-07T22:34:01.315765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-07T22:34:01.315857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-07T22:34:01.315923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-07T22:34:01.316012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-07T22:34:01.316116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-07T22:34:01.316205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-07T22:34:01.316271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-07T22:34:01.316336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-07T22:34:01.316465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-07T22:34:01.316565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-07T22:34:01.316632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-07T22:34:01.316851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-07T22:34:01.316928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-07T22:34:01.316993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-07T22:34:01.317070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-07T22:34:01.317160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-07T22:34:01.317228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-07T22:34:01.317322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-07T22:34:01.317412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-07T22:34:01.317478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-07T22:34:01.317542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-07T22:34:01.317604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-07T22:34:01.317699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-07T22:34:01.317820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-07T22:34:01.317912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-07T22:34:01.317978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-07T22:34:01.318043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-07T22:34:01.318105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-07T22:34:01.318180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-07T22:34:01.318291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-07T22:34:01.318384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-07T22:34:01.318452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-07T22:34:01.318540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-07T22:34:01.318716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-07T22:34:01.318845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-07T22:34:01.318965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-07T22:34:01.319067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-07T22:34:01.319201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-07T22:34:01.319319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-07T22:34:01.319455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-07T22:34:01.319579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-07T22:34:01.319733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-07T22:34:01.319851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-07T22:34:01.319971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-07T22:34:01.320088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-07T22:34:01.320232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-07T22:34:01.320388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-07T22:34:01.320506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-07T22:34:01.320618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-07T22:34:01.320886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-07T22:34:01.321007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-07T22:34:01.321126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-07T22:34:01.321239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-07T22:34:01.321336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-07T22:34:01.321449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-07T22:34:01.321568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-07T22:34:01.321719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-07T22:34:01.321808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-07T22:34:01.321896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-07T22:34:01.321985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-07T22:34:01.322064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-07T22:34:01.322152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-07T22:34:01.322216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-07T22:34:01.322278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-07T22:34:01.322339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-07T22:34:01.322420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-07T22:34:01.322508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-07T22:34:01.322675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-07T22:34:01.322778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-07T22:34:01.322873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-07T22:34:01.322940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-07T22:34:01.323028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-07T22:34:01.323119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-07T22:34:01.323185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-07T22:34:01.323248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-07T22:34:01.323314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-07T22:34:01.323381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-07T22:34:01.323442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-07T22:34:01.323506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-07T22:34:01.323573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-07T22:34:01.323677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-07T22:34:01.323793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-07T22:34:01.323881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-07T22:34:01.323955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-07T22:34:01.324088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-07T22:34:01.324187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-07T22:34:01.324279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-07T22:34:01.324344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-07T22:34:01.324429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-07T22:34:01.324520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-07T22:34:01.324599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-07T22:34:01.324820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-07T22:34:01.324919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-07T22:34:01.325009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-07T22:34:01.325090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-07T22:34:01.325179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-07T22:34:01.325243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-07T22:34:01.325309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-07T22:34:01.325372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-07T22:34:01.325475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-07T22:34:01.325565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-07T22:34:01.325632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-07T22:34:01.325754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-07T22:34:01.325847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-07T22:34:01.325982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-07T22:34:01.326110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-07T22:34:01.326226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-07T22:34:01.326343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-07T22:34:01.326513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-07T22:34:01.326628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-07T22:34:01.326783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-07T22:34:01.326911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-07T22:34:01.327033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-07T22:34:01.327148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-07T22:34:01.327250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-07T22:34:01.327369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-07T22:34:01.327491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-07T22:34:01.327630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-07T22:34:01.327786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-07T22:34:01.327890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-07T22:34:01.328015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-07T22:34:01.328134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-07T22:34:01.328282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-07T22:34:01.328411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-07T22:34:01.328531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-07T22:34:01.328742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-07T22:34:01.328851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-07T22:34:01.328927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-07T22:34:01.329001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-07T22:34:01.329080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-07T22:34:01.329169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-07T22:34:01.329237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-07T22:34:01.329301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-07T22:34:01.329365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-07T22:34:01.329443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-07T22:34:01.329545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-07T22:34:01.329636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-07T22:34:01.329775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-07T22:34:01.329863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-07T22:34:01.329929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-07T22:34:01.330000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-07T22:34:01.330092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-07T22:34:01.330160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-07T22:34:01.330223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-07T22:34:01.330307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-07T22:34:01.330398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-07T22:34:01.330479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-07T22:34:01.330567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-07T22:34:01.330632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-07T22:34:01.330743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-07T22:34:01.330834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-07T22:34:01.330939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-07T22:34:01.331050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-07T22:34:01.331151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-07T22:34:01.331243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-07T22:34:01.331307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-07T22:34:01.331383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-07T22:34:01.331472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-07T22:34:01.331549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-07T22:34:01.331672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-07T22:34:01.331802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-07T22:34:01.331891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-07T22:34:01.331970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-07T22:34:01.332072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-07T22:34:01.332210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-07T22:34:01.332300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-07T22:34:01.332416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-07T22:34:01.332522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-07T22:34:01.332633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-07T22:34:01.332762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-07T22:34:01.332854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-07T22:34:01.332921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-07T22:34:01.332984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-07T22:34:01.333046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-07T22:34:01.333107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-07T22:34:01.333228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-07T22:34:01.333351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-07T22:34:01.333478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-07T22:34:01.333588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-07T22:34:01.333714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-07T22:34:01.333842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-07T22:34:01.333982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-07T22:34:01.334104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-07T22:34:01.334223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-07T22:34:01.334345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-07T22:34:01.334463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-07T22:34:01.334560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-07T22:34:01.334718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-07T22:34:01.334850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-07T22:34:01.334967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-07T22:34:01.335083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-07T22:34:01.335191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-07T22:34:01.335314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-07T22:34:01.335424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-07T22:34:01.335529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-07T22:34:01.335677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-07T22:34:01.335814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-07T22:34:01.335941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-07T22:34:01.336049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-07T22:34:01.336168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-07T22:34:01.336254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-07T22:34:01.336324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-07T22:34:01.336392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-07T22:34:01.336491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-07T22:34:01.336580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-07T22:34:01.336737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-07T22:34:01.336858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-07T22:34:01.336952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-07T22:34:01.337024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-07T22:34:01.337090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-07T22:34:01.337171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-07T22:34:01.337263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-07T22:34:01.337348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-07T22:34:01.337443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-07T22:34:01.337536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-07T22:34:01.337662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-07T22:34:01.337759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-07T22:34:01.337841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-07T22:34:01.337930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-07T22:34:01.337997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-07T22:34:01.338072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-07T22:34:01.338179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-07T22:34:01.338289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-07T22:34:01.338385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-07T22:34:01.338469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-07T22:34:01.338576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-07T22:34:01.338704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-07T22:34:01.338797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-07T22:34:01.338923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-07T22:34:01.339031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-07T22:34:01.339122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-07T22:34:01.339210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-07T22:34:01.339315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-07T22:34:01.339406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-07T22:34:01.339473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-07T22:34:01.339538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-07T22:34:01.339600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-07T22:34:01.339758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-07T22:34:01.339858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-07T22:34:01.339928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-07T22:34:01.340009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-07T22:34:01.340101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-07T22:34:01.340168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-07T22:34:01.340234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-07T22:34:01.340297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-07T22:34:01.340375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-07T22:34:01.340516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-07T22:34:01.340638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-07T22:34:01.340790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-07T22:34:01.340904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-07T22:34:01.341035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-07T22:34:01.341150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-07T22:34:01.341252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-07T22:34:01.341386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-07T22:34:01.341518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-07T22:34:01.341667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-07T22:34:01.341790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-07T22:34:01.341888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-07T22:34:01.341986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-07T22:34:01.342082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-07T22:34:01.342195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-07T22:34:01.342336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-07T22:34:01.342461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-07T22:34:01.342581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-07T22:34:01.342715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-07T22:34:01.342828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-07T22:34:01.342927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-07T22:34:01.343024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-07T22:34:01.343119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-07T22:34:01.343216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-07T22:34:01.343317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-07T22:34:01.343402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-07T22:34:01.343468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-07T22:34:01.343549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-07T22:34:01.343637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-07T22:34:01.343799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-07T22:34:01.343883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-07T22:34:01.343950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-07T22:34:01.344028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-07T22:34:01.344119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-07T22:34:01.344184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-07T22:34:01.344249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-07T22:34:01.344313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-07T22:34:01.344405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-07T22:34:01.344471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-07T22:34:01.344535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-07T22:34:01.344597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-07T22:34:01.344745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-07T22:34:01.344837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-07T22:34:01.344921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-07T22:34:01.345024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-07T22:34:01.345115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-07T22:34:01.345181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-07T22:34:01.345244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-07T22:34:01.345309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-07T22:34:01.345391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-07T22:34:01.345502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-07T22:34:01.345602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-07T22:34:01.345724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-07T22:34:01.345804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-07T22:34:01.345884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-07T22:34:01.345973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-07T22:34:01.346039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-07T22:34:01.346102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-07T22:34:01.346165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-07T22:34:01.346229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-07T22:34:01.346311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-07T22:34:01.346399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-07T22:34:01.346506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-07T22:34:01.346589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-07T22:34:01.346684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-07T22:34:01.346774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-07T22:34:01.346843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-07T22:34:01.346920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-07T22:34:01.346986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-07T22:34:01.347054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-07T22:34:01.347133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-07T22:34:01.347289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-07T22:34:01.347402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-07T22:34:01.347498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-07T22:34:01.347593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-07T22:34:01.347734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-07T22:34:01.347846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-07T22:34:01.347963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-07T22:34:01.348094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-07T22:34:01.348210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-07T22:34:01.348308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-07T22:34:01.348409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-07T22:34:01.348505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-07T22:34:01.348601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-07T22:34:01.348736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-07T22:34:01.348849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-07T22:34:01.348950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-07T22:34:01.349061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-07T22:34:01.349175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-07T22:34:01.349317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-07T22:34:01.349490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-07T22:34:01.349606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-07T22:34:01.349741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-07T22:34:01.349855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-07T22:34:01.349955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-07T22:34:01.350023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-07T22:34:01.350090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-07T22:34:01.350155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-07T22:34:01.350221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-07T22:34:01.350301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-07T22:34:01.350415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-07T22:34:01.350508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-07T22:34:01.350575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-07T22:34:01.350671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-07T22:34:01.350778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-07T22:34:01.350847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-07T22:34:01.350944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-07T22:34:01.351027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-07T22:34:01.351093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-07T22:34:01.351176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-07T22:34:01.351281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-07T22:34:01.351374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-07T22:34:01.351441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-07T22:34:01.351506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-07T22:34:01.351569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-07T22:34:01.351634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-07T22:34:01.351779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-07T22:34:01.351882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-07T22:34:01.351972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-07T22:34:01.352039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-07T22:34:01.352105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-07T22:34:01.352180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-07T22:34:01.352298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-07T22:34:01.352392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-07T22:34:01.352475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-07T22:34:01.352573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-07T22:34:01.352757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-07T22:34:01.352871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-07T22:34:01.352966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-07T22:34:01.353033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-07T22:34:01.353096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-07T22:34:01.353176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-07T22:34:01.353265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-07T22:34:01.353333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-07T22:34:01.353412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-07T22:34:01.353515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-07T22:34:01.353606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-07T22:34:01.353705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-07T22:34:01.353793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-07T22:34:01.353883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-07T22:34:01.353987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-07T22:34:01.354076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-07T22:34:01.354224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-07T22:34:01.354340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-07T22:34:01.354489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-07T22:34:01.354605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-07T22:34:01.354741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-07T22:34:01.354859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-07T22:34:01.354979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-07T22:34:01.355094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-07T22:34:01.355200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-07T22:34:01.355343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-07T22:34:01.355471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-07T22:34:01.355589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-07T22:34:01.355738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-07T22:34:01.355896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-07T22:34:01.356045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-07T22:34:01.356192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-07T22:34:01.356350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-07T22:34:01.356508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-07T22:34:01.356662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-07T22:34:01.356786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-07T22:34:01.356883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-07T22:34:01.356990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-07T22:34:01.357128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-07T22:34:01.357251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-07T22:34:01.357374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-07T22:34:01.357494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-07T22:34:01.357593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-07T22:34:01.357854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-07T22:34:01.358019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-07T22:34:01.358120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-07T22:34:01.358189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-07T22:34:01.358271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-07T22:34:01.358362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-07T22:34:01.358430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-07T22:34:01.358493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-07T22:34:01.358565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-07T22:34:01.358712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-07T22:34:01.358826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-07T22:34:01.358917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-07T22:34:01.358986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-07T22:34:01.359091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-07T22:34:01.359185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-07T22:34:01.359254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-07T22:34:01.359323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-07T22:34:01.359384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-07T22:34:01.359448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-07T22:34:01.359513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-07T22:34:01.359577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-07T22:34:01.359676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-07T22:34:01.359775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-07T22:34:01.359844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-07T22:34:01.359923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-07T22:34:01.359991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-07T22:34:01.360076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-07T22:34:01.360166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-07T22:34:01.360234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-07T22:34:01.360299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-07T22:34:01.360377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-07T22:34:01.360467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-07T22:34:01.360562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-07T22:34:01.360804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-07T22:34:01.360904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-07T22:34:01.360971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-07T22:34:01.361034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-07T22:34:01.361099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-07T22:34:01.361166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-07T22:34:01.361232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-07T22:34:01.361295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-07T22:34:01.361359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-07T22:34:01.361422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-07T22:34:01.361486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-07T22:34:01.361603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-07T22:34:01.361745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-07T22:34:01.361868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-07T22:34:01.361982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-07T22:34:01.362097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-07T22:34:01.362209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-07T22:34:01.362331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-07T22:34:01.362474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-07T22:34:01.362588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-07T22:34:01.362715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-07T22:34:01.362834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-07T22:34:01.362931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-07T22:34:01.363029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-07T22:34:01.363125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-07T22:34:01.363237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-07T22:34:01.363338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-07T22:34:01.363434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-07T22:34:01.363536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-07T22:34:01.363637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-07T22:34:01.363796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-07T22:34:01.363910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-07T22:34:01.364009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-07T22:34:01.364104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-07T22:34:01.364204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-07T22:34:01.364302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-07T22:34:01.364383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-07T22:34:01.364475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-07T22:34:01.364541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-07T22:34:01.364620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-07T22:34:01.364857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-07T22:34:01.364932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-07T22:34:01.364999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-07T22:34:01.365065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-07T22:34:01.365139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-07T22:34:01.365233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-07T22:34:01.365299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-07T22:34:01.365363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-07T22:34:01.365450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-07T22:34:01.365539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-07T22:34:01.365605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-07T22:34:01.365701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-07T22:34:01.365842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-07T22:34:01.365936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-07T22:34:01.366004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-07T22:34:01.366067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-07T22:34:01.366138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-07T22:34:01.366203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-07T22:34:01.366266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-07T22:34:01.366329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-07T22:34:01.366392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-07T22:34:01.366493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-07T22:34:01.366587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-07T22:34:01.366687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-07T22:34:01.366795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-07T22:34:01.366888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-07T22:34:01.367016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-07T22:34:01.367110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-07T22:34:01.367178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-07T22:34:01.367245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-07T22:34:01.367311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-07T22:34:01.367377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-07T22:34:01.367444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-07T22:34:01.367529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-07T22:34:01.367623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-07T22:34:01.367742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-07T22:34:01.367834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-07T22:34:01.367926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-07T22:34:01.367996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-07T22:34:01.368060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-07T22:34:01.368125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-07T22:34:01.368187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-07T22:34:01.368319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-07T22:34:01.368436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-07T22:34:01.368536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-07T22:34:01.368660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-07T22:34:01.368808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-07T22:34:01.368925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-07T22:34:01.369023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-07T22:34:01.369120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-07T22:34:01.369234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-07T22:34:01.369364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-07T22:34:01.369482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-07T22:34:01.369579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-07T22:34:01.369738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-07T22:34:01.369848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-07T22:34:01.369969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-07T22:34:01.370078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-07T22:34:01.370273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-07T22:34:01.370404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-07T22:34:01.370518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-07T22:34:01.370638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-07T22:34:01.370781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-07T22:34:01.370881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-07T22:34:01.370981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-07T22:34:01.371070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-07T22:34:01.371136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-07T22:34:01.371216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-07T22:34:01.371307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-07T22:34:01.371388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-07T22:34:01.371478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-07T22:34:01.371546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-07T22:34:01.371631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-07T22:34:01.371776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-07T22:34:01.371868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-07T22:34:01.371935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-07T22:34:01.371999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-07T22:34:01.372064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-07T22:34:01.372129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-07T22:34:01.372210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-07T22:34:01.372299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-07T22:34:01.372364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-07T22:34:01.372428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-07T22:34:01.372493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-07T22:34:01.372573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-07T22:34:01.372765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-07T22:34:01.372856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-07T22:34:01.372934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-07T22:34:01.373028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-07T22:34:01.373095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-07T22:34:01.373161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-07T22:34:01.373242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-07T22:34:01.373330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-07T22:34:01.373403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-07T22:34:01.373493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-07T22:34:01.373587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-07T22:34:01.373691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-07T22:34:01.373791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-07T22:34:01.373857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-10-07T22:34:01.373938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-07T22:34:01.374026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-07T22:34:01.374092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-07T22:34:01.374156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-07T22:34:01.374235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-07T22:34:01.374324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-07T22:34:01.374389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-07T22:34:01.374454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-07T22:34:01.374518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-07T22:34:01.374584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-07T22:34:01.374672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-07T22:34:01.374769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-07T22:34:01.374836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-07T22:34:01.374916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-07T22:34:01.375046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-07T22:34:01.375159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-07T22:34:01.375263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-07T22:34:01.375359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-07T22:34:01.375458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-07T22:34:01.375596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-07T22:34:01.375778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-07T22:34:01.375914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-07T22:34:01.376037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-07T22:34:01.376157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-07T22:34:01.376276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-07T22:34:01.376375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-07T22:34:01.376507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-07T22:34:01.376674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-07T22:34:01.376795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-07T22:34:01.376897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-07T22:34:01.376998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-07T22:34:01.377096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-07T22:34:01.377226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-07T22:34:01.377349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-07T22:34:01.377475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-07T22:34:01.377583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-07T22:34:01.377707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-07T22:34:01.377825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-07T22:34:01.377912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-07T22:34:01.377979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-07T22:34:01.378046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-07T22:34:01.378127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-07T22:34:01.378219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-07T22:34:01.378289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-07T22:34:01.378354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-07T22:34:01.378419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-07T22:34:01.378484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-07T22:34:01.378548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-07T22:34:01.378630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-07T22:34:01.378765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-07T22:34:01.378855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-07T22:34:01.378946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-07T22:34:01.379015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-07T22:34:01.379080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-10-07T22:34:01.379145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-07T22:34:01.379224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-07T22:34:01.379332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-07T22:34:01.379422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-07T22:34:01.379489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-07T22:34:01.379572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-07T22:34:01.379703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-07T22:34:01.379815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-07T22:34:01.379910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-07T22:34:01.379979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-07T22:34:01.380055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-07T22:34:01.380148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-07T22:34:01.380216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-07T22:34:01.380281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-07T22:34:01.380343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-07T22:34:01.380409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-07T22:34:01.380505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-07T22:34:01.380589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-07T22:34:01.380765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-07T22:34:01.380857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-07T22:34:01.380923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-07T22:34:01.380988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-07T22:34:01.381052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-07T22:34:01.381118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-07T22:34:01.381182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-07T22:34:01.381246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-07T22:34:01.381309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-07T22:34:01.381372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-07T22:34:01.381434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-07T22:34:01.381499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-07T22:34:01.381563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-07T22:34:01.381730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-07T22:34:01.381850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-07T22:34:01.381949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-07T22:34:01.382048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-07T22:34:01.382145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-07T22:34:01.382241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-07T22:34:01.382340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-07T22:34:01.382437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-07T22:34:01.382554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-07T22:34:01.382700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-07T22:34:01.382821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-07T22:34:01.382941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-07T22:34:01.383048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-07T22:34:01.383161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-07T22:34:01.383273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-07T22:34:01.383368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-07T22:34:01.383485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-07T22:34:01.383596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-07T22:34:01.383747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-07T22:34:01.383855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-07T22:34:01.383979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-07T22:34:01.384092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-07T22:34:01.384187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-07T22:34:01.384321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-07T22:34:01.384428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-07T22:34:01.384501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-07T22:34:01.384566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-07T22:34:01.384630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-07T22:34:01.384853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-07T22:34:01.384943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-07T22:34:01.385023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-07T22:34:01.385113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-07T22:34:01.385185] [INFO ] [LOCAL ] Deleted 1648 derivative data files. [2025-10-07T22:34:01.385219] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-07T22:34:01.387046] [INFO ] [LOCAL ] Found 1748 symbols with primary data. [2025-10-07T22:34:01.387573] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1748 symbols [2025-10-07T22:34:01.388545] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:01.389273] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:01.388873] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:01.466848] [DEBUG] [LOCAL ] AA: Loaded 53620 existing records from primary storage. [2025-10-07T22:34:01.467128] [INFO ] [MAIN ] AA: Loaded 53620 primary data records. [2025-10-07T22:34:01.602510] [DEBUG] [LOCAL ] A: Loaded 50745 existing records from primary storage. [2025-10-07T22:34:01.603061] [INFO ] [MAIN ] A: Loaded 50745 primary data records. [2025-10-07T22:34:01.619530] [DEBUG] [LOCAL ] AAP: Loaded 51875 existing records from primary storage. [2025-10-07T22:34:01.673440] [INFO ] [MAIN ] AAP: Loaded 51875 primary data records. [2025-10-07T22:34:02.462805] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:02.465251] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53620 primary records. [2025-10-07T22:34:02.466390] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-07T22:34:02.482340] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:02.490337] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50745 primary records. [2025-10-07T22:34:02.504139] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-07T22:34:02.519780] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:02.520861] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51875 primary records. [2025-10-07T22:34:02.521253] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-07T22:34:02.521347] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-07T22:34:02.525187] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-07T22:34:02.528048] [INFO ] [MAIN ] Derivative Progress: 1/1748 symbols completed. AA took 1.1s. Estimated remaining: 33m 13s. Rate: 52.6 symbols/min [2025-10-07T22:34:02.536120] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:02.546522] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-10-07T22:34:02.547711] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-07T22:34:02.550865] [INFO ] [MAIN ] Derivative Progress: 2/1748 symbols completed. A took 1.2s. Estimated remaining: 16m 56s. Rate: 103.1 symbols/min [2025-10-07T22:34:02.551481] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:02.552311] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-07T22:34:02.552562] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-07T22:34:02.555929] [INFO ] [MAIN ] Derivative Progress: 3/1748 symbols completed. AAP took 1.2s. Estimated remaining: 11m 20s. Rate: 154.0 symbols/min [2025-10-07T22:34:02.556797] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:02.591899] [DEBUG] [LOCAL ] AB: Loaded 26634 existing records from primary storage. [2025-10-07T22:34:02.594219] [INFO ] [MAIN ] AB: Loaded 26634 primary data records. [2025-10-07T22:34:02.666116] [DEBUG] [LOCAL ] AAT: Loaded 30309 existing records from primary storage. [2025-10-07T22:34:02.688093] [INFO ] [MAIN ] AAT: Loaded 30309 primary data records. [2025-10-07T22:34:03.044671] [DEBUG] [LOCAL ] ABBV: Loaded 53685 existing records from primary storage. [2025-10-07T22:34:03.071366] [INFO ] [MAIN ] ABBV: Loaded 53685 primary data records. [2025-10-07T22:34:03.612799] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:03.615394] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 26634 primary records. [2025-10-07T22:34:03.615936] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-07T22:34:03.638760] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-10-07T22:34:03.656490] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-07T22:34:03.658866] [INFO ] [MAIN ] Derivative Progress: 4/1748 symbols completed. AB took 1.1s. Estimated remaining: 16m 30s. Rate: 105.6 symbols/min [2025-10-07T22:34:03.659547] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:03.660622] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30309 primary records. [2025-10-07T22:34:03.660843] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:03.660976] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-07T22:34:03.684473] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-10-07T22:34:03.684847] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-07T22:34:03.687283] [INFO ] [MAIN ] Derivative Progress: 5/1748 symbols completed. AAT took 1.2s. Estimated remaining: 13m 22s. Rate: 130.4 symbols/min [2025-10-07T22:34:03.688349] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:03.707230] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:34:03.708231] [INFO ] [MAIN ] ABBV: Generated 1793 derivative records from 53685 primary records. [2025-10-07T22:34:03.708400] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-07T22:34:03.731849] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1793 records). [2025-10-07T22:34:03.751991] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-07T22:34:03.751819] [DEBUG] [LOCAL ] ABG: Loaded 18537 existing records from primary storage. [2025-10-07T22:34:03.752151] [INFO ] [MAIN ] ABG: Loaded 18537 primary data records. [2025-10-07T22:34:03.754944] [INFO ] [MAIN ] Derivative Progress: 6/1748 symbols completed. ABBV took 1.2s. Estimated remaining: 11m 27s. Rate: 152.0 symbols/min [2025-10-07T22:34:03.787593] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:03.876260] [DEBUG] [LOCAL ] ABEV: Loaded 53279 existing records from primary storage. [2025-10-07T22:34:03.892474] [INFO ] [MAIN ] ABEV: Loaded 53279 primary data records. [2025-10-07T22:34:04.248210] [DEBUG] [LOCAL ] ABM: Loaded 32062 existing records from primary storage. [2025-10-07T22:34:04.253403] [INFO ] [MAIN ] ABM: Loaded 32062 primary data records. [2025-10-07T22:34:04.731055] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:04.732038] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18537 primary records. [2025-10-07T22:34:04.732271] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-07T22:34:04.754307] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-10-07T22:34:04.754547] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-07T22:34:04.757733] [INFO ] [MAIN ] Derivative Progress: 7/1748 symbols completed. ABG took 1.1s. Estimated remaining: 13m 58s. Rate: 124.6 symbols/min [2025-10-07T22:34:04.758202] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:04.772668] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:04.773691] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53279 primary records. [2025-10-07T22:34:04.773918] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-07T22:34:04.802526] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-07T22:34:04.807767] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-07T22:34:04.810251] [INFO ] [MAIN ] Derivative Progress: 8/1748 symbols completed. ABEV took 1.1s. Estimated remaining: 12m 25s. Rate: 140.2 symbols/min [2025-10-07T22:34:04.810417] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:04.808085] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:04.811594] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32062 primary records. [2025-10-07T22:34:04.812073] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-07T22:34:04.828584] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-10-07T22:34:04.828771] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-07T22:34:04.831241] [INFO ] [MAIN ] Derivative Progress: 9/1748 symbols completed. ABM took 1.0s. Estimated remaining: 11m 5s. Rate: 156.8 symbols/min [2025-10-07T22:34:04.831479] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:04.874756] [DEBUG] [LOCAL ] ABR: Loaded 51989 existing records from primary storage. [2025-10-07T22:34:04.882214] [DEBUG] [LOCAL ] ACA: Loaded 23241 existing records from primary storage. [2025-10-07T22:34:04.882394] [INFO ] [MAIN ] ACA: Loaded 23241 primary data records. [2025-10-07T22:34:04.882300] [INFO ] [MAIN ] ABR: Loaded 51989 primary data records. [2025-10-07T22:34:05.295881] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-07T22:34:05.416482] [INFO ] [MAIN ] ABT: Loaded 53623 primary data records. [2025-10-07T22:34:05.883068] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:05.883870] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:05.884698] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 51989 primary records. [2025-10-07T22:34:05.884928] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-07T22:34:05.885539] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 23241 primary records. [2025-10-07T22:34:05.885945] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-07T22:34:05.914525] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-10-07T22:34:05.915126] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-07T22:34:05.917492] [INFO ] [MAIN ] Derivative Progress: 10/1748 symbols completed. ACA took 1.1s. Estimated remaining: 13m 7s. Rate: 132.4 symbols/min [2025-10-07T22:34:05.919820] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:05.922265] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-10-07T22:34:05.923371] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-07T22:34:05.925505] [INFO ] [MAIN ] Derivative Progress: 11/1748 symbols completed. ABR took 1.2s. Estimated remaining: 11m 57s. Rate: 145.4 symbols/min [2025-10-07T22:34:05.927169] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:05.941393] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:05.942268] [INFO ] [MAIN ] ABT: Generated 1794 derivative records from 53623 primary records. [2025-10-07T22:34:05.942384] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-07T22:34:05.970533] [DEBUG] [LOCAL ] ABT: Derivative data saved (1794 records). [2025-10-07T22:34:05.970744] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-07T22:34:05.973669] [INFO ] [MAIN ] Derivative Progress: 12/1748 symbols completed. ABT took 1.2s. Estimated remaining: 11m 4s. Rate: 157.0 symbols/min [2025-10-07T22:34:05.973991] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:05.986396] [DEBUG] [LOCAL ] ACEL: Loaded 26706 existing records from primary storage. [2025-10-07T22:34:05.986608] [INFO ] [MAIN ] ACEL: Loaded 26706 primary data records. [2025-10-07T22:34:06.319923] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-07T22:34:06.320180] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-07T22:34:06.437040] [DEBUG] [LOCAL ] ACM: Loaded 43061 existing records from primary storage. [2025-10-07T22:34:06.464918] [INFO ] [MAIN ] ACM: Loaded 43061 primary data records. [2025-10-07T22:34:06.956019] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:06.957436] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 26706 primary records. [2025-10-07T22:34:06.957556] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-07T22:34:06.980851] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-10-07T22:34:06.981121] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-07T22:34:06.996108] [INFO ] [MAIN ] Derivative Progress: 13/1748 symbols completed. ACEL took 1.1s. Estimated remaining: 12m 29s. Rate: 139.1 symbols/min [2025-10-07T22:34:06.996616] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:06.997758] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-10-07T22:34:06.998012] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-07T22:34:07.026885] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:07.027979] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43061 primary records. [2025-10-07T22:34:07.028454] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-07T22:34:07.030230] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-10-07T22:34:07.030460] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-07T22:34:07.041290] [INFO ] [MAIN ] Derivative Progress: 14/1748 symbols completed. ACHR took 1.1s. Estimated remaining: 11m 40s. Rate: 148.6 symbols/min [2025-10-07T22:34:07.048352] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-10-07T22:34:07.048414] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-07T22:34:07.050790] [INFO ] [MAIN ] Derivative Progress: 15/1748 symbols completed. ACM took 1.1s. Estimated remaining: 10m 54s. Rate: 158.9 symbols/min [2025-10-07T22:34:07.051171] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:07.051115] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:07.051299] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:07.064529] [DEBUG] [LOCAL ] ACR: Loaded 5692 existing records from primary storage. [2025-10-07T22:34:07.064740] [INFO ] [MAIN ] ACR: Loaded 5692 primary data records. [2025-10-07T22:34:07.135946] [DEBUG] [LOCAL ] ACV: Loaded 7506 existing records from primary storage. [2025-10-07T22:34:07.158284] [INFO ] [MAIN ] ACV: Loaded 7506 primary data records. [2025-10-07T22:34:07.718891] [DEBUG] [LOCAL ] ADM: Loaded 53390 existing records from primary storage. [2025-10-07T22:34:07.727495] [INFO ] [MAIN ] ADM: Loaded 53390 primary data records. [2025-10-07T22:34:08.052437] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:08.054268] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 5692 primary records. [2025-10-07T22:34:08.054964] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-07T22:34:08.089579] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-10-07T22:34:08.089806] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:08.090040] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-07T22:34:08.092109] [INFO ] [MAIN ] Derivative Progress: 16/1748 symbols completed. ACR took 1.0s. Estimated remaining: 12m 6s. Rate: 143.2 symbols/min [2025-10-07T22:34:08.093045] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 7506 primary records. [2025-10-07T22:34:08.093278] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-07T22:34:08.093426] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:08.113160] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-10-07T22:34:08.113280] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-07T22:34:08.115342] [INFO ] [MAIN ] Derivative Progress: 17/1748 symbols completed. ACV took 1.1s. Estimated remaining: 11m 25s. Rate: 151.6 symbols/min [2025-10-07T22:34:08.115493] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:08.132153] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:08.133475] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53390 primary records. [2025-10-07T22:34:08.133671] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-07T22:34:08.166909] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-07T22:34:08.167098] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-07T22:34:08.169549] [INFO ] [MAIN ] Derivative Progress: 18/1748 symbols completed. ADM took 1.1s. Estimated remaining: 10m 52s. Rate: 159.2 symbols/min [2025-10-07T22:34:08.169866] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:08.181480] [DEBUG] [LOCAL ] ADX: Loaded 27503 existing records from primary storage. [2025-10-07T22:34:08.193929] [INFO ] [MAIN ] ADX: Loaded 27503 primary data records. [2025-10-07T22:34:08.194601] [DEBUG] [LOCAL ] ADNT: Loaded 47253 existing records from primary storage. [2025-10-07T22:34:08.215421] [INFO ] [MAIN ] ADNT: Loaded 47253 primary data records. [2025-10-07T22:34:08.827062] [DEBUG] [LOCAL ] AEE: Loaded 50121 existing records from primary storage. [2025-10-07T22:34:08.827548] [INFO ] [MAIN ] AEE: Loaded 50121 primary data records. [2025-10-07T22:34:09.191892] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:09.193175] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 47253 primary records. [2025-10-07T22:34:09.194036] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-07T22:34:09.225243] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:09.227200] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27503 primary records. [2025-10-07T22:34:09.227494] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-07T22:34:09.229041] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-10-07T22:34:09.236218] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-07T22:34:09.241877] [INFO ] [MAIN ] Derivative Progress: 19/1748 symbols completed. ADNT took 1.1s. Estimated remaining: 11m 55s. Rate: 145.1 symbols/min [2025-10-07T22:34:09.244434] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:09.247037] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-07T22:34:09.247100] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-07T22:34:09.249173] [INFO ] [MAIN ] Derivative Progress: 20/1748 symbols completed. ADX took 1.1s. Estimated remaining: 11m 19s. Rate: 152.6 symbols/min [2025-10-07T22:34:09.249415] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:09.269721] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:09.273868] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50121 primary records. [2025-10-07T22:34:09.273148] [DEBUG] [LOCAL ] AEFC: Loaded 8446 existing records from primary storage. [2025-10-07T22:34:09.274192] [INFO ] [MAIN ] AEFC: Loaded 8446 primary data records. [2025-10-07T22:34:09.274065] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-07T22:34:09.622122] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-07T22:34:09.623358] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-07T22:34:09.625443] [INFO ] [MAIN ] Derivative Progress: 21/1748 symbols completed. AEE took 1.5s. Estimated remaining: 11m 18s. Rate: 152.9 symbols/min [2025-10-07T22:34:09.625675] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:09.626847] [DEBUG] [LOCAL ] AEG: Loaded 49613 existing records from primary storage. [2025-10-07T22:34:09.628176] [INFO ] [MAIN ] AEG: Loaded 49613 primary data records. [2025-10-07T22:34:09.958528] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:09.959505] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8446 primary records. [2025-10-07T22:34:09.959699] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-07T22:34:09.990969] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-10-07T22:34:09.991971] [INFO ] [MAIN ] AEM: Loaded 53464 primary data records. [2025-10-07T22:34:10.004025] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-07T22:34:10.023472] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-07T22:34:10.037674] [INFO ] [MAIN ] Derivative Progress: 22/1748 symbols completed. AEFC took 0.8s. Estimated remaining: 11m 19s. Rate: 152.6 symbols/min [2025-10-07T22:34:10.043070] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:10.192056] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:10.323633] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49613 primary records. [2025-10-07T22:34:10.352275] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-07T22:34:10.385853] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-10-07T22:34:10.386353] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-07T22:34:10.388251] [INFO ] [MAIN ] Derivative Progress: 23/1748 symbols completed. AEG took 1.1s. Estimated remaining: 11m 15s. Rate: 153.3 symbols/min [2025-10-07T22:34:10.388588] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:10.410315] [DEBUG] [LOCAL ] AEO: Loaded 53560 existing records from primary storage. [2025-10-07T22:34:10.410779] [INFO ] [MAIN ] AEO: Loaded 53560 primary data records. [2025-10-07T22:34:10.574576] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:10.594735] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53464 primary records. [2025-10-07T22:34:10.632953] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-07T22:34:10.766498] [DEBUG] [LOCAL ] AER: Loaded 48272 existing records from primary storage. [2025-10-07T22:34:10.778000] [INFO ] [MAIN ] AER: Loaded 48272 primary data records. [2025-10-07T22:34:10.827676] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-07T22:34:10.849323] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-07T22:34:10.873425] [INFO ] [MAIN ] Derivative Progress: 24/1748 symbols completed. AEM took 1.2s. Estimated remaining: 11m 21s. Rate: 151.8 symbols/min [2025-10-07T22:34:10.887926] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:11.165094] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:11.166311] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53560 primary records. [2025-10-07T22:34:11.166691] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-07T22:34:11.202930] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-10-07T22:34:11.203206] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-07T22:34:11.205514] [INFO ] [MAIN ] Derivative Progress: 25/1748 symbols completed. AEO took 1.2s. Estimated remaining: 11m 17s. Rate: 152.8 symbols/min [2025-10-07T22:34:11.206126] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:11.240944] [DEBUG] [LOCAL ] AES: Loaded 53671 existing records from primary storage. [2025-10-07T22:34:11.242191] [INFO ] [MAIN ] AES: Loaded 53671 primary data records. [2025-10-07T22:34:11.242104] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:11.243240] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48272 primary records. [2025-10-07T22:34:11.254702] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-07T22:34:11.448498] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-07T22:34:11.453616] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-07T22:34:11.456097] [INFO ] [MAIN ] Derivative Progress: 26/1748 symbols completed. AER took 1.1s. Estimated remaining: 11m 7s. Rate: 154.9 symbols/min [2025-10-07T22:34:11.471734] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:11.594015] [DEBUG] [LOCAL ] AESI: Loaded 49549 existing records from primary storage. [2025-10-07T22:34:11.594183] [INFO ] [MAIN ] AESI: Loaded 49549 primary data records. [2025-10-07T22:34:11.734262] [DEBUG] [LOCAL ] AFB: Loaded 11472 existing records from primary storage. [2025-10-07T22:34:11.734525] [INFO ] [MAIN ] AFB: Loaded 11472 primary data records. [2025-10-07T22:34:12.264606] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:12.266067] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53671 primary records. [2025-10-07T22:34:12.266700] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-07T22:34:12.289503] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-07T22:34:12.290012] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-07T22:34:12.292281] [INFO ] [MAIN ] Derivative Progress: 27/1748 symbols completed. AES took 1.4s. Estimated remaining: 11m 35s. Rate: 148.6 symbols/min [2025-10-07T22:34:12.292712] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:12.311445] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:12.312251] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49549 primary records. [2025-10-07T22:34:12.312509] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-07T22:34:12.341867] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:12.343353] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11472 primary records. [2025-10-07T22:34:12.344022] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-07T22:34:12.365406] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-07T22:34:12.369579] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-07T22:34:12.369760] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-07T22:34:12.369695] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-07T22:34:12.371875] [INFO ] [MAIN ] Derivative Progress: 28/1748 symbols completed. AESI took 1.2s. Estimated remaining: 11m 15s. Rate: 152.9 symbols/min [2025-10-07T22:34:12.374347] [INFO ] [MAIN ] Derivative Progress: 29/1748 symbols completed. AFB took 0.9s. Estimated remaining: 10m 51s. Rate: 158.4 symbols/min [2025-10-07T22:34:12.386210] [DEBUG] [LOCAL ] AFG: Loaded 32272 existing records from primary storage. [2025-10-07T22:34:12.386325] [INFO ] [MAIN ] AFG: Loaded 32272 primary data records. [2025-10-07T22:34:12.690494] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:12.691219] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32272 primary records. [2025-10-07T22:34:12.691284] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-07T22:34:12.707234] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-07T22:34:12.707296] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-07T22:34:12.710663] [INFO ] [MAIN ] Derivative Progress: 30/1748 symbols completed. AFG took 0.4s. Estimated remaining: 10m 48s. Rate: 159.0 symbols/min [2025-10-07T22:34:12.711405] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:12.711591] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:12.712269] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:12.721148] [DEBUG] [LOCAL ] AFGB: Loaded 2311 existing records from primary storage. [2025-10-07T22:34:12.723412] [DEBUG] [LOCAL ] AFGD: Loaded 1808 existing records from primary storage. [2025-10-07T22:34:12.723559] [INFO ] [MAIN ] AFGB: Loaded 2311 primary data records. [2025-10-07T22:34:12.719437] [DEBUG] [LOCAL ] AFGC: Loaded 2546 existing records from primary storage. [2025-10-07T22:34:12.735000] [INFO ] [MAIN ] AFGC: Loaded 2546 primary data records. [2025-10-07T22:34:12.723777] [INFO ] [MAIN ] AFGD: Loaded 1808 primary data records. [2025-10-07T22:34:13.765245] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:34:13.766368] [INFO ] [MAIN ] AFGB: Generated 1793 derivative records from 2311 primary records. [2025-10-07T22:34:13.780832] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-07T22:34:13.783694] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:34:13.785282] [INFO ] [MAIN ] AFGD: Generated 1793 derivative records from 1808 primary records. [2025-10-07T22:34:13.791438] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-07T22:34:13.816979] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:13.823137] [INFO ] [MAIN ] AFGC: Generated 1794 derivative records from 2546 primary records. [2025-10-07T22:34:13.823477] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-07T22:34:13.840399] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1793 records). [2025-10-07T22:34:13.842123] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-07T22:34:13.845467] [INFO ] [MAIN ] Derivative Progress: 31/1748 symbols completed. AFGB took 1.1s. Estimated remaining: 11m 30s. Rate: 149.3 symbols/min [2025-10-07T22:34:13.846281] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:13.845678] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1793 records). [2025-10-07T22:34:13.847034] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-07T22:34:13.850617] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1794 records). [2025-10-07T22:34:13.850126] [INFO ] [MAIN ] Derivative Progress: 32/1748 symbols completed. AFGD took 1.1s. Estimated remaining: 11m 8s. Rate: 154.1 symbols/min [2025-10-07T22:34:13.850991] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:13.851064] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-07T22:34:13.853955] [INFO ] [MAIN ] Derivative Progress: 33/1748 symbols completed. AFGC took 1.1s. Estimated remaining: 10m 48s. Rate: 158.8 symbols/min [2025-10-07T22:34:13.854313] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:13.859090] [DEBUG] [LOCAL ] AFGE: Loaded 2430 existing records from primary storage. [2025-10-07T22:34:13.859565] [INFO ] [MAIN ] AFGE: Loaded 2430 primary data records. [2025-10-07T22:34:14.240477] [DEBUG] [LOCAL ] AG: Loaded 53642 existing records from primary storage. [2025-10-07T22:34:14.251487] [INFO ] [MAIN ] AG: Loaded 53642 primary data records. [2025-10-07T22:34:14.254029] [DEBUG] [LOCAL ] AGCO: Loaded 42359 existing records from primary storage. [2025-10-07T22:34:14.265573] [INFO ] [MAIN ] AGCO: Loaded 42359 primary data records. [2025-10-07T22:34:14.875399] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:14.877776] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2430 primary records. [2025-10-07T22:34:14.878755] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-07T22:34:14.896794] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-10-07T22:34:14.897285] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-07T22:34:14.900738] [INFO ] [MAIN ] Derivative Progress: 34/1748 symbols completed. AFGE took 1.1s. Estimated remaining: 11m 21s. Rate: 151.0 symbols/min [2025-10-07T22:34:14.901245] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:14.941934] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:14.942385] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:14.943115] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42359 primary records. [2025-10-07T22:34:14.949033] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-07T22:34:14.950744] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53642 primary records. [2025-10-07T22:34:14.951409] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-07T22:34:14.951105] [DEBUG] [LOCAL ] AGD: Loaded 18378 existing records from primary storage. [2025-10-07T22:34:14.952502] [INFO ] [MAIN ] AGD: Loaded 18378 primary data records. [2025-10-07T22:34:15.018410] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-10-07T22:34:15.019625] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-07T22:34:15.019841] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-07T22:34:15.050937] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-07T22:34:15.041750] [INFO ] [MAIN ] Derivative Progress: 35/1748 symbols completed. AG took 1.2s. Estimated remaining: 11m 8s. Rate: 153.8 symbols/min [2025-10-07T22:34:15.088827] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:15.091421] [INFO ] [MAIN ] Derivative Progress: 36/1748 symbols completed. AGCO took 1.2s. Estimated remaining: 10m 52s. Rate: 157.6 symbols/min [2025-10-07T22:34:15.091883] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:15.380135] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:15.408689] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 18378 primary records. [2025-10-07T22:34:15.408849] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-07T22:34:15.410071] [DEBUG] [LOCAL ] AGI: Loaded 53421 existing records from primary storage. [2025-10-07T22:34:15.411929] [INFO ] [MAIN ] AGI: Loaded 53421 primary data records. [2025-10-07T22:34:15.445039] [DEBUG] [LOCAL ] AGL: Loaded 52486 existing records from primary storage. [2025-10-07T22:34:15.447876] [INFO ] [MAIN ] AGL: Loaded 52486 primary data records. [2025-10-07T22:34:15.513276] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-07T22:34:15.545557] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-07T22:34:15.547974] [INFO ] [MAIN ] Derivative Progress: 37/1748 symbols completed. AGD took 0.6s. Estimated remaining: 10m 55s. Rate: 156.8 symbols/min [2025-10-07T22:34:15.548138] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:15.844857] [DEBUG] [LOCAL ] AGM: Loaded 10397 existing records from primary storage. [2025-10-07T22:34:15.863672] [INFO ] [MAIN ] AGM: Loaded 10397 primary data records. [2025-10-07T22:34:16.391756] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:16.406487] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53421 primary records. [2025-10-07T22:34:16.406889] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-07T22:34:16.408889] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:16.417351] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52486 primary records. [2025-10-07T22:34:16.417732] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-07T22:34:16.439069] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-07T22:34:16.439190] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-07T22:34:16.442582] [INFO ] [MAIN ] Derivative Progress: 38/1748 symbols completed. AGI took 1.4s. Estimated remaining: 11m 17s. Rate: 151.4 symbols/min [2025-10-07T22:34:16.444967] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:16.462293] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:16.463862] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10397 primary records. [2025-10-07T22:34:16.464143] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-07T22:34:16.465093] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-07T22:34:16.465357] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-07T22:34:16.467761] [INFO ] [MAIN ] Derivative Progress: 39/1748 symbols completed. AGL took 1.4s. Estimated remaining: 11m 1s. Rate: 155.2 symbols/min [2025-10-07T22:34:16.474915] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:16.492681] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-07T22:34:16.492761] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-07T22:34:16.495284] [INFO ] [MAIN ] Derivative Progress: 40/1748 symbols completed. AGM took 0.9s. Estimated remaining: 10m 45s. Rate: 158.9 symbols/min [2025-10-07T22:34:16.495540] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:16.507508] [DEBUG] [LOCAL ] AGO: Loaded 28004 existing records from primary storage. [2025-10-07T22:34:16.507778] [INFO ] [MAIN ] AGO: Loaded 28004 primary data records. [2025-10-07T22:34:16.663407] [DEBUG] [LOCAL ] AGRO: Loaded 33319 existing records from primary storage. [2025-10-07T22:34:16.670112] [INFO ] [MAIN ] AGRO: Loaded 33319 primary data records. [2025-10-07T22:34:16.681204] [DEBUG] [LOCAL ] AGX: Loaded 33141 existing records from primary storage. [2025-10-07T22:34:16.741935] [INFO ] [MAIN ] AGX: Loaded 33141 primary data records. [2025-10-07T22:34:17.603101] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:17.604146] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 28004 primary records. [2025-10-07T22:34:17.606710] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-07T22:34:17.624009] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-10-07T22:34:17.624245] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-07T22:34:17.640510] [INFO ] [MAIN ] Derivative Progress: 41/1748 symbols completed. AGO took 1.2s. Estimated remaining: 11m 17s. Rate: 151.4 symbols/min [2025-10-07T22:34:17.641583] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:17.640930] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:17.643053] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 33319 primary records. [2025-10-07T22:34:17.643844] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-07T22:34:17.663345] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-10-07T22:34:17.671574] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-07T22:34:17.678789] [INFO ] [MAIN ] Derivative Progress: 42/1748 symbols completed. AGRO took 1.2s. Estimated remaining: 11m 2s. Rate: 154.7 symbols/min [2025-10-07T22:34:17.679223] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:17.680143] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:17.680919] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33141 primary records. [2025-10-07T22:34:17.681112] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-07T22:34:17.707034] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-07T22:34:17.707239] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-07T22:34:17.709801] [INFO ] [MAIN ] Derivative Progress: 43/1748 symbols completed. AGX took 1.2s. Estimated remaining: 10m 47s. Rate: 158.1 symbols/min [2025-10-07T22:34:17.726743] [DEBUG] [LOCAL ] AHH: Loaded 40837 existing records from primary storage. [2025-10-07T22:34:17.726918] [INFO ] [MAIN ] AHH: Loaded 40837 primary data records. [2025-10-07T22:34:18.045631] [DEBUG] [LOCAL ] AHR: Loaded 49135 existing records from primary storage. [2025-10-07T22:34:18.046317] [INFO ] [MAIN ] AHR: Loaded 49135 primary data records. [2025-10-07T22:34:18.366125] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:18.367542] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 40837 primary records. [2025-10-07T22:34:18.367625] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-07T22:34:18.388832] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-07T22:34:18.389221] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-07T22:34:18.391554] [INFO ] [MAIN ] Derivative Progress: 44/1748 symbols completed. AHH took 0.7s. Estimated remaining: 10m 59s. Rate: 155.3 symbols/min [2025-10-07T22:34:18.409186] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:18.409874] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49135 primary records. [2025-10-07T22:34:18.409937] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-07T22:34:18.425853] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-10-07T22:34:18.425961] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-07T22:34:18.428062] [INFO ] [MAIN ] Derivative Progress: 45/1748 symbols completed. AHR took 0.7s. Estimated remaining: 10m 45s. Rate: 158.4 symbols/min [2025-10-07T22:34:18.428747] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:18.428927] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:18.428854] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:18.454539] [DEBUG] [LOCAL ] AIO: Loaded 13422 existing records from primary storage. [2025-10-07T22:34:18.454762] [INFO ] [MAIN ] AIO: Loaded 13422 primary data records. [2025-10-07T22:34:18.500018] [DEBUG] [LOCAL ] AIN: Loaded 24587 existing records from primary storage. [2025-10-07T22:34:18.527159] [INFO ] [MAIN ] AIN: Loaded 24587 primary data records. [2025-10-07T22:34:18.898345] [DEBUG] [LOCAL ] AIG: Loaded 53474 existing records from primary storage. [2025-10-07T22:34:18.922080] [INFO ] [MAIN ] AIG: Loaded 53474 primary data records. [2025-10-07T22:34:19.515533] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:19.516816] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13422 primary records. [2025-10-07T22:34:19.517043] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-07T22:34:19.537427] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-10-07T22:34:19.537807] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-07T22:34:19.541851] [INFO ] [MAIN ] Derivative Progress: 46/1748 symbols completed. AIO took 1.1s. Estimated remaining: 11m 12s. Rate: 152.0 symbols/min [2025-10-07T22:34:19.542199] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:19.558560] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:19.559526] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24587 primary records. [2025-10-07T22:34:19.561408] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-07T22:34:19.589408] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:19.590231] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53474 primary records. [2025-10-07T22:34:19.590298] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-07T22:34:19.618786] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-07T22:34:19.617715] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-07T22:34:19.618941] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-07T22:34:19.621326] [INFO ] [MAIN ] Derivative Progress: 47/1748 symbols completed. AIN took 1.2s. Estimated remaining: 10m 60s. Rate: 154.7 symbols/min [2025-10-07T22:34:19.619185] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-07T22:34:19.621497] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:19.624318] [INFO ] [MAIN ] Derivative Progress: 48/1748 symbols completed. AIG took 1.2s. Estimated remaining: 10m 46s. Rate: 157.9 symbols/min [2025-10-07T22:34:19.624616] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:19.636093] [DEBUG] [LOCAL ] AIR: Loaded 28749 existing records from primary storage. [2025-10-07T22:34:19.636348] [INFO ] [MAIN ] AIR: Loaded 28749 primary data records. [2025-10-07T22:34:19.824719] [DEBUG] [LOCAL ] AIT: Loaded 27197 existing records from primary storage. [2025-10-07T22:34:19.842305] [INFO ] [MAIN ] AIT: Loaded 27197 primary data records. [2025-10-07T22:34:19.973429] [DEBUG] [LOCAL ] AIV: Loaded 40863 existing records from primary storage. [2025-10-07T22:34:19.985438] [INFO ] [MAIN ] AIV: Loaded 40863 primary data records. [2025-10-07T22:34:20.610051] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:20.611420] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 28749 primary records. [2025-10-07T22:34:20.612032] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-07T22:34:20.640335] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-10-07T22:34:20.645214] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-07T22:34:20.648226] [INFO ] [MAIN ] Derivative Progress: 49/1748 symbols completed. AIR took 1.1s. Estimated remaining: 11m 8s. Rate: 152.6 symbols/min [2025-10-07T22:34:20.645771] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:20.648415] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:20.649363] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40863 primary records. [2025-10-07T22:34:20.649695] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-07T22:34:20.682067] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-07T22:34:20.682588] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-07T22:34:20.684739] [INFO ] [MAIN ] Derivative Progress: 50/1748 symbols completed. AIV took 1.1s. Estimated remaining: 10m 55s. Rate: 155.5 symbols/min [2025-10-07T22:34:20.682390] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:20.684978] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:20.685880] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 27197 primary records. [2025-10-07T22:34:20.686241] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-07T22:34:20.704836] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-07T22:34:20.713556] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-07T22:34:20.716592] [DEBUG] [LOCAL ] AIZN: Loaded 4050 existing records from primary storage. [2025-10-07T22:34:20.719107] [INFO ] [MAIN ] Derivative Progress: 51/1748 symbols completed. AIT took 1.1s. Estimated remaining: 10m 43s. Rate: 158.3 symbols/min [2025-10-07T22:34:20.719257] [INFO ] [MAIN ] AIZN: Loaded 4050 primary data records. [2025-10-07T22:34:20.730678] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:20.805613] [DEBUG] [LOCAL ] AIZ: Loaded 29798 existing records from primary storage. [2025-10-07T22:34:20.821070] [INFO ] [MAIN ] AIZ: Loaded 29798 primary data records. [2025-10-07T22:34:21.410788] [DEBUG] [LOCAL ] AJG: Loaded 46742 existing records from primary storage. [2025-10-07T22:34:21.411188] [INFO ] [MAIN ] AJG: Loaded 46742 primary data records. [2025-10-07T22:34:21.740437] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:21.741993] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 4050 primary records. [2025-10-07T22:34:21.742381] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-07T22:34:21.782077] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-10-07T22:34:21.781979] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:21.782449] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-07T22:34:21.784883] [INFO ] [MAIN ] Derivative Progress: 52/1748 symbols completed. AIZN took 1.1s. Estimated remaining: 11m 5s. Rate: 153.0 symbols/min [2025-10-07T22:34:21.786572] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29798 primary records. [2025-10-07T22:34:21.785139] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:21.787018] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-07T22:34:21.810850] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-07T22:34:21.811305] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-07T22:34:21.813941] [INFO ] [MAIN ] Derivative Progress: 53/1748 symbols completed. AIZ took 1.2s. Estimated remaining: 10m 53s. Rate: 155.7 symbols/min [2025-10-07T22:34:21.827734] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:21.828113] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:21.829172] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46742 primary records. [2025-10-07T22:34:21.829525] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-07T22:34:21.857535] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-10-07T22:34:21.857706] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-07T22:34:21.859869] [INFO ] [MAIN ] Derivative Progress: 54/1748 symbols completed. AJG took 1.1s. Estimated remaining: 10m 42s. Rate: 158.3 symbols/min [2025-10-07T22:34:21.860168] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:21.878734] [DEBUG] [LOCAL ] AKR: Loaded 45872 existing records from primary storage. [2025-10-07T22:34:21.879116] [INFO ] [MAIN ] AKR: Loaded 45872 primary data records. [2025-10-07T22:34:22.096663] [DEBUG] [LOCAL ] AL: Loaded 44440 existing records from primary storage. [2025-10-07T22:34:22.228748] [INFO ] [MAIN ] AL: Loaded 44440 primary data records. [2025-10-07T22:34:22.354945] [DEBUG] [LOCAL ] ALB: Loaded 53275 existing records from primary storage. [2025-10-07T22:34:22.355863] [INFO ] [MAIN ] ALB: Loaded 53275 primary data records. [2025-10-07T22:34:22.877760] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:22.878908] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 45872 primary records. [2025-10-07T22:34:22.879144] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-07T22:34:22.904556] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-07T22:34:22.904931] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-07T22:34:22.907416] [INFO ] [MAIN ] Derivative Progress: 55/1748 symbols completed. AKR took 1.1s. Estimated remaining: 11m 2s. Rate: 153.3 symbols/min [2025-10-07T22:34:22.908024] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:22.923184] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:22.924087] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44440 primary records. [2025-10-07T22:34:22.924277] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-07T22:34:22.941738] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-07T22:34:22.942188] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-07T22:34:22.945429] [INFO ] [MAIN ] Derivative Progress: 56/1748 symbols completed. AL took 1.1s. Estimated remaining: 10m 51s. Rate: 155.9 symbols/min [2025-10-07T22:34:22.947397] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:22.961596] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:22.962388] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53275 primary records. [2025-10-07T22:34:22.962587] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-07T22:34:22.991988] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-07T22:34:22.992218] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-07T22:34:22.994687] [INFO ] [MAIN ] Derivative Progress: 57/1748 symbols completed. ALB took 1.1s. Estimated remaining: 10m 41s. Rate: 158.3 symbols/min [2025-10-07T22:34:22.995101] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:23.013982] [DEBUG] [LOCAL ] ALC: Loaded 50987 existing records from primary storage. [2025-10-07T22:34:23.014359] [INFO ] [MAIN ] ALC: Loaded 50987 primary data records. [2025-10-07T22:34:23.175387] [DEBUG] [LOCAL ] ALE: Loaded 31260 existing records from primary storage. [2025-10-07T22:34:23.226060] [INFO ] [MAIN ] ALE: Loaded 31260 primary data records. [2025-10-07T22:34:23.450092] [DEBUG] [LOCAL ] ALEX: Loaded 31218 existing records from primary storage. [2025-10-07T22:34:23.478708] [INFO ] [MAIN ] ALEX: Loaded 31218 primary data records. [2025-10-07T22:34:24.035291] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:24.037299] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50987 primary records. [2025-10-07T22:34:24.037589] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-07T22:34:24.055147] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-07T22:34:24.055345] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-07T22:34:24.057857] [INFO ] [MAIN ] Derivative Progress: 58/1748 symbols completed. ALC took 1.1s. Estimated remaining: 11m 1s. Rate: 153.5 symbols/min [2025-10-07T22:34:24.075845] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:24.076601] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 31260 primary records. [2025-10-07T22:34:24.076776] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-07T22:34:24.094622] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-07T22:34:24.094781] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-07T22:34:24.096844] [INFO ] [MAIN ] Derivative Progress: 59/1748 symbols completed. ALE took 1.1s. Estimated remaining: 10m 50s. Rate: 155.9 symbols/min [2025-10-07T22:34:24.110132] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:24.110704] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31218 primary records. [2025-10-07T22:34:24.110764] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-07T22:34:24.126192] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-07T22:34:24.126254] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-07T22:34:24.128602] [INFO ] [MAIN ] Derivative Progress: 60/1748 symbols completed. ALEX took 1.1s. Estimated remaining: 10m 40s. Rate: 158.3 symbols/min [2025-10-07T22:34:24.129123] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:24.129069] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:24.128993] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:24.145349] [DEBUG] [LOCAL ] ALG: Loaded 9968 existing records from primary storage. [2025-10-07T22:34:24.145570] [INFO ] [MAIN ] ALG: Loaded 9968 primary data records. [2025-10-07T22:34:24.494894] [DEBUG] [LOCAL ] ALIT: Loaded 52769 existing records from primary storage. [2025-10-07T22:34:24.500473] [INFO ] [MAIN ] ALIT: Loaded 52769 primary data records. [2025-10-07T22:34:24.526347] [DEBUG] [LOCAL ] ALK: Loaded 53059 existing records from primary storage. [2025-10-07T22:34:24.540402] [INFO ] [MAIN ] ALK: Loaded 53059 primary data records. [2025-10-07T22:34:25.203843] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:25.204933] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 9968 primary records. [2025-10-07T22:34:25.205104] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-07T22:34:25.223403] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-07T22:34:25.223882] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-07T22:34:25.226380] [INFO ] [MAIN ] Derivative Progress: 61/1748 symbols completed. ALG took 1.1s. Estimated remaining: 10m 59s. Rate: 153.5 symbols/min [2025-10-07T22:34:25.226566] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:25.244450] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:25.245242] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52769 primary records. [2025-10-07T22:34:25.245405] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-07T22:34:25.264378] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-07T22:34:25.264612] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-07T22:34:25.279679] [INFO ] [MAIN ] Derivative Progress: 62/1748 symbols completed. ALIT took 1.2s. Estimated remaining: 10m 50s. Rate: 155.7 symbols/min [2025-10-07T22:34:25.280147] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:25.280532] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:25.281804] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53059 primary records. [2025-10-07T22:34:25.281866] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-07T22:34:25.309068] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-07T22:34:25.309202] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-07T22:34:25.311480] [INFO ] [MAIN ] Derivative Progress: 63/1748 symbols completed. ALK took 1.2s. Estimated remaining: 10m 40s. Rate: 158.0 symbols/min [2025-10-07T22:34:25.311774] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:25.331701] [DEBUG] [LOCAL ] ALL: Loaded 49915 existing records from primary storage. [2025-10-07T22:34:25.341294] [INFO ] [MAIN ] ALL: Loaded 49915 primary data records. [2025-10-07T22:34:25.461310] [DEBUG] [LOCAL ] ALLE: Loaded 44491 existing records from primary storage. [2025-10-07T22:34:25.495347] [INFO ] [MAIN ] ALLE: Loaded 44491 primary data records. [2025-10-07T22:34:25.809446] [DEBUG] [LOCAL ] ALLY: Loaded 53228 existing records from primary storage. [2025-10-07T22:34:25.836353] [INFO ] [MAIN ] ALLY: Loaded 53228 primary data records. [2025-10-07T22:34:26.323496] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:26.325029] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 49915 primary records. [2025-10-07T22:34:26.325418] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-07T22:34:26.345351] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-07T22:34:26.345605] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-07T22:34:26.348015] [INFO ] [MAIN ] Derivative Progress: 64/1748 symbols completed. ALL took 1.1s. Estimated remaining: 10m 57s. Rate: 153.8 symbols/min [2025-10-07T22:34:26.348694] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:26.362744] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:26.363712] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44491 primary records. [2025-10-07T22:34:26.363969] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-07T22:34:26.381805] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-07T22:34:26.382036] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-07T22:34:26.384815] [INFO ] [MAIN ] Derivative Progress: 65/1748 symbols completed. ALLE took 1.1s. Estimated remaining: 10m 47s. Rate: 156.0 symbols/min [2025-10-07T22:34:26.385800] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:26.410605] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:26.411390] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53228 primary records. [2025-10-07T22:34:26.411552] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-07T22:34:26.427544] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-07T22:34:26.427681] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-07T22:34:26.429890] [INFO ] [MAIN ] Derivative Progress: 66/1748 symbols completed. ALLY took 1.1s. Estimated remaining: 10m 38s. Rate: 158.1 symbols/min [2025-10-07T22:34:26.435348] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:26.450357] [DEBUG] [LOCAL ] ALSN: Loaded 43331 existing records from primary storage. [2025-10-07T22:34:26.450686] [INFO ] [MAIN ] ALSN: Loaded 43331 primary data records. [2025-10-07T22:34:26.522974] [DEBUG] [LOCAL ] ALTG: Loaded 23593 existing records from primary storage. [2025-10-07T22:34:26.561743] [INFO ] [MAIN ] ALTG: Loaded 23593 primary data records. [2025-10-07T22:34:26.561672] [DEBUG] [LOCAL ] ALUR: Loaded 10741 existing records from primary storage. [2025-10-07T22:34:26.572780] [INFO ] [MAIN ] ALUR: Loaded 10741 primary data records. [2025-10-07T22:34:27.489605] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:27.490953] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43331 primary records. [2025-10-07T22:34:27.491482] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-07T22:34:27.507809] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-10-07T22:34:27.508177] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-07T22:34:27.510623] [INFO ] [MAIN ] Derivative Progress: 67/1748 symbols completed. ALSN took 1.2s. Estimated remaining: 10m 55s. Rate: 153.9 symbols/min [2025-10-07T22:34:27.511426] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:27.549851] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:27.551704] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 10741 primary records. [2025-10-07T22:34:27.550874] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:27.551916] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-07T22:34:27.552850] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23593 primary records. [2025-10-07T22:34:27.553935] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-07T22:34:27.587377] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-07T22:34:27.591401] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-07T22:34:27.592498] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-07T22:34:27.595134] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-07T22:34:27.595015] [INFO ] [MAIN ] Derivative Progress: 68/1748 symbols completed. ALUR took 1.2s. Estimated remaining: 10m 47s. Rate: 155.7 symbols/min [2025-10-07T22:34:27.598126] [INFO ] [MAIN ] Derivative Progress: 69/1748 symbols completed. ALTG took 1.2s. Estimated remaining: 10m 38s. Rate: 157.9 symbols/min [2025-10-07T22:34:27.597998] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:27.598452] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:27.618666] [DEBUG] [LOCAL ] ALX: Loaded 6461 existing records from primary storage. [2025-10-07T22:34:27.618960] [INFO ] [MAIN ] ALX: Loaded 6461 primary data records. [2025-10-07T22:34:27.726836] [DEBUG] [LOCAL ] ALV: Loaded 42166 existing records from primary storage. [2025-10-07T22:34:27.753558] [INFO ] [MAIN ] ALV: Loaded 42166 primary data records. [2025-10-07T22:34:28.128674] [DEBUG] [LOCAL ] AM: Loaded 52017 existing records from primary storage. [2025-10-07T22:34:28.137883] [INFO ] [MAIN ] AM: Loaded 52017 primary data records. [2025-10-07T22:34:28.600854] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:28.601809] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 6461 primary records. [2025-10-07T22:34:28.602023] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-07T22:34:28.628834] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-10-07T22:34:28.634443] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:28.635300] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42166 primary records. [2025-10-07T22:34:28.634191] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-07T22:34:28.637599] [INFO ] [MAIN ] Derivative Progress: 70/1748 symbols completed. ALX took 1.0s. Estimated remaining: 10m 53s. Rate: 154.1 symbols/min [2025-10-07T22:34:28.637776] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:28.638253] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-07T22:34:28.673267] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-07T22:34:28.673345] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-07T22:34:28.675861] [INFO ] [MAIN ] Derivative Progress: 71/1748 symbols completed. ALV took 1.2s. Estimated remaining: 10m 45s. Rate: 156.1 symbols/min [2025-10-07T22:34:28.676090] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:28.672359] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:28.677768] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52017 primary records. [2025-10-07T22:34:28.677951] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-07T22:34:28.694336] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-07T22:34:28.694618] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-07T22:34:28.696938] [INFO ] [MAIN ] Derivative Progress: 72/1748 symbols completed. AM took 1.1s. Estimated remaining: 10m 36s. Rate: 158.2 symbols/min [2025-10-07T22:34:28.697127] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:28.723207] [DEBUG] [LOCAL ] AMBC: Loaded 36458 existing records from primary storage. [2025-10-07T22:34:28.723467] [INFO ] [MAIN ] AMBC: Loaded 36458 primary data records. [2025-10-07T22:34:28.854189] [DEBUG] [LOCAL ] AMBP: Loaded 44811 existing records from primary storage. [2025-10-07T22:34:28.878703] [INFO ] [MAIN ] AMBP: Loaded 44811 primary data records. [2025-10-07T22:34:29.179416] [DEBUG] [LOCAL ] AMC: Loaded 53761 existing records from primary storage. [2025-10-07T22:34:29.191020] [INFO ] [MAIN ] AMC: Loaded 53761 primary data records. [2025-10-07T22:34:29.740182] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:29.741182] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36458 primary records. [2025-10-07T22:34:29.741777] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-07T22:34:29.761129] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-07T22:34:29.762029] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-07T22:34:29.764392] [INFO ] [MAIN ] Derivative Progress: 73/1748 symbols completed. AMBC took 1.1s. Estimated remaining: 10m 51s. Rate: 154.3 symbols/min [2025-10-07T22:34:29.779023] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:29.780822] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 44811 primary records. [2025-10-07T22:34:29.781691] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-07T22:34:29.807858] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:29.809571] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53761 primary records. [2025-10-07T22:34:29.810233] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-07T22:34:29.821243] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-07T22:34:29.823827] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-07T22:34:29.828073] [INFO ] [MAIN ] Derivative Progress: 74/1748 symbols completed. AMBP took 1.2s. Estimated remaining: 10m 43s. Rate: 156.1 symbols/min [2025-10-07T22:34:29.830599] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-07T22:34:29.830704] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-07T22:34:29.833327] [INFO ] [MAIN ] Derivative Progress: 75/1748 symbols completed. AMC took 1.1s. Estimated remaining: 10m 35s. Rate: 158.2 symbols/min [2025-10-07T22:34:29.833869] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:29.834002] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:29.833810] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:29.856230] [DEBUG] [LOCAL ] AMG: Loaded 20226 existing records from primary storage. [2025-10-07T22:34:29.856389] [INFO ] [MAIN ] AMG: Loaded 20226 primary data records. [2025-10-07T22:34:30.208383] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-07T22:34:30.222416] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-10-07T22:34:30.223241] [DEBUG] [LOCAL ] AME: Loaded 48666 existing records from primary storage. [2025-10-07T22:34:30.223465] [INFO ] [MAIN ] AME: Loaded 48666 primary data records. [2025-10-07T22:34:30.867750] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:30.869498] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20226 primary records. [2025-10-07T22:34:30.869596] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-07T22:34:30.889575] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-10-07T22:34:30.889920] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-07T22:34:30.893032] [INFO ] [MAIN ] Derivative Progress: 76/1748 symbols completed. AMG took 1.1s. Estimated remaining: 10m 49s. Rate: 154.5 symbols/min [2025-10-07T22:34:30.901397] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:30.907343] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:30.908545] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48666 primary records. [2025-10-07T22:34:30.909054] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-07T22:34:30.929961] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-07T22:34:30.930090] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-07T22:34:30.940179] [INFO ] [MAIN ] Derivative Progress: 77/1748 symbols completed. AME took 1.1s. Estimated remaining: 10m 41s. Rate: 156.3 symbols/min [2025-10-07T22:34:30.945737] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:30.946363] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:30.947408] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-10-07T22:34:30.947593] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-07T22:34:30.964967] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-07T22:34:30.965078] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-07T22:34:30.967409] [INFO ] [MAIN ] Derivative Progress: 78/1748 symbols completed. AMCR took 1.1s. Estimated remaining: 10m 33s. Rate: 158.2 symbols/min [2025-10-07T22:34:30.967628] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:31.019052] [DEBUG] [LOCAL ] AMP: Loaded 32027 existing records from primary storage. [2025-10-07T22:34:31.020028] [DEBUG] [LOCAL ] AMH: Loaded 51759 existing records from primary storage. [2025-10-07T22:34:31.020491] [INFO ] [MAIN ] AMH: Loaded 51759 primary data records. [2025-10-07T22:34:31.020400] [INFO ] [MAIN ] AMP: Loaded 32027 primary data records. [2025-10-07T22:34:31.554266] [DEBUG] [LOCAL ] AMPX: Loaded 52317 existing records from primary storage. [2025-10-07T22:34:31.567227] [INFO ] [MAIN ] AMPX: Loaded 52317 primary data records. [2025-10-07T22:34:32.047231] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:32.061468] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32027 primary records. [2025-10-07T22:34:32.062262] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-07T22:34:32.062667] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:32.065021] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51759 primary records. [2025-10-07T22:34:32.072423] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-07T22:34:32.097381] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-07T22:34:32.098689] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-07T22:34:32.101112] [INFO ] [MAIN ] Derivative Progress: 79/1748 symbols completed. AMH took 1.2s. Estimated remaining: 10m 49s. Rate: 154.3 symbols/min [2025-10-07T22:34:32.102423] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:32.103551] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-10-07T22:34:32.104823] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-07T22:34:32.107330] [INFO ] [MAIN ] Derivative Progress: 80/1748 symbols completed. AMP took 1.2s. Estimated remaining: 10m 41s. Rate: 156.2 symbols/min [2025-10-07T22:34:32.108580] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:32.123978] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:32.124898] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52317 primary records. [2025-10-07T22:34:32.125050] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-07T22:34:32.143259] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-10-07T22:34:32.143505] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-07T22:34:32.146361] [INFO ] [MAIN ] Derivative Progress: 81/1748 symbols completed. AMPX took 1.2s. Estimated remaining: 10m 33s. Rate: 158.0 symbols/min [2025-10-07T22:34:32.146789] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:32.179790] [DEBUG] [LOCAL ] AMR: Loaded 29108 existing records from primary storage. [2025-10-07T22:34:32.190744] [INFO ] [MAIN ] AMR: Loaded 29108 primary data records. [2025-10-07T22:34:32.222087] [DEBUG] [LOCAL ] AMPY: Loaded 38451 existing records from primary storage. [2025-10-07T22:34:32.255106] [INFO ] [MAIN ] AMPY: Loaded 38451 primary data records. [2025-10-07T22:34:32.505061] [DEBUG] [LOCAL ] AMRC: Loaded 38121 existing records from primary storage. [2025-10-07T22:34:32.645743] [INFO ] [MAIN ] AMRC: Loaded 38121 primary data records. [2025-10-07T22:34:33.154463] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:33.155628] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 29108 primary records. [2025-10-07T22:34:33.156220] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-07T22:34:33.177606] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-07T22:34:33.186327] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-07T22:34:33.194110] [INFO ] [MAIN ] Derivative Progress: 82/1748 symbols completed. AMR took 1.1s. Estimated remaining: 10m 46s. Rate: 154.7 symbols/min [2025-10-07T22:34:33.194678] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:33.194518] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:33.196504] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 38451 primary records. [2025-10-07T22:34:33.196795] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-07T22:34:33.230550] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:33.232028] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38121 primary records. [2025-10-07T22:34:33.233475] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-07T22:34:33.233364] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-07T22:34:33.234370] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-07T22:34:33.237138] [INFO ] [MAIN ] Derivative Progress: 83/1748 symbols completed. AMPY took 1.1s. Estimated remaining: 10m 39s. Rate: 156.4 symbols/min [2025-10-07T22:34:33.244978] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:33.254225] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-07T22:34:33.254596] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-07T22:34:33.257008] [INFO ] [MAIN ] Derivative Progress: 84/1748 symbols completed. AMRC took 1.1s. Estimated remaining: 10m 31s. Rate: 158.1 symbols/min [2025-10-07T22:34:33.257223] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:33.263301] [DEBUG] [LOCAL ] AMTD: Loaded 3692 existing records from primary storage. [2025-10-07T22:34:33.263483] [INFO ] [MAIN ] AMTD: Loaded 3692 primary data records. [2025-10-07T22:34:33.390189] [DEBUG] [LOCAL ] AMTB: Loaded 20513 existing records from primary storage. [2025-10-07T22:34:33.404182] [INFO ] [MAIN ] AMTB: Loaded 20513 primary data records. [2025-10-07T22:34:33.501027] [DEBUG] [LOCAL ] AMT: Loaded 52437 existing records from primary storage. [2025-10-07T22:34:33.544434] [INFO ] [MAIN ] AMT: Loaded 52437 primary data records. [2025-10-07T22:34:34.261889] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:34.262957] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3692 primary records. [2025-10-07T22:34:34.263189] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-07T22:34:34.279312] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-07T22:34:34.279696] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-07T22:34:34.283073] [INFO ] [MAIN ] Derivative Progress: 85/1748 symbols completed. AMTD took 1.0s. Estimated remaining: 10m 44s. Rate: 155.0 symbols/min [2025-10-07T22:34:34.283537] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:34.320432] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:34.320164] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:34.321437] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20513 primary records. [2025-10-07T22:34:34.321594] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-07T22:34:34.322220] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52437 primary records. [2025-10-07T22:34:34.323112] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-07T22:34:34.338560] [DEBUG] [LOCAL ] AMWL: Loaded 9133 existing records from primary storage. [2025-10-07T22:34:34.346006] [INFO ] [MAIN ] AMWL: Loaded 9133 primary data records. [2025-10-07T22:34:34.420976] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-07T22:34:34.437871] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-07T22:34:34.438526] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-07T22:34:34.458543] [INFO ] [MAIN ] Derivative Progress: 86/1748 symbols completed. AMT took 1.3s. Estimated remaining: 10m 39s. Rate: 156.0 symbols/min [2025-10-07T22:34:34.448756] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-07T22:34:34.464398] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:34.464615] [INFO ] [MAIN ] Derivative Progress: 87/1748 symbols completed. AMTB took 1.2s. Estimated remaining: 10m 32s. Rate: 157.8 symbols/min [2025-10-07T22:34:34.476041] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:34.683517] [DEBUG] [LOCAL ] AN: Loaded 31743 existing records from primary storage. [2025-10-07T22:34:34.684140] [INFO ] [MAIN ] AN: Loaded 31743 primary data records. [2025-10-07T22:34:34.844489] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-07T22:34:34.863073] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-07T22:34:35.122881] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:35.136587] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 9133 primary records. [2025-10-07T22:34:35.140619] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-07T22:34:35.198990] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-07T22:34:35.207821] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-07T22:34:35.241093] [INFO ] [MAIN ] Derivative Progress: 88/1748 symbols completed. AMWL took 1.0s. Estimated remaining: 10m 39s. Rate: 156.0 symbols/min [2025-10-07T22:34:35.416221] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:35.417125] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 31743 primary records. [2025-10-07T22:34:35.417470] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-07T22:34:35.434614] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-10-07T22:34:35.434896] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-07T22:34:35.437254] [INFO ] [MAIN ] Derivative Progress: 89/1748 symbols completed. AN took 1.0s. Estimated remaining: 10m 35s. Rate: 156.8 symbols/min [2025-10-07T22:34:35.453408] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:35.453979] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-10-07T22:34:35.454074] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-07T22:34:35.469173] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-07T22:34:35.469239] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-07T22:34:35.471848] [INFO ] [MAIN ] Derivative Progress: 90/1748 symbols completed. ANET took 1.0s. Estimated remaining: 10m 28s. Rate: 158.4 symbols/min [2025-10-07T22:34:35.472202] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:35.472558] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:35.472314] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:35.492379] [DEBUG] [LOCAL ] AOMR: Loaded 16462 existing records from primary storage. [2025-10-07T22:34:35.492849] [INFO ] [MAIN ] AOMR: Loaded 16462 primary data records. [2025-10-07T22:34:35.794392] [DEBUG] [LOCAL ] ANF: Loaded 52101 existing records from primary storage. [2025-10-07T22:34:35.849141] [INFO ] [MAIN ] ANF: Loaded 52101 primary data records. [2025-10-07T22:34:35.850467] [DEBUG] [LOCAL ] AON: Loaded 45201 existing records from primary storage. [2025-10-07T22:34:35.871255] [INFO ] [MAIN ] AON: Loaded 45201 primary data records. [2025-10-07T22:34:36.483669] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:36.484880] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16462 primary records. [2025-10-07T22:34:36.485342] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-07T22:34:36.504358] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-07T22:34:36.505670] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-07T22:34:36.509116] [INFO ] [MAIN ] Derivative Progress: 91/1748 symbols completed. AOMR took 1.0s. Estimated remaining: 10m 40s. Rate: 155.5 symbols/min [2025-10-07T22:34:36.510284] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:36.536490] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:36.542720] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52101 primary records. [2025-10-07T22:34:36.543200] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-07T22:34:36.543077] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:36.544913] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45201 primary records. [2025-10-07T22:34:36.545297] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-07T22:34:36.575907] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-07T22:34:36.576110] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-07T22:34:36.578066] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-07T22:34:36.580397] [INFO ] [MAIN ] Derivative Progress: 92/1748 symbols completed. AON took 1.1s. Estimated remaining: 10m 33s. Rate: 156.8 symbols/min [2025-10-07T22:34:36.580749] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-07T22:34:36.580971] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:36.583500] [INFO ] [MAIN ] Derivative Progress: 93/1748 symbols completed. ANF took 1.1s. Estimated remaining: 10m 26s. Rate: 158.5 symbols/min [2025-10-07T22:34:36.584178] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:36.616713] [DEBUG] [LOCAL ] AOS: Loaded 48724 existing records from primary storage. [2025-10-07T22:34:36.617961] [INFO ] [MAIN ] AOS: Loaded 48724 primary data records. [2025-10-07T22:34:36.972729] [DEBUG] [LOCAL ] APG: Loaded 50426 existing records from primary storage. [2025-10-07T22:34:36.973386] [INFO ] [MAIN ] APG: Loaded 50426 primary data records. [2025-10-07T22:34:36.987157] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-07T22:34:36.997702] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-07T22:34:37.654495] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:37.656087] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 48724 primary records. [2025-10-07T22:34:37.657086] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-07T22:34:37.679095] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-10-07T22:34:37.682073] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-07T22:34:37.686060] [INFO ] [MAIN ] Derivative Progress: 94/1748 symbols completed. AOS took 1.2s. Estimated remaining: 10m 39s. Rate: 155.4 symbols/min [2025-10-07T22:34:37.688115] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:37.702419] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:37.715547] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50426 primary records. [2025-10-07T22:34:37.721958] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-07T22:34:37.724381] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:37.725418] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-10-07T22:34:37.745083] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-07T22:34:37.761328] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-07T22:34:37.761985] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-07T22:34:37.764065] [INFO ] [MAIN ] Derivative Progress: 95/1748 symbols completed. APG took 1.2s. Estimated remaining: 10m 33s. Rate: 156.7 symbols/min [2025-10-07T22:34:37.764318] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:37.782422] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-10-07T22:34:37.782601] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-07T22:34:37.785113] [INFO ] [MAIN ] Derivative Progress: 96/1748 symbols completed. APH took 1.2s. Estimated remaining: 10m 26s. Rate: 158.3 symbols/min [2025-10-07T22:34:37.785548] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:37.829517] [DEBUG] [LOCAL ] APLE: Loaded 51950 existing records from primary storage. [2025-10-07T22:34:37.838558] [INFO ] [MAIN ] APLE: Loaded 51950 primary data records. [2025-10-07T22:34:37.978120] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-07T22:34:37.978322] [INFO ] [MAIN ] APO: Loaded 53383 primary data records. [2025-10-07T22:34:38.296166] [DEBUG] [LOCAL ] APTV: Loaded 52052 existing records from primary storage. [2025-10-07T22:34:38.312834] [INFO ] [MAIN ] APTV: Loaded 52052 primary data records. [2025-10-07T22:34:38.812246] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:38.814020] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 51950 primary records. [2025-10-07T22:34:38.827614] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:38.822106] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-07T22:34:38.828332] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53383 primary records. [2025-10-07T22:34:38.828498] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-07T22:34:38.857486] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-07T22:34:38.859079] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-07T22:34:38.861373] [INFO ] [MAIN ] Derivative Progress: 97/1748 symbols completed. APO took 1.1s. Estimated remaining: 10m 38s. Rate: 155.3 symbols/min [2025-10-07T22:34:38.861963] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:38.864268] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-10-07T22:34:38.864445] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-07T22:34:38.866622] [INFO ] [MAIN ] Derivative Progress: 98/1748 symbols completed. APLE took 1.2s. Estimated remaining: 10m 31s. Rate: 156.9 symbols/min [2025-10-07T22:34:38.866955] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:38.883890] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:38.884749] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52052 primary records. [2025-10-07T22:34:38.884924] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-07T22:34:38.914337] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-10-07T22:34:38.914593] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-07T22:34:38.917060] [INFO ] [MAIN ] Derivative Progress: 99/1748 symbols completed. APTV took 1.1s. Estimated remaining: 10m 25s. Rate: 158.3 symbols/min [2025-10-07T22:34:38.917447] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:38.961841] [DEBUG] [LOCAL ] ARCO: Loaded 44383 existing records from primary storage. [2025-10-07T22:34:38.962039] [INFO ] [MAIN ] ARCO: Loaded 44383 primary data records. [2025-10-07T22:34:39.010228] [DEBUG] [LOCAL ] ARDC: Loaded 15020 existing records from primary storage. [2025-10-07T22:34:39.049664] [INFO ] [MAIN ] ARDC: Loaded 15020 primary data records. [2025-10-07T22:34:39.105303] [DEBUG] [LOCAL ] AR: Loaded 53589 existing records from primary storage. [2025-10-07T22:34:39.149527] [INFO ] [MAIN ] AR: Loaded 53589 primary data records. [2025-10-07T22:34:39.932425] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:39.933608] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44383 primary records. [2025-10-07T22:34:39.936013] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-07T22:34:39.972152] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:39.971738] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-10-07T22:34:39.985887] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-07T22:34:39.986686] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 15020 primary records. [2025-10-07T22:34:39.988836] [INFO ] [MAIN ] Derivative Progress: 100/1748 symbols completed. ARCO took 1.1s. Estimated remaining: 10m 36s. Rate: 155.4 symbols/min [2025-10-07T22:34:39.989402] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:39.989234] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:39.989314] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-07T22:34:39.990265] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53589 primary records. [2025-10-07T22:34:39.991474] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-07T22:34:40.022353] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-10-07T22:34:40.023233] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-07T22:34:40.026116] [INFO ] [MAIN ] Derivative Progress: 101/1748 symbols completed. ARDC took 1.1s. Estimated remaining: 10m 30s. Rate: 156.8 symbols/min [2025-10-07T22:34:40.026257] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:40.028263] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-10-07T22:34:40.028349] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-07T22:34:40.030965] [INFO ] [MAIN ] Derivative Progress: 102/1748 symbols completed. AR took 1.2s. Estimated remaining: 10m 24s. Rate: 158.4 symbols/min [2025-10-07T22:34:40.038680] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:40.051987] [DEBUG] [LOCAL ] ARDT: Loaded 27787 existing records from primary storage. [2025-10-07T22:34:40.052121] [INFO ] [MAIN ] ARDT: Loaded 27787 primary data records. [2025-10-07T22:34:40.381131] [DEBUG] [LOCAL ] ARIS: Loaded 42300 existing records from primary storage. [2025-10-07T22:34:40.382024] [INFO ] [MAIN ] ARIS: Loaded 42300 primary data records. [2025-10-07T22:34:40.501190] [DEBUG] [LOCAL ] ARE: Loaded 50729 existing records from primary storage. [2025-10-07T22:34:40.501395] [INFO ] [MAIN ] ARE: Loaded 50729 primary data records. [2025-10-07T22:34:41.021413] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:41.023011] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27787 primary records. [2025-10-07T22:34:41.024704] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-07T22:34:41.042351] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-07T22:34:41.042465] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-07T22:34:41.044566] [INFO ] [MAIN ] Derivative Progress: 103/1748 symbols completed. ARDT took 1.1s. Estimated remaining: 10m 33s. Rate: 155.8 symbols/min [2025-10-07T22:34:41.063078] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:41.063771] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42300 primary records. [2025-10-07T22:34:41.063916] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-10-07T22:34:41.095475] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-10-07T22:34:41.095932] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-10-07T22:34:41.095795] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:41.098121] [INFO ] [MAIN ] Derivative Progress: 104/1748 symbols completed. ARIS took 1.1s. Estimated remaining: 10m 28s. Rate: 157.1 symbols/min [2025-10-07T22:34:41.098899] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50729 primary records. [2025-10-07T22:34:41.099103] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-07T22:34:41.115419] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-07T22:34:41.115482] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-07T22:34:41.117836] [INFO ] [MAIN ] Derivative Progress: 105/1748 symbols completed. ARE took 1.1s. Estimated remaining: 10m 22s. Rate: 158.6 symbols/min [2025-10-07T22:34:41.118217] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:41.118281] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:41.118325] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:41.198697] [DEBUG] [LOCAL ] ARMK: Loaded 50378 existing records from primary storage. [2025-10-07T22:34:41.200012] [INFO ] [MAIN ] ARMK: Loaded 50378 primary data records. [2025-10-07T22:34:41.214559] [DEBUG] [LOCAL ] AROC: Loaded 48944 existing records from primary storage. [2025-10-07T22:34:41.240082] [INFO ] [MAIN ] AROC: Loaded 48944 primary data records. [2025-10-07T22:34:41.436322] [DEBUG] [LOCAL ] ARR: Loaded 52067 existing records from primary storage. [2025-10-07T22:34:41.452274] [INFO ] [MAIN ] ARR: Loaded 52067 primary data records. [2025-10-07T22:34:42.175203] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:34:42.175811] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:42.176544] [INFO ] [MAIN ] ARMK: Generated 1793 derivative records from 50378 primary records. [2025-10-07T22:34:42.176663] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-07T22:34:42.177961] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 48944 primary records. [2025-10-07T22:34:42.178287] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-07T22:34:42.216950] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1793 records). [2025-10-07T22:34:42.222216] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-07T22:34:42.222503] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:42.224967] [INFO ] [MAIN ] Derivative Progress: 106/1748 symbols completed. ARMK took 1.1s. Estimated remaining: 10m 33s. Rate: 155.7 symbols/min [2025-10-07T22:34:42.225788] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52067 primary records. [2025-10-07T22:34:42.226122] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-07T22:34:42.226279] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:42.237202] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-10-07T22:34:42.241274] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-07T22:34:42.243264] [INFO ] [MAIN ] Derivative Progress: 107/1748 symbols completed. AROC took 1.1s. Estimated remaining: 10m 27s. Rate: 157.1 symbols/min [2025-10-07T22:34:42.243712] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:42.249407] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-10-07T22:34:42.249620] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-07T22:34:42.252738] [INFO ] [MAIN ] Derivative Progress: 108/1748 symbols completed. ARR took 1.1s. Estimated remaining: 10m 21s. Rate: 158.6 symbols/min [2025-10-07T22:34:42.253230] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:42.280500] [DEBUG] [LOCAL ] ARW: Loaded 32930 existing records from primary storage. [2025-10-07T22:34:42.285438] [INFO ] [MAIN ] ARW: Loaded 32930 primary data records. [2025-10-07T22:34:42.285873] [DEBUG] [LOCAL ] ASA: Loaded 14503 existing records from primary storage. [2025-10-07T22:34:42.306387] [INFO ] [MAIN ] ASA: Loaded 14503 primary data records. [2025-10-07T22:34:42.549591] [DEBUG] [LOCAL ] AS: Loaded 53105 existing records from primary storage. [2025-10-07T22:34:42.576362] [INFO ] [MAIN ] AS: Loaded 53105 primary data records. [2025-10-07T22:34:43.300138] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:43.306559] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:43.308061] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 14503 primary records. [2025-10-07T22:34:43.308342] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-07T22:34:43.309002] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 32930 primary records. [2025-10-07T22:34:43.309099] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-07T22:34:43.344326] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-07T22:34:43.345581] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-07T22:34:43.349082] [INFO ] [MAIN ] Derivative Progress: 109/1748 symbols completed. ASA took 1.1s. Estimated remaining: 10m 31s. Rate: 155.9 symbols/min [2025-10-07T22:34:43.357406] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:43.357953] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-07T22:34:43.363295] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-07T22:34:43.365877] [INFO ] [MAIN ] Derivative Progress: 110/1748 symbols completed. ARW took 1.1s. Estimated remaining: 10m 25s. Rate: 157.2 symbols/min [2025-10-07T22:34:43.366105] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:43.366631] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:34:43.367978] [INFO ] [MAIN ] AS: Generated 1793 derivative records from 53105 primary records. [2025-10-07T22:34:43.368305] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-07T22:34:43.388399] [DEBUG] [LOCAL ] AS: Derivative data saved (1793 records). [2025-10-07T22:34:43.388757] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-07T22:34:43.391887] [INFO ] [MAIN ] Derivative Progress: 111/1748 symbols completed. AS took 1.1s. Estimated remaining: 10m 19s. Rate: 158.6 symbols/min [2025-10-07T22:34:43.392225] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:43.401732] [DEBUG] [LOCAL ] ASBA: Loaded 3471 existing records from primary storage. [2025-10-07T22:34:43.404937] [INFO ] [MAIN ] ASBA: Loaded 3471 primary data records. [2025-10-07T22:34:43.767430] [DEBUG] [LOCAL ] ASAN: Loaded 52722 existing records from primary storage. [2025-10-07T22:34:43.770317] [INFO ] [MAIN ] ASAN: Loaded 52722 primary data records. [2025-10-07T22:34:43.782964] [DEBUG] [LOCAL ] ASB: Loaded 49558 existing records from primary storage. [2025-10-07T22:34:43.803050] [INFO ] [MAIN ] ASB: Loaded 49558 primary data records. [2025-10-07T22:34:44.434533] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:44.436883] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3471 primary records. [2025-10-07T22:34:44.437195] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-07T22:34:44.463744] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-07T22:34:44.464197] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-07T22:34:44.467263] [INFO ] [MAIN ] Derivative Progress: 112/1748 symbols completed. ASBA took 1.1s. Estimated remaining: 10m 29s. Rate: 156.0 symbols/min [2025-10-07T22:34:44.468103] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:44.491266] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:44.507361] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49558 primary records. [2025-10-07T22:34:44.507779] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:44.508068] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-07T22:34:44.510215] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52722 primary records. [2025-10-07T22:34:44.510379] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-07T22:34:44.560349] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-07T22:34:44.561912] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-07T22:34:44.565916] [INFO ] [MAIN ] Derivative Progress: 113/1748 symbols completed. ASAN took 1.2s. Estimated remaining: 10m 25s. Rate: 157.0 symbols/min [2025-10-07T22:34:44.567257] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:44.585604] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-07T22:34:44.586365] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-07T22:34:44.587927] [DEBUG] [LOCAL ] ASC: Loaded 37428 existing records from primary storage. [2025-10-07T22:34:44.588124] [INFO ] [MAIN ] ASC: Loaded 37428 primary data records. [2025-10-07T22:34:44.590949] [INFO ] [MAIN ] Derivative Progress: 114/1748 symbols completed. ASB took 1.2s. Estimated remaining: 10m 19s. Rate: 158.3 symbols/min [2025-10-07T22:34:44.591443] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:44.756684] [DEBUG] [LOCAL ] ASG: Loaded 19702 existing records from primary storage. [2025-10-07T22:34:44.766931] [INFO ] [MAIN ] ASG: Loaded 19702 primary data records. [2025-10-07T22:34:44.890952] [DEBUG] [LOCAL ] ASGI: Loaded 22719 existing records from primary storage. [2025-10-07T22:34:44.922099] [INFO ] [MAIN ] ASGI: Loaded 22719 primary data records. [2025-10-07T22:34:45.859065] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:45.860437] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37428 primary records. [2025-10-07T22:34:45.861572] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-07T22:34:45.893086] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:45.894989] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 19702 primary records. [2025-10-07T22:34:45.895394] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-07T22:34:45.911552] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-07T22:34:45.912355] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-07T22:34:45.914369] [INFO ] [MAIN ] Derivative Progress: 115/1748 symbols completed. ASC took 1.4s. Estimated remaining: 10m 32s. Rate: 155.0 symbols/min [2025-10-07T22:34:45.915213] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:45.931859] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:45.933077] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22719 primary records. [2025-10-07T22:34:45.933863] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-07T22:34:45.935227] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-10-07T22:34:45.935333] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-07T22:34:45.938039] [INFO ] [MAIN ] Derivative Progress: 116/1748 symbols completed. ASG took 1.4s. Estimated remaining: 10m 27s. Rate: 156.2 symbols/min [2025-10-07T22:34:45.945572] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:45.955804] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-10-07T22:34:45.956022] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-07T22:34:45.958450] [INFO ] [MAIN ] Derivative Progress: 117/1748 symbols completed. ASGI took 1.4s. Estimated remaining: 10m 21s. Rate: 157.5 symbols/min [2025-10-07T22:34:45.958950] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:45.989703] [DEBUG] [LOCAL ] ASGN: Loaded 36349 existing records from primary storage. [2025-10-07T22:34:45.994301] [INFO ] [MAIN ] ASGN: Loaded 36349 primary data records. [2025-10-07T22:34:46.093908] [DEBUG] [LOCAL ] ASIX: Loaded 22844 existing records from primary storage. [2025-10-07T22:34:46.105563] [INFO ] [MAIN ] ASIX: Loaded 22844 primary data records. [2025-10-07T22:34:46.256354] [DEBUG] [LOCAL ] ASH: Loaded 37636 existing records from primary storage. [2025-10-07T22:34:46.343700] [INFO ] [MAIN ] ASH: Loaded 37636 primary data records. [2025-10-07T22:34:46.964970] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:46.965836] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36349 primary records. [2025-10-07T22:34:46.966193] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-07T22:34:47.002206] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:47.004270] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22844 primary records. [2025-10-07T22:34:47.004716] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-07T22:34:47.006882] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-07T22:34:47.008713] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-07T22:34:47.010853] [INFO ] [MAIN ] Derivative Progress: 118/1748 symbols completed. ASGN took 1.1s. Estimated remaining: 10m 30s. Rate: 155.2 symbols/min [2025-10-07T22:34:47.035417] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:47.036595] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37636 primary records. [2025-10-07T22:34:47.036898] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-07T22:34:47.055560] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-07T22:34:47.056061] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-07T22:34:47.056154] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-07T22:34:47.056227] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-07T22:34:47.058535] [INFO ] [MAIN ] Derivative Progress: 119/1748 symbols completed. ASIX took 1.1s. Estimated remaining: 10m 25s. Rate: 156.3 symbols/min [2025-10-07T22:34:47.061039] [INFO ] [MAIN ] Derivative Progress: 120/1748 symbols completed. ASH took 1.1s. Estimated remaining: 10m 20s. Rate: 157.6 symbols/min [2025-10-07T22:34:47.061545] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:47.061447] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:47.061663] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:47.074745] [DEBUG] [LOCAL ] ASR: Loaded 9354 existing records from primary storage. [2025-10-07T22:34:47.074953] [INFO ] [MAIN ] ASR: Loaded 9354 primary data records. [2025-10-07T22:34:47.412092] [DEBUG] [LOCAL ] ATEN: Loaded 38904 existing records from primary storage. [2025-10-07T22:34:47.427500] [INFO ] [MAIN ] ATEN: Loaded 38904 primary data records. [2025-10-07T22:34:47.449622] [DEBUG] [LOCAL ] ASPN: Loaded 49688 existing records from primary storage. [2025-10-07T22:34:47.473187] [INFO ] [MAIN ] ASPN: Loaded 49688 primary data records. [2025-10-07T22:34:48.141777] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:48.143492] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9354 primary records. [2025-10-07T22:34:48.143616] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-07T22:34:48.168213] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-10-07T22:34:48.168475] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-07T22:34:48.171330] [INFO ] [MAIN ] Derivative Progress: 121/1748 symbols completed. ASR took 1.1s. Estimated remaining: 10m 29s. Rate: 155.2 symbols/min [2025-10-07T22:34:48.172494] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:48.192148] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:48.193108] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49688 primary records. [2025-10-07T22:34:48.193320] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-07T22:34:48.224416] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-07T22:34:48.224534] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-07T22:34:48.220453] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:48.227000] [INFO ] [MAIN ] Derivative Progress: 122/1748 symbols completed. ASPN took 1.2s. Estimated remaining: 10m 24s. Rate: 156.3 symbols/min [2025-10-07T22:34:48.228047] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 38904 primary records. [2025-10-07T22:34:48.228234] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-07T22:34:48.228340] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:48.257492] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-07T22:34:48.257697] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-07T22:34:48.259836] [INFO ] [MAIN ] Derivative Progress: 123/1748 symbols completed. ATEN took 1.2s. Estimated remaining: 10m 19s. Rate: 157.4 symbols/min [2025-10-07T22:34:48.260148] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:48.274340] [DEBUG] [LOCAL ] ATGE: Loaded 31178 existing records from primary storage. [2025-10-07T22:34:48.274566] [INFO ] [MAIN ] ATGE: Loaded 31178 primary data records. [2025-10-07T22:34:48.341947] [DEBUG] [LOCAL ] ATHS: Loaded 6795 existing records from primary storage. [2025-10-07T22:34:48.356971] [INFO ] [MAIN ] ATHS: Loaded 6795 primary data records. [2025-10-07T22:34:48.428527] [DEBUG] [LOCAL ] ATHM: Loaded 31991 existing records from primary storage. [2025-10-07T22:34:48.447966] [INFO ] [MAIN ] ATHM: Loaded 31991 primary data records. [2025-10-07T22:34:49.278807] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:49.281023] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6795 primary records. [2025-10-07T22:34:49.281300] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-07T22:34:49.308372] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:49.309328] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31178 primary records. [2025-10-07T22:34:49.316517] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-07T22:34:49.316419] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:49.321896] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 31991 primary records. [2025-10-07T22:34:49.322249] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-07T22:34:49.352526] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-10-07T22:34:49.353354] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-07T22:34:49.355980] [INFO ] [MAIN ] Derivative Progress: 124/1748 symbols completed. ATHM took 1.1s. Estimated remaining: 10m 28s. Rate: 155.1 symbols/min [2025-10-07T22:34:49.356619] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:49.359278] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-07T22:34:49.359582] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-07T22:34:49.362042] [INFO ] [MAIN ] Derivative Progress: 125/1748 symbols completed. ATHS took 1.1s. Estimated remaining: 10m 23s. Rate: 156.3 symbols/min [2025-10-07T22:34:49.362752] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:49.363689] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-10-07T22:34:49.363825] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-07T22:34:49.367068] [INFO ] [MAIN ] Derivative Progress: 126/1748 symbols completed. ATGE took 1.2s. Estimated remaining: 10m 18s. Rate: 157.6 symbols/min [2025-10-07T22:34:49.367400] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:49.405612] [DEBUG] [LOCAL ] ATS: Loaded 17751 existing records from primary storage. [2025-10-07T22:34:49.405914] [INFO ] [MAIN ] ATS: Loaded 17751 primary data records. [2025-10-07T22:34:49.515966] [DEBUG] [LOCAL ] ATR: Loaded 30585 existing records from primary storage. [2025-10-07T22:34:49.526673] [INFO ] [MAIN ] ATR: Loaded 30585 primary data records. [2025-10-07T22:34:49.527231] [DEBUG] [LOCAL ] ATKR: Loaded 35515 existing records from primary storage. [2025-10-07T22:34:49.563099] [INFO ] [MAIN ] ATKR: Loaded 35515 primary data records. [2025-10-07T22:34:50.418058] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:50.420493] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:50.420060] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17751 primary records. [2025-10-07T22:34:50.420794] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-07T22:34:50.421704] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30585 primary records. [2025-10-07T22:34:50.421954] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-07T22:34:50.471204] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-10-07T22:34:50.472678] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-07T22:34:50.475719] [INFO ] [MAIN ] Derivative Progress: 127/1748 symbols completed. ATS took 1.1s. Estimated remaining: 10m 27s. Rate: 155.2 symbols/min [2025-10-07T22:34:50.476005] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:50.478274] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35515 primary records. [2025-10-07T22:34:50.479807] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-07T22:34:50.476474] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:50.479704] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-07T22:34:50.481573] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-07T22:34:50.484594] [INFO ] [MAIN ] Derivative Progress: 128/1748 symbols completed. ATR took 1.1s. Estimated remaining: 10m 21s. Rate: 156.4 symbols/min [2025-10-07T22:34:50.484933] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:50.502477] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-10-07T22:34:50.502741] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-07T22:34:50.505468] [INFO ] [MAIN ] Derivative Progress: 129/1748 symbols completed. ATKR took 1.1s. Estimated remaining: 10m 16s. Rate: 157.6 symbols/min [2025-10-07T22:34:50.505796] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:50.573942] [DEBUG] [LOCAL ] ATUS: Loaded 49494 existing records from primary storage. [2025-10-07T22:34:50.587227] [INFO ] [MAIN ] ATUS: Loaded 49494 primary data records. [2025-10-07T22:34:50.620018] [DEBUG] [LOCAL ] AU: Loaded 52994 existing records from primary storage. [2025-10-07T22:34:50.645773] [DEBUG] [LOCAL ] AUB: Loaded 46248 existing records from primary storage. [2025-10-07T22:34:50.646079] [INFO ] [MAIN ] AUB: Loaded 46248 primary data records. [2025-10-07T22:34:50.645905] [INFO ] [MAIN ] AU: Loaded 52994 primary data records. [2025-10-07T22:34:51.728303] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:51.727482] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:51.731028] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49494 primary records. [2025-10-07T22:34:51.732182] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46248 primary records. [2025-10-07T22:34:51.734265] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-07T22:34:51.734501] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-07T22:34:51.768953] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:51.772490] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52994 primary records. [2025-10-07T22:34:51.772600] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-07T22:34:51.782343] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-07T22:34:51.787186] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-07T22:34:51.787300] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-07T22:34:51.799604] [INFO ] [MAIN ] Derivative Progress: 130/1748 symbols completed. AUB took 1.3s. Estimated remaining: 10m 27s. Rate: 154.7 symbols/min [2025-10-07T22:34:51.803134] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:51.787839] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-07T22:34:51.810049] [INFO ] [MAIN ] Derivative Progress: 131/1748 symbols completed. ATUS took 1.3s. Estimated remaining: 10m 22s. Rate: 155.9 symbols/min [2025-10-07T22:34:51.811993] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-10-07T22:34:51.812324] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-07T22:34:51.812240] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:51.815772] [INFO ] [MAIN ] Derivative Progress: 132/1748 symbols completed. AU took 1.3s. Estimated remaining: 10m 17s. Rate: 157.1 symbols/min [2025-10-07T22:34:51.816202] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:51.825791] [DEBUG] [LOCAL ] AUNA: Loaded 5054 existing records from primary storage. [2025-10-07T22:34:51.826084] [INFO ] [MAIN ] AUNA: Loaded 5054 primary data records. [2025-10-07T22:34:52.183807] [DEBUG] [LOCAL ] AVA: Loaded 39243 existing records from primary storage. [2025-10-07T22:34:52.198557] [INFO ] [MAIN ] AVA: Loaded 39243 primary data records. [2025-10-07T22:34:52.200314] [DEBUG] [LOCAL ] AVB: Loaded 42115 existing records from primary storage. [2025-10-07T22:34:52.200636] [INFO ] [MAIN ] AVB: Loaded 42115 primary data records. [2025-10-07T22:34:52.923961] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:52.925677] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 5054 primary records. [2025-10-07T22:34:52.925861] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-07T22:34:52.942987] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-10-07T22:34:52.943214] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-07T22:34:52.946056] [INFO ] [MAIN ] Derivative Progress: 133/1748 symbols completed. AUNA took 1.1s. Estimated remaining: 10m 26s. Rate: 154.8 symbols/min [2025-10-07T22:34:52.964688] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:52.965344] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39243 primary records. [2025-10-07T22:34:52.965484] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-07T22:34:52.994819] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:52.996386] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 42115 primary records. [2025-10-07T22:34:52.997089] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-07T22:34:52.996884] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-07T22:34:52.997778] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-07T22:34:53.000246] [INFO ] [MAIN ] Derivative Progress: 134/1748 symbols completed. AVA took 1.2s. Estimated remaining: 10m 22s. Rate: 155.8 symbols/min [2025-10-07T22:34:53.015233] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-07T22:34:53.015295] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-07T22:34:53.017683] [INFO ] [MAIN ] Derivative Progress: 135/1748 symbols completed. AVB took 1.2s. Estimated remaining: 10m 17s. Rate: 156.9 symbols/min [2025-10-07T22:34:53.018220] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:53.018329] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:53.018434] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:53.051193] [DEBUG] [LOCAL ] AVD: Loaded 22358 existing records from primary storage. [2025-10-07T22:34:53.058775] [DEBUG] [LOCAL ] AVK: Loaded 18202 existing records from primary storage. [2025-10-07T22:34:53.058693] [INFO ] [MAIN ] AVD: Loaded 22358 primary data records. [2025-10-07T22:34:53.058918] [INFO ] [MAIN ] AVK: Loaded 18202 primary data records. [2025-10-07T22:34:53.269965] [DEBUG] [LOCAL ] AVNS: Loaded 33660 existing records from primary storage. [2025-10-07T22:34:53.270450] [INFO ] [MAIN ] AVNS: Loaded 33660 primary data records. [2025-10-07T22:34:54.085878] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:54.087193] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18202 primary records. [2025-10-07T22:34:54.087377] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-07T22:34:54.116478] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-07T22:34:54.125854] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-07T22:34:54.124790] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:54.127461] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22358 primary records. [2025-10-07T22:34:54.129822] [INFO ] [MAIN ] Derivative Progress: 136/1748 symbols completed. AVK took 1.1s. Estimated remaining: 10m 25s. Rate: 154.7 symbols/min [2025-10-07T22:34:54.127804] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-07T22:34:54.130994] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:54.158181] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:54.161241] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33660 primary records. [2025-10-07T22:34:54.161823] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-07T22:34:54.165177] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-07T22:34:54.172496] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-07T22:34:54.179298] [INFO ] [MAIN ] Derivative Progress: 137/1748 symbols completed. AVD took 1.2s. Estimated remaining: 10m 21s. Rate: 155.7 symbols/min [2025-10-07T22:34:54.179747] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:54.185504] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-07T22:34:54.185677] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-07T22:34:54.188367] [INFO ] [MAIN ] Derivative Progress: 138/1748 symbols completed. AVNS took 1.2s. Estimated remaining: 10m 16s. Rate: 156.8 symbols/min [2025-10-07T22:34:54.188609] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:54.238124] [DEBUG] [LOCAL ] AWF: Loaded 24241 existing records from primary storage. [2025-10-07T22:34:54.238324] [INFO ] [MAIN ] AWF: Loaded 24241 primary data records. [2025-10-07T22:34:54.368451] [DEBUG] [LOCAL ] AVTR: Loaded 53566 existing records from primary storage. [2025-10-07T22:34:54.368802] [INFO ] [MAIN ] AVTR: Loaded 53566 primary data records. [2025-10-07T22:34:54.375102] [DEBUG] [LOCAL ] AVY: Loaded 37557 existing records from primary storage. [2025-10-07T22:34:54.391772] [INFO ] [MAIN ] AVY: Loaded 37557 primary data records. [2025-10-07T22:34:55.229693] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:55.230746] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24241 primary records. [2025-10-07T22:34:55.231009] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-07T22:34:55.249635] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-07T22:34:55.251694] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-07T22:34:55.253677] [INFO ] [MAIN ] Derivative Progress: 139/1748 symbols completed. AWF took 1.1s. Estimated remaining: 10m 24s. Rate: 154.8 symbols/min [2025-10-07T22:34:55.254054] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:55.281239] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:55.281604] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:55.282400] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53566 primary records. [2025-10-07T22:34:55.283134] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-07T22:34:55.283069] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37557 primary records. [2025-10-07T22:34:55.283670] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-07T22:34:55.328634] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-10-07T22:34:55.330566] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-10-07T22:34:55.331056] [DEBUG] [LOCAL ] AWI: Loaded 25292 existing records from primary storage. [2025-10-07T22:34:55.331159] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-07T22:34:55.333792] [INFO ] [MAIN ] Derivative Progress: 140/1748 symbols completed. AVTR took 1.2s. Estimated remaining: 10m 20s. Rate: 155.7 symbols/min [2025-10-07T22:34:55.330692] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-07T22:34:55.334097] [INFO ] [MAIN ] AWI: Loaded 25292 primary data records. [2025-10-07T22:34:55.336397] [INFO ] [MAIN ] Derivative Progress: 141/1748 symbols completed. AVY took 1.2s. Estimated remaining: 10m 15s. Rate: 156.8 symbols/min [2025-10-07T22:34:55.333963] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:55.357102] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:55.511673] [DEBUG] [LOCAL ] AWP: Loaded 21505 existing records from primary storage. [2025-10-07T22:34:55.540112] [INFO ] [MAIN ] AWP: Loaded 21505 primary data records. [2025-10-07T22:34:55.806969] [DEBUG] [LOCAL ] AWK: Loaded 48693 existing records from primary storage. [2025-10-07T22:34:55.827853] [INFO ] [MAIN ] AWK: Loaded 48693 primary data records. [2025-10-07T22:34:56.369317] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:56.370496] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 25292 primary records. [2025-10-07T22:34:56.370709] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-07T22:34:56.393318] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-10-07T22:34:56.393895] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-07T22:34:56.404629] [INFO ] [MAIN ] Derivative Progress: 142/1748 symbols completed. AWI took 1.2s. Estimated remaining: 10m 22s. Rate: 154.9 symbols/min [2025-10-07T22:34:56.410529] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:56.410336] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:56.411957] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21505 primary records. [2025-10-07T22:34:56.412193] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-07T22:34:56.438204] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-07T22:34:56.451433] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-07T22:34:56.455260] [INFO ] [MAIN ] Derivative Progress: 143/1748 symbols completed. AWP took 1.1s. Estimated remaining: 10m 18s. Rate: 155.8 symbols/min [2025-10-07T22:34:56.452505] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:56.456339] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48693 primary records. [2025-10-07T22:34:56.456966] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-07T22:34:56.455525] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:56.474487] [DEBUG] [LOCAL ] AWR: Loaded 22714 existing records from primary storage. [2025-10-07T22:34:56.478018] [INFO ] [MAIN ] AWR: Loaded 22714 primary data records. [2025-10-07T22:34:56.525032] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-07T22:34:56.525156] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-07T22:34:56.527944] [INFO ] [MAIN ] Derivative Progress: 144/1748 symbols completed. AWK took 1.2s. Estimated remaining: 10m 14s. Rate: 156.7 symbols/min [2025-10-07T22:34:56.565062] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:56.804476] [DEBUG] [LOCAL ] AX: Loaded 28121 existing records from primary storage. [2025-10-07T22:34:56.806180] [INFO ] [MAIN ] AX: Loaded 28121 primary data records. [2025-10-07T22:34:57.026624] [DEBUG] [LOCAL ] AXP: Loaded 53170 existing records from primary storage. [2025-10-07T22:34:57.144698] [INFO ] [MAIN ] AXP: Loaded 53170 primary data records. [2025-10-07T22:34:57.336378] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:57.476372] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22714 primary records. [2025-10-07T22:34:57.476938] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-07T22:34:57.494359] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-07T22:34:57.494577] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-07T22:34:57.496678] [INFO ] [MAIN ] Derivative Progress: 145/1748 symbols completed. AWR took 1.1s. Estimated remaining: 10m 20s. Rate: 155.1 symbols/min [2025-10-07T22:34:57.497094] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:57.505865] [DEBUG] [LOCAL ] AXR: Loaded 2994 existing records from primary storage. [2025-10-07T22:34:57.519057] [INFO ] [MAIN ] AXR: Loaded 2994 primary data records. [2025-10-07T22:34:57.540890] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:57.558639] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28121 primary records. [2025-10-07T22:34:57.565600] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-07T22:34:57.675221] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-07T22:34:57.693102] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-07T22:34:57.715056] [INFO ] [MAIN ] Derivative Progress: 146/1748 symbols completed. AX took 1.3s. Estimated remaining: 10m 18s. Rate: 155.5 symbols/min [2025-10-07T22:34:57.746134] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:57.917460] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:57.928450] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53170 primary records. [2025-10-07T22:34:57.928795] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-07T22:34:57.947094] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-07T22:34:57.947792] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-07T22:34:57.950365] [INFO ] [MAIN ] Derivative Progress: 147/1748 symbols completed. AXP took 1.4s. Estimated remaining: 10m 16s. Rate: 155.9 symbols/min [2025-10-07T22:34:57.951013] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:57.978501] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:57.989313] [INFO ] [MAIN ] AXR: Generated 1794 derivative records from 2994 primary records. [2025-10-07T22:34:57.989572] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-07T22:34:58.019599] [DEBUG] [LOCAL ] AXR: Derivative data saved (1794 records). [2025-10-07T22:34:58.020958] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-07T22:34:58.020850] [DEBUG] [LOCAL ] AXS: Loaded 38558 existing records from primary storage. [2025-10-07T22:34:58.023194] [INFO ] [MAIN ] Derivative Progress: 148/1748 symbols completed. AXR took 0.5s. Estimated remaining: 10m 12s. Rate: 156.8 symbols/min [2025-10-07T22:34:58.023351] [INFO ] [MAIN ] AXS: Loaded 38558 primary data records. [2025-10-07T22:34:58.228635] [DEBUG] [LOCAL ] AXTA: Loaded 52161 existing records from primary storage. [2025-10-07T22:34:58.343024] [INFO ] [MAIN ] AXTA: Loaded 52161 primary data records. [2025-10-07T22:34:58.676135] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:58.677055] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38558 primary records. [2025-10-07T22:34:58.677249] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-07T22:34:58.708462] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:58.709671] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52161 primary records. [2025-10-07T22:34:58.710009] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-07T22:34:58.711050] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-10-07T22:34:58.711405] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-07T22:34:58.713590] [INFO ] [MAIN ] Derivative Progress: 149/1748 symbols completed. AXS took 1.0s. Estimated remaining: 10m 15s. Rate: 155.9 symbols/min [2025-10-07T22:34:58.732935] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-07T22:34:58.733047] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-07T22:34:58.735454] [INFO ] [MAIN ] Derivative Progress: 150/1748 symbols completed. AXTA took 0.8s. Estimated remaining: 10m 11s. Rate: 156.9 symbols/min [2025-10-07T22:34:58.735985] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:58.736134] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:58.737092] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:58.752491] [DEBUG] [LOCAL ] AZO: Loaded 11286 existing records from primary storage. [2025-10-07T22:34:58.752726] [INFO ] [MAIN ] AZO: Loaded 11286 primary data records. [2025-10-07T22:34:58.873484] [DEBUG] [LOCAL ] AZZ: Loaded 22027 existing records from primary storage. [2025-10-07T22:34:58.881501] [INFO ] [MAIN ] AZZ: Loaded 22027 primary data records. [2025-10-07T22:34:58.939233] [DEBUG] [LOCAL ] AYI: Loaded 25223 existing records from primary storage. [2025-10-07T22:34:58.994996] [INFO ] [MAIN ] AYI: Loaded 25223 primary data records. [2025-10-07T22:34:59.720489] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:59.722080] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11286 primary records. [2025-10-07T22:34:59.722470] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-07T22:34:59.745396] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:59.747909] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22027 primary records. [2025-10-07T22:34:59.750668] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-07T22:34:59.769382] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-10-07T22:34:59.770477] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-07T22:34:59.773232] [INFO ] [MAIN ] Derivative Progress: 151/1748 symbols completed. AZO took 1.0s. Estimated remaining: 10m 18s. Rate: 155.2 symbols/min [2025-10-07T22:34:59.773478] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:59.789809] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:34:59.792173] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25223 primary records. [2025-10-07T22:34:59.792663] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-10-07T22:34:59.792936] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-07T22:34:59.792817] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-07T22:34:59.795716] [INFO ] [MAIN ] Derivative Progress: 152/1748 symbols completed. AZZ took 1.1s. Estimated remaining: 10m 13s. Rate: 156.1 symbols/min [2025-10-07T22:34:59.796123] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:59.813858] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-10-07T22:34:59.814080] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-07T22:34:59.816954] [INFO ] [MAIN ] Derivative Progress: 153/1748 symbols completed. AYI took 1.1s. Estimated remaining: 10m 9s. Rate: 157.1 symbols/min [2025-10-07T22:34:59.817204] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:34:59.879412] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-07T22:34:59.880257] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-07T22:34:59.933877] [DEBUG] [LOCAL ] BAK: Loaded 39374 existing records from primary storage. [2025-10-07T22:34:59.955082] [INFO ] [MAIN ] BAK: Loaded 39374 primary data records. [2025-10-07T22:35:00.043523] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-07T22:35:00.087285] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-07T22:35:00.914124] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:00.920593] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-10-07T22:35:00.920832] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-07T22:35:00.921018] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:00.922443] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39374 primary records. [2025-10-07T22:35:00.932608] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-07T22:35:00.953763] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-07T22:35:00.954262] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-07T22:35:00.956993] [INFO ] [MAIN ] Derivative Progress: 154/1748 symbols completed. BA took 1.2s. Estimated remaining: 10m 17s. Rate: 155.1 symbols/min [2025-10-07T22:35:00.957407] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:00.972359] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:00.973419] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-10-07T22:35:00.974222] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-07T22:35:00.990691] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-07T22:35:00.992861] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-07T22:35:00.995544] [INFO ] [MAIN ] Derivative Progress: 155/1748 symbols completed. BAK took 1.2s. Estimated remaining: 10m 13s. Rate: 156.0 symbols/min [2025-10-07T22:35:00.996571] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-10-07T22:35:00.996797] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-07T22:35:00.996928] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:01.000399] [INFO ] [MAIN ] Derivative Progress: 156/1748 symbols completed. BAC took 1.2s. Estimated remaining: 10m 8s. Rate: 157.0 symbols/min [2025-10-07T22:35:01.000862] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:01.048342] [DEBUG] [LOCAL ] BAM: Loaded 52009 existing records from primary storage. [2025-10-07T22:35:01.056572] [INFO ] [MAIN ] BAM: Loaded 52009 primary data records. [2025-10-07T22:35:01.057282] [DEBUG] [LOCAL ] BAP: Loaded 25960 existing records from primary storage. [2025-10-07T22:35:01.093617] [INFO ] [MAIN ] BAP: Loaded 25960 primary data records. [2025-10-07T22:35:01.327073] [DEBUG] [LOCAL ] BANC: Loaded 51275 existing records from primary storage. [2025-10-07T22:35:01.372718] [INFO ] [MAIN ] BANC: Loaded 51275 primary data records. [2025-10-07T22:35:02.088050] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:02.089342] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52009 primary records. [2025-10-07T22:35:02.089449] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-07T22:35:02.124560] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:02.126323] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 25960 primary records. [2025-10-07T22:35:02.126462] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-07T22:35:02.126572] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-07T22:35:02.128432] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-07T22:35:02.130302] [INFO ] [MAIN ] Derivative Progress: 157/1748 symbols completed. BAM took 1.2s. Estimated remaining: 10m 16s. Rate: 155.1 symbols/min [2025-10-07T22:35:02.130702] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:02.148245] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-10-07T22:35:02.148839] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-07T22:35:02.151533] [INFO ] [MAIN ] Derivative Progress: 158/1748 symbols completed. BAP took 1.2s. Estimated remaining: 10m 11s. Rate: 156.0 symbols/min [2025-10-07T22:35:02.165088] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:02.166129] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:02.167345] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51275 primary records. [2025-10-07T22:35:02.167469] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-07T22:35:02.185770] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-07T22:35:02.186127] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-07T22:35:02.189015] [INFO ] [MAIN ] Derivative Progress: 159/1748 symbols completed. BANC took 1.2s. Estimated remaining: 10m 8s. Rate: 156.9 symbols/min [2025-10-07T22:35:02.189253] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:02.241468] [DEBUG] [LOCAL ] BARK: Loaded 37946 existing records from primary storage. [2025-10-07T22:35:02.241837] [INFO ] [MAIN ] BARK: Loaded 37946 primary data records. [2025-10-07T22:35:02.375391] [DEBUG] [LOCAL ] BAX: Loaded 53504 existing records from primary storage. [2025-10-07T22:35:02.393199] [INFO ] [MAIN ] BAX: Loaded 53504 primary data records. [2025-10-07T22:35:02.405122] [DEBUG] [LOCAL ] BB: Loaded 52944 existing records from primary storage. [2025-10-07T22:35:02.469953] [INFO ] [MAIN ] BB: Loaded 52944 primary data records. [2025-10-07T22:35:03.247840] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:03.249021] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 37946 primary records. [2025-10-07T22:35:03.249436] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-07T22:35:03.272750] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-07T22:35:03.273220] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-07T22:35:03.275431] [INFO ] [MAIN ] Derivative Progress: 160/1748 symbols completed. BARK took 1.1s. Estimated remaining: 10m 14s. Rate: 155.1 symbols/min [2025-10-07T22:35:03.275852] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:03.303551] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:03.303285] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:03.304414] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53504 primary records. [2025-10-07T22:35:03.305418] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-07T22:35:03.305343] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52944 primary records. [2025-10-07T22:35:03.306407] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-07T22:35:03.337495] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-07T22:35:03.339236] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-07T22:35:03.339181] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-07T22:35:03.341910] [INFO ] [MAIN ] Derivative Progress: 161/1748 symbols completed. BAX took 1.2s. Estimated remaining: 10m 11s. Rate: 155.9 symbols/min [2025-10-07T22:35:03.342189] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:03.342072] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-07T22:35:03.345341] [INFO ] [MAIN ] Derivative Progress: 162/1748 symbols completed. BB took 1.2s. Estimated remaining: 10m 7s. Rate: 156.9 symbols/min [2025-10-07T22:35:03.345784] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:03.399715] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-07T22:35:03.400047] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-07T22:35:03.532872] [DEBUG] [LOCAL ] BBAR: Loaded 41683 existing records from primary storage. [2025-10-07T22:35:03.542929] [INFO ] [MAIN ] BBAR: Loaded 41683 primary data records. [2025-10-07T22:35:03.678806] [DEBUG] [LOCAL ] BBD: Loaded 53239 existing records from primary storage. [2025-10-07T22:35:03.722124] [INFO ] [MAIN ] BBD: Loaded 53239 primary data records. [2025-10-07T22:35:04.485377] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:04.486934] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-07T22:35:04.487292] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-07T22:35:04.521189] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-07T22:35:04.521840] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:04.522687] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-07T22:35:04.522582] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41683 primary records. [2025-10-07T22:35:04.524886] [INFO ] [MAIN ] Derivative Progress: 163/1748 symbols completed. BBAI took 1.2s. Estimated remaining: 10m 14s. Rate: 154.9 symbols/min [2025-10-07T22:35:04.522863] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-07T22:35:04.557873] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-07T22:35:04.558314] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-07T22:35:04.560818] [INFO ] [MAIN ] Derivative Progress: 164/1748 symbols completed. BBAR took 1.2s. Estimated remaining: 10m 10s. Rate: 155.8 symbols/min [2025-10-07T22:35:04.561195] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:04.562017] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53239 primary records. [2025-10-07T22:35:04.562082] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-07T22:35:04.577722] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-10-07T22:35:04.577787] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-07T22:35:04.580444] [INFO ] [MAIN ] Derivative Progress: 165/1748 symbols completed. BBD took 1.2s. Estimated remaining: 10m 6s. Rate: 156.7 symbols/min [2025-10-07T22:35:04.580923] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:04.580981] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:04.580870] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:04.593143] [DEBUG] [LOCAL ] BBDO: Loaded 4997 existing records from primary storage. [2025-10-07T22:35:04.593336] [DEBUG] [LOCAL ] BBU: Loaded 5038 existing records from primary storage. [2025-10-07T22:35:04.593499] [INFO ] [MAIN ] BBU: Loaded 5038 primary data records. [2025-10-07T22:35:04.593568] [INFO ] [MAIN ] BBDO: Loaded 4997 primary data records. [2025-10-07T22:35:04.963343] [DEBUG] [LOCAL ] BBDC: Loaded 32890 existing records from primary storage. [2025-10-07T22:35:05.088868] [INFO ] [MAIN ] BBDC: Loaded 32890 primary data records. [2025-10-07T22:35:05.633727] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:05.634986] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 5038 primary records. [2025-10-07T22:35:05.635310] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-07T22:35:05.650452] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:05.651635] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 4997 primary records. [2025-10-07T22:35:05.662600] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-07T22:35:05.673233] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-10-07T22:35:05.673475] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-07T22:35:05.675572] [INFO ] [MAIN ] Derivative Progress: 166/1748 symbols completed. BBU took 1.1s. Estimated remaining: 10m 13s. Rate: 154.9 symbols/min [2025-10-07T22:35:05.683736] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:05.694950] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-07T22:35:05.695218] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-07T22:35:05.707608] [INFO ] [MAIN ] Derivative Progress: 167/1748 symbols completed. BBDO took 1.1s. Estimated remaining: 10m 9s. Rate: 155.8 symbols/min [2025-10-07T22:35:05.713228] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:05.713409] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:05.714377] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 32890 primary records. [2025-10-07T22:35:05.714844] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-07T22:35:05.740574] [DEBUG] [LOCAL ] BBUC: Loaded 13427 existing records from primary storage. [2025-10-07T22:35:05.742127] [INFO ] [MAIN ] BBUC: Loaded 13427 primary data records. [2025-10-07T22:35:05.742048] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-07T22:35:05.742316] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-07T22:35:05.766424] [INFO ] [MAIN ] Derivative Progress: 168/1748 symbols completed. BBDC took 1.2s. Estimated remaining: 10m 5s. Rate: 156.6 symbols/min [2025-10-07T22:35:05.793509] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:06.091747] [DEBUG] [LOCAL ] BBVA: Loaded 49183 existing records from primary storage. [2025-10-07T22:35:06.092744] [INFO ] [MAIN ] BBVA: Loaded 49183 primary data records. [2025-10-07T22:35:06.092604] [DEBUG] [LOCAL ] BBW: Loaded 27006 existing records from primary storage. [2025-10-07T22:35:06.093033] [INFO ] [MAIN ] BBW: Loaded 27006 primary data records. [2025-10-07T22:35:06.765695] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:06.767140] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13427 primary records. [2025-10-07T22:35:06.767495] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-07T22:35:06.785806] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-10-07T22:35:06.786022] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-07T22:35:06.788238] [INFO ] [MAIN ] Derivative Progress: 169/1748 symbols completed. BBUC took 1.1s. Estimated remaining: 10m 11s. Rate: 155.0 symbols/min [2025-10-07T22:35:06.788497] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:06.822976] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:06.823460] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:06.824859] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 27006 primary records. [2025-10-07T22:35:06.824197] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49183 primary records. [2025-10-07T22:35:06.824958] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-07T22:35:06.825035] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-07T22:35:06.854223] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-07T22:35:06.855691] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-07T22:35:06.858435] [INFO ] [MAIN ] Derivative Progress: 170/1748 symbols completed. BBW took 1.1s. Estimated remaining: 10m 8s. Rate: 155.8 symbols/min [2025-10-07T22:35:06.860333] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:06.860176] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-07T22:35:06.860610] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-07T22:35:06.863080] [INFO ] [MAIN ] Derivative Progress: 171/1748 symbols completed. BBVA took 1.1s. Estimated remaining: 10m 4s. Rate: 156.7 symbols/min [2025-10-07T22:35:06.863410] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:06.904808] [DEBUG] [LOCAL ] BBWI: Loaded 53581 existing records from primary storage. [2025-10-07T22:35:06.905159] [INFO ] [MAIN ] BBWI: Loaded 53581 primary data records. [2025-10-07T22:35:07.146411] [DEBUG] [LOCAL ] BBY: Loaded 53455 existing records from primary storage. [2025-10-07T22:35:07.262110] [INFO ] [MAIN ] BBY: Loaded 53455 primary data records. [2025-10-07T22:35:07.330548] [DEBUG] [LOCAL ] BC: Loaded 44173 existing records from primary storage. [2025-10-07T22:35:07.378470] [INFO ] [MAIN ] BC: Loaded 44173 primary data records. [2025-10-07T22:35:07.903541] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:07.906595] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53581 primary records. [2025-10-07T22:35:07.907018] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-07T22:35:07.924964] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-07T22:35:07.926593] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-07T22:35:07.928926] [INFO ] [MAIN ] Derivative Progress: 172/1748 symbols completed. BBWI took 1.1s. Estimated remaining: 10m 10s. Rate: 155.1 symbols/min [2025-10-07T22:35:07.929288] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:07.956357] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:07.957319] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53455 primary records. [2025-10-07T22:35:07.957395] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-07T22:35:07.994377] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:07.995407] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44173 primary records. [2025-10-07T22:35:07.993930] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-10-07T22:35:08.003316] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-07T22:35:08.005528] [INFO ] [MAIN ] Derivative Progress: 173/1748 symbols completed. BBY took 1.1s. Estimated remaining: 10m 6s. Rate: 155.8 symbols/min [2025-10-07T22:35:08.005809] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:08.005695] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-07T22:35:08.033292] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-07T22:35:08.034437] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-07T22:35:08.035099] [DEBUG] [LOCAL ] BCAT: Loaded 34059 existing records from primary storage. [2025-10-07T22:35:08.035192] [INFO ] [MAIN ] BCAT: Loaded 34059 primary data records. [2025-10-07T22:35:08.037572] [INFO ] [MAIN ] Derivative Progress: 174/1748 symbols completed. BC took 1.2s. Estimated remaining: 10m 3s. Rate: 156.6 symbols/min [2025-10-07T22:35:08.037883] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:08.402353] [DEBUG] [LOCAL ] BCH: Loaded 29740 existing records from primary storage. [2025-10-07T22:35:08.403104] [INFO ] [MAIN ] BCH: Loaded 29740 primary data records. [2025-10-07T22:35:08.506938] [DEBUG] [LOCAL ] BCE: Loaded 52205 existing records from primary storage. [2025-10-07T22:35:08.531007] [INFO ] [MAIN ] BCE: Loaded 52205 primary data records. [2025-10-07T22:35:09.064537] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:09.066073] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34059 primary records. [2025-10-07T22:35:09.066585] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-07T22:35:09.088608] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-07T22:35:09.090211] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-07T22:35:09.092780] [INFO ] [MAIN ] Derivative Progress: 175/1748 symbols completed. BCAT took 1.2s. Estimated remaining: 10m 9s. Rate: 155.1 symbols/min [2025-10-07T22:35:09.093395] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:09.108334] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:09.109484] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 29740 primary records. [2025-10-07T22:35:09.109586] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-07T22:35:09.142957] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-10-07T22:35:09.156148] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-07T22:35:09.156883] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:09.159592] [INFO ] [MAIN ] Derivative Progress: 176/1748 symbols completed. BCH took 1.1s. Estimated remaining: 10m 5s. Rate: 155.8 symbols/min [2025-10-07T22:35:09.160554] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52205 primary records. [2025-10-07T22:35:09.160717] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-07T22:35:09.161285] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:09.171483] [DEBUG] [LOCAL ] BDC: Loaded 24590 existing records from primary storage. [2025-10-07T22:35:09.182734] [INFO ] [MAIN ] BDC: Loaded 24590 primary data records. [2025-10-07T22:35:09.269854] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-07T22:35:09.288219] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-07T22:35:09.296788] [INFO ] [MAIN ] Derivative Progress: 177/1748 symbols completed. BCE took 1.3s. Estimated remaining: 10m 3s. Rate: 156.4 symbols/min [2025-10-07T22:35:09.304401] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:09.329093] [DEBUG] [LOCAL ] BDJ: Loaded 29018 existing records from primary storage. [2025-10-07T22:35:09.359339] [INFO ] [MAIN ] BDJ: Loaded 29018 primary data records. [2025-10-07T22:35:09.833659] [DEBUG] [LOCAL ] BDN: Loaded 47541 existing records from primary storage. [2025-10-07T22:35:09.851586] [INFO ] [MAIN ] BDN: Loaded 47541 primary data records. [2025-10-07T22:35:09.979838] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:10.022318] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24590 primary records. [2025-10-07T22:35:10.032470] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-07T22:35:10.255927] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-07T22:35:10.256382] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-07T22:35:10.258842] [INFO ] [MAIN ] Derivative Progress: 178/1748 symbols completed. BDC took 1.2s. Estimated remaining: 10m 7s. Rate: 155.1 symbols/min [2025-10-07T22:35:10.278724] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:10.279483] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29018 primary records. [2025-10-07T22:35:10.279856] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-07T22:35:10.296190] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-07T22:35:10.296285] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-07T22:35:10.298861] [INFO ] [MAIN ] Derivative Progress: 179/1748 symbols completed. BDJ took 1.1s. Estimated remaining: 10m 4s. Rate: 155.9 symbols/min [2025-10-07T22:35:10.314438] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:10.315114] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47541 primary records. [2025-10-07T22:35:10.315175] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-07T22:35:10.334419] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-10-07T22:35:10.334528] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-07T22:35:10.337697] [INFO ] [MAIN ] Derivative Progress: 180/1748 symbols completed. BDN took 1.0s. Estimated remaining: 10m 1s. Rate: 156.6 symbols/min [2025-10-07T22:35:10.338303] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:10.338446] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:10.338221] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:10.434842] [DEBUG] [LOCAL ] BE: Loaded 53659 existing records from primary storage. [2025-10-07T22:35:10.435064] [INFO ] [MAIN ] BE: Loaded 53659 primary data records. [2025-10-07T22:35:10.436049] [DEBUG] [LOCAL ] BEKE: Loaded 53231 existing records from primary storage. [2025-10-07T22:35:10.457088] [INFO ] [MAIN ] BEKE: Loaded 53231 primary data records. [2025-10-07T22:35:10.642916] [DEBUG] [LOCAL ] BDX: Loaded 52271 existing records from primary storage. [2025-10-07T22:35:10.657458] [INFO ] [MAIN ] BDX: Loaded 52271 primary data records. [2025-10-07T22:35:11.424941] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:11.428570] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53659 primary records. [2025-10-07T22:35:11.429620] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-07T22:35:11.427462] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:11.430985] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53231 primary records. [2025-10-07T22:35:11.432309] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-07T22:35:11.464820] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-10-07T22:35:11.465051] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-07T22:35:11.467477] [INFO ] [MAIN ] Derivative Progress: 181/1748 symbols completed. BE took 1.1s. Estimated remaining: 10m 7s. Rate: 155.0 symbols/min [2025-10-07T22:35:11.465350] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:11.479248] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:11.480430] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52271 primary records. [2025-10-07T22:35:11.488164] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-07T22:35:11.508247] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-07T22:35:11.508880] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-07T22:35:11.515909] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-07T22:35:11.516116] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-07T22:35:11.513598] [INFO ] [MAIN ] Derivative Progress: 182/1748 symbols completed. BDX took 1.2s. Estimated remaining: 10m 3s. Rate: 155.7 symbols/min [2025-10-07T22:35:11.518944] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:11.519187] [INFO ] [MAIN ] Derivative Progress: 183/1748 symbols completed. BEKE took 1.2s. Estimated remaining: 9m 60s. Rate: 156.6 symbols/min [2025-10-07T22:35:11.519981] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:11.543464] [DEBUG] [LOCAL ] BEPH: Loaded 5357 existing records from primary storage. [2025-10-07T22:35:11.543796] [INFO ] [MAIN ] BEPH: Loaded 5357 primary data records. [2025-10-07T22:35:11.693452] [DEBUG] [LOCAL ] BEN: Loaded 53046 existing records from primary storage. [2025-10-07T22:35:11.713688] [INFO ] [MAIN ] BEN: Loaded 53046 primary data records. [2025-10-07T22:35:12.000419] [DEBUG] [LOCAL ] BEP: Loaded 38827 existing records from primary storage. [2025-10-07T22:35:12.012512] [INFO ] [MAIN ] BEP: Loaded 38827 primary data records. [2025-10-07T22:35:12.595163] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:12.596133] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5357 primary records. [2025-10-07T22:35:12.596233] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-07T22:35:12.629582] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-10-07T22:35:12.629821] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-07T22:35:12.632054] [INFO ] [MAIN ] Derivative Progress: 184/1748 symbols completed. BEPH took 1.1s. Estimated remaining: 10m 6s. Rate: 155.0 symbols/min [2025-10-07T22:35:12.632339] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:12.629202] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:12.633885] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53046 primary records. [2025-10-07T22:35:12.634077] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-07T22:35:12.667070] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:12.667615] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-07T22:35:12.670556] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38827 primary records. [2025-10-07T22:35:12.670803] [DEBUG] [LOCAL ] BEPI: Loaded 3587 existing records from primary storage. [2025-10-07T22:35:12.670879] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-07T22:35:12.673932] [INFO ] [MAIN ] Derivative Progress: 185/1748 symbols completed. BEN took 1.2s. Estimated remaining: 10m 2s. Rate: 155.7 symbols/min [2025-10-07T22:35:12.674040] [INFO ] [MAIN ] BEPI: Loaded 3587 primary data records. [2025-10-07T22:35:12.670959] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-07T22:35:12.685818] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:12.775152] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-07T22:35:12.792895] [DEBUG] [LOCAL ] BEPJ: Loaded 3141 existing records from primary storage. [2025-10-07T22:35:12.793255] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-07T22:35:12.803683] [INFO ] [MAIN ] BEPJ: Loaded 3141 primary data records. [2025-10-07T22:35:12.812370] [INFO ] [MAIN ] Derivative Progress: 186/1748 symbols completed. BEP took 1.3s. Estimated remaining: 9m 60s. Rate: 156.2 symbols/min [2025-10-07T22:35:12.817622] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:13.304455] [DEBUG] [LOCAL ] BFAM: Loaded 33486 existing records from primary storage. [2025-10-07T22:35:13.305467] [INFO ] [MAIN ] BFAM: Loaded 33486 primary data records. [2025-10-07T22:35:13.501110] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:13.588487] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3587 primary records. [2025-10-07T22:35:13.620842] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-07T22:35:13.653425] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:13.655430] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3141 primary records. [2025-10-07T22:35:13.655553] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-07T22:35:13.655605] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-07T22:35:13.656543] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-07T22:35:13.658753] [INFO ] [MAIN ] Derivative Progress: 187/1748 symbols completed. BEPI took 1.0s. Estimated remaining: 10m 3s. Rate: 155.2 symbols/min [2025-10-07T22:35:13.664800] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:13.675020] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-10-07T22:35:13.675143] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-07T22:35:13.677577] [INFO ] [MAIN ] Derivative Progress: 188/1748 symbols completed. BEPJ took 1.0s. Estimated remaining: 9m 60s. Rate: 156.0 symbols/min [2025-10-07T22:35:13.677985] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:13.697997] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:13.698823] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33486 primary records. [2025-10-07T22:35:13.702460] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-07T22:35:13.731677] [DEBUG] [LOCAL ] BFK: Loaded 13628 existing records from primary storage. [2025-10-07T22:35:13.733098] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-07T22:35:13.733273] [INFO ] [MAIN ] BFK: Loaded 13628 primary data records. [2025-10-07T22:35:13.745047] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-07T22:35:13.757032] [INFO ] [MAIN ] Derivative Progress: 189/1748 symbols completed. BFAM took 0.9s. Estimated remaining: 9m 57s. Rate: 156.7 symbols/min [2025-10-07T22:35:13.757207] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:13.839432] [DEBUG] [LOCAL ] BFH: Loaded 41518 existing records from primary storage. [2025-10-07T22:35:13.850007] [INFO ] [MAIN ] BFH: Loaded 41518 primary data records. [2025-10-07T22:35:14.419110] [DEBUG] [LOCAL ] BFLY: Loaded 51810 existing records from primary storage. [2025-10-07T22:35:14.420587] [INFO ] [MAIN ] BFLY: Loaded 51810 primary data records. [2025-10-07T22:35:14.746033] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:14.747429] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13628 primary records. [2025-10-07T22:35:14.749126] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-07T22:35:14.768111] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-07T22:35:14.768570] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-07T22:35:14.770991] [INFO ] [MAIN ] Derivative Progress: 190/1748 symbols completed. BFK took 1.1s. Estimated remaining: 10m 2s. Rate: 155.3 symbols/min [2025-10-07T22:35:14.779632] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:14.786572] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:14.787452] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41518 primary records. [2025-10-07T22:35:14.787552] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-07T22:35:14.811186] [DEBUG] [LOCAL ] BFS: Loaded 9327 existing records from primary storage. [2025-10-07T22:35:14.811855] [INFO ] [MAIN ] BFS: Loaded 9327 primary data records. [2025-10-07T22:35:14.843744] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-10-07T22:35:14.868448] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-07T22:35:14.871586] [INFO ] [MAIN ] Derivative Progress: 191/1748 symbols completed. BFH took 1.2s. Estimated remaining: 9m 59s. Rate: 156.0 symbols/min [2025-10-07T22:35:14.880538] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:14.942044] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:14.989188] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51810 primary records. [2025-10-07T22:35:14.996000] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-07T22:35:15.143154] [DEBUG] [LOCAL ] BFZ: Loaded 11914 existing records from primary storage. [2025-10-07T22:35:15.143913] [INFO ] [MAIN ] BFZ: Loaded 11914 primary data records. [2025-10-07T22:35:15.342981] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-07T22:35:15.343165] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-07T22:35:15.447728] [INFO ] [MAIN ] Derivative Progress: 192/1748 symbols completed. BFLY took 1.7s. Estimated remaining: 10m 0s. Rate: 155.5 symbols/min [2025-10-07T22:35:15.461756] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:15.487700] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:15.488599] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9327 primary records. [2025-10-07T22:35:15.488942] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-07T22:35:15.530358] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-07T22:35:15.535941] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-07T22:35:15.536138] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:15.538740] [INFO ] [MAIN ] Derivative Progress: 193/1748 symbols completed. BFS took 0.8s. Estimated remaining: 9m 57s. Rate: 156.2 symbols/min [2025-10-07T22:35:15.539691] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11914 primary records. [2025-10-07T22:35:15.539804] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-07T22:35:15.555931] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-07T22:35:15.569372] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-07T22:35:15.571738] [INFO ] [MAIN ] Derivative Progress: 194/1748 symbols completed. BFZ took 0.7s. Estimated remaining: 9m 54s. Rate: 156.9 symbols/min [2025-10-07T22:35:15.573046] [DEBUG] [LOCAL ] BG: Loaded 50444 existing records from primary storage. [2025-10-07T22:35:15.573122] [INFO ] [MAIN ] BG: Loaded 50444 primary data records. [2025-10-07T22:35:15.874785] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:15.875379] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50444 primary records. [2025-10-07T22:35:15.875440] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-07T22:35:15.890920] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-07T22:35:15.890984] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-07T22:35:15.893162] [INFO ] [MAIN ] Derivative Progress: 195/1748 symbols completed. BG took 0.4s. Estimated remaining: 9m 53s. Rate: 157.0 symbols/min [2025-10-07T22:35:15.893819] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:15.893904] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:15.893964] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:15.917363] [DEBUG] [LOCAL ] BGR: Loaded 13482 existing records from primary storage. [2025-10-07T22:35:15.917504] [INFO ] [MAIN ] BGR: Loaded 13482 primary data records. [2025-10-07T22:35:15.998753] [DEBUG] [LOCAL ] BGB: Loaded 17853 existing records from primary storage. [2025-10-07T22:35:16.024857] [INFO ] [MAIN ] BGB: Loaded 17853 primary data records. [2025-10-07T22:35:16.413009] [DEBUG] [LOCAL ] BGS: Loaded 50456 existing records from primary storage. [2025-10-07T22:35:16.454428] [INFO ] [MAIN ] BGS: Loaded 50456 primary data records. [2025-10-07T22:35:16.991036] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:16.992106] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13482 primary records. [2025-10-07T22:35:16.992327] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-07T22:35:17.011289] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-07T22:35:17.012961] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-07T22:35:17.016269] [INFO ] [MAIN ] Derivative Progress: 196/1748 symbols completed. BGR took 1.1s. Estimated remaining: 9m 59s. Rate: 155.5 symbols/min [2025-10-07T22:35:17.017556] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:17.045619] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:17.046490] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17853 primary records. [2025-10-07T22:35:17.048275] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-07T22:35:17.051739] [DEBUG] [LOCAL ] BGSF: Loaded 7706 existing records from primary storage. [2025-10-07T22:35:17.052595] [INFO ] [MAIN ] BGSF: Loaded 7706 primary data records. [2025-10-07T22:35:17.101905] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-07T22:35:17.074621] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:17.117693] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50456 primary records. [2025-10-07T22:35:17.111860] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-07T22:35:17.126708] [INFO ] [MAIN ] Derivative Progress: 197/1748 symbols completed. BGB took 1.2s. Estimated remaining: 9m 56s. Rate: 156.1 symbols/min [2025-10-07T22:35:17.126813] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-07T22:35:17.147368] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:17.214765] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-07T22:35:17.252236] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-07T22:35:17.280689] [INFO ] [MAIN ] Derivative Progress: 198/1748 symbols completed. BGS took 1.4s. Estimated remaining: 9m 54s. Rate: 156.5 symbols/min [2025-10-07T22:35:17.382135] [DEBUG] [LOCAL ] BGX: Loaded 11063 existing records from primary storage. [2025-10-07T22:35:17.398321] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:17.411778] [INFO ] [MAIN ] BGX: Loaded 11063 primary data records. [2025-10-07T22:35:17.633226] [DEBUG] [LOCAL ] BGY: Loaded 22024 existing records from primary storage. [2025-10-07T22:35:17.676845] [INFO ] [MAIN ] BGY: Loaded 22024 primary data records. [2025-10-07T22:35:18.115580] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:18.117080] [INFO ] [MAIN ] BGSF: Generated 1794 derivative records from 7706 primary records. [2025-10-07T22:35:18.117341] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-07T22:35:18.138593] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-10-07T22:35:18.138901] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-07T22:35:18.141991] [INFO ] [MAIN ] Derivative Progress: 199/1748 symbols completed. BGSF took 1.1s. Estimated remaining: 9m 57s. Rate: 155.6 symbols/min [2025-10-07T22:35:18.155915] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:18.156194] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:18.157137] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 11063 primary records. [2025-10-07T22:35:18.157602] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-07T22:35:18.173921] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-07T22:35:18.174033] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-07T22:35:18.176504] [INFO ] [MAIN ] Derivative Progress: 200/1748 symbols completed. BGX took 1.0s. Estimated remaining: 9m 54s. Rate: 156.3 symbols/min [2025-10-07T22:35:18.176702] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:18.198476] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:18.199335] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 22024 primary records. [2025-10-07T22:35:18.205179] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-07T22:35:18.205042] [DEBUG] [LOCAL ] BH: Loaded 16167 existing records from primary storage. [2025-10-07T22:35:18.205808] [INFO ] [MAIN ] BH: Loaded 16167 primary data records. [2025-10-07T22:35:18.405617] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-07T22:35:18.526257] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-07T22:35:18.528960] [INFO ] [MAIN ] Derivative Progress: 201/1748 symbols completed. BGY took 1.1s. Estimated remaining: 9m 54s. Rate: 156.3 symbols/min [2025-10-07T22:35:18.541081] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:18.543634] [DEBUG] [LOCAL ] BHC: Loaded 46839 existing records from primary storage. [2025-10-07T22:35:18.544551] [INFO ] [MAIN ] BHC: Loaded 46839 primary data records. [2025-10-07T22:35:18.869881] [DEBUG] [LOCAL ] BHE: Loaded 24238 existing records from primary storage. [2025-10-07T22:35:18.870891] [INFO ] [MAIN ] BHE: Loaded 24238 primary data records. [2025-10-07T22:35:19.001876] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:19.018452] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 16167 primary records. [2025-10-07T22:35:19.023847] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-07T22:35:19.224966] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-10-07T22:35:19.233405] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-07T22:35:19.242106] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:19.241731] [INFO ] [MAIN ] Derivative Progress: 202/1748 symbols completed. BH took 1.1s. Estimated remaining: 9m 56s. Rate: 155.7 symbols/min [2025-10-07T22:35:19.243016] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46839 primary records. [2025-10-07T22:35:19.243272] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-07T22:35:19.243179] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:19.261588] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-07T22:35:19.261850] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-07T22:35:19.264187] [INFO ] [MAIN ] Derivative Progress: 203/1748 symbols completed. BHC took 1.1s. Estimated remaining: 9m 53s. Rate: 156.4 symbols/min [2025-10-07T22:35:19.264507] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:19.296691] [DEBUG] [LOCAL ] BHK: Loaded 23307 existing records from primary storage. [2025-10-07T22:35:19.296920] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:19.297270] [INFO ] [MAIN ] BHK: Loaded 23307 primary data records. [2025-10-07T22:35:19.298113] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 24238 primary records. [2025-10-07T22:35:19.309294] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-07T22:35:19.415234] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-07T22:35:19.415512] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-07T22:35:19.418170] [INFO ] [MAIN ] Derivative Progress: 204/1748 symbols completed. BHE took 0.9s. Estimated remaining: 9m 51s. Rate: 156.9 symbols/min [2025-10-07T22:35:19.424089] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:19.651773] [DEBUG] [LOCAL ] BHR: Loaded 21777 existing records from primary storage. [2025-10-07T22:35:19.654027] [INFO ] [MAIN ] BHR: Loaded 21777 primary data records. [2025-10-07T22:35:19.660456] [DEBUG] [LOCAL ] BHP: Loaded 53371 existing records from primary storage. [2025-10-07T22:35:19.667151] [INFO ] [MAIN ] BHP: Loaded 53371 primary data records. [2025-10-07T22:35:20.343869] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:20.345151] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23307 primary records. [2025-10-07T22:35:20.345335] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-07T22:35:20.382130] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-07T22:35:20.382772] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-07T22:35:20.385428] [INFO ] [MAIN ] Derivative Progress: 205/1748 symbols completed. BHK took 1.1s. Estimated remaining: 9m 55s. Rate: 155.7 symbols/min [2025-10-07T22:35:20.382538] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:20.387687] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:20.387387] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21777 primary records. [2025-10-07T22:35:20.389155] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-07T22:35:20.416143] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:20.417460] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53371 primary records. [2025-10-07T22:35:20.418113] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-07T22:35:20.435114] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-07T22:35:20.435857] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-07T22:35:20.438412] [INFO ] [MAIN ] Derivative Progress: 206/1748 symbols completed. BHR took 1.0s. Estimated remaining: 9m 52s. Rate: 156.4 symbols/min [2025-10-07T22:35:20.439279] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:20.452838] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-10-07T22:35:20.452936] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-07T22:35:20.456268] [INFO ] [MAIN ] Derivative Progress: 207/1748 symbols completed. BHP took 1.2s. Estimated remaining: 9m 49s. Rate: 157.1 symbols/min [2025-10-07T22:35:20.456628] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:20.491917] [DEBUG] [LOCAL ] BHVN: Loaded 50123 existing records from primary storage. [2025-10-07T22:35:20.492143] [INFO ] [MAIN ] BHVN: Loaded 50123 primary data records. [2025-10-07T22:35:20.591408] [DEBUG] [LOCAL ] BIO: Loaded 24515 existing records from primary storage. [2025-10-07T22:35:20.622103] [INFO ] [MAIN ] BIO: Loaded 24515 primary data records. [2025-10-07T22:35:20.697187] [DEBUG] [LOCAL ] BILL: Loaded 52380 existing records from primary storage. [2025-10-07T22:35:20.722581] [INFO ] [MAIN ] BILL: Loaded 52380 primary data records. [2025-10-07T22:35:21.484675] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:21.489859] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:21.490587] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 24515 primary records. [2025-10-07T22:35:21.491456] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 50123 primary records. [2025-10-07T22:35:21.490886] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-07T22:35:21.491584] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-07T22:35:21.526425] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-07T22:35:21.526327] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-07T22:35:21.526725] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-07T22:35:21.537400] [INFO ] [MAIN ] Derivative Progress: 208/1748 symbols completed. BIO took 1.1s. Estimated remaining: 9m 53s. Rate: 155.7 symbols/min [2025-10-07T22:35:21.542897] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-07T22:35:21.545329] [INFO ] [MAIN ] Derivative Progress: 209/1748 symbols completed. BHVN took 1.2s. Estimated remaining: 9m 50s. Rate: 156.4 symbols/min [2025-10-07T22:35:21.545771] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:21.546758] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52380 primary records. [2025-10-07T22:35:21.546950] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-07T22:35:21.562110] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-07T22:35:21.562169] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-07T22:35:21.564816] [INFO ] [MAIN ] Derivative Progress: 210/1748 symbols completed. BILL took 1.1s. Estimated remaining: 9m 47s. Rate: 157.2 symbols/min [2025-10-07T22:35:21.565223] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:21.565278] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:21.565755] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:21.571536] [DEBUG] [LOCAL ] BIPH: Loaded 2558 existing records from primary storage. [2025-10-07T22:35:21.571737] [INFO ] [MAIN ] BIPH: Loaded 2558 primary data records. [2025-10-07T22:35:21.795830] [DEBUG] [LOCAL ] BIP: Loaded 39410 existing records from primary storage. [2025-10-07T22:35:21.898010] [INFO ] [MAIN ] BIP: Loaded 39410 primary data records. [2025-10-07T22:35:22.009402] [DEBUG] [LOCAL ] BIPC: Loaded 41252 existing records from primary storage. [2025-10-07T22:35:22.022749] [INFO ] [MAIN ] BIPC: Loaded 41252 primary data records. [2025-10-07T22:35:22.588824] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:35:22.590499] [INFO ] [MAIN ] BIPH: Generated 1793 derivative records from 2558 primary records. [2025-10-07T22:35:22.591569] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-07T22:35:22.609281] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1793 records). [2025-10-07T22:35:22.609747] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-07T22:35:22.612492] [INFO ] [MAIN ] Derivative Progress: 211/1748 symbols completed. BIPH took 1.0s. Estimated remaining: 9m 52s. Rate: 155.9 symbols/min [2025-10-07T22:35:22.612759] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:22.622018] [DEBUG] [LOCAL ] BIPI: Loaded 3159 existing records from primary storage. [2025-10-07T22:35:22.635895] [INFO ] [MAIN ] BIPI: Loaded 3159 primary data records. [2025-10-07T22:35:22.635628] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:22.660441] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39410 primary records. [2025-10-07T22:35:22.667800] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-07T22:35:22.778867] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-07T22:35:22.797484] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-07T22:35:22.807712] [INFO ] [MAIN ] Derivative Progress: 212/1748 symbols completed. BIP took 1.2s. Estimated remaining: 9m 50s. Rate: 156.2 symbols/min [2025-10-07T22:35:22.847612] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:22.849896] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:22.977380] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41252 primary records. [2025-10-07T22:35:22.977883] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-07T22:35:23.001101] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-07T22:35:23.001637] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-07T22:35:22.999498] [DEBUG] [LOCAL ] BIPJ: Loaded 3146 existing records from primary storage. [2025-10-07T22:35:23.001966] [INFO ] [MAIN ] BIPJ: Loaded 3146 primary data records. [2025-10-07T22:35:23.004860] [INFO ] [MAIN ] Derivative Progress: 213/1748 symbols completed. BIPC took 1.4s. Estimated remaining: 9m 48s. Rate: 156.6 symbols/min [2025-10-07T22:35:23.016625] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:23.350197] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:35:23.364933] [INFO ] [MAIN ] BIPI: Generated 1793 derivative records from 3159 primary records. [2025-10-07T22:35:23.366606] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-07T22:35:23.368566] [DEBUG] [LOCAL ] BIRK: Loaded 50954 existing records from primary storage. [2025-10-07T22:35:23.368795] [INFO ] [MAIN ] BIRK: Loaded 50954 primary data records. [2025-10-07T22:35:23.426931] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1793 records). [2025-10-07T22:35:23.448547] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-07T22:35:23.456070] [INFO ] [MAIN ] Derivative Progress: 214/1748 symbols completed. BIPI took 0.8s. Estimated remaining: 9m 48s. Rate: 156.5 symbols/min [2025-10-07T22:35:23.473826] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:23.710670] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:23.712032] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3146 primary records. [2025-10-07T22:35:23.712267] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-07T22:35:23.737504] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-07T22:35:23.737027] [DEBUG] [LOCAL ] BIT: Loaded 23137 existing records from primary storage. [2025-10-07T22:35:23.737852] [INFO ] [MAIN ] BIT: Loaded 23137 primary data records. [2025-10-07T22:35:23.737730] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-07T22:35:23.740513] [INFO ] [MAIN ] Derivative Progress: 215/1748 symbols completed. BIPJ took 0.9s. Estimated remaining: 9m 47s. Rate: 156.6 symbols/min [2025-10-07T22:35:23.752891] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:24.146861] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:24.168753] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50954 primary records. [2025-10-07T22:35:24.170981] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-07T22:35:24.185567] [DEBUG] [LOCAL ] BJ: Loaded 51495 existing records from primary storage. [2025-10-07T22:35:24.191892] [INFO ] [MAIN ] BJ: Loaded 51495 primary data records. [2025-10-07T22:35:24.273368] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-07T22:35:24.295885] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-07T22:35:24.306293] [INFO ] [MAIN ] Derivative Progress: 216/1748 symbols completed. BIRK took 1.3s. Estimated remaining: 9m 48s. Rate: 156.3 symbols/min [2025-10-07T22:35:24.311144] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:24.536287] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:24.546885] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 23137 primary records. [2025-10-07T22:35:24.547527] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-07T22:35:24.568122] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-07T22:35:24.568603] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-07T22:35:24.571740] [INFO ] [MAIN ] Derivative Progress: 217/1748 symbols completed. BIT took 1.1s. Estimated remaining: 9m 47s. Rate: 156.5 symbols/min [2025-10-07T22:35:24.572496] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:24.626213] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:24.628240] [DEBUG] [LOCAL ] BK: Loaded 53536 existing records from primary storage. [2025-10-07T22:35:24.628432] [INFO ] [MAIN ] BK: Loaded 53536 primary data records. [2025-10-07T22:35:24.627102] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51495 primary records. [2025-10-07T22:35:24.628634] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-07T22:35:24.790762] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-07T22:35:24.806348] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-07T22:35:24.835965] [INFO ] [MAIN ] Derivative Progress: 218/1748 symbols completed. BJ took 1.1s. Estimated remaining: 9m 46s. Rate: 156.7 symbols/min [2025-10-07T22:35:24.867015] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:24.861543] [DEBUG] [LOCAL ] BKD: Loaded 50321 existing records from primary storage. [2025-10-07T22:35:24.954721] [INFO ] [MAIN ] BKD: Loaded 50321 primary data records. [2025-10-07T22:35:25.328054] [DEBUG] [LOCAL ] BKE: Loaded 34102 existing records from primary storage. [2025-10-07T22:35:25.328513] [INFO ] [MAIN ] BKE: Loaded 34102 primary data records. [2025-10-07T22:35:25.550236] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:25.668833] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53536 primary records. [2025-10-07T22:35:25.669327] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-07T22:35:25.690258] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-07T22:35:25.691164] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-07T22:35:25.695075] [INFO ] [MAIN ] Derivative Progress: 219/1748 symbols completed. BK took 1.4s. Estimated remaining: 9m 49s. Rate: 155.9 symbols/min [2025-10-07T22:35:25.695667] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:25.716059] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:25.717373] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50321 primary records. [2025-10-07T22:35:25.717698] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-07T22:35:25.736318] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-07T22:35:25.736590] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-07T22:35:25.741182] [INFO ] [MAIN ] Derivative Progress: 220/1748 symbols completed. BKD took 1.2s. Estimated remaining: 9m 46s. Rate: 156.5 symbols/min [2025-10-07T22:35:25.743417] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:25.757611] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:25.758430] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 34102 primary records. [2025-10-07T22:35:25.758625] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-07T22:35:25.784369] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-10-07T22:35:25.785206] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-07T22:35:25.788109] [INFO ] [MAIN ] Derivative Progress: 221/1748 symbols completed. BKE took 0.9s. Estimated remaining: 9m 43s. Rate: 157.1 symbols/min [2025-10-07T22:35:25.788375] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:25.803232] [DEBUG] [LOCAL ] BKH: Loaded 36861 existing records from primary storage. [2025-10-07T22:35:25.811460] [INFO ] [MAIN ] BKH: Loaded 36861 primary data records. [2025-10-07T22:35:25.937725] [DEBUG] [LOCAL ] BKN: Loaded 7685 existing records from primary storage. [2025-10-07T22:35:25.937349] [DEBUG] [LOCAL ] BKKT: Loaded 35633 existing records from primary storage. [2025-10-07T22:35:25.938485] [INFO ] [MAIN ] BKKT: Loaded 35633 primary data records. [2025-10-07T22:35:25.938408] [INFO ] [MAIN ] BKN: Loaded 7685 primary data records. [2025-10-07T22:35:26.837665] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:26.838766] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36861 primary records. [2025-10-07T22:35:26.839406] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-07T22:35:26.862536] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-10-07T22:35:26.862823] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-07T22:35:26.865880] [INFO ] [MAIN ] Derivative Progress: 222/1748 symbols completed. BKH took 1.2s. Estimated remaining: 9m 48s. Rate: 155.8 symbols/min [2025-10-07T22:35:26.867022] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:26.883443] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:26.897154] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7685 primary records. [2025-10-07T22:35:26.897804] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-07T22:35:26.898156] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:26.899746] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 35633 primary records. [2025-10-07T22:35:26.899936] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-07T22:35:26.929148] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-07T22:35:26.929821] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-07T22:35:26.932808] [INFO ] [MAIN ] Derivative Progress: 223/1748 symbols completed. BKKT took 1.2s. Estimated remaining: 9m 45s. Rate: 156.4 symbols/min [2025-10-07T22:35:26.935661] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-07T22:35:26.935745] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-07T22:35:26.949524] [INFO ] [MAIN ] Derivative Progress: 224/1748 symbols completed. BKN took 1.2s. Estimated remaining: 9m 42s. Rate: 157.1 symbols/min [2025-10-07T22:35:26.970423] [DEBUG] [LOCAL ] BKSY: Loaded 48400 existing records from primary storage. [2025-10-07T22:35:26.970628] [INFO ] [MAIN ] BKSY: Loaded 48400 primary data records. [2025-10-07T22:35:27.289262] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:27.290037] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48400 primary records. [2025-10-07T22:35:27.290103] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-07T22:35:27.305391] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-07T22:35:27.305448] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-07T22:35:27.307615] [INFO ] [MAIN ] Derivative Progress: 225/1748 symbols completed. BKSY took 0.4s. Estimated remaining: 9m 42s. Rate: 157.1 symbols/min [2025-10-07T22:35:27.308489] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:27.308370] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:27.308778] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:27.369634] [DEBUG] [LOCAL ] BLCO: Loaded 35528 existing records from primary storage. [2025-10-07T22:35:27.370988] [INFO ] [MAIN ] BLCO: Loaded 35528 primary data records. [2025-10-07T22:35:27.371594] [DEBUG] [LOCAL ] BKV: Loaded 29802 existing records from primary storage. [2025-10-07T22:35:27.383108] [INFO ] [MAIN ] BKV: Loaded 29802 primary data records. [2025-10-07T22:35:27.570717] [DEBUG] [LOCAL ] BKU: Loaded 41591 existing records from primary storage. [2025-10-07T22:35:27.597217] [INFO ] [MAIN ] BKU: Loaded 41591 primary data records. [2025-10-07T22:35:28.385232] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:28.386178] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35528 primary records. [2025-10-07T22:35:28.386370] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-07T22:35:28.401288] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:28.409511] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29802 primary records. [2025-10-07T22:35:28.409633] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-07T22:35:28.418364] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-07T22:35:28.418464] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-07T22:35:28.422033] [INFO ] [MAIN ] Derivative Progress: 226/1748 symbols completed. BLCO took 1.1s. Estimated remaining: 9m 46s. Rate: 155.8 symbols/min [2025-10-07T22:35:28.429366] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:28.449770] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:28.450809] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41591 primary records. [2025-10-07T22:35:28.451194] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-07T22:35:28.461987] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-07T22:35:28.462155] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-07T22:35:28.465436] [INFO ] [MAIN ] Derivative Progress: 227/1748 symbols completed. BKV took 1.2s. Estimated remaining: 9m 43s. Rate: 156.4 symbols/min [2025-10-07T22:35:28.468216] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:28.472954] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-07T22:35:28.473055] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-07T22:35:28.475463] [INFO ] [MAIN ] Derivative Progress: 228/1748 symbols completed. BKU took 1.2s. Estimated remaining: 9m 41s. Rate: 157.1 symbols/min [2025-10-07T22:35:28.475715] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:28.496343] [DEBUG] [LOCAL ] BLD: Loaded 27585 existing records from primary storage. [2025-10-07T22:35:28.496519] [INFO ] [MAIN ] BLD: Loaded 27585 primary data records. [2025-10-07T22:35:28.603360] [DEBUG] [LOCAL ] BLE: Loaded 14063 existing records from primary storage. [2025-10-07T22:35:28.606890] [INFO ] [MAIN ] BLE: Loaded 14063 primary data records. [2025-10-07T22:35:28.847225] [DEBUG] [LOCAL ] BLDR: Loaded 51691 existing records from primary storage. [2025-10-07T22:35:29.001966] [INFO ] [MAIN ] BLDR: Loaded 51691 primary data records. [2025-10-07T22:35:29.493382] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:35:29.487785] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:29.494436] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14063 primary records. [2025-10-07T22:35:29.495545] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-07T22:35:29.495289] [INFO ] [MAIN ] BLD: Generated 1793 derivative records from 27585 primary records. [2025-10-07T22:35:29.508917] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-07T22:35:29.522801] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-07T22:35:29.523023] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-07T22:35:29.529326] [INFO ] [MAIN ] Derivative Progress: 229/1748 symbols completed. BLE took 1.1s. Estimated remaining: 9m 45s. Rate: 155.9 symbols/min [2025-10-07T22:35:29.530035] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:29.534055] [DEBUG] [LOCAL ] BLD: Derivative data saved (1793 records). [2025-10-07T22:35:29.534263] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-07T22:35:29.536357] [INFO ] [MAIN ] Derivative Progress: 230/1748 symbols completed. BLD took 1.1s. Estimated remaining: 9m 42s. Rate: 156.6 symbols/min [2025-10-07T22:35:29.536868] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:29.554448] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:29.555255] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51691 primary records. [2025-10-07T22:35:29.555371] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-07T22:35:29.572108] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-07T22:35:29.572220] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-07T22:35:29.575726] [INFO ] [MAIN ] Derivative Progress: 231/1748 symbols completed. BLDR took 1.1s. Estimated remaining: 9m 39s. Rate: 157.2 symbols/min [2025-10-07T22:35:29.576112] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:29.619440] [DEBUG] [LOCAL ] BLW: Loaded 13323 existing records from primary storage. [2025-10-07T22:35:29.620817] [INFO ] [MAIN ] BLW: Loaded 13323 primary data records. [2025-10-07T22:35:29.620680] [DEBUG] [LOCAL ] BLK: Loaded 34141 existing records from primary storage. [2025-10-07T22:35:29.654234] [INFO ] [MAIN ] BLK: Loaded 34141 primary data records. [2025-10-07T22:35:29.708751] [DEBUG] [LOCAL ] BLND: Loaded 49214 existing records from primary storage. [2025-10-07T22:35:29.709044] [INFO ] [MAIN ] BLND: Loaded 49214 primary data records. [2025-10-07T22:35:30.676786] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:30.679948] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 13323 primary records. [2025-10-07T22:35:30.684236] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-07T22:35:30.699266] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:30.713802] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49214 primary records. [2025-10-07T22:35:30.714285] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-07T22:35:30.714152] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:30.724100] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34141 primary records. [2025-10-07T22:35:30.724471] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-07T22:35:30.767422] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-07T22:35:30.768786] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-07T22:35:30.770588] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-07T22:35:30.770444] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-10-07T22:35:30.771048] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-07T22:35:30.773832] [INFO ] [MAIN ] Derivative Progress: 232/1748 symbols completed. BLK took 1.2s. Estimated remaining: 9m 44s. Rate: 155.7 symbols/min [2025-10-07T22:35:30.770964] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-07T22:35:30.779886] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:30.780100] [INFO ] [MAIN ] Derivative Progress: 233/1748 symbols completed. BLND took 1.2s. Estimated remaining: 9m 41s. Rate: 156.4 symbols/min [2025-10-07T22:35:30.780633] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:30.780926] [INFO ] [MAIN ] Derivative Progress: 234/1748 symbols completed. BLW took 1.2s. Estimated remaining: 9m 38s. Rate: 157.1 symbols/min [2025-10-07T22:35:30.781551] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:30.805532] [DEBUG] [LOCAL ] BME: Loaded 11037 existing records from primary storage. [2025-10-07T22:35:30.806273] [INFO ] [MAIN ] BME: Loaded 11037 primary data records. [2025-10-07T22:35:30.806746] [DEBUG] [LOCAL ] BLX: Loaded 15607 existing records from primary storage. [2025-10-07T22:35:30.828027] [INFO ] [MAIN ] BLX: Loaded 15607 primary data records. [2025-10-07T22:35:31.099052] [DEBUG] [LOCAL ] BMA: Loaded 35599 existing records from primary storage. [2025-10-07T22:35:31.141668] [INFO ] [MAIN ] BMA: Loaded 35599 primary data records. [2025-10-07T22:35:31.781958] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:31.784597] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 11037 primary records. [2025-10-07T22:35:31.784840] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-07T22:35:31.810429] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:31.812524] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15607 primary records. [2025-10-07T22:35:31.813666] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-07T22:35:31.816417] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-07T22:35:31.824695] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-07T22:35:31.835294] [INFO ] [MAIN ] Derivative Progress: 235/1748 symbols completed. BME took 1.1s. Estimated remaining: 9m 42s. Rate: 155.9 symbols/min [2025-10-07T22:35:31.836372] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:31.837021] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-07T22:35:31.837241] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-07T22:35:31.840033] [INFO ] [MAIN ] Derivative Progress: 236/1748 symbols completed. BLX took 1.1s. Estimated remaining: 9m 40s. Rate: 156.5 symbols/min [2025-10-07T22:35:31.848726] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:31.854472] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:31.855471] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 35599 primary records. [2025-10-07T22:35:31.855636] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-07T22:35:31.872257] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-07T22:35:31.872534] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-07T22:35:31.875099] [INFO ] [MAIN ] Derivative Progress: 237/1748 symbols completed. BMA took 1.1s. Estimated remaining: 9m 37s. Rate: 157.1 symbols/min [2025-10-07T22:35:31.882435] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:31.892240] [DEBUG] [LOCAL ] BMN: Loaded 2582 existing records from primary storage. [2025-10-07T22:35:31.892462] [INFO ] [MAIN ] BMN: Loaded 2582 primary data records. [2025-10-07T22:35:31.992625] [DEBUG] [LOCAL ] BMEZ: Loaded 26653 existing records from primary storage. [2025-10-07T22:35:32.014263] [DEBUG] [LOCAL ] BMI: Loaded 24368 existing records from primary storage. [2025-10-07T22:35:32.010735] [INFO ] [MAIN ] BMEZ: Loaded 26653 primary data records. [2025-10-07T22:35:32.014738] [INFO ] [MAIN ] BMI: Loaded 24368 primary data records. [2025-10-07T22:35:32.888276] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:32.889187] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2582 primary records. [2025-10-07T22:35:32.889314] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-07T22:35:32.905297] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-10-07T22:35:32.905421] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-07T22:35:32.907732] [INFO ] [MAIN ] Derivative Progress: 238/1748 symbols completed. BMN took 1.0s. Estimated remaining: 9m 41s. Rate: 156.0 symbols/min [2025-10-07T22:35:32.928858] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:32.929937] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26653 primary records. [2025-10-07T22:35:32.930064] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-07T22:35:32.943811] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:32.944874] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24368 primary records. [2025-10-07T22:35:32.945180] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-07T22:35:32.977315] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-07T22:35:32.977234] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-10-07T22:35:32.977466] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-07T22:35:32.977542] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-07T22:35:32.980264] [INFO ] [MAIN ] Derivative Progress: 239/1748 symbols completed. BMEZ took 1.1s. Estimated remaining: 9m 38s. Rate: 156.6 symbols/min [2025-10-07T22:35:32.983009] [INFO ] [MAIN ] Derivative Progress: 240/1748 symbols completed. BMI took 1.1s. Estimated remaining: 9m 36s. Rate: 157.2 symbols/min [2025-10-07T22:35:32.983674] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:32.983741] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:32.983898] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:33.029262] [DEBUG] [LOCAL ] BMO: Loaded 41146 existing records from primary storage. [2025-10-07T22:35:33.029407] [INFO ] [MAIN ] BMO: Loaded 41146 primary data records. [2025-10-07T22:35:33.249046] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-07T22:35:33.254626] [INFO ] [MAIN ] BN: Loaded 52993 primary data records. [2025-10-07T22:35:33.458860] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-07T22:35:33.471358] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-07T22:35:34.063627] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:34.064976] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41146 primary records. [2025-10-07T22:35:34.065270] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-07T22:35:34.086614] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-07T22:35:34.086829] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-07T22:35:34.089506] [INFO ] [MAIN ] Derivative Progress: 241/1748 symbols completed. BMO took 1.1s. Estimated remaining: 9m 40s. Rate: 156.0 symbols/min [2025-10-07T22:35:34.089698] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:34.107326] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:34.108804] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52993 primary records. [2025-10-07T22:35:34.109066] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-07T22:35:34.124219] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:34.137049] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-10-07T22:35:34.138700] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-07T22:35:34.150438] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-07T22:35:34.158254] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-07T22:35:34.169091] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-10-07T22:35:34.169338] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-07T22:35:34.168972] [INFO ] [MAIN ] Derivative Progress: 242/1748 symbols completed. BN took 1.2s. Estimated remaining: 9m 37s. Rate: 156.5 symbols/min [2025-10-07T22:35:34.172382] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:34.172587] [INFO ] [MAIN ] Derivative Progress: 243/1748 symbols completed. BMY took 1.2s. Estimated remaining: 9m 35s. Rate: 157.1 symbols/min [2025-10-07T22:35:34.173351] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:34.187074] [DEBUG] [LOCAL ] BNED: Loaded 29337 existing records from primary storage. [2025-10-07T22:35:34.189769] [INFO ] [MAIN ] BNED: Loaded 29337 primary data records. [2025-10-07T22:35:34.224043] [DEBUG] [LOCAL ] BNJ: Loaded 2661 existing records from primary storage. [2025-10-07T22:35:34.258123] [INFO ] [MAIN ] BNJ: Loaded 2661 primary data records. [2025-10-07T22:35:34.279794] [DEBUG] [LOCAL ] BNH: Loaded 5256 existing records from primary storage. [2025-10-07T22:35:34.324576] [INFO ] [MAIN ] BNH: Loaded 5256 primary data records. [2025-10-07T22:35:35.231471] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:35.233401] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2661 primary records. [2025-10-07T22:35:35.233529] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-07T22:35:35.249143] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:35.249928] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 29337 primary records. [2025-10-07T22:35:35.256964] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-07T22:35:35.291675] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-07T22:35:35.300858] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-07T22:35:35.301497] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-07T22:35:35.299839] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-07T22:35:35.301327] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:35.304887] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 5256 primary records. [2025-10-07T22:35:35.303718] [INFO ] [MAIN ] Derivative Progress: 244/1748 symbols completed. BNED took 1.2s. Estimated remaining: 9m 39s. Rate: 155.9 symbols/min [2025-10-07T22:35:35.307714] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-07T22:35:35.307559] [INFO ] [MAIN ] Derivative Progress: 245/1748 symbols completed. BNJ took 1.1s. Estimated remaining: 9m 36s. Rate: 156.5 symbols/min [2025-10-07T22:35:35.308024] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:35.307477] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:35.326120] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-07T22:35:35.326316] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-07T22:35:35.328500] [INFO ] [MAIN ] Derivative Progress: 246/1748 symbols completed. BNH took 1.2s. Estimated remaining: 9m 34s. Rate: 157.1 symbols/min [2025-10-07T22:35:35.329151] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:35.340563] [DEBUG] [LOCAL ] BNT: Loaded 3349 existing records from primary storage. [2025-10-07T22:35:35.341001] [INFO ] [MAIN ] BNT: Loaded 3349 primary data records. [2025-10-07T22:35:35.552595] [DEBUG] [LOCAL ] BNS: Loaded 51478 existing records from primary storage. [2025-10-07T22:35:35.561754] [INFO ] [MAIN ] BNS: Loaded 51478 primary data records. [2025-10-07T22:35:35.626263] [DEBUG] [LOCAL ] BNL: Loaded 47159 existing records from primary storage. [2025-10-07T22:35:35.740716] [INFO ] [MAIN ] BNL: Loaded 47159 primary data records. [2025-10-07T22:35:36.426836] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:35:36.428346] [INFO ] [MAIN ] BNT: Generated 1793 derivative records from 3349 primary records. [2025-10-07T22:35:36.428746] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-07T22:35:36.446028] [DEBUG] [LOCAL ] BNT: Derivative data saved (1793 records). [2025-10-07T22:35:36.446699] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-07T22:35:36.448572] [INFO ] [MAIN ] Derivative Progress: 247/1748 symbols completed. BNT took 1.1s. Estimated remaining: 9m 38s. Rate: 155.9 symbols/min [2025-10-07T22:35:36.448766] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:36.490101] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:36.494747] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51478 primary records. [2025-10-07T22:35:36.494984] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-07T22:35:36.495696] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:36.495946] [DEBUG] [LOCAL ] BNY: Loaded 7242 existing records from primary storage. [2025-10-07T22:35:36.496713] [INFO ] [MAIN ] BNY: Loaded 7242 primary data records. [2025-10-07T22:35:36.519123] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 47159 primary records. [2025-10-07T22:35:36.528820] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-07T22:35:36.629961] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-07T22:35:36.630695] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-07T22:35:36.633274] [INFO ] [MAIN ] Derivative Progress: 248/1748 symbols completed. BNL took 1.3s. Estimated remaining: 9m 36s. Rate: 156.2 symbols/min [2025-10-07T22:35:36.644523] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:36.639312] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-07T22:35:36.673883] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-07T22:35:36.708996] [INFO ] [MAIN ] Derivative Progress: 249/1748 symbols completed. BNS took 1.4s. Estimated remaining: 9m 34s. Rate: 156.7 symbols/min [2025-10-07T22:35:36.714542] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:36.852275] [DEBUG] [LOCAL ] BOC: Loaded 18321 existing records from primary storage. [2025-10-07T22:35:36.853467] [INFO ] [MAIN ] BOC: Loaded 18321 primary data records. [2025-10-07T22:35:36.999050] [DEBUG] [LOCAL ] BOH: Loaded 30506 existing records from primary storage. [2025-10-07T22:35:37.026228] [INFO ] [MAIN ] BOH: Loaded 30506 primary data records. [2025-10-07T22:35:37.296289] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:37.303039] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7242 primary records. [2025-10-07T22:35:37.308265] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-07T22:35:37.513839] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-07T22:35:37.515313] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-07T22:35:37.517583] [INFO ] [MAIN ] Derivative Progress: 250/1748 symbols completed. BNY took 1.1s. Estimated remaining: 9m 36s. Rate: 156.0 symbols/min [2025-10-07T22:35:37.517883] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:37.542927] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:37.543701] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18321 primary records. [2025-10-07T22:35:37.543923] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-07T22:35:37.585394] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-07T22:35:37.585712] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-07T22:35:37.589204] [INFO ] [MAIN ] Derivative Progress: 251/1748 symbols completed. BOC took 0.9s. Estimated remaining: 9m 34s. Rate: 156.5 symbols/min [2025-10-07T22:35:37.586449] [DEBUG] [LOCAL ] BOND: Loaded 32226 existing records from primary storage. [2025-10-07T22:35:37.597622] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:37.589421] [INFO ] [MAIN ] BOND: Loaded 32226 primary data records. [2025-10-07T22:35:37.603874] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:37.642252] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30506 primary records. [2025-10-07T22:35:37.675789] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-07T22:35:37.935722] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-07T22:35:37.936069] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-07T22:35:37.938185] [INFO ] [MAIN ] Derivative Progress: 252/1748 symbols completed. BOH took 1.2s. Estimated remaining: 9m 33s. Rate: 156.6 symbols/min [2025-10-07T22:35:37.938410] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:37.958891] [DEBUG] [LOCAL ] BOOT: Loaded 40234 existing records from primary storage. [2025-10-07T22:35:37.960525] [INFO ] [MAIN ] BOOT: Loaded 40234 primary data records. [2025-10-07T22:35:38.289104] [DEBUG] [LOCAL ] BORR: Loaded 51100 existing records from primary storage. [2025-10-07T22:35:38.343210] [INFO ] [MAIN ] BORR: Loaded 51100 primary data records. [2025-10-07T22:35:38.349720] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:35:38.350795] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32226 primary records. [2025-10-07T22:35:38.397974] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-07T22:35:38.733770] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-10-07T22:35:38.733924] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-07T22:35:38.736048] [INFO ] [MAIN ] Derivative Progress: 253/1748 symbols completed. BOND took 1.2s. Estimated remaining: 9m 35s. Rate: 155.9 symbols/min [2025-10-07T22:35:38.755447] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:38.756286] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 40234 primary records. [2025-10-07T22:35:38.756678] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-07T22:35:38.776697] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-07T22:35:38.776864] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-07T22:35:38.779108] [INFO ] [MAIN ] Derivative Progress: 254/1748 symbols completed. BOOT took 1.2s. Estimated remaining: 9m 33s. Rate: 156.5 symbols/min [2025-10-07T22:35:38.792535] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:38.793135] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51100 primary records. [2025-10-07T22:35:38.793198] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-07T22:35:38.809609] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-10-07T22:35:38.809704] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-07T22:35:38.812037] [INFO ] [MAIN ] Derivative Progress: 255/1748 symbols completed. BORR took 0.9s. Estimated remaining: 9m 30s. Rate: 157.0 symbols/min [2025-10-07T22:35:38.812466] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:38.812407] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:38.812558] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:38.863775] [DEBUG] [LOCAL ] BOW: Loaded 23806 existing records from primary storage. [2025-10-07T22:35:38.864085] [INFO ] [MAIN ] BOW: Loaded 23806 primary data records. [2025-10-07T22:35:38.980838] [DEBUG] [LOCAL ] BR: Loaded 34891 existing records from primary storage. [2025-10-07T22:35:38.991904] [INFO ] [MAIN ] BR: Loaded 34891 primary data records. [2025-10-07T22:35:39.283798] [DEBUG] [LOCAL ] BP: Loaded 53709 existing records from primary storage. [2025-10-07T22:35:39.318534] [INFO ] [MAIN ] BP: Loaded 53709 primary data records. [2025-10-07T22:35:39.831119] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:39.835313] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23806 primary records. [2025-10-07T22:35:39.835955] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-07T22:35:39.850511] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:39.863204] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34891 primary records. [2025-10-07T22:35:39.865019] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-07T22:35:39.868815] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-07T22:35:39.876574] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-07T22:35:39.882138] [INFO ] [MAIN ] Derivative Progress: 256/1748 symbols completed. BOW took 1.1s. Estimated remaining: 9m 34s. Rate: 155.9 symbols/min [2025-10-07T22:35:39.882485] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:39.890738] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-07T22:35:39.891948] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-07T22:35:39.894068] [INFO ] [MAIN ] Derivative Progress: 257/1748 symbols completed. BR took 1.1s. Estimated remaining: 9m 31s. Rate: 156.5 symbols/min [2025-10-07T22:35:39.895232] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:39.910283] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:39.911227] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53709 primary records. [2025-10-07T22:35:39.911501] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-07T22:35:39.942761] [DEBUG] [LOCAL ] BRC: Loaded 18876 existing records from primary storage. [2025-10-07T22:35:39.955817] [INFO ] [MAIN ] BRC: Loaded 18876 primary data records. [2025-10-07T22:35:39.981622] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-10-07T22:35:39.997879] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-07T22:35:40.033674] [INFO ] [MAIN ] Derivative Progress: 258/1748 symbols completed. BP took 1.2s. Estimated remaining: 9m 30s. Rate: 156.9 symbols/min [2025-10-07T22:35:40.068981] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:40.069134] [DEBUG] [LOCAL ] BRBR: Loaded 51420 existing records from primary storage. [2025-10-07T22:35:40.074576] [INFO ] [MAIN ] BRBR: Loaded 51420 primary data records. [2025-10-07T22:35:40.649294] [DEBUG] [LOCAL ] BRCC: Loaded 40149 existing records from primary storage. [2025-10-07T22:35:40.649548] [INFO ] [MAIN ] BRCC: Loaded 40149 primary data records. [2025-10-07T22:35:40.984801] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:40.986533] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 18876 primary records. [2025-10-07T22:35:40.986893] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-07T22:35:41.023183] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:41.025169] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51420 primary records. [2025-10-07T22:35:41.026205] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-07T22:35:41.027736] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-07T22:35:41.027834] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-07T22:35:41.031146] [INFO ] [MAIN ] Derivative Progress: 259/1748 symbols completed. BRC took 1.1s. Estimated remaining: 9m 33s. Rate: 156.0 symbols/min [2025-10-07T22:35:41.031359] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:41.048221] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-10-07T22:35:41.048704] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-07T22:35:41.051010] [INFO ] [MAIN ] Derivative Progress: 260/1748 symbols completed. BRBR took 1.2s. Estimated remaining: 9m 30s. Rate: 156.5 symbols/min [2025-10-07T22:35:41.051360] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:41.069371] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:41.070408] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40149 primary records. [2025-10-07T22:35:41.070502] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-07T22:35:41.124562] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-07T22:35:41.124759] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-07T22:35:41.127095] [INFO ] [MAIN ] Derivative Progress: 261/1748 symbols completed. BRCC took 1.1s. Estimated remaining: 9m 28s. Rate: 157.0 symbols/min [2025-10-07T22:35:41.127518] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:41.176168] [DEBUG] [LOCAL ] BRO: Loaded 51940 existing records from primary storage. [2025-10-07T22:35:41.176502] [INFO ] [MAIN ] BRO: Loaded 51940 primary data records. [2025-10-07T22:35:41.296547] [DEBUG] [LOCAL ] BROS: Loaded 53293 existing records from primary storage. [2025-10-07T22:35:41.309396] [INFO ] [MAIN ] BROS: Loaded 53293 primary data records. [2025-10-07T22:35:41.345975] [DEBUG] [LOCAL ] BRSP: Loaded 36656 existing records from primary storage. [2025-10-07T22:35:41.367754] [INFO ] [MAIN ] BRSP: Loaded 36656 primary data records. [2025-10-07T22:35:42.147976] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:42.149423] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51940 primary records. [2025-10-07T22:35:42.149770] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-07T22:35:42.169257] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-10-07T22:35:42.170679] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-07T22:35:42.172676] [INFO ] [MAIN ] Derivative Progress: 262/1748 symbols completed. BRO took 1.1s. Estimated remaining: 9m 32s. Rate: 156.0 symbols/min [2025-10-07T22:35:42.175116] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:42.193030] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:42.194115] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36656 primary records. [2025-10-07T22:35:42.194253] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-07T22:35:42.216512] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:42.224854] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-07T22:35:42.225047] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-07T22:35:42.225905] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53293 primary records. [2025-10-07T22:35:42.228671] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-07T22:35:42.228457] [INFO ] [MAIN ] Derivative Progress: 263/1748 symbols completed. BRSP took 1.1s. Estimated remaining: 9m 29s. Rate: 156.5 symbols/min [2025-10-07T22:35:42.228924] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:42.252500] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-07T22:35:42.252742] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-07T22:35:42.255293] [INFO ] [MAIN ] Derivative Progress: 264/1748 symbols completed. BROS took 1.2s. Estimated remaining: 9m 27s. Rate: 157.0 symbols/min [2025-10-07T22:35:42.255603] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:42.294630] [DEBUG] [LOCAL ] BSAC: Loaded 32827 existing records from primary storage. [2025-10-07T22:35:42.308853] [INFO ] [MAIN ] BSAC: Loaded 32827 primary data records. [2025-10-07T22:35:42.361241] [DEBUG] [LOCAL ] BRX: Loaded 51770 existing records from primary storage. [2025-10-07T22:35:42.404103] [INFO ] [MAIN ] BRX: Loaded 51770 primary data records. [2025-10-07T22:35:42.484556] [DEBUG] [LOCAL ] BSM: Loaded 32094 existing records from primary storage. [2025-10-07T22:35:42.513961] [INFO ] [MAIN ] BSM: Loaded 32094 primary data records. [2025-10-07T22:35:43.341267] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:43.342566] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51770 primary records. [2025-10-07T22:35:43.343057] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-07T22:35:43.342834] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:43.344214] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32827 primary records. [2025-10-07T22:35:43.345427] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-07T22:35:43.377797] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-07T22:35:43.379179] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-07T22:35:43.382057] [INFO ] [MAIN ] Derivative Progress: 265/1748 symbols completed. BRX took 1.2s. Estimated remaining: 9m 31s. Rate: 155.9 symbols/min [2025-10-07T22:35:43.396545] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:43.397286] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:43.399314] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32094 primary records. [2025-10-07T22:35:43.399796] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-07T22:35:43.399417] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-10-07T22:35:43.399903] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-07T22:35:43.401922] [INFO ] [MAIN ] Derivative Progress: 266/1748 symbols completed. BSAC took 1.2s. Estimated remaining: 9m 28s. Rate: 156.4 symbols/min [2025-10-07T22:35:43.402576] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:43.427153] [DEBUG] [LOCAL ] BTA: Loaded 5458 existing records from primary storage. [2025-10-07T22:35:43.427805] [INFO ] [MAIN ] BTA: Loaded 5458 primary data records. [2025-10-07T22:35:43.493020] [DEBUG] [LOCAL ] BST: Loaded 19001 existing records from primary storage. [2025-10-07T22:35:43.507792] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-10-07T22:35:43.529709] [INFO ] [MAIN ] BST: Loaded 19001 primary data records. [2025-10-07T22:35:43.529839] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-07T22:35:43.546483] [INFO ] [MAIN ] Derivative Progress: 267/1748 symbols completed. BSM took 1.3s. Estimated remaining: 9m 27s. Rate: 156.8 symbols/min [2025-10-07T22:35:43.590330] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:44.146118] [DEBUG] [LOCAL ] BTE: Loaded 52715 existing records from primary storage. [2025-10-07T22:35:44.148166] [INFO ] [MAIN ] BTE: Loaded 52715 primary data records. [2025-10-07T22:35:44.247594] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:44.260086] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5458 primary records. [2025-10-07T22:35:44.268289] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-07T22:35:44.336779] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:44.370710] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 19001 primary records. [2025-10-07T22:35:44.378322] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-07T22:35:44.510403] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-07T22:35:44.515498] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-07T22:35:44.518451] [INFO ] [MAIN ] Derivative Progress: 268/1748 symbols completed. BTA took 1.1s. Estimated remaining: 9m 30s. Rate: 155.9 symbols/min [2025-10-07T22:35:44.525304] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-07T22:35:44.525449] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-07T22:35:44.528094] [INFO ] [MAIN ] Derivative Progress: 269/1748 symbols completed. BST took 1.1s. Estimated remaining: 9m 27s. Rate: 156.5 symbols/min [2025-10-07T22:35:44.547812] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:44.548470] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52715 primary records. [2025-10-07T22:35:44.548541] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-07T22:35:44.564112] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-10-07T22:35:44.564195] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-07T22:35:44.566697] [INFO ] [MAIN ] Derivative Progress: 270/1748 symbols completed. BTE took 1.0s. Estimated remaining: 9m 25s. Rate: 157.0 symbols/min [2025-10-07T22:35:44.567135] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:44.567438] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:44.567306] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:44.587024] [DEBUG] [LOCAL ] BTT: Loaded 15845 existing records from primary storage. [2025-10-07T22:35:44.587177] [INFO ] [MAIN ] BTT: Loaded 15845 primary data records. [2025-10-07T22:35:44.975038] [DEBUG] [LOCAL ] BTI: Loaded 53572 existing records from primary storage. [2025-10-07T22:35:44.989249] [INFO ] [MAIN ] BTI: Loaded 53572 primary data records. [2025-10-07T22:35:45.001320] [DEBUG] [LOCAL ] BTU: Loaded 53316 existing records from primary storage. [2025-10-07T22:35:45.011560] [INFO ] [MAIN ] BTU: Loaded 53316 primary data records. [2025-10-07T22:35:45.637034] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:45.639072] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15845 primary records. [2025-10-07T22:35:45.639839] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-07T22:35:45.663558] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-10-07T22:35:45.663796] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-07T22:35:45.666286] [INFO ] [MAIN ] Derivative Progress: 271/1748 symbols completed. BTT took 1.1s. Estimated remaining: 9m 28s. Rate: 155.9 symbols/min [2025-10-07T22:35:45.666593] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:45.699562] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:45.699292] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:45.700481] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53316 primary records. [2025-10-07T22:35:45.701181] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-07T22:35:45.701113] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53572 primary records. [2025-10-07T22:35:45.701292] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-07T22:35:45.742983] [DEBUG] [LOCAL ] BTZ: Loaded 22735 existing records from primary storage. [2025-10-07T22:35:45.744147] [INFO ] [MAIN ] BTZ: Loaded 22735 primary data records. [2025-10-07T22:35:45.757239] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-10-07T22:35:45.767936] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-07T22:35:45.768518] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-10-07T22:35:45.780804] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-07T22:35:45.770344] [INFO ] [MAIN ] Derivative Progress: 272/1748 symbols completed. BTI took 1.2s. Estimated remaining: 9m 26s. Rate: 156.3 symbols/min [2025-10-07T22:35:45.830634] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:45.835900] [INFO ] [MAIN ] Derivative Progress: 273/1748 symbols completed. BTU took 1.3s. Estimated remaining: 9m 24s. Rate: 156.8 symbols/min [2025-10-07T22:35:45.846412] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:46.071971] [DEBUG] [LOCAL ] BUI: Loaded 11784 existing records from primary storage. [2025-10-07T22:35:46.072180] [INFO ] [MAIN ] BUI: Loaded 11784 primary data records. [2025-10-07T22:35:46.405305] [DEBUG] [LOCAL ] BUD: Loaded 52706 existing records from primary storage. [2025-10-07T22:35:46.405748] [INFO ] [MAIN ] BUD: Loaded 52706 primary data records. [2025-10-07T22:35:46.509724] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:46.528253] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22735 primary records. [2025-10-07T22:35:46.554983] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-07T22:35:46.798229] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-07T22:35:46.800627] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-07T22:35:46.802706] [INFO ] [MAIN ] Derivative Progress: 274/1748 symbols completed. BTZ took 1.1s. Estimated remaining: 9m 27s. Rate: 156.0 symbols/min [2025-10-07T22:35:46.802999] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:46.819188] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:46.820089] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11784 primary records. [2025-10-07T22:35:46.820303] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-07T22:35:46.841921] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-10-07T22:35:46.842320] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-07T22:35:46.844957] [INFO ] [MAIN ] Derivative Progress: 275/1748 symbols completed. BUI took 1.0s. Estimated remaining: 9m 25s. Rate: 156.5 symbols/min [2025-10-07T22:35:46.845296] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:46.873483] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:46.874232] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52706 primary records. [2025-10-07T22:35:46.874299] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-07T22:35:46.913087] [DEBUG] [LOCAL ] BUXX: Loaded 15298 existing records from primary storage. [2025-10-07T22:35:46.913352] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-07T22:35:46.913639] [INFO ] [MAIN ] BUXX: Loaded 15298 primary data records. [2025-10-07T22:35:46.913888] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-07T22:35:46.916348] [INFO ] [MAIN ] Derivative Progress: 276/1748 symbols completed. BUD took 1.1s. Estimated remaining: 9m 23s. Rate: 156.9 symbols/min [2025-10-07T22:35:46.927707] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:46.972490] [DEBUG] [LOCAL ] BURL: Loaded 45815 existing records from primary storage. [2025-10-07T22:35:46.987211] [INFO ] [MAIN ] BURL: Loaded 45815 primary data records. [2025-10-07T22:35:47.554263] [DEBUG] [LOCAL ] BVN: Loaded 44028 existing records from primary storage. [2025-10-07T22:35:47.555294] [INFO ] [MAIN ] BVN: Loaded 44028 primary data records. [2025-10-07T22:35:47.898828] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:35:47.908581] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15298 primary records. [2025-10-07T22:35:47.915022] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-07T22:35:47.914872] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:47.916043] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45815 primary records. [2025-10-07T22:35:47.918112] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-07T22:35:47.951774] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-10-07T22:35:47.951675] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-07T22:35:47.952118] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-07T22:35:47.954298] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-07T22:35:47.954098] [INFO ] [MAIN ] Derivative Progress: 277/1748 symbols completed. BUXX took 1.1s. Estimated remaining: 9m 26s. Rate: 156.0 symbols/min [2025-10-07T22:35:47.954538] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:47.957858] [INFO ] [MAIN ] Derivative Progress: 278/1748 symbols completed. BURL took 1.2s. Estimated remaining: 9m 24s. Rate: 156.5 symbols/min [2025-10-07T22:35:47.958141] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:47.976916] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:47.977840] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 44028 primary records. [2025-10-07T22:35:47.978068] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-07T22:35:48.007557] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-07T22:35:48.007705] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-07T22:35:48.012221] [INFO ] [MAIN ] Derivative Progress: 279/1748 symbols completed. BVN took 1.1s. Estimated remaining: 9m 21s. Rate: 157.0 symbols/min [2025-10-07T22:35:48.012474] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:48.040297] [DEBUG] [LOCAL ] BW: Loaded 40087 existing records from primary storage. [2025-10-07T22:35:48.040666] [INFO ] [MAIN ] BW: Loaded 40087 primary data records. [2025-10-07T22:35:48.170819] [DEBUG] [LOCAL ] BWG: Loaded 12612 existing records from primary storage. [2025-10-07T22:35:48.187983] [INFO ] [MAIN ] BWG: Loaded 12612 primary data records. [2025-10-07T22:35:48.172136] [DEBUG] [LOCAL ] BWA: Loaded 52171 existing records from primary storage. [2025-10-07T22:35:48.193341] [INFO ] [MAIN ] BWA: Loaded 52171 primary data records. [2025-10-07T22:35:49.081545] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:49.082489] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 40087 primary records. [2025-10-07T22:35:49.082598] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-07T22:35:49.117961] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:49.119501] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52171 primary records. [2025-10-07T22:35:49.134766] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-07T22:35:49.134159] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:49.134703] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-10-07T22:35:49.136387] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12612 primary records. [2025-10-07T22:35:49.136546] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-07T22:35:49.137213] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-07T22:35:49.139499] [INFO ] [MAIN ] Derivative Progress: 280/1748 symbols completed. BW took 1.2s. Estimated remaining: 9m 25s. Rate: 155.9 symbols/min [2025-10-07T22:35:49.147469] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:49.171471] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-07T22:35:49.172286] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-07T22:35:49.172212] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-07T22:35:49.172403] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-07T22:35:49.174877] [INFO ] [MAIN ] Derivative Progress: 281/1748 symbols completed. BWA took 1.2s. Estimated remaining: 9m 23s. Rate: 156.4 symbols/min [2025-10-07T22:35:49.177366] [INFO ] [MAIN ] Derivative Progress: 282/1748 symbols completed. BWG took 1.2s. Estimated remaining: 9m 20s. Rate: 157.0 symbols/min [2025-10-07T22:35:49.177271] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:49.177966] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:49.188469] [DEBUG] [LOCAL ] BWNB: Loaded 4363 existing records from primary storage. [2025-10-07T22:35:49.188743] [INFO ] [MAIN ] BWNB: Loaded 4363 primary data records. [2025-10-07T22:35:49.275463] [DEBUG] [LOCAL ] BWMX: Loaded 7672 existing records from primary storage. [2025-10-07T22:35:49.304194] [INFO ] [MAIN ] BWMX: Loaded 7672 primary data records. [2025-10-07T22:35:49.458716] [DEBUG] [LOCAL ] BWLP: Loaded 32303 existing records from primary storage. [2025-10-07T22:35:49.496629] [INFO ] [MAIN ] BWLP: Loaded 32303 primary data records. [2025-10-07T22:35:50.167185] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:50.168282] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4363 primary records. [2025-10-07T22:35:50.170125] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-07T22:35:50.197607] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:50.199614] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7672 primary records. [2025-10-07T22:35:50.200385] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-07T22:35:50.216626] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-07T22:35:50.220911] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-10-07T22:35:50.221824] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-07T22:35:50.225185] [INFO ] [MAIN ] Derivative Progress: 283/1748 symbols completed. BWNB took 1.0s. Estimated remaining: 9m 23s. Rate: 156.0 symbols/min [2025-10-07T22:35:50.222897] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-07T22:35:50.228742] [INFO ] [MAIN ] Derivative Progress: 284/1748 symbols completed. BWMX took 1.1s. Estimated remaining: 9m 21s. Rate: 156.6 symbols/min [2025-10-07T22:35:50.244580] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:50.245324] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32303 primary records. [2025-10-07T22:35:50.245386] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-07T22:35:50.261017] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-07T22:35:50.261077] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-07T22:35:50.263300] [INFO ] [MAIN ] Derivative Progress: 285/1748 symbols completed. BWLP took 1.1s. Estimated remaining: 9m 19s. Rate: 157.1 symbols/min [2025-10-07T22:35:50.264257] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:50.263963] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:50.264118] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:50.280586] [DEBUG] [LOCAL ] BWSN: Loaded 5170 existing records from primary storage. [2025-10-07T22:35:50.286690] [INFO ] [MAIN ] BWSN: Loaded 5170 primary data records. [2025-10-07T22:35:50.319290] [DEBUG] [LOCAL ] BXC: Loaded 13701 existing records from primary storage. [2025-10-07T22:35:50.351981] [INFO ] [MAIN ] BXC: Loaded 13701 primary data records. [2025-10-07T22:35:50.963865] [DEBUG] [LOCAL ] BX: Loaded 53479 existing records from primary storage. [2025-10-07T22:35:50.964866] [INFO ] [MAIN ] BX: Loaded 53479 primary data records. [2025-10-07T22:35:51.303984] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:51.305956] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5170 primary records. [2025-10-07T22:35:51.306316] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-07T22:35:51.332877] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:51.337132] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-10-07T22:35:51.337946] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13701 primary records. [2025-10-07T22:35:51.338044] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-07T22:35:51.340689] [INFO ] [MAIN ] Derivative Progress: 286/1748 symbols completed. BWSN took 1.1s. Estimated remaining: 9m 22s. Rate: 156.1 symbols/min [2025-10-07T22:35:51.341019] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:51.338098] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-07T22:35:51.358866] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-10-07T22:35:51.359297] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-07T22:35:51.361804] [INFO ] [MAIN ] Derivative Progress: 287/1748 symbols completed. BXC took 1.1s. Estimated remaining: 9m 20s. Rate: 156.6 symbols/min [2025-10-07T22:35:51.362068] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:51.379153] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:35:51.380158] [INFO ] [MAIN ] BX: Generated 1793 derivative records from 53479 primary records. [2025-10-07T22:35:51.380346] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-07T22:35:51.401984] [DEBUG] [LOCAL ] BX: Derivative data saved (1793 records). [2025-10-07T22:35:51.402136] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-07T22:35:51.404391] [INFO ] [MAIN ] Derivative Progress: 288/1748 symbols completed. BX took 1.1s. Estimated remaining: 9m 18s. Rate: 157.1 symbols/min [2025-10-07T22:35:51.404737] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:51.424268] [DEBUG] [LOCAL ] BXMX: Loaded 19513 existing records from primary storage. [2025-10-07T22:35:51.424489] [INFO ] [MAIN ] BXMX: Loaded 19513 primary data records. [2025-10-07T22:35:51.545136] [DEBUG] [LOCAL ] BXMT: Loaded 47180 existing records from primary storage. [2025-10-07T22:35:51.566877] [INFO ] [MAIN ] BXMT: Loaded 47180 primary data records. [2025-10-07T22:35:51.952566] [DEBUG] [LOCAL ] BXP: Loaded 49822 existing records from primary storage. [2025-10-07T22:35:52.089032] [INFO ] [MAIN ] BXP: Loaded 49822 primary data records. [2025-10-07T22:35:52.440566] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:52.441679] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19513 primary records. [2025-10-07T22:35:52.442415] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-07T22:35:52.461932] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-10-07T22:35:52.464145] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-07T22:35:52.466586] [INFO ] [MAIN ] Derivative Progress: 289/1748 symbols completed. BXMX took 1.1s. Estimated remaining: 9m 21s. Rate: 156.1 symbols/min [2025-10-07T22:35:52.466951] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:52.483470] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:52.484543] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47180 primary records. [2025-10-07T22:35:52.484858] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-07T22:35:52.502853] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-10-07T22:35:52.503186] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-07T22:35:52.505366] [INFO ] [MAIN ] Derivative Progress: 290/1748 symbols completed. BXMT took 1.2s. Estimated remaining: 9m 19s. Rate: 156.6 symbols/min [2025-10-07T22:35:52.505776] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:52.523524] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:52.524298] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49822 primary records. [2025-10-07T22:35:52.524411] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-07T22:35:52.556338] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-07T22:35:52.556541] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-07T22:35:52.578469] [INFO ] [MAIN ] Derivative Progress: 291/1748 symbols completed. BXP took 1.2s. Estimated remaining: 9m 17s. Rate: 157.0 symbols/min [2025-10-07T22:35:52.581131] [DEBUG] [LOCAL ] BXSL: Loaded 47768 existing records from primary storage. [2025-10-07T22:35:52.580141] [DEBUG] [LOCAL ] BY: Loaded 21734 existing records from primary storage. [2025-10-07T22:35:52.580305] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:52.581628] [INFO ] [MAIN ] BY: Loaded 21734 primary data records. [2025-10-07T22:35:52.581462] [INFO ] [MAIN ] BXSL: Loaded 47768 primary data records. [2025-10-07T22:35:53.340333] [DEBUG] [LOCAL ] BYD: Loaded 44885 existing records from primary storage. [2025-10-07T22:35:53.356970] [INFO ] [MAIN ] BYD: Loaded 44885 primary data records. [2025-10-07T22:35:53.530958] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:53.544565] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21734 primary records. [2025-10-07T22:35:53.576699] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-07T22:35:53.582314] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:53.600032] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47768 primary records. [2025-10-07T22:35:53.616565] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-07T22:35:53.926627] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-10-07T22:35:53.933441] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-07T22:35:53.936892] [INFO ] [MAIN ] Derivative Progress: 292/1748 symbols completed. BXSL took 1.5s. Estimated remaining: 9m 21s. Rate: 155.7 symbols/min [2025-10-07T22:35:53.949760] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:53.951736] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-07T22:35:53.952252] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-07T22:35:53.954979] [INFO ] [MAIN ] Derivative Progress: 293/1748 symbols completed. BY took 1.4s. Estimated remaining: 9m 19s. Rate: 156.2 symbols/min [2025-10-07T22:35:53.955360] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:53.971555] [DEBUG] [LOCAL ] BYM: Loaded 11929 existing records from primary storage. [2025-10-07T22:35:53.971794] [INFO ] [MAIN ] BYM: Loaded 11929 primary data records. [2025-10-07T22:35:54.158438] [DEBUG] [LOCAL ] BZH: Loaded 32402 existing records from primary storage. [2025-10-07T22:35:54.221549] [INFO ] [MAIN ] BZH: Loaded 32402 primary data records. [2025-10-07T22:35:54.491303] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:54.519187] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 44885 primary records. [2025-10-07T22:35:54.540580] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-07T22:35:54.714616] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-07T22:35:54.715164] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-07T22:35:54.717754] [INFO ] [MAIN ] Derivative Progress: 294/1748 symbols completed. BYD took 2.1s. Estimated remaining: 9m 20s. Rate: 155.7 symbols/min [2025-10-07T22:35:54.718264] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:54.745588] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:54.746768] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 11929 primary records. [2025-10-07T22:35:54.747057] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-07T22:35:54.783769] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-07T22:35:54.784281] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:54.785215] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32402 primary records. [2025-10-07T22:35:54.784517] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-07T22:35:54.787521] [INFO ] [MAIN ] Derivative Progress: 295/1748 symbols completed. BYM took 0.8s. Estimated remaining: 9m 19s. Rate: 156.1 symbols/min [2025-10-07T22:35:54.787793] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:54.787685] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-07T22:35:54.818889] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-07T22:35:54.819026] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-07T22:35:54.821741] [INFO ] [MAIN ] Derivative Progress: 296/1748 symbols completed. BZH took 0.9s. Estimated remaining: 9m 16s. Rate: 156.6 symbols/min [2025-10-07T22:35:54.822170] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:54.845302] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-07T22:35:54.845638] [INFO ] [MAIN ] C: Loaded 53740 primary data records. [2025-10-07T22:35:54.912290] [DEBUG] [LOCAL ] CAAP: Loaded 19823 existing records from primary storage. [2025-10-07T22:35:54.954979] [DEBUG] [LOCAL ] CABO: Loaded 16889 existing records from primary storage. [2025-10-07T22:35:54.948844] [INFO ] [MAIN ] CAAP: Loaded 19823 primary data records. [2025-10-07T22:35:54.962572] [INFO ] [MAIN ] CABO: Loaded 16889 primary data records. [2025-10-07T22:35:55.859350] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:55.869151] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53740 primary records. [2025-10-07T22:35:55.874788] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-07T22:35:55.877105] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:55.885126] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19823 primary records. [2025-10-07T22:35:55.886334] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-07T22:35:55.895536] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-10-07T22:35:55.895668] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-07T22:35:55.898081] [INFO ] [MAIN ] Derivative Progress: 297/1748 symbols completed. C took 1.2s. Estimated remaining: 9m 19s. Rate: 155.6 symbols/min [2025-10-07T22:35:55.906478] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:55.927496] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:55.928933] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 16889 primary records. [2025-10-07T22:35:55.929493] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-07T22:35:55.950486] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-07T22:35:55.951297] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-07T22:35:55.954474] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-07T22:35:55.954681] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-07T22:35:55.954067] [INFO ] [MAIN ] Derivative Progress: 298/1748 symbols completed. CAAP took 1.2s. Estimated remaining: 9m 17s. Rate: 156.1 symbols/min [2025-10-07T22:35:55.957286] [INFO ] [MAIN ] Derivative Progress: 299/1748 symbols completed. CABO took 1.1s. Estimated remaining: 9m 15s. Rate: 156.6 symbols/min [2025-10-07T22:35:55.975046] [DEBUG] [LOCAL ] CACI: Loaded 24024 existing records from primary storage. [2025-10-07T22:35:55.975178] [INFO ] [MAIN ] CACI: Loaded 24024 primary data records. [2025-10-07T22:35:56.345219] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:56.346107] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 24024 primary records. [2025-10-07T22:35:56.346210] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-07T22:35:56.362231] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-10-07T22:35:56.362296] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-07T22:35:56.364478] [INFO ] [MAIN ] Derivative Progress: 300/1748 symbols completed. CACI took 0.5s. Estimated remaining: 9m 15s. Rate: 156.6 symbols/min [2025-10-07T22:35:56.365382] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:56.365314] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:56.365196] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:56.372929] [DEBUG] [LOCAL ] CAF: Loaded 3410 existing records from primary storage. [2025-10-07T22:35:56.373044] [INFO ] [MAIN ] CAF: Loaded 3410 primary data records. [2025-10-07T22:35:56.739031] [DEBUG] [LOCAL ] CAE: Loaded 39206 existing records from primary storage. [2025-10-07T22:35:56.739333] [INFO ] [MAIN ] CAE: Loaded 39206 primary data records. [2025-10-07T22:35:56.829296] [DEBUG] [LOCAL ] CADE: Loaded 49123 existing records from primary storage. [2025-10-07T22:35:56.835352] [INFO ] [MAIN ] CADE: Loaded 49123 primary data records. [2025-10-07T22:35:57.460925] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:57.462565] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3410 primary records. [2025-10-07T22:35:57.463938] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-07T22:35:57.481673] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-10-07T22:35:57.481942] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-07T22:35:57.484663] [INFO ] [MAIN ] Derivative Progress: 301/1748 symbols completed. CAF took 1.1s. Estimated remaining: 9m 18s. Rate: 155.6 symbols/min [2025-10-07T22:35:57.484948] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:57.507845] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:57.509588] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39206 primary records. [2025-10-07T22:35:57.509866] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-07T22:35:57.537245] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:57.538336] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 49123 primary records. [2025-10-07T22:35:57.538781] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-07T22:35:57.557049] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-07T22:35:57.557146] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-07T22:35:57.559796] [INFO ] [MAIN ] Derivative Progress: 302/1748 symbols completed. CADE took 1.2s. Estimated remaining: 9m 16s. Rate: 156.0 symbols/min [2025-10-07T22:35:57.560789] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:57.575326] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-07T22:35:57.575437] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-07T22:35:57.577672] [INFO ] [MAIN ] Derivative Progress: 303/1748 symbols completed. CAE took 1.2s. Estimated remaining: 9m 14s. Rate: 156.5 symbols/min [2025-10-07T22:35:57.577990] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:57.604711] [DEBUG] [LOCAL ] CAG: Loaded 53664 existing records from primary storage. [2025-10-07T22:35:57.604978] [INFO ] [MAIN ] CAG: Loaded 53664 primary data records. [2025-10-07T22:35:57.854754] [DEBUG] [LOCAL ] CAH: Loaded 51479 existing records from primary storage. [2025-10-07T22:35:57.854993] [INFO ] [MAIN ] CAH: Loaded 51479 primary data records. [2025-10-07T22:35:57.855754] [DEBUG] [LOCAL ] CAL: Loaded 43072 existing records from primary storage. [2025-10-07T22:35:57.973760] [INFO ] [MAIN ] CAL: Loaded 43072 primary data records. [2025-10-07T22:35:58.658217] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:58.659252] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53664 primary records. [2025-10-07T22:35:58.660698] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-07T22:35:58.678755] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-07T22:35:58.679018] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-07T22:35:58.681239] [INFO ] [MAIN ] Derivative Progress: 304/1748 symbols completed. CAG took 1.2s. Estimated remaining: 9m 17s. Rate: 155.5 symbols/min [2025-10-07T22:35:58.681999] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:58.699884] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:58.703550] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51479 primary records. [2025-10-07T22:35:58.703941] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-07T22:35:58.736939] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-07T22:35:58.737524] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-07T22:35:58.739784] [INFO ] [MAIN ] Derivative Progress: 305/1748 symbols completed. CAH took 1.2s. Estimated remaining: 9m 15s. Rate: 155.9 symbols/min [2025-10-07T22:35:58.737436] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:58.741459] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:58.741278] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43072 primary records. [2025-10-07T22:35:58.742190] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-07T22:35:58.760745] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-07T22:35:58.760840] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-07T22:35:58.763203] [INFO ] [MAIN ] Derivative Progress: 306/1748 symbols completed. CAL took 1.2s. Estimated remaining: 9m 13s. Rate: 156.4 symbols/min [2025-10-07T22:35:58.763411] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:58.788387] [DEBUG] [LOCAL ] CAPL: Loaded 5715 existing records from primary storage. [2025-10-07T22:35:58.797401] [INFO ] [MAIN ] CAPL: Loaded 5715 primary data records. [2025-10-07T22:35:58.797275] [DEBUG] [LOCAL ] CANG: Loaded 26957 existing records from primary storage. [2025-10-07T22:35:58.802886] [INFO ] [MAIN ] CANG: Loaded 26957 primary data records. [2025-10-07T22:35:58.886597] [DEBUG] [LOCAL ] CALX: Loaded 37780 existing records from primary storage. [2025-10-07T22:35:59.007707] [INFO ] [MAIN ] CALX: Loaded 37780 primary data records. [2025-10-07T22:35:59.896022] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:59.897143] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26957 primary records. [2025-10-07T22:35:59.912611] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:59.912745] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-07T22:35:59.913697] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5715 primary records. [2025-10-07T22:35:59.914576] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-07T22:35:59.945855] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-10-07T22:35:59.949578] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-07T22:35:59.954107] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-07T22:35:59.952942] [INFO ] [MAIN ] Derivative Progress: 307/1748 symbols completed. CANG took 1.2s. Estimated remaining: 9m 17s. Rate: 155.4 symbols/min [2025-10-07T22:35:59.954543] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:59.954616] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-07T22:35:59.970786] [INFO ] [MAIN ] Derivative Progress: 308/1748 symbols completed. CAPL took 1.2s. Estimated remaining: 9m 14s. Rate: 155.8 symbols/min [2025-10-07T22:35:59.971478] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:35:59.971012] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:35:59.972476] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37780 primary records. [2025-10-07T22:35:59.973170] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-07T22:36:00.005501] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-07T22:36:00.005677] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-07T22:36:00.008260] [INFO ] [MAIN ] Derivative Progress: 309/1748 symbols completed. CALX took 1.3s. Estimated remaining: 9m 12s. Rate: 156.3 symbols/min [2025-10-07T22:36:00.008433] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:00.084358] [DEBUG] [LOCAL ] CARR: Loaded 53597 existing records from primary storage. [2025-10-07T22:36:00.099383] [INFO ] [MAIN ] CARR: Loaded 53597 primary data records. [2025-10-07T22:36:00.146353] [DEBUG] [LOCAL ] CARS: Loaded 39739 existing records from primary storage. [2025-10-07T22:36:00.177022] [INFO ] [MAIN ] CARS: Loaded 39739 primary data records. [2025-10-07T22:36:00.301754] [DEBUG] [LOCAL ] CAT: Loaded 52913 existing records from primary storage. [2025-10-07T22:36:00.356218] [INFO ] [MAIN ] CAT: Loaded 52913 primary data records. [2025-10-07T22:36:01.164352] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:01.166418] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53597 primary records. [2025-10-07T22:36:01.166807] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-07T22:36:01.185046] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-07T22:36:01.185410] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-07T22:36:01.188518] [INFO ] [MAIN ] Derivative Progress: 310/1748 symbols completed. CARR took 1.2s. Estimated remaining: 9m 16s. Rate: 155.3 symbols/min [2025-10-07T22:36:01.189961] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:01.210570] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:01.211766] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39739 primary records. [2025-10-07T22:36:01.227250] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-07T22:36:01.230128] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:01.242384] [DEBUG] [LOCAL ] CATO: Loaded 6981 existing records from primary storage. [2025-10-07T22:36:01.242503] [INFO ] [MAIN ] CATO: Loaded 6981 primary data records. [2025-10-07T22:36:01.231348] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52913 primary records. [2025-10-07T22:36:01.253817] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-07T22:36:01.373135] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-07T22:36:01.384385] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-07T22:36:01.387356] [INFO ] [MAIN ] Derivative Progress: 311/1748 symbols completed. CARS took 1.4s. Estimated remaining: 9m 14s. Rate: 155.5 symbols/min [2025-10-07T22:36:01.393076] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:01.440062] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-07T22:36:01.459193] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-07T22:36:01.468021] [INFO ] [MAIN ] Derivative Progress: 312/1748 symbols completed. CAT took 1.5s. Estimated remaining: 9m 13s. Rate: 155.9 symbols/min [2025-10-07T22:36:01.625312] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:01.643971] [DEBUG] [LOCAL ] CBAN: Loaded 10701 existing records from primary storage. [2025-10-07T22:36:01.644271] [INFO ] [MAIN ] CBAN: Loaded 10701 primary data records. [2025-10-07T22:36:01.799726] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:36:01.800753] [INFO ] [MAIN ] CATO: Generated 1793 derivative records from 6981 primary records. [2025-10-07T22:36:01.800873] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-07T22:36:02.059578] [DEBUG] [LOCAL ] CB: Loaded 49930 existing records from primary storage. [2025-10-07T22:36:02.060308] [INFO ] [MAIN ] CB: Loaded 49930 primary data records. [2025-10-07T22:36:02.093538] [DEBUG] [LOCAL ] CATO: Derivative data saved (1793 records). [2025-10-07T22:36:02.113664] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-07T22:36:02.121622] [INFO ] [MAIN ] Derivative Progress: 313/1748 symbols completed. CATO took 0.9s. Estimated remaining: 9m 14s. Rate: 155.5 symbols/min [2025-10-07T22:36:02.426841] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:02.428156] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10701 primary records. [2025-10-07T22:36:02.428257] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-07T22:36:02.450081] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-07T22:36:02.450549] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-07T22:36:02.453124] [INFO ] [MAIN ] Derivative Progress: 314/1748 symbols completed. CBAN took 0.8s. Estimated remaining: 9m 13s. Rate: 155.6 symbols/min [2025-10-07T22:36:02.473489] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:02.474258] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49930 primary records. [2025-10-07T22:36:02.474323] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-07T22:36:02.492005] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-07T22:36:02.492085] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-07T22:36:02.494432] [INFO ] [MAIN ] Derivative Progress: 315/1748 symbols completed. CB took 1.1s. Estimated remaining: 9m 11s. Rate: 156.1 symbols/min [2025-10-07T22:36:02.494938] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:02.494898] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:02.495716] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:02.502304] [DEBUG] [LOCAL ] CBNA: Loaded 2906 existing records from primary storage. [2025-10-07T22:36:02.502454] [INFO ] [MAIN ] CBNA: Loaded 2906 primary data records. [2025-10-07T22:36:02.630508] [DEBUG] [LOCAL ] CBL: Loaded 16300 existing records from primary storage. [2025-10-07T22:36:02.630875] [INFO ] [MAIN ] CBL: Loaded 16300 primary data records. [2025-10-07T22:36:02.999138] [DEBUG] [LOCAL ] CBRE: Loaded 50455 existing records from primary storage. [2025-10-07T22:36:03.015359] [INFO ] [MAIN ] CBRE: Loaded 50455 primary data records. [2025-10-07T22:36:03.591388] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:03.592738] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2906 primary records. [2025-10-07T22:36:03.593264] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-07T22:36:03.611237] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-10-07T22:36:03.611700] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-07T22:36:03.613832] [INFO ] [MAIN ] Derivative Progress: 316/1748 symbols completed. CBNA took 1.1s. Estimated remaining: 9m 14s. Rate: 155.1 symbols/min [2025-10-07T22:36:03.614177] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:03.629271] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:03.631328] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16300 primary records. [2025-10-07T22:36:03.631673] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-07T22:36:03.675237] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:03.675478] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-07T22:36:03.676204] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50455 primary records. [2025-10-07T22:36:03.676487] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-07T22:36:03.676413] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-07T22:36:03.679975] [INFO ] [MAIN ] Derivative Progress: 317/1748 symbols completed. CBL took 1.2s. Estimated remaining: 9m 12s. Rate: 155.5 symbols/min [2025-10-07T22:36:03.687814] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:03.703854] [DEBUG] [LOCAL ] CBT: Loaded 30815 existing records from primary storage. [2025-10-07T22:36:03.704585] [INFO ] [MAIN ] CBT: Loaded 30815 primary data records. [2025-10-07T22:36:03.789594] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-07T22:36:03.794915] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-07T22:36:03.802900] [INFO ] [MAIN ] Derivative Progress: 318/1748 symbols completed. CBRE took 1.3s. Estimated remaining: 9m 10s. Rate: 155.9 symbols/min [2025-10-07T22:36:03.819182] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:03.868771] [DEBUG] [LOCAL ] CBU: Loaded 22579 existing records from primary storage. [2025-10-07T22:36:03.908619] [INFO ] [MAIN ] CBU: Loaded 22579 primary data records. [2025-10-07T22:36:04.358372] [DEBUG] [LOCAL ] CBZ: Loaded 33989 existing records from primary storage. [2025-10-07T22:36:04.358766] [INFO ] [MAIN ] CBZ: Loaded 33989 primary data records. [2025-10-07T22:36:04.669411] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:04.678958] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 30815 primary records. [2025-10-07T22:36:04.679348] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-07T22:36:04.701561] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-07T22:36:04.701728] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-07T22:36:04.704499] [INFO ] [MAIN ] Derivative Progress: 319/1748 symbols completed. CBT took 1.1s. Estimated remaining: 9m 12s. Rate: 155.2 symbols/min [2025-10-07T22:36:04.704778] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:04.720136] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:04.721047] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22579 primary records. [2025-10-07T22:36:04.721171] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-07T22:36:04.739986] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-07T22:36:04.740219] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-07T22:36:04.743673] [INFO ] [MAIN ] Derivative Progress: 320/1748 symbols completed. CBU took 1.1s. Estimated remaining: 9m 10s. Rate: 155.6 symbols/min [2025-10-07T22:36:04.744831] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:04.759766] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:04.760619] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33989 primary records. [2025-10-07T22:36:04.760996] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-07T22:36:04.792399] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-07T22:36:04.792547] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-07T22:36:04.795038] [INFO ] [MAIN ] Derivative Progress: 321/1748 symbols completed. CBZ took 1.0s. Estimated remaining: 9m 9s. Rate: 156.1 symbols/min [2025-10-07T22:36:04.795498] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:04.821507] [DEBUG] [LOCAL ] CC: Loaded 52991 existing records from primary storage. [2025-10-07T22:36:04.821914] [INFO ] [MAIN ] CC: Loaded 52991 primary data records. [2025-10-07T22:36:04.927446] [DEBUG] [LOCAL ] CCIF: Loaded 15588 existing records from primary storage. [2025-10-07T22:36:04.962831] [INFO ] [MAIN ] CCIF: Loaded 15588 primary data records. [2025-10-07T22:36:05.127527] [DEBUG] [LOCAL ] CCI: Loaded 53138 existing records from primary storage. [2025-10-07T22:36:05.275771] [INFO ] [MAIN ] CCI: Loaded 53138 primary data records. [2025-10-07T22:36:05.853670] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:05.855708] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 52991 primary records. [2025-10-07T22:36:05.855837] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-07T22:36:05.887078] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:05.888923] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15588 primary records. [2025-10-07T22:36:05.889579] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-07T22:36:05.891743] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-07T22:36:05.892039] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-07T22:36:05.894740] [INFO ] [MAIN ] Derivative Progress: 322/1748 symbols completed. CC took 1.2s. Estimated remaining: 9m 11s. Rate: 155.2 symbols/min [2025-10-07T22:36:05.902763] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:05.915106] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-07T22:36:05.915392] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-07T22:36:05.918523] [INFO ] [MAIN ] Derivative Progress: 323/1748 symbols completed. CCIF took 1.1s. Estimated remaining: 9m 9s. Rate: 155.6 symbols/min [2025-10-07T22:36:05.918846] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:05.933127] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:05.934039] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53138 primary records. [2025-10-07T22:36:05.934333] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-07T22:36:05.952915] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-07T22:36:05.953088] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-07T22:36:05.955873] [INFO ] [MAIN ] Derivative Progress: 324/1748 symbols completed. CCI took 1.2s. Estimated remaining: 9m 7s. Rate: 156.1 symbols/min [2025-10-07T22:36:05.956210] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:06.009402] [DEBUG] [LOCAL ] CCJ: Loaded 53676 existing records from primary storage. [2025-10-07T22:36:06.009850] [INFO ] [MAIN ] CCJ: Loaded 53676 primary data records. [2025-10-07T22:36:06.356884] [DEBUG] [LOCAL ] CCK: Loaded 46302 existing records from primary storage. [2025-10-07T22:36:06.357182] [INFO ] [MAIN ] CCK: Loaded 46302 primary data records. [2025-10-07T22:36:06.480591] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-07T22:36:06.486871] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-07T22:36:07.005024] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:07.006701] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53676 primary records. [2025-10-07T22:36:07.006900] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-07T22:36:07.025488] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-07T22:36:07.026093] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-07T22:36:07.028434] [INFO ] [MAIN ] Derivative Progress: 325/1748 symbols completed. CCJ took 1.1s. Estimated remaining: 9m 10s. Rate: 155.2 symbols/min [2025-10-07T22:36:07.028886] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:07.047816] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:07.049447] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46302 primary records. [2025-10-07T22:36:07.049579] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-07T22:36:07.078871] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:07.080308] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-10-07T22:36:07.080665] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-07T22:36:07.095495] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-07T22:36:07.106072] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-07T22:36:07.111491] [INFO ] [MAIN ] Derivative Progress: 326/1748 symbols completed. CCK took 1.2s. Estimated remaining: 9m 8s. Rate: 155.6 symbols/min [2025-10-07T22:36:07.112258] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-07T22:36:07.112394] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-07T22:36:07.112515] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:07.115082] [INFO ] [MAIN ] Derivative Progress: 327/1748 symbols completed. CCL took 1.2s. Estimated remaining: 9m 6s. Rate: 156.1 symbols/min [2025-10-07T22:36:07.115563] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:07.134982] [DEBUG] [LOCAL ] CCO: Loaded 48007 existing records from primary storage. [2025-10-07T22:36:07.135208] [INFO ] [MAIN ] CCO: Loaded 48007 primary data records. [2025-10-07T22:36:07.182330] [DEBUG] [LOCAL ] CCRD: Loaded 9204 existing records from primary storage. [2025-10-07T22:36:07.208184] [INFO ] [MAIN ] CCRD: Loaded 9204 primary data records. [2025-10-07T22:36:07.397030] [DEBUG] [LOCAL ] CCS: Loaded 30314 existing records from primary storage. [2025-10-07T22:36:07.422885] [INFO ] [MAIN ] CCS: Loaded 30314 primary data records. [2025-10-07T22:36:08.174856] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:08.176680] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 48007 primary records. [2025-10-07T22:36:08.177130] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-07T22:36:08.210926] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:36:08.214571] [INFO ] [MAIN ] CCRD: Generated 1793 derivative records from 9204 primary records. [2025-10-07T22:36:08.213693] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-07T22:36:08.214943] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-07T22:36:08.215212] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-07T22:36:08.217346] [INFO ] [MAIN ] Derivative Progress: 328/1748 symbols completed. CCO took 1.2s. Estimated remaining: 9m 9s. Rate: 155.2 symbols/min [2025-10-07T22:36:08.235878] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1793 records). [2025-10-07T22:36:08.236063] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-07T22:36:08.238473] [INFO ] [MAIN ] Derivative Progress: 329/1748 symbols completed. CCRD took 1.1s. Estimated remaining: 9m 7s. Rate: 155.6 symbols/min [2025-10-07T22:36:08.252793] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:08.253538] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30314 primary records. [2025-10-07T22:36:08.253601] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-07T22:36:08.269288] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-10-07T22:36:08.269383] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-07T22:36:08.272047] [INFO ] [MAIN ] Derivative Progress: 330/1748 symbols completed. CCS took 1.2s. Estimated remaining: 9m 5s. Rate: 156.0 symbols/min [2025-10-07T22:36:08.272682] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:08.272794] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:08.272589] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:08.287737] [DEBUG] [LOCAL ] CDLR: Loaded 9880 existing records from primary storage. [2025-10-07T22:36:08.287995] [INFO ] [MAIN ] CDLR: Loaded 9880 primary data records. [2025-10-07T22:36:08.395065] [DEBUG] [LOCAL ] CCU: Loaded 22981 existing records from primary storage. [2025-10-07T22:36:08.419243] [INFO ] [MAIN ] CCU: Loaded 22981 primary data records. [2025-10-07T22:36:08.820490] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-07T22:36:08.847606] [INFO ] [MAIN ] CDE: Loaded 53642 primary data records. [2025-10-07T22:36:09.313155] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:09.314274] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9880 primary records. [2025-10-07T22:36:09.314546] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-07T22:36:09.333116] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-07T22:36:09.333413] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-07T22:36:09.343487] [INFO ] [MAIN ] Derivative Progress: 331/1748 symbols completed. CDLR took 1.1s. Estimated remaining: 9m 8s. Rate: 155.2 symbols/min [2025-10-07T22:36:09.349577] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:09.349475] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:09.350816] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 22981 primary records. [2025-10-07T22:36:09.351714] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-07T22:36:09.388746] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:09.390426] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53642 primary records. [2025-10-07T22:36:09.390939] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-07T22:36:09.391908] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-07T22:36:09.392202] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-07T22:36:09.394305] [INFO ] [MAIN ] Derivative Progress: 332/1748 symbols completed. CCU took 1.1s. Estimated remaining: 9m 6s. Rate: 155.6 symbols/min [2025-10-07T22:36:09.394439] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:09.411349] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-07T22:36:09.420701] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-07T22:36:09.423218] [INFO ] [MAIN ] Derivative Progress: 333/1748 symbols completed. CDE took 1.2s. Estimated remaining: 9m 4s. Rate: 156.0 symbols/min [2025-10-07T22:36:09.423596] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:09.444496] [DEBUG] [LOCAL ] CDP: Loaded 42619 existing records from primary storage. [2025-10-07T22:36:09.444862] [INFO ] [MAIN ] CDP: Loaded 42619 primary data records. [2025-10-07T22:36:09.516229] [DEBUG] [LOCAL ] CDRE: Loaded 24694 existing records from primary storage. [2025-10-07T22:36:09.544318] [INFO ] [MAIN ] CDRE: Loaded 24694 primary data records. [2025-10-07T22:36:10.104332] [DEBUG] [LOCAL ] CE: Loaded 51475 existing records from primary storage. [2025-10-07T22:36:10.114365] [INFO ] [MAIN ] CE: Loaded 51475 primary data records. [2025-10-07T22:36:10.465158] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:10.468493] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42619 primary records. [2025-10-07T22:36:10.470526] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-07T22:36:10.498710] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:10.501069] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24694 primary records. [2025-10-07T22:36:10.501985] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-07T22:36:10.518210] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-07T22:36:10.518482] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-07T22:36:10.520913] [INFO ] [MAIN ] Derivative Progress: 334/1748 symbols completed. CDP took 1.2s. Estimated remaining: 9m 7s. Rate: 155.2 symbols/min [2025-10-07T22:36:10.521986] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:10.543533] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-07T22:36:10.549529] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-07T22:36:10.552192] [INFO ] [MAIN ] Derivative Progress: 335/1748 symbols completed. CDRE took 1.2s. Estimated remaining: 9m 5s. Rate: 155.6 symbols/min [2025-10-07T22:36:10.549438] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:10.553711] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:10.553293] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51475 primary records. [2025-10-07T22:36:10.557532] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-07T22:36:10.558337] [DEBUG] [LOCAL ] CEE: Loaded 5637 existing records from primary storage. [2025-10-07T22:36:10.568266] [INFO ] [MAIN ] CEE: Loaded 5637 primary data records. [2025-10-07T22:36:10.671917] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-07T22:36:10.698034] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-07T22:36:10.704003] [DEBUG] [LOCAL ] CEPU: Loaded 25974 existing records from primary storage. [2025-10-07T22:36:10.712175] [INFO ] [MAIN ] CEPU: Loaded 25974 primary data records. [2025-10-07T22:36:10.712077] [INFO ] [MAIN ] Derivative Progress: 336/1748 symbols completed. CE took 1.3s. Estimated remaining: 9m 3s. Rate: 155.9 symbols/min [2025-10-07T22:36:10.717612] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:11.265294] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:11.271200] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 5637 primary records. [2025-10-07T22:36:11.272533] [DEBUG] [LOCAL ] CF: Loaded 52174 existing records from primary storage. [2025-10-07T22:36:11.273314] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-07T22:36:11.274494] [INFO ] [MAIN ] CF: Loaded 52174 primary data records. [2025-10-07T22:36:11.444212] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-10-07T22:36:11.460731] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:11.478711] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-07T22:36:11.478556] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25974 primary records. [2025-10-07T22:36:11.490915] [INFO ] [MAIN ] Derivative Progress: 337/1748 symbols completed. CEE took 1.0s. Estimated remaining: 9m 5s. Rate: 155.4 symbols/min [2025-10-07T22:36:11.502218] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-07T22:36:11.518678] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:11.662357] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-07T22:36:11.662690] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-07T22:36:11.665558] [INFO ] [MAIN ] Derivative Progress: 338/1748 symbols completed. CEPU took 1.1s. Estimated remaining: 9m 3s. Rate: 155.7 symbols/min [2025-10-07T22:36:11.666522] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:11.708736] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:11.710006] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52174 primary records. [2025-10-07T22:36:11.711120] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-07T22:36:11.757024] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-07T22:36:11.757869] [INFO ] [MAIN ] CFG: Loaded 53624 primary data records. [2025-10-07T22:36:11.827756] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-10-07T22:36:11.849755] [DEBUG] [LOCAL ] CFR: Loaded 33008 existing records from primary storage. [2025-10-07T22:36:11.849141] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-07T22:36:11.858066] [INFO ] [MAIN ] Derivative Progress: 339/1748 symbols completed. CF took 1.1s. Estimated remaining: 9m 2s. Rate: 155.9 symbols/min [2025-10-07T22:36:11.863537] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:11.858173] [INFO ] [MAIN ] CFR: Loaded 33008 primary data records. [2025-10-07T22:36:12.442257] [DEBUG] [LOCAL ] CGAU: Loaded 43023 existing records from primary storage. [2025-10-07T22:36:12.443434] [INFO ] [MAIN ] CGAU: Loaded 43023 primary data records. [2025-10-07T22:36:12.774118] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:12.775588] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53624 primary records. [2025-10-07T22:36:12.776623] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-07T22:36:12.812450] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-07T22:36:12.810308] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:12.812605] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-07T22:36:12.814970] [INFO ] [MAIN ] Derivative Progress: 340/1748 symbols completed. CFG took 1.3s. Estimated remaining: 9m 4s. Rate: 155.2 symbols/min [2025-10-07T22:36:12.816305] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:12.817183] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33008 primary records. [2025-10-07T22:36:12.818112] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-07T22:36:12.838442] [DEBUG] [LOCAL ] CGV: Loaded 1394 existing records from primary storage. [2025-10-07T22:36:12.836177] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-10-07T22:36:12.838781] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-07T22:36:12.841068] [INFO ] [MAIN ] Derivative Progress: 341/1748 symbols completed. CFR took 1.2s. Estimated remaining: 9m 2s. Rate: 155.6 symbols/min [2025-10-07T22:36:12.841319] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:12.841206] [INFO ] [MAIN ] CGV: Loaded 1394 primary data records. [2025-10-07T22:36:12.990970] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:13.062439] [DEBUG] [LOCAL ] CHCT: Loaded 23845 existing records from primary storage. [2025-10-07T22:36:13.055501] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 43023 primary records. [2025-10-07T22:36:13.062734] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-07T22:36:13.174349] [INFO ] [MAIN ] CHCT: Loaded 23845 primary data records. [2025-10-07T22:36:13.287550] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-07T22:36:13.300633] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-07T22:36:13.306501] [INFO ] [MAIN ] Derivative Progress: 342/1748 symbols completed. CGAU took 1.4s. Estimated remaining: 9m 2s. Rate: 155.5 symbols/min [2025-10-07T22:36:13.307071] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:13.520073] [DEBUG] [LOCAL ] CHE: Loaded 15233 existing records from primary storage. [2025-10-07T22:36:13.523670] [INFO ] [MAIN ] CHE: Loaded 15233 primary data records. [2025-10-07T22:36:13.607360] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:36:13.631013] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1394 primary records. [2025-10-07T22:36:13.657314] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-07T22:36:13.970571] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-10-07T22:36:13.971247] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:13.971384] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-07T22:36:13.975927] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 23845 primary records. [2025-10-07T22:36:13.976372] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-07T22:36:13.974725] [INFO ] [MAIN ] Derivative Progress: 343/1748 symbols completed. CGV took 1.2s. Estimated remaining: 9m 3s. Rate: 155.2 symbols/min [2025-10-07T22:36:13.994386] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-10-07T22:36:13.994603] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-07T22:36:13.996814] [INFO ] [MAIN ] Derivative Progress: 344/1748 symbols completed. CHCT took 1.2s. Estimated remaining: 9m 1s. Rate: 155.6 symbols/min [2025-10-07T22:36:14.014774] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:14.015397] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15233 primary records. [2025-10-07T22:36:14.015457] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-07T22:36:14.030556] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-07T22:36:14.030618] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-07T22:36:14.032983] [INFO ] [MAIN ] Derivative Progress: 345/1748 symbols completed. CHE took 0.7s. Estimated remaining: 8m 59s. Rate: 156.1 symbols/min [2025-10-07T22:36:14.033666] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:14.033523] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:14.034103] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:14.068685] [DEBUG] [LOCAL ] CHMI: Loaded 21639 existing records from primary storage. [2025-10-07T22:36:14.068931] [INFO ] [MAIN ] CHMI: Loaded 21639 primary data records. [2025-10-07T22:36:14.192352] [DEBUG] [LOCAL ] CHH: Loaded 32270 existing records from primary storage. [2025-10-07T22:36:14.203256] [INFO ] [MAIN ] CHH: Loaded 32270 primary data records. [2025-10-07T22:36:14.504034] [DEBUG] [LOCAL ] CHGG: Loaded 47825 existing records from primary storage. [2025-10-07T22:36:14.504706] [INFO ] [MAIN ] CHGG: Loaded 47825 primary data records. [2025-10-07T22:36:15.062590] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:15.063616] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21639 primary records. [2025-10-07T22:36:15.065608] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-07T22:36:15.095962] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-07T22:36:15.098190] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-07T22:36:15.102339] [INFO ] [MAIN ] Derivative Progress: 346/1748 symbols completed. CHMI took 1.1s. Estimated remaining: 9m 2s. Rate: 155.3 symbols/min [2025-10-07T22:36:15.103282] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:15.118466] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:15.119772] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32270 primary records. [2025-10-07T22:36:15.120175] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-07T22:36:15.142685] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-10-07T22:36:15.159753] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-07T22:36:15.160078] [DEBUG] [LOCAL ] CHN: Loaded 4770 existing records from primary storage. [2025-10-07T22:36:15.162213] [INFO ] [MAIN ] Derivative Progress: 347/1748 symbols completed. CHH took 1.1s. Estimated remaining: 9m 0s. Rate: 155.6 symbols/min [2025-10-07T22:36:15.162907] [INFO ] [MAIN ] CHN: Loaded 4770 primary data records. [2025-10-07T22:36:15.163044] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:15.162696] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:15.169691] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47825 primary records. [2025-10-07T22:36:15.176859] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-07T22:36:15.364833] [DEBUG] [LOCAL ] CHT: Loaded 19602 existing records from primary storage. [2025-10-07T22:36:15.395578] [INFO ] [MAIN ] CHT: Loaded 19602 primary data records. [2025-10-07T22:36:15.618450] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-10-07T22:36:15.619638] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-07T22:36:15.643461] [INFO ] [MAIN ] Derivative Progress: 348/1748 symbols completed. CHGG took 1.6s. Estimated remaining: 9m 0s. Rate: 155.5 symbols/min [2025-10-07T22:36:15.661487] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:15.879796] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:15.881104] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4770 primary records. [2025-10-07T22:36:15.882411] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-07T22:36:15.897600] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-10-07T22:36:15.897927] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-07T22:36:15.900273] [INFO ] [MAIN ] Derivative Progress: 349/1748 symbols completed. CHN took 0.8s. Estimated remaining: 8m 59s. Rate: 155.7 symbols/min [2025-10-07T22:36:15.900487] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:15.935792] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:15.936899] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19602 primary records. [2025-10-07T22:36:15.937040] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-07T22:36:15.966489] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-07T22:36:15.968395] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-10-07T22:36:16.003005] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-10-07T22:36:16.003308] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-07T22:36:16.017859] [INFO ] [MAIN ] Derivative Progress: 350/1748 symbols completed. CHT took 0.9s. Estimated remaining: 8m 58s. Rate: 156.0 symbols/min [2025-10-07T22:36:16.040965] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:16.157887] [DEBUG] [LOCAL ] CI: Loaded 49809 existing records from primary storage. [2025-10-07T22:36:16.187148] [INFO ] [MAIN ] CI: Loaded 49809 primary data records. [2025-10-07T22:36:16.376621] [DEBUG] [LOCAL ] CIA: Loaded 16849 existing records from primary storage. [2025-10-07T22:36:16.402058] [INFO ] [MAIN ] CIA: Loaded 16849 primary data records. [2025-10-07T22:36:16.943134] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:16.944611] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53654 primary records. [2025-10-07T22:36:16.944930] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-07T22:36:16.965300] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-10-07T22:36:16.966168] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-07T22:36:16.968427] [INFO ] [MAIN ] Derivative Progress: 351/1748 symbols completed. CHWY took 1.3s. Estimated remaining: 8m 60s. Rate: 155.3 symbols/min [2025-10-07T22:36:16.968891] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:16.982881] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:16.984011] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49809 primary records. [2025-10-07T22:36:16.984131] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-07T22:36:17.003304] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-10-07T22:36:17.003483] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-07T22:36:17.014041] [INFO ] [MAIN ] Derivative Progress: 352/1748 symbols completed. CI took 1.1s. Estimated remaining: 8m 58s. Rate: 155.7 symbols/min [2025-10-07T22:36:17.014316] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:17.020904] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:17.021739] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16849 primary records. [2025-10-07T22:36:17.021895] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-07T22:36:17.050212] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-10-07T22:36:17.050373] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-07T22:36:17.053679] [INFO ] [MAIN ] Derivative Progress: 353/1748 symbols completed. CIA took 1.0s. Estimated remaining: 8m 56s. Rate: 156.1 symbols/min [2025-10-07T22:36:17.054078] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:17.064549] [DEBUG] [LOCAL ] CIB: Loaded 30737 existing records from primary storage. [2025-10-07T22:36:17.064796] [INFO ] [MAIN ] CIB: Loaded 30737 primary data records. [2025-10-07T22:36:17.207181] [DEBUG] [LOCAL ] CIEN: Loaded 52111 existing records from primary storage. [2025-10-07T22:36:17.219934] [INFO ] [MAIN ] CIEN: Loaded 52111 primary data records. [2025-10-07T22:36:17.593832] [DEBUG] [LOCAL ] CIG: Loaded 43835 existing records from primary storage. [2025-10-07T22:36:17.724306] [INFO ] [MAIN ] CIG: Loaded 43835 primary data records. [2025-10-07T22:36:18.118014] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:18.120087] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 30737 primary records. [2025-10-07T22:36:18.120712] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-07T22:36:18.155152] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:18.156040] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52111 primary records. [2025-10-07T22:36:18.154319] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-10-07T22:36:18.156257] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-07T22:36:18.156176] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-07T22:36:18.159348] [INFO ] [MAIN ] Derivative Progress: 354/1748 symbols completed. CIB took 1.2s. Estimated remaining: 8m 59s. Rate: 155.3 symbols/min [2025-10-07T22:36:18.167174] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:18.175857] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-10-07T22:36:18.177030] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-07T22:36:18.180938] [INFO ] [MAIN ] Derivative Progress: 355/1748 symbols completed. CIEN took 1.2s. Estimated remaining: 8m 57s. Rate: 155.7 symbols/min [2025-10-07T22:36:18.181222] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:18.195251] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:18.199882] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43835 primary records. [2025-10-07T22:36:18.200003] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-07T22:36:18.217404] [DEBUG] [LOCAL ] CII: Loaded 15178 existing records from primary storage. [2025-10-07T22:36:18.219111] [INFO ] [MAIN ] CII: Loaded 15178 primary data records. [2025-10-07T22:36:18.333109] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-07T22:36:18.333269] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-07T22:36:18.336081] [INFO ] [MAIN ] Derivative Progress: 356/1748 symbols completed. CIG took 1.3s. Estimated remaining: 8m 55s. Rate: 156.0 symbols/min [2025-10-07T22:36:18.346717] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:18.426634] [DEBUG] [LOCAL ] CIM: Loaded 37719 existing records from primary storage. [2025-10-07T22:36:18.531709] [INFO ] [MAIN ] CIM: Loaded 37719 primary data records. [2025-10-07T22:36:18.637986] [DEBUG] [LOCAL ] CINT: Loaded 19213 existing records from primary storage. [2025-10-07T22:36:18.643731] [INFO ] [MAIN ] CINT: Loaded 19213 primary data records. [2025-10-07T22:36:19.165432] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:19.166928] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15178 primary records. [2025-10-07T22:36:19.167178] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-07T22:36:19.191138] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-10-07T22:36:19.191489] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-07T22:36:19.193758] [INFO ] [MAIN ] Derivative Progress: 357/1748 symbols completed. CII took 1.0s. Estimated remaining: 8m 57s. Rate: 155.4 symbols/min [2025-10-07T22:36:19.194037] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:19.211732] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:19.213527] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37719 primary records. [2025-10-07T22:36:19.213891] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-07T22:36:19.244417] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:19.246608] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 19213 primary records. [2025-10-07T22:36:19.248797] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-07T22:36:19.251085] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-10-07T22:36:19.257632] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-07T22:36:19.267072] [DEBUG] [LOCAL ] CIO: Loaded 20458 existing records from primary storage. [2025-10-07T22:36:19.272483] [INFO ] [MAIN ] CIO: Loaded 20458 primary data records. [2025-10-07T22:36:19.271841] [INFO ] [MAIN ] Derivative Progress: 358/1748 symbols completed. CIM took 1.1s. Estimated remaining: 8m 55s. Rate: 155.8 symbols/min [2025-10-07T22:36:19.379981] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-10-07T22:36:19.382639] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-07T22:36:19.390169] [INFO ] [MAIN ] Derivative Progress: 359/1748 symbols completed. CINT took 1.0s. Estimated remaining: 8m 54s. Rate: 156.1 symbols/min [2025-10-07T22:36:19.600286] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:19.601036] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20458 primary records. [2025-10-07T22:36:19.601100] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-07T22:36:19.615771] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-07T22:36:19.615837] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-07T22:36:19.618072] [INFO ] [MAIN ] Derivative Progress: 360/1748 symbols completed. CIO took 0.4s. Estimated remaining: 8m 53s. Rate: 156.3 symbols/min [2025-10-07T22:36:19.618507] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:19.618583] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:19.619213] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:19.661174] [DEBUG] [LOCAL ] CION: Loaded 28464 existing records from primary storage. [2025-10-07T22:36:19.673427] [INFO ] [MAIN ] CION: Loaded 28464 primary data records. [2025-10-07T22:36:19.809593] [DEBUG] [LOCAL ] CIVI: Loaded 52615 existing records from primary storage. [2025-10-07T22:36:19.827338] [INFO ] [MAIN ] CIVI: Loaded 52615 primary data records. [2025-10-07T22:36:19.973131] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-07T22:36:20.125673] [INFO ] [MAIN ] CL: Loaded 53648 primary data records. [2025-10-07T22:36:20.675142] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:20.676077] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 28464 primary records. [2025-10-07T22:36:20.676344] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-07T22:36:20.695857] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-10-07T22:36:20.709801] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-07T22:36:20.712078] [INFO ] [MAIN ] Derivative Progress: 361/1748 symbols completed. CION took 1.1s. Estimated remaining: 8m 55s. Rate: 155.5 symbols/min [2025-10-07T22:36:20.710128] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:20.713915] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:20.714886] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52615 primary records. [2025-10-07T22:36:20.715323] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-07T22:36:20.736704] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:20.742605] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53648 primary records. [2025-10-07T22:36:20.744337] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-07T22:36:20.747346] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-07T22:36:20.747424] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-07T22:36:20.749728] [INFO ] [MAIN ] Derivative Progress: 362/1748 symbols completed. CIVI took 1.1s. Estimated remaining: 8m 54s. Rate: 155.9 symbols/min [2025-10-07T22:36:20.749914] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:20.769784] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-10-07T22:36:20.770026] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-07T22:36:20.775897] [INFO ] [MAIN ] Derivative Progress: 363/1748 symbols completed. CL took 1.2s. Estimated remaining: 8m 52s. Rate: 156.3 symbols/min [2025-10-07T22:36:20.783965] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:20.791305] [DEBUG] [LOCAL ] CLCO: Loaded 12716 existing records from primary storage. [2025-10-07T22:36:20.791512] [INFO ] [MAIN ] CLCO: Loaded 12716 primary data records. [2025-10-07T22:36:20.880262] [DEBUG] [LOCAL ] CLB: Loaded 33057 existing records from primary storage. [2025-10-07T22:36:20.903590] [INFO ] [MAIN ] CLB: Loaded 33057 primary data records. [2025-10-07T22:36:21.426538] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-07T22:36:21.428688] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-07T22:36:21.832494] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:21.869629] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12716 primary records. [2025-10-07T22:36:21.870105] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-07T22:36:21.891346] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-10-07T22:36:21.891492] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-07T22:36:21.906520] [INFO ] [MAIN ] Derivative Progress: 364/1748 symbols completed. CLCO took 1.2s. Estimated remaining: 8m 54s. Rate: 155.4 symbols/min [2025-10-07T22:36:21.908448] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:21.908899] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:21.909722] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33057 primary records. [2025-10-07T22:36:21.909926] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-07T22:36:21.927575] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-10-07T22:36:21.927744] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-07T22:36:21.930086] [INFO ] [MAIN ] Derivative Progress: 365/1748 symbols completed. CLB took 1.2s. Estimated remaining: 8m 53s. Rate: 155.8 symbols/min [2025-10-07T22:36:21.930384] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:21.958470] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:21.959332] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-10-07T22:36:21.959472] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-07T22:36:21.989462] [DEBUG] [LOCAL ] CLH: Loaded 27665 existing records from primary storage. [2025-10-07T22:36:21.991387] [INFO ] [MAIN ] CLH: Loaded 27665 primary data records. [2025-10-07T22:36:22.012599] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-10-07T22:36:22.022630] [DEBUG] [LOCAL ] CLW: Loaded 21707 existing records from primary storage. [2025-10-07T22:36:22.056777] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-07T22:36:22.065561] [INFO ] [MAIN ] CLW: Loaded 21707 primary data records. [2025-10-07T22:36:22.084549] [INFO ] [MAIN ] Derivative Progress: 366/1748 symbols completed. CLF took 1.3s. Estimated remaining: 8m 51s. Rate: 156.1 symbols/min [2025-10-07T22:36:22.123997] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:22.646548] [DEBUG] [LOCAL ] CLX: Loaded 51546 existing records from primary storage. [2025-10-07T22:36:22.647056] [INFO ] [MAIN ] CLX: Loaded 51546 primary data records. [2025-10-07T22:36:22.749073] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:22.772434] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27665 primary records. [2025-10-07T22:36:22.773319] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-07T22:36:22.990081] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:23.000240] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21707 primary records. [2025-10-07T22:36:23.000692] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-07T22:36:23.002725] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-07T22:36:23.002824] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-07T22:36:23.004921] [INFO ] [MAIN ] Derivative Progress: 367/1748 symbols completed. CLH took 1.1s. Estimated remaining: 8m 53s. Rate: 155.5 symbols/min [2025-10-07T22:36:23.014629] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:23.024793] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-07T22:36:23.024889] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-07T22:36:23.027466] [INFO ] [MAIN ] Derivative Progress: 368/1748 symbols completed. CLW took 1.1s. Estimated remaining: 8m 51s. Rate: 155.9 symbols/min [2025-10-07T22:36:23.027862] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:23.050912] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:23.058215] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51546 primary records. [2025-10-07T22:36:23.058351] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-07T22:36:23.089755] [DEBUG] [LOCAL ] CMBT: Loaded 24479 existing records from primary storage. [2025-10-07T22:36:23.090680] [INFO ] [MAIN ] CMBT: Loaded 24479 primary data records. [2025-10-07T22:36:23.129571] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-07T22:36:23.142347] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-07T22:36:23.145846] [INFO ] [MAIN ] Derivative Progress: 369/1748 symbols completed. CLX took 1.0s. Estimated remaining: 8m 50s. Rate: 156.2 symbols/min [2025-10-07T22:36:23.158424] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:23.176104] [DEBUG] [LOCAL ] CMA: Loaded 49900 existing records from primary storage. [2025-10-07T22:36:23.199286] [INFO ] [MAIN ] CMA: Loaded 49900 primary data records. [2025-10-07T22:36:23.765468] [DEBUG] [LOCAL ] CMC: Loaded 45441 existing records from primary storage. [2025-10-07T22:36:23.766242] [INFO ] [MAIN ] CMC: Loaded 45441 primary data records. [2025-10-07T22:36:24.157060] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:24.166780] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 24479 primary records. [2025-10-07T22:36:24.172117] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-07T22:36:24.174056] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:24.188536] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 49900 primary records. [2025-10-07T22:36:24.189391] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-07T22:36:24.214073] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-10-07T22:36:24.214190] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-07T22:36:24.214665] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-07T22:36:24.214557] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-07T22:36:24.216846] [INFO ] [MAIN ] Derivative Progress: 370/1748 symbols completed. CMBT took 1.2s. Estimated remaining: 8m 52s. Rate: 155.4 symbols/min [2025-10-07T22:36:24.219711] [INFO ] [MAIN ] Derivative Progress: 371/1748 symbols completed. CMA took 1.2s. Estimated remaining: 8m 50s. Rate: 155.8 symbols/min [2025-10-07T22:36:24.219562] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:24.220033] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:24.237911] [DEBUG] [LOCAL ] CMCM: Loaded 4731 existing records from primary storage. [2025-10-07T22:36:24.243165] [INFO ] [MAIN ] CMCM: Loaded 4731 primary data records. [2025-10-07T22:36:24.243440] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:24.255353] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45441 primary records. [2025-10-07T22:36:24.255535] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-07T22:36:24.422431] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-07T22:36:24.432552] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-07T22:36:24.440447] [INFO ] [MAIN ] Derivative Progress: 372/1748 symbols completed. CMC took 1.3s. Estimated remaining: 8m 49s. Rate: 156.0 symbols/min [2025-10-07T22:36:24.577471] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:24.613200] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-07T22:36:24.614308] [INFO ] [MAIN ] CMG: Loaded 53721 primary data records. [2025-10-07T22:36:24.957795] [DEBUG] [LOCAL ] CMI: Loaded 41708 existing records from primary storage. [2025-10-07T22:36:24.958965] [INFO ] [MAIN ] CMI: Loaded 41708 primary data records. [2025-10-07T22:36:25.018703] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:25.032059] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4731 primary records. [2025-10-07T22:36:25.069969] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-07T22:36:25.296880] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-07T22:36:25.297954] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-07T22:36:25.300289] [INFO ] [MAIN ] Derivative Progress: 373/1748 symbols completed. CMCM took 1.1s. Estimated remaining: 8m 51s. Rate: 155.5 symbols/min [2025-10-07T22:36:25.317333] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:25.319110] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53721 primary records. [2025-10-07T22:36:25.319354] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-07T22:36:25.339518] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-10-07T22:36:25.339612] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-07T22:36:25.342076] [INFO ] [MAIN ] Derivative Progress: 374/1748 symbols completed. CMG took 1.1s. Estimated remaining: 8m 49s. Rate: 155.9 symbols/min [2025-10-07T22:36:25.357600] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:25.358312] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41708 primary records. [2025-10-07T22:36:25.358375] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-07T22:36:25.373665] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-07T22:36:25.373742] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-07T22:36:25.375936] [INFO ] [MAIN ] Derivative Progress: 375/1748 symbols completed. CMI took 0.8s. Estimated remaining: 8m 47s. Rate: 156.3 symbols/min [2025-10-07T22:36:25.376356] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:25.376489] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:25.376674] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:25.440938] [DEBUG] [LOCAL ] CMRE: Loaded 35498 existing records from primary storage. [2025-10-07T22:36:25.452189] [INFO ] [MAIN ] CMRE: Loaded 35498 primary data records. [2025-10-07T22:36:25.452069] [DEBUG] [LOCAL ] CMP: Loaded 36085 existing records from primary storage. [2025-10-07T22:36:25.453443] [INFO ] [MAIN ] CMP: Loaded 36085 primary data records. [2025-10-07T22:36:25.480908] [DEBUG] [LOCAL ] CMPO: Loaded 39033 existing records from primary storage. [2025-10-07T22:36:25.559985] [INFO ] [MAIN ] CMPO: Loaded 39033 primary data records. [2025-10-07T22:36:26.474692] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:26.475440] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:26.476250] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35498 primary records. [2025-10-07T22:36:26.477388] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 36085 primary records. [2025-10-07T22:36:26.477699] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-07T22:36:26.477779] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-07T22:36:26.510705] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-10-07T22:36:26.512415] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-07T22:36:26.514886] [INFO ] [MAIN ] Derivative Progress: 376/1748 symbols completed. CMRE took 1.1s. Estimated remaining: 8m 50s. Rate: 155.4 symbols/min [2025-10-07T22:36:26.515096] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:26.522283] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-07T22:36:26.533087] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-07T22:36:26.535802] [INFO ] [MAIN ] Derivative Progress: 377/1748 symbols completed. CMP took 1.2s. Estimated remaining: 8m 48s. Rate: 155.8 symbols/min [2025-10-07T22:36:26.536135] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:26.536597] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:26.537825] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 39033 primary records. [2025-10-07T22:36:26.537945] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-07T22:36:26.556086] [DEBUG] [LOCAL ] CMSA: Loaded 3514 existing records from primary storage. [2025-10-07T22:36:26.556856] [INFO ] [MAIN ] CMSA: Loaded 3514 primary data records. [2025-10-07T22:36:26.680755] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-07T22:36:26.681345] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-07T22:36:26.699956] [INFO ] [MAIN ] Derivative Progress: 378/1748 symbols completed. CMPO took 1.3s. Estimated remaining: 8m 47s. Rate: 156.1 symbols/min [2025-10-07T22:36:26.710468] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:26.895275] [DEBUG] [LOCAL ] CMS: Loaded 52626 existing records from primary storage. [2025-10-07T22:36:26.896941] [INFO ] [MAIN ] CMS: Loaded 52626 primary data records. [2025-10-07T22:36:26.922232] [DEBUG] [LOCAL ] CMSC: Loaded 5021 existing records from primary storage. [2025-10-07T22:36:26.970607] [INFO ] [MAIN ] CMSC: Loaded 5021 primary data records. [2025-10-07T22:36:27.529447] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:27.530695] [INFO ] [MAIN ] CMSA: Generated 1794 derivative records from 3514 primary records. [2025-10-07T22:36:27.531337] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-07T22:36:27.551163] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1794 records). [2025-10-07T22:36:27.551720] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-07T22:36:27.554145] [INFO ] [MAIN ] Derivative Progress: 379/1748 symbols completed. CMSA took 1.0s. Estimated remaining: 8m 48s. Rate: 155.6 symbols/min [2025-10-07T22:36:27.556068] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:27.574370] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:27.577260] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52626 primary records. [2025-10-07T22:36:27.577554] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-07T22:36:27.596995] [DEBUG] [LOCAL ] CMSD: Loaded 8015 existing records from primary storage. [2025-10-07T22:36:27.601209] [INFO ] [MAIN ] CMSD: Loaded 8015 primary data records. [2025-10-07T22:36:27.664767] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-10-07T22:36:27.684718] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-07T22:36:27.725521] [INFO ] [MAIN ] Derivative Progress: 380/1748 symbols completed. CMS took 1.2s. Estimated remaining: 8m 47s. Rate: 155.8 symbols/min [2025-10-07T22:36:27.726029] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:27.727072] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:27.726982] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5021 primary records. [2025-10-07T22:36:27.732919] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-07T22:36:27.976331] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-07T22:36:27.976601] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-07T22:36:27.978927] [INFO ] [MAIN ] Derivative Progress: 381/1748 symbols completed. CMSC took 1.3s. Estimated remaining: 8m 46s. Rate: 155.9 symbols/min [2025-10-07T22:36:27.979980] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:28.008511] [DEBUG] [LOCAL ] CMTG: Loaded 36360 existing records from primary storage. [2025-10-07T22:36:28.010056] [INFO ] [MAIN ] CMTG: Loaded 36360 primary data records. [2025-10-07T22:36:28.154837] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:28.161122] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 8015 primary records. [2025-10-07T22:36:28.185421] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-07T22:36:28.375746] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-10-07T22:36:28.376075] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-07T22:36:28.376874] [DEBUG] [LOCAL ] CNC: Loaded 53752 existing records from primary storage. [2025-10-07T22:36:28.380793] [INFO ] [MAIN ] Derivative Progress: 382/1748 symbols completed. CMSD took 0.8s. Estimated remaining: 8m 46s. Rate: 155.9 symbols/min [2025-10-07T22:36:28.381051] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:28.380935] [INFO ] [MAIN ] CNC: Loaded 53752 primary data records. [2025-10-07T22:36:28.497317] [DEBUG] [LOCAL ] CNF: Loaded 10538 existing records from primary storage. [2025-10-07T22:36:28.519270] [INFO ] [MAIN ] CNF: Loaded 10538 primary data records. [2025-10-07T22:36:29.021821] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:29.022934] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 36360 primary records. [2025-10-07T22:36:29.023329] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-07T22:36:29.045018] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-07T22:36:29.045374] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-07T22:36:29.047877] [INFO ] [MAIN ] Derivative Progress: 383/1748 symbols completed. CMTG took 1.3s. Estimated remaining: 8m 46s. Rate: 155.6 symbols/min [2025-10-07T22:36:29.048953] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:29.066311] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:29.067390] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53752 primary records. [2025-10-07T22:36:29.067672] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-07T22:36:29.087718] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-10-07T22:36:29.089621] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-07T22:36:29.093005] [INFO ] [MAIN ] Derivative Progress: 384/1748 symbols completed. CNC took 1.1s. Estimated remaining: 8m 45s. Rate: 156.0 symbols/min [2025-10-07T22:36:29.093223] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:29.107551] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:36:29.108251] [INFO ] [MAIN ] CNF: Generated 1793 derivative records from 10538 primary records. [2025-10-07T22:36:29.108537] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-07T22:36:29.137598] [DEBUG] [LOCAL ] CNF: Derivative data saved (1793 records). [2025-10-07T22:36:29.137721] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-07T22:36:29.139993] [INFO ] [MAIN ] Derivative Progress: 385/1748 symbols completed. CNF took 0.8s. Estimated remaining: 8m 43s. Rate: 156.3 symbols/min [2025-10-07T22:36:29.140303] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:29.161674] [DEBUG] [LOCAL ] CNH: Loaded 53551 existing records from primary storage. [2025-10-07T22:36:29.161944] [INFO ] [MAIN ] CNH: Loaded 53551 primary data records. [2025-10-07T22:36:29.356880] [DEBUG] [LOCAL ] CNI: Loaded 51675 existing records from primary storage. [2025-10-07T22:36:29.384532] [INFO ] [MAIN ] CNI: Loaded 51675 primary data records. [2025-10-07T22:36:29.626228] [DEBUG] [LOCAL ] CNK: Loaded 52883 existing records from primary storage. [2025-10-07T22:36:29.632193] [INFO ] [MAIN ] CNK: Loaded 52883 primary data records. [2025-10-07T22:36:30.210811] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:30.212996] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53551 primary records. [2025-10-07T22:36:30.213564] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-07T22:36:30.234901] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-10-07T22:36:30.235108] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-07T22:36:30.237855] [INFO ] [MAIN ] Derivative Progress: 386/1748 symbols completed. CNH took 1.2s. Estimated remaining: 8m 45s. Rate: 155.6 symbols/min [2025-10-07T22:36:30.238493] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:30.256987] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:30.257995] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51675 primary records. [2025-10-07T22:36:30.259000] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-07T22:36:30.286614] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:30.288875] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52883 primary records. [2025-10-07T22:36:30.289227] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-07T22:36:30.304619] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-07T22:36:30.306260] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-07T22:36:30.310008] [INFO ] [MAIN ] Derivative Progress: 387/1748 symbols completed. CNI took 1.2s. Estimated remaining: 8m 44s. Rate: 155.9 symbols/min [2025-10-07T22:36:30.310239] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:30.326067] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-07T22:36:30.326180] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-07T22:36:30.328530] [INFO ] [MAIN ] Derivative Progress: 388/1748 symbols completed. CNK took 1.2s. Estimated remaining: 8m 42s. Rate: 156.3 symbols/min [2025-10-07T22:36:30.348522] [DEBUG] [LOCAL ] CNM: Loaded 51054 existing records from primary storage. [2025-10-07T22:36:30.348789] [INFO ] [MAIN ] CNM: Loaded 51054 primary data records. [2025-10-07T22:36:30.540285] [DEBUG] [LOCAL ] CNNE: Loaded 36320 existing records from primary storage. [2025-10-07T22:36:30.545037] [INFO ] [MAIN ] CNNE: Loaded 36320 primary data records. [2025-10-07T22:36:30.988208] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:30.990159] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 51054 primary records. [2025-10-07T22:36:30.990251] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-07T22:36:31.008618] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-10-07T22:36:31.009036] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-07T22:36:31.011059] [INFO ] [MAIN ] Derivative Progress: 389/1748 symbols completed. CNM took 0.8s. Estimated remaining: 8m 43s. Rate: 156.0 symbols/min [2025-10-07T22:36:31.027254] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:31.028035] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36320 primary records. [2025-10-07T22:36:31.028098] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-07T22:36:31.044753] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-10-07T22:36:31.044836] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-07T22:36:31.047010] [INFO ] [MAIN ] Derivative Progress: 390/1748 symbols completed. CNNE took 0.7s. Estimated remaining: 8m 41s. Rate: 156.4 symbols/min [2025-10-07T22:36:31.048058] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:31.047931] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:31.048775] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:31.133573] [DEBUG] [LOCAL ] CNP: Loaded 53475 existing records from primary storage. [2025-10-07T22:36:31.135757] [INFO ] [MAIN ] CNP: Loaded 53475 primary data records. [2025-10-07T22:36:31.141900] [DEBUG] [LOCAL ] CNO: Loaded 40903 existing records from primary storage. [2025-10-07T22:36:31.157721] [INFO ] [MAIN ] CNO: Loaded 40903 primary data records. [2025-10-07T22:36:31.334010] [DEBUG] [LOCAL ] CNQ: Loaded 53577 existing records from primary storage. [2025-10-07T22:36:31.371131] [INFO ] [MAIN ] CNQ: Loaded 53577 primary data records. [2025-10-07T22:36:32.259157] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:32.275305] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53475 primary records. [2025-10-07T22:36:32.273906] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:32.277210] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 40903 primary records. [2025-10-07T22:36:32.277296] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-07T22:36:32.279530] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-07T22:36:32.322977] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:32.325171] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53577 primary records. [2025-10-07T22:36:32.325503] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-07T22:36:32.330579] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-07T22:36:32.331304] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-07T22:36:32.340937] [INFO ] [MAIN ] Derivative Progress: 391/1748 symbols completed. CNO took 1.3s. Estimated remaining: 8m 44s. Rate: 155.4 symbols/min [2025-10-07T22:36:32.345556] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:32.350472] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-07T22:36:32.350906] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-07T22:36:32.353597] [INFO ] [MAIN ] Derivative Progress: 392/1748 symbols completed. CNQ took 1.3s. Estimated remaining: 8m 42s. Rate: 155.8 symbols/min [2025-10-07T22:36:32.355330] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:32.355545] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-07T22:36:32.356308] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-07T22:36:32.358421] [INFO ] [MAIN ] Derivative Progress: 393/1748 symbols completed. CNP took 1.3s. Estimated remaining: 8m 41s. Rate: 156.2 symbols/min [2025-10-07T22:36:32.358710] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:32.430875] [DEBUG] [LOCAL ] CNX: Loaded 51355 existing records from primary storage. [2025-10-07T22:36:32.431553] [INFO ] [MAIN ] CNX: Loaded 51355 primary data records. [2025-10-07T22:36:32.479889] [DEBUG] [LOCAL ] COF: Loaded 53609 existing records from primary storage. [2025-10-07T22:36:32.497006] [INFO ] [MAIN ] COF: Loaded 53609 primary data records. [2025-10-07T22:36:32.613952] [DEBUG] [LOCAL ] COHR: Loaded 53365 existing records from primary storage. [2025-10-07T22:36:32.718290] [INFO ] [MAIN ] COHR: Loaded 53365 primary data records. [2025-10-07T22:36:33.449564] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:33.452810] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51355 primary records. [2025-10-07T22:36:33.453055] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-07T22:36:33.470521] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-10-07T22:36:33.470884] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-07T22:36:33.478255] [INFO ] [MAIN ] Derivative Progress: 394/1748 symbols completed. CNX took 1.1s. Estimated remaining: 8m 43s. Rate: 155.4 symbols/min [2025-10-07T22:36:33.487938] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:33.489940] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:33.492198] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53609 primary records. [2025-10-07T22:36:33.493083] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-07T22:36:33.520253] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:33.525859] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53365 primary records. [2025-10-07T22:36:33.526044] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-07T22:36:33.525035] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-07T22:36:33.526229] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-07T22:36:33.529404] [INFO ] [MAIN ] Derivative Progress: 395/1748 symbols completed. COF took 1.2s. Estimated remaining: 8m 41s. Rate: 155.8 symbols/min [2025-10-07T22:36:33.529923] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:33.546363] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-10-07T22:36:33.546587] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-07T22:36:33.548921] [INFO ] [MAIN ] Derivative Progress: 396/1748 symbols completed. COHR took 1.2s. Estimated remaining: 8m 40s. Rate: 156.1 symbols/min [2025-10-07T22:36:33.549118] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:33.593236] [DEBUG] [LOCAL ] COMP: Loaded 53401 existing records from primary storage. [2025-10-07T22:36:33.593542] [INFO ] [MAIN ] COMP: Loaded 53401 primary data records. [2025-10-07T22:36:33.622044] [DEBUG] [LOCAL ] COOK: Loaded 24428 existing records from primary storage. [2025-10-07T22:36:33.642090] [INFO ] [MAIN ] COOK: Loaded 24428 primary data records. [2025-10-07T22:36:33.824510] [DEBUG] [LOCAL ] CON: Loaded 38863 existing records from primary storage. [2025-10-07T22:36:33.840940] [INFO ] [MAIN ] CON: Loaded 38863 primary data records. [2025-10-07T22:36:34.651818] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:34.666330] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53401 primary records. [2025-10-07T22:36:34.667505] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-07T22:36:34.669537] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:34.671614] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24428 primary records. [2025-10-07T22:36:34.693917] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-07T22:36:34.697933] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:34.707402] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38863 primary records. [2025-10-07T22:36:34.712189] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-10-07T22:36:34.715118] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-07T22:36:34.716573] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-07T22:36:34.718539] [INFO ] [MAIN ] Derivative Progress: 397/1748 symbols completed. COMP took 1.2s. Estimated remaining: 8m 42s. Rate: 155.3 symbols/min [2025-10-07T22:36:34.720718] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:34.735740] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-07T22:36:34.737967] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-07T22:36:34.740495] [INFO ] [MAIN ] Derivative Progress: 398/1748 symbols completed. COOK took 1.2s. Estimated remaining: 8m 40s. Rate: 155.7 symbols/min [2025-10-07T22:36:34.741879] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:34.743177] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-10-07T22:36:34.743807] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-07T22:36:34.745948] [INFO ] [MAIN ] Derivative Progress: 399/1748 symbols completed. CON took 1.2s. Estimated remaining: 8m 38s. Rate: 156.1 symbols/min [2025-10-07T22:36:34.746223] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:34.804373] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-07T22:36:34.804589] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-07T22:36:34.926001] [DEBUG] [LOCAL ] COUR: Loaded 49046 existing records from primary storage. [2025-10-07T22:36:34.937540] [INFO ] [MAIN ] COUR: Loaded 49046 primary data records. [2025-10-07T22:36:35.256570] [DEBUG] [LOCAL ] COTY: Loaded 53239 existing records from primary storage. [2025-10-07T22:36:35.290272] [INFO ] [MAIN ] COTY: Loaded 53239 primary data records. [2025-10-07T22:36:35.844419] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:35.859027] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-10-07T22:36:35.860024] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:35.859875] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-07T22:36:35.870251] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 49046 primary records. [2025-10-07T22:36:35.871751] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-07T22:36:35.915873] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-10-07T22:36:35.916770] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-07T22:36:35.915787] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:35.917790] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53239 primary records. [2025-10-07T22:36:35.921407] [INFO ] [MAIN ] Derivative Progress: 400/1748 symbols completed. COP took 1.2s. Estimated remaining: 8m 41s. Rate: 155.3 symbols/min [2025-10-07T22:36:35.921797] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-10-07T22:36:35.921610] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:35.921949] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-10-07T22:36:35.923866] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-07T22:36:35.935311] [INFO ] [MAIN ] Derivative Progress: 401/1748 symbols completed. COUR took 1.2s. Estimated remaining: 8m 39s. Rate: 155.7 symbols/min [2025-10-07T22:36:35.941761] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:35.945674] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-10-07T22:36:35.946370] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-10-07T22:36:35.949156] [INFO ] [MAIN ] Derivative Progress: 402/1748 symbols completed. COTY took 1.2s. Estimated remaining: 8m 38s. Rate: 156.1 symbols/min [2025-10-07T22:36:35.949351] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:36.000929] [DEBUG] [LOCAL ] CPA: Loaded 28274 existing records from primary storage. [2025-10-07T22:36:36.001267] [INFO ] [MAIN ] CPA: Loaded 28274 primary data records. [2025-10-07T22:36:36.097394] [DEBUG] [LOCAL ] CPAY: Loaded 30449 existing records from primary storage. [2025-10-07T22:36:36.135017] [INFO ] [MAIN ] CPAY: Loaded 30449 primary data records. [2025-10-07T22:36:36.139379] [DEBUG] [LOCAL ] CP: Loaded 53265 existing records from primary storage. [2025-10-07T22:36:36.180995] [INFO ] [MAIN ] CP: Loaded 53265 primary data records. [2025-10-07T22:36:37.037785] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:37.040395] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28274 primary records. [2025-10-07T22:36:37.040804] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-07T22:36:37.071311] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-10-07T22:36:37.071230] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:37.071556] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-07T22:36:37.072319] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30449 primary records. [2025-10-07T22:36:37.075301] [INFO ] [MAIN ] Derivative Progress: 403/1748 symbols completed. CPA took 1.1s. Estimated remaining: 8m 40s. Rate: 155.3 symbols/min [2025-10-07T22:36:37.073319] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-07T22:36:37.103396] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:37.105964] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53265 primary records. [2025-10-07T22:36:37.107016] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-07T22:36:37.107073] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-07T22:36:37.107670] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-07T22:36:37.109975] [INFO ] [MAIN ] Derivative Progress: 404/1748 symbols completed. CPAY took 1.2s. Estimated remaining: 8m 38s. Rate: 155.7 symbols/min [2025-10-07T22:36:37.125065] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-07T22:36:37.125157] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-07T22:36:37.127693] [INFO ] [MAIN ] Derivative Progress: 405/1748 symbols completed. CP took 1.2s. Estimated remaining: 8m 36s. Rate: 156.0 symbols/min [2025-10-07T22:36:37.128137] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:37.128453] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:37.128313] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:37.149894] [DEBUG] [LOCAL ] CPK: Loaded 13627 existing records from primary storage. [2025-10-07T22:36:37.150074] [INFO ] [MAIN ] CPK: Loaded 13627 primary data records. [2025-10-07T22:36:37.386352] [DEBUG] [LOCAL ] CPNG: Loaded 53672 existing records from primary storage. [2025-10-07T22:36:37.389960] [INFO ] [MAIN ] CPNG: Loaded 53672 primary data records. [2025-10-07T22:36:37.406577] [DEBUG] [LOCAL ] CPRI: Loaded 52513 existing records from primary storage. [2025-10-07T22:36:37.410196] [INFO ] [MAIN ] CPRI: Loaded 52513 primary data records. [2025-10-07T22:36:38.157881] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:38.158788] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13627 primary records. [2025-10-07T22:36:38.158976] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-07T22:36:38.182431] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-07T22:36:38.182962] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-07T22:36:38.184874] [INFO ] [MAIN ] Derivative Progress: 406/1748 symbols completed. CPK took 1.1s. Estimated remaining: 8m 38s. Rate: 155.4 symbols/min [2025-10-07T22:36:38.185152] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:38.205059] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:38.207805] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52513 primary records. [2025-10-07T22:36:38.208636] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-07T22:36:38.245030] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:38.255126] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53672 primary records. [2025-10-07T22:36:38.258095] [DEBUG] [LOCAL ] CPS: Loaded 25707 existing records from primary storage. [2025-10-07T22:36:38.257703] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-07T22:36:38.257461] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-07T22:36:38.259156] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-07T22:36:38.259519] [INFO ] [MAIN ] CPS: Loaded 25707 primary data records. [2025-10-07T22:36:38.282321] [INFO ] [MAIN ] Derivative Progress: 407/1748 symbols completed. CPRI took 1.2s. Estimated remaining: 8m 37s. Rate: 155.6 symbols/min [2025-10-07T22:36:38.307995] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:38.343844] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-10-07T22:36:38.355510] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-07T22:36:38.373565] [INFO ] [MAIN ] Derivative Progress: 408/1748 symbols completed. CPNG took 1.2s. Estimated remaining: 8m 36s. Rate: 155.9 symbols/min [2025-10-07T22:36:38.384806] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:38.637830] [DEBUG] [LOCAL ] CR: Loaded 24194 existing records from primary storage. [2025-10-07T22:36:38.638009] [INFO ] [MAIN ] CR: Loaded 24194 primary data records. [2025-10-07T22:36:38.725166] [DEBUG] [LOCAL ] CPT: Loaded 44398 existing records from primary storage. [2025-10-07T22:36:38.737101] [INFO ] [MAIN ] CPT: Loaded 44398 primary data records. [2025-10-07T22:36:39.127414] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:39.169998] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 25707 primary records. [2025-10-07T22:36:39.281233] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-07T22:36:39.308626] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-07T22:36:39.308804] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-07T22:36:39.311038] [INFO ] [MAIN ] Derivative Progress: 409/1748 symbols completed. CPS took 1.1s. Estimated remaining: 8m 37s. Rate: 155.4 symbols/min [2025-10-07T22:36:39.311326] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:39.325452] [DEBUG] [LOCAL ] CRBD: Loaded 8964 existing records from primary storage. [2025-10-07T22:36:39.326156] [INFO ] [MAIN ] CRBD: Loaded 8964 primary data records. [2025-10-07T22:36:39.448034] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:39.490423] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24194 primary records. [2025-10-07T22:36:39.523217] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-07T22:36:39.669786] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:39.674217] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44398 primary records. [2025-10-07T22:36:39.674909] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-07T22:36:39.695793] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-07T22:36:39.696524] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-10-07T22:36:39.697490] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-07T22:36:39.696615] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-07T22:36:39.699794] [INFO ] [MAIN ] Derivative Progress: 410/1748 symbols completed. CR took 1.3s. Estimated remaining: 8m 37s. Rate: 155.4 symbols/min [2025-10-07T22:36:39.702742] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:39.703108] [INFO ] [MAIN ] Derivative Progress: 411/1748 symbols completed. CPT took 1.4s. Estimated remaining: 8m 35s. Rate: 155.8 symbols/min [2025-10-07T22:36:39.703922] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:39.729601] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:39.730697] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 8964 primary records. [2025-10-07T22:36:39.730859] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-07T22:36:39.748491] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-10-07T22:36:39.748588] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-07T22:36:39.751299] [INFO ] [MAIN ] Derivative Progress: 412/1748 symbols completed. CRBD took 0.4s. Estimated remaining: 8m 34s. Rate: 156.1 symbols/min [2025-10-07T22:36:39.767256] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:39.799271] [DEBUG] [LOCAL ] CRBG: Loaded 52422 existing records from primary storage. [2025-10-07T22:36:39.811685] [INFO ] [MAIN ] CRBG: Loaded 52422 primary data records. [2025-10-07T22:36:39.859856] [DEBUG] [LOCAL ] CRC: Loaded 43850 existing records from primary storage. [2025-10-07T22:36:39.871272] [INFO ] [MAIN ] CRC: Loaded 43850 primary data records. [2025-10-07T22:36:40.160857] [DEBUG] [LOCAL ] CRGY: Loaded 52498 existing records from primary storage. [2025-10-07T22:36:40.394690] [INFO ] [MAIN ] CRGY: Loaded 52498 primary data records. [2025-10-07T22:36:40.939828] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:40.940884] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52422 primary records. [2025-10-07T22:36:40.941201] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-07T22:36:40.968744] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:40.970685] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 43850 primary records. [2025-10-07T22:36:40.971037] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-07T22:36:40.989541] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-07T22:36:40.990089] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-07T22:36:40.993548] [INFO ] [MAIN ] Derivative Progress: 413/1748 symbols completed. CRC took 1.3s. Estimated remaining: 8m 36s. Rate: 155.3 symbols/min [2025-10-07T22:36:40.993777] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:40.995102] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-07T22:36:40.995403] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-07T22:36:40.997478] [INFO ] [MAIN ] Derivative Progress: 414/1748 symbols completed. CRBG took 1.3s. Estimated remaining: 8m 34s. Rate: 155.6 symbols/min [2025-10-07T22:36:40.999892] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:41.016155] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:41.017015] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52498 primary records. [2025-10-07T22:36:41.017115] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-07T22:36:41.033856] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-07T22:36:41.033984] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-07T22:36:41.036178] [INFO ] [MAIN ] Derivative Progress: 415/1748 symbols completed. CRGY took 1.3s. Estimated remaining: 8m 33s. Rate: 156.0 symbols/min [2025-10-07T22:36:41.036493] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:41.086454] [DEBUG] [LOCAL ] CRH: Loaded 53462 existing records from primary storage. [2025-10-07T22:36:41.086849] [INFO ] [MAIN ] CRH: Loaded 53462 primary data records. [2025-10-07T22:36:41.213363] [DEBUG] [LOCAL ] CRI: Loaded 49806 existing records from primary storage. [2025-10-07T22:36:41.217081] [INFO ] [MAIN ] CRI: Loaded 49806 primary data records. [2025-10-07T22:36:41.423157] [DEBUG] [LOCAL ] CRK: Loaded 52197 existing records from primary storage. [2025-10-07T22:36:41.550976] [INFO ] [MAIN ] CRK: Loaded 52197 primary data records. [2025-10-07T22:36:42.138759] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:42.139904] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53462 primary records. [2025-10-07T22:36:42.140056] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-07T22:36:42.157595] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-10-07T22:36:42.157751] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-07T22:36:42.159824] [INFO ] [MAIN ] Derivative Progress: 416/1748 symbols completed. CRH took 1.2s. Estimated remaining: 8m 35s. Rate: 155.3 symbols/min [2025-10-07T22:36:42.161471] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:42.178810] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:42.179567] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49806 primary records. [2025-10-07T22:36:42.179916] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-07T22:36:42.203067] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-07T22:36:42.215939] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-07T22:36:42.218808] [INFO ] [MAIN ] Derivative Progress: 417/1748 symbols completed. CRI took 1.2s. Estimated remaining: 8m 33s. Rate: 155.6 symbols/min [2025-10-07T22:36:42.219132] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:42.219476] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:42.220601] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52197 primary records. [2025-10-07T22:36:42.220826] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-07T22:36:42.264983] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-10-07T22:36:42.266324] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-07T22:36:42.269117] [INFO ] [MAIN ] Derivative Progress: 418/1748 symbols completed. CRK took 1.2s. Estimated remaining: 8m 32s. Rate: 155.9 symbols/min [2025-10-07T22:36:42.270203] [DEBUG] [LOCAL ] CRL: Loaded 42802 existing records from primary storage. [2025-10-07T22:36:42.270361] [INFO ] [MAIN ] CRL: Loaded 42802 primary data records. [2025-10-07T22:36:42.626214] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-07T22:36:42.627058] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-07T22:36:42.952052] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:42.952951] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42802 primary records. [2025-10-07T22:36:42.953092] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-07T22:36:42.974301] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-07T22:36:42.974412] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-07T22:36:42.977262] [INFO ] [MAIN ] Derivative Progress: 419/1748 symbols completed. CRL took 0.8s. Estimated remaining: 8m 33s. Rate: 155.6 symbols/min [2025-10-07T22:36:42.993117] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:42.993783] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-10-07T22:36:42.993844] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-07T22:36:43.009198] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-10-07T22:36:43.009258] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-07T22:36:43.011359] [INFO ] [MAIN ] Derivative Progress: 420/1748 symbols completed. CRM took 0.8s. Estimated remaining: 8m 31s. Rate: 155.9 symbols/min [2025-10-07T22:36:43.012022] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:43.011958] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:43.011876] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:43.022327] [DEBUG] [LOCAL ] CRT: Loaded 5025 existing records from primary storage. [2025-10-07T22:36:43.022675] [INFO ] [MAIN ] CRT: Loaded 5025 primary data records. [2025-10-07T22:36:43.253929] [DEBUG] [LOCAL ] CSAN: Loaded 42225 existing records from primary storage. [2025-10-07T22:36:43.375249] [DEBUG] [LOCAL ] CRS: Loaded 43173 existing records from primary storage. [2025-10-07T22:36:43.423371] [INFO ] [MAIN ] CRS: Loaded 43173 primary data records. [2025-10-07T22:36:43.297608] [INFO ] [MAIN ] CSAN: Loaded 42225 primary data records. [2025-10-07T22:36:44.069143] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:44.070024] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 5025 primary records. [2025-10-07T22:36:44.070258] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-07T22:36:44.091064] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-10-07T22:36:44.091437] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-07T22:36:44.093517] [INFO ] [MAIN ] Derivative Progress: 421/1748 symbols completed. CRT took 1.1s. Estimated remaining: 8m 33s. Rate: 155.2 symbols/min [2025-10-07T22:36:44.093702] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:44.111633] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:44.113697] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43173 primary records. [2025-10-07T22:36:44.114895] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-07T22:36:44.146189] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:44.151123] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42225 primary records. [2025-10-07T22:36:44.151705] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-07T22:36:44.151530] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-07T22:36:44.160636] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-07T22:36:44.163740] [INFO ] [MAIN ] Derivative Progress: 422/1748 symbols completed. CRS took 1.2s. Estimated remaining: 8m 31s. Rate: 155.6 symbols/min [2025-10-07T22:36:44.164040] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:44.194907] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-07T22:36:44.195872] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-07T22:36:44.195695] [DEBUG] [LOCAL ] CSL: Loaded 31514 existing records from primary storage. [2025-10-07T22:36:44.198816] [INFO ] [MAIN ] Derivative Progress: 423/1748 symbols completed. CSAN took 1.2s. Estimated remaining: 8m 30s. Rate: 155.9 symbols/min [2025-10-07T22:36:44.199143] [INFO ] [MAIN ] CSL: Loaded 31514 primary data records. [2025-10-07T22:36:44.199344] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:44.277106] [DEBUG] [LOCAL ] CSR: Loaded 12957 existing records from primary storage. [2025-10-07T22:36:44.294173] [INFO ] [MAIN ] CSR: Loaded 12957 primary data records. [2025-10-07T22:36:44.694211] [DEBUG] [LOCAL ] CSTM: Loaded 47537 existing records from primary storage. [2025-10-07T22:36:44.716617] [INFO ] [MAIN ] CSTM: Loaded 47537 primary data records. [2025-10-07T22:36:45.314221] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:36:45.315592] [INFO ] [MAIN ] CSL: Generated 1793 derivative records from 31514 primary records. [2025-10-07T22:36:45.316565] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-07T22:36:45.366082] [DEBUG] [LOCAL ] CSL: Derivative data saved (1793 records). [2025-10-07T22:36:45.365974] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:45.366304] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-07T22:36:45.369731] [INFO ] [MAIN ] Derivative Progress: 424/1748 symbols completed. CSL took 1.3s. Estimated remaining: 8m 32s. Rate: 155.1 symbols/min [2025-10-07T22:36:45.370030] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:45.367323] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12957 primary records. [2025-10-07T22:36:45.371890] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-07T22:36:45.399540] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-07T22:36:45.401714] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-07T22:36:45.412780] [INFO ] [MAIN ] Derivative Progress: 425/1748 symbols completed. CSR took 1.2s. Estimated remaining: 8m 31s. Rate: 155.5 symbols/min [2025-10-07T22:36:45.416571] [DEBUG] [LOCAL ] CSV: Loaded 12795 existing records from primary storage. [2025-10-07T22:36:45.415228] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:45.436125] [INFO ] [MAIN ] CSV: Loaded 12795 primary data records. [2025-10-07T22:36:45.437114] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:45.438849] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47537 primary records. [2025-10-07T22:36:45.467351] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-07T22:36:45.582665] [DEBUG] [LOCAL ] CTBB: Loaded 7035 existing records from primary storage. [2025-10-07T22:36:45.594159] [INFO ] [MAIN ] CTBB: Loaded 7035 primary data records. [2025-10-07T22:36:45.737955] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-10-07T22:36:45.748824] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-07T22:36:45.821815] [INFO ] [MAIN ] Derivative Progress: 426/1748 symbols completed. CSTM took 1.6s. Estimated remaining: 8m 30s. Rate: 155.4 symbols/min [2025-10-07T22:36:45.832540] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:46.174008] [DEBUG] [LOCAL ] CTDD: Loaded 5824 existing records from primary storage. [2025-10-07T22:36:46.318080] [INFO ] [MAIN ] CTDD: Loaded 5824 primary data records. [2025-10-07T22:36:46.658463] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:46.659831] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12795 primary records. [2025-10-07T22:36:46.660072] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-07T22:36:46.682672] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-07T22:36:46.682851] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-07T22:36:46.685239] [INFO ] [MAIN ] Derivative Progress: 427/1748 symbols completed. CSV took 1.3s. Estimated remaining: 8m 31s. Rate: 155.0 symbols/min [2025-10-07T22:36:46.693845] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:46.700691] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:46.701792] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7035 primary records. [2025-10-07T22:36:46.702029] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-07T22:36:46.719419] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-07T22:36:46.720057] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-07T22:36:46.723597] [INFO ] [MAIN ] Derivative Progress: 428/1748 symbols completed. CTBB took 1.3s. Estimated remaining: 8m 30s. Rate: 155.3 symbols/min [2025-10-07T22:36:46.725825] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:46.748695] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:46.749467] [INFO ] [MAIN ] CTDD: Generated 1794 derivative records from 5824 primary records. [2025-10-07T22:36:46.749678] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-07T22:36:46.772562] [DEBUG] [LOCAL ] CTO: Loaded 27731 existing records from primary storage. [2025-10-07T22:36:46.773243] [INFO ] [MAIN ] CTO: Loaded 27731 primary data records. [2025-10-07T22:36:46.829349] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1794 records). [2025-10-07T22:36:46.855963] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-07T22:36:46.863961] [INFO ] [MAIN ] Derivative Progress: 429/1748 symbols completed. CTDD took 1.0s. Estimated remaining: 8m 29s. Rate: 155.6 symbols/min [2025-10-07T22:36:46.869339] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:46.953878] [DEBUG] [LOCAL ] CTOS: Loaded 36691 existing records from primary storage. [2025-10-07T22:36:46.983683] [INFO ] [MAIN ] CTOS: Loaded 36691 primary data records. [2025-10-07T22:36:47.495806] [DEBUG] [LOCAL ] CTRA: Loaded 53646 existing records from primary storage. [2025-10-07T22:36:47.497396] [INFO ] [MAIN ] CTRA: Loaded 53646 primary data records. [2025-10-07T22:36:47.804284] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:47.819586] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27731 primary records. [2025-10-07T22:36:47.819907] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-07T22:36:47.839292] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-10-07T22:36:47.840036] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-07T22:36:47.843261] [INFO ] [MAIN ] Derivative Progress: 430/1748 symbols completed. CTO took 1.1s. Estimated remaining: 8m 30s. Rate: 155.0 symbols/min [2025-10-07T22:36:47.845437] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:47.861940] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:47.863044] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 36691 primary records. [2025-10-07T22:36:47.863172] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-07T22:36:47.881300] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-10-07T22:36:47.881583] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-07T22:36:47.884573] [INFO ] [MAIN ] Derivative Progress: 431/1748 symbols completed. CTOS took 1.2s. Estimated remaining: 8m 29s. Rate: 155.3 symbols/min [2025-10-07T22:36:47.886020] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:47.912374] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:47.913091] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53646 primary records. [2025-10-07T22:36:47.913332] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-07T22:36:47.929329] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-07T22:36:47.930210] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-07T22:36:47.932908] [INFO ] [MAIN ] Derivative Progress: 432/1748 symbols completed. CTRA took 1.1s. Estimated remaining: 8m 27s. Rate: 155.6 symbols/min [2025-10-07T22:36:47.945450] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:47.949064] [DEBUG] [LOCAL ] CTRE: Loaded 49274 existing records from primary storage. [2025-10-07T22:36:47.949468] [INFO ] [MAIN ] CTRE: Loaded 49274 primary data records. [2025-10-07T22:36:48.093019] [DEBUG] [LOCAL ] CTS: Loaded 19410 existing records from primary storage. [2025-10-07T22:36:48.133440] [INFO ] [MAIN ] CTS: Loaded 19410 primary data records. [2025-10-07T22:36:48.369148] [DEBUG] [LOCAL ] CTRI: Loaded 39307 existing records from primary storage. [2025-10-07T22:36:48.392117] [INFO ] [MAIN ] CTRI: Loaded 39307 primary data records. [2025-10-07T22:36:48.993025] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:48.994935] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49274 primary records. [2025-10-07T22:36:48.995456] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-07T22:36:49.014396] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-10-07T22:36:49.015253] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-07T22:36:49.017585] [INFO ] [MAIN ] Derivative Progress: 433/1748 symbols completed. CTRE took 1.2s. Estimated remaining: 8m 29s. Rate: 155.0 symbols/min [2025-10-07T22:36:49.040675] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:49.041583] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19410 primary records. [2025-10-07T22:36:49.041703] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-07T22:36:49.074065] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:49.075453] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 39307 primary records. [2025-10-07T22:36:49.075517] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-07T22:36:49.075731] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-07T22:36:49.075634] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-07T22:36:49.078696] [INFO ] [MAIN ] Derivative Progress: 434/1748 symbols completed. CTS took 1.1s. Estimated remaining: 8m 28s. Rate: 155.3 symbols/min [2025-10-07T22:36:49.094505] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-10-07T22:36:49.094571] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-07T22:36:49.102861] [INFO ] [MAIN ] Derivative Progress: 435/1748 symbols completed. CTRI took 1.2s. Estimated remaining: 8m 26s. Rate: 155.6 symbols/min [2025-10-07T22:36:49.103819] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:49.103697] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:49.103885] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:49.137857] [DEBUG] [LOCAL ] CUBI: Loaded 27078 existing records from primary storage. [2025-10-07T22:36:49.151888] [INFO ] [MAIN ] CUBI: Loaded 27078 primary data records. [2025-10-07T22:36:49.301488] [DEBUG] [LOCAL ] CUBE: Loaded 50776 existing records from primary storage. [2025-10-07T22:36:49.302786] [INFO ] [MAIN ] CUBE: Loaded 50776 primary data records. [2025-10-07T22:36:49.302216] [DEBUG] [LOCAL ] CUK: Loaded 50976 existing records from primary storage. [2025-10-07T22:36:49.303093] [INFO ] [MAIN ] CUK: Loaded 50976 primary data records. [2025-10-07T22:36:50.146382] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:50.147590] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27078 primary records. [2025-10-07T22:36:50.147829] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-07T22:36:50.181701] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-10-07T22:36:50.182697] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-07T22:36:50.183001] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:50.185184] [INFO ] [MAIN ] Derivative Progress: 436/1748 symbols completed. CUBI took 1.1s. Estimated remaining: 8m 28s. Rate: 155.0 symbols/min [2025-10-07T22:36:50.186809] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50776 primary records. [2025-10-07T22:36:50.186986] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-07T22:36:50.187937] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:50.218704] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:50.220126] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 50976 primary records. [2025-10-07T22:36:50.220595] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-07T22:36:50.223217] [DEBUG] [LOCAL ] CULP: Loaded 2898 existing records from primary storage. [2025-10-07T22:36:50.223570] [INFO ] [MAIN ] CULP: Loaded 2898 primary data records. [2025-10-07T22:36:50.236041] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-07T22:36:50.236413] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-07T22:36:50.257586] [INFO ] [MAIN ] Derivative Progress: 437/1748 symbols completed. CUBE took 1.2s. Estimated remaining: 8m 27s. Rate: 155.3 symbols/min [2025-10-07T22:36:50.284283] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:50.372206] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-07T22:36:50.399721] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-07T22:36:50.437696] [INFO ] [MAIN ] Derivative Progress: 438/1748 symbols completed. CUK took 1.3s. Estimated remaining: 8m 26s. Rate: 155.5 symbols/min [2025-10-07T22:36:50.438425] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:50.577059] [DEBUG] [LOCAL ] CURB: Loaded 32683 existing records from primary storage. [2025-10-07T22:36:50.577391] [INFO ] [MAIN ] CURB: Loaded 32683 primary data records. [2025-10-07T22:36:50.929117] [DEBUG] [LOCAL ] CUZ: Loaded 49405 existing records from primary storage. [2025-10-07T22:36:50.930423] [INFO ] [MAIN ] CUZ: Loaded 49405 primary data records. [2025-10-07T22:36:51.077786] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:51.108842] [INFO ] [MAIN ] CULP: Generated 1794 derivative records from 2898 primary records. [2025-10-07T22:36:51.147241] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-07T22:36:51.336544] [DEBUG] [LOCAL ] CULP: Derivative data saved (1794 records). [2025-10-07T22:36:51.336807] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-07T22:36:51.339288] [INFO ] [MAIN ] Derivative Progress: 439/1748 symbols completed. CULP took 1.2s. Estimated remaining: 8m 27s. Rate: 155.0 symbols/min [2025-10-07T22:36:51.340294] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:51.357000] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:51.357750] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32683 primary records. [2025-10-07T22:36:51.357840] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-07T22:36:51.379123] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-10-07T22:36:51.379214] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-07T22:36:51.395294] [INFO ] [MAIN ] Derivative Progress: 440/1748 symbols completed. CURB took 1.1s. Estimated remaining: 8m 25s. Rate: 155.3 symbols/min [2025-10-07T22:36:51.395721] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:51.396160] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:51.397735] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49405 primary records. [2025-10-07T22:36:51.397840] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-07T22:36:51.432777] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-07T22:36:51.432980] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-07T22:36:51.435463] [INFO ] [MAIN ] Derivative Progress: 441/1748 symbols completed. CUZ took 1.0s. Estimated remaining: 8m 24s. Rate: 155.6 symbols/min [2025-10-07T22:36:51.441203] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:51.441906] [DEBUG] [LOCAL ] CVEO: Loaded 15232 existing records from primary storage. [2025-10-07T22:36:51.442344] [INFO ] [MAIN ] CVEO: Loaded 15232 primary data records. [2025-10-07T22:36:51.563503] [DEBUG] [LOCAL ] CVE: Loaded 53559 existing records from primary storage. [2025-10-07T22:36:51.579266] [INFO ] [MAIN ] CVE: Loaded 53559 primary data records. [2025-10-07T22:36:51.957831] [DEBUG] [LOCAL ] CVI: Loaded 46516 existing records from primary storage. [2025-10-07T22:36:51.958889] [INFO ] [MAIN ] CVI: Loaded 46516 primary data records. [2025-10-07T22:36:52.450351] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:52.452324] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15232 primary records. [2025-10-07T22:36:52.452496] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-07T22:36:52.490122] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-10-07T22:36:52.490923] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:52.491737] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53559 primary records. [2025-10-07T22:36:52.491996] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-07T22:36:52.492890] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-07T22:36:52.496920] [INFO ] [MAIN ] Derivative Progress: 442/1748 symbols completed. CVEO took 1.1s. Estimated remaining: 8m 26s. Rate: 155.0 symbols/min [2025-10-07T22:36:52.504757] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:52.533233] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:52.534232] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46516 primary records. [2025-10-07T22:36:52.534414] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-07T22:36:52.543208] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-10-07T22:36:52.544292] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-07T22:36:52.547887] [INFO ] [MAIN ] Derivative Progress: 443/1748 symbols completed. CVE took 1.2s. Estimated remaining: 8m 24s. Rate: 155.3 symbols/min [2025-10-07T22:36:52.568634] [DEBUG] [LOCAL ] CVLG: Loaded 15491 existing records from primary storage. [2025-10-07T22:36:52.568943] [INFO ] [MAIN ] CVLG: Loaded 15491 primary data records. [2025-10-07T22:36:52.565853] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:52.571915] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-10-07T22:36:52.579786] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-07T22:36:52.607081] [INFO ] [MAIN ] Derivative Progress: 444/1748 symbols completed. CVI took 1.2s. Estimated remaining: 8m 23s. Rate: 155.6 symbols/min [2025-10-07T22:36:52.619389] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:52.902842] [DEBUG] [LOCAL ] CW: Loaded 22229 existing records from primary storage. [2025-10-07T22:36:52.903872] [INFO ] [MAIN ] CW: Loaded 22229 primary data records. [2025-10-07T22:36:53.029471] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-07T22:36:53.035850] [INFO ] [MAIN ] CVS: Loaded 53696 primary data records. [2025-10-07T22:36:53.613624] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:53.615324] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15491 primary records. [2025-10-07T22:36:53.615616] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-07T22:36:53.634295] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-10-07T22:36:53.634632] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-07T22:36:53.637135] [INFO ] [MAIN ] Derivative Progress: 445/1748 symbols completed. CVLG took 1.1s. Estimated remaining: 8m 24s. Rate: 155.0 symbols/min [2025-10-07T22:36:53.637340] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:53.657421] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:53.658199] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22229 primary records. [2025-10-07T22:36:53.658532] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-07T22:36:53.690739] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:53.691997] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53696 primary records. [2025-10-07T22:36:53.692174] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-07T22:36:53.691138] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-10-07T22:36:53.692708] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-07T22:36:53.695691] [INFO ] [MAIN ] Derivative Progress: 446/1748 symbols completed. CW took 1.1s. Estimated remaining: 8m 23s. Rate: 155.3 symbols/min [2025-10-07T22:36:53.707075] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:53.725550] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-07T22:36:53.725768] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-07T22:36:53.728688] [INFO ] [MAIN ] Derivative Progress: 447/1748 symbols completed. CVS took 1.2s. Estimated remaining: 8m 22s. Rate: 155.6 symbols/min [2025-10-07T22:36:53.729072] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:53.748982] [DEBUG] [LOCAL ] CWAN: Loaded 52446 existing records from primary storage. [2025-10-07T22:36:53.749163] [INFO ] [MAIN ] CWAN: Loaded 52446 primary data records. [2025-10-07T22:36:53.954262] [DEBUG] [LOCAL ] CWEN: Loaded 45224 existing records from primary storage. [2025-10-07T22:36:53.954622] [INFO ] [MAIN ] CWEN: Loaded 45224 primary data records. [2025-10-07T22:36:54.231255] [DEBUG] [LOCAL ] CWH: Loaded 51310 existing records from primary storage. [2025-10-07T22:36:54.242068] [INFO ] [MAIN ] CWH: Loaded 51310 primary data records. [2025-10-07T22:36:54.744905] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:54.746461] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52446 primary records. [2025-10-07T22:36:54.746771] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-07T22:36:54.781822] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:54.782983] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45224 primary records. [2025-10-07T22:36:54.783065] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-10-07T22:36:54.783239] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-07T22:36:54.783880] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-07T22:36:54.786793] [INFO ] [MAIN ] Derivative Progress: 448/1748 symbols completed. CWAN took 1.1s. Estimated remaining: 8m 23s. Rate: 155.0 symbols/min [2025-10-07T22:36:54.804885] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-10-07T22:36:54.817801] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-07T22:36:54.818086] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:54.820605] [INFO ] [MAIN ] Derivative Progress: 449/1748 symbols completed. CWEN took 1.1s. Estimated remaining: 8m 22s. Rate: 155.3 symbols/min [2025-10-07T22:36:54.821353] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51310 primary records. [2025-10-07T22:36:54.821575] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-07T22:36:54.837297] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-10-07T22:36:54.837358] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-07T22:36:54.839690] [INFO ] [MAIN ] Derivative Progress: 450/1748 symbols completed. CWH took 1.1s. Estimated remaining: 8m 20s. Rate: 155.7 symbols/min [2025-10-07T22:36:54.840174] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:54.840333] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:54.840268] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:54.850187] [DEBUG] [LOCAL ] CXE: Loaded 6168 existing records from primary storage. [2025-10-07T22:36:54.850471] [INFO ] [MAIN ] CXE: Loaded 6168 primary data records. [2025-10-07T22:36:55.233558] [DEBUG] [LOCAL ] CWK: Loaded 49503 existing records from primary storage. [2025-10-07T22:36:55.233929] [INFO ] [MAIN ] CWK: Loaded 49503 primary data records. [2025-10-07T22:36:55.355620] [DEBUG] [LOCAL ] CX: Loaded 52822 existing records from primary storage. [2025-10-07T22:36:55.377306] [INFO ] [MAIN ] CX: Loaded 52822 primary data records. [2025-10-07T22:36:55.879912] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:55.881155] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6168 primary records. [2025-10-07T22:36:55.881423] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-07T22:36:55.903245] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-07T22:36:55.911770] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-07T22:36:55.914106] [INFO ] [MAIN ] Derivative Progress: 451/1748 symbols completed. CXE took 1.1s. Estimated remaining: 8m 22s. Rate: 155.0 symbols/min [2025-10-07T22:36:55.918966] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:55.920864] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:55.921701] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49503 primary records. [2025-10-07T22:36:55.921877] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-07T22:36:55.953532] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:55.956566] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-07T22:36:55.955515] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52822 primary records. [2025-10-07T22:36:55.956826] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-07T22:36:55.956758] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-07T22:36:55.958929] [INFO ] [MAIN ] Derivative Progress: 452/1748 symbols completed. CWK took 1.1s. Estimated remaining: 8m 21s. Rate: 155.4 symbols/min [2025-10-07T22:36:55.959229] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:55.976323] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-07T22:36:55.976416] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-07T22:36:55.978736] [INFO ] [MAIN ] Derivative Progress: 453/1748 symbols completed. CX took 1.1s. Estimated remaining: 8m 19s. Rate: 155.7 symbols/min [2025-10-07T22:36:55.979156] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:56.015638] [DEBUG] [LOCAL ] CXM: Loaded 47611 existing records from primary storage. [2025-10-07T22:36:56.015913] [INFO ] [MAIN ] CXM: Loaded 47611 primary data records. [2025-10-07T22:36:56.088418] [DEBUG] [LOCAL ] CXT: Loaded 30988 existing records from primary storage. [2025-10-07T22:36:56.101125] [INFO ] [MAIN ] CXT: Loaded 30988 primary data records. [2025-10-07T22:36:56.441972] [DEBUG] [LOCAL ] CXW: Loaded 43951 existing records from primary storage. [2025-10-07T22:36:56.461584] [INFO ] [MAIN ] CXW: Loaded 43951 primary data records. [2025-10-07T22:36:56.972067] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:56.973746] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47611 primary records. [2025-10-07T22:36:56.975816] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-07T22:36:57.007040] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:57.010048] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30988 primary records. [2025-10-07T22:36:57.010692] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-07T22:36:57.011341] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-07T22:36:57.012065] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-07T22:36:57.014775] [INFO ] [MAIN ] Derivative Progress: 454/1748 symbols completed. CXM took 1.1s. Estimated remaining: 8m 21s. Rate: 155.1 symbols/min [2025-10-07T22:36:57.015411] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:57.054005] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:57.056023] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 43951 primary records. [2025-10-07T22:36:57.063493] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-07T22:36:57.063624] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-07T22:36:57.064058] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-07T22:36:57.066692] [INFO ] [MAIN ] Derivative Progress: 455/1748 symbols completed. CXT took 1.1s. Estimated remaining: 8m 19s. Rate: 155.4 symbols/min [2025-10-07T22:36:57.082989] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:57.103187] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-07T22:36:57.102744] [DEBUG] [LOCAL ] CYD: Loaded 26352 existing records from primary storage. [2025-10-07T22:36:57.103300] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-07T22:36:57.103478] [INFO ] [MAIN ] CYD: Loaded 26352 primary data records. [2025-10-07T22:36:57.105895] [INFO ] [MAIN ] Derivative Progress: 456/1748 symbols completed. CXW took 1.1s. Estimated remaining: 8m 18s. Rate: 155.7 symbols/min [2025-10-07T22:36:57.117828] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:57.316397] [DEBUG] [LOCAL ] DAC: Loaded 12546 existing records from primary storage. [2025-10-07T22:36:57.475696] [INFO ] [MAIN ] DAC: Loaded 12546 primary data records. [2025-10-07T22:36:57.497796] [DEBUG] [LOCAL ] CYH: Loaded 47623 existing records from primary storage. [2025-10-07T22:36:57.520913] [INFO ] [MAIN ] CYH: Loaded 47623 primary data records. [2025-10-07T22:36:58.129077] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:58.130438] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26352 primary records. [2025-10-07T22:36:58.130966] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-07T22:36:58.168832] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-10-07T22:36:58.169627] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-07T22:36:58.172853] [INFO ] [MAIN ] Derivative Progress: 457/1748 symbols completed. CYD took 1.2s. Estimated remaining: 8m 19s. Rate: 155.1 symbols/min [2025-10-07T22:36:58.169571] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:58.173844] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:58.175113] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12546 primary records. [2025-10-07T22:36:58.175353] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-07T22:36:58.206103] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:58.207687] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47623 primary records. [2025-10-07T22:36:58.208374] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-07T22:36:58.209574] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-07T22:36:58.210197] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-07T22:36:58.212459] [INFO ] [MAIN ] Derivative Progress: 458/1748 symbols completed. DAC took 1.1s. Estimated remaining: 8m 18s. Rate: 155.4 symbols/min [2025-10-07T22:36:58.219926] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:58.229229] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-07T22:36:58.229306] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-07T22:36:58.231613] [INFO ] [MAIN ] Derivative Progress: 459/1748 symbols completed. CYH took 1.1s. Estimated remaining: 8m 17s. Rate: 155.7 symbols/min [2025-10-07T22:36:58.231871] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:58.265116] [DEBUG] [LOCAL ] DAO: Loaded 20194 existing records from primary storage. [2025-10-07T22:36:58.265336] [INFO ] [MAIN ] DAO: Loaded 20194 primary data records. [2025-10-07T22:36:58.410724] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-07T22:36:58.433766] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-07T22:36:58.684112] [DEBUG] [LOCAL ] DAN: Loaded 49104 existing records from primary storage. [2025-10-07T22:36:58.707639] [INFO ] [MAIN ] DAN: Loaded 49104 primary data records. [2025-10-07T22:36:59.315299] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:59.316928] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 20194 primary records. [2025-10-07T22:36:59.317195] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-07T22:36:59.348561] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:59.350016] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-10-07T22:36:59.351325] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-07T22:36:59.355460] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-10-07T22:36:59.366570] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-07T22:36:59.370559] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-07T22:36:59.380994] [INFO ] [MAIN ] Derivative Progress: 460/1748 symbols completed. DAO took 1.1s. Estimated remaining: 8m 18s. Rate: 155.1 symbols/min [2025-10-07T22:36:59.386276] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-07T22:36:59.386125] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:59.388417] [INFO ] [MAIN ] Derivative Progress: 461/1748 symbols completed. DAL took 1.2s. Estimated remaining: 8m 17s. Rate: 155.4 symbols/min [2025-10-07T22:36:59.389083] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:59.388966] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:36:59.390524] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49104 primary records. [2025-10-07T22:36:59.390746] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-07T22:36:59.408663] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-10-07T22:36:59.408831] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-07T22:36:59.411244] [INFO ] [MAIN ] Derivative Progress: 462/1748 symbols completed. DAN took 1.2s. Estimated remaining: 8m 16s. Rate: 155.7 symbols/min [2025-10-07T22:36:59.411489] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:36:59.459213] [DEBUG] [LOCAL ] DAVA: Loaded 41291 existing records from primary storage. [2025-10-07T22:36:59.459548] [INFO ] [MAIN ] DAVA: Loaded 41291 primary data records. [2025-10-07T22:36:59.598595] [DEBUG] [LOCAL ] DAR: Loaded 51864 existing records from primary storage. [2025-10-07T22:36:59.609204] [INFO ] [MAIN ] DAR: Loaded 51864 primary data records. [2025-10-07T22:36:59.787260] [DEBUG] [LOCAL ] DB: Loaded 52522 existing records from primary storage. [2025-10-07T22:36:59.906206] [INFO ] [MAIN ] DB: Loaded 52522 primary data records. [2025-10-07T22:37:00.460846] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:00.462049] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 41291 primary records. [2025-10-07T22:37:00.462204] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-07T22:37:00.476397] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:00.484409] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51864 primary records. [2025-10-07T22:37:00.488406] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-07T22:37:00.524542] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:00.526035] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52522 primary records. [2025-10-07T22:37:00.526460] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-07T22:37:00.526383] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-07T22:37:00.524020] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-07T22:37:00.527329] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-07T22:37:00.527402] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-07T22:37:00.529474] [INFO ] [MAIN ] Derivative Progress: 463/1748 symbols completed. DAVA took 1.1s. Estimated remaining: 8m 17s. Rate: 155.1 symbols/min [2025-10-07T22:37:00.543491] [INFO ] [MAIN ] Derivative Progress: 464/1748 symbols completed. DAR took 1.2s. Estimated remaining: 8m 16s. Rate: 155.4 symbols/min [2025-10-07T22:37:00.547624] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-07T22:37:00.547714] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-07T22:37:00.550899] [INFO ] [MAIN ] Derivative Progress: 465/1748 symbols completed. DB took 1.1s. Estimated remaining: 8m 14s. Rate: 155.7 symbols/min [2025-10-07T22:37:00.551407] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:00.551342] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:00.551286] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:00.579280] [DEBUG] [LOCAL ] DBL: Loaded 9263 existing records from primary storage. [2025-10-07T22:37:00.578929] [DEBUG] [LOCAL ] DCO: Loaded 13934 existing records from primary storage. [2025-10-07T22:37:00.579459] [INFO ] [MAIN ] DBL: Loaded 9263 primary data records. [2025-10-07T22:37:00.579538] [INFO ] [MAIN ] DCO: Loaded 13934 primary data records. [2025-10-07T22:37:00.836835] [DEBUG] [LOCAL ] DBI: Loaded 44391 existing records from primary storage. [2025-10-07T22:37:00.866071] [INFO ] [MAIN ] DBI: Loaded 44391 primary data records. [2025-10-07T22:37:01.597736] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:01.607456] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9263 primary records. [2025-10-07T22:37:01.613790] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:01.614072] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-07T22:37:01.615034] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13934 primary records. [2025-10-07T22:37:01.615999] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-07T22:37:01.654546] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-10-07T22:37:01.655685] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-07T22:37:01.658151] [INFO ] [MAIN ] Derivative Progress: 466/1748 symbols completed. DCO took 1.1s. Estimated remaining: 8m 16s. Rate: 155.1 symbols/min [2025-10-07T22:37:01.659162] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:01.674611] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:01.676159] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 44391 primary records. [2025-10-07T22:37:01.676758] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-07T22:37:01.679059] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-10-07T22:37:01.690405] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-07T22:37:01.695824] [INFO ] [MAIN ] Derivative Progress: 467/1748 symbols completed. DBL took 1.1s. Estimated remaining: 8m 15s. Rate: 155.4 symbols/min [2025-10-07T22:37:01.697081] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:01.698291] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-07T22:37:01.698546] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-07T22:37:01.701284] [INFO ] [MAIN ] Derivative Progress: 468/1748 symbols completed. DBI took 1.1s. Estimated remaining: 8m 13s. Rate: 155.7 symbols/min [2025-10-07T22:37:01.702009] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:01.775182] [DEBUG] [LOCAL ] DD: Loaded 52861 existing records from primary storage. [2025-10-07T22:37:01.789710] [INFO ] [MAIN ] DD: Loaded 52861 primary data records. [2025-10-07T22:37:01.790411] [DEBUG] [LOCAL ] DDL: Loaded 36762 existing records from primary storage. [2025-10-07T22:37:01.813053] [INFO ] [MAIN ] DDL: Loaded 36762 primary data records. [2025-10-07T22:37:01.994736] [DEBUG] [LOCAL ] DDD: Loaded 50919 existing records from primary storage. [2025-10-07T22:37:02.007815] [INFO ] [MAIN ] DDD: Loaded 50919 primary data records. [2025-10-07T22:37:02.816782] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:02.818339] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:02.818096] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52861 primary records. [2025-10-07T22:37:02.818580] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-07T22:37:02.819515] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36762 primary records. [2025-10-07T22:37:02.819956] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-07T22:37:02.853714] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-07T22:37:02.856108] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-07T22:37:02.859636] [INFO ] [MAIN ] Derivative Progress: 469/1748 symbols completed. DDL took 1.2s. Estimated remaining: 8m 15s. Rate: 155.1 symbols/min [2025-10-07T22:37:02.860186] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:02.860831] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-10-07T22:37:02.861196] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-07T22:37:02.871984] [INFO ] [MAIN ] Derivative Progress: 470/1748 symbols completed. DD took 1.2s. Estimated remaining: 8m 13s. Rate: 155.4 symbols/min [2025-10-07T22:37:02.877207] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:02.878451] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:02.879273] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50919 primary records. [2025-10-07T22:37:02.879337] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-07T22:37:02.901789] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-10-07T22:37:02.902008] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-07T22:37:02.904467] [INFO ] [MAIN ] Derivative Progress: 471/1748 symbols completed. DDD took 1.2s. Estimated remaining: 8m 12s. Rate: 155.7 symbols/min [2025-10-07T22:37:02.904868] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:02.911531] [DEBUG] [LOCAL ] DDS: Loaded 12873 existing records from primary storage. [2025-10-07T22:37:02.911821] [INFO ] [MAIN ] DDS: Loaded 12873 primary data records. [2025-10-07T22:37:03.247074] [DEBUG] [LOCAL ] DE: Loaded 47575 existing records from primary storage. [2025-10-07T22:37:03.248529] [INFO ] [MAIN ] DE: Loaded 47575 primary data records. [2025-10-07T22:37:03.341157] [DEBUG] [LOCAL ] DEA: Loaded 40570 existing records from primary storage. [2025-10-07T22:37:03.379638] [INFO ] [MAIN ] DEA: Loaded 40570 primary data records. [2025-10-07T22:37:03.951720] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:03.968256] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 12873 primary records. [2025-10-07T22:37:03.968521] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-07T22:37:03.996514] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-10-07T22:37:03.997422] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-07T22:37:04.000611] [INFO ] [MAIN ] Derivative Progress: 472/1748 symbols completed. DDS took 1.1s. Estimated remaining: 8m 14s. Rate: 155.1 symbols/min [2025-10-07T22:37:04.001012] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:04.028524] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:04.040833] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47575 primary records. [2025-10-07T22:37:04.041055] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-07T22:37:04.065720] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:04.073746] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 40570 primary records. [2025-10-07T22:37:04.082967] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-07T22:37:04.085209] [DEBUG] [LOCAL ] DEC: Loaded 30438 existing records from primary storage. [2025-10-07T22:37:04.086033] [INFO ] [MAIN ] DEC: Loaded 30438 primary data records. [2025-10-07T22:37:04.185427] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-07T22:37:04.191834] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-07T22:37:04.200904] [INFO ] [MAIN ] Derivative Progress: 473/1748 symbols completed. DE took 1.3s. Estimated remaining: 8m 13s. Rate: 155.2 symbols/min [2025-10-07T22:37:04.206236] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:04.233912] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-10-07T22:37:04.239631] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-07T22:37:04.241968] [INFO ] [MAIN ] Derivative Progress: 474/1748 symbols completed. DEA took 1.3s. Estimated remaining: 8m 11s. Rate: 155.5 symbols/min [2025-10-07T22:37:04.242233] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:04.507693] [DEBUG] [LOCAL ] DECK: Loaded 53299 existing records from primary storage. [2025-10-07T22:37:04.508106] [INFO ] [MAIN ] DECK: Loaded 53299 primary data records. [2025-10-07T22:37:04.616326] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-07T22:37:04.635454] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-10-07T22:37:04.673227] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:04.725149] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30438 primary records. [2025-10-07T22:37:04.777922] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-07T22:37:05.155212] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-10-07T22:37:05.155387] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-07T22:37:05.157701] [INFO ] [MAIN ] Derivative Progress: 475/1748 symbols completed. DEC took 1.2s. Estimated remaining: 8m 13s. Rate: 155.1 symbols/min [2025-10-07T22:37:05.158992] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:05.183750] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:05.184785] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53299 primary records. [2025-10-07T22:37:05.185228] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-07T22:37:05.210776] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-10-07T22:37:05.211015] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-07T22:37:05.213306] [INFO ] [MAIN ] Derivative Progress: 476/1748 symbols completed. DECK took 1.0s. Estimated remaining: 8m 11s. Rate: 155.4 symbols/min [2025-10-07T22:37:05.213600] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:05.242153] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:05.244317] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53736 primary records. [2025-10-07T22:37:05.243452] [DEBUG] [LOCAL ] DFH: Loaded 32149 existing records from primary storage. [2025-10-07T22:37:05.244525] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-07T22:37:05.244890] [INFO ] [MAIN ] DFH: Loaded 32149 primary data records. [2025-10-07T22:37:05.391161] [DEBUG] [LOCAL ] DFIN: Loaded 22891 existing records from primary storage. [2025-10-07T22:37:05.402897] [INFO ] [MAIN ] DFIN: Loaded 22891 primary data records. [2025-10-07T22:37:05.403892] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-10-07T22:37:05.420449] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-07T22:37:05.443190] [INFO ] [MAIN ] Derivative Progress: 477/1748 symbols completed. DELL took 1.2s. Estimated remaining: 8m 10s. Rate: 155.5 symbols/min [2025-10-07T22:37:05.533843] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:05.825981] [DEBUG] [LOCAL ] DFP: Loaded 11307 existing records from primary storage. [2025-10-07T22:37:05.942876] [INFO ] [MAIN ] DFP: Loaded 11307 primary data records. [2025-10-07T22:37:06.284891] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:06.289818] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32149 primary records. [2025-10-07T22:37:06.289916] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-07T22:37:06.323290] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-10-07T22:37:06.323881] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-07T22:37:06.326060] [INFO ] [MAIN ] Derivative Progress: 478/1748 symbols completed. DFH took 1.2s. Estimated remaining: 8m 11s. Rate: 155.1 symbols/min [2025-10-07T22:37:06.326501] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:06.327541] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 22891 primary records. [2025-10-07T22:37:06.328014] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-07T22:37:06.354850] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-10-07T22:37:06.355057] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-07T22:37:06.358077] [INFO ] [MAIN ] Derivative Progress: 479/1748 symbols completed. DFIN took 1.1s. Estimated remaining: 8m 10s. Rate: 155.4 symbols/min [2025-10-07T22:37:06.377476] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:06.378384] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11307 primary records. [2025-10-07T22:37:06.378449] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-07T22:37:06.394111] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-10-07T22:37:06.394173] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-07T22:37:06.396586] [INFO ] [MAIN ] Derivative Progress: 480/1748 symbols completed. DFP took 0.9s. Estimated remaining: 8m 9s. Rate: 155.7 symbols/min [2025-10-07T22:37:06.397113] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:06.397357] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:06.397286] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:06.484119] [DEBUG] [LOCAL ] DHR: Loaded 53382 existing records from primary storage. [2025-10-07T22:37:06.485690] [INFO ] [MAIN ] DHR: Loaded 53382 primary data records. [2025-10-07T22:37:06.485883] [DEBUG] [LOCAL ] DGX: Loaded 44803 existing records from primary storage. [2025-10-07T22:37:06.499099] [INFO ] [MAIN ] DGX: Loaded 44803 primary data records. [2025-10-07T22:37:06.543446] [DEBUG] [LOCAL ] DHI: Loaded 53341 existing records from primary storage. [2025-10-07T22:37:06.570012] [INFO ] [MAIN ] DHI: Loaded 53341 primary data records. [2025-10-07T22:37:07.579337] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:07.579733] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:07.581301] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53341 primary records. [2025-10-07T22:37:07.580725] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 44803 primary records. [2025-10-07T22:37:07.581472] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-07T22:37:07.582377] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-07T22:37:07.607159] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:07.615916] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53382 primary records. [2025-10-07T22:37:07.616276] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-07T22:37:07.626634] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-10-07T22:37:07.627181] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-07T22:37:07.642157] [INFO ] [MAIN ] Derivative Progress: 481/1748 symbols completed. DGX took 1.2s. Estimated remaining: 8m 11s. Rate: 154.9 symbols/min [2025-10-07T22:37:07.643112] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:07.647048] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-10-07T22:37:07.647158] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-07T22:37:07.649502] [INFO ] [MAIN ] Derivative Progress: 482/1748 symbols completed. DHI took 1.3s. Estimated remaining: 8m 9s. Rate: 155.3 symbols/min [2025-10-07T22:37:07.649671] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:07.650879] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-10-07T22:37:07.651107] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-07T22:37:07.653371] [INFO ] [MAIN ] Derivative Progress: 483/1748 symbols completed. DHR took 1.3s. Estimated remaining: 8m 8s. Rate: 155.6 symbols/min [2025-10-07T22:37:07.653602] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:07.671780] [DEBUG] [LOCAL ] DHX: Loaded 12971 existing records from primary storage. [2025-10-07T22:37:07.672072] [INFO ] [MAIN ] DHX: Loaded 12971 primary data records. [2025-10-07T22:37:07.721354] [DEBUG] [LOCAL ] DIAX: Loaded 13133 existing records from primary storage. [2025-10-07T22:37:07.754226] [INFO ] [MAIN ] DIAX: Loaded 13133 primary data records. [2025-10-07T22:37:08.181344] [DEBUG] [LOCAL ] DHT: Loaded 47896 existing records from primary storage. [2025-10-07T22:37:08.297039] [INFO ] [MAIN ] DHT: Loaded 47896 primary data records. [2025-10-07T22:37:08.621829] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:08.624875] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 12971 primary records. [2025-10-07T22:37:08.625406] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-07T22:37:08.651552] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:08.654414] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 13133 primary records. [2025-10-07T22:37:08.654802] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-07T22:37:08.672028] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-10-07T22:37:08.672290] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-07T22:37:08.674456] [INFO ] [MAIN ] Derivative Progress: 484/1748 symbols completed. DHX took 1.0s. Estimated remaining: 8m 9s. Rate: 155.1 symbols/min [2025-10-07T22:37:08.674932] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:08.677331] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-10-07T22:37:08.677842] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-07T22:37:08.680200] [INFO ] [MAIN ] Derivative Progress: 485/1748 symbols completed. DIAX took 1.0s. Estimated remaining: 8m 8s. Rate: 155.4 symbols/min [2025-10-07T22:37:08.680371] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:08.701219] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:08.702191] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47896 primary records. [2025-10-07T22:37:08.702255] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-07T22:37:08.722151] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-10-07T22:37:08.722459] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-07T22:37:08.724772] [INFO ] [MAIN ] Derivative Progress: 486/1748 symbols completed. DHT took 1.1s. Estimated remaining: 8m 6s. Rate: 155.7 symbols/min [2025-10-07T22:37:08.725172] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:08.781842] [DEBUG] [LOCAL ] DINO: Loaded 52913 existing records from primary storage. [2025-10-07T22:37:08.782077] [INFO ] [MAIN ] DINO: Loaded 52913 primary data records. [2025-10-07T22:37:08.955023] [DEBUG] [LOCAL ] DK: Loaded 49328 existing records from primary storage. [2025-10-07T22:37:08.943031] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-07T22:37:08.977719] [INFO ] [MAIN ] DK: Loaded 49328 primary data records. [2025-10-07T22:37:08.968930] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-07T22:37:09.818758] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:09.819532] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52913 primary records. [2025-10-07T22:37:09.819623] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-07T22:37:09.853671] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-10-07T22:37:09.854151] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:09.855160] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49328 primary records. [2025-10-07T22:37:09.863162] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-07T22:37:09.854381] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-07T22:37:09.870994] [INFO ] [MAIN ] Derivative Progress: 487/1748 symbols completed. DINO took 1.2s. Estimated remaining: 8m 8s. Rate: 155.0 symbols/min [2025-10-07T22:37:09.871265] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:09.885138] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:09.887415] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-10-07T22:37:09.888519] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-07T22:37:09.889177] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-10-07T22:37:09.890035] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-07T22:37:09.892227] [INFO ] [MAIN ] Derivative Progress: 488/1748 symbols completed. DK took 1.2s. Estimated remaining: 8m 7s. Rate: 155.3 symbols/min [2025-10-07T22:37:09.892607] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:09.913395] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-10-07T22:37:09.913528] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-07T22:37:09.915888] [INFO ] [MAIN ] Derivative Progress: 489/1748 symbols completed. DIS took 1.2s. Estimated remaining: 8m 5s. Rate: 155.6 symbols/min [2025-10-07T22:37:09.916125] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:09.924565] [DEBUG] [LOCAL ] DKL: Loaded 18057 existing records from primary storage. [2025-10-07T22:37:09.924710] [INFO ] [MAIN ] DKL: Loaded 18057 primary data records. [2025-10-07T22:37:10.256782] [DEBUG] [LOCAL ] DLB: Loaded 32090 existing records from primary storage. [2025-10-07T22:37:10.270078] [INFO ] [MAIN ] DLB: Loaded 32090 primary data records. [2025-10-07T22:37:10.301587] [DEBUG] [LOCAL ] DKS: Loaded 49700 existing records from primary storage. [2025-10-07T22:37:10.326211] [INFO ] [MAIN ] DKS: Loaded 49700 primary data records. [2025-10-07T22:37:10.891504] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:10.894417] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 18057 primary records. [2025-10-07T22:37:10.894803] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-07T22:37:10.917742] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-07T22:37:10.919479] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-07T22:37:10.922214] [INFO ] [MAIN ] Derivative Progress: 490/1748 symbols completed. DKL took 1.1s. Estimated remaining: 8m 7s. Rate: 155.1 symbols/min [2025-10-07T22:37:10.922561] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:10.936666] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:10.937913] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32090 primary records. [2025-10-07T22:37:10.938180] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-07T22:37:10.967995] [DEBUG] [LOCAL ] DLNG: Loaded 6093 existing records from primary storage. [2025-10-07T22:37:10.974553] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:10.976550] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49700 primary records. [2025-10-07T22:37:10.976694] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-07T22:37:10.975106] [INFO ] [MAIN ] DLNG: Loaded 6093 primary data records. [2025-10-07T22:37:10.975767] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-10-07T22:37:10.988272] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-07T22:37:11.000105] [INFO ] [MAIN ] Derivative Progress: 491/1748 symbols completed. DLB took 1.1s. Estimated remaining: 8m 5s. Rate: 155.4 symbols/min [2025-10-07T22:37:11.041157] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:11.076030] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-10-07T22:37:11.098996] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-07T22:37:11.101258] [INFO ] [MAIN ] Derivative Progress: 492/1748 symbols completed. DKS took 1.2s. Estimated remaining: 8m 4s. Rate: 155.6 symbols/min [2025-10-07T22:37:11.123584] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:11.337883] [DEBUG] [LOCAL ] DLX: Loaded 28517 existing records from primary storage. [2025-10-07T22:37:11.339114] [INFO ] [MAIN ] DLX: Loaded 28517 primary data records. [2025-10-07T22:37:11.413677] [DEBUG] [LOCAL ] DLR: Loaded 50862 existing records from primary storage. [2025-10-07T22:37:11.415840] [INFO ] [MAIN ] DLR: Loaded 50862 primary data records. [2025-10-07T22:37:11.488951] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:37:11.551284] [INFO ] [MAIN ] DLNG: Generated 1793 derivative records from 6093 primary records. [2025-10-07T22:37:11.655750] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-07T22:37:12.037469] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1793 records). [2025-10-07T22:37:12.037938] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-07T22:37:12.040473] [INFO ] [MAIN ] Derivative Progress: 493/1748 symbols completed. DLNG took 1.1s. Estimated remaining: 8m 5s. Rate: 155.2 symbols/min [2025-10-07T22:37:12.083947] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:12.084211] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:12.085299] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50862 primary records. [2025-10-07T22:37:12.085444] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-07T22:37:12.087181] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28517 primary records. [2025-10-07T22:37:12.087338] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-07T22:37:12.113946] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-10-07T22:37:12.116796] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-07T22:37:12.119034] [INFO ] [MAIN ] Derivative Progress: 494/1748 symbols completed. DLR took 1.1s. Estimated remaining: 8m 4s. Rate: 155.4 symbols/min [2025-10-07T22:37:12.123674] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-07T22:37:12.123802] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-07T22:37:12.126195] [INFO ] [MAIN ] Derivative Progress: 495/1748 symbols completed. DLX took 1.0s. Estimated remaining: 8m 3s. Rate: 155.7 symbols/min [2025-10-07T22:37:12.126736] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:12.127094] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:12.126964] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:12.137265] [DEBUG] [LOCAL ] DMA: Loaded 4585 existing records from primary storage. [2025-10-07T22:37:12.137371] [INFO ] [MAIN ] DMA: Loaded 4585 primary data records. [2025-10-07T22:37:12.243010] [DEBUG] [LOCAL ] DMB: Loaded 10289 existing records from primary storage. [2025-10-07T22:37:12.262009] [INFO ] [MAIN ] DMB: Loaded 10289 primary data records. [2025-10-07T22:37:12.438800] [DEBUG] [LOCAL ] DLY: Loaded 20249 existing records from primary storage. [2025-10-07T22:37:12.457107] [INFO ] [MAIN ] DLY: Loaded 20249 primary data records. [2025-10-07T22:37:13.134815] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:13.136594] [INFO ] [MAIN ] DMA: Generated 1794 derivative records from 4585 primary records. [2025-10-07T22:37:13.137819] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-07T22:37:13.162830] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:13.164225] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10289 primary records. [2025-10-07T22:37:13.164564] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-07T22:37:13.198216] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:13.200101] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 20249 primary records. [2025-10-07T22:37:13.200777] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-07T22:37:13.201233] [DEBUG] [LOCAL ] DMA: Derivative data saved (1794 records). [2025-10-07T22:37:13.202543] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-07T22:37:13.201639] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-10-07T22:37:13.204997] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-07T22:37:13.204888] [INFO ] [MAIN ] Derivative Progress: 496/1748 symbols completed. DMA took 1.1s. Estimated remaining: 8m 4s. Rate: 155.1 symbols/min [2025-10-07T22:37:13.216020] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:13.219008] [INFO ] [MAIN ] Derivative Progress: 497/1748 symbols completed. DMB took 1.1s. Estimated remaining: 8m 3s. Rate: 155.4 symbols/min [2025-10-07T22:37:13.219884] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:13.224007] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-10-07T22:37:13.224243] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-07T22:37:13.226534] [INFO ] [MAIN ] Derivative Progress: 498/1748 symbols completed. DLY took 1.1s. Estimated remaining: 8m 2s. Rate: 155.8 symbols/min [2025-10-07T22:37:13.227052] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:13.239379] [DEBUG] [LOCAL ] DMO: Loaded 9932 existing records from primary storage. [2025-10-07T22:37:13.239577] [INFO ] [MAIN ] DMO: Loaded 9932 primary data records. [2025-10-07T22:37:13.626622] [DEBUG] [LOCAL ] DNA: Loaded 48427 existing records from primary storage. [2025-10-07T22:37:13.627270] [DEBUG] [LOCAL ] DNOW: Loaded 43697 existing records from primary storage. [2025-10-07T22:37:13.627435] [INFO ] [MAIN ] DNOW: Loaded 43697 primary data records. [2025-10-07T22:37:13.627528] [INFO ] [MAIN ] DNA: Loaded 48427 primary data records. [2025-10-07T22:37:14.287721] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:14.289576] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9932 primary records. [2025-10-07T22:37:14.289891] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-07T22:37:14.315431] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-10-07T22:37:14.318624] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-07T22:37:14.321537] [INFO ] [MAIN ] Derivative Progress: 499/1748 symbols completed. DMO took 1.1s. Estimated remaining: 8m 3s. Rate: 155.2 symbols/min [2025-10-07T22:37:14.322505] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:14.341196] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:14.355938] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43697 primary records. [2025-10-07T22:37:14.356239] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:14.356332] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-07T22:37:14.357557] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48427 primary records. [2025-10-07T22:37:14.358127] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-07T22:37:14.390956] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-10-07T22:37:14.391927] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-07T22:37:14.394700] [INFO ] [MAIN ] Derivative Progress: 500/1748 symbols completed. DNA took 1.2s. Estimated remaining: 8m 2s. Rate: 155.4 symbols/min [2025-10-07T22:37:14.395388] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:14.406544] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-10-07T22:37:14.406732] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-07T22:37:14.408809] [INFO ] [MAIN ] Derivative Progress: 501/1748 symbols completed. DNOW took 1.2s. Estimated remaining: 8m 0s. Rate: 155.7 symbols/min [2025-10-07T22:37:14.409219] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:14.422126] [DEBUG] [LOCAL ] DNP: Loaded 33279 existing records from primary storage. [2025-10-07T22:37:14.422328] [INFO ] [MAIN ] DNP: Loaded 33279 primary data records. [2025-10-07T22:37:14.775219] [DEBUG] [LOCAL ] DOC: Loaded 53552 existing records from primary storage. [2025-10-07T22:37:14.776524] [INFO ] [MAIN ] DOC: Loaded 53552 primary data records. [2025-10-07T22:37:14.891773] [DEBUG] [LOCAL ] DOCN: Loaded 50780 existing records from primary storage. [2025-10-07T22:37:14.895760] [INFO ] [MAIN ] DOCN: Loaded 50780 primary data records. [2025-10-07T22:37:15.463112] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:15.463904] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33279 primary records. [2025-10-07T22:37:15.463998] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-07T22:37:15.486973] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-10-07T22:37:15.487900] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-07T22:37:15.490842] [INFO ] [MAIN ] Derivative Progress: 502/1748 symbols completed. DNP took 1.2s. Estimated remaining: 8m 2s. Rate: 155.2 symbols/min [2025-10-07T22:37:15.491110] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:15.506918] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:15.507784] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53552 primary records. [2025-10-07T22:37:15.508013] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-07T22:37:15.529461] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-07T22:37:15.529773] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-07T22:37:15.531968] [INFO ] [MAIN ] Derivative Progress: 503/1748 symbols completed. DOC took 1.1s. Estimated remaining: 8m 1s. Rate: 155.5 symbols/min [2025-10-07T22:37:15.532217] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:15.555684] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:15.556685] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50780 primary records. [2025-10-07T22:37:15.556752] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-07T22:37:15.585473] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-10-07T22:37:15.585629] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-07T22:37:15.588950] [INFO ] [MAIN ] Derivative Progress: 504/1748 symbols completed. DOCN took 1.2s. Estimated remaining: 7m 59s. Rate: 155.7 symbols/min [2025-10-07T22:37:15.589124] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:15.586343] [DEBUG] [LOCAL ] DOLE: Loaded 38734 existing records from primary storage. [2025-10-07T22:37:15.589920] [INFO ] [MAIN ] DOLE: Loaded 38734 primary data records. [2025-10-07T22:37:15.925726] [DEBUG] [LOCAL ] DOV: Loaded 45506 existing records from primary storage. [2025-10-07T22:37:15.926703] [INFO ] [MAIN ] DOV: Loaded 45506 primary data records. [2025-10-07T22:37:16.049206] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-07T22:37:16.060211] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-07T22:37:16.575554] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:16.576837] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 38734 primary records. [2025-10-07T22:37:16.577195] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-07T22:37:16.597557] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-10-07T22:37:16.597818] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-07T22:37:16.600104] [INFO ] [MAIN ] Derivative Progress: 505/1748 symbols completed. DOLE took 1.1s. Estimated remaining: 8m 0s. Rate: 155.2 symbols/min [2025-10-07T22:37:16.600488] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:16.620612] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:16.621343] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45506 primary records. [2025-10-07T22:37:16.621513] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-07T22:37:16.645898] [DEBUG] [LOCAL ] DPG: Loaded 13428 existing records from primary storage. [2025-10-07T22:37:16.647307] [INFO ] [MAIN ] DPG: Loaded 13428 primary data records. [2025-10-07T22:37:16.739346] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:16.751416] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-07T22:37:16.746204] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-10-07T22:37:16.757179] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-07T22:37:16.757257] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-07T22:37:16.769729] [INFO ] [MAIN ] Derivative Progress: 506/1748 symbols completed. DOV took 1.2s. Estimated remaining: 7m 60s. Rate: 155.4 symbols/min [2025-10-07T22:37:16.775856] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:16.994503] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-10-07T22:37:16.995374] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-07T22:37:16.997911] [INFO ] [MAIN ] Derivative Progress: 507/1748 symbols completed. DOW took 1.4s. Estimated remaining: 7m 59s. Rate: 155.5 symbols/min [2025-10-07T22:37:16.998130] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:17.047192] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:17.048198] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13428 primary records. [2025-10-07T22:37:17.048323] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-07T22:37:17.057914] [DEBUG] [LOCAL ] DQ: Loaded 43484 existing records from primary storage. [2025-10-07T22:37:17.058983] [INFO ] [MAIN ] DQ: Loaded 43484 primary data records. [2025-10-07T22:37:17.127819] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-07T22:37:17.136898] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-07T22:37:17.150283] [INFO ] [MAIN ] Derivative Progress: 508/1748 symbols completed. DPG took 0.5s. Estimated remaining: 7m 58s. Rate: 155.7 symbols/min [2025-10-07T22:37:17.213679] [DEBUG] [LOCAL ] DRD: Loaded 37150 existing records from primary storage. [2025-10-07T22:37:17.237591] [INFO ] [MAIN ] DRD: Loaded 37150 primary data records. [2025-10-07T22:37:17.779453] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:17.780490] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43484 primary records. [2025-10-07T22:37:17.780587] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-07T22:37:17.799678] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-10-07T22:37:17.799882] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-07T22:37:17.802264] [INFO ] [MAIN ] Derivative Progress: 509/1748 symbols completed. DQ took 1.0s. Estimated remaining: 7m 58s. Rate: 155.5 symbols/min [2025-10-07T22:37:17.819423] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:17.820104] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 37150 primary records. [2025-10-07T22:37:17.820207] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-07T22:37:17.837888] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-07T22:37:17.837952] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-07T22:37:17.840021] [INFO ] [MAIN ] Derivative Progress: 510/1748 symbols completed. DRD took 0.8s. Estimated remaining: 7m 57s. Rate: 155.8 symbols/min [2025-10-07T22:37:17.840675] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:17.840849] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:17.841855] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:17.853168] [DEBUG] [LOCAL ] DRLL: Loaded 9285 existing records from primary storage. [2025-10-07T22:37:17.853487] [INFO ] [MAIN ] DRLL: Loaded 9285 primary data records. [2025-10-07T22:37:18.213074] [DEBUG] [LOCAL ] DRH: Loaded 50480 existing records from primary storage. [2025-10-07T22:37:18.226411] [INFO ] [MAIN ] DRH: Loaded 50480 primary data records. [2025-10-07T22:37:18.263765] [DEBUG] [LOCAL ] DRI: Loaded 47703 existing records from primary storage. [2025-10-07T22:37:18.297666] [INFO ] [MAIN ] DRI: Loaded 47703 primary data records. [2025-10-07T22:37:18.840513] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:37:18.842165] [INFO ] [MAIN ] DRLL: Generated 1793 derivative records from 9285 primary records. [2025-10-07T22:37:18.842664] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-07T22:37:18.861038] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1793 records). [2025-10-07T22:37:18.861160] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-07T22:37:18.863425] [INFO ] [MAIN ] Derivative Progress: 511/1748 symbols completed. DRLL took 1.0s. Estimated remaining: 7m 58s. Rate: 155.3 symbols/min [2025-10-07T22:37:18.863723] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:18.886996] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:18.900165] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:18.901687] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50480 primary records. [2025-10-07T22:37:18.901040] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47703 primary records. [2025-10-07T22:37:18.901874] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-07T22:37:18.901797] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-07T22:37:18.933796] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-10-07T22:37:18.939416] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-07T22:37:18.940712] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-10-07T22:37:18.942722] [INFO ] [MAIN ] Derivative Progress: 512/1748 symbols completed. DRH took 1.1s. Estimated remaining: 7m 57s. Rate: 155.5 symbols/min [2025-10-07T22:37:18.950750] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:18.951724] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-07T22:37:18.954183] [INFO ] [MAIN ] Derivative Progress: 513/1748 symbols completed. DRI took 1.1s. Estimated remaining: 7m 56s. Rate: 155.8 symbols/min [2025-10-07T22:37:18.954510] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:18.955424] [DEBUG] [LOCAL ] DSL: Loaded 28564 existing records from primary storage. [2025-10-07T22:37:18.955632] [INFO ] [MAIN ] DSL: Loaded 28564 primary data records. [2025-10-07T22:37:19.066974] [DEBUG] [LOCAL ] DSM: Loaded 14610 existing records from primary storage. [2025-10-07T22:37:19.066714] [DEBUG] [LOCAL ] DSMC: Loaded 1845 existing records from primary storage. [2025-10-07T22:37:19.067182] [INFO ] [MAIN ] DSM: Loaded 14610 primary data records. [2025-10-07T22:37:19.067274] [INFO ] [MAIN ] DSMC: Loaded 1845 primary data records. [2025-10-07T22:37:19.914777] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:19.915812] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28564 primary records. [2025-10-07T22:37:19.916260] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-07T22:37:19.937636] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-10-07T22:37:19.937807] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-07T22:37:19.939938] [INFO ] [MAIN ] Derivative Progress: 514/1748 symbols completed. DSL took 1.1s. Estimated remaining: 7m 57s. Rate: 155.3 symbols/min [2025-10-07T22:37:19.940208] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:19.967543] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:19.968856] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 14610 primary records. [2025-10-07T22:37:19.968988] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-07T22:37:19.967946] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-07T22:37:19.977166] [INFO ] [MAIN ] DSMC: Generated 1791 derivative records from 1845 primary records. [2025-10-07T22:37:19.982737] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-07T22:37:20.005318] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1791 records). [2025-10-07T22:37:20.004575] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-10-07T22:37:20.005518] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-07T22:37:20.007792] [INFO ] [MAIN ] Derivative Progress: 515/1748 symbols completed. DSM took 1.1s. Estimated remaining: 7m 56s. Rate: 155.6 symbols/min [2025-10-07T22:37:20.007978] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-07T22:37:20.010286] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:20.010880] [INFO ] [MAIN ] Derivative Progress: 516/1748 symbols completed. DSMC took 1.1s. Estimated remaining: 7m 54s. Rate: 155.9 symbols/min [2025-10-07T22:37:20.011091] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:20.020399] [DEBUG] [LOCAL ] DSU: Loaded 22802 existing records from primary storage. [2025-10-07T22:37:20.021723] [INFO ] [MAIN ] DSU: Loaded 22802 primary data records. [2025-10-07T22:37:20.066040] [DEBUG] [LOCAL ] DTB: Loaded 4948 existing records from primary storage. [2025-10-07T22:37:20.097416] [INFO ] [MAIN ] DTB: Loaded 4948 primary data records. [2025-10-07T22:37:20.521027] [DEBUG] [LOCAL ] DTM: Loaded 44092 existing records from primary storage. [2025-10-07T22:37:20.639334] [INFO ] [MAIN ] DTM: Loaded 44092 primary data records. [2025-10-07T22:37:20.963580] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:20.965319] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22802 primary records. [2025-10-07T22:37:20.965581] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-07T22:37:20.985065] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-10-07T22:37:20.985208] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-07T22:37:20.987525] [INFO ] [MAIN ] Derivative Progress: 517/1748 symbols completed. DSU took 1.0s. Estimated remaining: 7m 55s. Rate: 155.4 symbols/min [2025-10-07T22:37:20.988689] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:21.004749] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-07T22:37:21.005681] [INFO ] [MAIN ] DTB: Generated 1790 derivative records from 4948 primary records. [2025-10-07T22:37:21.005864] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-07T22:37:21.022945] [DEBUG] [LOCAL ] DTW: Loaded 4907 existing records from primary storage. [2025-10-07T22:37:21.024167] [INFO ] [MAIN ] DTW: Loaded 4907 primary data records. [2025-10-07T22:37:21.088098] [DEBUG] [LOCAL ] DTB: Derivative data saved (1790 records). [2025-10-07T22:37:21.108495] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-07T22:37:21.147798] [INFO ] [MAIN ] Derivative Progress: 518/1748 symbols completed. DTB took 1.1s. Estimated remaining: 7m 54s. Rate: 155.6 symbols/min [2025-10-07T22:37:21.151877] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:21.152021] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:21.152918] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 44092 primary records. [2025-10-07T22:37:21.153125] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-07T22:37:21.391587] [DEBUG] [LOCAL ] DUKB: Loaded 6365 existing records from primary storage. [2025-10-07T22:37:21.423718] [INFO ] [MAIN ] DUKB: Loaded 6365 primary data records. [2025-10-07T22:37:21.432461] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-10-07T22:37:21.457750] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-07T22:37:21.465980] [INFO ] [MAIN ] Derivative Progress: 519/1748 symbols completed. DTM took 1.5s. Estimated remaining: 7m 54s. Rate: 155.6 symbols/min [2025-10-07T22:37:21.466300] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:21.792430] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:37:21.793677] [INFO ] [MAIN ] DTW: Generated 1793 derivative records from 4907 primary records. [2025-10-07T22:37:21.807063] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-07T22:37:21.810402] [DEBUG] [LOCAL ] DV: Loaded 51295 existing records from primary storage. [2025-10-07T22:37:21.817282] [INFO ] [MAIN ] DV: Loaded 51295 primary data records. [2025-10-07T22:37:21.942076] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:21.948126] [DEBUG] [LOCAL ] DTW: Derivative data saved (1793 records). [2025-10-07T22:37:21.959219] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6365 primary records. [2025-10-07T22:37:21.958450] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-07T22:37:21.972020] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-07T22:37:21.966796] [INFO ] [MAIN ] Derivative Progress: 520/1748 symbols completed. DTW took 1.0s. Estimated remaining: 7m 54s. Rate: 155.5 symbols/min [2025-10-07T22:37:22.025624] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:22.158871] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-10-07T22:37:22.159673] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-07T22:37:22.162699] [INFO ] [MAIN ] Derivative Progress: 521/1748 symbols completed. DUKB took 1.0s. Estimated remaining: 7m 53s. Rate: 155.7 symbols/min [2025-10-07T22:37:22.162961] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:22.189810] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:22.190426] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51295 primary records. [2025-10-07T22:37:22.190486] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-07T22:37:22.217309] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-07T22:37:22.217624] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-07T22:37:22.220120] [INFO ] [MAIN ] Derivative Progress: 522/1748 symbols completed. DV took 0.8s. Estimated remaining: 7m 52s. Rate: 156.0 symbols/min [2025-10-07T22:37:22.220322] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:22.255717] [DEBUG] [LOCAL ] DVA: Loaded 41009 existing records from primary storage. [2025-10-07T22:37:22.255987] [INFO ] [MAIN ] DVA: Loaded 41009 primary data records. [2025-10-07T22:37:22.407300] [DEBUG] [LOCAL ] DX: Loaded 52486 existing records from primary storage. [2025-10-07T22:37:22.408171] [INFO ] [MAIN ] DX: Loaded 52486 primary data records. [2025-10-07T22:37:22.528715] [DEBUG] [LOCAL ] DXYZ: Loaded 37024 existing records from primary storage. [2025-10-07T22:37:22.599447] [INFO ] [MAIN ] DXYZ: Loaded 37024 primary data records. [2025-10-07T22:37:23.297809] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:23.301593] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41009 primary records. [2025-10-07T22:37:23.303679] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-07T22:37:23.332408] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:23.334365] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52486 primary records. [2025-10-07T22:37:23.335507] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-07T22:37:23.359217] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-10-07T22:37:23.360093] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-10-07T22:37:23.360492] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-07T22:37:23.373779] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-07T22:37:23.376235] [INFO ] [MAIN ] Derivative Progress: 523/1748 symbols completed. DX took 1.2s. Estimated remaining: 7m 53s. Rate: 155.4 symbols/min [2025-10-07T22:37:23.380805] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:23.382022] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 37024 primary records. [2025-10-07T22:37:23.382139] [INFO ] [MAIN ] Derivative Progress: 524/1748 symbols completed. DVA took 1.4s. Estimated remaining: 7m 52s. Rate: 155.6 symbols/min [2025-10-07T22:37:23.382295] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-07T22:37:23.399484] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-10-07T22:37:23.399561] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-07T22:37:23.402482] [INFO ] [MAIN ] Derivative Progress: 525/1748 symbols completed. DXYZ took 1.2s. Estimated remaining: 7m 51s. Rate: 155.9 symbols/min [2025-10-07T22:37:23.403139] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:23.403253] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:23.403018] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:23.448331] [DEBUG] [LOCAL ] DY: Loaded 28615 existing records from primary storage. [2025-10-07T22:37:23.457787] [INFO ] [MAIN ] DY: Loaded 28615 primary data records. [2025-10-07T22:37:23.577228] [DEBUG] [LOCAL ] E: Loaded 33210 existing records from primary storage. [2025-10-07T22:37:23.612287] [INFO ] [MAIN ] E: Loaded 33210 primary data records. [2025-10-07T22:37:23.655276] [DEBUG] [LOCAL ] EAF: Loaded 42243 existing records from primary storage. [2025-10-07T22:37:23.685597] [INFO ] [MAIN ] EAF: Loaded 42243 primary data records. [2025-10-07T22:37:24.588895] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:24.590235] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 28615 primary records. [2025-10-07T22:37:24.590586] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-07T22:37:24.609386] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-10-07T22:37:24.610259] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-07T22:37:24.612587] [INFO ] [MAIN ] Derivative Progress: 526/1748 symbols completed. DY took 1.2s. Estimated remaining: 7m 52s. Rate: 155.3 symbols/min [2025-10-07T22:37:24.613849] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:24.630069] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:24.632281] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33210 primary records. [2025-10-07T22:37:24.645503] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-07T22:37:24.645942] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:24.650079] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 42243 primary records. [2025-10-07T22:37:24.649285] [DEBUG] [LOCAL ] EAI: Loaded 3998 existing records from primary storage. [2025-10-07T22:37:24.651041] [INFO ] [MAIN ] EAI: Loaded 3998 primary data records. [2025-10-07T22:37:24.651128] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-07T22:37:24.757368] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-10-07T22:37:24.763534] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-10-07T22:37:24.780899] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-07T22:37:24.786363] [INFO ] [MAIN ] Derivative Progress: 527/1748 symbols completed. EAF took 1.4s. Estimated remaining: 7m 51s. Rate: 155.5 symbols/min [2025-10-07T22:37:24.786564] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-07T22:37:24.789012] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:24.789186] [INFO ] [MAIN ] Derivative Progress: 528/1748 symbols completed. E took 1.4s. Estimated remaining: 7m 50s. Rate: 155.8 symbols/min [2025-10-07T22:37:24.795687] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:25.008624] [DEBUG] [LOCAL ] EARN: Loaded 29238 existing records from primary storage. [2025-10-07T22:37:25.009011] [INFO ] [MAIN ] EARN: Loaded 29238 primary data records. [2025-10-07T22:37:25.160705] [DEBUG] [LOCAL ] EAT: Loaded 49804 existing records from primary storage. [2025-10-07T22:37:25.205616] [INFO ] [MAIN ] EAT: Loaded 49804 primary data records. [2025-10-07T22:37:25.466889] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:25.469130] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 3998 primary records. [2025-10-07T22:37:25.470407] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-07T22:37:25.558998] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-10-07T22:37:25.559167] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-07T22:37:25.732938] [INFO ] [MAIN ] Derivative Progress: 529/1748 symbols completed. EAI took 1.1s. Estimated remaining: 7m 51s. Rate: 155.3 symbols/min [2025-10-07T22:37:25.734867] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:25.764014] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:25.764811] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 29238 primary records. [2025-10-07T22:37:25.764996] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-07T22:37:25.783969] [DEBUG] [LOCAL ] EBF: Loaded 19079 existing records from primary storage. [2025-10-07T22:37:25.786302] [INFO ] [MAIN ] EBF: Loaded 19079 primary data records. [2025-10-07T22:37:25.867532] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-10-07T22:37:25.879109] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-07T22:37:25.896631] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:25.898864] [INFO ] [MAIN ] Derivative Progress: 530/1748 symbols completed. EARN took 1.1s. Estimated remaining: 7m 50s. Rate: 155.5 symbols/min [2025-10-07T22:37:25.899740] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49804 primary records. [2025-10-07T22:37:25.911057] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:25.911304] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-07T22:37:26.134432] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-10-07T22:37:26.145941] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-07T22:37:26.148717] [INFO ] [MAIN ] Derivative Progress: 531/1748 symbols completed. EAT took 1.4s. Estimated remaining: 7m 49s. Rate: 155.6 symbols/min [2025-10-07T22:37:26.149237] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:26.166885] [DEBUG] [LOCAL ] EBR: Loaded 43045 existing records from primary storage. [2025-10-07T22:37:26.167187] [INFO ] [MAIN ] EBR: Loaded 43045 primary data records. [2025-10-07T22:37:26.319694] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:26.330805] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19079 primary records. [2025-10-07T22:37:26.361889] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-07T22:37:26.534897] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-10-07T22:37:26.535050] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-07T22:37:26.534164] [DEBUG] [LOCAL ] EBS: Loaded 46746 existing records from primary storage. [2025-10-07T22:37:26.537411] [INFO ] [MAIN ] Derivative Progress: 532/1748 symbols completed. EBF took 0.8s. Estimated remaining: 7m 49s. Rate: 155.6 symbols/min [2025-10-07T22:37:26.538038] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:26.538400] [INFO ] [MAIN ] EBS: Loaded 46746 primary data records. [2025-10-07T22:37:26.870021] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:26.871071] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43045 primary records. [2025-10-07T22:37:26.883405] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-07T22:37:26.895794] [DEBUG] [LOCAL ] EC: Loaded 49091 existing records from primary storage. [2025-10-07T22:37:26.898690] [INFO ] [MAIN ] EC: Loaded 49091 primary data records. [2025-10-07T22:37:26.976578] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-07T22:37:26.987893] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-07T22:37:26.995202] [INFO ] [MAIN ] Derivative Progress: 533/1748 symbols completed. EBR took 1.1s. Estimated remaining: 7m 49s. Rate: 155.5 symbols/min [2025-10-07T22:37:27.010819] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:27.237362] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:27.239273] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46746 primary records. [2025-10-07T22:37:27.239391] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-07T22:37:27.279881] [DEBUG] [LOCAL ] ECAT: Loaded 29448 existing records from primary storage. [2025-10-07T22:37:27.281598] [INFO ] [MAIN ] ECAT: Loaded 29448 primary data records. [2025-10-07T22:37:27.281473] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-10-07T22:37:27.281844] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-07T22:37:27.284504] [INFO ] [MAIN ] Derivative Progress: 534/1748 symbols completed. EBS took 1.1s. Estimated remaining: 7m 48s. Rate: 155.6 symbols/min [2025-10-07T22:37:27.296669] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:27.657134] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:27.657964] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49091 primary records. [2025-10-07T22:37:27.658152] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-07T22:37:27.687072] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-10-07T22:37:27.688884] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-07T22:37:27.692048] [INFO ] [MAIN ] Derivative Progress: 535/1748 symbols completed. EC took 1.2s. Estimated remaining: 7m 48s. Rate: 155.6 symbols/min [2025-10-07T22:37:27.692223] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:27.693825] [DEBUG] [LOCAL ] ECC: Loaded 43086 existing records from primary storage. [2025-10-07T22:37:27.694762] [INFO ] [MAIN ] ECC: Loaded 43086 primary data records. [2025-10-07T22:37:28.008238] [DEBUG] [LOCAL ] ECG: Loaded 33518 existing records from primary storage. [2025-10-07T22:37:28.018897] [INFO ] [MAIN ] ECG: Loaded 33518 primary data records. [2025-10-07T22:37:28.116246] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:28.135415] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29448 primary records. [2025-10-07T22:37:28.135953] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-07T22:37:28.349812] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-10-07T22:37:28.350810] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-07T22:37:28.353329] [INFO ] [MAIN ] Derivative Progress: 536/1748 symbols completed. ECAT took 1.3s. Estimated remaining: 7m 48s. Rate: 155.4 symbols/min [2025-10-07T22:37:28.353736] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:28.377978] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:28.379038] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43086 primary records. [2025-10-07T22:37:28.379208] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-07T22:37:28.411359] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-10-07T22:37:28.411534] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-07T22:37:28.414025] [INFO ] [MAIN ] Derivative Progress: 537/1748 symbols completed. ECC took 1.1s. Estimated remaining: 7m 47s. Rate: 155.6 symbols/min [2025-10-07T22:37:28.414328] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:28.428494] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:28.429401] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33518 primary records. [2025-10-07T22:37:28.429590] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-07T22:37:28.459366] [DEBUG] [LOCAL ] ECL: Loaded 46705 existing records from primary storage. [2025-10-07T22:37:28.460194] [INFO ] [MAIN ] ECL: Loaded 46705 primary data records. [2025-10-07T22:37:28.572784] [DEBUG] [LOCAL ] ECO: Loaded 18390 existing records from primary storage. [2025-10-07T22:37:28.577052] [INFO ] [MAIN ] ECO: Loaded 18390 primary data records. [2025-10-07T22:37:28.576630] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-07T22:37:28.613612] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-07T22:37:28.625920] [INFO ] [MAIN ] Derivative Progress: 538/1748 symbols completed. ECG took 0.9s. Estimated remaining: 7m 46s. Rate: 155.8 symbols/min [2025-10-07T22:37:29.099419] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:29.100284] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46705 primary records. [2025-10-07T22:37:29.100476] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-07T22:37:29.123458] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-10-07T22:37:29.137243] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-07T22:37:29.139541] [INFO ] [MAIN ] Derivative Progress: 539/1748 symbols completed. ECL took 0.8s. Estimated remaining: 7m 46s. Rate: 155.7 symbols/min [2025-10-07T22:37:29.140372] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:29.141260] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18390 primary records. [2025-10-07T22:37:29.141342] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-07T22:37:29.158097] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-10-07T22:37:29.158164] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-07T22:37:29.160636] [INFO ] [MAIN ] Derivative Progress: 540/1748 symbols completed. ECO took 0.7s. Estimated remaining: 7m 45s. Rate: 155.9 symbols/min [2025-10-07T22:37:29.161221] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:29.161688] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:29.161339] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:29.202556] [DEBUG] [LOCAL ] EDD: Loaded 27101 existing records from primary storage. [2025-10-07T22:37:29.202818] [INFO ] [MAIN ] EDD: Loaded 27101 primary data records. [2025-10-07T22:37:29.335908] [DEBUG] [LOCAL ] ECVT: Loaded 43236 existing records from primary storage. [2025-10-07T22:37:29.352052] [INFO ] [MAIN ] ECVT: Loaded 43236 primary data records. [2025-10-07T22:37:29.636243] [DEBUG] [LOCAL ] ED: Loaded 52726 existing records from primary storage. [2025-10-07T22:37:29.655543] [INFO ] [MAIN ] ED: Loaded 52726 primary data records. [2025-10-07T22:37:30.220961] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:30.222045] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27101 primary records. [2025-10-07T22:37:30.222215] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-07T22:37:30.240324] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-07T22:37:30.240584] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-07T22:37:30.242885] [INFO ] [MAIN ] Derivative Progress: 541/1748 symbols completed. EDD took 1.1s. Estimated remaining: 7m 46s. Rate: 155.4 symbols/min [2025-10-07T22:37:30.243078] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:30.260731] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:30.261761] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43236 primary records. [2025-10-07T22:37:30.261946] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-07T22:37:30.286967] [DEBUG] [LOCAL ] EDF: Loaded 13197 existing records from primary storage. [2025-10-07T22:37:30.288318] [INFO ] [MAIN ] EDF: Loaded 13197 primary data records. [2025-10-07T22:37:30.289288] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-10-07T22:37:30.313298] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-07T22:37:30.313601] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:30.325137] [INFO ] [MAIN ] Derivative Progress: 542/1748 symbols completed. ECVT took 1.2s. Estimated remaining: 7m 45s. Rate: 155.6 symbols/min [2025-10-07T22:37:30.325933] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52726 primary records. [2025-10-07T22:37:30.326039] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-07T22:37:30.336210] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:30.424093] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-10-07T22:37:30.433715] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-07T22:37:30.451571] [INFO ] [MAIN ] Derivative Progress: 543/1748 symbols completed. ED took 1.3s. Estimated remaining: 7m 44s. Rate: 155.8 symbols/min [2025-10-07T22:37:30.488518] [DEBUG] [LOCAL ] EDN: Loaded 18236 existing records from primary storage. [2025-10-07T22:37:30.517893] [INFO ] [MAIN ] EDN: Loaded 18236 primary data records. [2025-10-07T22:37:30.487975] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:30.970852] [DEBUG] [LOCAL ] EDU: Loaded 44805 existing records from primary storage. [2025-10-07T22:37:30.972959] [INFO ] [MAIN ] EDU: Loaded 44805 primary data records. [2025-10-07T22:37:31.073914] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:31.093594] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13197 primary records. [2025-10-07T22:37:31.104914] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-07T22:37:31.325012] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:31.329061] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18236 primary records. [2025-10-07T22:37:31.329325] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-10-07T22:37:31.329670] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-07T22:37:31.329805] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-07T22:37:31.332036] [INFO ] [MAIN ] Derivative Progress: 544/1748 symbols completed. EDF took 1.1s. Estimated remaining: 7m 45s. Rate: 155.5 symbols/min [2025-10-07T22:37:31.333454] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:31.350068] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-10-07T22:37:31.350635] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-07T22:37:31.353408] [INFO ] [MAIN ] Derivative Progress: 545/1748 symbols completed. EDN took 1.0s. Estimated remaining: 7m 43s. Rate: 155.7 symbols/min [2025-10-07T22:37:31.353856] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:31.378218] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:31.390488] [DEBUG] [LOCAL ] EEX: Loaded 10938 existing records from primary storage. [2025-10-07T22:37:31.391410] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44805 primary records. [2025-10-07T22:37:31.391540] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-07T22:37:31.391608] [INFO ] [MAIN ] EEX: Loaded 10938 primary data records. [2025-10-07T22:37:31.496005] [DEBUG] [LOCAL ] EE: Loaded 32733 existing records from primary storage. [2025-10-07T22:37:31.510006] [INFO ] [MAIN ] EE: Loaded 32733 primary data records. [2025-10-07T22:37:31.544163] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-10-07T22:37:31.554503] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-07T22:37:31.580246] [INFO ] [MAIN ] Derivative Progress: 546/1748 symbols completed. EDU took 1.1s. Estimated remaining: 7m 43s. Rate: 155.9 symbols/min [2025-10-07T22:37:31.590760] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:32.124707] [DEBUG] [LOCAL ] EFC: Loaded 46373 existing records from primary storage. [2025-10-07T22:37:32.125482] [INFO ] [MAIN ] EFC: Loaded 46373 primary data records. [2025-10-07T22:37:32.153541] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:32.191605] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 10938 primary records. [2025-10-07T22:37:32.242530] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-07T22:37:32.294607] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:32.326424] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32733 primary records. [2025-10-07T22:37:32.328843] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-07T22:37:32.512390] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-07T22:37:32.512313] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-10-07T22:37:32.512747] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-07T22:37:32.512837] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-07T22:37:32.515793] [INFO ] [MAIN ] Derivative Progress: 547/1748 symbols completed. EEX took 1.2s. Estimated remaining: 7m 44s. Rate: 155.5 symbols/min [2025-10-07T22:37:32.518922] [INFO ] [MAIN ] Derivative Progress: 548/1748 symbols completed. EE took 1.2s. Estimated remaining: 7m 42s. Rate: 155.7 symbols/min [2025-10-07T22:37:32.519114] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:32.518845] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:32.543803] [DEBUG] [LOCAL ] EFT: Loaded 13169 existing records from primary storage. [2025-10-07T22:37:32.544285] [INFO ] [MAIN ] EFT: Loaded 13169 primary data records. [2025-10-07T22:37:32.607125] [DEBUG] [LOCAL ] EFR: Loaded 14868 existing records from primary storage. [2025-10-07T22:37:32.627330] [INFO ] [MAIN ] EFR: Loaded 14868 primary data records. [2025-10-07T22:37:32.677432] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:32.721296] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46373 primary records. [2025-10-07T22:37:32.732033] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-07T22:37:33.106367] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-10-07T22:37:33.107102] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-07T22:37:33.161605] [INFO ] [MAIN ] Derivative Progress: 549/1748 symbols completed. EFC took 1.6s. Estimated remaining: 7m 43s. Rate: 155.5 symbols/min [2025-10-07T22:37:33.226095] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:33.255810] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:33.256815] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 13169 primary records. [2025-10-07T22:37:33.256909] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-07T22:37:33.285995] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-10-07T22:37:33.286241] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-07T22:37:33.288601] [INFO ] [MAIN ] Derivative Progress: 550/1748 symbols completed. EFT took 0.8s. Estimated remaining: 7m 42s. Rate: 155.7 symbols/min [2025-10-07T22:37:33.302848] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:33.302727] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:33.304024] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 14868 primary records. [2025-10-07T22:37:33.304175] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-07T22:37:33.334057] [DEBUG] [LOCAL ] EFX: Loaded 44568 existing records from primary storage. [2025-10-07T22:37:33.334480] [INFO ] [MAIN ] EFX: Loaded 44568 primary data records. [2025-10-07T22:37:33.438130] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-10-07T22:37:33.449887] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-07T22:37:33.452272] [INFO ] [MAIN ] Derivative Progress: 551/1748 symbols completed. EFR took 0.9s. Estimated remaining: 7m 41s. Rate: 155.9 symbols/min [2025-10-07T22:37:33.464691] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:33.464496] [DEBUG] [LOCAL ] EFXT: Loaded 29278 existing records from primary storage. [2025-10-07T22:37:33.464901] [INFO ] [MAIN ] EFXT: Loaded 29278 primary data records. [2025-10-07T22:37:34.059967] [DEBUG] [LOCAL ] EG: Loaded 27855 existing records from primary storage. [2025-10-07T22:37:34.061346] [INFO ] [MAIN ] EG: Loaded 27855 primary data records. [2025-10-07T22:37:34.263160] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:34.395484] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44568 primary records. [2025-10-07T22:37:34.396984] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-07T22:37:34.433755] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:34.437131] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29278 primary records. [2025-10-07T22:37:34.437567] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-10-07T22:37:34.438128] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-07T22:37:34.438244] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-07T22:37:34.442364] [INFO ] [MAIN ] Derivative Progress: 552/1748 symbols completed. EFX took 1.2s. Estimated remaining: 7m 42s. Rate: 155.5 symbols/min [2025-10-07T22:37:34.442867] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:34.458953] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-10-07T22:37:34.460508] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-07T22:37:34.462714] [INFO ] [MAIN ] Derivative Progress: 553/1748 symbols completed. EFXT took 1.2s. Estimated remaining: 7m 40s. Rate: 155.7 symbols/min [2025-10-07T22:37:34.483299] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:34.484166] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 27855 primary records. [2025-10-07T22:37:34.484277] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-07T22:37:34.514493] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-10-07T22:37:34.514640] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-07T22:37:34.516909] [INFO ] [MAIN ] Derivative Progress: 554/1748 symbols completed. EG took 1.1s. Estimated remaining: 7m 39s. Rate: 156.0 symbols/min [2025-10-07T22:37:34.537526] [DEBUG] [LOCAL ] EGO: Loaded 51673 existing records from primary storage. [2025-10-07T22:37:34.537700] [INFO ] [MAIN ] EGO: Loaded 51673 primary data records. [2025-10-07T22:37:34.850595] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:34.851286] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51673 primary records. [2025-10-07T22:37:34.851352] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-07T22:37:34.867062] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-10-07T22:37:34.867126] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-07T22:37:34.869276] [INFO ] [MAIN ] Derivative Progress: 555/1748 symbols completed. EGO took 0.4s. Estimated remaining: 7m 39s. Rate: 156.0 symbols/min [2025-10-07T22:37:34.869763] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:34.869836] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:34.870034] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:34.923401] [DEBUG] [LOCAL ] EGP: Loaded 30699 existing records from primary storage. [2025-10-07T22:37:34.923627] [INFO ] [MAIN ] EGP: Loaded 30699 primary data records. [2025-10-07T22:37:35.005906] [DEBUG] [LOCAL ] EGY: Loaded 41850 existing records from primary storage. [2025-10-07T22:37:35.027196] [INFO ] [MAIN ] EGY: Loaded 41850 primary data records. [2025-10-07T22:37:35.090173] [DEBUG] [LOCAL ] EHC: Loaded 41268 existing records from primary storage. [2025-10-07T22:37:35.137102] [INFO ] [MAIN ] EHC: Loaded 41268 primary data records. [2025-10-07T22:37:35.936416] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:35.937413] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30699 primary records. [2025-10-07T22:37:35.937588] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-07T22:37:35.957587] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-07T22:37:35.966021] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-07T22:37:35.968056] [INFO ] [MAIN ] Derivative Progress: 556/1748 symbols completed. EGP took 1.1s. Estimated remaining: 7m 40s. Rate: 155.5 symbols/min [2025-10-07T22:37:35.973510] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:35.974563] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:35.978142] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 41850 primary records. [2025-10-07T22:37:35.978376] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-07T22:37:36.005239] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:36.007171] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41268 primary records. [2025-10-07T22:37:36.008042] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-07T22:37:36.017343] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-10-07T22:37:36.017538] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-07T22:37:36.030463] [INFO ] [MAIN ] Derivative Progress: 557/1748 symbols completed. EGY took 1.2s. Estimated remaining: 7m 39s. Rate: 155.7 symbols/min [2025-10-07T22:37:36.031207] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:36.035262] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-10-07T22:37:36.035413] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-07T22:37:36.038415] [INFO ] [MAIN ] Derivative Progress: 558/1748 symbols completed. EHC took 1.2s. Estimated remaining: 7m 38s. Rate: 156.0 symbols/min [2025-10-07T22:37:36.039535] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:36.048376] [DEBUG] [LOCAL ] EIC: Loaded 23128 existing records from primary storage. [2025-10-07T22:37:36.048771] [INFO ] [MAIN ] EIC: Loaded 23128 primary data records. [2025-10-07T22:37:36.215477] [DEBUG] [LOCAL ] EIG: Loaded 20324 existing records from primary storage. [2025-10-07T22:37:36.224576] [INFO ] [MAIN ] EIG: Loaded 20324 primary data records. [2025-10-07T22:37:36.528359] [DEBUG] [LOCAL ] EIX: Loaded 53343 existing records from primary storage. [2025-10-07T22:37:36.582470] [INFO ] [MAIN ] EIX: Loaded 53343 primary data records. [2025-10-07T22:37:37.038081] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:37.039204] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 23128 primary records. [2025-10-07T22:37:37.039313] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-07T22:37:37.058465] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-10-07T22:37:37.059431] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-07T22:37:37.061829] [INFO ] [MAIN ] Derivative Progress: 559/1748 symbols completed. EIC took 1.1s. Estimated remaining: 7m 39s. Rate: 155.5 symbols/min [2025-10-07T22:37:37.062195] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:37.076355] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:37.077264] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20324 primary records. [2025-10-07T22:37:37.077490] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-07T22:37:37.095127] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-07T22:37:37.096899] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-07T22:37:37.099658] [INFO ] [MAIN ] Derivative Progress: 560/1748 symbols completed. EIG took 1.1s. Estimated remaining: 7m 38s. Rate: 155.8 symbols/min [2025-10-07T22:37:37.099989] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:37.114814] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:37.115697] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53343 primary records. [2025-10-07T22:37:37.115828] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-07T22:37:37.138771] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-10-07T22:37:37.139009] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-07T22:37:37.141013] [INFO ] [MAIN ] Derivative Progress: 561/1748 symbols completed. EIX took 1.1s. Estimated remaining: 7m 37s. Rate: 156.0 symbols/min [2025-10-07T22:37:37.141256] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:37.196285] [DEBUG] [LOCAL ] EL: Loaded 53369 existing records from primary storage. [2025-10-07T22:37:37.196727] [INFO ] [MAIN ] EL: Loaded 53369 primary data records. [2025-10-07T22:37:37.339494] [DEBUG] [LOCAL ] ELAN: Loaded 53273 existing records from primary storage. [2025-10-07T22:37:37.339724] [INFO ] [MAIN ] ELAN: Loaded 53273 primary data records. [2025-10-07T22:37:37.691150] [DEBUG] [LOCAL ] ELF: Loaded 52072 existing records from primary storage. [2025-10-07T22:37:37.696579] [INFO ] [MAIN ] ELF: Loaded 52072 primary data records. [2025-10-07T22:37:38.471212] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:38.473319] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53369 primary records. [2025-10-07T22:37:38.473816] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-07T22:37:38.499484] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-10-07T22:37:38.514037] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:38.515011] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53273 primary records. [2025-10-07T22:37:38.513635] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-07T22:37:38.515121] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-07T22:37:38.518720] [INFO ] [MAIN ] Derivative Progress: 562/1748 symbols completed. EL took 1.5s. Estimated remaining: 7m 38s. Rate: 155.3 symbols/min [2025-10-07T22:37:38.520605] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:38.546700] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-10-07T22:37:38.548559] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-07T22:37:38.551517] [INFO ] [MAIN ] Derivative Progress: 563/1748 symbols completed. ELAN took 1.5s. Estimated remaining: 7m 37s. Rate: 155.6 symbols/min [2025-10-07T22:37:38.551824] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:38.567415] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:38.568265] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52072 primary records. [2025-10-07T22:37:38.568414] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-07T22:37:38.604762] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-10-07T22:37:38.605261] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-07T22:37:38.607493] [INFO ] [MAIN ] Derivative Progress: 564/1748 symbols completed. ELF took 1.5s. Estimated remaining: 7m 36s. Rate: 155.8 symbols/min [2025-10-07T22:37:38.607751] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:38.637353] [DEBUG] [LOCAL ] ELME: Loaded 39289 existing records from primary storage. [2025-10-07T22:37:38.638125] [DEBUG] [LOCAL ] ELP: Loaded 25608 existing records from primary storage. [2025-10-07T22:37:38.638229] [INFO ] [MAIN ] ELP: Loaded 25608 primary data records. [2025-10-07T22:37:38.650435] [INFO ] [MAIN ] ELME: Loaded 39289 primary data records. [2025-10-07T22:37:39.211683] [DEBUG] [LOCAL ] ELS: Loaded 49737 existing records from primary storage. [2025-10-07T22:37:39.300702] [INFO ] [MAIN ] ELS: Loaded 49737 primary data records. [2025-10-07T22:37:39.675593] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:39.676676] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25608 primary records. [2025-10-07T22:37:39.676854] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-07T22:37:39.692011] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:39.692873] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39289 primary records. [2025-10-07T22:37:39.704149] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-07T22:37:39.721232] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-10-07T22:37:39.721563] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-07T22:37:39.724454] [INFO ] [MAIN ] Derivative Progress: 565/1748 symbols completed. ELP took 1.2s. Estimated remaining: 7m 37s. Rate: 155.3 symbols/min [2025-10-07T22:37:39.724753] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:39.731913] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-10-07T22:37:39.732154] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-07T22:37:39.734374] [INFO ] [MAIN ] Derivative Progress: 566/1748 symbols completed. ELME took 1.2s. Estimated remaining: 7m 36s. Rate: 155.5 symbols/min [2025-10-07T22:37:39.734615] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:39.749313] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:39.750094] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49737 primary records. [2025-10-07T22:37:39.750209] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-07T22:37:39.773109] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-10-07T22:37:39.773345] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-07T22:37:39.775754] [INFO ] [MAIN ] Derivative Progress: 567/1748 symbols completed. ELS took 1.2s. Estimated remaining: 7m 35s. Rate: 155.8 symbols/min [2025-10-07T22:37:39.776079] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:39.784945] [DEBUG] [LOCAL ] EMD: Loaded 21092 existing records from primary storage. [2025-10-07T22:37:39.785112] [INFO ] [MAIN ] EMD: Loaded 21092 primary data records. [2025-10-07T22:37:39.965773] [DEBUG] [LOCAL ] ELV: Loaded 50629 existing records from primary storage. [2025-10-07T22:37:39.975451] [INFO ] [MAIN ] ELV: Loaded 50629 primary data records. [2025-10-07T22:37:40.195954] [DEBUG] [LOCAL ] EME: Loaded 31195 existing records from primary storage. [2025-10-07T22:37:40.216327] [INFO ] [MAIN ] EME: Loaded 31195 primary data records. [2025-10-07T22:37:40.806949] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:40.807892] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 21092 primary records. [2025-10-07T22:37:40.808504] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-07T22:37:40.831270] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-10-07T22:37:40.831673] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-07T22:37:40.834229] [INFO ] [MAIN ] Derivative Progress: 568/1748 symbols completed. EMD took 1.1s. Estimated remaining: 7m 36s. Rate: 155.3 symbols/min [2025-10-07T22:37:40.854150] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:40.854993] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50629 primary records. [2025-10-07T22:37:40.855194] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-07T22:37:40.887211] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:40.888543] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31195 primary records. [2025-10-07T22:37:40.888946] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-07T22:37:40.889793] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-10-07T22:37:40.890195] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-07T22:37:40.892427] [INFO ] [MAIN ] Derivative Progress: 569/1748 symbols completed. ELV took 1.2s. Estimated remaining: 7m 35s. Rate: 155.5 symbols/min [2025-10-07T22:37:40.907589] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-10-07T22:37:40.907677] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-07T22:37:40.909666] [INFO ] [MAIN ] Derivative Progress: 570/1748 symbols completed. EME took 1.1s. Estimated remaining: 7m 34s. Rate: 155.8 symbols/min [2025-10-07T22:37:40.910076] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:40.910204] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:40.910017] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:40.918518] [DEBUG] [LOCAL ] EMP: Loaded 3076 existing records from primary storage. [2025-10-07T22:37:40.918845] [INFO ] [MAIN ] EMP: Loaded 3076 primary data records. [2025-10-07T22:37:41.011369] [DEBUG] [LOCAL ] EMO: Loaded 12812 existing records from primary storage. [2025-10-07T22:37:41.033891] [INFO ] [MAIN ] EMO: Loaded 12812 primary data records. [2025-10-07T22:37:41.412421] [DEBUG] [LOCAL ] EMN: Loaded 50612 existing records from primary storage. [2025-10-07T22:37:41.444273] [INFO ] [MAIN ] EMN: Loaded 50612 primary data records. [2025-10-07T22:37:41.899550] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:41.913358] [INFO ] [MAIN ] EMP: Generated 1794 derivative records from 3076 primary records. [2025-10-07T22:37:41.913464] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-07T22:37:41.913808] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:41.915482] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 12812 primary records. [2025-10-07T22:37:41.922767] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-07T22:37:41.931530] [DEBUG] [LOCAL ] EMP: Derivative data saved (1794 records). [2025-10-07T22:37:41.931727] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-07T22:37:41.934134] [INFO ] [MAIN ] Derivative Progress: 571/1748 symbols completed. EMP took 1.0s. Estimated remaining: 7m 35s. Rate: 155.3 symbols/min [2025-10-07T22:37:41.941374] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:41.950224] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-10-07T22:37:41.950434] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-07T22:37:41.952586] [INFO ] [MAIN ] Derivative Progress: 572/1748 symbols completed. EMO took 1.0s. Estimated remaining: 7m 33s. Rate: 155.6 symbols/min [2025-10-07T22:37:41.952896] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:41.977289] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:41.978161] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50612 primary records. [2025-10-07T22:37:41.978603] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-07T22:37:41.996545] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-10-07T22:37:41.996757] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-07T22:37:41.998797] [INFO ] [MAIN ] Derivative Progress: 573/1748 symbols completed. EMN took 1.1s. Estimated remaining: 7m 32s. Rate: 155.8 symbols/min [2025-10-07T22:37:41.999152] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:42.019000] [DEBUG] [LOCAL ] ENFY: Loaded 3219 existing records from primary storage. [2025-10-07T22:37:42.019254] [INFO ] [MAIN ] ENFY: Loaded 3219 primary data records. [2025-10-07T22:37:42.161504] [DEBUG] [LOCAL ] EMR: Loaded 53240 existing records from primary storage. [2025-10-07T22:37:42.177443] [INFO ] [MAIN ] EMR: Loaded 53240 primary data records. [2025-10-07T22:37:42.419301] [DEBUG] [LOCAL ] ENB: Loaded 53509 existing records from primary storage. [2025-10-07T22:37:42.433978] [INFO ] [MAIN ] ENB: Loaded 53509 primary data records. [2025-10-07T22:37:43.020451] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7832 incomplete bins [2025-10-07T22:37:43.021631] [INFO ] [MAIN ] ENFY: Generated 1782 derivative records from 3219 primary records. [2025-10-07T22:37:43.021932] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-10-07T22:37:43.047487] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1782 records). [2025-10-07T22:37:43.052880] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-10-07T22:37:43.053173] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:43.058489] [INFO ] [MAIN ] Derivative Progress: 574/1748 symbols completed. ENFY took 1.1s. Estimated remaining: 7m 33s. Rate: 155.4 symbols/min [2025-10-07T22:37:43.055697] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53240 primary records. [2025-10-07T22:37:43.058735] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-07T22:37:43.058830] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:43.088901] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:43.091128] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53509 primary records. [2025-10-07T22:37:43.091354] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-07T22:37:43.091243] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-10-07T22:37:43.092419] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-07T22:37:43.101534] [INFO ] [MAIN ] Derivative Progress: 575/1748 symbols completed. EMR took 1.2s. Estimated remaining: 7m 32s. Rate: 155.6 symbols/min [2025-10-07T22:37:43.105570] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:43.109909] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-10-07T22:37:43.110357] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-07T22:37:43.112695] [INFO ] [MAIN ] Derivative Progress: 576/1748 symbols completed. ENB took 1.2s. Estimated remaining: 7m 31s. Rate: 155.9 symbols/min [2025-10-07T22:37:43.112966] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:43.138286] [DEBUG] [LOCAL ] ENIC: Loaded 36328 existing records from primary storage. [2025-10-07T22:37:43.138514] [INFO ] [MAIN ] ENIC: Loaded 36328 primary data records. [2025-10-07T22:37:43.330811] [DEBUG] [LOCAL ] ENOV: Loaded 44787 existing records from primary storage. [2025-10-07T22:37:43.360006] [INFO ] [MAIN ] ENOV: Loaded 44787 primary data records. [2025-10-07T22:37:43.520678] [DEBUG] [LOCAL ] ENR: Loaded 43186 existing records from primary storage. [2025-10-07T22:37:43.576999] [INFO ] [MAIN ] ENR: Loaded 43186 primary data records. [2025-10-07T22:37:44.160384] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:44.161472] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36328 primary records. [2025-10-07T22:37:44.161568] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-07T22:37:44.183189] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-10-07T22:37:44.183454] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-07T22:37:44.185604] [INFO ] [MAIN ] Derivative Progress: 577/1748 symbols completed. ENIC took 1.1s. Estimated remaining: 7m 32s. Rate: 155.4 symbols/min [2025-10-07T22:37:44.199565] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:44.199464] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:44.200793] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 44787 primary records. [2025-10-07T22:37:44.200956] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-07T22:37:44.219611] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-10-07T22:37:44.219881] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-07T22:37:44.222712] [INFO ] [MAIN ] Derivative Progress: 578/1748 symbols completed. ENOV took 1.1s. Estimated remaining: 7m 31s. Rate: 155.6 symbols/min [2025-10-07T22:37:44.223583] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:44.239272] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:44.247730] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 43186 primary records. [2025-10-07T22:37:44.247886] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-07T22:37:44.273849] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-07T22:37:44.280629] [DEBUG] [LOCAL ] ENS: Loaded 29309 existing records from primary storage. [2025-10-07T22:37:44.280793] [INFO ] [MAIN ] ENS: Loaded 29309 primary data records. [2025-10-07T22:37:44.280882] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-07T22:37:44.315628] [INFO ] [MAIN ] Derivative Progress: 579/1748 symbols completed. ENR took 1.2s. Estimated remaining: 7m 30s. Rate: 155.8 symbols/min [2025-10-07T22:37:44.355247] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:44.396365] [DEBUG] [LOCAL ] ENVA: Loaded 25309 existing records from primary storage. [2025-10-07T22:37:44.450579] [INFO ] [MAIN ] ENVA: Loaded 25309 primary data records. [2025-10-07T22:37:44.617775] [DEBUG] [LOCAL ] EOD: Loaded 14699 existing records from primary storage. [2025-10-07T22:37:44.649575] [INFO ] [MAIN ] EOD: Loaded 14699 primary data records. [2025-10-07T22:37:45.250198] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:45.252283] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29309 primary records. [2025-10-07T22:37:45.252872] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-07T22:37:45.272870] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-10-07T22:37:45.286910] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-07T22:37:45.289427] [INFO ] [MAIN ] Derivative Progress: 580/1748 symbols completed. ENS took 1.1s. Estimated remaining: 7m 31s. Rate: 155.4 symbols/min [2025-10-07T22:37:45.289989] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:45.291118] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:45.291024] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25309 primary records. [2025-10-07T22:37:45.291664] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-07T22:37:45.325396] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:45.326240] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-07T22:37:45.327161] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14699 primary records. [2025-10-07T22:37:45.327470] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-07T22:37:45.327403] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-07T22:37:45.330324] [INFO ] [MAIN ] Derivative Progress: 581/1748 symbols completed. ENVA took 1.1s. Estimated remaining: 7m 30s. Rate: 155.7 symbols/min [2025-10-07T22:37:45.331511] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:45.366824] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-10-07T22:37:45.371547] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-07T22:37:45.371447] [DEBUG] [LOCAL ] EOI: Loaded 10811 existing records from primary storage. [2025-10-07T22:37:45.373689] [INFO ] [MAIN ] Derivative Progress: 582/1748 symbols completed. EOD took 1.0s. Estimated remaining: 7m 29s. Rate: 155.9 symbols/min [2025-10-07T22:37:45.373826] [INFO ] [MAIN ] EOI: Loaded 10811 primary data records. [2025-10-07T22:37:45.374208] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:45.509097] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-07T22:37:45.525179] [INFO ] [MAIN ] EOG: Loaded 53344 primary data records. [2025-10-07T22:37:45.550391] [DEBUG] [LOCAL ] EOS: Loaded 15413 existing records from primary storage. [2025-10-07T22:37:45.617799] [INFO ] [MAIN ] EOS: Loaded 15413 primary data records. [2025-10-07T22:37:46.390249] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:46.391287] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10811 primary records. [2025-10-07T22:37:46.391487] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-07T22:37:46.411630] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-07T22:37:46.411800] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-07T22:37:46.414227] [INFO ] [MAIN ] Derivative Progress: 583/1748 symbols completed. EOI took 1.1s. Estimated remaining: 7m 30s. Rate: 155.4 symbols/min [2025-10-07T22:37:46.428368] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:46.429080] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53344 primary records. [2025-10-07T22:37:46.429327] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-07T22:37:46.448102] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-07T22:37:46.448313] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-07T22:37:46.461372] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:46.462111] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15413 primary records. [2025-10-07T22:37:46.464878] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-07T22:37:46.464720] [INFO ] [MAIN ] Derivative Progress: 584/1748 symbols completed. EOG took 1.2s. Estimated remaining: 7m 29s. Rate: 155.7 symbols/min [2025-10-07T22:37:46.480843] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-07T22:37:46.480945] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-07T22:37:46.482853] [INFO ] [MAIN ] Derivative Progress: 585/1748 symbols completed. EOS took 1.1s. Estimated remaining: 7m 27s. Rate: 155.9 symbols/min [2025-10-07T22:37:46.483272] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:46.483362] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:46.483452] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:46.494972] [DEBUG] [LOCAL ] EOT: Loaded 6766 existing records from primary storage. [2025-10-07T22:37:46.495184] [INFO ] [MAIN ] EOT: Loaded 6766 primary data records. [2025-10-07T22:37:46.708822] [DEBUG] [LOCAL ] EPAC: Loaded 26790 existing records from primary storage. [2025-10-07T22:37:46.719843] [INFO ] [MAIN ] EPAC: Loaded 26790 primary data records. [2025-10-07T22:37:46.828490] [DEBUG] [LOCAL ] EPAM: Loaded 39563 existing records from primary storage. [2025-10-07T22:37:46.849070] [INFO ] [MAIN ] EPAM: Loaded 39563 primary data records. [2025-10-07T22:37:47.459729] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:47.460802] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6766 primary records. [2025-10-07T22:37:47.461050] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-07T22:37:47.481156] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-10-07T22:37:47.481332] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-07T22:37:47.484063] [INFO ] [MAIN ] Derivative Progress: 586/1748 symbols completed. EOT took 1.0s. Estimated remaining: 7m 28s. Rate: 155.5 symbols/min [2025-10-07T22:37:47.492359] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:47.499487] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:47.501224] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26790 primary records. [2025-10-07T22:37:47.501347] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-07T22:37:47.523273] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:47.529616] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39563 primary records. [2025-10-07T22:37:47.533884] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-07T22:37:47.533827] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-10-07T22:37:47.534860] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-07T22:37:47.537332] [INFO ] [MAIN ] Derivative Progress: 587/1748 symbols completed. EPAC took 1.1s. Estimated remaining: 7m 27s. Rate: 155.7 symbols/min [2025-10-07T22:37:47.537563] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:47.553700] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-10-07T22:37:47.554007] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-07T22:37:47.558059] [INFO ] [MAIN ] Derivative Progress: 588/1748 symbols completed. EPAM took 1.1s. Estimated remaining: 7m 26s. Rate: 156.0 symbols/min [2025-10-07T22:37:47.558379] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:47.579525] [DEBUG] [LOCAL ] EQBK: Loaded 10957 existing records from primary storage. [2025-10-07T22:37:47.579723] [INFO ] [MAIN ] EQBK: Loaded 10957 primary data records. [2025-10-07T22:37:47.700579] [DEBUG] [LOCAL ] EPC: Loaded 39861 existing records from primary storage. [2025-10-07T22:37:47.711950] [INFO ] [MAIN ] EPC: Loaded 39861 primary data records. [2025-10-07T22:37:48.095545] [DEBUG] [LOCAL ] EQNR: Loaded 53034 existing records from primary storage. [2025-10-07T22:37:48.106668] [INFO ] [MAIN ] EQNR: Loaded 53034 primary data records. [2025-10-07T22:37:48.609879] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:48.611254] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 10957 primary records. [2025-10-07T22:37:48.611550] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-07T22:37:48.633987] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-10-07T22:37:48.634607] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-07T22:37:48.637265] [INFO ] [MAIN ] Derivative Progress: 589/1748 symbols completed. EQBK took 1.1s. Estimated remaining: 7m 27s. Rate: 155.5 symbols/min [2025-10-07T22:37:48.650450] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:48.652113] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:48.653295] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39861 primary records. [2025-10-07T22:37:48.653389] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-07T22:37:48.675546] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-10-07T22:37:48.688962] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-07T22:37:48.689387] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:48.690116] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53034 primary records. [2025-10-07T22:37:48.690180] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-07T22:37:48.694123] [INFO ] [MAIN ] Derivative Progress: 590/1748 symbols completed. EPC took 1.2s. Estimated remaining: 7m 26s. Rate: 155.7 symbols/min [2025-10-07T22:37:48.705752] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:48.730078] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-07T22:37:48.730365] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-07T22:37:48.732709] [INFO ] [MAIN ] Derivative Progress: 591/1748 symbols completed. EQNR took 1.2s. Estimated remaining: 7m 25s. Rate: 156.0 symbols/min [2025-10-07T22:37:48.733140] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:48.739741] [DEBUG] [LOCAL ] EQV: Loaded 2705 existing records from primary storage. [2025-10-07T22:37:48.740107] [INFO ] [MAIN ] EQV: Loaded 2705 primary data records. [2025-10-07T22:37:48.877045] [DEBUG] [LOCAL ] EQR: Loaded 51602 existing records from primary storage. [2025-10-07T22:37:48.877616] [INFO ] [MAIN ] EQR: Loaded 51602 primary data records. [2025-10-07T22:37:49.051454] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-07T22:37:49.196336] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-10-07T22:37:49.723877] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:49.725994] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2705 primary records. [2025-10-07T22:37:49.726312] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-07T22:37:49.744066] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-07T22:37:49.744197] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-07T22:37:49.746321] [INFO ] [MAIN ] Derivative Progress: 592/1748 symbols completed. EQV took 1.0s. Estimated remaining: 7m 26s. Rate: 155.5 symbols/min [2025-10-07T22:37:49.746775] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:49.760689] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:49.761923] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51602 primary records. [2025-10-07T22:37:49.762006] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-07T22:37:49.781600] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-07T22:37:49.781891] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-07T22:37:49.784282] [INFO ] [MAIN ] Derivative Progress: 593/1748 symbols completed. EQR took 1.1s. Estimated remaining: 7m 25s. Rate: 155.8 symbols/min [2025-10-07T22:37:49.784503] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:49.798701] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:49.799578] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-10-07T22:37:49.799785] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-07T22:37:49.816478] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-07T22:37:49.816750] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-07T22:37:49.818915] [INFO ] [MAIN ] Derivative Progress: 594/1748 symbols completed. EQT took 1.1s. Estimated remaining: 7m 24s. Rate: 156.0 symbols/min [2025-10-07T22:37:49.819103] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:49.866495] [DEBUG] [LOCAL ] ERJ: Loaded 50561 existing records from primary storage. [2025-10-07T22:37:49.866769] [INFO ] [MAIN ] ERJ: Loaded 50561 primary data records. [2025-10-07T22:37:49.996383] [DEBUG] [LOCAL ] ERO: Loaded 41407 existing records from primary storage. [2025-10-07T22:37:49.996570] [INFO ] [MAIN ] ERO: Loaded 41407 primary data records. [2025-10-07T22:37:50.161896] [DEBUG] [LOCAL ] ES: Loaded 52614 existing records from primary storage. [2025-10-07T22:37:50.184531] [INFO ] [MAIN ] ES: Loaded 52614 primary data records. [2025-10-07T22:37:50.867304] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:50.868417] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50561 primary records. [2025-10-07T22:37:50.868594] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-07T22:37:50.905030] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-07T22:37:50.903888] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:50.906021] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41407 primary records. [2025-10-07T22:37:50.906132] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-07T22:37:50.906356] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-07T22:37:50.922770] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:50.922378] [INFO ] [MAIN ] Derivative Progress: 595/1748 symbols completed. ERJ took 1.2s. Estimated remaining: 7m 25s. Rate: 155.5 symbols/min [2025-10-07T22:37:50.931270] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:50.931142] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52614 primary records. [2025-10-07T22:37:50.931712] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-07T22:37:50.949078] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-07T22:37:50.949297] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-07T22:37:50.951674] [INFO ] [MAIN ] Derivative Progress: 596/1748 symbols completed. ERO took 1.2s. Estimated remaining: 7m 24s. Rate: 155.8 symbols/min [2025-10-07T22:37:50.951824] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:50.959261] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-10-07T22:37:50.959398] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-07T22:37:50.961696] [INFO ] [MAIN ] Derivative Progress: 597/1748 symbols completed. ES took 1.1s. Estimated remaining: 7m 23s. Rate: 156.0 symbols/min [2025-10-07T22:37:50.962575] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:50.994221] [DEBUG] [LOCAL ] ESAB: Loaded 26108 existing records from primary storage. [2025-10-07T22:37:50.994477] [INFO ] [MAIN ] ESAB: Loaded 26108 primary data records. [2025-10-07T22:37:50.993736] [DEBUG] [LOCAL ] ESE: Loaded 16585 existing records from primary storage. [2025-10-07T22:37:50.994718] [INFO ] [MAIN ] ESE: Loaded 16585 primary data records. [2025-10-07T22:37:51.659045] [DEBUG] [LOCAL ] ESI: Loaded 50698 existing records from primary storage. [2025-10-07T22:37:51.659389] [INFO ] [MAIN ] ESI: Loaded 50698 primary data records. [2025-10-07T22:37:52.076528] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:52.078068] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:52.077720] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26108 primary records. [2025-10-07T22:37:52.078977] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16585 primary records. [2025-10-07T22:37:52.079250] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-07T22:37:52.079189] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-07T22:37:52.109309] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-07T22:37:52.110077] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-07T22:37:52.113958] [INFO ] [MAIN ] Derivative Progress: 598/1748 symbols completed. ESE took 1.2s. Estimated remaining: 7m 24s. Rate: 155.5 symbols/min [2025-10-07T22:37:52.120769] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-10-07T22:37:52.121105] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-07T22:37:52.124516] [INFO ] [MAIN ] Derivative Progress: 599/1748 symbols completed. ESAB took 1.2s. Estimated remaining: 7m 23s. Rate: 155.8 symbols/min [2025-10-07T22:37:52.140098] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:52.140701] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50698 primary records. [2025-10-07T22:37:52.140764] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-07T22:37:52.155963] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-07T22:37:52.156025] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-07T22:37:52.158120] [INFO ] [MAIN ] Derivative Progress: 600/1748 symbols completed. ESI took 1.2s. Estimated remaining: 7m 22s. Rate: 156.0 symbols/min [2025-10-07T22:37:52.158614] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:52.158864] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:52.158716] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:52.214442] [DEBUG] [LOCAL ] ESS: Loaded 29871 existing records from primary storage. [2025-10-07T22:37:52.214748] [INFO ] [MAIN ] ESS: Loaded 29871 primary data records. [2025-10-07T22:37:52.318434] [DEBUG] [LOCAL ] ESNT: Loaded 38318 existing records from primary storage. [2025-10-07T22:37:52.340284] [INFO ] [MAIN ] ESNT: Loaded 38318 primary data records. [2025-10-07T22:37:52.353870] [DEBUG] [LOCAL ] ESRT: Loaded 46351 existing records from primary storage. [2025-10-07T22:37:52.484209] [INFO ] [MAIN ] ESRT: Loaded 46351 primary data records. [2025-10-07T22:37:53.180679] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:53.194901] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 29871 primary records. [2025-10-07T22:37:53.195785] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-07T22:37:53.195514] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:53.198228] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38318 primary records. [2025-10-07T22:37:53.206588] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-07T22:37:53.214027] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-10-07T22:37:53.214950] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-07T22:37:53.225443] [INFO ] [MAIN ] Derivative Progress: 601/1748 symbols completed. ESS took 1.1s. Estimated remaining: 7m 22s. Rate: 155.5 symbols/min [2025-10-07T22:37:53.225778] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:53.234532] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-07T22:37:53.234830] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-07T22:37:53.238176] [INFO ] [MAIN ] Derivative Progress: 602/1748 symbols completed. ESNT took 1.1s. Estimated remaining: 7m 21s. Rate: 155.8 symbols/min [2025-10-07T22:37:53.240084] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:53.254956] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:53.255816] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46351 primary records. [2025-10-07T22:37:53.255968] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-07T22:37:53.275742] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-07T22:37:53.275975] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-07T22:37:53.278756] [INFO ] [MAIN ] Derivative Progress: 603/1748 symbols completed. ESRT took 1.1s. Estimated remaining: 7m 20s. Rate: 156.0 symbols/min [2025-10-07T22:37:53.279086] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:53.318984] [DEBUG] [LOCAL ] ETB: Loaded 12221 existing records from primary storage. [2025-10-07T22:37:53.319149] [INFO ] [MAIN ] ETB: Loaded 12221 primary data records. [2025-10-07T22:37:53.458745] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-07T22:37:53.460209] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-07T22:37:53.459977] [DEBUG] [LOCAL ] ESTC: Loaded 50060 existing records from primary storage. [2025-10-07T22:37:53.491198] [INFO ] [MAIN ] ESTC: Loaded 50060 primary data records. [2025-10-07T22:37:54.376722] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:54.378701] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:54.380750] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-10-07T22:37:54.380868] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-07T22:37:54.379966] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12221 primary records. [2025-10-07T22:37:54.389970] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-07T22:37:54.404452] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:54.408382] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50060 primary records. [2025-10-07T22:37:54.416624] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-07T22:37:54.427253] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-10-07T22:37:54.437159] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-10-07T22:37:54.435322] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-07T22:37:54.437310] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-07T22:37:54.441906] [INFO ] [MAIN ] Derivative Progress: 604/1748 symbols completed. ETB took 1.2s. Estimated remaining: 7m 21s. Rate: 155.5 symbols/min [2025-10-07T22:37:54.446156] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-10-07T22:37:54.446339] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:54.446477] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-07T22:37:54.448714] [INFO ] [MAIN ] Derivative Progress: 605/1748 symbols completed. ESTC took 1.2s. Estimated remaining: 7m 20s. Rate: 155.8 symbols/min [2025-10-07T22:37:54.451638] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:54.452530] [INFO ] [MAIN ] Derivative Progress: 606/1748 symbols completed. ET took 1.2s. Estimated remaining: 7m 19s. Rate: 156.0 symbols/min [2025-10-07T22:37:54.452795] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:54.481349] [DEBUG] [LOCAL ] ETJ: Loaded 17010 existing records from primary storage. [2025-10-07T22:37:54.481563] [INFO ] [MAIN ] ETJ: Loaded 17010 primary data records. [2025-10-07T22:37:54.492504] [DEBUG] [LOCAL ] ETG: Loaded 16574 existing records from primary storage. [2025-10-07T22:37:54.516866] [INFO ] [MAIN ] ETG: Loaded 16574 primary data records. [2025-10-07T22:37:54.590088] [DEBUG] [LOCAL ] ETD: Loaded 27351 existing records from primary storage. [2025-10-07T22:37:54.649630] [INFO ] [MAIN ] ETD: Loaded 27351 primary data records. [2025-10-07T22:37:55.453507] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:55.456616] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 17010 primary records. [2025-10-07T22:37:55.456882] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-07T22:37:55.479504] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:55.480390] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16574 primary records. [2025-10-07T22:37:55.489919] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-07T22:37:55.490108] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-07T22:37:55.492162] [INFO ] [MAIN ] Derivative Progress: 607/1748 symbols completed. ETJ took 1.0s. Estimated remaining: 7m 20s. Rate: 155.6 symbols/min [2025-10-07T22:37:55.485737] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-07T22:37:55.492472] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:55.507621] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:55.516052] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27351 primary records. [2025-10-07T22:37:55.519884] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-07T22:37:55.527492] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-10-07T22:37:55.543000] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-07T22:37:55.543191] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-07T22:37:55.545563] [INFO ] [MAIN ] Derivative Progress: 608/1748 symbols completed. ETD took 1.1s. Estimated remaining: 7m 19s. Rate: 155.8 symbols/min [2025-10-07T22:37:55.541867] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-07T22:37:55.546115] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:55.552213] [INFO ] [MAIN ] Derivative Progress: 609/1748 symbols completed. ETG took 1.1s. Estimated remaining: 7m 18s. Rate: 156.0 symbols/min [2025-10-07T22:37:55.549706] [DEBUG] [LOCAL ] ETO: Loaded 6736 existing records from primary storage. [2025-10-07T22:37:55.552765] [INFO ] [MAIN ] ETO: Loaded 6736 primary data records. [2025-10-07T22:37:55.552870] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:55.877348] [DEBUG] [LOCAL ] ETV: Loaded 21890 existing records from primary storage. [2025-10-07T22:37:55.877787] [INFO ] [MAIN ] ETV: Loaded 21890 primary data records. [2025-10-07T22:37:56.037784] [DEBUG] [LOCAL ] ETR: Loaded 53233 existing records from primary storage. [2025-10-07T22:37:56.068392] [INFO ] [MAIN ] ETR: Loaded 53233 primary data records. [2025-10-07T22:37:56.582173] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:56.584049] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6736 primary records. [2025-10-07T22:37:56.584434] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-07T22:37:56.606083] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-07T22:37:56.620533] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-07T22:37:56.620930] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:56.626243] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21890 primary records. [2025-10-07T22:37:56.625320] [INFO ] [MAIN ] Derivative Progress: 610/1748 symbols completed. ETO took 1.1s. Estimated remaining: 7m 19s. Rate: 155.6 symbols/min [2025-10-07T22:37:56.626810] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-07T22:37:56.626731] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:56.646115] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-10-07T22:37:56.646279] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-07T22:37:56.650968] [INFO ] [MAIN ] Derivative Progress: 611/1748 symbols completed. ETV took 1.1s. Estimated remaining: 7m 18s. Rate: 155.8 symbols/min [2025-10-07T22:37:56.651343] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:56.677092] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:56.677982] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53233 primary records. [2025-10-07T22:37:56.678186] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-07T22:37:56.689591] [DEBUG] [LOCAL ] ETX: Loaded 5181 existing records from primary storage. [2025-10-07T22:37:56.702158] [INFO ] [MAIN ] ETX: Loaded 5181 primary data records. [2025-10-07T22:37:56.727522] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-10-07T22:37:56.750133] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-07T22:37:56.749956] [DEBUG] [LOCAL ] ETW: Loaded 25336 existing records from primary storage. [2025-10-07T22:37:56.750331] [INFO ] [MAIN ] ETW: Loaded 25336 primary data records. [2025-10-07T22:37:56.752827] [INFO ] [MAIN ] Derivative Progress: 612/1748 symbols completed. ETR took 1.2s. Estimated remaining: 7m 17s. Rate: 156.0 symbols/min [2025-10-07T22:37:56.807944] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:57.078132] [DEBUG] [LOCAL ] ETY: Loaded 23014 existing records from primary storage. [2025-10-07T22:37:57.312741] [INFO ] [MAIN ] ETY: Loaded 23014 primary data records. [2025-10-07T22:37:57.653945] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:57.655062] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25336 primary records. [2025-10-07T22:37:57.655246] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-07T22:37:57.681908] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:57.687346] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5181 primary records. [2025-10-07T22:37:57.687750] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-07T22:37:57.691401] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-07T22:37:57.691833] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-07T22:37:57.694244] [INFO ] [MAIN ] Derivative Progress: 613/1748 symbols completed. ETW took 1.1s. Estimated remaining: 7m 18s. Rate: 155.6 symbols/min [2025-10-07T22:37:57.711571] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-10-07T22:37:57.711753] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-07T22:37:57.713780] [INFO ] [MAIN ] Derivative Progress: 614/1748 symbols completed. ETX took 1.1s. Estimated remaining: 7m 16s. Rate: 155.9 symbols/min [2025-10-07T22:37:57.729972] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:57.730547] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 23014 primary records. [2025-10-07T22:37:57.730606] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-07T22:37:57.745874] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-10-07T22:37:57.745934] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-07T22:37:57.748110] [INFO ] [MAIN ] Derivative Progress: 615/1748 symbols completed. ETY took 0.9s. Estimated remaining: 7m 15s. Rate: 156.1 symbols/min [2025-10-07T22:37:57.748561] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:57.748748] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:57.748860] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:57.763436] [DEBUG] [LOCAL ] EVF: Loaded 9610 existing records from primary storage. [2025-10-07T22:37:57.763684] [INFO ] [MAIN ] EVF: Loaded 9610 primary data records. [2025-10-07T22:37:57.895275] [DEBUG] [LOCAL ] EVC: Loaded 18322 existing records from primary storage. [2025-10-07T22:37:57.922907] [INFO ] [MAIN ] EVC: Loaded 18322 primary data records. [2025-10-07T22:37:57.955051] [DEBUG] [LOCAL ] EVEX: Loaded 31180 existing records from primary storage. [2025-10-07T22:37:57.971761] [INFO ] [MAIN ] EVEX: Loaded 31180 primary data records. [2025-10-07T22:37:58.777963] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:58.779127] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9610 primary records. [2025-10-07T22:37:58.779449] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-07T22:37:58.828217] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-10-07T22:37:58.828947] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-07T22:37:58.828792] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:58.829614] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:58.830494] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 18322 primary records. [2025-10-07T22:37:58.832689] [INFO ] [MAIN ] Derivative Progress: 616/1748 symbols completed. EVF took 1.1s. Estimated remaining: 7m 16s. Rate: 155.7 symbols/min [2025-10-07T22:37:58.833542] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 31180 primary records. [2025-10-07T22:37:58.833637] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-07T22:37:58.834274] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:58.834342] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-07T22:37:58.865633] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-07T22:37:58.866326] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-07T22:37:58.869073] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-07T22:37:58.871176] [INFO ] [MAIN ] Derivative Progress: 617/1748 symbols completed. EVEX took 1.1s. Estimated remaining: 7m 15s. Rate: 155.9 symbols/min [2025-10-07T22:37:58.871545] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-07T22:37:58.871780] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:58.877168] [INFO ] [MAIN ] Derivative Progress: 618/1748 symbols completed. EVC took 1.1s. Estimated remaining: 7m 14s. Rate: 156.1 symbols/min [2025-10-07T22:37:58.877347] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:58.877848] [DEBUG] [LOCAL ] EVG: Loaded 5964 existing records from primary storage. [2025-10-07T22:37:58.878152] [INFO ] [MAIN ] EVG: Loaded 5964 primary data records. [2025-10-07T22:37:59.002855] [DEBUG] [LOCAL ] EVN: Loaded 11046 existing records from primary storage. [2025-10-07T22:37:59.023767] [INFO ] [MAIN ] EVN: Loaded 11046 primary data records. [2025-10-07T22:37:59.350925] [DEBUG] [LOCAL ] EVH: Loaded 49492 existing records from primary storage. [2025-10-07T22:37:59.372596] [INFO ] [MAIN ] EVH: Loaded 49492 primary data records. [2025-10-07T22:37:59.900961] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:59.902507] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5964 primary records. [2025-10-07T22:37:59.902929] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-07T22:37:59.924394] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-07T22:37:59.934238] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-07T22:37:59.942845] [INFO ] [MAIN ] Derivative Progress: 619/1748 symbols completed. EVG took 1.1s. Estimated remaining: 7m 15s. Rate: 155.7 symbols/min [2025-10-07T22:37:59.943667] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:59.944835] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:59.947060] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 11046 primary records. [2025-10-07T22:37:59.948354] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-07T22:37:59.972935] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-07T22:37:59.975130] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-07T22:37:59.977732] [INFO ] [MAIN ] Derivative Progress: 620/1748 symbols completed. EVN took 1.1s. Estimated remaining: 7m 14s. Rate: 155.9 symbols/min [2025-10-07T22:37:59.978012] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:37:59.992615] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:37:59.993607] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49492 primary records. [2025-10-07T22:37:59.993804] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-07T22:38:00.017951] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-07T22:38:00.018098] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-07T22:38:00.020386] [INFO ] [MAIN ] Derivative Progress: 621/1748 symbols completed. EVH took 1.1s. Estimated remaining: 7m 13s. Rate: 156.1 symbols/min [2025-10-07T22:38:00.020705] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:00.036982] [DEBUG] [LOCAL ] EVT: Loaded 16888 existing records from primary storage. [2025-10-07T22:38:00.037192] [INFO ] [MAIN ] EVT: Loaded 16888 primary data records. [2025-10-07T22:38:00.167909] [DEBUG] [LOCAL ] EVR: Loaded 34643 existing records from primary storage. [2025-10-07T22:38:00.168161] [INFO ] [MAIN ] EVR: Loaded 34643 primary data records. [2025-10-07T22:38:00.279022] [DEBUG] [LOCAL ] EVTC: Loaded 26406 existing records from primary storage. [2025-10-07T22:38:00.336486] [INFO ] [MAIN ] EVTC: Loaded 26406 primary data records. [2025-10-07T22:38:01.077924] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:01.080512] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16888 primary records. [2025-10-07T22:38:01.082200] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-07T22:38:01.098396] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:01.111622] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 34643 primary records. [2025-10-07T22:38:01.113699] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-07T22:38:01.117004] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-10-07T22:38:01.117519] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-07T22:38:01.119952] [INFO ] [MAIN ] Derivative Progress: 622/1748 symbols completed. EVT took 1.1s. Estimated remaining: 7m 14s. Rate: 155.7 symbols/min [2025-10-07T22:38:01.127418] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:01.136091] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-10-07T22:38:01.136933] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-07T22:38:01.139564] [INFO ] [MAIN ] Derivative Progress: 623/1748 symbols completed. EVR took 1.2s. Estimated remaining: 7m 13s. Rate: 155.9 symbols/min [2025-10-07T22:38:01.139923] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:01.160441] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:01.163381] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26406 primary records. [2025-10-07T22:38:01.163684] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-07T22:38:01.186273] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-07T22:38:01.186610] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-07T22:38:01.188704] [INFO ] [MAIN ] Derivative Progress: 624/1748 symbols completed. EVTC took 1.2s. Estimated remaining: 7m 12s. Rate: 156.1 symbols/min [2025-10-07T22:38:01.188912] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:01.211999] [DEBUG] [LOCAL ] EVTR: Loaded 24189 existing records from primary storage. [2025-10-07T22:38:01.212234] [INFO ] [MAIN ] EVTR: Loaded 24189 primary data records. [2025-10-07T22:38:01.333915] [DEBUG] [LOCAL ] EVTL: Loaded 38975 existing records from primary storage. [2025-10-07T22:38:01.334530] [INFO ] [MAIN ] EVTL: Loaded 38975 primary data records. [2025-10-07T22:38:01.695260] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-07T22:38:01.723952] [INFO ] [MAIN ] EW: Loaded 53402 primary data records. [2025-10-07T22:38:02.260068] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:38:02.261413] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 24189 primary records. [2025-10-07T22:38:02.261827] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-07T22:38:02.280571] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-10-07T22:38:02.282440] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-07T22:38:02.284841] [INFO ] [MAIN ] Derivative Progress: 625/1748 symbols completed. EVTR took 1.1s. Estimated remaining: 7m 13s. Rate: 155.7 symbols/min [2025-10-07T22:38:02.285008] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:02.301411] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:02.302369] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 38975 primary records. [2025-10-07T22:38:02.302635] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-07T22:38:02.321459] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-07T22:38:02.323804] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-07T22:38:02.326973] [INFO ] [MAIN ] Derivative Progress: 626/1748 symbols completed. EVTL took 1.2s. Estimated remaining: 7m 12s. Rate: 155.9 symbols/min [2025-10-07T22:38:02.327180] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:02.344218] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:02.345106] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53402 primary records. [2025-10-07T22:38:02.345261] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-07T22:38:02.370185] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-07T22:38:02.370304] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-07T22:38:02.372426] [INFO ] [MAIN ] Derivative Progress: 627/1748 symbols completed. EW took 1.2s. Estimated remaining: 7m 11s. Rate: 156.1 symbols/min [2025-10-07T22:38:02.373168] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:02.385564] [DEBUG] [LOCAL ] EXG: Loaded 34226 existing records from primary storage. [2025-10-07T22:38:02.385881] [INFO ] [MAIN ] EXG: Loaded 34226 primary data records. [2025-10-07T22:38:02.733687] [DEBUG] [LOCAL ] EXP: Loaded 29608 existing records from primary storage. [2025-10-07T22:38:02.733904] [INFO ] [MAIN ] EXP: Loaded 29608 primary data records. [2025-10-07T22:38:02.756241] [DEBUG] [LOCAL ] EXK: Loaded 53139 existing records from primary storage. [2025-10-07T22:38:02.779727] [INFO ] [MAIN ] EXK: Loaded 53139 primary data records. [2025-10-07T22:38:03.364193] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:03.365550] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34226 primary records. [2025-10-07T22:38:03.365740] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-07T22:38:03.385187] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-07T22:38:03.385636] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-07T22:38:03.388221] [INFO ] [MAIN ] Derivative Progress: 628/1748 symbols completed. EXG took 1.1s. Estimated remaining: 7m 12s. Rate: 155.7 symbols/min [2025-10-07T22:38:03.420443] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:03.420247] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:03.421197] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53139 primary records. [2025-10-07T22:38:03.421756] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29608 primary records. [2025-10-07T22:38:03.421852] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-07T22:38:03.421907] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-07T22:38:03.451727] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-10-07T22:38:03.453407] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-07T22:38:03.453355] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-07T22:38:03.455399] [INFO ] [MAIN ] Derivative Progress: 629/1748 symbols completed. EXP took 1.1s. Estimated remaining: 7m 11s. Rate: 155.9 symbols/min [2025-10-07T22:38:03.453512] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-07T22:38:03.457596] [INFO ] [MAIN ] Derivative Progress: 630/1748 symbols completed. EXK took 1.1s. Estimated remaining: 7m 10s. Rate: 156.2 symbols/min [2025-10-07T22:38:03.458155] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:03.458263] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:03.458305] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:03.527128] [DEBUG] [LOCAL ] EXPD: Loaded 47815 existing records from primary storage. [2025-10-07T22:38:03.527363] [INFO ] [MAIN ] EXPD: Loaded 47815 primary data records. [2025-10-07T22:38:03.658804] [DEBUG] [LOCAL ] EXR: Loaded 45261 existing records from primary storage. [2025-10-07T22:38:03.659070] [INFO ] [MAIN ] EXR: Loaded 45261 primary data records. [2025-10-07T22:38:03.660229] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-07T22:38:03.670888] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-07T22:38:04.576589] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:04.578350] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47815 primary records. [2025-10-07T22:38:04.578711] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-07T22:38:04.600993] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-07T22:38:04.601191] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-07T22:38:04.603326] [INFO ] [MAIN ] Derivative Progress: 631/1748 symbols completed. EXPD took 1.1s. Estimated remaining: 7m 11s. Rate: 155.7 symbols/min [2025-10-07T22:38:04.603639] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:04.620233] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:04.621931] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-07T22:38:04.622162] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-07T22:38:04.649876] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:04.651316] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45261 primary records. [2025-10-07T22:38:04.654937] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-07T22:38:04.655305] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-07T22:38:04.656305] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-07T22:38:04.658285] [INFO ] [MAIN ] Derivative Progress: 632/1748 symbols completed. F took 1.2s. Estimated remaining: 7m 10s. Rate: 155.9 symbols/min [2025-10-07T22:38:04.658669] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:04.678221] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-07T22:38:04.678353] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-07T22:38:04.680593] [INFO ] [MAIN ] Derivative Progress: 633/1748 symbols completed. EXR took 1.2s. Estimated remaining: 7m 9s. Rate: 156.1 symbols/min [2025-10-07T22:38:04.680881] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:04.733587] [DEBUG] [LOCAL ] FAF: Loaded 41605 existing records from primary storage. [2025-10-07T22:38:04.733910] [INFO ] [MAIN ] FAF: Loaded 41605 primary data records. [2025-10-07T22:38:04.823811] [DEBUG] [LOCAL ] FBK: Loaded 26609 existing records from primary storage. [2025-10-07T22:38:04.842701] [INFO ] [MAIN ] FBK: Loaded 26609 primary data records. [2025-10-07T22:38:04.887825] [DEBUG] [LOCAL ] FBIN: Loaded 50405 existing records from primary storage. [2025-10-07T22:38:04.907957] [INFO ] [MAIN ] FBIN: Loaded 50405 primary data records. [2025-10-07T22:38:05.825075] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:05.828561] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41605 primary records. [2025-10-07T22:38:05.828734] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-07T22:38:05.854134] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-07T22:38:05.857398] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-07T22:38:05.877236] [INFO ] [MAIN ] Derivative Progress: 634/1748 symbols completed. FAF took 1.3s. Estimated remaining: 7m 10s. Rate: 155.6 symbols/min [2025-10-07T22:38:05.887167] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:05.878879] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:05.895145] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50405 primary records. [2025-10-07T22:38:05.893671] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:05.895412] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-07T22:38:05.897698] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 26609 primary records. [2025-10-07T22:38:05.897981] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-07T22:38:05.924816] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-10-07T22:38:05.926486] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-07T22:38:05.931262] [INFO ] [MAIN ] Derivative Progress: 635/1748 symbols completed. FBIN took 1.3s. Estimated remaining: 7m 9s. Rate: 155.8 symbols/min [2025-10-07T22:38:05.931475] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:05.936427] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-07T22:38:05.937214] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-07T22:38:05.939314] [INFO ] [MAIN ] Derivative Progress: 636/1748 symbols completed. FBK took 1.3s. Estimated remaining: 7m 8s. Rate: 156.0 symbols/min [2025-10-07T22:38:05.939777] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:05.966609] [DEBUG] [LOCAL ] FC: Loaded 15301 existing records from primary storage. [2025-10-07T22:38:05.967031] [INFO ] [MAIN ] FC: Loaded 15301 primary data records. [2025-10-07T22:38:06.032387] [DEBUG] [LOCAL ] FBP: Loaded 45850 existing records from primary storage. [2025-10-07T22:38:06.081900] [INFO ] [MAIN ] FBP: Loaded 45850 primary data records. [2025-10-07T22:38:06.150017] [DEBUG] [LOCAL ] FBRT: Loaded 35007 existing records from primary storage. [2025-10-07T22:38:06.204790] [INFO ] [MAIN ] FBRT: Loaded 35007 primary data records. [2025-10-07T22:38:06.974499] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:06.975857] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15301 primary records. [2025-10-07T22:38:06.976073] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-07T22:38:06.999470] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:07.000393] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45850 primary records. [2025-10-07T22:38:07.001745] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-07T22:38:07.020278] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-10-07T22:38:07.025096] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-07T22:38:07.029853] [INFO ] [MAIN ] Derivative Progress: 637/1748 symbols completed. FC took 1.1s. Estimated remaining: 7m 8s. Rate: 155.6 symbols/min [2025-10-07T22:38:07.031674] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:07.031517] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-07T22:38:07.032057] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-07T22:38:07.047561] [INFO ] [MAIN ] Derivative Progress: 638/1748 symbols completed. FBP took 1.2s. Estimated remaining: 7m 7s. Rate: 155.8 symbols/min [2025-10-07T22:38:07.048259] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:07.047943] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:07.049718] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 35007 primary records. [2025-10-07T22:38:07.050459] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-07T22:38:07.068782] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-10-07T22:38:07.068883] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-07T22:38:07.070876] [INFO ] [MAIN ] Derivative Progress: 639/1748 symbols completed. FBRT took 1.1s. Estimated remaining: 7m 6s. Rate: 156.1 symbols/min [2025-10-07T22:38:07.071130] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:07.105680] [DEBUG] [LOCAL ] FCN: Loaded 26013 existing records from primary storage. [2025-10-07T22:38:07.105846] [INFO ] [MAIN ] FCN: Loaded 26013 primary data records. [2025-10-07T22:38:07.231103] [DEBUG] [LOCAL ] FCF: Loaded 39294 existing records from primary storage. [2025-10-07T22:38:07.258686] [INFO ] [MAIN ] FCF: Loaded 39294 primary data records. [2025-10-07T22:38:07.293556] [DEBUG] [LOCAL ] FCPT: Loaded 37319 existing records from primary storage. [2025-10-07T22:38:07.322146] [INFO ] [MAIN ] FCPT: Loaded 37319 primary data records. [2025-10-07T22:38:08.115068] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:08.116134] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26013 primary records. [2025-10-07T22:38:08.116472] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-07T22:38:08.155674] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-07T22:38:08.156210] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:08.156313] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-07T22:38:08.158431] [INFO ] [MAIN ] Derivative Progress: 640/1748 symbols completed. FCN took 1.1s. Estimated remaining: 7m 7s. Rate: 155.6 symbols/min [2025-10-07T22:38:08.159322] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37319 primary records. [2025-10-07T22:38:08.159564] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-07T22:38:08.159493] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:08.191706] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:08.197085] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-07T22:38:08.197230] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-07T22:38:08.199632] [INFO ] [MAIN ] Derivative Progress: 641/1748 symbols completed. FCPT took 1.1s. Estimated remaining: 7m 6s. Rate: 155.8 symbols/min [2025-10-07T22:38:08.200629] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39294 primary records. [2025-10-07T22:38:08.200861] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:08.201093] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-07T22:38:08.208582] [DEBUG] [LOCAL ] FCT: Loaded 14747 existing records from primary storage. [2025-10-07T22:38:08.209000] [INFO ] [MAIN ] FCT: Loaded 14747 primary data records. [2025-10-07T22:38:08.272842] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-10-07T22:38:08.286049] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-07T22:38:08.315911] [INFO ] [MAIN ] Derivative Progress: 642/1748 symbols completed. FCF took 1.3s. Estimated remaining: 7m 5s. Rate: 156.0 symbols/min [2025-10-07T22:38:08.328500] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:08.611864] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-07T22:38:08.612883] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-10-07T22:38:08.708374] [DEBUG] [LOCAL ] FDP: Loaded 30089 existing records from primary storage. [2025-10-07T22:38:08.720146] [INFO ] [MAIN ] FDP: Loaded 30089 primary data records. [2025-10-07T22:38:09.271526] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:09.272924] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14747 primary records. [2025-10-07T22:38:09.273129] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-07T22:38:09.291627] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-10-07T22:38:09.292841] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-07T22:38:09.295022] [INFO ] [MAIN ] Derivative Progress: 643/1748 symbols completed. FCT took 1.1s. Estimated remaining: 7m 6s. Rate: 155.6 symbols/min [2025-10-07T22:38:09.312104] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:09.312921] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-10-07T22:38:09.313068] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-07T22:38:09.330803] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-07T22:38:09.331545] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-07T22:38:09.333356] [INFO ] [MAIN ] Derivative Progress: 644/1748 symbols completed. FCX took 1.1s. Estimated remaining: 7m 5s. Rate: 155.8 symbols/min [2025-10-07T22:38:09.347100] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:09.347760] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30089 primary records. [2025-10-07T22:38:09.347824] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-07T22:38:09.363523] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-07T22:38:09.363591] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-07T22:38:09.365856] [INFO ] [MAIN ] Derivative Progress: 645/1748 symbols completed. FDP took 1.0s. Estimated remaining: 7m 4s. Rate: 156.1 symbols/min [2025-10-07T22:38:09.366281] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:09.366405] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:09.366517] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:09.397479] [DEBUG] [LOCAL ] FDS: Loaded 26938 existing records from primary storage. [2025-10-07T22:38:09.397638] [INFO ] [MAIN ] FDS: Loaded 26938 primary data records. [2025-10-07T22:38:09.577161] [DEBUG] [LOCAL ] FDX: Loaded 51485 existing records from primary storage. [2025-10-07T22:38:09.593593] [DEBUG] [LOCAL ] FE: Loaded 53431 existing records from primary storage. [2025-10-07T22:38:09.617505] [INFO ] [MAIN ] FE: Loaded 53431 primary data records. [2025-10-07T22:38:09.604048] [INFO ] [MAIN ] FDX: Loaded 51485 primary data records. [2025-10-07T22:38:10.469130] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:10.470222] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 26938 primary records. [2025-10-07T22:38:10.470575] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-07T22:38:10.489928] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-07T22:38:10.490905] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-07T22:38:10.492983] [INFO ] [MAIN ] Derivative Progress: 646/1748 symbols completed. FDS took 1.1s. Estimated remaining: 7m 5s. Rate: 155.6 symbols/min [2025-10-07T22:38:10.493485] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:10.510921] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:10.524267] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53431 primary records. [2025-10-07T22:38:10.524751] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-07T22:38:10.525070] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:10.525698] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51485 primary records. [2025-10-07T22:38:10.526111] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-07T22:38:10.558856] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-07T22:38:10.558781] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-07T22:38:10.559169] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-07T22:38:10.559106] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-07T22:38:10.561413] [INFO ] [MAIN ] Derivative Progress: 647/1748 symbols completed. FDX took 1.2s. Estimated remaining: 7m 4s. Rate: 155.8 symbols/min [2025-10-07T22:38:10.563829] [INFO ] [MAIN ] Derivative Progress: 648/1748 symbols completed. FE took 1.2s. Estimated remaining: 7m 3s. Rate: 156.0 symbols/min [2025-10-07T22:38:10.563730] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:10.564098] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:10.590548] [DEBUG] [LOCAL ] FET: Loaded 12791 existing records from primary storage. [2025-10-07T22:38:10.590836] [INFO ] [MAIN ] FET: Loaded 12791 primary data records. [2025-10-07T22:38:10.719546] [DEBUG] [LOCAL ] FF: Loaded 24565 existing records from primary storage. [2025-10-07T22:38:10.731110] [DEBUG] [LOCAL ] FERG: Loaded 48782 existing records from primary storage. [2025-10-07T22:38:10.736331] [INFO ] [MAIN ] FF: Loaded 24565 primary data records. [2025-10-07T22:38:10.779828] [INFO ] [MAIN ] FERG: Loaded 48782 primary data records. [2025-10-07T22:38:11.534628] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:11.535977] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12791 primary records. [2025-10-07T22:38:11.536168] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-07T22:38:11.558888] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-07T22:38:11.572536] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-07T22:38:11.572909] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:11.575780] [INFO ] [MAIN ] Derivative Progress: 649/1748 symbols completed. FET took 1.0s. Estimated remaining: 7m 4s. Rate: 155.6 symbols/min [2025-10-07T22:38:11.576125] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:11.573809] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48782 primary records. [2025-10-07T22:38:11.577627] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-07T22:38:11.606169] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:11.616823] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 24565 primary records. [2025-10-07T22:38:11.618524] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-07T22:38:11.618919] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-07T22:38:11.624224] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-07T22:38:11.626675] [INFO ] [MAIN ] Derivative Progress: 650/1748 symbols completed. FERG took 1.1s. Estimated remaining: 7m 3s. Rate: 155.9 symbols/min [2025-10-07T22:38:11.634128] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:11.624148] [DEBUG] [LOCAL ] FFA: Loaded 5982 existing records from primary storage. [2025-10-07T22:38:11.634463] [INFO ] [MAIN ] FFA: Loaded 5982 primary data records. [2025-10-07T22:38:11.708870] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-07T22:38:11.740050] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-07T22:38:11.752724] [INFO ] [MAIN ] Derivative Progress: 651/1748 symbols completed. FF took 1.2s. Estimated remaining: 7m 2s. Rate: 156.0 symbols/min [2025-10-07T22:38:11.753006] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:11.785622] [DEBUG] [LOCAL ] FFC: Loaded 16682 existing records from primary storage. [2025-10-07T22:38:11.803998] [INFO ] [MAIN ] FFC: Loaded 16682 primary data records. [2025-10-07T22:38:12.314890] [DEBUG] [LOCAL ] FFWM: Loaded 35834 existing records from primary storage. [2025-10-07T22:38:12.315249] [INFO ] [MAIN ] FFWM: Loaded 35834 primary data records. [2025-10-07T22:38:12.648201] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:12.650448] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5982 primary records. [2025-10-07T22:38:12.650701] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-07T22:38:12.679786] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:12.681733] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16682 primary records. [2025-10-07T22:38:12.682612] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-07T22:38:12.699177] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-10-07T22:38:12.699636] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-07T22:38:12.701841] [INFO ] [MAIN ] Derivative Progress: 652/1748 symbols completed. FFA took 1.1s. Estimated remaining: 7m 2s. Rate: 155.7 symbols/min [2025-10-07T22:38:12.702735] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:12.708127] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-07T22:38:12.708262] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-07T22:38:12.710454] [INFO ] [MAIN ] Derivative Progress: 653/1748 symbols completed. FFC took 1.1s. Estimated remaining: 7m 1s. Rate: 155.9 symbols/min [2025-10-07T22:38:12.711243] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:12.730974] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:12.732075] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35834 primary records. [2025-10-07T22:38:12.734549] [DEBUG] [LOCAL ] FGN: Loaded 3819 existing records from primary storage. [2025-10-07T22:38:12.734769] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-07T22:38:12.735636] [INFO ] [MAIN ] FGN: Loaded 3819 primary data records. [2025-10-07T22:38:12.858902] [DEBUG] [LOCAL ] FG: Loaded 22959 existing records from primary storage. [2025-10-07T22:38:12.863982] [INFO ] [MAIN ] FG: Loaded 22959 primary data records. [2025-10-07T22:38:12.926313] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-10-07T22:38:12.926474] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-07T22:38:12.969256] [INFO ] [MAIN ] Derivative Progress: 654/1748 symbols completed. FFWM took 1.2s. Estimated remaining: 7m 1s. Rate: 156.0 symbols/min [2025-10-07T22:38:13.024184] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:13.429793] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:13.433014] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3819 primary records. [2025-10-07T22:38:13.433240] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-07T22:38:13.434499] [DEBUG] [LOCAL ] FHI: Loaded 39965 existing records from primary storage. [2025-10-07T22:38:13.435533] [INFO ] [MAIN ] FHI: Loaded 39965 primary data records. [2025-10-07T22:38:13.505353] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-07T22:38:13.548444] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-07T22:38:13.555804] [INFO ] [MAIN ] Derivative Progress: 655/1748 symbols completed. FGN took 0.8s. Estimated remaining: 7m 1s. Rate: 155.8 symbols/min [2025-10-07T22:38:13.566957] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:13.613144] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:13.648984] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22959 primary records. [2025-10-07T22:38:13.651700] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-07T22:38:13.796236] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-10-07T22:38:13.796916] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-07T22:38:13.799762] [INFO ] [MAIN ] Derivative Progress: 656/1748 symbols completed. FG took 1.1s. Estimated remaining: 7m 0s. Rate: 155.9 symbols/min [2025-10-07T22:38:13.800262] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:13.839612] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:13.840747] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 39965 primary records. [2025-10-07T22:38:13.840863] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-07T22:38:13.868255] [DEBUG] [LOCAL ] FHN: Loaded 53368 existing records from primary storage. [2025-10-07T22:38:13.868833] [INFO ] [MAIN ] FHN: Loaded 53368 primary data records. [2025-10-07T22:38:14.008395] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-10-07T22:38:14.043015] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-07T22:38:14.188592] [INFO ] [MAIN ] Derivative Progress: 657/1748 symbols completed. FHI took 1.2s. Estimated remaining: 6m 60s. Rate: 155.9 symbols/min [2025-10-07T22:38:14.197017] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:14.199687] [DEBUG] [LOCAL ] FI: Loaded 53526 existing records from primary storage. [2025-10-07T22:38:14.200007] [INFO ] [MAIN ] FI: Loaded 53526 primary data records. [2025-10-07T22:38:14.379350] [DEBUG] [LOCAL ] FICO: Loaded 21194 existing records from primary storage. [2025-10-07T22:38:14.436822] [INFO ] [MAIN ] FICO: Loaded 21194 primary data records. [2025-10-07T22:38:14.725275] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:14.758132] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53368 primary records. [2025-10-07T22:38:14.874710] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-07T22:38:14.897448] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-07T22:38:14.899156] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-07T22:38:14.901583] [INFO ] [MAIN ] Derivative Progress: 658/1748 symbols completed. FHN took 1.3s. Estimated remaining: 6m 60s. Rate: 155.7 symbols/min [2025-10-07T22:38:14.920223] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:14.922149] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53526 primary records. [2025-10-07T22:38:14.922239] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-07T22:38:14.941542] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-07T22:38:14.941865] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-07T22:38:14.944232] [INFO ] [MAIN ] Derivative Progress: 659/1748 symbols completed. FI took 1.1s. Estimated remaining: 6m 59s. Rate: 155.9 symbols/min [2025-10-07T22:38:14.960165] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:38:14.960837] [INFO ] [MAIN ] FICO: Generated 1793 derivative records from 21194 primary records. [2025-10-07T22:38:14.960899] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-07T22:38:14.976904] [DEBUG] [LOCAL ] FICO: Derivative data saved (1793 records). [2025-10-07T22:38:14.976984] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-07T22:38:14.979244] [INFO ] [MAIN ] Derivative Progress: 660/1748 symbols completed. FICO took 0.8s. Estimated remaining: 6m 58s. Rate: 156.2 symbols/min [2025-10-07T22:38:14.980125] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:14.980006] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:14.980286] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:14.994814] [DEBUG] [LOCAL ] FINS: Loaded 8266 existing records from primary storage. [2025-10-07T22:38:14.994991] [INFO ] [MAIN ] FINS: Loaded 8266 primary data records. [2025-10-07T22:38:15.323027] [DEBUG] [LOCAL ] FIHL: Loaded 39681 existing records from primary storage. [2025-10-07T22:38:15.336986] [INFO ] [MAIN ] FIHL: Loaded 39681 primary data records. [2025-10-07T22:38:15.349080] [DEBUG] [LOCAL ] FIGS: Loaded 48805 existing records from primary storage. [2025-10-07T22:38:15.374107] [INFO ] [MAIN ] FIGS: Loaded 48805 primary data records. [2025-10-07T22:38:15.960497] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:15.962355] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8266 primary records. [2025-10-07T22:38:15.962958] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-07T22:38:15.985387] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-07T22:38:15.985929] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-07T22:38:15.988191] [INFO ] [MAIN ] Derivative Progress: 661/1748 symbols completed. FINS took 1.0s. Estimated remaining: 6m 59s. Rate: 155.8 symbols/min [2025-10-07T22:38:15.988358] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:16.011632] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:16.012637] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39681 primary records. [2025-10-07T22:38:16.026237] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-07T22:38:16.027534] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:16.028531] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48805 primary records. [2025-10-07T22:38:16.028948] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-07T22:38:16.054130] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-07T22:38:16.060361] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-07T22:38:16.063049] [INFO ] [MAIN ] Derivative Progress: 662/1748 symbols completed. FIHL took 1.1s. Estimated remaining: 6m 58s. Rate: 156.0 symbols/min [2025-10-07T22:38:16.063680] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-07T22:38:16.063926] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:16.063809] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-07T22:38:16.066316] [INFO ] [MAIN ] Derivative Progress: 663/1748 symbols completed. FIGS took 1.1s. Estimated remaining: 6m 57s. Rate: 156.2 symbols/min [2025-10-07T22:38:16.066918] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:16.097192] [DEBUG] [LOCAL ] FINV: Loaded 45208 existing records from primary storage. [2025-10-07T22:38:16.097449] [INFO ] [MAIN ] FINV: Loaded 45208 primary data records. [2025-10-07T22:38:16.222697] [DEBUG] [LOCAL ] FIX: Loaded 29405 existing records from primary storage. [2025-10-07T22:38:16.253335] [INFO ] [MAIN ] FIX: Loaded 29405 primary data records. [2025-10-07T22:38:16.547955] [DEBUG] [LOCAL ] FIS: Loaded 53356 existing records from primary storage. [2025-10-07T22:38:16.570403] [INFO ] [MAIN ] FIS: Loaded 53356 primary data records. [2025-10-07T22:38:17.106290] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:17.107516] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45208 primary records. [2025-10-07T22:38:17.107668] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-07T22:38:17.140139] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:38:17.142085] [INFO ] [MAIN ] FIX: Generated 1793 derivative records from 29405 primary records. [2025-10-07T22:38:17.142684] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-07T22:38:17.143686] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-07T22:38:17.144113] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-07T22:38:17.146232] [INFO ] [MAIN ] Derivative Progress: 664/1748 symbols completed. FINV took 1.2s. Estimated remaining: 6m 58s. Rate: 155.8 symbols/min [2025-10-07T22:38:17.146557] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:17.169377] [DEBUG] [LOCAL ] FLC: Loaded 5372 existing records from primary storage. [2025-10-07T22:38:17.183463] [INFO ] [MAIN ] FLC: Loaded 5372 primary data records. [2025-10-07T22:38:17.215924] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:17.229258] [DEBUG] [LOCAL ] FIX: Derivative data saved (1793 records). [2025-10-07T22:38:17.242756] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53356 primary records. [2025-10-07T22:38:17.257062] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-07T22:38:17.256951] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-07T22:38:17.288910] [INFO ] [MAIN ] Derivative Progress: 665/1748 symbols completed. FIX took 1.2s. Estimated remaining: 6m 57s. Rate: 155.9 symbols/min [2025-10-07T22:38:17.293413] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:17.513778] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-07T22:38:17.514619] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-07T22:38:17.516859] [INFO ] [MAIN ] Derivative Progress: 666/1748 symbols completed. FIS took 1.5s. Estimated remaining: 6m 56s. Rate: 156.0 symbols/min [2025-10-07T22:38:17.517064] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:17.571172] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:17.572140] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5372 primary records. [2025-10-07T22:38:17.572331] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-07T22:38:17.600799] [DEBUG] [LOCAL ] FLG: Loaded 53331 existing records from primary storage. [2025-10-07T22:38:17.609779] [INFO ] [MAIN ] FLG: Loaded 53331 primary data records. [2025-10-07T22:38:17.617477] [DEBUG] [LOCAL ] FLNG: Loaded 33596 existing records from primary storage. [2025-10-07T22:38:17.617584] [INFO ] [MAIN ] FLNG: Loaded 33596 primary data records. [2025-10-07T22:38:17.713706] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-07T22:38:17.715740] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-07T22:38:17.766192] [INFO ] [MAIN ] Derivative Progress: 667/1748 symbols completed. FLC took 0.6s. Estimated remaining: 6m 56s. Rate: 156.1 symbols/min [2025-10-07T22:38:17.798551] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:18.305372] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:18.308674] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33596 primary records. [2025-10-07T22:38:18.323237] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-07T22:38:18.338435] [DEBUG] [LOCAL ] FLO: Loaded 51949 existing records from primary storage. [2025-10-07T22:38:18.338832] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:18.347167] [INFO ] [MAIN ] FLO: Loaded 51949 primary data records. [2025-10-07T22:38:18.339797] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53331 primary records. [2025-10-07T22:38:18.350840] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-07T22:38:18.477090] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-07T22:38:18.488068] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-07T22:38:18.500609] [INFO ] [MAIN ] Derivative Progress: 668/1748 symbols completed. FLNG took 1.0s. Estimated remaining: 6m 56s. Rate: 155.9 symbols/min [2025-10-07T22:38:18.515389] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:18.516472] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-07T22:38:18.525245] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-07T22:38:18.559587] [INFO ] [MAIN ] Derivative Progress: 669/1748 symbols completed. FLG took 1.3s. Estimated remaining: 6m 55s. Rate: 156.1 symbols/min [2025-10-07T22:38:18.679799] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:18.714529] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:18.730152] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51949 primary records. [2025-10-07T22:38:18.739744] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-07T22:38:18.787058] [DEBUG] [LOCAL ] FLS: Loaded 50242 existing records from primary storage. [2025-10-07T22:38:18.787693] [INFO ] [MAIN ] FLS: Loaded 50242 primary data records. [2025-10-07T22:38:18.789135] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-07T22:38:18.806556] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-07T22:38:18.801509] [DEBUG] [LOCAL ] FLR: Loaded 53161 existing records from primary storage. [2025-10-07T22:38:18.840908] [INFO ] [MAIN ] FLR: Loaded 53161 primary data records. [2025-10-07T22:38:18.843047] [INFO ] [MAIN ] Derivative Progress: 670/1748 symbols completed. FLO took 1.0s. Estimated remaining: 6m 54s. Rate: 156.1 symbols/min [2025-10-07T22:38:18.906271] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:19.457289] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:19.458813] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50242 primary records. [2025-10-07T22:38:19.471720] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-07T22:38:19.477145] [DEBUG] [LOCAL ] FLUT: Loaded 50783 existing records from primary storage. [2025-10-07T22:38:19.486595] [INFO ] [MAIN ] FLUT: Loaded 50783 primary data records. [2025-10-07T22:38:19.573174] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:38:19.580632] [INFO ] [MAIN ] FLR: Generated 1793 derivative records from 53161 primary records. [2025-10-07T22:38:19.591806] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-07T22:38:19.610936] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-10-07T22:38:19.633799] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-07T22:38:19.704726] [INFO ] [MAIN ] Derivative Progress: 671/1748 symbols completed. FLS took 1.0s. Estimated remaining: 6m 55s. Rate: 155.9 symbols/min [2025-10-07T22:38:19.706610] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:19.736631] [DEBUG] [LOCAL ] FLR: Derivative data saved (1793 records). [2025-10-07T22:38:19.827850] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-07T22:38:19.830868] [INFO ] [MAIN ] Derivative Progress: 672/1748 symbols completed. FLR took 1.3s. Estimated remaining: 6m 54s. Rate: 156.0 symbols/min [2025-10-07T22:38:19.831073] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:19.859939] [DEBUG] [LOCAL ] FLXR: Loaded 20685 existing records from primary storage. [2025-10-07T22:38:19.873350] [INFO ] [MAIN ] FLXR: Loaded 20685 primary data records. [2025-10-07T22:38:19.874008] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:19.910862] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50783 primary records. [2025-10-07T22:38:19.930116] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-07T22:38:20.094866] [DEBUG] [LOCAL ] FMC: Loaded 51806 existing records from primary storage. [2025-10-07T22:38:20.246710] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-07T22:38:20.252127] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-07T22:38:20.245746] [INFO ] [MAIN ] FMC: Loaded 51806 primary data records. [2025-10-07T22:38:20.262734] [INFO ] [MAIN ] Derivative Progress: 673/1748 symbols completed. FLUT took 1.4s. Estimated remaining: 6m 54s. Rate: 156.0 symbols/min [2025-10-07T22:38:20.596795] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:20.598024] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 20685 primary records. [2025-10-07T22:38:20.598288] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-07T22:38:20.615675] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-10-07T22:38:20.615870] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-07T22:38:20.618160] [INFO ] [MAIN ] Derivative Progress: 674/1748 symbols completed. FLXR took 0.9s. Estimated remaining: 6m 53s. Rate: 156.0 symbols/min [2025-10-07T22:38:20.634822] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:20.635475] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51806 primary records. [2025-10-07T22:38:20.635535] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-07T22:38:20.651363] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-07T22:38:20.651433] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-07T22:38:20.653633] [INFO ] [MAIN ] Derivative Progress: 675/1748 symbols completed. FMC took 0.8s. Estimated remaining: 6m 52s. Rate: 156.2 symbols/min [2025-10-07T22:38:20.654257] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:20.654357] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:20.654513] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:20.664637] [DEBUG] [LOCAL ] FMN: Loaded 5266 existing records from primary storage. [2025-10-07T22:38:20.664925] [INFO ] [MAIN ] FMN: Loaded 5266 primary data records. [2025-10-07T22:38:21.001154] [DEBUG] [LOCAL ] FMS: Loaded 29997 existing records from primary storage. [2025-10-07T22:38:21.002356] [INFO ] [MAIN ] FMS: Loaded 29997 primary data records. [2025-10-07T22:38:21.077858] [DEBUG] [LOCAL ] FMX: Loaded 40660 existing records from primary storage. [2025-10-07T22:38:21.105814] [INFO ] [MAIN ] FMX: Loaded 40660 primary data records. [2025-10-07T22:38:21.677872] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:21.679585] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5266 primary records. [2025-10-07T22:38:21.680666] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-07T22:38:21.702609] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-07T22:38:21.702833] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-07T22:38:21.705054] [INFO ] [MAIN ] Derivative Progress: 676/1748 symbols completed. FMN took 1.1s. Estimated remaining: 6m 53s. Rate: 155.8 symbols/min [2025-10-07T22:38:21.705356] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:21.719454] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:21.720368] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 29997 primary records. [2025-10-07T22:38:21.720595] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-07T22:38:21.735473] [DEBUG] [LOCAL ] FMY: Loaded 1385 existing records from primary storage. [2025-10-07T22:38:21.736403] [INFO ] [MAIN ] FMY: Loaded 1385 primary data records. [2025-10-07T22:38:21.839411] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:21.845334] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40660 primary records. [2025-10-07T22:38:21.851563] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-07T22:38:21.851667] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-07T22:38:21.859892] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-07T22:38:21.884537] [INFO ] [MAIN ] Derivative Progress: 677/1748 symbols completed. FMS took 1.2s. Estimated remaining: 6m 52s. Rate: 155.9 symbols/min [2025-10-07T22:38:21.895624] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:21.906538] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-07T22:38:21.920920] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-07T22:38:21.934954] [INFO ] [MAIN ] Derivative Progress: 678/1748 symbols completed. FMX took 1.3s. Estimated remaining: 6m 51s. Rate: 156.1 symbols/min [2025-10-07T22:38:21.940679] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:22.146293] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:22.169610] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1385 primary records. [2025-10-07T22:38:22.169831] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-07T22:38:22.171147] [DEBUG] [LOCAL ] FN: Loaded 38245 existing records from primary storage. [2025-10-07T22:38:22.176912] [INFO ] [MAIN ] FN: Loaded 38245 primary data records. [2025-10-07T22:38:22.253797] [DEBUG] [LOCAL ] FNB: Loaded 52527 existing records from primary storage. [2025-10-07T22:38:22.268940] [INFO ] [MAIN ] FNB: Loaded 52527 primary data records. [2025-10-07T22:38:22.283087] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-10-07T22:38:22.351722] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-07T22:38:22.402251] [INFO ] [MAIN ] Derivative Progress: 679/1748 symbols completed. FMY took 0.7s. Estimated remaining: 6m 51s. Rate: 156.1 symbols/min [2025-10-07T22:38:22.413429] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:22.917783] [DEBUG] [LOCAL ] FND: Loaded 52089 existing records from primary storage. [2025-10-07T22:38:22.918590] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:22.919465] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 38245 primary records. [2025-10-07T22:38:22.919690] [INFO ] [MAIN ] FND: Loaded 52089 primary data records. [2025-10-07T22:38:22.920893] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-07T22:38:23.046112] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:23.055374] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52527 primary records. [2025-10-07T22:38:23.059212] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-07T22:38:23.154603] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-07T22:38:23.274529] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-07T22:38:23.277166] [INFO ] [MAIN ] Derivative Progress: 680/1748 symbols completed. FN took 1.4s. Estimated remaining: 6m 51s. Rate: 155.8 symbols/min [2025-10-07T22:38:23.281055] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:23.284748] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-07T22:38:23.285478] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-07T22:38:23.287448] [INFO ] [MAIN ] Derivative Progress: 681/1748 symbols completed. FNB took 1.3s. Estimated remaining: 6m 50s. Rate: 156.0 symbols/min [2025-10-07T22:38:23.287832] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:23.316480] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:23.317391] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52089 primary records. [2025-10-07T22:38:23.317537] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-07T22:38:23.348258] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-07T22:38:23.348418] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-07T22:38:23.350439] [INFO ] [MAIN ] Derivative Progress: 682/1748 symbols completed. FND took 0.9s. Estimated remaining: 6m 49s. Rate: 156.2 symbols/min [2025-10-07T22:38:23.350731] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:23.378264] [DEBUG] [LOCAL ] FNF: Loaded 48940 existing records from primary storage. [2025-10-07T22:38:23.378543] [INFO ] [MAIN ] FNF: Loaded 48940 primary data records. [2025-10-07T22:38:23.510147] [DEBUG] [LOCAL ] FOA: Loaded 13075 existing records from primary storage. [2025-10-07T22:38:23.532226] [INFO ] [MAIN ] FOA: Loaded 13075 primary data records. [2025-10-07T22:38:23.532130] [DEBUG] [LOCAL ] FNV: Loaded 46152 existing records from primary storage. [2025-10-07T22:38:23.559436] [INFO ] [MAIN ] FNV: Loaded 46152 primary data records. [2025-10-07T22:38:24.470529] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:24.471403] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:24.473002] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 48940 primary records. [2025-10-07T22:38:24.473121] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-07T22:38:24.472201] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13075 primary records. [2025-10-07T22:38:24.475314] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-07T22:38:24.518068] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:24.520114] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46152 primary records. [2025-10-07T22:38:24.521019] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-07T22:38:24.537163] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-10-07T22:38:24.541830] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-07T22:38:24.543977] [INFO ] [MAIN ] Derivative Progress: 683/1748 symbols completed. FNF took 1.3s. Estimated remaining: 6m 50s. Rate: 155.7 symbols/min [2025-10-07T22:38:24.541486] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-10-07T22:38:24.544452] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:24.545810] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-07T22:38:24.548314] [INFO ] [MAIN ] Derivative Progress: 684/1748 symbols completed. FNV took 1.3s. Estimated remaining: 6m 49s. Rate: 156.0 symbols/min [2025-10-07T22:38:24.548443] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-07T22:38:24.549115] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:24.548754] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-07T22:38:24.551196] [INFO ] [MAIN ] Derivative Progress: 685/1748 symbols completed. FOA took 1.2s. Estimated remaining: 6m 48s. Rate: 156.2 symbols/min [2025-10-07T22:38:24.551829] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:24.562914] [DEBUG] [LOCAL ] FOF: Loaded 8500 existing records from primary storage. [2025-10-07T22:38:24.563074] [INFO ] [MAIN ] FOF: Loaded 8500 primary data records. [2025-10-07T22:38:24.687136] [DEBUG] [LOCAL ] FOR: Loaded 19691 existing records from primary storage. [2025-10-07T22:38:24.687442] [INFO ] [MAIN ] FOR: Loaded 19691 primary data records. [2025-10-07T22:38:25.059355] [DEBUG] [LOCAL ] FOUR: Loaded 49599 existing records from primary storage. [2025-10-07T22:38:25.068600] [INFO ] [MAIN ] FOUR: Loaded 49599 primary data records. [2025-10-07T22:38:25.540834] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:25.542169] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8500 primary records. [2025-10-07T22:38:25.543018] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-07T22:38:25.572397] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:25.573715] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19691 primary records. [2025-10-07T22:38:25.574320] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-07T22:38:25.592545] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-10-07T22:38:25.593592] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-07T22:38:25.596273] [INFO ] [MAIN ] Derivative Progress: 686/1748 symbols completed. FOF took 1.1s. Estimated remaining: 6m 49s. Rate: 155.8 symbols/min [2025-10-07T22:38:25.598787] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:25.600227] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-07T22:38:25.600988] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-07T22:38:25.603089] [INFO ] [MAIN ] Derivative Progress: 687/1748 symbols completed. FOR took 1.1s. Estimated remaining: 6m 48s. Rate: 156.0 symbols/min [2025-10-07T22:38:25.611291] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:25.617397] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:25.618824] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49599 primary records. [2025-10-07T22:38:25.618924] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-07T22:38:25.647726] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-07T22:38:25.647992] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-07T22:38:25.650074] [INFO ] [MAIN ] Derivative Progress: 688/1748 symbols completed. FOUR took 1.1s. Estimated remaining: 6m 47s. Rate: 156.2 symbols/min [2025-10-07T22:38:25.662800] [DEBUG] [LOCAL ] FPF: Loaded 18492 existing records from primary storage. [2025-10-07T22:38:25.662923] [INFO ] [MAIN ] FPF: Loaded 18492 primary data records. [2025-10-07T22:38:25.663221] [DEBUG] [LOCAL ] FPH: Loaded 19275 existing records from primary storage. [2025-10-07T22:38:25.663367] [INFO ] [MAIN ] FPH: Loaded 19275 primary data records. [2025-10-07T22:38:26.323944] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:26.324876] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19275 primary records. [2025-10-07T22:38:26.337538] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-07T22:38:26.337781] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:26.338678] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18492 primary records. [2025-10-07T22:38:26.338883] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-07T22:38:26.369603] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-07T22:38:26.370211] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-07T22:38:26.372418] [INFO ] [MAIN ] Derivative Progress: 689/1748 symbols completed. FPH took 0.8s. Estimated remaining: 6m 47s. Rate: 156.0 symbols/min [2025-10-07T22:38:26.372887] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-07T22:38:26.372979] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-07T22:38:26.375343] [INFO ] [MAIN ] Derivative Progress: 690/1748 symbols completed. FPF took 0.8s. Estimated remaining: 6m 46s. Rate: 156.2 symbols/min [2025-10-07T22:38:26.375805] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:26.375735] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:26.376017] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:26.397831] [DEBUG] [LOCAL ] FRA: Loaded 14607 existing records from primary storage. [2025-10-07T22:38:26.398217] [INFO ] [MAIN ] FRA: Loaded 14607 primary data records. [2025-10-07T22:38:26.725628] [DEBUG] [LOCAL ] FPI: Loaded 31067 existing records from primary storage. [2025-10-07T22:38:26.739630] [DEBUG] [LOCAL ] FR: Loaded 46429 existing records from primary storage. [2025-10-07T22:38:26.740474] [INFO ] [MAIN ] FR: Loaded 46429 primary data records. [2025-10-07T22:38:26.740604] [INFO ] [MAIN ] FPI: Loaded 31067 primary data records. [2025-10-07T22:38:27.399113] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:27.401428] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14607 primary records. [2025-10-07T22:38:27.402861] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-07T22:38:27.429570] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-07T22:38:27.429870] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-07T22:38:27.433622] [INFO ] [MAIN ] Derivative Progress: 691/1748 symbols completed. FRA took 1.1s. Estimated remaining: 6m 47s. Rate: 155.8 symbols/min [2025-10-07T22:38:27.434242] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:27.453901] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:27.462567] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46429 primary records. [2025-10-07T22:38:27.467880] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:27.473197] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31067 primary records. [2025-10-07T22:38:27.472508] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-07T22:38:27.473372] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-07T22:38:27.507845] [DEBUG] [LOCAL ] FRGE: Loaded 16981 existing records from primary storage. [2025-10-07T22:38:27.509243] [INFO ] [MAIN ] FRGE: Loaded 16981 primary data records. [2025-10-07T22:38:27.577292] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-07T22:38:27.589171] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-10-07T22:38:27.594425] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-07T22:38:27.596736] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-07T22:38:27.596592] [INFO ] [MAIN ] Derivative Progress: 692/1748 symbols completed. FR took 1.2s. Estimated remaining: 6m 46s. Rate: 156.0 symbols/min [2025-10-07T22:38:27.609565] [INFO ] [MAIN ] Derivative Progress: 693/1748 symbols completed. FPI took 1.2s. Estimated remaining: 6m 45s. Rate: 156.2 symbols/min [2025-10-07T22:38:27.604080] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:27.618368] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:27.872758] [DEBUG] [LOCAL ] FRT: Loaded 41989 existing records from primary storage. [2025-10-07T22:38:27.873797] [INFO ] [MAIN ] FRT: Loaded 41989 primary data records. [2025-10-07T22:38:27.897357] [DEBUG] [LOCAL ] FRO: Loaded 51679 existing records from primary storage. [2025-10-07T22:38:27.915473] [INFO ] [MAIN ] FRO: Loaded 51679 primary data records. [2025-10-07T22:38:28.013962] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:28.025524] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 16981 primary records. [2025-10-07T22:38:28.032483] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-07T22:38:28.466074] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-10-07T22:38:28.474676] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-07T22:38:28.477256] [INFO ] [MAIN ] Derivative Progress: 694/1748 symbols completed. FRGE took 1.0s. Estimated remaining: 6m 46s. Rate: 155.9 symbols/min [2025-10-07T22:38:28.589002] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:28.625947] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:28.627058] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41989 primary records. [2025-10-07T22:38:28.627387] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-07T22:38:28.644461] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-07T22:38:28.644818] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-07T22:38:28.646690] [INFO ] [MAIN ] Derivative Progress: 695/1748 symbols completed. FRT took 1.0s. Estimated remaining: 6m 45s. Rate: 156.0 symbols/min [2025-10-07T22:38:28.646953] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:28.673677] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:28.674771] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51679 primary records. [2025-10-07T22:38:28.675456] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-07T22:38:28.699581] [DEBUG] [LOCAL ] FSCO: Loaded 37940 existing records from primary storage. [2025-10-07T22:38:28.700774] [INFO ] [MAIN ] FSCO: Loaded 37940 primary data records. [2025-10-07T22:38:28.747804] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-07T22:38:28.748024] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-07T22:38:28.770909] [INFO ] [MAIN ] Derivative Progress: 696/1748 symbols completed. FRO took 1.2s. Estimated remaining: 6m 44s. Rate: 156.2 symbols/min [2025-10-07T22:38:28.777726] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:29.042754] [DEBUG] [LOCAL ] FSK: Loaded 49404 existing records from primary storage. [2025-10-07T22:38:29.043049] [INFO ] [MAIN ] FSK: Loaded 49404 primary data records. [2025-10-07T22:38:29.379212] [DEBUG] [LOCAL ] FSLY: Loaded 51244 existing records from primary storage. [2025-10-07T22:38:29.388365] [INFO ] [MAIN ] FSLY: Loaded 51244 primary data records. [2025-10-07T22:38:29.568977] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:29.592100] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 37940 primary records. [2025-10-07T22:38:29.715155] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-07T22:38:29.736917] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-07T22:38:29.738760] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-07T22:38:29.743152] [INFO ] [MAIN ] Derivative Progress: 697/1748 symbols completed. FSCO took 1.2s. Estimated remaining: 6m 45s. Rate: 155.8 symbols/min [2025-10-07T22:38:29.744206] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:29.765362] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:29.766584] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49404 primary records. [2025-10-07T22:38:29.766703] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-07T22:38:29.785872] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-07T22:38:29.787303] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-07T22:38:29.791106] [INFO ] [MAIN ] Derivative Progress: 698/1748 symbols completed. FSK took 1.1s. Estimated remaining: 6m 44s. Rate: 156.0 symbols/min [2025-10-07T22:38:29.791677] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:29.807118] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:29.808362] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51244 primary records. [2025-10-07T22:38:29.808551] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-07T22:38:29.844386] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-07T22:38:29.844766] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-07T22:38:29.847984] [INFO ] [MAIN ] Derivative Progress: 699/1748 symbols completed. FSLY took 1.1s. Estimated remaining: 6m 43s. Rate: 156.2 symbols/min [2025-10-07T22:38:29.849602] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:29.869471] [DEBUG] [LOCAL ] FSM: Loaded 53294 existing records from primary storage. [2025-10-07T22:38:29.881378] [INFO ] [MAIN ] FSM: Loaded 53294 primary data records. [2025-10-07T22:38:29.935167] [DEBUG] [LOCAL ] FT: Loaded 6560 existing records from primary storage. [2025-10-07T22:38:29.986496] [INFO ] [MAIN ] FT: Loaded 6560 primary data records. [2025-10-07T22:38:30.093956] [DEBUG] [LOCAL ] FSS: Loaded 33992 existing records from primary storage. [2025-10-07T22:38:30.127356] [INFO ] [MAIN ] FSS: Loaded 33992 primary data records. [2025-10-07T22:38:31.192173] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:31.193415] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53294 primary records. [2025-10-07T22:38:31.193903] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-07T22:38:31.237069] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-10-07T22:38:31.236585] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:31.238117] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6560 primary records. [2025-10-07T22:38:31.237349] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-07T22:38:31.238269] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-07T22:38:31.252877] [INFO ] [MAIN ] Derivative Progress: 700/1748 symbols completed. FSM took 1.5s. Estimated remaining: 6m 44s. Rate: 155.6 symbols/min [2025-10-07T22:38:31.253461] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:31.261043] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:31.261824] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 33992 primary records. [2025-10-07T22:38:31.262004] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-07T22:38:31.287022] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-10-07T22:38:31.291416] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-07T22:38:31.293445] [INFO ] [MAIN ] Derivative Progress: 701/1748 symbols completed. FT took 1.4s. Estimated remaining: 6m 43s. Rate: 155.8 symbols/min [2025-10-07T22:38:31.293828] [DEBUG] [LOCAL ] FTHY: Loaded 12266 existing records from primary storage. [2025-10-07T22:38:31.293936] [INFO ] [MAIN ] FTHY: Loaded 12266 primary data records. [2025-10-07T22:38:31.294054] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:31.338811] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-07T22:38:31.359573] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-07T22:38:31.376603] [INFO ] [MAIN ] Derivative Progress: 702/1748 symbols completed. FSS took 1.6s. Estimated remaining: 6m 42s. Rate: 156.0 symbols/min [2025-10-07T22:38:31.393812] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:31.675325] [DEBUG] [LOCAL ] FTK: Loaded 32577 existing records from primary storage. [2025-10-07T22:38:31.676469] [INFO ] [MAIN ] FTK: Loaded 32577 primary data records. [2025-10-07T22:38:31.688633] [DEBUG] [LOCAL ] FTI: Loaded 53292 existing records from primary storage. [2025-10-07T22:38:31.688786] [INFO ] [MAIN ] FTI: Loaded 53292 primary data records. [2025-10-07T22:38:32.313848] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:32.315748] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 12266 primary records. [2025-10-07T22:38:32.316538] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-07T22:38:32.339997] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-07T22:38:32.340587] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-07T22:38:32.345095] [INFO ] [MAIN ] Derivative Progress: 703/1748 symbols completed. FTHY took 1.1s. Estimated remaining: 6m 43s. Rate: 155.7 symbols/min [2025-10-07T22:38:32.359367] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:32.361500] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32577 primary records. [2025-10-07T22:38:32.362280] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-07T22:38:32.376090] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:32.385115] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53292 primary records. [2025-10-07T22:38:32.387849] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-07T22:38:32.409082] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-07T22:38:32.410226] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-07T22:38:32.412240] [INFO ] [MAIN ] Derivative Progress: 704/1748 symbols completed. FTK took 1.0s. Estimated remaining: 6m 42s. Rate: 155.9 symbols/min [2025-10-07T22:38:32.410323] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-07T22:38:32.412616] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-07T22:38:32.414601] [INFO ] [MAIN ] Derivative Progress: 705/1748 symbols completed. FTI took 1.1s. Estimated remaining: 6m 41s. Rate: 156.1 symbols/min [2025-10-07T22:38:32.415096] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:32.415236] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:32.415037] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:32.421138] [DEBUG] [LOCAL ] FTWO: Loaded 1866 existing records from primary storage. [2025-10-07T22:38:32.421332] [INFO ] [MAIN ] FTWO: Loaded 1866 primary data records. [2025-10-07T22:38:32.815434] [DEBUG] [LOCAL ] FTS: Loaded 42398 existing records from primary storage. [2025-10-07T22:38:32.830107] [INFO ] [MAIN ] FTS: Loaded 42398 primary data records. [2025-10-07T22:38:32.832834] [DEBUG] [LOCAL ] FTV: Loaded 52985 existing records from primary storage. [2025-10-07T22:38:32.872975] [INFO ] [MAIN ] FTV: Loaded 52985 primary data records. [2025-10-07T22:38:33.480800] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:38:33.482690] [INFO ] [MAIN ] FTWO: Generated 1792 derivative records from 1866 primary records. [2025-10-07T22:38:33.483910] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-07T22:38:33.503880] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1792 records). [2025-10-07T22:38:33.504511] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-07T22:38:33.506769] [INFO ] [MAIN ] Derivative Progress: 706/1748 symbols completed. FTWO took 1.1s. Estimated remaining: 6m 42s. Rate: 155.7 symbols/min [2025-10-07T22:38:33.507026] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:33.527631] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:33.540973] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42398 primary records. [2025-10-07T22:38:33.541079] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-07T22:38:33.549606] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:33.551712] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52985 primary records. [2025-10-07T22:38:33.554431] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-07T22:38:33.572486] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-07T22:38:33.573083] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-07T22:38:33.575432] [INFO ] [MAIN ] Derivative Progress: 707/1748 symbols completed. FTV took 1.2s. Estimated remaining: 6m 41s. Rate: 155.8 symbols/min [2025-10-07T22:38:33.575952] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:33.579686] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-07T22:38:33.579831] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-07T22:38:33.581763] [INFO ] [MAIN ] Derivative Progress: 708/1748 symbols completed. FTS took 1.2s. Estimated remaining: 6m 40s. Rate: 156.1 symbols/min [2025-10-07T22:38:33.595955] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:33.626797] [DEBUG] [LOCAL ] FUBO: Loaded 53701 existing records from primary storage. [2025-10-07T22:38:33.627070] [INFO ] [MAIN ] FUBO: Loaded 53701 primary data records. [2025-10-07T22:38:33.713128] [DEBUG] [LOCAL ] FUL: Loaded 32878 existing records from primary storage. [2025-10-07T22:38:33.752810] [INFO ] [MAIN ] FUL: Loaded 32878 primary data records. [2025-10-07T22:38:34.092356] [DEBUG] [LOCAL ] FUN: Loaded 51731 existing records from primary storage. [2025-10-07T22:38:34.098505] [INFO ] [MAIN ] FUN: Loaded 51731 primary data records. [2025-10-07T22:38:34.663214] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:34.664482] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53701 primary records. [2025-10-07T22:38:34.664675] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-07T22:38:34.700579] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-07T22:38:34.700857] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-07T22:38:34.703132] [INFO ] [MAIN ] Derivative Progress: 709/1748 symbols completed. FUBO took 1.2s. Estimated remaining: 6m 41s. Rate: 155.6 symbols/min [2025-10-07T22:38:34.700505] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:34.704316] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32878 primary records. [2025-10-07T22:38:34.704616] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-07T22:38:34.704540] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:34.725587] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-07T22:38:34.727426] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-07T22:38:34.729873] [INFO ] [MAIN ] Derivative Progress: 710/1748 symbols completed. FUL took 1.2s. Estimated remaining: 6m 40s. Rate: 155.8 symbols/min [2025-10-07T22:38:34.730210] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:34.750031] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:34.750955] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51731 primary records. [2025-10-07T22:38:34.751111] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-07T22:38:34.774552] [DEBUG] [LOCAL ] FVR: Loaded 21680 existing records from primary storage. [2025-10-07T22:38:34.775992] [INFO ] [MAIN ] FVR: Loaded 21680 primary data records. [2025-10-07T22:38:34.775909] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-07T22:38:34.776208] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-07T22:38:34.779511] [INFO ] [MAIN ] Derivative Progress: 711/1748 symbols completed. FUN took 1.2s. Estimated remaining: 6m 39s. Rate: 156.0 symbols/min [2025-10-07T22:38:34.791277] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:34.891624] [DEBUG] [LOCAL ] FXED: Loaded 1252 existing records from primary storage. [2025-10-07T22:38:34.897838] [INFO ] [MAIN ] FXED: Loaded 1252 primary data records. [2025-10-07T22:38:35.101157] [DEBUG] [LOCAL ] FVRR: Loaded 40180 existing records from primary storage. [2025-10-07T22:38:35.250208] [INFO ] [MAIN ] FVRR: Loaded 40180 primary data records. [2025-10-07T22:38:35.791143] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:35.792224] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 21680 primary records. [2025-10-07T22:38:35.792465] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-07T22:38:35.827865] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-07T22:38:35.828016] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-07T22:38:35.827740] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-07T22:38:35.831353] [INFO ] [MAIN ] FXED: Generated 1790 derivative records from 1252 primary records. [2025-10-07T22:38:35.831593] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-07T22:38:35.830211] [INFO ] [MAIN ] Derivative Progress: 712/1748 symbols completed. FVR took 1.1s. Estimated remaining: 6m 39s. Rate: 155.7 symbols/min [2025-10-07T22:38:35.833005] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:35.851216] [DEBUG] [LOCAL ] FXED: Derivative data saved (1790 records). [2025-10-07T22:38:35.851598] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-07T22:38:35.867582] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:35.867205] [INFO ] [MAIN ] Derivative Progress: 713/1748 symbols completed. FXED took 1.1s. Estimated remaining: 6m 38s. Rate: 155.9 symbols/min [2025-10-07T22:38:35.868707] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:35.868434] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40180 primary records. [2025-10-07T22:38:35.869168] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-07T22:38:35.887160] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-07T22:38:35.887312] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-07T22:38:35.889361] [INFO ] [MAIN ] Derivative Progress: 714/1748 symbols completed. FVRR took 1.2s. Estimated remaining: 6m 38s. Rate: 156.1 symbols/min [2025-10-07T22:38:35.889615] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:35.914110] [DEBUG] [LOCAL ] GAM: Loaded 4015 existing records from primary storage. [2025-10-07T22:38:35.914306] [INFO ] [MAIN ] GAM: Loaded 4015 primary data records. [2025-10-07T22:38:36.043534] [DEBUG] [LOCAL ] GAB: Loaded 27802 existing records from primary storage. [2025-10-07T22:38:36.050335] [DEBUG] [LOCAL ] G: Loaded 49989 existing records from primary storage. [2025-10-07T22:38:36.044067] [INFO ] [MAIN ] GAB: Loaded 27802 primary data records. [2025-10-07T22:38:36.050502] [INFO ] [MAIN ] G: Loaded 49989 primary data records. [2025-10-07T22:38:36.966779] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:36.968259] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4015 primary records. [2025-10-07T22:38:36.968756] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-07T22:38:36.997583] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:37.000288] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49989 primary records. [2025-10-07T22:38:37.002484] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-07T22:38:37.004834] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-10-07T22:38:37.020265] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-07T22:38:37.035486] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-07T22:38:37.036000] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:37.036062] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-07T22:38:37.033890] [INFO ] [MAIN ] Derivative Progress: 715/1748 symbols completed. GAM took 1.1s. Estimated remaining: 6m 38s. Rate: 155.6 symbols/min [2025-10-07T22:38:37.039224] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:37.039331] [INFO ] [MAIN ] Derivative Progress: 716/1748 symbols completed. G took 1.2s. Estimated remaining: 6m 37s. Rate: 155.8 symbols/min [2025-10-07T22:38:37.039088] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27802 primary records. [2025-10-07T22:38:37.039731] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:37.039615] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-07T22:38:37.059110] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-07T22:38:37.059250] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-07T22:38:37.062055] [INFO ] [MAIN ] Derivative Progress: 717/1748 symbols completed. GAB took 1.2s. Estimated remaining: 6m 36s. Rate: 156.1 symbols/min [2025-10-07T22:38:37.062322] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:37.086818] [DEBUG] [LOCAL ] GATX: Loaded 18153 existing records from primary storage. [2025-10-07T22:38:37.087043] [INFO ] [MAIN ] GATX: Loaded 18153 primary data records. [2025-10-07T22:38:37.148257] [DEBUG] [LOCAL ] GBAB: Loaded 13001 existing records from primary storage. [2025-10-07T22:38:37.157940] [INFO ] [MAIN ] GBAB: Loaded 13001 primary data records. [2025-10-07T22:38:37.592391] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-07T22:38:37.607861] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-07T22:38:38.063569] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:38.066418] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18153 primary records. [2025-10-07T22:38:38.074702] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-07T22:38:38.089111] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:38.094632] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 13001 primary records. [2025-10-07T22:38:38.095104] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-07T22:38:38.113489] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-10-07T22:38:38.114821] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-07T22:38:38.117723] [INFO ] [MAIN ] Derivative Progress: 718/1748 symbols completed. GBAB took 1.1s. Estimated remaining: 6m 37s. Rate: 155.7 symbols/min [2025-10-07T22:38:38.122342] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-07T22:38:38.122624] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-07T22:38:38.125119] [INFO ] [MAIN ] Derivative Progress: 719/1748 symbols completed. GATX took 1.1s. Estimated remaining: 6m 36s. Rate: 155.9 symbols/min [2025-10-07T22:38:38.138944] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:38.139554] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53653 primary records. [2025-10-07T22:38:38.139614] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-07T22:38:38.155154] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-07T22:38:38.155214] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-07T22:38:38.157967] [INFO ] [MAIN ] Derivative Progress: 720/1748 symbols completed. GAP took 1.1s. Estimated remaining: 6m 35s. Rate: 156.1 symbols/min [2025-10-07T22:38:38.158434] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:38.158370] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:38.158555] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:38.213953] [DEBUG] [LOCAL ] GBTG: Loaded 40073 existing records from primary storage. [2025-10-07T22:38:38.214570] [INFO ] [MAIN ] GBTG: Loaded 40073 primary data records. [2025-10-07T22:38:38.313717] [DEBUG] [LOCAL ] GBCI: Loaded 40500 existing records from primary storage. [2025-10-07T22:38:38.302027] [DEBUG] [LOCAL ] GBX: Loaded 29133 existing records from primary storage. [2025-10-07T22:38:38.332330] [INFO ] [MAIN ] GBX: Loaded 29133 primary data records. [2025-10-07T22:38:38.346550] [INFO ] [MAIN ] GBCI: Loaded 40500 primary data records. [2025-10-07T22:38:39.265012] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:39.266388] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40073 primary records. [2025-10-07T22:38:39.266624] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-07T22:38:39.288472] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:39.290600] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29133 primary records. [2025-10-07T22:38:39.290909] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-07T22:38:39.324697] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-07T22:38:39.331725] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-07T22:38:39.332184] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:39.337166] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-07T22:38:39.336133] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40500 primary records. [2025-10-07T22:38:39.334802] [INFO ] [MAIN ] Derivative Progress: 721/1748 symbols completed. GBX took 1.2s. Estimated remaining: 6m 36s. Rate: 155.6 symbols/min [2025-10-07T22:38:39.337382] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-07T22:38:39.337635] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:39.337456] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-07T22:38:39.339935] [INFO ] [MAIN ] Derivative Progress: 722/1748 symbols completed. GBTG took 1.2s. Estimated remaining: 6m 35s. Rate: 155.9 symbols/min [2025-10-07T22:38:39.340168] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:39.360378] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-10-07T22:38:39.360515] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-07T22:38:39.363263] [INFO ] [MAIN ] Derivative Progress: 723/1748 symbols completed. GBCI took 1.2s. Estimated remaining: 6m 34s. Rate: 156.1 symbols/min [2025-10-07T22:38:39.363531] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:39.401533] [DEBUG] [LOCAL ] GCTS: Loaded 20339 existing records from primary storage. [2025-10-07T22:38:39.410842] [DEBUG] [LOCAL ] GCO: Loaded 24194 existing records from primary storage. [2025-10-07T22:38:39.411107] [INFO ] [MAIN ] GCO: Loaded 24194 primary data records. [2025-10-07T22:38:39.411344] [INFO ] [MAIN ] GCTS: Loaded 20339 primary data records. [2025-10-07T22:38:39.631718] [DEBUG] [LOCAL ] GCI: Loaded 44112 existing records from primary storage. [2025-10-07T22:38:39.642775] [INFO ] [MAIN ] GCI: Loaded 44112 primary data records. [2025-10-07T22:38:40.377446] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:40.391079] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:40.393755] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 24194 primary records. [2025-10-07T22:38:40.393848] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-07T22:38:40.392453] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 20339 primary records. [2025-10-07T22:38:40.394922] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-07T22:38:40.439495] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:40.441622] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44112 primary records. [2025-10-07T22:38:40.444007] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-07T22:38:40.445266] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-07T22:38:40.445590] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-07T22:38:40.449360] [INFO ] [MAIN ] Derivative Progress: 724/1748 symbols completed. GCTS took 1.1s. Estimated remaining: 6m 35s. Rate: 155.7 symbols/min [2025-10-07T22:38:40.457432] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:40.466052] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-10-07T22:38:40.466161] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-07T22:38:40.469065] [INFO ] [MAIN ] Derivative Progress: 725/1748 symbols completed. GCO took 1.1s. Estimated remaining: 6m 34s. Rate: 155.9 symbols/min [2025-10-07T22:38:40.470408] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-07T22:38:40.470582] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-07T22:38:40.472827] [INFO ] [MAIN ] Derivative Progress: 726/1748 symbols completed. GCI took 1.1s. Estimated remaining: 6m 33s. Rate: 156.1 symbols/min [2025-10-07T22:38:40.470318] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:40.473174] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:40.481969] [DEBUG] [LOCAL ] GCV: Loaded 7535 existing records from primary storage. [2025-10-07T22:38:40.482314] [INFO ] [MAIN ] GCV: Loaded 7535 primary data records. [2025-10-07T22:38:40.859233] [DEBUG] [LOCAL ] GD: Loaded 46964 existing records from primary storage. [2025-10-07T22:38:40.859950] [INFO ] [MAIN ] GD: Loaded 46964 primary data records. [2025-10-07T22:38:40.977275] [DEBUG] [LOCAL ] GDDY: Loaded 49795 existing records from primary storage. [2025-10-07T22:38:40.977564] [INFO ] [MAIN ] GDDY: Loaded 49795 primary data records. [2025-10-07T22:38:41.512711] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:41.514082] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7535 primary records. [2025-10-07T22:38:41.514745] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-07T22:38:41.535479] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-10-07T22:38:41.535849] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-07T22:38:41.538157] [INFO ] [MAIN ] Derivative Progress: 727/1748 symbols completed. GCV took 1.1s. Estimated remaining: 6m 33s. Rate: 155.7 symbols/min [2025-10-07T22:38:41.540739] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:41.558528] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:41.559449] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 46964 primary records. [2025-10-07T22:38:41.559609] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-07T22:38:41.563538] [DEBUG] [LOCAL ] GDIV: Loaded 3613 existing records from primary storage. [2025-10-07T22:38:41.571054] [INFO ] [MAIN ] GDIV: Loaded 3613 primary data records. [2025-10-07T22:38:41.689668] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:41.697580] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-07T22:38:41.698492] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49795 primary records. [2025-10-07T22:38:41.702092] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-07T22:38:41.704080] [INFO ] [MAIN ] Derivative Progress: 728/1748 symbols completed. GD took 1.2s. Estimated remaining: 6m 33s. Rate: 155.8 symbols/min [2025-10-07T22:38:41.704238] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:41.702019] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-07T22:38:41.782214] [DEBUG] [LOCAL ] GDL: Loaded 2551 existing records from primary storage. [2025-10-07T22:38:41.799436] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-07T22:38:41.805932] [INFO ] [MAIN ] GDL: Loaded 2551 primary data records. [2025-10-07T22:38:41.805853] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-07T22:38:41.840515] [INFO ] [MAIN ] Derivative Progress: 729/1748 symbols completed. GDDY took 1.4s. Estimated remaining: 6m 32s. Rate: 156.0 symbols/min [2025-10-07T22:38:41.963674] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:42.044374] [DEBUG] [LOCAL ] GDO: Loaded 5920 existing records from primary storage. [2025-10-07T22:38:42.060271] [INFO ] [MAIN ] GDO: Loaded 5920 primary data records. [2025-10-07T22:38:42.558868] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:38:42.559867] [INFO ] [MAIN ] GDIV: Generated 1792 derivative records from 3613 primary records. [2025-10-07T22:38:42.560143] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-07T22:38:42.582246] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1792 records). [2025-10-07T22:38:42.582532] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-07T22:38:42.584623] [INFO ] [MAIN ] Derivative Progress: 730/1748 symbols completed. GDIV took 1.0s. Estimated remaining: 6m 32s. Rate: 155.8 symbols/min [2025-10-07T22:38:42.584941] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:42.599029] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:42.599882] [INFO ] [MAIN ] GDL: Generated 1794 derivative records from 2551 primary records. [2025-10-07T22:38:42.600160] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-07T22:38:42.618126] [DEBUG] [LOCAL ] GDL: Derivative data saved (1794 records). [2025-10-07T22:38:42.619073] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-07T22:38:42.621550] [INFO ] [MAIN ] Derivative Progress: 731/1748 symbols completed. GDL took 0.9s. Estimated remaining: 6m 31s. Rate: 156.0 symbols/min [2025-10-07T22:38:42.630157] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:42.636058] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:42.637409] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5920 primary records. [2025-10-07T22:38:42.637681] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-07T22:38:42.678957] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-07T22:38:42.683122] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-07T22:38:42.685245] [INFO ] [MAIN ] Derivative Progress: 732/1748 symbols completed. GDO took 0.7s. Estimated remaining: 6m 30s. Rate: 156.1 symbols/min [2025-10-07T22:38:42.685439] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:42.687103] [DEBUG] [LOCAL ] GDOT: Loaded 37959 existing records from primary storage. [2025-10-07T22:38:42.687598] [INFO ] [MAIN ] GDOT: Loaded 37959 primary data records. [2025-10-07T22:38:42.796255] [DEBUG] [LOCAL ] GDV: Loaded 19508 existing records from primary storage. [2025-10-07T22:38:42.800203] [INFO ] [MAIN ] GDV: Loaded 19508 primary data records. [2025-10-07T22:38:43.368450] [DEBUG] [LOCAL ] GE: Loaded 53712 existing records from primary storage. [2025-10-07T22:38:43.369184] [INFO ] [MAIN ] GE: Loaded 53712 primary data records. [2025-10-07T22:38:43.712855] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:43.715234] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 37959 primary records. [2025-10-07T22:38:43.715876] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-07T22:38:43.737256] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-07T22:38:43.745761] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-07T22:38:43.753885] [INFO ] [MAIN ] Derivative Progress: 733/1748 symbols completed. GDOT took 1.2s. Estimated remaining: 6m 31s. Rate: 155.8 symbols/min [2025-10-07T22:38:43.755030] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:43.755978] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19508 primary records. [2025-10-07T22:38:43.756204] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-07T22:38:43.775906] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-07T22:38:43.776130] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-07T22:38:43.791382] [INFO ] [MAIN ] Derivative Progress: 734/1748 symbols completed. GDV took 1.2s. Estimated remaining: 6m 30s. Rate: 155.9 symbols/min [2025-10-07T22:38:43.789300] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:43.792257] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53712 primary records. [2025-10-07T22:38:43.792343] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-07T22:38:43.808224] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-07T22:38:43.808309] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-07T22:38:43.810515] [INFO ] [MAIN ] Derivative Progress: 735/1748 symbols completed. GE took 1.1s. Estimated remaining: 6m 29s. Rate: 156.1 symbols/min [2025-10-07T22:38:43.810956] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:43.811081] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:43.811180] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:43.846520] [DEBUG] [LOCAL ] GEF: Loaded 20741 existing records from primary storage. [2025-10-07T22:38:43.856542] [INFO ] [MAIN ] GEF: Loaded 20741 primary data records. [2025-10-07T22:38:43.857414] [DEBUG] [LOCAL ] GEL: Loaded 32496 existing records from primary storage. [2025-10-07T22:38:43.878632] [INFO ] [MAIN ] GEL: Loaded 32496 primary data records. [2025-10-07T22:38:44.494476] [DEBUG] [LOCAL ] GENI: Loaded 52945 existing records from primary storage. [2025-10-07T22:38:44.507714] [INFO ] [MAIN ] GENI: Loaded 52945 primary data records. [2025-10-07T22:38:44.907363] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:44.913963] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20741 primary records. [2025-10-07T22:38:44.914290] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:44.915492] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-07T22:38:44.915398] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 32496 primary records. [2025-10-07T22:38:44.916686] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-07T22:38:44.958216] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:44.959916] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52945 primary records. [2025-10-07T22:38:44.960577] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-07T22:38:44.967272] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-10-07T22:38:44.980988] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-07T22:38:44.980887] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-07T22:38:44.983687] [INFO ] [MAIN ] Derivative Progress: 736/1748 symbols completed. GEL took 1.2s. Estimated remaining: 6m 30s. Rate: 155.7 symbols/min [2025-10-07T22:38:44.981426] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-07T22:38:44.986489] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:44.987476] [INFO ] [MAIN ] Derivative Progress: 737/1748 symbols completed. GEF took 1.2s. Estimated remaining: 6m 29s. Rate: 155.9 symbols/min [2025-10-07T22:38:44.988995] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:44.991302] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-07T22:38:44.991404] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-07T22:38:44.993377] [INFO ] [MAIN ] Derivative Progress: 738/1748 symbols completed. GENI took 1.2s. Estimated remaining: 6m 28s. Rate: 156.1 symbols/min [2025-10-07T22:38:44.993625] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:45.031313] [DEBUG] [LOCAL ] GETY: Loaded 35311 existing records from primary storage. [2025-10-07T22:38:45.045143] [INFO ] [MAIN ] GETY: Loaded 35311 primary data records. [2025-10-07T22:38:45.185167] [DEBUG] [LOCAL ] GES: Loaded 38833 existing records from primary storage. [2025-10-07T22:38:45.228457] [INFO ] [MAIN ] GES: Loaded 38833 primary data records. [2025-10-07T22:38:45.447983] [DEBUG] [LOCAL ] GEO: Loaded 51896 existing records from primary storage. [2025-10-07T22:38:45.487018] [INFO ] [MAIN ] GEO: Loaded 51896 primary data records. [2025-10-07T22:38:46.027456] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:46.030291] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35311 primary records. [2025-10-07T22:38:46.030578] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-07T22:38:46.051768] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-07T22:38:46.053263] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-07T22:38:46.055765] [INFO ] [MAIN ] Derivative Progress: 739/1748 symbols completed. GETY took 1.1s. Estimated remaining: 6m 29s. Rate: 155.8 symbols/min [2025-10-07T22:38:46.056187] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:46.074902] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:46.075886] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 38833 primary records. [2025-10-07T22:38:46.076121] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-07T22:38:46.114422] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:46.115096] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-10-07T22:38:46.116108] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51896 primary records. [2025-10-07T22:38:46.116342] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-07T22:38:46.116234] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-07T22:38:46.118773] [INFO ] [MAIN ] Derivative Progress: 740/1748 symbols completed. GES took 1.1s. Estimated remaining: 6m 28s. Rate: 155.9 symbols/min [2025-10-07T22:38:46.119553] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:46.150633] [DEBUG] [LOCAL ] GF: Loaded 2801 existing records from primary storage. [2025-10-07T22:38:46.151246] [INFO ] [MAIN ] GF: Loaded 2801 primary data records. [2025-10-07T22:38:46.252410] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-07T22:38:46.265442] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-07T22:38:46.279342] [INFO ] [MAIN ] Derivative Progress: 741/1748 symbols completed. GEO took 1.3s. Estimated remaining: 6m 27s. Rate: 156.1 symbols/min [2025-10-07T22:38:46.281036] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:46.291617] [DEBUG] [LOCAL ] GEV: Loaded 53018 existing records from primary storage. [2025-10-07T22:38:46.355519] [INFO ] [MAIN ] GEV: Loaded 53018 primary data records. [2025-10-07T22:38:46.713688] [DEBUG] [LOCAL ] GFF: Loaded 30268 existing records from primary storage. [2025-10-07T22:38:46.867174] [INFO ] [MAIN ] GFF: Loaded 30268 primary data records. [2025-10-07T22:38:47.199612] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:47.213923] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2801 primary records. [2025-10-07T22:38:47.214756] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-07T22:38:47.242151] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-07T22:38:47.243226] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-07T22:38:47.245460] [INFO ] [MAIN ] Derivative Progress: 742/1748 symbols completed. GF took 1.1s. Estimated remaining: 6m 28s. Rate: 155.7 symbols/min [2025-10-07T22:38:47.259746] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:47.259597] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:47.261249] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53018 primary records. [2025-10-07T22:38:47.261586] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-07T22:38:47.280187] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-07T22:38:47.281168] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-07T22:38:47.284506] [INFO ] [MAIN ] Derivative Progress: 743/1748 symbols completed. GEV took 1.2s. Estimated remaining: 6m 27s. Rate: 155.9 symbols/min [2025-10-07T22:38:47.284694] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:47.300543] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:47.302070] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30268 primary records. [2025-10-07T22:38:47.302231] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-07T22:38:47.321568] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-07T22:38:47.321824] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-07T22:38:47.324565] [INFO ] [MAIN ] Derivative Progress: 744/1748 symbols completed. GFF took 1.0s. Estimated remaining: 6m 26s. Rate: 156.1 symbols/min [2025-10-07T22:38:47.324811] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:47.350523] [DEBUG] [LOCAL ] GFR: Loaded 8002 existing records from primary storage. [2025-10-07T22:38:47.350689] [INFO ] [MAIN ] GFR: Loaded 8002 primary data records. [2025-10-07T22:38:47.484404] [DEBUG] [LOCAL ] GFI: Loaded 53101 existing records from primary storage. [2025-10-07T22:38:47.497591] [INFO ] [MAIN ] GFI: Loaded 53101 primary data records. [2025-10-07T22:38:47.529247] [DEBUG] [LOCAL ] GFL: Loaded 47875 existing records from primary storage. [2025-10-07T22:38:47.613613] [INFO ] [MAIN ] GFL: Loaded 47875 primary data records. [2025-10-07T22:38:48.354304] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:48.355675] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8002 primary records. [2025-10-07T22:38:48.355804] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-07T22:38:48.389982] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:48.391167] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53101 primary records. [2025-10-07T22:38:48.391680] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-07T22:38:48.393372] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-10-07T22:38:48.405437] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-07T22:38:48.407600] [INFO ] [MAIN ] Derivative Progress: 745/1748 symbols completed. GFR took 1.1s. Estimated remaining: 6m 26s. Rate: 155.7 symbols/min [2025-10-07T22:38:48.408213] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:48.416621] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-07T22:38:48.416838] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-07T22:38:48.427197] [INFO ] [MAIN ] Derivative Progress: 746/1748 symbols completed. GFI took 1.2s. Estimated remaining: 6m 26s. Rate: 155.9 symbols/min [2025-10-07T22:38:48.432521] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:48.433197] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:48.434364] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47875 primary records. [2025-10-07T22:38:48.434428] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-07T22:38:48.451934] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-07T22:38:48.451997] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-07T22:38:48.454026] [INFO ] [MAIN ] Derivative Progress: 747/1748 symbols completed. GFL took 1.2s. Estimated remaining: 6m 25s. Rate: 156.1 symbols/min [2025-10-07T22:38:48.454272] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:48.494597] [DEBUG] [LOCAL ] GGT: Loaded 14149 existing records from primary storage. [2025-10-07T22:38:48.495437] [INFO ] [MAIN ] GGT: Loaded 14149 primary data records. [2025-10-07T22:38:48.598167] [DEBUG] [LOCAL ] GGG: Loaded 40843 existing records from primary storage. [2025-10-07T22:38:48.604780] [INFO ] [MAIN ] GGG: Loaded 40843 primary data records. [2025-10-07T22:38:48.604662] [DEBUG] [LOCAL ] GGB: Loaded 51168 existing records from primary storage. [2025-10-07T22:38:48.630803] [INFO ] [MAIN ] GGB: Loaded 51168 primary data records. [2025-10-07T22:38:49.505849] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:49.508112] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14149 primary records. [2025-10-07T22:38:49.508313] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-07T22:38:49.539504] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:49.539211] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-10-07T22:38:49.552828] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40843 primary records. [2025-10-07T22:38:49.552923] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-07T22:38:49.553773] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-07T22:38:49.556269] [INFO ] [MAIN ] Derivative Progress: 748/1748 symbols completed. GGT took 1.1s. Estimated remaining: 6m 25s. Rate: 155.7 symbols/min [2025-10-07T22:38:49.554138] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:49.557312] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51168 primary records. [2025-10-07T22:38:49.558191] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-07T22:38:49.587586] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-07T22:38:49.591363] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-07T22:38:49.592139] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-10-07T22:38:49.594945] [INFO ] [MAIN ] Derivative Progress: 749/1748 symbols completed. GGG took 1.2s. Estimated remaining: 6m 24s. Rate: 155.9 symbols/min [2025-10-07T22:38:49.595141] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-07T22:38:49.597552] [INFO ] [MAIN ] Derivative Progress: 750/1748 symbols completed. GGB took 1.2s. Estimated remaining: 6m 24s. Rate: 156.1 symbols/min [2025-10-07T22:38:49.598013] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:49.598151] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:49.598395] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:49.609142] [DEBUG] [LOCAL ] GHG: Loaded 3190 existing records from primary storage. [2025-10-07T22:38:49.607118] [DEBUG] [LOCAL ] GGZ: Loaded 2428 existing records from primary storage. [2025-10-07T22:38:49.612988] [INFO ] [MAIN ] GGZ: Loaded 2428 primary data records. [2025-10-07T22:38:49.609421] [INFO ] [MAIN ] GHG: Loaded 3190 primary data records. [2025-10-07T22:38:49.612863] [DEBUG] [LOCAL ] GHC: Loaded 2760 existing records from primary storage. [2025-10-07T22:38:49.654970] [INFO ] [MAIN ] GHC: Loaded 2760 primary data records. [2025-10-07T22:38:50.622671] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:38:50.624453] [INFO ] [MAIN ] GHG: Generated 1793 derivative records from 3190 primary records. [2025-10-07T22:38:50.632996] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-07T22:38:50.642122] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:50.649104] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2428 primary records. [2025-10-07T22:38:50.653832] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-07T22:38:50.675888] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:50.681496] [INFO ] [MAIN ] GHC: Generated 1794 derivative records from 2760 primary records. [2025-10-07T22:38:50.681942] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-07T22:38:50.687594] [DEBUG] [LOCAL ] GHG: Derivative data saved (1793 records). [2025-10-07T22:38:50.688182] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-07T22:38:50.696368] [INFO ] [MAIN ] Derivative Progress: 751/1748 symbols completed. GHG took 1.1s. Estimated remaining: 6m 24s. Rate: 155.8 symbols/min [2025-10-07T22:38:50.700784] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:50.688075] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-10-07T22:38:50.702513] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-07T22:38:50.705388] [INFO ] [MAIN ] Derivative Progress: 752/1748 symbols completed. GGZ took 1.1s. Estimated remaining: 6m 23s. Rate: 156.0 symbols/min [2025-10-07T22:38:50.705934] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:50.711720] [DEBUG] [LOCAL ] GHC: Derivative data saved (1794 records). [2025-10-07T22:38:50.712089] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-07T22:38:50.714774] [INFO ] [MAIN ] Derivative Progress: 753/1748 symbols completed. GHC took 1.1s. Estimated remaining: 6m 22s. Rate: 156.2 symbols/min [2025-10-07T22:38:50.715102] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:50.720924] [DEBUG] [LOCAL ] GHI: Loaded 7175 existing records from primary storage. [2025-10-07T22:38:50.721113] [INFO ] [MAIN ] GHI: Loaded 7175 primary data records. [2025-10-07T22:38:50.762821] [DEBUG] [LOCAL ] GHLD: Loaded 4186 existing records from primary storage. [2025-10-07T22:38:50.769298] [INFO ] [MAIN ] GHLD: Loaded 4186 primary data records. [2025-10-07T22:38:50.941945] [DEBUG] [LOCAL ] GHM: Loaded 14153 existing records from primary storage. [2025-10-07T22:38:50.959334] [INFO ] [MAIN ] GHM: Loaded 14153 primary data records. [2025-10-07T22:38:51.738530] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:51.740572] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7175 primary records. [2025-10-07T22:38:51.742400] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-07T22:38:51.768921] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:38:51.770162] [INFO ] [MAIN ] GHLD: Generated 1792 derivative records from 4186 primary records. [2025-10-07T22:38:51.770690] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-07T22:38:51.789742] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-07T22:38:51.789856] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1792 records). [2025-10-07T22:38:51.790065] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-07T22:38:51.792235] [INFO ] [MAIN ] Derivative Progress: 754/1748 symbols completed. GHI took 1.1s. Estimated remaining: 6m 23s. Rate: 155.8 symbols/min [2025-10-07T22:38:51.792338] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-07T22:38:51.792544] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:51.807743] [INFO ] [MAIN ] Derivative Progress: 755/1748 symbols completed. GHLD took 1.1s. Estimated remaining: 6m 22s. Rate: 156.0 symbols/min [2025-10-07T22:38:51.808355] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:51.808705] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:51.809594] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14153 primary records. [2025-10-07T22:38:51.809752] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-07T22:38:51.827063] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-07T22:38:51.827194] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-07T22:38:51.829288] [INFO ] [MAIN ] Derivative Progress: 756/1748 symbols completed. GHM took 1.1s. Estimated remaining: 6m 21s. Rate: 156.2 symbols/min [2025-10-07T22:38:51.829601] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:51.856144] [DEBUG] [LOCAL ] GHY: Loaded 20933 existing records from primary storage. [2025-10-07T22:38:51.856406] [INFO ] [MAIN ] GHY: Loaded 20933 primary data records. [2025-10-07T22:38:51.951786] [DEBUG] [LOCAL ] GIC: Loaded 13473 existing records from primary storage. [2025-10-07T22:38:51.964926] [INFO ] [MAIN ] GIC: Loaded 13473 primary data records. [2025-10-07T22:38:51.997215] [DEBUG] [LOCAL ] GIB: Loaded 31877 existing records from primary storage. [2025-10-07T22:38:52.024944] [INFO ] [MAIN ] GIB: Loaded 31877 primary data records. [2025-10-07T22:38:52.855133] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:52.856377] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20933 primary records. [2025-10-07T22:38:52.856747] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-07T22:38:52.884920] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-07T22:38:52.889818] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-07T22:38:52.892427] [INFO ] [MAIN ] Derivative Progress: 757/1748 symbols completed. GHY took 1.1s. Estimated remaining: 6m 22s. Rate: 155.8 symbols/min [2025-10-07T22:38:52.892761] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:52.893168] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:52.894506] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13473 primary records. [2025-10-07T22:38:52.894998] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-07T22:38:52.927811] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:52.929290] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 31877 primary records. [2025-10-07T22:38:52.929818] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-07T22:38:52.931296] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-07T22:38:52.939259] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-07T22:38:52.942250] [INFO ] [MAIN ] Derivative Progress: 758/1748 symbols completed. GIC took 1.1s. Estimated remaining: 6m 21s. Rate: 156.0 symbols/min [2025-10-07T22:38:52.949277] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:52.952796] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-07T22:38:52.952928] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-07T22:38:52.964758] [INFO ] [MAIN ] Derivative Progress: 759/1748 symbols completed. GIB took 1.2s. Estimated remaining: 6m 20s. Rate: 156.2 symbols/min [2025-10-07T22:38:52.965199] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:52.990431] [DEBUG] [LOCAL ] GIL: Loaded 43629 existing records from primary storage. [2025-10-07T22:38:52.990726] [INFO ] [MAIN ] GIL: Loaded 43629 primary data records. [2025-10-07T22:38:53.350328] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-07T22:38:53.350760] [INFO ] [MAIN ] GIS: Loaded 53672 primary data records. [2025-10-07T22:38:53.351299] [DEBUG] [LOCAL ] GKOS: Loaded 42637 existing records from primary storage. [2025-10-07T22:38:53.351549] [INFO ] [MAIN ] GKOS: Loaded 42637 primary data records. [2025-10-07T22:38:53.989976] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:53.991678] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43629 primary records. [2025-10-07T22:38:53.992108] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-07T22:38:54.012805] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-07T22:38:54.013224] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-07T22:38:54.015573] [INFO ] [MAIN ] Derivative Progress: 760/1748 symbols completed. GIL took 1.1s. Estimated remaining: 6m 20s. Rate: 155.8 symbols/min [2025-10-07T22:38:54.016201] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:54.037097] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:54.037989] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42637 primary records. [2025-10-07T22:38:54.038249] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-07T22:38:54.051872] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:54.052664] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53672 primary records. [2025-10-07T22:38:54.052903] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-07T22:38:54.080441] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-07T22:38:54.089505] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-07T22:38:54.091764] [INFO ] [MAIN ] Derivative Progress: 761/1748 symbols completed. GKOS took 1.1s. Estimated remaining: 6m 20s. Rate: 156.0 symbols/min [2025-10-07T22:38:54.092479] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:54.097471] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-07T22:38:54.098349] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-07T22:38:54.100428] [INFO ] [MAIN ] Derivative Progress: 762/1748 symbols completed. GIS took 1.2s. Estimated remaining: 6m 19s. Rate: 156.2 symbols/min [2025-10-07T22:38:54.100624] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:54.113156] [DEBUG] [LOCAL ] GL: Loaded 37747 existing records from primary storage. [2025-10-07T22:38:54.113383] [INFO ] [MAIN ] GL: Loaded 37747 primary data records. [2025-10-07T22:38:54.223458] [DEBUG] [LOCAL ] GLP: Loaded 9284 existing records from primary storage. [2025-10-07T22:38:54.239329] [INFO ] [MAIN ] GLP: Loaded 9284 primary data records. [2025-10-07T22:38:54.590862] [DEBUG] [LOCAL ] GLOB: Loaded 47732 existing records from primary storage. [2025-10-07T22:38:54.605894] [INFO ] [MAIN ] GLOB: Loaded 47732 primary data records. [2025-10-07T22:38:55.130732] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:55.132316] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37747 primary records. [2025-10-07T22:38:55.132572] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-07T22:38:55.151591] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-07T22:38:55.152709] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-07T22:38:55.156362] [INFO ] [MAIN ] Derivative Progress: 763/1748 symbols completed. GL took 1.1s. Estimated remaining: 6m 19s. Rate: 155.8 symbols/min [2025-10-07T22:38:55.170669] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:38:55.171316] [INFO ] [MAIN ] GLP: Generated 1793 derivative records from 9284 primary records. [2025-10-07T22:38:55.171565] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-07T22:38:55.202001] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:55.202616] [DEBUG] [LOCAL ] GLP: Derivative data saved (1793 records). [2025-10-07T22:38:55.203344] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-07T22:38:55.203254] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47732 primary records. [2025-10-07T22:38:55.203457] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-07T22:38:55.205441] [INFO ] [MAIN ] Derivative Progress: 764/1748 symbols completed. GLP took 1.1s. Estimated remaining: 6m 18s. Rate: 156.0 symbols/min [2025-10-07T22:38:55.220626] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-10-07T22:38:55.220711] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-07T22:38:55.222908] [INFO ] [MAIN ] Derivative Progress: 765/1748 symbols completed. GLOB took 1.1s. Estimated remaining: 6m 18s. Rate: 156.2 symbols/min [2025-10-07T22:38:55.223288] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:55.223437] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:55.223390] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:55.300761] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-07T22:38:55.301043] [INFO ] [MAIN ] GLW: Loaded 53636 primary data records. [2025-10-07T22:38:55.384368] [DEBUG] [LOCAL ] GME: Loaded 53782 existing records from primary storage. [2025-10-07T22:38:55.404359] [INFO ] [MAIN ] GME: Loaded 53782 primary data records. [2025-10-07T22:38:55.456201] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-07T22:38:55.506921] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-07T22:38:56.306939] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:56.309915] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53636 primary records. [2025-10-07T22:38:56.310152] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-07T22:38:56.334253] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:56.340305] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53782 primary records. [2025-10-07T22:38:56.340897] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-07T22:38:56.343960] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-07T22:38:56.352576] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-07T22:38:56.356205] [INFO ] [MAIN ] Derivative Progress: 766/1748 symbols completed. GLW took 1.1s. Estimated remaining: 6m 18s. Rate: 155.8 symbols/min [2025-10-07T22:38:56.358009] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:56.381971] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:56.383852] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53729 primary records. [2025-10-07T22:38:56.383947] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-07T22:38:56.382810] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-07T22:38:56.385278] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-07T22:38:56.396282] [INFO ] [MAIN ] Derivative Progress: 767/1748 symbols completed. GME took 1.2s. Estimated remaining: 6m 17s. Rate: 156.0 symbols/min [2025-10-07T22:38:56.400760] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:56.404549] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-07T22:38:56.404913] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-07T22:38:56.407919] [INFO ] [MAIN ] Derivative Progress: 768/1748 symbols completed. GM took 1.2s. Estimated remaining: 6m 16s. Rate: 156.2 symbols/min [2025-10-07T22:38:56.408465] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:56.451300] [DEBUG] [LOCAL ] GMED: Loaded 48385 existing records from primary storage. [2025-10-07T22:38:56.468411] [INFO ] [MAIN ] GMED: Loaded 48385 primary data records. [2025-10-07T22:38:56.468854] [DEBUG] [LOCAL ] GNE: Loaded 17867 existing records from primary storage. [2025-10-07T22:38:56.490745] [INFO ] [MAIN ] GNE: Loaded 17867 primary data records. [2025-10-07T22:38:56.640665] [DEBUG] [LOCAL ] GMRE: Loaded 37200 existing records from primary storage. [2025-10-07T22:38:56.675269] [INFO ] [MAIN ] GMRE: Loaded 37200 primary data records. [2025-10-07T22:38:57.521755] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:57.529866] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48385 primary records. [2025-10-07T22:38:57.530462] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:57.531264] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17867 primary records. [2025-10-07T22:38:57.531387] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-07T22:38:57.530155] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-07T22:38:57.576977] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:57.581191] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-07T22:38:57.582172] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37200 primary records. [2025-10-07T22:38:57.583176] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-07T22:38:57.585619] [INFO ] [MAIN ] Derivative Progress: 769/1748 symbols completed. GMED took 1.2s. Estimated remaining: 6m 17s. Rate: 155.8 symbols/min [2025-10-07T22:38:57.582788] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-07T22:38:57.586221] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:57.590673] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-07T22:38:57.591040] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-07T22:38:57.601894] [INFO ] [MAIN ] Derivative Progress: 770/1748 symbols completed. GNE took 1.2s. Estimated remaining: 6m 16s. Rate: 156.0 symbols/min [2025-10-07T22:38:57.604926] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:57.610907] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-07T22:38:57.610994] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-07T22:38:57.612935] [INFO ] [MAIN ] Derivative Progress: 771/1748 symbols completed. GMRE took 1.2s. Estimated remaining: 6m 15s. Rate: 156.2 symbols/min [2025-10-07T22:38:57.613129] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:57.667435] [DEBUG] [LOCAL ] GNK: Loaded 40272 existing records from primary storage. [2025-10-07T22:38:57.667881] [INFO ] [MAIN ] GNK: Loaded 40272 primary data records. [2025-10-07T22:38:57.814799] [DEBUG] [LOCAL ] GNRC: Loaded 45210 existing records from primary storage. [2025-10-07T22:38:57.815911] [DEBUG] [LOCAL ] GNL: Loaded 46755 existing records from primary storage. [2025-10-07T22:38:57.826574] [INFO ] [MAIN ] GNRC: Loaded 45210 primary data records. [2025-10-07T22:38:57.882883] [INFO ] [MAIN ] GNL: Loaded 46755 primary data records. [2025-10-07T22:38:58.742213] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:58.743337] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40272 primary records. [2025-10-07T22:38:58.743750] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-07T22:38:58.777974] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:58.779688] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45210 primary records. [2025-10-07T22:38:58.780673] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-07T22:38:58.795167] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-07T22:38:58.797302] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-07T22:38:58.799724] [INFO ] [MAIN ] Derivative Progress: 772/1748 symbols completed. GNK took 1.2s. Estimated remaining: 6m 16s. Rate: 155.7 symbols/min [2025-10-07T22:38:58.800418] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:58.819158] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-07T22:38:58.818408] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:58.820180] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46755 primary records. [2025-10-07T22:38:58.820398] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-07T22:38:58.820473] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-07T22:38:58.822980] [INFO ] [MAIN ] Derivative Progress: 773/1748 symbols completed. GNRC took 1.2s. Estimated remaining: 6m 15s. Rate: 155.9 symbols/min [2025-10-07T22:38:58.823220] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:58.844183] [DEBUG] [LOCAL ] GNT: Loaded 8259 existing records from primary storage. [2025-10-07T22:38:58.845823] [INFO ] [MAIN ] GNT: Loaded 8259 primary data records. [2025-10-07T22:38:58.858785] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-07T22:38:58.884092] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-07T22:38:58.893091] [INFO ] [MAIN ] Derivative Progress: 774/1748 symbols completed. GNL took 1.3s. Estimated remaining: 6m 14s. Rate: 156.1 symbols/min [2025-10-07T22:38:58.905554] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:59.220934] [DEBUG] [LOCAL ] GNW: Loaded 51367 existing records from primary storage. [2025-10-07T22:38:59.221513] [INFO ] [MAIN ] GNW: Loaded 51367 primary data records. [2025-10-07T22:38:59.349719] [DEBUG] [LOCAL ] GOF: Loaded 42499 existing records from primary storage. [2025-10-07T22:38:59.410668] [INFO ] [MAIN ] GOF: Loaded 42499 primary data records. [2025-10-07T22:38:59.879459] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:59.881698] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8259 primary records. [2025-10-07T22:38:59.882155] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-07T22:38:59.920468] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-10-07T22:38:59.920843] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:59.921033] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-07T22:38:59.923283] [INFO ] [MAIN ] Derivative Progress: 775/1748 symbols completed. GNT took 1.1s. Estimated remaining: 6m 15s. Rate: 155.8 symbols/min [2025-10-07T22:38:59.924276] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51367 primary records. [2025-10-07T22:38:59.924712] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:59.925139] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-07T22:38:59.947206] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-07T22:38:59.947522] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-07T22:38:59.949748] [INFO ] [MAIN ] Derivative Progress: 776/1748 symbols completed. GNW took 1.1s. Estimated remaining: 6m 14s. Rate: 155.9 symbols/min [2025-10-07T22:38:59.964294] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:38:59.963975] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:38:59.965529] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42499 primary records. [2025-10-07T22:38:59.965594] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-07T22:38:59.990410] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-07T22:38:59.990700] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-07T22:38:59.992755] [INFO ] [MAIN ] Derivative Progress: 777/1748 symbols completed. GOF took 1.1s. Estimated remaining: 6m 13s. Rate: 156.1 symbols/min [2025-10-07T22:38:59.993034] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:00.005999] [DEBUG] [LOCAL ] GOLF: Loaded 31098 existing records from primary storage. [2025-10-07T22:39:00.006287] [INFO ] [MAIN ] GOLF: Loaded 31098 primary data records. [2025-10-07T22:39:00.221546] [DEBUG] [LOCAL ] GOOS: Loaded 44748 existing records from primary storage. [2025-10-07T22:39:00.238592] [INFO ] [MAIN ] GOOS: Loaded 44748 primary data records. [2025-10-07T22:39:00.417498] [DEBUG] [LOCAL ] GOTU: Loaded 37911 existing records from primary storage. [2025-10-07T22:39:00.451963] [INFO ] [MAIN ] GOTU: Loaded 37911 primary data records. [2025-10-07T22:39:00.998529] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:00.999637] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31098 primary records. [2025-10-07T22:39:00.999822] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-07T22:39:01.028149] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-07T22:39:01.033848] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-07T22:39:01.033781] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:01.036031] [INFO ] [MAIN ] Derivative Progress: 778/1748 symbols completed. GOLF took 1.1s. Estimated remaining: 6m 14s. Rate: 155.8 symbols/min [2025-10-07T22:39:01.037173] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 44748 primary records. [2025-10-07T22:39:01.037341] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-07T22:39:01.068340] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:01.069426] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-07T22:39:01.070175] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-07T22:39:01.070087] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 37911 primary records. [2025-10-07T22:39:01.072096] [INFO ] [MAIN ] Derivative Progress: 779/1748 symbols completed. GOOS took 1.1s. Estimated remaining: 6m 13s. Rate: 156.0 symbols/min [2025-10-07T22:39:01.072158] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-07T22:39:01.087872] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-07T22:39:01.087936] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-07T22:39:01.089925] [INFO ] [MAIN ] Derivative Progress: 780/1748 symbols completed. GOTU took 1.1s. Estimated remaining: 6m 12s. Rate: 156.2 symbols/min [2025-10-07T22:39:01.090392] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:01.090458] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:01.090333] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:01.101215] [DEBUG] [LOCAL ] GPJA: Loaded 4266 existing records from primary storage. [2025-10-07T22:39:01.101536] [INFO ] [MAIN ] GPJA: Loaded 4266 primary data records. [2025-10-07T22:39:01.232733] [DEBUG] [LOCAL ] GPI: Loaded 14631 existing records from primary storage. [2025-10-07T22:39:01.246305] [INFO ] [MAIN ] GPI: Loaded 14631 primary data records. [2025-10-07T22:39:01.662602] [DEBUG] [LOCAL ] GPC: Loaded 46229 existing records from primary storage. [2025-10-07T22:39:01.674298] [INFO ] [MAIN ] GPC: Loaded 46229 primary data records. [2025-10-07T22:39:02.208956] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-07T22:39:02.211156] [INFO ] [MAIN ] GPJA: Generated 1791 derivative records from 4266 primary records. [2025-10-07T22:39:02.211307] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-07T22:39:02.243553] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1791 records). [2025-10-07T22:39:02.244510] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:02.244177] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-07T22:39:02.247936] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 14631 primary records. [2025-10-07T22:39:02.246759] [INFO ] [MAIN ] Derivative Progress: 781/1748 symbols completed. GPJA took 1.2s. Estimated remaining: 6m 13s. Rate: 155.8 symbols/min [2025-10-07T22:39:02.248299] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-07T22:39:02.248464] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:02.270623] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-10-07T22:39:02.285156] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-07T22:39:02.287272] [INFO ] [MAIN ] Derivative Progress: 782/1748 symbols completed. GPI took 1.2s. Estimated remaining: 6m 12s. Rate: 155.9 symbols/min [2025-10-07T22:39:02.288223] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:02.288987] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:02.290093] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46229 primary records. [2025-10-07T22:39:02.290222] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-07T22:39:02.313545] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-10-07T22:39:02.313912] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-07T22:39:02.323354] [INFO ] [MAIN ] Derivative Progress: 783/1748 symbols completed. GPC took 1.2s. Estimated remaining: 6m 11s. Rate: 156.1 symbols/min [2025-10-07T22:39:02.323884] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:02.347905] [DEBUG] [LOCAL ] GPMT: Loaded 25876 existing records from primary storage. [2025-10-07T22:39:02.348130] [INFO ] [MAIN ] GPMT: Loaded 25876 primary data records. [2025-10-07T22:39:02.492873] [DEBUG] [LOCAL ] GPK: Loaded 52658 existing records from primary storage. [2025-10-07T22:39:02.521274] [INFO ] [MAIN ] GPK: Loaded 52658 primary data records. [2025-10-07T22:39:02.803089] [DEBUG] [LOCAL ] GPN: Loaded 52045 existing records from primary storage. [2025-10-07T22:39:02.819273] [INFO ] [MAIN ] GPN: Loaded 52045 primary data records. [2025-10-07T22:39:03.361976] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:03.363369] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 25876 primary records. [2025-10-07T22:39:03.363560] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-07T22:39:03.383528] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-07T22:39:03.383952] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-07T22:39:03.385956] [INFO ] [MAIN ] Derivative Progress: 784/1748 symbols completed. GPMT took 1.1s. Estimated remaining: 6m 11s. Rate: 155.8 symbols/min [2025-10-07T22:39:03.386328] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:03.400115] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:03.401091] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52658 primary records. [2025-10-07T22:39:03.401487] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-07T22:39:03.435274] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-07T22:39:03.440296] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-07T22:39:03.434892] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:03.442274] [INFO ] [MAIN ] Derivative Progress: 785/1748 symbols completed. GPK took 1.2s. Estimated remaining: 6m 11s. Rate: 155.9 symbols/min [2025-10-07T22:39:03.443423] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52045 primary records. [2025-10-07T22:39:03.443586] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-07T22:39:03.442426] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:03.465897] [DEBUG] [LOCAL ] GPOR: Loaded 23208 existing records from primary storage. [2025-10-07T22:39:03.467244] [INFO ] [MAIN ] GPOR: Loaded 23208 primary data records. [2025-10-07T22:39:03.505068] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-07T22:39:03.544059] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-07T22:39:03.573669] [INFO ] [MAIN ] Derivative Progress: 786/1748 symbols completed. GPN took 1.2s. Estimated remaining: 6m 10s. Rate: 156.1 symbols/min [2025-10-07T22:39:03.583815] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:03.791196] [DEBUG] [LOCAL ] GPRK: Loaded 39388 existing records from primary storage. [2025-10-07T22:39:03.791552] [INFO ] [MAIN ] GPRK: Loaded 39388 primary data records. [2025-10-07T22:39:04.113920] [DEBUG] [LOCAL ] GRBK: Loaded 26976 existing records from primary storage. [2025-10-07T22:39:04.114401] [INFO ] [MAIN ] GRBK: Loaded 26976 primary data records. [2025-10-07T22:39:04.418470] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:04.427622] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23208 primary records. [2025-10-07T22:39:04.428086] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-07T22:39:04.465381] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:04.465944] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-10-07T22:39:04.466738] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39388 primary records. [2025-10-07T22:39:04.466969] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-07T22:39:04.469101] [INFO ] [MAIN ] Derivative Progress: 787/1748 symbols completed. GPOR took 1.1s. Estimated remaining: 6m 10s. Rate: 155.8 symbols/min [2025-10-07T22:39:04.469265] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:04.466922] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-07T22:39:04.495605] [DEBUG] [LOCAL ] GRC: Loaded 9198 existing records from primary storage. [2025-10-07T22:39:04.495374] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-07T22:39:04.495858] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-07T22:39:04.497921] [INFO ] [MAIN ] Derivative Progress: 788/1748 symbols completed. GPRK took 1.1s. Estimated remaining: 6m 9s. Rate: 156.0 symbols/min [2025-10-07T22:39:04.498075] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:04.498236] [INFO ] [MAIN ] GRC: Loaded 9198 primary data records. [2025-10-07T22:39:04.564955] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:04.581381] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 26976 primary records. [2025-10-07T22:39:04.581598] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-07T22:39:04.678794] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-07T22:39:04.729744] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-07T22:39:04.732205] [INFO ] [MAIN ] Derivative Progress: 789/1748 symbols completed. GRBK took 1.1s. Estimated remaining: 6m 9s. Rate: 156.1 symbols/min [2025-10-07T22:39:04.730101] [DEBUG] [LOCAL ] GRDN: Loaded 20854 existing records from primary storage. [2025-10-07T22:39:04.732502] [INFO ] [MAIN ] GRDN: Loaded 20854 primary data records. [2025-10-07T22:39:04.869485] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:05.235813] [DEBUG] [LOCAL ] GRMN: Loaded 40786 existing records from primary storage. [2025-10-07T22:39:05.237672] [INFO ] [MAIN ] GRMN: Loaded 40786 primary data records. [2025-10-07T22:39:05.324697] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:05.354158] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 9198 primary records. [2025-10-07T22:39:05.359710] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-07T22:39:05.628146] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-10-07T22:39:05.629133] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-07T22:39:05.631333] [INFO ] [MAIN ] Derivative Progress: 790/1748 symbols completed. GRC took 1.2s. Estimated remaining: 6m 9s. Rate: 155.8 symbols/min [2025-10-07T22:39:05.639788] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:05.646549] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:05.648107] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 20854 primary records. [2025-10-07T22:39:05.648509] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-07T22:39:05.669723] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-10-07T22:39:05.670260] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-07T22:39:05.672457] [INFO ] [MAIN ] Derivative Progress: 791/1748 symbols completed. GRDN took 1.2s. Estimated remaining: 6m 8s. Rate: 156.0 symbols/min [2025-10-07T22:39:05.672664] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:05.693824] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:05.707286] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 40786 primary records. [2025-10-07T22:39:05.707442] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-07T22:39:05.750604] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-10-07T22:39:05.750780] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-07T22:39:05.752927] [INFO ] [MAIN ] Derivative Progress: 792/1748 symbols completed. GRMN took 0.9s. Estimated remaining: 6m 7s. Rate: 156.1 symbols/min [2025-10-07T22:39:05.755168] [DEBUG] [LOCAL ] GRND: Loaded 49989 existing records from primary storage. [2025-10-07T22:39:05.755407] [INFO ] [MAIN ] GRND: Loaded 49989 primary data records. [2025-10-07T22:39:05.755322] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:05.778986] [DEBUG] [LOCAL ] GRNT: Loaded 33812 existing records from primary storage. [2025-10-07T22:39:05.797757] [INFO ] [MAIN ] GRNT: Loaded 33812 primary data records. [2025-10-07T22:39:05.977694] [DEBUG] [LOCAL ] GROV: Loaded 8861 existing records from primary storage. [2025-10-07T22:39:06.014113] [INFO ] [MAIN ] GROV: Loaded 8861 primary data records. [2025-10-07T22:39:06.801118] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:06.802507] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33812 primary records. [2025-10-07T22:39:06.802752] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-07T22:39:06.838805] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-07T22:39:06.838174] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:06.839197] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-07T22:39:06.844266] [INFO ] [MAIN ] Derivative Progress: 793/1748 symbols completed. GRNT took 1.2s. Estimated remaining: 6m 8s. Rate: 155.8 symbols/min [2025-10-07T22:39:06.841271] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 49989 primary records. [2025-10-07T22:39:06.845343] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-07T22:39:06.873354] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:06.875391] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8861 primary records. [2025-10-07T22:39:06.875739] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-07T22:39:06.892125] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-07T22:39:06.892686] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-07T22:39:06.895393] [INFO ] [MAIN ] Derivative Progress: 794/1748 symbols completed. GRND took 1.3s. Estimated remaining: 6m 7s. Rate: 155.9 symbols/min [2025-10-07T22:39:06.898006] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-07T22:39:06.898118] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-07T22:39:06.900500] [INFO ] [MAIN ] Derivative Progress: 795/1748 symbols completed. GROV took 1.1s. Estimated remaining: 6m 6s. Rate: 156.1 symbols/min [2025-10-07T22:39:06.901175] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:06.901313] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:06.901093] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:06.911035] [DEBUG] [LOCAL ] GRX: Loaded 4786 existing records from primary storage. [2025-10-07T22:39:06.911277] [INFO ] [MAIN ] GRX: Loaded 4786 primary data records. [2025-10-07T22:39:07.283785] [DEBUG] [LOCAL ] GSBD: Loaded 39246 existing records from primary storage. [2025-10-07T22:39:07.284140] [INFO ] [MAIN ] GSBD: Loaded 39246 primary data records. [2025-10-07T22:39:07.418032] [DEBUG] [LOCAL ] GS: Loaded 51792 existing records from primary storage. [2025-10-07T22:39:07.421730] [INFO ] [MAIN ] GS: Loaded 51792 primary data records. [2025-10-07T22:39:07.986124] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:07.987719] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4786 primary records. [2025-10-07T22:39:07.987810] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-07T22:39:08.006114] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-10-07T22:39:08.007062] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-07T22:39:08.009509] [INFO ] [MAIN ] Derivative Progress: 796/1748 symbols completed. GRX took 1.1s. Estimated remaining: 6m 7s. Rate: 155.8 symbols/min [2025-10-07T22:39:08.010436] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:08.035297] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:08.050771] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39246 primary records. [2025-10-07T22:39:08.050955] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-07T22:39:08.051579] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:08.052944] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51792 primary records. [2025-10-07T22:39:08.053065] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-07T22:39:08.099116] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-07T22:39:08.099454] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-07T22:39:08.101495] [INFO ] [MAIN ] Derivative Progress: 797/1748 symbols completed. GSBD took 1.2s. Estimated remaining: 6m 6s. Rate: 155.9 symbols/min [2025-10-07T22:39:08.101843] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:08.104880] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-07T22:39:08.105034] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-07T22:39:08.107396] [INFO ] [MAIN ] Derivative Progress: 798/1748 symbols completed. GS took 1.2s. Estimated remaining: 6m 5s. Rate: 156.1 symbols/min [2025-10-07T22:39:08.107805] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:08.127014] [DEBUG] [LOCAL ] GSK: Loaded 53502 existing records from primary storage. [2025-10-07T22:39:08.127317] [INFO ] [MAIN ] GSK: Loaded 53502 primary data records. [2025-10-07T22:39:08.395043] [DEBUG] [LOCAL ] GSL: Loaded 33185 existing records from primary storage. [2025-10-07T22:39:08.521725] [DEBUG] [LOCAL ] GTES: Loaded 50458 existing records from primary storage. [2025-10-07T22:39:08.531019] [INFO ] [MAIN ] GSL: Loaded 33185 primary data records. [2025-10-07T22:39:08.531264] [INFO ] [MAIN ] GTES: Loaded 50458 primary data records. [2025-10-07T22:39:09.157958] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:09.161190] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53502 primary records. [2025-10-07T22:39:09.161566] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-07T22:39:09.182599] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-07T22:39:09.183032] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-07T22:39:09.185345] [INFO ] [MAIN ] Derivative Progress: 799/1748 symbols completed. GSK took 1.2s. Estimated remaining: 6m 6s. Rate: 155.8 symbols/min [2025-10-07T22:39:09.185536] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:09.219111] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:09.221159] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50458 primary records. [2025-10-07T22:39:09.220278] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:09.221343] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-07T22:39:09.222220] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33185 primary records. [2025-10-07T22:39:09.223464] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-07T22:39:09.256426] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-07T22:39:09.256910] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-07T22:39:09.259094] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-07T22:39:09.259006] [INFO ] [MAIN ] Derivative Progress: 800/1748 symbols completed. GTES took 1.2s. Estimated remaining: 6m 5s. Rate: 155.9 symbols/min [2025-10-07T22:39:09.259352] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-07T22:39:09.259480] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:09.272246] [INFO ] [MAIN ] Derivative Progress: 801/1748 symbols completed. GSL took 1.2s. Estimated remaining: 6m 4s. Rate: 156.1 symbols/min [2025-10-07T22:39:09.272446] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:09.295094] [DEBUG] [LOCAL ] GTLS: Loaded 42987 existing records from primary storage. [2025-10-07T22:39:09.295423] [INFO ] [MAIN ] GTLS: Loaded 42987 primary data records. [2025-10-07T22:39:09.435710] [DEBUG] [LOCAL ] GTY: Loaded 30174 existing records from primary storage. [2025-10-07T22:39:09.449956] [INFO ] [MAIN ] GTY: Loaded 30174 primary data records. [2025-10-07T22:39:09.785903] [DEBUG] [LOCAL ] GTN: Loaded 45327 existing records from primary storage. [2025-10-07T22:39:09.786224] [INFO ] [MAIN ] GTN: Loaded 45327 primary data records. [2025-10-07T22:39:10.364935] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:10.366605] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 42987 primary records. [2025-10-07T22:39:10.367032] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-07T22:39:10.386228] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-07T22:39:10.387317] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-07T22:39:10.390218] [INFO ] [MAIN ] Derivative Progress: 802/1748 symbols completed. GTLS took 1.2s. Estimated remaining: 6m 4s. Rate: 155.7 symbols/min [2025-10-07T22:39:10.390492] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:10.405805] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:10.406873] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30174 primary records. [2025-10-07T22:39:10.407045] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-07T22:39:10.434538] [DEBUG] [LOCAL ] GUG: Loaded 12172 existing records from primary storage. [2025-10-07T22:39:10.435303] [INFO ] [MAIN ] GUG: Loaded 12172 primary data records. [2025-10-07T22:39:10.438398] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-07T22:39:10.456222] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-07T22:39:10.478432] [INFO ] [MAIN ] Derivative Progress: 803/1748 symbols completed. GTY took 1.2s. Estimated remaining: 6m 4s. Rate: 155.9 symbols/min [2025-10-07T22:39:10.523635] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:10.524037] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:10.572949] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45327 primary records. [2025-10-07T22:39:10.584173] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-07T22:39:10.643855] [DEBUG] [LOCAL ] GUT: Loaded 15453 existing records from primary storage. [2025-10-07T22:39:10.660312] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-07T22:39:10.660403] [INFO ] [MAIN ] GUT: Loaded 15453 primary data records. [2025-10-07T22:39:10.669290] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-07T22:39:10.722097] [INFO ] [MAIN ] Derivative Progress: 804/1748 symbols completed. GTN took 1.5s. Estimated remaining: 6m 3s. Rate: 155.9 symbols/min [2025-10-07T22:39:10.850526] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:11.209594] [DEBUG] [LOCAL ] GVA: Loaded 32996 existing records from primary storage. [2025-10-07T22:39:11.210367] [INFO ] [MAIN ] GVA: Loaded 32996 primary data records. [2025-10-07T22:39:11.329811] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:11.352183] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12172 primary records. [2025-10-07T22:39:11.406373] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-07T22:39:11.601124] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-10-07T22:39:11.601612] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-07T22:39:11.618949] [INFO ] [MAIN ] Derivative Progress: 805/1748 symbols completed. GUG took 1.2s. Estimated remaining: 6m 3s. Rate: 155.7 symbols/min [2025-10-07T22:39:11.620516] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:11.620237] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:11.622291] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15453 primary records. [2025-10-07T22:39:11.622834] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-07T22:39:11.644246] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-07T22:39:11.644487] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-07T22:39:11.646922] [INFO ] [MAIN ] Derivative Progress: 806/1748 symbols completed. GUT took 1.1s. Estimated remaining: 6m 3s. Rate: 155.9 symbols/min [2025-10-07T22:39:11.647393] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:11.663875] [DEBUG] [LOCAL ] GWH: Loaded 16885 existing records from primary storage. [2025-10-07T22:39:11.664157] [INFO ] [MAIN ] GWH: Loaded 16885 primary data records. [2025-10-07T22:39:11.707790] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:11.720392] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 32996 primary records. [2025-10-07T22:39:11.740927] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-07T22:39:11.853830] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-10-07T22:39:11.896869] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-07T22:39:12.016858] [DEBUG] [LOCAL ] GWRE: Loaded 40202 existing records from primary storage. [2025-10-07T22:39:12.020141] [INFO ] [MAIN ] GWRE: Loaded 40202 primary data records. [2025-10-07T22:39:12.019996] [INFO ] [MAIN ] Derivative Progress: 807/1748 symbols completed. GVA took 1.2s. Estimated remaining: 6m 2s. Rate: 155.9 symbols/min [2025-10-07T22:39:12.020478] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:12.180601] [DEBUG] [LOCAL ] GWW: Loaded 19466 existing records from primary storage. [2025-10-07T22:39:12.216555] [INFO ] [MAIN ] GWW: Loaded 19466 primary data records. [2025-10-07T22:39:12.665147] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:12.667202] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 16885 primary records. [2025-10-07T22:39:12.668088] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-07T22:39:12.688822] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-07T22:39:12.689971] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-07T22:39:12.692723] [INFO ] [MAIN ] Derivative Progress: 808/1748 symbols completed. GWH took 1.1s. Estimated remaining: 6m 2s. Rate: 155.7 symbols/min [2025-10-07T22:39:12.707100] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:12.707917] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 40202 primary records. [2025-10-07T22:39:12.708124] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-07T22:39:12.724445] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-10-07T22:39:12.724804] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-07T22:39:12.726753] [INFO ] [MAIN ] Derivative Progress: 809/1748 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 1s. Rate: 155.9 symbols/min [2025-10-07T22:39:12.744807] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:12.745665] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19466 primary records. [2025-10-07T22:39:12.745741] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-07T22:39:12.762213] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-07T22:39:12.762281] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-07T22:39:12.766209] [INFO ] [MAIN ] Derivative Progress: 810/1748 symbols completed. GWW took 0.7s. Estimated remaining: 6m 1s. Rate: 156.1 symbols/min [2025-10-07T22:39:12.769402] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:12.769353] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:12.769295] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:12.774873] [DEBUG] [LOCAL ] GYLD: Loaded 1538 existing records from primary storage. [2025-10-07T22:39:12.775161] [INFO ] [MAIN ] GYLD: Loaded 1538 primary data records. [2025-10-07T22:39:13.158069] [DEBUG] [LOCAL ] H: Loaded 44572 existing records from primary storage. [2025-10-07T22:39:13.160218] [DEBUG] [LOCAL ] GXO: Loaded 47159 existing records from primary storage. [2025-10-07T22:39:13.161237] [INFO ] [MAIN ] H: Loaded 44572 primary data records. [2025-10-07T22:39:13.161151] [INFO ] [MAIN ] GXO: Loaded 47159 primary data records. [2025-10-07T22:39:13.916565] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:39:13.919366] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1538 primary records. [2025-10-07T22:39:13.921433] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-07T22:39:13.938258] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-10-07T22:39:13.940708] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-07T22:39:13.944458] [INFO ] [MAIN ] Derivative Progress: 811/1748 symbols completed. GYLD took 1.2s. Estimated remaining: 6m 1s. Rate: 155.7 symbols/min [2025-10-07T22:39:13.945042] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:13.984066] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:14.000596] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:14.001881] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44572 primary records. [2025-10-07T22:39:14.002097] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-07T22:39:14.003332] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47159 primary records. [2025-10-07T22:39:14.004528] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-07T22:39:14.048887] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-10-07T22:39:14.053767] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-07T22:39:14.051574] [DEBUG] [LOCAL ] HAE: Loaded 39434 existing records from primary storage. [2025-10-07T22:39:14.053467] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-10-07T22:39:14.056572] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-07T22:39:14.056194] [INFO ] [MAIN ] Derivative Progress: 812/1748 symbols completed. GXO took 1.3s. Estimated remaining: 6m 0s. Rate: 155.8 symbols/min [2025-10-07T22:39:14.060026] [INFO ] [MAIN ] HAE: Loaded 39434 primary data records. [2025-10-07T22:39:14.060213] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:14.060409] [INFO ] [MAIN ] Derivative Progress: 813/1748 symbols completed. H took 1.3s. Estimated remaining: 5m 60s. Rate: 156.0 symbols/min [2025-10-07T22:39:14.105799] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:14.439139] [DEBUG] [LOCAL ] HAFN: Loaded 43197 existing records from primary storage. [2025-10-07T22:39:14.440755] [INFO ] [MAIN ] HAFN: Loaded 43197 primary data records. [2025-10-07T22:39:14.569477] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-07T22:39:14.591468] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-07T22:39:14.931812] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:14.951387] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39434 primary records. [2025-10-07T22:39:14.951481] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-07T22:39:15.007683] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-10-07T22:39:15.117927] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-07T22:39:15.129017] [INFO ] [MAIN ] Derivative Progress: 814/1748 symbols completed. HAE took 1.2s. Estimated remaining: 5m 60s. Rate: 155.7 symbols/min [2025-10-07T22:39:15.129356] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:15.158066] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:15.158957] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43197 primary records. [2025-10-07T22:39:15.159318] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-07T22:39:15.188207] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-10-07T22:39:15.188409] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-07T22:39:15.190711] [INFO ] [MAIN ] Derivative Progress: 815/1748 symbols completed. HAFN took 1.1s. Estimated remaining: 5m 59s. Rate: 155.8 symbols/min [2025-10-07T22:39:15.191010] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:15.209155] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:15.222305] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-10-07T22:39:15.222516] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-07T22:39:15.224158] [DEBUG] [LOCAL ] HASI: Loaded 47253 existing records from primary storage. [2025-10-07T22:39:15.224463] [INFO ] [MAIN ] HASI: Loaded 47253 primary data records. [2025-10-07T22:39:15.239785] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-10-07T22:39:15.275515] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-07T22:39:15.296556] [INFO ] [MAIN ] Derivative Progress: 816/1748 symbols completed. HAL took 1.2s. Estimated remaining: 5m 59s. Rate: 156.0 symbols/min [2025-10-07T22:39:15.317201] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:15.491610] [DEBUG] [LOCAL ] HBB: Loaded 6499 existing records from primary storage. [2025-10-07T22:39:15.580413] [DEBUG] [LOCAL ] HAYW: Loaded 48748 existing records from primary storage. [2025-10-07T22:39:15.570037] [INFO ] [MAIN ] HBB: Loaded 6499 primary data records. [2025-10-07T22:39:15.580863] [INFO ] [MAIN ] HAYW: Loaded 48748 primary data records. [2025-10-07T22:39:16.322547] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:16.323807] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47253 primary records. [2025-10-07T22:39:16.324357] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-07T22:39:16.348081] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-10-07T22:39:16.348319] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-07T22:39:16.350308] [INFO ] [MAIN ] Derivative Progress: 817/1748 symbols completed. HASI took 1.2s. Estimated remaining: 5m 59s. Rate: 155.6 symbols/min [2025-10-07T22:39:16.350615] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:16.381208] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:16.381573] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:16.383686] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48748 primary records. [2025-10-07T22:39:16.382853] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6499 primary records. [2025-10-07T22:39:16.383930] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-07T22:39:16.384447] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-07T22:39:16.416258] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-10-07T22:39:16.418613] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-10-07T22:39:16.418970] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-07T22:39:16.418893] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-07T22:39:16.421293] [INFO ] [MAIN ] Derivative Progress: 818/1748 symbols completed. HBB took 1.1s. Estimated remaining: 5m 58s. Rate: 155.8 symbols/min [2025-10-07T22:39:16.423763] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:16.423958] [INFO ] [MAIN ] Derivative Progress: 819/1748 symbols completed. HAYW took 1.2s. Estimated remaining: 5m 57s. Rate: 156.0 symbols/min [2025-10-07T22:39:16.424611] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:16.482497] [DEBUG] [LOCAL ] HBI: Loaded 52991 existing records from primary storage. [2025-10-07T22:39:16.493442] [INFO ] [MAIN ] HBI: Loaded 52991 primary data records. [2025-10-07T22:39:16.636771] [DEBUG] [LOCAL ] HCA: Loaded 46862 existing records from primary storage. [2025-10-07T22:39:16.635285] [DEBUG] [LOCAL ] HBM: Loaded 52924 existing records from primary storage. [2025-10-07T22:39:16.642679] [INFO ] [MAIN ] HCA: Loaded 46862 primary data records. [2025-10-07T22:39:16.642581] [INFO ] [MAIN ] HBM: Loaded 52924 primary data records. [2025-10-07T22:39:17.509348] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:17.510481] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52991 primary records. [2025-10-07T22:39:17.510835] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-07T22:39:17.557944] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:17.558303] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:17.560006] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52924 primary records. [2025-10-07T22:39:17.561051] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-07T22:39:17.562811] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46862 primary records. [2025-10-07T22:39:17.563421] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-07T22:39:17.564220] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-10-07T22:39:17.564587] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-07T22:39:17.567044] [INFO ] [MAIN ] Derivative Progress: 820/1748 symbols completed. HBI took 1.2s. Estimated remaining: 5m 58s. Rate: 155.6 symbols/min [2025-10-07T22:39:17.567293] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:17.596315] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-10-07T22:39:17.596771] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-07T22:39:17.599046] [INFO ] [MAIN ] Derivative Progress: 821/1748 symbols completed. HBM took 1.2s. Estimated remaining: 5m 57s. Rate: 155.8 symbols/min [2025-10-07T22:39:17.599597] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:17.603779] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-10-07T22:39:17.604127] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-07T22:39:17.606140] [INFO ] [MAIN ] Derivative Progress: 822/1748 symbols completed. HCA took 1.2s. Estimated remaining: 5m 56s. Rate: 156.0 symbols/min [2025-10-07T22:39:17.606423] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:17.622083] [DEBUG] [LOCAL ] HCI: Loaded 14035 existing records from primary storage. [2025-10-07T22:39:17.622294] [INFO ] [MAIN ] HCI: Loaded 14035 primary data records. [2025-10-07T22:39:17.769009] [DEBUG] [LOCAL ] HCC: Loaded 45348 existing records from primary storage. [2025-10-07T22:39:17.842167] [INFO ] [MAIN ] HCC: Loaded 45348 primary data records. [2025-10-07T22:39:18.133766] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-07T22:39:18.153638] [INFO ] [MAIN ] HD: Loaded 53492 primary data records. [2025-10-07T22:39:18.633579] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:18.635276] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 14035 primary records. [2025-10-07T22:39:18.635514] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-07T22:39:18.660737] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-10-07T22:39:18.660998] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-07T22:39:18.664132] [INFO ] [MAIN ] Derivative Progress: 823/1748 symbols completed. HCI took 1.1s. Estimated remaining: 5m 57s. Rate: 155.6 symbols/min [2025-10-07T22:39:18.680299] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:18.681217] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45348 primary records. [2025-10-07T22:39:18.681408] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-07T22:39:18.716907] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-10-07T22:39:18.717079] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-07T22:39:18.719416] [INFO ] [MAIN ] Derivative Progress: 824/1748 symbols completed. HCC took 1.2s. Estimated remaining: 5m 56s. Rate: 155.8 symbols/min [2025-10-07T22:39:18.717002] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:18.720372] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53492 primary records. [2025-10-07T22:39:18.720442] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-07T22:39:18.736469] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-10-07T22:39:18.736542] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-07T22:39:18.738482] [INFO ] [MAIN ] Derivative Progress: 825/1748 symbols completed. HD took 1.1s. Estimated remaining: 5m 55s. Rate: 156.0 symbols/min [2025-10-07T22:39:18.739079] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:18.739525] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:18.739690] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:18.785281] [DEBUG] [LOCAL ] HEI: Loaded 31750 existing records from primary storage. [2025-10-07T22:39:18.785423] [INFO ] [MAIN ] HEI: Loaded 31750 primary data records. [2025-10-07T22:39:18.911178] [DEBUG] [LOCAL ] HDB: Loaded 51936 existing records from primary storage. [2025-10-07T22:39:18.915910] [INFO ] [MAIN ] HDB: Loaded 51936 primary data records. [2025-10-07T22:39:19.107588] [DEBUG] [LOCAL ] HE: Loaded 48998 existing records from primary storage. [2025-10-07T22:39:19.218418] [INFO ] [MAIN ] HE: Loaded 48998 primary data records. [2025-10-07T22:39:19.794748] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:19.795833] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 31750 primary records. [2025-10-07T22:39:19.796036] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-07T22:39:19.815638] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-10-07T22:39:19.828589] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-07T22:39:19.831401] [INFO ] [MAIN ] Derivative Progress: 826/1748 symbols completed. HEI took 1.1s. Estimated remaining: 5m 55s. Rate: 155.6 symbols/min [2025-10-07T22:39:19.829463] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:19.832466] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51936 primary records. [2025-10-07T22:39:19.832565] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-07T22:39:19.832869] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:19.866077] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-10-07T22:39:19.866195] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-07T22:39:19.872959] [INFO ] [MAIN ] Derivative Progress: 827/1748 symbols completed. HDB took 1.1s. Estimated remaining: 5m 55s. Rate: 155.8 symbols/min [2025-10-07T22:39:19.865779] [DEBUG] [LOCAL ] HEQ: Loaded 6524 existing records from primary storage. [2025-10-07T22:39:19.873887] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:19.873385] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:19.873638] [INFO ] [MAIN ] HEQ: Loaded 6524 primary data records. [2025-10-07T22:39:19.895342] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 48998 primary records. [2025-10-07T22:39:19.911193] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-07T22:39:20.030515] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-10-07T22:39:20.063105] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-07T22:39:20.176495] [INFO ] [MAIN ] Derivative Progress: 828/1748 symbols completed. HE took 1.4s. Estimated remaining: 5m 54s. Rate: 155.8 symbols/min [2025-10-07T22:39:20.185380] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:20.231708] [DEBUG] [LOCAL ] HESM: Loaded 48284 existing records from primary storage. [2025-10-07T22:39:20.232424] [DEBUG] [LOCAL ] HFRO: Loaded 17508 existing records from primary storage. [2025-10-07T22:39:20.233023] [INFO ] [MAIN ] HFRO: Loaded 17508 primary data records. [2025-10-07T22:39:20.232949] [INFO ] [MAIN ] HESM: Loaded 48284 primary data records. [2025-10-07T22:39:20.430429] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:20.464371] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6524 primary records. [2025-10-07T22:39:20.464617] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-07T22:39:20.868241] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-10-07T22:39:20.878412] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-07T22:39:20.880600] [INFO ] [MAIN ] Derivative Progress: 829/1748 symbols completed. HEQ took 1.0s. Estimated remaining: 5m 54s. Rate: 155.7 symbols/min [2025-10-07T22:39:20.882018] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:20.903904] [DEBUG] [LOCAL ] HGER: Loaded 14155 existing records from primary storage. [2025-10-07T22:39:20.904300] [INFO ] [MAIN ] HGER: Loaded 14155 primary data records. [2025-10-07T22:39:21.026152] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:21.032853] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48284 primary records. [2025-10-07T22:39:21.053014] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-07T22:39:21.082107] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:21.119928] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17508 primary records. [2025-10-07T22:39:21.230341] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-07T22:39:21.268451] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-10-07T22:39:21.281479] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-07T22:39:21.284166] [INFO ] [MAIN ] Derivative Progress: 830/1748 symbols completed. HESM took 1.4s. Estimated remaining: 5m 54s. Rate: 155.7 symbols/min [2025-10-07T22:39:21.284619] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:21.287789] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-10-07T22:39:21.287901] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-07T22:39:21.290031] [INFO ] [MAIN ] Derivative Progress: 831/1748 symbols completed. HFRO took 1.1s. Estimated remaining: 5m 53s. Rate: 155.9 symbols/min [2025-10-07T22:39:21.290248] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:21.303738] [DEBUG] [LOCAL ] HGLB: Loaded 9696 existing records from primary storage. [2025-10-07T22:39:21.304105] [INFO ] [MAIN ] HGLB: Loaded 9696 primary data records. [2025-10-07T22:39:21.418894] [DEBUG] [LOCAL ] HGTY: Loaded 13274 existing records from primary storage. [2025-10-07T22:39:21.424797] [INFO ] [MAIN ] HGTY: Loaded 13274 primary data records. [2025-10-07T22:39:21.526637] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:21.690915] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 14155 primary records. [2025-10-07T22:39:21.722584] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-07T22:39:21.777381] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-10-07T22:39:21.831719] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-07T22:39:21.890971] [INFO ] [MAIN ] Derivative Progress: 832/1748 symbols completed. HGER took 1.0s. Estimated remaining: 5m 53s. Rate: 155.8 symbols/min [2025-10-07T22:39:21.992229] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:22.019479] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:22.020442] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9696 primary records. [2025-10-07T22:39:22.020715] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-07T22:39:22.048126] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-10-07T22:39:22.050123] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-07T22:39:22.052308] [INFO ] [MAIN ] Derivative Progress: 833/1748 symbols completed. HGLB took 0.8s. Estimated remaining: 5m 52s. Rate: 155.9 symbols/min [2025-10-07T22:39:22.052818] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:22.067343] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:22.068251] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13274 primary records. [2025-10-07T22:39:22.068408] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-07T22:39:22.084829] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-10-07T22:39:22.096596] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-07T22:39:22.099791] [INFO ] [MAIN ] Derivative Progress: 834/1748 symbols completed. HGTY took 0.8s. Estimated remaining: 5m 51s. Rate: 156.0 symbols/min [2025-10-07T22:39:22.101006] [DEBUG] [LOCAL ] HGV: Loaded 46457 existing records from primary storage. [2025-10-07T22:39:22.101316] [INFO ] [MAIN ] HGV: Loaded 46457 primary data records. [2025-10-07T22:39:22.101139] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:22.251165] [DEBUG] [LOCAL ] HHH: Loaded 32912 existing records from primary storage. [2025-10-07T22:39:22.287491] [INFO ] [MAIN ] HHH: Loaded 32912 primary data records. [2025-10-07T22:39:22.553453] [DEBUG] [LOCAL ] HI: Loaded 35337 existing records from primary storage. [2025-10-07T22:39:22.557773] [INFO ] [MAIN ] HI: Loaded 35337 primary data records. [2025-10-07T22:39:23.075153] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:23.076338] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46457 primary records. [2025-10-07T22:39:23.076460] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-07T22:39:23.093832] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-10-07T22:39:23.093980] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-07T22:39:23.096021] [INFO ] [MAIN ] Derivative Progress: 835/1748 symbols completed. HGV took 1.1s. Estimated remaining: 5m 52s. Rate: 155.7 symbols/min [2025-10-07T22:39:23.096340] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:23.115935] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:23.116912] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32912 primary records. [2025-10-07T22:39:23.117081] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-07T22:39:23.146524] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:23.147616] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35337 primary records. [2025-10-07T22:39:23.147750] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-07T22:39:23.168259] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-10-07T22:39:23.168378] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-07T22:39:23.170851] [INFO ] [MAIN ] Derivative Progress: 836/1748 symbols completed. HI took 1.1s. Estimated remaining: 5m 51s. Rate: 155.9 symbols/min [2025-10-07T22:39:23.171728] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:23.171566] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-10-07T22:39:23.172247] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-07T22:39:23.174342] [INFO ] [MAIN ] Derivative Progress: 837/1748 symbols completed. HHH took 1.1s. Estimated remaining: 5m 50s. Rate: 156.1 symbols/min [2025-10-07T22:39:23.174469] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:23.212892] [DEBUG] [LOCAL ] HIG: Loaded 51176 existing records from primary storage. [2025-10-07T22:39:23.213045] [INFO ] [MAIN ] HIG: Loaded 51176 primary data records. [2025-10-07T22:39:23.360437] [DEBUG] [LOCAL ] HII: Loaded 34213 existing records from primary storage. [2025-10-07T22:39:23.424084] [INFO ] [MAIN ] HII: Loaded 34213 primary data records. [2025-10-07T22:39:23.649365] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-07T22:39:23.660060] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-07T22:39:24.297213] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:24.299476] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51176 primary records. [2025-10-07T22:39:24.299919] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-07T22:39:24.329065] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-10-07T22:39:24.356393] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:24.355863] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-07T22:39:24.358979] [INFO ] [MAIN ] Derivative Progress: 838/1748 symbols completed. HIG took 1.3s. Estimated remaining: 5m 51s. Rate: 155.7 symbols/min [2025-10-07T22:39:24.359385] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:24.360477] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-10-07T22:39:24.361380] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 34213 primary records. [2025-10-07T22:39:24.361491] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-07T22:39:24.361589] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-07T22:39:24.393595] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-10-07T22:39:24.393914] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-07T22:39:24.396479] [INFO ] [MAIN ] Derivative Progress: 839/1748 symbols completed. HIMS took 1.2s. Estimated remaining: 5m 50s. Rate: 155.8 symbols/min [2025-10-07T22:39:24.394255] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-10-07T22:39:24.396741] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-07T22:39:24.399240] [INFO ] [MAIN ] Derivative Progress: 840/1748 symbols completed. HII took 1.2s. Estimated remaining: 5m 49s. Rate: 156.0 symbols/min [2025-10-07T22:39:24.400224] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:24.400376] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:24.400155] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:24.423577] [DEBUG] [LOCAL ] HIPO: Loaded 22014 existing records from primary storage. [2025-10-07T22:39:24.423733] [INFO ] [MAIN ] HIPO: Loaded 22014 primary data records. [2025-10-07T22:39:24.549576] [DEBUG] [LOCAL ] HIO: Loaded 24020 existing records from primary storage. [2025-10-07T22:39:24.592716] [INFO ] [MAIN ] HIO: Loaded 24020 primary data records. [2025-10-07T22:39:24.672146] [DEBUG] [LOCAL ] HIW: Loaded 44561 existing records from primary storage. [2025-10-07T22:39:24.812392] [INFO ] [MAIN ] HIW: Loaded 44561 primary data records. [2025-10-07T22:39:25.396261] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:25.397681] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22014 primary records. [2025-10-07T22:39:25.398061] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-07T22:39:25.420605] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-10-07T22:39:25.420776] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-07T22:39:25.422970] [INFO ] [MAIN ] Derivative Progress: 841/1748 symbols completed. HIPO took 1.0s. Estimated remaining: 5m 49s. Rate: 155.7 symbols/min [2025-10-07T22:39:25.423288] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:25.438263] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:25.439351] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 24020 primary records. [2025-10-07T22:39:25.439569] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-07T22:39:25.470729] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:25.478000] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44561 primary records. [2025-10-07T22:39:25.478151] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-07T22:39:25.481183] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-10-07T22:39:25.494994] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-07T22:39:25.502881] [INFO ] [MAIN ] Derivative Progress: 842/1748 symbols completed. HIO took 1.1s. Estimated remaining: 5m 49s. Rate: 155.9 symbols/min [2025-10-07T22:39:25.504301] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:25.503350] [DEBUG] [LOCAL ] HIX: Loaded 20709 existing records from primary storage. [2025-10-07T22:39:25.505197] [INFO ] [MAIN ] HIX: Loaded 20709 primary data records. [2025-10-07T22:39:25.609993] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-10-07T22:39:25.633484] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-07T22:39:25.647382] [INFO ] [MAIN ] Derivative Progress: 843/1748 symbols completed. HIW took 1.2s. Estimated remaining: 5m 48s. Rate: 156.0 symbols/min [2025-10-07T22:39:25.647623] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:25.648185] [DEBUG] [LOCAL ] HKD: Loaded 18519 existing records from primary storage. [2025-10-07T22:39:25.664849] [INFO ] [MAIN ] HKD: Loaded 18519 primary data records. [2025-10-07T22:39:26.245211] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-10-07T22:39:26.246471] [INFO ] [MAIN ] HL: Loaded 53671 primary data records. [2025-10-07T22:39:26.394678] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:26.423408] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20709 primary records. [2025-10-07T22:39:26.573586] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-07T22:39:26.610113] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-10-07T22:39:26.610484] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-07T22:39:26.610886] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:26.613458] [INFO ] [MAIN ] Derivative Progress: 844/1748 symbols completed. HIX took 1.2s. Estimated remaining: 5m 48s. Rate: 155.7 symbols/min [2025-10-07T22:39:26.614013] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:26.615077] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18519 primary records. [2025-10-07T22:39:26.615632] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-07T22:39:26.634226] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-10-07T22:39:26.634499] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-07T22:39:26.636761] [INFO ] [MAIN ] Derivative Progress: 845/1748 symbols completed. HKD took 1.1s. Estimated remaining: 5m 48s. Rate: 155.9 symbols/min [2025-10-07T22:39:26.637204] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:26.657062] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:26.657846] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53671 primary records. [2025-10-07T22:39:26.657909] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-07T22:39:26.693983] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-10-07T22:39:26.694128] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-07T22:39:26.696256] [INFO ] [MAIN ] Derivative Progress: 846/1748 symbols completed. HL took 1.0s. Estimated remaining: 5m 47s. Rate: 156.0 symbols/min [2025-10-07T22:39:26.696599] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:26.725908] [DEBUG] [LOCAL ] HLF: Loaded 48469 existing records from primary storage. [2025-10-07T22:39:26.726720] [INFO ] [MAIN ] HLF: Loaded 48469 primary data records. [2025-10-07T22:39:26.726483] [DEBUG] [LOCAL ] HLI: Loaded 30814 existing records from primary storage. [2025-10-07T22:39:26.738236] [INFO ] [MAIN ] HLI: Loaded 30814 primary data records. [2025-10-07T22:39:27.029683] [DEBUG] [LOCAL ] HLIO: Loaded 27889 existing records from primary storage. [2025-10-07T22:39:27.146052] [INFO ] [MAIN ] HLIO: Loaded 27889 primary data records. [2025-10-07T22:39:27.700079] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:27.703634] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48469 primary records. [2025-10-07T22:39:27.703812] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-07T22:39:27.732264] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:27.733204] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30814 primary records. [2025-10-07T22:39:27.735281] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-07T22:39:27.735217] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-10-07T22:39:27.736135] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-07T22:39:27.738298] [INFO ] [MAIN ] Derivative Progress: 847/1748 symbols completed. HLF took 1.1s. Estimated remaining: 5m 47s. Rate: 155.7 symbols/min [2025-10-07T22:39:27.739104] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:27.757351] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-10-07T22:39:27.770548] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-07T22:39:27.773059] [INFO ] [MAIN ] Derivative Progress: 848/1748 symbols completed. HLI took 1.1s. Estimated remaining: 5m 46s. Rate: 155.9 symbols/min [2025-10-07T22:39:27.773238] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:27.770812] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:27.774397] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 27889 primary records. [2025-10-07T22:39:27.774745] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-07T22:39:27.794078] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-10-07T22:39:27.794198] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-07T22:39:27.796682] [INFO ] [MAIN ] Derivative Progress: 849/1748 symbols completed. HLIO took 1.1s. Estimated remaining: 5m 46s. Rate: 156.1 symbols/min [2025-10-07T22:39:27.805326] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:27.821571] [DEBUG] [LOCAL ] HLLY: Loaded 33426 existing records from primary storage. [2025-10-07T22:39:27.821842] [INFO ] [MAIN ] HLLY: Loaded 33426 primary data records. [2025-10-07T22:39:28.206389] [DEBUG] [LOCAL ] HLN: Loaded 53099 existing records from primary storage. [2025-10-07T22:39:28.206687] [INFO ] [MAIN ] HLN: Loaded 53099 primary data records. [2025-10-07T22:39:28.233395] [DEBUG] [LOCAL ] HLT: Loaded 50618 existing records from primary storage. [2025-10-07T22:39:28.250950] [INFO ] [MAIN ] HLT: Loaded 50618 primary data records. [2025-10-07T22:39:28.860515] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:28.862150] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33426 primary records. [2025-10-07T22:39:28.862497] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-07T22:39:28.880231] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-10-07T22:39:28.880356] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-07T22:39:28.882871] [INFO ] [MAIN ] Derivative Progress: 850/1748 symbols completed. HLLY took 1.1s. Estimated remaining: 5m 46s. Rate: 155.7 symbols/min [2025-10-07T22:39:28.883962] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:28.901424] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:28.902282] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53099 primary records. [2025-10-07T22:39:28.902383] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-07T22:39:28.919544] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-10-07T22:39:28.919718] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-07T22:39:28.921551] [INFO ] [MAIN ] Derivative Progress: 851/1748 symbols completed. HLN took 1.1s. Estimated remaining: 5m 45s. Rate: 155.9 symbols/min [2025-10-07T22:39:28.921787] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:28.939102] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:28.939837] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50618 primary records. [2025-10-07T22:39:28.940033] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-07T22:39:28.966923] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-10-07T22:39:28.967112] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-07T22:39:28.969414] [INFO ] [MAIN ] Derivative Progress: 852/1748 symbols completed. HLT took 1.2s. Estimated remaining: 5m 44s. Rate: 156.1 symbols/min [2025-10-07T22:39:28.969683] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:28.987443] [DEBUG] [LOCAL ] HLX: Loaded 47654 existing records from primary storage. [2025-10-07T22:39:28.987598] [INFO ] [MAIN ] HLX: Loaded 47654 primary data records. [2025-10-07T22:39:29.118579] [DEBUG] [LOCAL ] HMN: Loaded 23451 existing records from primary storage. [2025-10-07T22:39:29.153708] [INFO ] [MAIN ] HMN: Loaded 23451 primary data records. [2025-10-07T22:39:29.201485] [DEBUG] [LOCAL ] HMC: Loaded 46638 existing records from primary storage. [2025-10-07T22:39:29.355615] [INFO ] [MAIN ] HMC: Loaded 46638 primary data records. [2025-10-07T22:39:29.998443] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:29.999690] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47654 primary records. [2025-10-07T22:39:30.000367] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-07T22:39:30.021501] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-10-07T22:39:30.021734] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-07T22:39:30.023737] [INFO ] [MAIN ] Derivative Progress: 853/1748 symbols completed. HLX took 1.1s. Estimated remaining: 5m 45s. Rate: 155.7 symbols/min [2025-10-07T22:39:30.039214] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:30.040274] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23451 primary records. [2025-10-07T22:39:30.040377] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-07T22:39:30.073216] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:30.074302] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-10-07T22:39:30.074510] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-07T22:39:30.075237] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46638 primary records. [2025-10-07T22:39:30.077703] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-07T22:39:30.077607] [INFO ] [MAIN ] Derivative Progress: 854/1748 symbols completed. HMN took 1.1s. Estimated remaining: 5m 44s. Rate: 155.9 symbols/min [2025-10-07T22:39:30.093559] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-10-07T22:39:30.093624] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-07T22:39:30.095806] [INFO ] [MAIN ] Derivative Progress: 855/1748 symbols completed. HMC took 1.2s. Estimated remaining: 5m 43s. Rate: 156.1 symbols/min [2025-10-07T22:39:30.096564] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:30.096393] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:30.096494] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:30.131942] [DEBUG] [LOCAL ] HNI: Loaded 29406 existing records from primary storage. [2025-10-07T22:39:30.132160] [INFO ] [MAIN ] HNI: Loaded 29406 primary data records. [2025-10-07T22:39:30.360546] [DEBUG] [LOCAL ] HOG: Loaded 51064 existing records from primary storage. [2025-10-07T22:39:30.374443] [INFO ] [MAIN ] HOG: Loaded 51064 primary data records. [2025-10-07T22:39:30.490260] [DEBUG] [LOCAL ] HMY: Loaded 53140 existing records from primary storage. [2025-10-07T22:39:30.512060] [INFO ] [MAIN ] HMY: Loaded 53140 primary data records. [2025-10-07T22:39:31.114223] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:31.115141] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29406 primary records. [2025-10-07T22:39:31.116261] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-07T22:39:31.139884] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-10-07T22:39:31.142869] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-07T22:39:31.166914] [INFO ] [MAIN ] Derivative Progress: 856/1748 symbols completed. HNI took 1.1s. Estimated remaining: 5m 44s. Rate: 155.7 symbols/min [2025-10-07T22:39:31.164711] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:31.167995] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51064 primary records. [2025-10-07T22:39:31.167217] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:31.173693] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:31.173872] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-07T22:39:31.174613] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53140 primary records. [2025-10-07T22:39:31.176179] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-07T22:39:31.208623] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-10-07T22:39:31.208837] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-07T22:39:31.212163] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-10-07T22:39:31.212430] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-07T22:39:31.211177] [INFO ] [MAIN ] Derivative Progress: 857/1748 symbols completed. HOG took 1.1s. Estimated remaining: 5m 43s. Rate: 155.9 symbols/min [2025-10-07T22:39:31.214699] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:31.214830] [INFO ] [MAIN ] Derivative Progress: 858/1748 symbols completed. HMY took 1.1s. Estimated remaining: 5m 42s. Rate: 156.1 symbols/min [2025-10-07T22:39:31.215167] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:31.248584] [DEBUG] [LOCAL ] HOMB: Loaded 43458 existing records from primary storage. [2025-10-07T22:39:31.248890] [INFO ] [MAIN ] HOMB: Loaded 43458 primary data records. [2025-10-07T22:39:31.322684] [DEBUG] [LOCAL ] HOV: Loaded 13932 existing records from primary storage. [2025-10-07T22:39:31.334026] [INFO ] [MAIN ] HOV: Loaded 13932 primary data records. [2025-10-07T22:39:31.590790] [DEBUG] [LOCAL ] HOUS: Loaded 44807 existing records from primary storage. [2025-10-07T22:39:31.691013] [INFO ] [MAIN ] HOUS: Loaded 44807 primary data records. [2025-10-07T22:39:32.279246] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:32.280262] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43458 primary records. [2025-10-07T22:39:32.280588] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-07T22:39:32.313703] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:32.315417] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13932 primary records. [2025-10-07T22:39:32.316396] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-07T22:39:32.330443] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-10-07T22:39:32.331249] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-07T22:39:32.333827] [INFO ] [MAIN ] Derivative Progress: 859/1748 symbols completed. HOMB took 1.2s. Estimated remaining: 5m 43s. Rate: 155.7 symbols/min [2025-10-07T22:39:32.337953] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-10-07T22:39:32.336831] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:32.338214] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-07T22:39:32.340874] [INFO ] [MAIN ] Derivative Progress: 860/1748 symbols completed. HOV took 1.1s. Estimated remaining: 5m 42s. Rate: 155.9 symbols/min [2025-10-07T22:39:32.341142] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:32.360165] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:32.360930] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 44807 primary records. [2025-10-07T22:39:32.361165] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-07T22:39:32.378752] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-10-07T22:39:32.378965] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-07T22:39:32.381197] [INFO ] [MAIN ] Derivative Progress: 861/1748 symbols completed. HOUS took 1.2s. Estimated remaining: 5m 41s. Rate: 156.1 symbols/min [2025-10-07T22:39:32.381452] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:32.433042] [DEBUG] [LOCAL ] HP: Loaded 51653 existing records from primary storage. [2025-10-07T22:39:32.436803] [DEBUG] [LOCAL ] HPF: Loaded 7495 existing records from primary storage. [2025-10-07T22:39:32.436930] [INFO ] [MAIN ] HP: Loaded 51653 primary data records. [2025-10-07T22:39:32.436988] [INFO ] [MAIN ] HPF: Loaded 7495 primary data records. [2025-10-07T22:39:32.586250] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-07T22:39:32.609058] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-07T22:39:33.410693] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:33.411978] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51653 primary records. [2025-10-07T22:39:33.412512] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-07T22:39:33.435370] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:33.438716] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7495 primary records. [2025-10-07T22:39:33.439970] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-07T22:39:33.458315] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-10-07T22:39:33.472514] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-07T22:39:33.474903] [INFO ] [MAIN ] Derivative Progress: 862/1748 symbols completed. HPF took 1.1s. Estimated remaining: 5m 41s. Rate: 155.7 symbols/min [2025-10-07T22:39:33.475896] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:33.475232] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:33.477739] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-10-07T22:39:33.477908] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-10-07T22:39:33.478348] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-07T22:39:33.480310] [INFO ] [MAIN ] Derivative Progress: 863/1748 symbols completed. HP took 1.1s. Estimated remaining: 5m 41s. Rate: 155.9 symbols/min [2025-10-07T22:39:33.478447] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-07T22:39:33.480445] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:33.500883] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-10-07T22:39:33.501088] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-07T22:39:33.503469] [INFO ] [MAIN ] Derivative Progress: 864/1748 symbols completed. HPE took 1.2s. Estimated remaining: 5m 40s. Rate: 156.1 symbols/min [2025-10-07T22:39:33.508559] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:33.508362] [DEBUG] [LOCAL ] HPI: Loaded 10570 existing records from primary storage. [2025-10-07T22:39:33.509179] [INFO ] [MAIN ] HPI: Loaded 10570 primary data records. [2025-10-07T22:39:33.719342] [DEBUG] [LOCAL ] HPP: Loaded 51040 existing records from primary storage. [2025-10-07T22:39:33.831240] [INFO ] [MAIN ] HPP: Loaded 51040 primary data records. [2025-10-07T22:39:33.985618] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-07T22:39:34.061428] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-10-07T22:39:34.562110] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:34.563474] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10570 primary records. [2025-10-07T22:39:34.563735] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-07T22:39:34.591357] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-10-07T22:39:34.599921] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-07T22:39:34.608295] [INFO ] [MAIN ] Derivative Progress: 865/1748 symbols completed. HPI took 1.1s. Estimated remaining: 5m 40s. Rate: 155.8 symbols/min [2025-10-07T22:39:34.609111] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:34.608733] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:34.610681] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 51040 primary records. [2025-10-07T22:39:34.611810] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-07T22:39:34.638403] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-10-07T22:39:34.638534] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-07T22:39:34.641183] [INFO ] [MAIN ] Derivative Progress: 866/1748 symbols completed. HPP took 1.2s. Estimated remaining: 5m 39s. Rate: 155.9 symbols/min [2025-10-07T22:39:34.641360] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:34.651599] [DEBUG] [LOCAL ] HPS: Loaded 10266 existing records from primary storage. [2025-10-07T22:39:34.651992] [INFO ] [MAIN ] HPS: Loaded 10266 primary data records. [2025-10-07T22:39:34.705233] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:34.741794] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-10-07T22:39:34.753057] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-07T22:39:34.867336] [DEBUG] [LOCAL ] HQH: Loaded 25466 existing records from primary storage. [2025-10-07T22:39:34.886711] [INFO ] [MAIN ] HQH: Loaded 25466 primary data records. [2025-10-07T22:39:35.098769] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-10-07T22:39:35.099346] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-07T22:39:35.107595] [INFO ] [MAIN ] Derivative Progress: 867/1748 symbols completed. HPQ took 1.6s. Estimated remaining: 5m 39s. Rate: 155.9 symbols/min [2025-10-07T22:39:35.115075] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:35.329447] [DEBUG] [LOCAL ] HQL: Loaded 16555 existing records from primary storage. [2025-10-07T22:39:35.330787] [INFO ] [MAIN ] HQL: Loaded 16555 primary data records. [2025-10-07T22:39:35.646816] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:35.647906] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10266 primary records. [2025-10-07T22:39:35.648121] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-07T22:39:35.683496] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-10-07T22:39:35.683409] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:35.684351] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25466 primary records. [2025-10-07T22:39:35.684491] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-07T22:39:35.684582] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-07T22:39:35.687873] [INFO ] [MAIN ] Derivative Progress: 868/1748 symbols completed. HPS took 1.1s. Estimated remaining: 5m 39s. Rate: 155.8 symbols/min [2025-10-07T22:39:35.705610] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-10-07T22:39:35.705719] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-07T22:39:35.707907] [INFO ] [MAIN ] Derivative Progress: 869/1748 symbols completed. HQH took 1.1s. Estimated remaining: 5m 38s. Rate: 156.0 symbols/min [2025-10-07T22:39:35.723180] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:35.723849] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16555 primary records. [2025-10-07T22:39:35.723910] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-07T22:39:35.739252] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-10-07T22:39:35.739312] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-07T22:39:35.741459] [INFO ] [MAIN ] Derivative Progress: 870/1748 symbols completed. HQL took 0.6s. Estimated remaining: 5m 37s. Rate: 156.1 symbols/min [2025-10-07T22:39:35.742311] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:35.742235] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:35.742879] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:35.824772] [DEBUG] [LOCAL ] HRI: Loaded 32653 existing records from primary storage. [2025-10-07T22:39:35.825042] [INFO ] [MAIN ] HRI: Loaded 32653 primary data records. [2025-10-07T22:39:35.869340] [DEBUG] [LOCAL ] HRB: Loaded 48437 existing records from primary storage. [2025-10-07T22:39:35.895073] [INFO ] [MAIN ] HRB: Loaded 48437 primary data records. [2025-10-07T22:39:35.968920] [DEBUG] [LOCAL ] HR: Loaded 51972 existing records from primary storage. [2025-10-07T22:39:36.049154] [INFO ] [MAIN ] HR: Loaded 51972 primary data records. [2025-10-07T22:39:36.817275] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:36.818261] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 32653 primary records. [2025-10-07T22:39:36.819397] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-07T22:39:36.851431] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-10-07T22:39:36.851768] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:36.851911] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-07T22:39:36.854102] [INFO ] [MAIN ] Derivative Progress: 871/1748 symbols completed. HRI took 1.1s. Estimated remaining: 5m 38s. Rate: 155.8 symbols/min [2025-10-07T22:39:36.854944] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48437 primary records. [2025-10-07T22:39:36.855057] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-07T22:39:36.855299] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:36.886560] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:36.888563] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51972 primary records. [2025-10-07T22:39:36.889423] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-07T22:39:36.890568] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-10-07T22:39:36.890990] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-07T22:39:36.893532] [INFO ] [MAIN ] Derivative Progress: 872/1748 symbols completed. HRB took 1.2s. Estimated remaining: 5m 37s. Rate: 155.9 symbols/min [2025-10-07T22:39:36.902518] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:36.911216] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-10-07T22:39:36.911303] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-07T22:39:36.913745] [INFO ] [MAIN ] Derivative Progress: 873/1748 symbols completed. HR took 1.2s. Estimated remaining: 5m 36s. Rate: 156.1 symbols/min [2025-10-07T22:39:36.914036] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:36.944211] [DEBUG] [LOCAL ] HSHP: Loaded 15141 existing records from primary storage. [2025-10-07T22:39:36.944402] [INFO ] [MAIN ] HSHP: Loaded 15141 primary data records. [2025-10-07T22:39:36.997436] [DEBUG] [LOCAL ] HRL: Loaded 53093 existing records from primary storage. [2025-10-07T22:39:37.020948] [INFO ] [MAIN ] HRL: Loaded 53093 primary data records. [2025-10-07T22:39:37.163547] [DEBUG] [LOCAL ] HRTG: Loaded 33749 existing records from primary storage. [2025-10-07T22:39:37.174393] [INFO ] [MAIN ] HRTG: Loaded 33749 primary data records. [2025-10-07T22:39:37.988876] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:37.991231] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15141 primary records. [2025-10-07T22:39:37.992231] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-07T22:39:38.014322] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:38.020968] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53093 primary records. [2025-10-07T22:39:38.021873] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-10-07T22:39:38.021956] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-07T22:39:38.022032] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-07T22:39:38.023795] [INFO ] [MAIN ] Derivative Progress: 874/1748 symbols completed. HSHP took 1.1s. Estimated remaining: 5m 37s. Rate: 155.8 symbols/min [2025-10-07T22:39:38.024950] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:38.052672] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-10-07T22:39:38.057948] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-07T22:39:38.060245] [INFO ] [MAIN ] Derivative Progress: 875/1748 symbols completed. HRL took 1.2s. Estimated remaining: 5m 36s. Rate: 155.9 symbols/min [2025-10-07T22:39:38.060606] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:38.060779] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:38.061681] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 33749 primary records. [2025-10-07T22:39:38.062281] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-07T22:39:38.081070] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-10-07T22:39:38.081267] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-07T22:39:38.083469] [INFO ] [MAIN ] Derivative Progress: 876/1748 symbols completed. HRTG took 1.2s. Estimated remaining: 5m 35s. Rate: 156.1 symbols/min [2025-10-07T22:39:38.083794] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:38.097328] [DEBUG] [LOCAL ] HTD: Loaded 13918 existing records from primary storage. [2025-10-07T22:39:38.107765] [INFO ] [MAIN ] HTD: Loaded 13918 primary data records. [2025-10-07T22:39:38.244327] [DEBUG] [LOCAL ] HSY: Loaded 50359 existing records from primary storage. [2025-10-07T22:39:38.250711] [INFO ] [MAIN ] HSY: Loaded 50359 primary data records. [2025-10-07T22:39:38.565226] [DEBUG] [LOCAL ] HTGC: Loaded 47448 existing records from primary storage. [2025-10-07T22:39:38.568894] [INFO ] [MAIN ] HTGC: Loaded 47448 primary data records. [2025-10-07T22:39:39.092840] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:39.093813] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13918 primary records. [2025-10-07T22:39:39.094182] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-07T22:39:39.114163] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-10-07T22:39:39.114321] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-07T22:39:39.116430] [INFO ] [MAIN ] Derivative Progress: 877/1748 symbols completed. HTD took 1.1s. Estimated remaining: 5m 35s. Rate: 155.8 symbols/min [2025-10-07T22:39:39.116725] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:39.130583] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:39.131483] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50359 primary records. [2025-10-07T22:39:39.131825] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-07T22:39:39.163887] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:39.165441] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47448 primary records. [2025-10-07T22:39:39.165559] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-07T22:39:39.167337] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-10-07T22:39:39.167584] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-07T22:39:39.176975] [INFO ] [MAIN ] Derivative Progress: 878/1748 symbols completed. HSY took 1.2s. Estimated remaining: 5m 35s. Rate: 156.0 symbols/min [2025-10-07T22:39:39.188614] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:39.195213] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-10-07T22:39:39.195404] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-07T22:39:39.197734] [INFO ] [MAIN ] Derivative Progress: 879/1748 symbols completed. HTGC took 1.1s. Estimated remaining: 5m 34s. Rate: 156.1 symbols/min [2025-10-07T22:39:39.197970] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:39.209450] [DEBUG] [LOCAL ] HTH: Loaded 32391 existing records from primary storage. [2025-10-07T22:39:39.209744] [INFO ] [MAIN ] HTH: Loaded 32391 primary data records. [2025-10-07T22:39:39.561031] [DEBUG] [LOCAL ] HUBB: Loaded 36598 existing records from primary storage. [2025-10-07T22:39:39.572121] [INFO ] [MAIN ] HUBB: Loaded 36598 primary data records. [2025-10-07T22:39:39.572999] [DEBUG] [LOCAL ] HUBS: Loaded 39612 existing records from primary storage. [2025-10-07T22:39:39.589325] [INFO ] [MAIN ] HUBS: Loaded 39612 primary data records. [2025-10-07T22:39:40.430541] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:40.435209] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32391 primary records. [2025-10-07T22:39:40.436705] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-07T22:39:40.468232] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-10-07T22:39:40.470048] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-07T22:39:40.475352] [INFO ] [MAIN ] Derivative Progress: 880/1748 symbols completed. HTH took 1.4s. Estimated remaining: 5m 34s. Rate: 155.7 symbols/min [2025-10-07T22:39:40.476905] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:40.503313] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:40.510987] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36598 primary records. [2025-10-07T22:39:40.517944] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-07T22:39:40.536294] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:40.547307] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39612 primary records. [2025-10-07T22:39:40.550672] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-07T22:39:40.553842] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-10-07T22:39:40.554033] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-07T22:39:40.557338] [INFO ] [MAIN ] Derivative Progress: 881/1748 symbols completed. HUBB took 1.4s. Estimated remaining: 5m 34s. Rate: 155.9 symbols/min [2025-10-07T22:39:40.579688] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:40.583744] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-10-07T22:39:40.584452] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-07T22:39:40.587892] [INFO ] [MAIN ] Derivative Progress: 882/1748 symbols completed. HUBS took 1.4s. Estimated remaining: 5m 33s. Rate: 156.0 symbols/min [2025-10-07T22:39:40.588420] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:40.667711] [DEBUG] [LOCAL ] HUM: Loaded 48999 existing records from primary storage. [2025-10-07T22:39:40.668061] [INFO ] [MAIN ] HUM: Loaded 48999 primary data records. [2025-10-07T22:39:40.930275] [DEBUG] [LOCAL ] HUN: Loaded 53204 existing records from primary storage. [2025-10-07T22:39:40.964263] [INFO ] [MAIN ] HUN: Loaded 53204 primary data records. [2025-10-07T22:39:41.096949] [DEBUG] [LOCAL ] HUYA: Loaded 43908 existing records from primary storage. [2025-10-07T22:39:41.123376] [INFO ] [MAIN ] HUYA: Loaded 43908 primary data records. [2025-10-07T22:39:41.737271] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:41.739214] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 48999 primary records. [2025-10-07T22:39:41.739345] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-07T22:39:41.758963] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-10-07T22:39:41.759409] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-07T22:39:41.762315] [INFO ] [MAIN ] Derivative Progress: 883/1748 symbols completed. HUM took 1.3s. Estimated remaining: 5m 33s. Rate: 155.7 symbols/min [2025-10-07T22:39:41.784458] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:41.798018] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 43908 primary records. [2025-10-07T22:39:41.798280] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:41.798400] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-07T22:39:41.799009] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53204 primary records. [2025-10-07T22:39:41.799734] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-07T22:39:41.830917] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-10-07T22:39:41.831437] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-07T22:39:41.834283] [INFO ] [MAIN ] Derivative Progress: 884/1748 symbols completed. HUYA took 1.2s. Estimated remaining: 5m 33s. Rate: 155.8 symbols/min [2025-10-07T22:39:41.834366] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-10-07T22:39:41.834591] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-07T22:39:41.836838] [INFO ] [MAIN ] Derivative Progress: 885/1748 symbols completed. HUN took 1.3s. Estimated remaining: 5m 32s. Rate: 156.0 symbols/min [2025-10-07T22:39:41.837356] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:41.837301] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:41.837451] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:41.855816] [DEBUG] [LOCAL ] HVT: Loaded 15322 existing records from primary storage. [2025-10-07T22:39:41.856035] [INFO ] [MAIN ] HVT: Loaded 15322 primary data records. [2025-10-07T22:39:42.196942] [DEBUG] [LOCAL ] HXL: Loaded 45917 existing records from primary storage. [2025-10-07T22:39:42.197244] [INFO ] [MAIN ] HXL: Loaded 45917 primary data records. [2025-10-07T22:39:42.319672] [DEBUG] [LOCAL ] HWM: Loaded 52904 existing records from primary storage. [2025-10-07T22:39:42.363849] [INFO ] [MAIN ] HWM: Loaded 52904 primary data records. [2025-10-07T22:39:42.882472] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:42.884706] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 15322 primary records. [2025-10-07T22:39:42.884969] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-07T22:39:42.902880] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-10-07T22:39:42.903225] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-07T22:39:42.905724] [INFO ] [MAIN ] Derivative Progress: 886/1748 symbols completed. HVT took 1.1s. Estimated remaining: 5m 32s. Rate: 155.7 symbols/min [2025-10-07T22:39:42.907997] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:42.926429] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:42.927631] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45917 primary records. [2025-10-07T22:39:42.927910] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-07T22:39:42.952916] [DEBUG] [LOCAL ] HY: Loaded 10004 existing records from primary storage. [2025-10-07T22:39:42.954877] [INFO ] [MAIN ] HY: Loaded 10004 primary data records. [2025-10-07T22:39:42.993151] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-10-07T22:39:43.021415] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-07T22:39:43.029999] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:43.045790] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52904 primary records. [2025-10-07T22:39:43.059960] [INFO ] [MAIN ] Derivative Progress: 887/1748 symbols completed. HXL took 1.2s. Estimated remaining: 5m 32s. Rate: 155.8 symbols/min [2025-10-07T22:39:43.057923] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-07T22:39:43.083908] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:43.146421] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-10-07T22:39:43.315432] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-07T22:39:43.318003] [INFO ] [MAIN ] Derivative Progress: 888/1748 symbols completed. HWM took 1.5s. Estimated remaining: 5m 31s. Rate: 155.8 symbols/min [2025-10-07T22:39:43.318567] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:43.324474] [DEBUG] [LOCAL ] HYI: Loaded 9882 existing records from primary storage. [2025-10-07T22:39:43.325520] [INFO ] [MAIN ] HYI: Loaded 9882 primary data records. [2025-10-07T22:39:43.660071] [DEBUG] [LOCAL ] HYT: Loaded 33699 existing records from primary storage. [2025-10-07T22:39:43.661567] [INFO ] [MAIN ] HYT: Loaded 33699 primary data records. [2025-10-07T22:39:43.829874] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:43.839796] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10004 primary records. [2025-10-07T22:39:43.840090] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-07T22:39:44.005245] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-10-07T22:39:44.005467] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-07T22:39:44.007730] [INFO ] [MAIN ] Derivative Progress: 889/1748 symbols completed. HY took 1.1s. Estimated remaining: 5m 31s. Rate: 155.7 symbols/min [2025-10-07T22:39:44.009490] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:44.030847] [DEBUG] [LOCAL ] HYTR: Loaded 3134 existing records from primary storage. [2025-10-07T22:39:44.031298] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:44.032147] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9882 primary records. [2025-10-07T22:39:44.032733] [INFO ] [MAIN ] HYTR: Loaded 3134 primary data records. [2025-10-07T22:39:44.032673] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-07T22:39:44.146488] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-10-07T22:39:44.154914] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-07T22:39:44.157503] [INFO ] [MAIN ] Derivative Progress: 890/1748 symbols completed. HYI took 1.1s. Estimated remaining: 5m 30s. Rate: 155.8 symbols/min [2025-10-07T22:39:44.161680] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:44.423966] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:44.424956] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33699 primary records. [2025-10-07T22:39:44.425105] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-07T22:39:44.453014] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-10-07T22:39:44.466251] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-07T22:39:44.470030] [DEBUG] [LOCAL ] HZO: Loaded 29133 existing records from primary storage. [2025-10-07T22:39:44.470677] [INFO ] [MAIN ] HZO: Loaded 29133 primary data records. [2025-10-07T22:39:44.468851] [INFO ] [MAIN ] Derivative Progress: 891/1748 symbols completed. HYT took 1.2s. Estimated remaining: 5m 30s. Rate: 155.8 symbols/min [2025-10-07T22:39:44.471965] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:44.593283] [DEBUG] [LOCAL ] IAE: Loaded 6054 existing records from primary storage. [2025-10-07T22:39:44.642689] [INFO ] [MAIN ] IAE: Loaded 6054 primary data records. [2025-10-07T22:39:44.886119] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:39:44.909962] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3134 primary records. [2025-10-07T22:39:44.927924] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-07T22:39:45.129875] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-10-07T22:39:45.130924] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-07T22:39:45.133465] [INFO ] [MAIN ] Derivative Progress: 892/1748 symbols completed. HYTR took 1.1s. Estimated remaining: 5m 30s. Rate: 155.7 symbols/min [2025-10-07T22:39:45.134263] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:45.159904] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:45.161104] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29133 primary records. [2025-10-07T22:39:45.161371] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-07T22:39:45.184403] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-10-07T22:39:45.193004] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-07T22:39:45.195507] [INFO ] [MAIN ] Derivative Progress: 893/1748 symbols completed. HZO took 1.0s. Estimated remaining: 5m 29s. Rate: 155.8 symbols/min [2025-10-07T22:39:45.201777] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:45.201635] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:45.202760] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6054 primary records. [2025-10-07T22:39:45.203442] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-07T22:39:45.234623] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-10-07T22:39:45.234852] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-07T22:39:45.237111] [INFO ] [MAIN ] Derivative Progress: 894/1748 symbols completed. IAE took 0.8s. Estimated remaining: 5m 28s. Rate: 156.0 symbols/min [2025-10-07T22:39:45.237366] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:45.256133] [DEBUG] [LOCAL ] IAG: Loaded 53461 existing records from primary storage. [2025-10-07T22:39:45.256506] [INFO ] [MAIN ] IAG: Loaded 53461 primary data records. [2025-10-07T22:39:45.616048] [DEBUG] [LOCAL ] IBM: Loaded 53631 existing records from primary storage. [2025-10-07T22:39:45.630273] [INFO ] [MAIN ] IBM: Loaded 53631 primary data records. [2025-10-07T22:39:45.664398] [DEBUG] [LOCAL ] IBN: Loaded 52857 existing records from primary storage. [2025-10-07T22:39:45.688457] [INFO ] [MAIN ] IBN: Loaded 52857 primary data records. [2025-10-07T22:39:46.327414] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:46.328953] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53461 primary records. [2025-10-07T22:39:46.329190] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-07T22:39:46.348207] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-10-07T22:39:46.348776] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-07T22:39:46.351190] [INFO ] [MAIN ] Derivative Progress: 895/1748 symbols completed. IAG took 1.2s. Estimated remaining: 5m 29s. Rate: 155.7 symbols/min [2025-10-07T22:39:46.351599] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:46.384550] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:46.390750] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52857 primary records. [2025-10-07T22:39:46.391036] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-07T22:39:46.391949] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:46.393154] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53631 primary records. [2025-10-07T22:39:46.401068] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-07T22:39:46.439190] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-10-07T22:39:46.440342] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-07T22:39:46.442583] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-10-07T22:39:46.446379] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-07T22:39:46.446161] [INFO ] [MAIN ] Derivative Progress: 896/1748 symbols completed. IBN took 1.2s. Estimated remaining: 5m 28s. Rate: 155.8 symbols/min [2025-10-07T22:39:46.446611] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:46.448720] [INFO ] [MAIN ] Derivative Progress: 897/1748 symbols completed. IBM took 1.2s. Estimated remaining: 5m 27s. Rate: 156.0 symbols/min [2025-10-07T22:39:46.449804] [DEBUG] [LOCAL ] IBP: Loaded 28806 existing records from primary storage. [2025-10-07T22:39:46.450279] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:46.450481] [INFO ] [MAIN ] IBP: Loaded 28806 primary data records. [2025-10-07T22:39:46.782004] [DEBUG] [LOCAL ] IBTA: Loaded 37273 existing records from primary storage. [2025-10-07T22:39:46.797816] [INFO ] [MAIN ] IBTA: Loaded 37273 primary data records. [2025-10-07T22:39:46.948731] [DEBUG] [LOCAL ] ICE: Loaded 53011 existing records from primary storage. [2025-10-07T22:39:46.959377] [INFO ] [MAIN ] ICE: Loaded 53011 primary data records. [2025-10-07T22:39:47.341187] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:47.341964] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28806 primary records. [2025-10-07T22:39:47.445526] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-07T22:39:47.482937] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-10-07T22:39:47.483799] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-07T22:39:47.486304] [INFO ] [MAIN ] Derivative Progress: 898/1748 symbols completed. IBP took 1.1s. Estimated remaining: 5m 28s. Rate: 155.7 symbols/min [2025-10-07T22:39:47.504419] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:47.505570] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 37273 primary records. [2025-10-07T22:39:47.505841] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-07T22:39:47.524467] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-07T22:39:47.524806] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-07T22:39:47.527181] [INFO ] [MAIN ] Derivative Progress: 899/1748 symbols completed. IBTA took 1.1s. Estimated remaining: 5m 27s. Rate: 155.8 symbols/min [2025-10-07T22:39:47.540612] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:47.541256] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53011 primary records. [2025-10-07T22:39:47.541316] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-07T22:39:47.557112] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-07T22:39:47.557183] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-07T22:39:47.559447] [INFO ] [MAIN ] Derivative Progress: 900/1748 symbols completed. ICE took 1.1s. Estimated remaining: 5m 26s. Rate: 156.0 symbols/min [2025-10-07T22:39:47.560076] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:47.560179] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:47.560329] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:47.573815] [DEBUG] [LOCAL ] IDE: Loaded 8835 existing records from primary storage. [2025-10-07T22:39:47.574006] [INFO ] [MAIN ] IDE: Loaded 8835 primary data records. [2025-10-07T22:39:47.919914] [DEBUG] [LOCAL ] IDA: Loaded 32522 existing records from primary storage. [2025-10-07T22:39:47.921185] [DEBUG] [LOCAL ] ICL: Loaded 38342 existing records from primary storage. [2025-10-07T22:39:47.920619] [INFO ] [MAIN ] IDA: Loaded 32522 primary data records. [2025-10-07T22:39:47.921381] [INFO ] [MAIN ] ICL: Loaded 38342 primary data records. [2025-10-07T22:39:48.575843] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:48.577132] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8835 primary records. [2025-10-07T22:39:48.577361] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-07T22:39:48.594979] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-07T22:39:48.595344] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-07T22:39:48.599347] [INFO ] [MAIN ] Derivative Progress: 901/1748 symbols completed. IDE took 1.0s. Estimated remaining: 5m 26s. Rate: 155.7 symbols/min [2025-10-07T22:39:48.600436] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:48.614884] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:48.615937] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38342 primary records. [2025-10-07T22:39:48.616091] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-07T22:39:48.656670] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:48.658468] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32522 primary records. [2025-10-07T22:39:48.665175] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-07T22:39:48.666827] [DEBUG] [LOCAL ] IDT: Loaded 18116 existing records from primary storage. [2025-10-07T22:39:48.667424] [INFO ] [MAIN ] IDT: Loaded 18116 primary data records. [2025-10-07T22:39:48.720211] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-07T22:39:48.737072] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-07T22:39:48.739067] [INFO ] [MAIN ] Derivative Progress: 902/1748 symbols completed. ICL took 1.2s. Estimated remaining: 5m 26s. Rate: 155.8 symbols/min [2025-10-07T22:39:48.739521] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:48.755998] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-07T22:39:48.756137] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-07T22:39:48.776101] [INFO ] [MAIN ] Derivative Progress: 903/1748 symbols completed. IDA took 1.2s. Estimated remaining: 5m 25s. Rate: 156.0 symbols/min [2025-10-07T22:39:48.794059] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:49.057211] [DEBUG] [LOCAL ] IEX: Loaded 38343 existing records from primary storage. [2025-10-07T22:39:49.057494] [INFO ] [MAIN ] IEX: Loaded 38343 primary data records. [2025-10-07T22:39:49.159315] [DEBUG] [LOCAL ] IFF: Loaded 51041 existing records from primary storage. [2025-10-07T22:39:49.173790] [INFO ] [MAIN ] IFF: Loaded 51041 primary data records. [2025-10-07T22:39:49.728683] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:49.731155] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 18116 primary records. [2025-10-07T22:39:49.731305] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-07T22:39:49.749323] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-07T22:39:49.749740] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-07T22:39:49.751906] [INFO ] [MAIN ] Derivative Progress: 904/1748 symbols completed. IDT took 1.2s. Estimated remaining: 5m 25s. Rate: 155.7 symbols/min [2025-10-07T22:39:49.752341] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:49.775365] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:49.776365] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38343 primary records. [2025-10-07T22:39:49.776531] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-07T22:39:49.803196] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:49.808392] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 51041 primary records. [2025-10-07T22:39:49.818387] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-07T22:39:49.818810] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-07T22:39:49.819008] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-07T22:39:49.822149] [INFO ] [MAIN ] Derivative Progress: 905/1748 symbols completed. IEX took 1.1s. Estimated remaining: 5m 25s. Rate: 155.8 symbols/min [2025-10-07T22:39:49.819913] [DEBUG] [LOCAL ] IFN: Loaded 18399 existing records from primary storage. [2025-10-07T22:39:49.822599] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:49.837544] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-07T22:39:49.837920] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-07T22:39:49.837789] [INFO ] [MAIN ] IFN: Loaded 18399 primary data records. [2025-10-07T22:39:49.840088] [INFO ] [MAIN ] Derivative Progress: 906/1748 symbols completed. IFF took 1.0s. Estimated remaining: 5m 24s. Rate: 156.0 symbols/min [2025-10-07T22:39:49.860840] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:49.970806] [DEBUG] [LOCAL ] IGA: Loaded 9969 existing records from primary storage. [2025-10-07T22:39:49.976544] [INFO ] [MAIN ] IGA: Loaded 9969 primary data records. [2025-10-07T22:39:50.079159] [DEBUG] [LOCAL ] IGD: Loaded 19232 existing records from primary storage. [2025-10-07T22:39:50.142687] [INFO ] [MAIN ] IGD: Loaded 19232 primary data records. [2025-10-07T22:39:50.830892] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:50.832122] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18399 primary records. [2025-10-07T22:39:50.832344] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-07T22:39:50.863775] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:50.878588] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9969 primary records. [2025-10-07T22:39:50.880027] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-07T22:39:50.882430] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-07T22:39:50.882127] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:50.883128] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19232 primary records. [2025-10-07T22:39:50.883460] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-07T22:39:50.883399] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-07T22:39:50.893351] [INFO ] [MAIN ] Derivative Progress: 907/1748 symbols completed. IFN took 1.1s. Estimated remaining: 5m 24s. Rate: 155.7 symbols/min [2025-10-07T22:39:50.897621] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:50.915062] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-07T22:39:50.916988] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-07T22:39:50.919596] [INFO ] [MAIN ] Derivative Progress: 908/1748 symbols completed. IGD took 1.1s. Estimated remaining: 5m 23s. Rate: 155.9 symbols/min [2025-10-07T22:39:50.921574] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-07T22:39:50.921772] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:50.922337] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-07T22:39:50.924622] [INFO ] [MAIN ] Derivative Progress: 909/1748 symbols completed. IGA took 1.1s. Estimated remaining: 5m 23s. Rate: 156.0 symbols/min [2025-10-07T22:39:50.924938] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:50.928467] [DEBUG] [LOCAL ] IGI: Loaded 3734 existing records from primary storage. [2025-10-07T22:39:50.929098] [INFO ] [MAIN ] IGI: Loaded 3734 primary data records. [2025-10-07T22:39:51.008437] [DEBUG] [LOCAL ] IH: Loaded 2861 existing records from primary storage. [2025-10-07T22:39:51.024676] [INFO ] [MAIN ] IH: Loaded 2861 primary data records. [2025-10-07T22:39:51.235116] [DEBUG] [LOCAL ] IGR: Loaded 30409 existing records from primary storage. [2025-10-07T22:39:51.355850] [INFO ] [MAIN ] IGR: Loaded 30409 primary data records. [2025-10-07T22:39:51.881249] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:51.882614] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3734 primary records. [2025-10-07T22:39:51.883024] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-07T22:39:51.901868] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-07T22:39:51.902142] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-07T22:39:51.904603] [INFO ] [MAIN ] Derivative Progress: 910/1748 symbols completed. IGI took 1.0s. Estimated remaining: 5m 23s. Rate: 155.8 symbols/min [2025-10-07T22:39:51.920768] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:39:51.919314] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:51.921829] [INFO ] [MAIN ] IH: Generated 1793 derivative records from 2861 primary records. [2025-10-07T22:39:51.921948] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-07T22:39:51.946637] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:51.950117] [DEBUG] [LOCAL ] IH: Derivative data saved (1793 records). [2025-10-07T22:39:51.950281] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-07T22:39:51.951027] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30409 primary records. [2025-10-07T22:39:51.953886] [INFO ] [MAIN ] Derivative Progress: 911/1748 symbols completed. IH took 1.0s. Estimated remaining: 5m 22s. Rate: 155.9 symbols/min [2025-10-07T22:39:51.955787] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-07T22:39:51.955934] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:51.972237] [DEBUG] [LOCAL ] IHD: Loaded 7017 existing records from primary storage. [2025-10-07T22:39:51.973736] [INFO ] [MAIN ] IHD: Loaded 7017 primary data records. [2025-10-07T22:39:51.987772] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-07T22:39:51.988004] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-07T22:39:52.000223] [INFO ] [MAIN ] Derivative Progress: 912/1748 symbols completed. IGR took 1.1s. Estimated remaining: 5m 21s. Rate: 156.1 symbols/min [2025-10-07T22:39:52.017313] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:52.149323] [DEBUG] [LOCAL ] IHG: Loaded 24318 existing records from primary storage. [2025-10-07T22:39:52.186504] [INFO ] [MAIN ] IHG: Loaded 24318 primary data records. [2025-10-07T22:39:52.431074] [DEBUG] [LOCAL ] IHS: Loaded 38502 existing records from primary storage. [2025-10-07T22:39:52.431680] [INFO ] [MAIN ] IHS: Loaded 38502 primary data records. [2025-10-07T22:39:52.991757] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:52.993974] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7017 primary records. [2025-10-07T22:39:52.994343] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-07T22:39:53.016550] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-07T22:39:53.017108] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-07T22:39:53.019387] [INFO ] [MAIN ] Derivative Progress: 913/1748 symbols completed. IHD took 1.1s. Estimated remaining: 5m 22s. Rate: 155.8 symbols/min [2025-10-07T22:39:53.033429] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:53.034105] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24318 primary records. [2025-10-07T22:39:53.034261] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-07T22:39:53.050918] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-07T22:39:53.051801] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-07T22:39:53.053919] [INFO ] [MAIN ] Derivative Progress: 914/1748 symbols completed. IHG took 1.1s. Estimated remaining: 5m 21s. Rate: 155.9 symbols/min [2025-10-07T22:39:53.068522] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:53.069136] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 38502 primary records. [2025-10-07T22:39:53.069227] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-07T22:39:53.084390] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-07T22:39:53.084453] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-07T22:39:53.086616] [INFO ] [MAIN ] Derivative Progress: 915/1748 symbols completed. IHS took 1.1s. Estimated remaining: 5m 20s. Rate: 156.1 symbols/min [2025-10-07T22:39:53.087034] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:53.087136] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:53.087229] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:53.096198] [DEBUG] [LOCAL ] IIF: Loaded 5685 existing records from primary storage. [2025-10-07T22:39:53.096327] [INFO ] [MAIN ] IIF: Loaded 5685 primary data records. [2025-10-07T22:39:53.264454] [DEBUG] [LOCAL ] IIIN: Loaded 16171 existing records from primary storage. [2025-10-07T22:39:53.307694] [INFO ] [MAIN ] IIIN: Loaded 16171 primary data records. [2025-10-07T22:39:53.255376] [DEBUG] [LOCAL ] IIM: Loaded 15838 existing records from primary storage. [2025-10-07T22:39:53.307862] [INFO ] [MAIN ] IIM: Loaded 15838 primary data records. [2025-10-07T22:39:54.033538] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:54.035073] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5685 primary records. [2025-10-07T22:39:54.035179] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-07T22:39:54.068127] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-07T22:39:54.067199] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:54.069109] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16171 primary records. [2025-10-07T22:39:54.069214] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-07T22:39:54.069296] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-07T22:39:54.081199] [INFO ] [MAIN ] Derivative Progress: 916/1748 symbols completed. IIF took 1.0s. Estimated remaining: 5m 20s. Rate: 155.8 symbols/min [2025-10-07T22:39:54.083222] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:54.103417] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:54.105133] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15838 primary records. [2025-10-07T22:39:54.106125] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-07T22:39:54.106198] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-07T22:39:54.107112] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-07T22:39:54.109561] [INFO ] [MAIN ] Derivative Progress: 917/1748 symbols completed. IIIN took 1.0s. Estimated remaining: 5m 20s. Rate: 156.0 symbols/min [2025-10-07T22:39:54.116817] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:54.136381] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-07T22:39:54.136478] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-07T22:39:54.138905] [INFO ] [MAIN ] Derivative Progress: 918/1748 symbols completed. IIM took 1.1s. Estimated remaining: 5m 19s. Rate: 156.1 symbols/min [2025-10-07T22:39:54.139116] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:54.154015] [DEBUG] [LOCAL ] IIPR: Loaded 29578 existing records from primary storage. [2025-10-07T22:39:54.154159] [INFO ] [MAIN ] IIPR: Loaded 29578 primary data records. [2025-10-07T22:39:54.340545] [DEBUG] [LOCAL ] IMAX: Loaded 42871 existing records from primary storage. [2025-10-07T22:39:54.370986] [INFO ] [MAIN ] IMAX: Loaded 42871 primary data records. [2025-10-07T22:39:54.616970] [DEBUG] [LOCAL ] INFA: Loaded 49429 existing records from primary storage. [2025-10-07T22:39:54.630562] [INFO ] [MAIN ] INFA: Loaded 49429 primary data records. [2025-10-07T22:39:55.176787] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:55.177938] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29578 primary records. [2025-10-07T22:39:55.178205] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-07T22:39:55.196072] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-07T22:39:55.197248] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-07T22:39:55.199747] [INFO ] [MAIN ] Derivative Progress: 919/1748 symbols completed. IIPR took 1.1s. Estimated remaining: 5m 19s. Rate: 155.8 symbols/min [2025-10-07T22:39:55.201109] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:55.219625] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:55.220767] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42871 primary records. [2025-10-07T22:39:55.220984] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-07T22:39:55.244345] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-10-07T22:39:55.244553] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-07T22:39:55.247017] [INFO ] [MAIN ] Derivative Progress: 920/1748 symbols completed. IMAX took 1.1s. Estimated remaining: 5m 18s. Rate: 156.0 symbols/min [2025-10-07T22:39:55.260515] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:55.261792] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:55.262503] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49429 primary records. [2025-10-07T22:39:55.262616] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-07T22:39:55.294051] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-07T22:39:55.294287] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-07T22:39:55.296500] [INFO ] [MAIN ] Derivative Progress: 921/1748 symbols completed. INFA took 1.2s. Estimated remaining: 5m 18s. Rate: 156.1 symbols/min [2025-10-07T22:39:55.296864] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:55.335417] [DEBUG] [LOCAL ] INFY: Loaded 53595 existing records from primary storage. [2025-10-07T22:39:55.335823] [INFO ] [MAIN ] INFY: Loaded 53595 primary data records. [2025-10-07T22:39:55.473773] [DEBUG] [LOCAL ] INGM: Loaded 28689 existing records from primary storage. [2025-10-07T22:39:55.479743] [INFO ] [MAIN ] INGM: Loaded 28689 primary data records. [2025-10-07T22:39:55.633379] [DEBUG] [LOCAL ] ING: Loaded 50705 existing records from primary storage. [2025-10-07T22:39:55.645600] [INFO ] [MAIN ] ING: Loaded 50705 primary data records. [2025-10-07T22:39:56.389566] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:56.391026] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53595 primary records. [2025-10-07T22:39:56.391415] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-07T22:39:56.412985] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-07T22:39:56.427078] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:56.427807] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28689 primary records. [2025-10-07T22:39:56.426795] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-07T22:39:56.427989] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-07T22:39:56.431526] [INFO ] [MAIN ] Derivative Progress: 922/1748 symbols completed. INFY took 1.2s. Estimated remaining: 5m 18s. Rate: 155.8 symbols/min [2025-10-07T22:39:56.431734] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:56.461802] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-07T22:39:56.462593] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:56.462749] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-07T22:39:56.463566] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50705 primary records. [2025-10-07T22:39:56.463671] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-07T22:39:56.465796] [INFO ] [MAIN ] Derivative Progress: 923/1748 symbols completed. INGM took 1.2s. Estimated remaining: 5m 17s. Rate: 156.0 symbols/min [2025-10-07T22:39:56.466040] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:56.483872] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-10-07T22:39:56.484148] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-07T22:39:56.486622] [INFO ] [MAIN ] Derivative Progress: 924/1748 symbols completed. ING took 1.2s. Estimated remaining: 5m 17s. Rate: 156.1 symbols/min [2025-10-07T22:39:56.487129] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:56.538931] [DEBUG] [LOCAL ] INGR: Loaded 33657 existing records from primary storage. [2025-10-07T22:39:56.539271] [INFO ] [MAIN ] INGR: Loaded 33657 primary data records. [2025-10-07T22:39:56.545204] [DEBUG] [LOCAL ] INN: Loaded 41813 existing records from primary storage. [2025-10-07T22:39:56.562502] [INFO ] [MAIN ] INN: Loaded 41813 primary data records. [2025-10-07T22:39:56.816928] [DEBUG] [LOCAL ] INSP: Loaded 37565 existing records from primary storage. [2025-10-07T22:39:56.872201] [INFO ] [MAIN ] INSP: Loaded 37565 primary data records. [2025-10-07T22:39:57.519251] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:57.521200] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41813 primary records. [2025-10-07T22:39:57.522003] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-07T22:39:57.537957] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:57.550036] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33657 primary records. [2025-10-07T22:39:57.553865] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-07T22:39:57.555564] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-07T22:39:57.556127] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-07T22:39:57.565812] [INFO ] [MAIN ] Derivative Progress: 925/1748 symbols completed. INN took 1.1s. Estimated remaining: 5m 17s. Rate: 155.8 symbols/min [2025-10-07T22:39:57.569989] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:57.575353] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-07T22:39:57.575675] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-07T22:39:57.577738] [INFO ] [MAIN ] Derivative Progress: 926/1748 symbols completed. INGR took 1.1s. Estimated remaining: 5m 16s. Rate: 156.0 symbols/min [2025-10-07T22:39:57.577967] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:57.595909] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:57.596780] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 37565 primary records. [2025-10-07T22:39:57.596866] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-07T22:39:57.626517] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-10-07T22:39:57.637145] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-07T22:39:57.640575] [INFO ] [MAIN ] Derivative Progress: 927/1748 symbols completed. INSP took 1.2s. Estimated remaining: 5m 16s. Rate: 156.1 symbols/min [2025-10-07T22:39:57.641370] [DEBUG] [LOCAL ] INSW: Loaded 39831 existing records from primary storage. [2025-10-07T22:39:57.641922] [INFO ] [MAIN ] INSW: Loaded 39831 primary data records. [2025-10-07T22:39:57.641730] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:57.843168] [DEBUG] [LOCAL ] INVH: Loaded 53160 existing records from primary storage. [2025-10-07T22:39:57.852218] [INFO ] [MAIN ] INVH: Loaded 53160 primary data records. [2025-10-07T22:39:58.043912] [DEBUG] [LOCAL ] INVX: Loaded 29163 existing records from primary storage. [2025-10-07T22:39:58.064307] [INFO ] [MAIN ] INVX: Loaded 29163 primary data records. [2025-10-07T22:39:58.730945] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:58.732696] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39831 primary records. [2025-10-07T22:39:58.733064] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-07T22:39:58.755217] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-07T22:39:58.755443] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-07T22:39:58.757928] [INFO ] [MAIN ] Derivative Progress: 928/1748 symbols completed. INSW took 1.2s. Estimated remaining: 5m 16s. Rate: 155.8 symbols/min [2025-10-07T22:39:58.789910] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:58.795963] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53160 primary records. [2025-10-07T22:39:58.795034] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:58.796073] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-07T22:39:58.797336] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29163 primary records. [2025-10-07T22:39:58.797749] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-07T22:39:58.831560] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-07T22:39:58.833066] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-07T22:39:58.832971] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-07T22:39:58.833238] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-07T22:39:58.835504] [INFO ] [MAIN ] Derivative Progress: 929/1748 symbols completed. INVX took 1.2s. Estimated remaining: 5m 15s. Rate: 155.9 symbols/min [2025-10-07T22:39:58.838176] [INFO ] [MAIN ] Derivative Progress: 930/1748 symbols completed. INVH took 1.3s. Estimated remaining: 5m 14s. Rate: 156.1 symbols/min [2025-10-07T22:39:58.838769] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:58.838919] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:58.838675] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:39:58.933427] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-07T22:39:58.933813] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-07T22:39:59.060922] [DEBUG] [LOCAL ] IP: Loaded 53319 existing records from primary storage. [2025-10-07T22:39:59.061620] [DEBUG] [LOCAL ] IOT: Loaded 53472 existing records from primary storage. [2025-10-07T22:39:59.076247] [INFO ] [MAIN ] IOT: Loaded 53472 primary data records. [2025-10-07T22:39:59.079765] [INFO ] [MAIN ] IP: Loaded 53319 primary data records. [2025-10-07T22:39:59.981278] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:39:59.996077] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-07T22:39:59.996216] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-07T22:39:59.996925] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:00.007557] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53319 primary records. [2025-10-07T22:40:00.013278] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:00.026970] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-07T22:40:00.027937] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53472 primary records. [2025-10-07T22:40:00.033864] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-07T22:40:00.028457] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-07T22:40:00.033976] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-07T22:40:00.043935] [INFO ] [MAIN ] Derivative Progress: 931/1748 symbols completed. IONQ took 1.2s. Estimated remaining: 5m 15s. Rate: 155.7 symbols/min [2025-10-07T22:40:00.053236] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-07T22:40:00.049898] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:00.063703] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-07T22:40:00.066182] [INFO ] [MAIN ] Derivative Progress: 932/1748 symbols completed. IP took 1.2s. Estimated remaining: 5m 14s. Rate: 155.9 symbols/min [2025-10-07T22:40:00.066768] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:00.080564] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-07T22:40:00.080830] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-07T22:40:00.083631] [INFO ] [MAIN ] Derivative Progress: 933/1748 symbols completed. IOT took 1.2s. Estimated remaining: 5m 13s. Rate: 156.1 symbols/min [2025-10-07T22:40:00.083942] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:00.106982] [DEBUG] [LOCAL ] IPI: Loaded 21533 existing records from primary storage. [2025-10-07T22:40:00.107295] [INFO ] [MAIN ] IPI: Loaded 21533 primary data records. [2025-10-07T22:40:00.220907] [DEBUG] [LOCAL ] IQI: Loaded 18006 existing records from primary storage. [2025-10-07T22:40:00.250118] [INFO ] [MAIN ] IQI: Loaded 18006 primary data records. [2025-10-07T22:40:00.552683] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-07T22:40:00.563450] [INFO ] [MAIN ] IPG: Loaded 53330 primary data records. [2025-10-07T22:40:01.178794] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:01.180499] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21533 primary records. [2025-10-07T22:40:01.181497] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-07T22:40:01.203952] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-10-07T22:40:01.217027] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-07T22:40:01.218246] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:01.220893] [INFO ] [MAIN ] Derivative Progress: 934/1748 symbols completed. IPI took 1.2s. Estimated remaining: 5m 14s. Rate: 155.7 symbols/min [2025-10-07T22:40:01.221614] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:01.222564] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 18006 primary records. [2025-10-07T22:40:01.222825] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-07T22:40:01.242479] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-07T22:40:01.242623] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-07T22:40:01.252868] [INFO ] [MAIN ] Derivative Progress: 935/1748 symbols completed. IQI took 1.2s. Estimated remaining: 5m 13s. Rate: 155.9 symbols/min [2025-10-07T22:40:01.258154] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:01.258776] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:01.259690] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53330 primary records. [2025-10-07T22:40:01.260038] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-07T22:40:01.279539] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-10-07T22:40:01.279719] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-07T22:40:01.282154] [INFO ] [MAIN ] Derivative Progress: 936/1748 symbols completed. IPG took 1.2s. Estimated remaining: 5m 12s. Rate: 156.0 symbols/min [2025-10-07T22:40:01.282393] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:01.343129] [DEBUG] [LOCAL ] IQV: Loaded 50087 existing records from primary storage. [2025-10-07T22:40:01.343473] [INFO ] [MAIN ] IQV: Loaded 50087 primary data records. [2025-10-07T22:40:01.509526] [DEBUG] [LOCAL ] IR: Loaded 52740 existing records from primary storage. [2025-10-07T22:40:01.525858] [DEBUG] [LOCAL ] IRM: Loaded 49283 existing records from primary storage. [2025-10-07T22:40:01.513507] [INFO ] [MAIN ] IR: Loaded 52740 primary data records. [2025-10-07T22:40:01.541733] [INFO ] [MAIN ] IRM: Loaded 49283 primary data records. [2025-10-07T22:40:02.507480] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:02.508629] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50087 primary records. [2025-10-07T22:40:02.508807] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-07T22:40:02.545544] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-10-07T22:40:02.545944] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:02.559374] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-07T22:40:02.560526] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49283 primary records. [2025-10-07T22:40:02.563300] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-07T22:40:02.563727] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:02.562832] [INFO ] [MAIN ] Derivative Progress: 937/1748 symbols completed. IQV took 1.3s. Estimated remaining: 5m 13s. Rate: 155.7 symbols/min [2025-10-07T22:40:02.564855] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:02.565970] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52740 primary records. [2025-10-07T22:40:02.573942] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-07T22:40:02.584078] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-07T22:40:02.584500] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-07T22:40:02.593890] [INFO ] [MAIN ] Derivative Progress: 938/1748 symbols completed. IRM took 1.3s. Estimated remaining: 5m 12s. Rate: 155.8 symbols/min [2025-10-07T22:40:02.598637] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:02.603028] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-07T22:40:02.603712] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-07T22:40:02.605864] [INFO ] [MAIN ] Derivative Progress: 939/1748 symbols completed. IR took 1.3s. Estimated remaining: 5m 11s. Rate: 156.0 symbols/min [2025-10-07T22:40:02.606148] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:02.624919] [DEBUG] [LOCAL ] IRS: Loaded 22364 existing records from primary storage. [2025-10-07T22:40:02.628772] [INFO ] [MAIN ] IRS: Loaded 22364 primary data records. [2025-10-07T22:40:02.700181] [DEBUG] [LOCAL ] ISD: Loaded 15796 existing records from primary storage. [2025-10-07T22:40:02.735927] [INFO ] [MAIN ] ISD: Loaded 15796 primary data records. [2025-10-07T22:40:02.938021] [DEBUG] [LOCAL ] IRT: Loaded 50400 existing records from primary storage. [2025-10-07T22:40:03.122828] [INFO ] [MAIN ] IRT: Loaded 50400 primary data records. [2025-10-07T22:40:03.650783] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:03.665401] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:03.666399] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 22364 primary records. [2025-10-07T22:40:03.667393] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15796 primary records. [2025-10-07T22:40:03.666631] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-07T22:40:03.667899] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-07T22:40:03.700491] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-07T22:40:03.701048] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-07T22:40:03.703218] [INFO ] [MAIN ] Derivative Progress: 940/1748 symbols completed. IRS took 1.1s. Estimated remaining: 5m 11s. Rate: 155.7 symbols/min [2025-10-07T22:40:03.704406] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-07T22:40:03.703683] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:03.704729] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-07T22:40:03.706940] [INFO ] [MAIN ] Derivative Progress: 941/1748 symbols completed. ISD took 1.1s. Estimated remaining: 5m 11s. Rate: 155.8 symbols/min [2025-10-07T22:40:03.707148] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:03.725453] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:03.726323] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50400 primary records. [2025-10-07T22:40:03.726405] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-07T22:40:03.757228] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-07T22:40:03.757465] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-07T22:40:03.759985] [INFO ] [MAIN ] Derivative Progress: 942/1748 symbols completed. IRT took 1.2s. Estimated remaining: 5m 10s. Rate: 156.0 symbols/min [2025-10-07T22:40:03.760266] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:03.782117] [DEBUG] [LOCAL ] ITGR: Loaded 31277 existing records from primary storage. [2025-10-07T22:40:03.782358] [INFO ] [MAIN ] ITGR: Loaded 31277 primary data records. [2025-10-07T22:40:03.901845] [DEBUG] [LOCAL ] IT: Loaded 42202 existing records from primary storage. [2025-10-07T22:40:03.905056] [INFO ] [MAIN ] IT: Loaded 42202 primary data records. [2025-10-07T22:40:03.999551] [DEBUG] [LOCAL ] ITT: Loaded 32663 existing records from primary storage. [2025-10-07T22:40:04.021154] [INFO ] [MAIN ] ITT: Loaded 32663 primary data records. [2025-10-07T22:40:04.816098] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:04.818928] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31277 primary records. [2025-10-07T22:40:04.819386] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-07T22:40:04.846958] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:04.851332] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 42202 primary records. [2025-10-07T22:40:04.852158] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-07T22:40:04.851616] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-07T22:40:04.852357] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-07T22:40:04.854944] [INFO ] [MAIN ] Derivative Progress: 943/1748 symbols completed. ITGR took 1.1s. Estimated remaining: 5m 10s. Rate: 155.7 symbols/min [2025-10-07T22:40:04.883616] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-10-07T22:40:04.889117] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-07T22:40:04.891590] [INFO ] [MAIN ] Derivative Progress: 944/1748 symbols completed. IT took 1.2s. Estimated remaining: 5m 10s. Rate: 155.8 symbols/min [2025-10-07T22:40:04.889452] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:04.892558] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32663 primary records. [2025-10-07T22:40:04.892626] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-07T22:40:04.909120] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-07T22:40:04.909193] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-07T22:40:04.911280] [INFO ] [MAIN ] Derivative Progress: 945/1748 symbols completed. ITT took 1.2s. Estimated remaining: 5m 9s. Rate: 156.0 symbols/min [2025-10-07T22:40:04.911756] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:04.911859] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:04.912318] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:04.989915] [DEBUG] [LOCAL ] IVR: Loaded 48059 existing records from primary storage. [2025-10-07T22:40:04.991624] [INFO ] [MAIN ] IVR: Loaded 48059 primary data records. [2025-10-07T22:40:05.062279] [DEBUG] [LOCAL ] ITW: Loaded 45729 existing records from primary storage. [2025-10-07T22:40:05.063525] [DEBUG] [LOCAL ] ITUB: Loaded 53315 existing records from primary storage. [2025-10-07T22:40:05.078189] [INFO ] [MAIN ] ITW: Loaded 45729 primary data records. [2025-10-07T22:40:05.078252] [INFO ] [MAIN ] ITUB: Loaded 53315 primary data records. [2025-10-07T22:40:05.964342] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:05.965605] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 48059 primary records. [2025-10-07T22:40:05.966735] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-07T22:40:05.993588] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-10-07T22:40:05.993981] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-07T22:40:06.008680] [INFO ] [MAIN ] Derivative Progress: 946/1748 symbols completed. IVR took 1.1s. Estimated remaining: 5m 9s. Rate: 155.7 symbols/min [2025-10-07T22:40:06.022370] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:06.021853] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:06.024005] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45729 primary records. [2025-10-07T22:40:06.024337] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-07T22:40:06.024276] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:06.025200] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53315 primary records. [2025-10-07T22:40:06.025902] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-07T22:40:06.053441] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-07T22:40:06.054002] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-07T22:40:06.056215] [INFO ] [MAIN ] Derivative Progress: 947/1748 symbols completed. ITUB took 1.1s. Estimated remaining: 5m 8s. Rate: 155.8 symbols/min [2025-10-07T22:40:06.056594] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:06.070734] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-07T22:40:06.070825] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-07T22:40:06.072969] [INFO ] [MAIN ] Derivative Progress: 948/1748 symbols completed. ITW took 1.2s. Estimated remaining: 5m 8s. Rate: 156.0 symbols/min [2025-10-07T22:40:06.073172] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:06.084957] [DEBUG] [LOCAL ] IVT: Loaded 30888 existing records from primary storage. [2025-10-07T22:40:06.085110] [INFO ] [MAIN ] IVT: Loaded 30888 primary data records. [2025-10-07T22:40:06.263362] [DEBUG] [LOCAL ] IX: Loaded 22307 existing records from primary storage. [2025-10-07T22:40:06.294675] [INFO ] [MAIN ] IX: Loaded 22307 primary data records. [2025-10-07T22:40:06.503216] [DEBUG] [LOCAL ] IVZ: Loaded 53132 existing records from primary storage. [2025-10-07T22:40:06.513698] [INFO ] [MAIN ] IVZ: Loaded 53132 primary data records. [2025-10-07T22:40:07.093000] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:07.094256] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30888 primary records. [2025-10-07T22:40:07.094427] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-07T22:40:07.114914] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-07T22:40:07.115129] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-07T22:40:07.117318] [INFO ] [MAIN ] Derivative Progress: 949/1748 symbols completed. IVT took 1.1s. Estimated remaining: 5m 8s. Rate: 155.7 symbols/min [2025-10-07T22:40:07.125665] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:07.131995] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:07.132967] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22307 primary records. [2025-10-07T22:40:07.133146] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-07T22:40:07.165275] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-07T22:40:07.165049] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:07.165409] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-07T22:40:07.166089] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53132 primary records. [2025-10-07T22:40:07.168046] [INFO ] [MAIN ] Derivative Progress: 950/1748 symbols completed. IX took 1.1s. Estimated remaining: 5m 7s. Rate: 155.8 symbols/min [2025-10-07T22:40:07.168411] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-07T22:40:07.168281] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:07.186034] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-07T22:40:07.186240] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-07T22:40:07.188213] [INFO ] [MAIN ] Derivative Progress: 951/1748 symbols completed. IVZ took 1.1s. Estimated remaining: 5m 7s. Rate: 156.0 symbols/min [2025-10-07T22:40:07.188465] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:07.224992] [DEBUG] [LOCAL ] J: Loaded 40213 existing records from primary storage. [2025-10-07T22:40:07.225141] [INFO ] [MAIN ] J: Loaded 40213 primary data records. [2025-10-07T22:40:07.371276] [DEBUG] [LOCAL ] JBGS: Loaded 42319 existing records from primary storage. [2025-10-07T22:40:07.391145] [INFO ] [MAIN ] JBGS: Loaded 42319 primary data records. [2025-10-07T22:40:07.614077] [DEBUG] [LOCAL ] JBI: Loaded 43410 existing records from primary storage. [2025-10-07T22:40:07.636307] [INFO ] [MAIN ] JBI: Loaded 43410 primary data records. [2025-10-07T22:40:08.188128] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:08.189789] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40213 primary records. [2025-10-07T22:40:08.191009] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-07T22:40:08.209021] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-07T22:40:08.209346] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-07T22:40:08.212242] [INFO ] [MAIN ] Derivative Progress: 952/1748 symbols completed. J took 1.1s. Estimated remaining: 5m 7s. Rate: 155.7 symbols/min [2025-10-07T22:40:08.212615] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:08.236173] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:08.237248] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42319 primary records. [2025-10-07T22:40:08.237447] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-07T22:40:08.252033] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:08.265053] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43410 primary records. [2025-10-07T22:40:08.265418] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-07T22:40:08.278794] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-07T22:40:08.285766] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-07T22:40:08.289407] [INFO ] [MAIN ] Derivative Progress: 953/1748 symbols completed. JBGS took 1.1s. Estimated remaining: 5m 6s. Rate: 155.8 symbols/min [2025-10-07T22:40:08.286923] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-07T22:40:08.289725] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-07T22:40:08.289920] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:08.292343] [INFO ] [MAIN ] Derivative Progress: 954/1748 symbols completed. JBI took 1.1s. Estimated remaining: 5m 5s. Rate: 156.0 symbols/min [2025-10-07T22:40:08.292941] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:08.315423] [DEBUG] [LOCAL ] JCE: Loaded 7029 existing records from primary storage. [2025-10-07T22:40:08.315735] [INFO ] [MAIN ] JCE: Loaded 7029 primary data records. [2025-10-07T22:40:08.446351] [DEBUG] [LOCAL ] JBL: Loaded 48387 existing records from primary storage. [2025-10-07T22:40:08.452055] [INFO ] [MAIN ] JBL: Loaded 48387 primary data records. [2025-10-07T22:40:08.590734] [DEBUG] [LOCAL ] JBND: Loaded 26404 existing records from primary storage. [2025-10-07T22:40:08.751026] [INFO ] [MAIN ] JBND: Loaded 26404 primary data records. [2025-10-07T22:40:09.327969] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:09.328893] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 7029 primary records. [2025-10-07T22:40:09.330164] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-07T22:40:09.349319] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-07T22:40:09.351758] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-07T22:40:09.354563] [INFO ] [MAIN ] Derivative Progress: 955/1748 symbols completed. JCE took 1.1s. Estimated remaining: 5m 6s. Rate: 155.7 symbols/min [2025-10-07T22:40:09.354752] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:09.370216] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:09.372440] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48387 primary records. [2025-10-07T22:40:09.374310] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-07T22:40:09.398916] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:09.404931] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 26404 primary records. [2025-10-07T22:40:09.405203] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-07T22:40:09.425258] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-07T22:40:09.425985] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-07T22:40:09.425866] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-10-07T22:40:09.428112] [INFO ] [MAIN ] Derivative Progress: 956/1748 symbols completed. JBND took 1.1s. Estimated remaining: 5m 5s. Rate: 155.9 symbols/min [2025-10-07T22:40:09.428434] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:09.428206] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-07T22:40:09.431070] [INFO ] [MAIN ] Derivative Progress: 957/1748 symbols completed. JBL took 1.2s. Estimated remaining: 5m 4s. Rate: 156.0 symbols/min [2025-10-07T22:40:09.431572] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:09.475668] [DEBUG] [LOCAL ] JCI: Loaded 53538 existing records from primary storage. [2025-10-07T22:40:09.476003] [INFO ] [MAIN ] JCI: Loaded 53538 primary data records. [2025-10-07T22:40:09.692923] [DEBUG] [LOCAL ] JELD: Loaded 46120 existing records from primary storage. [2025-10-07T22:40:09.820008] [INFO ] [MAIN ] JELD: Loaded 46120 primary data records. [2025-10-07T22:40:09.849756] [DEBUG] [LOCAL ] JEF: Loaded 50041 existing records from primary storage. [2025-10-07T22:40:09.872085] [INFO ] [MAIN ] JEF: Loaded 50041 primary data records. [2025-10-07T22:40:10.463374] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:10.464448] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53538 primary records. [2025-10-07T22:40:10.464774] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-07T22:40:10.483871] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-07T22:40:10.484058] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-07T22:40:10.486357] [INFO ] [MAIN ] Derivative Progress: 958/1748 symbols completed. JCI took 1.1s. Estimated remaining: 5m 4s. Rate: 155.7 symbols/min [2025-10-07T22:40:10.500190] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:10.500896] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46120 primary records. [2025-10-07T22:40:10.501043] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-07T22:40:10.530405] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:10.531703] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50041 primary records. [2025-10-07T22:40:10.532011] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-07T22:40:10.533444] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-07T22:40:10.533748] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-07T22:40:10.535883] [INFO ] [MAIN ] Derivative Progress: 959/1748 symbols completed. JELD took 1.1s. Estimated remaining: 5m 4s. Rate: 155.9 symbols/min [2025-10-07T22:40:10.551247] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-10-07T22:40:10.551337] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-07T22:40:10.553317] [INFO ] [MAIN ] Derivative Progress: 960/1748 symbols completed. JEF took 1.1s. Estimated remaining: 5m 3s. Rate: 156.0 symbols/min [2025-10-07T22:40:10.553670] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:10.553786] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:10.553894] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:10.569888] [DEBUG] [LOCAL ] JEQ: Loaded 8664 existing records from primary storage. [2025-10-07T22:40:10.570083] [INFO ] [MAIN ] JEQ: Loaded 8664 primary data records. [2025-10-07T22:40:10.642842] [DEBUG] [LOCAL ] JGH: Loaded 11315 existing records from primary storage. [2025-10-07T22:40:10.667535] [INFO ] [MAIN ] JGH: Loaded 11315 primary data records. [2025-10-07T22:40:10.876558] [DEBUG] [LOCAL ] JFR: Loaded 31002 existing records from primary storage. [2025-10-07T22:40:11.031282] [INFO ] [MAIN ] JFR: Loaded 31002 primary data records. [2025-10-07T22:40:11.579273] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:11.580241] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 8664 primary records. [2025-10-07T22:40:11.580436] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-10-07T22:40:11.596826] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-10-07T22:40:11.597055] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-10-07T22:40:11.600813] [INFO ] [MAIN ] Derivative Progress: 961/1748 symbols completed. JEQ took 1.0s. Estimated remaining: 5m 3s. Rate: 155.7 symbols/min [2025-10-07T22:40:11.601344] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:11.615286] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:11.616744] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 11315 primary records. [2025-10-07T22:40:11.617735] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-07T22:40:11.648060] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-07T22:40:11.647986] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:11.648944] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 31002 primary records. [2025-10-07T22:40:11.648187] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-07T22:40:11.649104] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-07T22:40:11.651679] [INFO ] [MAIN ] Derivative Progress: 962/1748 symbols completed. JGH took 1.1s. Estimated remaining: 5m 3s. Rate: 155.9 symbols/min [2025-10-07T22:40:11.652033] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:11.669840] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-07T22:40:11.670101] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-07T22:40:11.672095] [INFO ] [MAIN ] Derivative Progress: 963/1748 symbols completed. JFR took 1.1s. Estimated remaining: 5m 2s. Rate: 156.0 symbols/min [2025-10-07T22:40:11.672338] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:11.675459] [DEBUG] [LOCAL ] JHI: Loaded 3696 existing records from primary storage. [2025-10-07T22:40:11.685540] [INFO ] [MAIN ] JHI: Loaded 3696 primary data records. [2025-10-07T22:40:11.818881] [DEBUG] [LOCAL ] JHG: Loaded 47590 existing records from primary storage. [2025-10-07T22:40:11.807435] [DEBUG] [LOCAL ] JHS: Loaded 2876 existing records from primary storage. [2025-10-07T22:40:11.824157] [INFO ] [MAIN ] JHS: Loaded 2876 primary data records. [2025-10-07T22:40:11.859690] [INFO ] [MAIN ] JHG: Loaded 47590 primary data records. [2025-10-07T22:40:12.684833] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:12.685615] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3696 primary records. [2025-10-07T22:40:12.686526] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-07T22:40:12.708439] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-10-07T22:40:12.734773] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:40:12.735390] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:12.735027] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-07T22:40:12.736250] [INFO ] [MAIN ] JHS: Generated 1793 derivative records from 2876 primary records. [2025-10-07T22:40:12.737251] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-07T22:40:12.737166] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47590 primary records. [2025-10-07T22:40:12.737741] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-07T22:40:12.740245] [INFO ] [MAIN ] Derivative Progress: 964/1748 symbols completed. JHI took 1.1s. Estimated remaining: 5m 2s. Rate: 155.8 symbols/min [2025-10-07T22:40:12.741568] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:12.766319] [DEBUG] [LOCAL ] JHS: Derivative data saved (1793 records). [2025-10-07T22:40:12.766431] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-07T22:40:12.768795] [INFO ] [MAIN ] Derivative Progress: 965/1748 symbols completed. JHS took 1.1s. Estimated remaining: 5m 1s. Rate: 155.9 symbols/min [2025-10-07T22:40:12.769327] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:12.776180] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-10-07T22:40:12.776393] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-07T22:40:12.779338] [INFO ] [MAIN ] Derivative Progress: 966/1748 symbols completed. JHG took 1.2s. Estimated remaining: 5m 1s. Rate: 156.1 symbols/min [2025-10-07T22:40:12.779527] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:12.795452] [DEBUG] [LOCAL ] JILL: Loaded 16381 existing records from primary storage. [2025-10-07T22:40:12.800085] [INFO ] [MAIN ] JILL: Loaded 16381 primary data records. [2025-10-07T22:40:13.151520] [DEBUG] [LOCAL ] JKS: Loaded 39913 existing records from primary storage. [2025-10-07T22:40:13.152370] [DEBUG] [LOCAL ] JHX: Loaded 52906 existing records from primary storage. [2025-10-07T22:40:13.152493] [INFO ] [MAIN ] JKS: Loaded 39913 primary data records. [2025-10-07T22:40:13.152676] [INFO ] [MAIN ] JHX: Loaded 52906 primary data records. [2025-10-07T22:40:13.798044] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:13.799246] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16381 primary records. [2025-10-07T22:40:13.799459] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-07T22:40:13.817671] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-07T22:40:13.817926] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-07T22:40:13.820773] [INFO ] [MAIN ] Derivative Progress: 967/1748 symbols completed. JILL took 1.1s. Estimated remaining: 5m 1s. Rate: 155.8 symbols/min [2025-10-07T22:40:13.821440] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:13.847360] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:13.848364] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 39913 primary records. [2025-10-07T22:40:13.848679] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-07T22:40:13.871122] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-07T22:40:13.879411] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-07T22:40:13.899736] [INFO ] [MAIN ] Derivative Progress: 968/1748 symbols completed. JKS took 1.1s. Estimated remaining: 5m 0s. Rate: 155.9 symbols/min [2025-10-07T22:40:13.901906] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:13.901806] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:13.903325] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 52906 primary records. [2025-10-07T22:40:13.903507] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-07T22:40:13.936667] [DEBUG] [LOCAL ] JLS: Loaded 4146 existing records from primary storage. [2025-10-07T22:40:13.937138] [INFO ] [MAIN ] JLS: Loaded 4146 primary data records. [2025-10-07T22:40:13.933299] [DEBUG] [LOCAL ] JLL: Loaded 31486 existing records from primary storage. [2025-10-07T22:40:13.958687] [INFO ] [MAIN ] JLL: Loaded 31486 primary data records. [2025-10-07T22:40:14.125919] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-10-07T22:40:14.158784] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-07T22:40:14.176785] [INFO ] [MAIN ] Derivative Progress: 969/1748 symbols completed. JHX took 1.4s. Estimated remaining: 4m 60s. Rate: 156.0 symbols/min [2025-10-07T22:40:14.187248] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:14.607277] [DEBUG] [LOCAL ] JMIA: Loaded 50814 existing records from primary storage. [2025-10-07T22:40:14.607778] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:40:14.609469] [INFO ] [MAIN ] JLS: Generated 1792 derivative records from 4146 primary records. [2025-10-07T22:40:14.608600] [INFO ] [MAIN ] JMIA: Loaded 50814 primary data records. [2025-10-07T22:40:14.622245] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-07T22:40:14.705587] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:14.718268] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31486 primary records. [2025-10-07T22:40:14.723830] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-07T22:40:14.795969] [DEBUG] [LOCAL ] JLS: Derivative data saved (1792 records). [2025-10-07T22:40:14.828424] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-07T22:40:14.830606] [INFO ] [MAIN ] Derivative Progress: 970/1748 symbols completed. JLS took 0.9s. Estimated remaining: 4m 60s. Rate: 155.8 symbols/min [2025-10-07T22:40:14.836891] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:15.009580] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-07T22:40:15.009720] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-07T22:40:15.011929] [INFO ] [MAIN ] Derivative Progress: 971/1748 symbols completed. JLL took 1.2s. Estimated remaining: 4m 59s. Rate: 155.9 symbols/min [2025-10-07T22:40:15.012212] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:15.041535] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:15.042385] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50814 primary records. [2025-10-07T22:40:15.042568] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-07T22:40:15.074607] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-10-07T22:40:15.074776] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-07T22:40:15.077004] [INFO ] [MAIN ] Derivative Progress: 972/1748 symbols completed. JMIA took 0.9s. Estimated remaining: 4m 58s. Rate: 156.1 symbols/min [2025-10-07T22:40:15.077334] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:15.108241] [DEBUG] [LOCAL ] JOBY: Loaded 53801 existing records from primary storage. [2025-10-07T22:40:15.108588] [INFO ] [MAIN ] JOBY: Loaded 53801 primary data records. [2025-10-07T22:40:15.226942] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-07T22:40:15.245476] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-07T22:40:15.246059] [DEBUG] [LOCAL ] JOE: Loaded 23982 existing records from primary storage. [2025-10-07T22:40:15.266409] [INFO ] [MAIN ] JOE: Loaded 23982 primary data records. [2025-10-07T22:40:16.075484] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:16.076391] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53801 primary records. [2025-10-07T22:40:16.076766] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-07T22:40:16.122790] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-07T22:40:16.106305] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:16.123984] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-07T22:40:16.122909] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-07T22:40:16.123286] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:16.124686] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 23982 primary records. [2025-10-07T22:40:16.126712] [INFO ] [MAIN ] Derivative Progress: 973/1748 symbols completed. JOBY took 1.1s. Estimated remaining: 4m 58s. Rate: 155.8 symbols/min [2025-10-07T22:40:16.126919] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-07T22:40:16.124779] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-07T22:40:16.163220] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-07T22:40:16.163446] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-07T22:40:16.163285] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-07T22:40:16.165673] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-07T22:40:16.165609] [INFO ] [MAIN ] Derivative Progress: 974/1748 symbols completed. JNJ took 1.3s. Estimated remaining: 4m 58s. Rate: 155.9 symbols/min [2025-10-07T22:40:16.167888] [INFO ] [MAIN ] Derivative Progress: 975/1748 symbols completed. JOE took 1.1s. Estimated remaining: 4m 57s. Rate: 156.1 symbols/min [2025-10-07T22:40:16.168289] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:16.168422] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:16.168477] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:16.179591] [DEBUG] [LOCAL ] JOF: Loaded 6917 existing records from primary storage. [2025-10-07T22:40:16.179875] [INFO ] [MAIN ] JOF: Loaded 6917 primary data records. [2025-10-07T22:40:16.515144] [DEBUG] [LOCAL ] JPC: Loaded 37176 existing records from primary storage. [2025-10-07T22:40:16.515352] [INFO ] [MAIN ] JPC: Loaded 37176 primary data records. [2025-10-07T22:40:16.640747] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-07T22:40:16.652637] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-07T22:40:17.086288] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:17.087179] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 6917 primary records. [2025-10-07T22:40:17.196763] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-07T22:40:17.228494] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-07T22:40:17.229202] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-07T22:40:17.231526] [INFO ] [MAIN ] Derivative Progress: 976/1748 symbols completed. JOF took 1.1s. Estimated remaining: 4m 57s. Rate: 155.8 symbols/min [2025-10-07T22:40:17.232102] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:17.255061] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:17.256361] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37176 primary records. [2025-10-07T22:40:17.256582] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-07T22:40:17.286586] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-07T22:40:17.286927] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-07T22:40:17.288810] [INFO ] [MAIN ] Derivative Progress: 977/1748 symbols completed. JPC took 1.1s. Estimated remaining: 4m 57s. Rate: 155.9 symbols/min [2025-10-07T22:40:17.289055] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:17.304550] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:17.315426] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-07T22:40:17.315693] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-07T22:40:17.317301] [DEBUG] [LOCAL ] JQC: Loaded 34440 existing records from primary storage. [2025-10-07T22:40:17.317514] [INFO ] [MAIN ] JQC: Loaded 34440 primary data records. [2025-10-07T22:40:17.432183] [DEBUG] [LOCAL ] JRI: Loaded 15101 existing records from primary storage. [2025-10-07T22:40:17.443708] [INFO ] [MAIN ] JRI: Loaded 15101 primary data records. [2025-10-07T22:40:17.459975] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-07T22:40:17.460071] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-07T22:40:17.470436] [INFO ] [MAIN ] Derivative Progress: 978/1748 symbols completed. JPM took 1.3s. Estimated remaining: 4m 56s. Rate: 156.0 symbols/min [2025-10-07T22:40:17.514329] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:17.847240] [DEBUG] [LOCAL ] JRS: Loaded 11483 existing records from primary storage. [2025-10-07T22:40:17.960831] [INFO ] [MAIN ] JRS: Loaded 11483 primary data records. [2025-10-07T22:40:18.291601] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:40:18.292985] [INFO ] [MAIN ] JQC: Generated 1793 derivative records from 34440 primary records. [2025-10-07T22:40:18.293460] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-07T22:40:18.313019] [DEBUG] [LOCAL ] JQC: Derivative data saved (1793 records). [2025-10-07T22:40:18.313403] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-07T22:40:18.327010] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:18.329113] [INFO ] [MAIN ] Derivative Progress: 979/1748 symbols completed. JQC took 1.1s. Estimated remaining: 4m 56s. Rate: 155.8 symbols/min [2025-10-07T22:40:18.330108] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:18.329946] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15101 primary records. [2025-10-07T22:40:18.330313] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-07T22:40:18.347481] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-07T22:40:18.347592] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-07T22:40:18.349807] [INFO ] [MAIN ] Derivative Progress: 980/1748 symbols completed. JRI took 1.1s. Estimated remaining: 4m 55s. Rate: 156.0 symbols/min [2025-10-07T22:40:18.350231] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:18.369385] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:18.370244] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11483 primary records. [2025-10-07T22:40:18.370367] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-07T22:40:18.389788] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-10-07T22:40:18.390127] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-07T22:40:18.392471] [INFO ] [MAIN ] Derivative Progress: 981/1748 symbols completed. JRS took 0.9s. Estimated remaining: 4m 55s. Rate: 156.1 symbols/min [2025-10-07T22:40:18.392974] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:18.448104] [DEBUG] [LOCAL ] K: Loaded 50101 existing records from primary storage. [2025-10-07T22:40:18.449338] [INFO ] [MAIN ] K: Loaded 50101 primary data records. [2025-10-07T22:40:18.450165] [DEBUG] [LOCAL ] JXN: Loaded 45206 existing records from primary storage. [2025-10-07T22:40:18.497905] [DEBUG] [LOCAL ] KAI: Loaded 13296 existing records from primary storage. [2025-10-07T22:40:18.502676] [INFO ] [MAIN ] JXN: Loaded 45206 primary data records. [2025-10-07T22:40:18.523496] [INFO ] [MAIN ] KAI: Loaded 13296 primary data records. [2025-10-07T22:40:19.390936] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:19.392362] [INFO ] [MAIN ] K: Generated 1794 derivative records from 50101 primary records. [2025-10-07T22:40:19.392552] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-07T22:40:19.420741] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:19.431300] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-07T22:40:19.436950] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-07T22:40:19.431972] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 45206 primary records. [2025-10-07T22:40:19.437223] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:19.437360] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-07T22:40:19.439867] [INFO ] [MAIN ] Derivative Progress: 982/1748 symbols completed. K took 1.1s. Estimated remaining: 4m 55s. Rate: 155.9 symbols/min [2025-10-07T22:40:19.438045] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13296 primary records. [2025-10-07T22:40:19.439979] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-07T22:40:19.440429] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:19.467798] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-07T22:40:19.471553] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-07T22:40:19.472305] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-07T22:40:19.472414] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-07T22:40:19.474414] [INFO ] [MAIN ] Derivative Progress: 983/1748 symbols completed. KAI took 1.1s. Estimated remaining: 4m 54s. Rate: 156.0 symbols/min [2025-10-07T22:40:19.476855] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:19.476956] [INFO ] [MAIN ] Derivative Progress: 984/1748 symbols completed. JXN took 1.1s. Estimated remaining: 4m 54s. Rate: 156.2 symbols/min [2025-10-07T22:40:19.477115] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:19.519293] [DEBUG] [LOCAL ] KBDC: Loaded 21539 existing records from primary storage. [2025-10-07T22:40:19.519865] [DEBUG] [LOCAL ] KB: Loaded 23640 existing records from primary storage. [2025-10-07T22:40:19.529827] [INFO ] [MAIN ] KBDC: Loaded 21539 primary data records. [2025-10-07T22:40:19.530947] [INFO ] [MAIN ] KB: Loaded 23640 primary data records. [2025-10-07T22:40:19.562225] [DEBUG] [LOCAL ] KAR: Loaded 40083 existing records from primary storage. [2025-10-07T22:40:19.606001] [INFO ] [MAIN ] KAR: Loaded 40083 primary data records. [2025-10-07T22:40:20.444130] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:20.447952] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 21539 primary records. [2025-10-07T22:40:20.448206] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-07T22:40:20.492865] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:20.493917] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-07T22:40:20.494344] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:20.495285] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-07T22:40:20.495185] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23640 primary records. [2025-10-07T22:40:20.497292] [INFO ] [MAIN ] Derivative Progress: 985/1748 symbols completed. KBDC took 1.0s. Estimated remaining: 4m 54s. Rate: 155.9 symbols/min [2025-10-07T22:40:20.497493] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:20.498292] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 40083 primary records. [2025-10-07T22:40:20.498558] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-07T22:40:20.498417] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-07T22:40:20.531170] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-07T22:40:20.531419] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-07T22:40:20.534749] [INFO ] [MAIN ] Derivative Progress: 986/1748 symbols completed. KAR took 1.1s. Estimated remaining: 4m 53s. Rate: 156.0 symbols/min [2025-10-07T22:40:20.532694] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-07T22:40:20.535180] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:20.535045] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-07T22:40:20.537714] [INFO ] [MAIN ] Derivative Progress: 987/1748 symbols completed. KB took 1.1s. Estimated remaining: 4m 52s. Rate: 156.2 symbols/min [2025-10-07T22:40:20.538321] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:20.572588] [DEBUG] [LOCAL ] KBH: Loaded 48893 existing records from primary storage. [2025-10-07T22:40:20.574911] [INFO ] [MAIN ] KBH: Loaded 48893 primary data records. [2025-10-07T22:40:20.949139] [DEBUG] [LOCAL ] KD: Loaded 52329 existing records from primary storage. [2025-10-07T22:40:20.948280] [DEBUG] [LOCAL ] KBR: Loaded 47906 existing records from primary storage. [2025-10-07T22:40:20.949564] [INFO ] [MAIN ] KBR: Loaded 47906 primary data records. [2025-10-07T22:40:20.949701] [INFO ] [MAIN ] KD: Loaded 52329 primary data records. [2025-10-07T22:40:21.571121] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:21.572922] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48893 primary records. [2025-10-07T22:40:21.573156] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-07T22:40:21.591190] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-07T22:40:21.591421] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-07T22:40:21.593996] [INFO ] [MAIN ] Derivative Progress: 988/1748 symbols completed. KBH took 1.1s. Estimated remaining: 4m 52s. Rate: 155.9 symbols/min [2025-10-07T22:40:21.613425] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:21.616142] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 47906 primary records. [2025-10-07T22:40:21.616429] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-07T22:40:21.629608] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:21.631290] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52329 primary records. [2025-10-07T22:40:21.631633] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-07T22:40:21.656119] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-07T22:40:21.661129] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-07T22:40:21.663046] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-07T22:40:21.665213] [INFO ] [MAIN ] Derivative Progress: 989/1748 symbols completed. KBR took 1.1s. Estimated remaining: 4m 52s. Rate: 156.0 symbols/min [2025-10-07T22:40:21.663144] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-07T22:40:21.667605] [INFO ] [MAIN ] Derivative Progress: 990/1748 symbols completed. KD took 1.1s. Estimated remaining: 4m 51s. Rate: 156.2 symbols/min [2025-10-07T22:40:21.668228] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:21.668160] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:21.668480] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:21.677289] [DEBUG] [LOCAL ] KEN: Loaded 4674 existing records from primary storage. [2025-10-07T22:40:21.677436] [INFO ] [MAIN ] KEN: Loaded 4674 primary data records. [2025-10-07T22:40:21.887384] [DEBUG] [LOCAL ] KEP: Loaded 31291 existing records from primary storage. [2025-10-07T22:40:22.001943] [INFO ] [MAIN ] KEP: Loaded 31291 primary data records. [2025-10-07T22:40:22.079925] [DEBUG] [LOCAL ] KEX: Loaded 38453 existing records from primary storage. [2025-10-07T22:40:22.098102] [INFO ] [MAIN ] KEX: Loaded 38453 primary data records. [2025-10-07T22:40:22.703188] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:22.705165] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4674 primary records. [2025-10-07T22:40:22.706080] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-07T22:40:22.725969] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-07T22:40:22.726557] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-07T22:40:22.728933] [INFO ] [MAIN ] Derivative Progress: 991/1748 symbols completed. KEN took 1.1s. Estimated remaining: 4m 51s. Rate: 155.9 symbols/min [2025-10-07T22:40:22.729181] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:22.750807] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:22.751874] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 31291 primary records. [2025-10-07T22:40:22.752050] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-07T22:40:22.765925] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:22.767493] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38453 primary records. [2025-10-07T22:40:22.767635] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-07T22:40:22.796695] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-07T22:40:22.800542] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-07T22:40:22.803112] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-07T22:40:22.802810] [INFO ] [MAIN ] Derivative Progress: 992/1748 symbols completed. KEP took 1.1s. Estimated remaining: 4m 51s. Rate: 156.1 symbols/min [2025-10-07T22:40:22.803225] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-07T22:40:22.805415] [INFO ] [MAIN ] Derivative Progress: 993/1748 symbols completed. KEX took 1.1s. Estimated remaining: 4m 50s. Rate: 156.2 symbols/min [2025-10-07T22:40:22.803476] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:22.815154] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:22.825014] [DEBUG] [LOCAL ] KF: Loaded 2377 existing records from primary storage. [2025-10-07T22:40:22.825165] [INFO ] [MAIN ] KF: Loaded 2377 primary data records. [2025-10-07T22:40:22.937960] [DEBUG] [LOCAL ] KEYS: Loaded 43149 existing records from primary storage. [2025-10-07T22:40:22.938181] [INFO ] [MAIN ] KEYS: Loaded 43149 primary data records. [2025-10-07T22:40:23.243155] [DEBUG] [LOCAL ] KFRC: Loaded 19897 existing records from primary storage. [2025-10-07T22:40:23.255219] [INFO ] [MAIN ] KFRC: Loaded 19897 primary data records. [2025-10-07T22:40:23.827434] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:40:23.830036] [INFO ] [MAIN ] KF: Generated 1792 derivative records from 2377 primary records. [2025-10-07T22:40:23.831167] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-07T22:40:23.865545] [DEBUG] [LOCAL ] KF: Derivative data saved (1792 records). [2025-10-07T22:40:23.866105] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:23.867043] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43149 primary records. [2025-10-07T22:40:23.867299] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-07T22:40:23.867365] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-07T22:40:23.870584] [INFO ] [MAIN ] Derivative Progress: 994/1748 symbols completed. KF took 1.1s. Estimated remaining: 4m 50s. Rate: 155.9 symbols/min [2025-10-07T22:40:23.871308] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:23.890686] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-07T22:40:23.891937] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-07T22:40:23.894672] [INFO ] [MAIN ] Derivative Progress: 995/1748 symbols completed. KEYS took 1.2s. Estimated remaining: 4m 49s. Rate: 156.1 symbols/min [2025-10-07T22:40:23.910210] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:23.914217] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:23.915222] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19897 primary records. [2025-10-07T22:40:23.915423] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-07T22:40:23.920505] [DEBUG] [LOCAL ] KFS: Loaded 8525 existing records from primary storage. [2025-10-07T22:40:23.921005] [INFO ] [MAIN ] KFS: Loaded 8525 primary data records. [2025-10-07T22:40:24.073058] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-07T22:40:24.101698] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-07T22:40:24.131228] [INFO ] [MAIN ] Derivative Progress: 996/1748 symbols completed. KFRC took 1.3s. Estimated remaining: 4m 49s. Rate: 156.1 symbols/min [2025-10-07T22:40:24.150844] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:24.290071] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-07T22:40:24.290877] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-10-07T22:40:24.678381] [DEBUG] [LOCAL ] KGS: Loaded 45896 existing records from primary storage. [2025-10-07T22:40:24.680713] [INFO ] [MAIN ] KGS: Loaded 45896 primary data records. [2025-10-07T22:40:24.789604] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:24.802445] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8525 primary records. [2025-10-07T22:40:24.802930] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-07T22:40:24.898015] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-10-07T22:40:25.016709] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-07T22:40:25.027871] [INFO ] [MAIN ] Derivative Progress: 997/1748 symbols completed. KFS took 1.2s. Estimated remaining: 4m 49s. Rate: 155.9 symbols/min [2025-10-07T22:40:25.028503] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:25.048582] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:25.049485] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-10-07T22:40:25.049584] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-07T22:40:25.069460] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-07T22:40:25.069740] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-07T22:40:25.072756] [INFO ] [MAIN ] Derivative Progress: 998/1748 symbols completed. KGC took 1.2s. Estimated remaining: 4m 48s. Rate: 156.1 symbols/min [2025-10-07T22:40:25.073808] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:25.104431] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:25.105205] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45896 primary records. [2025-10-07T22:40:25.105371] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-07T22:40:25.139981] [DEBUG] [LOCAL ] KIM: Loaded 53026 existing records from primary storage. [2025-10-07T22:40:25.140633] [INFO ] [MAIN ] KIM: Loaded 53026 primary data records. [2025-10-07T22:40:25.207606] [DEBUG] [LOCAL ] KIO: Loaded 21383 existing records from primary storage. [2025-10-07T22:40:25.222080] [INFO ] [MAIN ] KIO: Loaded 21383 primary data records. [2025-10-07T22:40:25.314692] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-07T22:40:25.328521] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-07T22:40:25.404074] [INFO ] [MAIN ] Derivative Progress: 999/1748 symbols completed. KGS took 1.3s. Estimated remaining: 4m 48s. Rate: 156.1 symbols/min [2025-10-07T22:40:25.433764] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:25.805680] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:25.806515] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53026 primary records. [2025-10-07T22:40:25.806813] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-07T22:40:25.854678] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:25.856706] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21383 primary records. [2025-10-07T22:40:25.857054] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-07T22:40:25.857837] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-10-07T22:40:25.855881] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-10-07T22:40:25.858623] [INFO ] [MAIN ] KKR: Loaded 53502 primary data records. [2025-10-07T22:40:25.858552] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-07T22:40:25.860848] [INFO ] [MAIN ] Derivative Progress: 1000/1748 symbols completed. KIM took 0.8s. Estimated remaining: 4m 48s. Rate: 156.1 symbols/min [2025-10-07T22:40:25.922530] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:25.980715] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-07T22:40:25.996525] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-07T22:40:26.023402] [DEBUG] [LOCAL ] KKRS: Loaded 5718 existing records from primary storage. [2025-10-07T22:40:26.023531] [INFO ] [MAIN ] KKRS: Loaded 5718 primary data records. [2025-10-07T22:40:26.025956] [INFO ] [MAIN ] Derivative Progress: 1001/1748 symbols completed. KIO took 1.0s. Estimated remaining: 4m 47s. Rate: 156.1 symbols/min [2025-10-07T22:40:26.070370] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:26.508202] [DEBUG] [LOCAL ] KLC: Loaded 36880 existing records from primary storage. [2025-10-07T22:40:26.509052] [INFO ] [MAIN ] KLC: Loaded 36880 primary data records. [2025-10-07T22:40:26.627676] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:26.644247] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53502 primary records. [2025-10-07T22:40:26.644395] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-07T22:40:26.795493] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-10-07T22:40:26.796432] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-07T22:40:26.903855] [INFO ] [MAIN ] Derivative Progress: 1002/1748 symbols completed. KKR took 1.5s. Estimated remaining: 4m 47s. Rate: 155.9 symbols/min [2025-10-07T22:40:26.913533] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:26.928579] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:26.929594] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5718 primary records. [2025-10-07T22:40:26.929828] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-07T22:40:26.950557] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-10-07T22:40:26.950853] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-07T22:40:26.953122] [INFO ] [MAIN ] Derivative Progress: 1003/1748 symbols completed. KKRS took 1.0s. Estimated remaining: 4m 46s. Rate: 156.1 symbols/min [2025-10-07T22:40:26.972893] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:26.973583] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36880 primary records. [2025-10-07T22:40:26.973703] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-07T22:40:27.003380] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-07T22:40:27.003581] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-07T22:40:27.005741] [INFO ] [MAIN ] Derivative Progress: 1004/1748 symbols completed. KLC took 0.9s. Estimated remaining: 4m 46s. Rate: 156.2 symbols/min [2025-10-07T22:40:27.023952] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-07T22:40:27.024090] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-07T22:40:27.332741] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:27.333366] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-07T22:40:27.333428] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-07T22:40:27.348879] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-07T22:40:27.348938] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-07T22:40:27.350831] [INFO ] [MAIN ] Derivative Progress: 1005/1748 symbols completed. KMI took 0.4s. Estimated remaining: 4m 45s. Rate: 156.2 symbols/min [2025-10-07T22:40:27.351281] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:27.351428] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:27.351539] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:27.358825] [DEBUG] [LOCAL ] KMPB: Loaded 3812 existing records from primary storage. [2025-10-07T22:40:27.359115] [INFO ] [MAIN ] KMPB: Loaded 3812 primary data records. [2025-10-07T22:40:27.724303] [DEBUG] [LOCAL ] KMT: Loaded 43017 existing records from primary storage. [2025-10-07T22:40:27.735488] [INFO ] [MAIN ] KMT: Loaded 43017 primary data records. [2025-10-07T22:40:27.749104] [DEBUG] [LOCAL ] KMPR: Loaded 39271 existing records from primary storage. [2025-10-07T22:40:27.771226] [INFO ] [MAIN ] KMPR: Loaded 39271 primary data records. [2025-10-07T22:40:28.370259] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-07T22:40:28.371368] [INFO ] [MAIN ] KMPB: Generated 1791 derivative records from 3812 primary records. [2025-10-07T22:40:28.371590] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-07T22:40:28.389340] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1791 records). [2025-10-07T22:40:28.389662] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-07T22:40:28.392334] [INFO ] [MAIN ] Derivative Progress: 1006/1748 symbols completed. KMPB took 1.0s. Estimated remaining: 4m 45s. Rate: 156.0 symbols/min [2025-10-07T22:40:28.392620] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:28.427078] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:28.426900] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:28.427870] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 39271 primary records. [2025-10-07T22:40:28.428483] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 43017 primary records. [2025-10-07T22:40:28.428568] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-07T22:40:28.428751] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-07T22:40:28.462029] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-07T22:40:28.462237] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-07T22:40:28.460913] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-07T22:40:28.464466] [INFO ] [MAIN ] Derivative Progress: 1007/1748 symbols completed. KMPR took 1.1s. Estimated remaining: 4m 45s. Rate: 156.1 symbols/min [2025-10-07T22:40:28.464636] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:28.465070] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-07T22:40:28.468819] [INFO ] [MAIN ] Derivative Progress: 1008/1748 symbols completed. KMT took 1.1s. Estimated remaining: 4m 44s. Rate: 156.2 symbols/min [2025-10-07T22:40:28.469102] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:28.527044] [DEBUG] [LOCAL ] KMX: Loaded 53191 existing records from primary storage. [2025-10-07T22:40:28.527322] [INFO ] [MAIN ] KMX: Loaded 53191 primary data records. [2025-10-07T22:40:28.639223] [DEBUG] [LOCAL ] KN: Loaded 38610 existing records from primary storage. [2025-10-07T22:40:28.675117] [INFO ] [MAIN ] KN: Loaded 38610 primary data records. [2025-10-07T22:40:28.705479] [DEBUG] [LOCAL ] KNF: Loaded 36138 existing records from primary storage. [2025-10-07T22:40:28.733218] [INFO ] [MAIN ] KNF: Loaded 36138 primary data records. [2025-10-07T22:40:29.527009] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:29.528631] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53191 primary records. [2025-10-07T22:40:29.528925] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-07T22:40:29.568117] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-07T22:40:29.569529] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:29.570480] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-07T22:40:29.570399] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38610 primary records. [2025-10-07T22:40:29.574341] [INFO ] [MAIN ] Derivative Progress: 1009/1748 symbols completed. KMX took 1.2s. Estimated remaining: 4m 44s. Rate: 156.0 symbols/min [2025-10-07T22:40:29.574698] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:29.571550] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-07T22:40:29.603213] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:29.604725] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 36138 primary records. [2025-10-07T22:40:29.605020] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-07T22:40:29.624899] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-07T22:40:29.625263] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-07T22:40:29.627720] [INFO ] [MAIN ] Derivative Progress: 1010/1748 symbols completed. KN took 1.2s. Estimated remaining: 4m 44s. Rate: 156.1 symbols/min [2025-10-07T22:40:29.628790] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:29.636337] [DEBUG] [LOCAL ] KNSL: Loaded 18443 existing records from primary storage. [2025-10-07T22:40:29.637574] [INFO ] [MAIN ] KNSL: Loaded 18443 primary data records. [2025-10-07T22:40:29.698109] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-07T22:40:29.717591] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-07T22:40:29.734372] [INFO ] [MAIN ] Derivative Progress: 1011/1748 symbols completed. KNF took 1.3s. Estimated remaining: 4m 43s. Rate: 156.2 symbols/min [2025-10-07T22:40:29.734676] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:30.003452] [DEBUG] [LOCAL ] KNTK: Loaded 46489 existing records from primary storage. [2025-10-07T22:40:30.003786] [INFO ] [MAIN ] KNTK: Loaded 46489 primary data records. [2025-10-07T22:40:30.333963] [DEBUG] [LOCAL ] KNX: Loaded 52597 existing records from primary storage. [2025-10-07T22:40:30.334885] [INFO ] [MAIN ] KNX: Loaded 52597 primary data records. [2025-10-07T22:40:30.512407] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:30.683369] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18443 primary records. [2025-10-07T22:40:30.701880] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-07T22:40:30.720366] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-07T22:40:30.721484] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-07T22:40:30.723937] [INFO ] [MAIN ] Derivative Progress: 1012/1748 symbols completed. KNSL took 1.1s. Estimated remaining: 4m 43s. Rate: 156.0 symbols/min [2025-10-07T22:40:30.724673] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:30.747678] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:30.749283] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46489 primary records. [2025-10-07T22:40:30.749446] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-07T22:40:30.770275] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-07T22:40:30.770565] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-07T22:40:30.772848] [INFO ] [MAIN ] Derivative Progress: 1013/1748 symbols completed. KNTK took 1.1s. Estimated remaining: 4m 43s. Rate: 156.1 symbols/min [2025-10-07T22:40:30.773152] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:30.800811] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:30.801593] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52597 primary records. [2025-10-07T22:40:30.802509] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-07T22:40:30.832277] [DEBUG] [LOCAL ] KODK: Loaded 43411 existing records from primary storage. [2025-10-07T22:40:30.832665] [INFO ] [MAIN ] KODK: Loaded 43411 primary data records. [2025-10-07T22:40:30.832446] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-07T22:40:30.832906] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-07T22:40:30.866188] [INFO ] [MAIN ] Derivative Progress: 1014/1748 symbols completed. KNX took 1.1s. Estimated remaining: 4m 42s. Rate: 156.2 symbols/min [2025-10-07T22:40:30.879774] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:31.015635] [DEBUG] [LOCAL ] KOF: Loaded 26511 existing records from primary storage. [2025-10-07T22:40:31.032682] [INFO ] [MAIN ] KOF: Loaded 26511 primary data records. [2025-10-07T22:40:31.233944] [DEBUG] [LOCAL ] KOP: Loaded 17540 existing records from primary storage. [2025-10-07T22:40:31.239510] [INFO ] [MAIN ] KOP: Loaded 17540 primary data records. [2025-10-07T22:40:31.796671] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:31.797852] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43411 primary records. [2025-10-07T22:40:31.798553] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-07T22:40:31.835193] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-07T22:40:31.833309] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:31.836474] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26511 primary records. [2025-10-07T22:40:31.835692] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-07T22:40:31.838873] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-07T22:40:31.838786] [INFO ] [MAIN ] Derivative Progress: 1015/1748 symbols completed. KODK took 1.1s. Estimated remaining: 4m 42s. Rate: 156.0 symbols/min [2025-10-07T22:40:31.839308] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:31.864295] [DEBUG] [LOCAL ] KORE: Loaded 2093 existing records from primary storage. [2025-10-07T22:40:31.877901] [INFO ] [MAIN ] KORE: Loaded 2093 primary data records. [2025-10-07T22:40:31.878674] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:31.890772] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17540 primary records. [2025-10-07T22:40:31.900295] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-07T22:40:31.917453] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-07T22:40:31.936758] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-07T22:40:31.960671] [INFO ] [MAIN ] Derivative Progress: 1016/1748 symbols completed. KOF took 1.2s. Estimated remaining: 4m 41s. Rate: 156.1 symbols/min [2025-10-07T22:40:31.986108] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:32.219099] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-07T22:40:32.219334] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-07T22:40:32.222018] [INFO ] [MAIN ] Derivative Progress: 1017/1748 symbols completed. KOP took 1.3s. Estimated remaining: 4m 41s. Rate: 156.1 symbols/min [2025-10-07T22:40:32.222323] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:32.282713] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-07T22:40:32.284453] [INFO ] [MAIN ] KORE: Generated 1790 derivative records from 2093 primary records. [2025-10-07T22:40:32.304079] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-07T22:40:32.306271] [DEBUG] [LOCAL ] KOS: Loaded 53067 existing records from primary storage. [2025-10-07T22:40:32.306839] [INFO ] [MAIN ] KOS: Loaded 53067 primary data records. [2025-10-07T22:40:32.486633] [DEBUG] [LOCAL ] KORE: Derivative data saved (1790 records). [2025-10-07T22:40:32.503993] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-07T22:40:32.509457] [INFO ] [MAIN ] Derivative Progress: 1018/1748 symbols completed. KORE took 0.7s. Estimated remaining: 4m 40s. Rate: 156.2 symbols/min [2025-10-07T22:40:32.515031] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-07T22:40:32.520195] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-07T22:40:33.278576] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:33.279444] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53067 primary records. [2025-10-07T22:40:33.279782] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-07T22:40:33.301228] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-07T22:40:33.301528] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-07T22:40:33.315449] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:33.317680] [INFO ] [MAIN ] Derivative Progress: 1019/1748 symbols completed. KOS took 1.3s. Estimated remaining: 4m 40s. Rate: 156.0 symbols/min [2025-10-07T22:40:33.318633] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-10-07T22:40:33.318742] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-07T22:40:33.335830] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-07T22:40:33.335944] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-07T22:40:33.339236] [INFO ] [MAIN ] Derivative Progress: 1020/1748 symbols completed. KR took 1.1s. Estimated remaining: 4m 40s. Rate: 156.1 symbols/min [2025-10-07T22:40:33.339737] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:33.339785] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:33.339919] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:33.439585] [DEBUG] [LOCAL ] KREF: Loaded 37782 existing records from primary storage. [2025-10-07T22:40:33.441031] [DEBUG] [LOCAL ] KRC: Loaded 48364 existing records from primary storage. [2025-10-07T22:40:33.441368] [INFO ] [MAIN ] KRC: Loaded 48364 primary data records. [2025-10-07T22:40:33.441224] [INFO ] [MAIN ] KREF: Loaded 37782 primary data records. [2025-10-07T22:40:33.442136] [DEBUG] [LOCAL ] KRG: Loaded 49208 existing records from primary storage. [2025-10-07T22:40:33.442439] [INFO ] [MAIN ] KRG: Loaded 49208 primary data records. [2025-10-07T22:40:34.468325] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:34.469689] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49208 primary records. [2025-10-07T22:40:34.478097] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-07T22:40:34.484206] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:34.508870] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48364 primary records. [2025-10-07T22:40:34.509411] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-07T22:40:34.509311] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:34.516731] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37782 primary records. [2025-10-07T22:40:34.517560] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-07T22:40:34.526935] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-07T22:40:34.531051] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-07T22:40:34.532949] [INFO ] [MAIN ] Derivative Progress: 1021/1748 symbols completed. KRG took 1.2s. Estimated remaining: 4m 40s. Rate: 155.8 symbols/min [2025-10-07T22:40:34.533732] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:34.555522] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-07T22:40:34.556098] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-07T22:40:34.558524] [INFO ] [MAIN ] Derivative Progress: 1022/1748 symbols completed. KREF took 1.2s. Estimated remaining: 4m 39s. Rate: 156.0 symbols/min [2025-10-07T22:40:34.559066] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:34.567324] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-10-07T22:40:34.567632] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-07T22:40:34.569852] [INFO ] [MAIN ] Derivative Progress: 1023/1748 symbols completed. KRC took 1.2s. Estimated remaining: 4m 39s. Rate: 156.1 symbols/min [2025-10-07T22:40:34.570144] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:34.581811] [DEBUG] [LOCAL ] KRO: Loaded 26164 existing records from primary storage. [2025-10-07T22:40:34.582137] [INFO ] [MAIN ] KRO: Loaded 26164 primary data records. [2025-10-07T22:40:34.913059] [DEBUG] [LOCAL ] KRP: Loaded 36699 existing records from primary storage. [2025-10-07T22:40:34.915847] [INFO ] [MAIN ] KRP: Loaded 36699 primary data records. [2025-10-07T22:40:34.975228] [DEBUG] [LOCAL ] KSS: Loaded 53600 existing records from primary storage. [2025-10-07T22:40:34.986524] [INFO ] [MAIN ] KSS: Loaded 53600 primary data records. [2025-10-07T22:40:35.636863] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:35.637970] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26164 primary records. [2025-10-07T22:40:35.638567] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-07T22:40:35.662351] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-07T22:40:35.663346] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-07T22:40:35.665546] [INFO ] [MAIN ] Derivative Progress: 1024/1748 symbols completed. KRO took 1.1s. Estimated remaining: 4m 39s. Rate: 155.8 symbols/min [2025-10-07T22:40:35.666269] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:35.689777] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:35.703879] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:35.703590] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 36699 primary records. [2025-10-07T22:40:35.704573] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53600 primary records. [2025-10-07T22:40:35.706059] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-07T22:40:35.705958] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-07T22:40:35.747755] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-07T22:40:35.749102] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-07T22:40:35.751313] [INFO ] [MAIN ] Derivative Progress: 1025/1748 symbols completed. KRP took 1.2s. Estimated remaining: 4m 38s. Rate: 155.9 symbols/min [2025-10-07T22:40:35.751947] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:35.753877] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-07T22:40:35.753944] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-07T22:40:35.756194] [INFO ] [MAIN ] Derivative Progress: 1026/1748 symbols completed. KSS took 1.2s. Estimated remaining: 4m 38s. Rate: 156.1 symbols/min [2025-10-07T22:40:35.756537] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:35.772510] [DEBUG] [LOCAL ] KT: Loaded 45597 existing records from primary storage. [2025-10-07T22:40:35.772801] [INFO ] [MAIN ] KT: Loaded 45597 primary data records. [2025-10-07T22:40:35.877537] [DEBUG] [LOCAL ] KTF: Loaded 12066 existing records from primary storage. [2025-10-07T22:40:35.895983] [INFO ] [MAIN ] KTF: Loaded 12066 primary data records. [2025-10-07T22:40:36.427432] [DEBUG] [LOCAL ] KTB: Loaded 40697 existing records from primary storage. [2025-10-07T22:40:36.437878] [INFO ] [MAIN ] KTB: Loaded 40697 primary data records. [2025-10-07T22:40:36.777684] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:36.793103] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45597 primary records. [2025-10-07T22:40:36.793363] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-07T22:40:36.793732] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:36.804999] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 12066 primary records. [2025-10-07T22:40:36.807821] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-07T22:40:36.826777] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-07T22:40:36.827151] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-07T22:40:36.829720] [INFO ] [MAIN ] Derivative Progress: 1027/1748 symbols completed. KTF took 1.1s. Estimated remaining: 4m 38s. Rate: 155.8 symbols/min [2025-10-07T22:40:36.830377] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:36.833757] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-07T22:40:36.833899] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-07T22:40:36.842567] [INFO ] [MAIN ] Derivative Progress: 1028/1748 symbols completed. KT took 1.2s. Estimated remaining: 4m 37s. Rate: 156.0 symbols/min [2025-10-07T22:40:36.844227] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:36.860206] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:36.861566] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 40697 primary records. [2025-10-07T22:40:36.861737] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-07T22:40:36.887536] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-07T22:40:36.889421] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-07T22:40:36.892358] [INFO ] [MAIN ] Derivative Progress: 1029/1748 symbols completed. KTB took 1.1s. Estimated remaining: 4m 36s. Rate: 156.1 symbols/min [2025-10-07T22:40:36.892794] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:36.955027] [DEBUG] [LOCAL ] KVYO: Loaded 50334 existing records from primary storage. [2025-10-07T22:40:36.955269] [INFO ] [MAIN ] KVYO: Loaded 50334 primary data records. [2025-10-07T22:40:36.964951] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-07T22:40:36.982623] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-07T22:40:37.250318] [DEBUG] [LOCAL ] KW: Loaded 40422 existing records from primary storage. [2025-10-07T22:40:37.373571] [INFO ] [MAIN ] KW: Loaded 40422 primary data records. [2025-10-07T22:40:37.948609] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:37.953859] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:40:37.954714] [INFO ] [MAIN ] KVYO: Generated 1793 derivative records from 50334 primary records. [2025-10-07T22:40:37.955591] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-07T22:40:37.955715] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-07T22:40:37.955033] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-07T22:40:37.990179] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1793 records). [2025-10-07T22:40:37.988225] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-07T22:40:37.990490] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-07T22:40:37.990552] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-07T22:40:37.992571] [INFO ] [MAIN ] Derivative Progress: 1030/1748 symbols completed. KVYO took 1.1s. Estimated remaining: 4m 36s. Rate: 155.8 symbols/min [2025-10-07T22:40:37.992806] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:38.009169] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:37.995221] [INFO ] [MAIN ] Derivative Progress: 1031/1748 symbols completed. KVUE took 1.2s. Estimated remaining: 4m 36s. Rate: 156.0 symbols/min [2025-10-07T22:40:38.009340] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:38.010290] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40422 primary records. [2025-10-07T22:40:38.010449] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-07T22:40:38.027160] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-07T22:40:38.027299] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-07T22:40:38.029634] [INFO ] [MAIN ] Derivative Progress: 1032/1748 symbols completed. KW took 1.1s. Estimated remaining: 4m 35s. Rate: 156.1 symbols/min [2025-10-07T22:40:38.029963] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:38.044724] [DEBUG] [LOCAL ] KWR: Loaded 16316 existing records from primary storage. [2025-10-07T22:40:38.044872] [INFO ] [MAIN ] KWR: Loaded 16316 primary data records. [2025-10-07T22:40:38.191382] [DEBUG] [LOCAL ] KYN: Loaded 29972 existing records from primary storage. [2025-10-07T22:40:38.210148] [INFO ] [MAIN ] KYN: Loaded 29972 primary data records. [2025-10-07T22:40:38.521778] [DEBUG] [LOCAL ] L: Loaded 41121 existing records from primary storage. [2025-10-07T22:40:38.522465] [INFO ] [MAIN ] L: Loaded 41121 primary data records. [2025-10-07T22:40:39.151231] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:39.153037] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16316 primary records. [2025-10-07T22:40:39.153532] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-07T22:40:39.174571] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-07T22:40:39.175411] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-07T22:40:39.177460] [INFO ] [MAIN ] Derivative Progress: 1033/1748 symbols completed. KWR took 1.2s. Estimated remaining: 4m 35s. Rate: 155.8 symbols/min [2025-10-07T22:40:39.200005] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:39.201968] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 29972 primary records. [2025-10-07T22:40:39.202595] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-07T22:40:39.234010] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:39.238494] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-07T22:40:39.238726] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-07T22:40:39.242161] [INFO ] [MAIN ] Derivative Progress: 1034/1748 symbols completed. KYN took 1.2s. Estimated remaining: 4m 35s. Rate: 155.9 symbols/min [2025-10-07T22:40:39.238608] [INFO ] [MAIN ] L: Generated 1794 derivative records from 41121 primary records. [2025-10-07T22:40:39.242445] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-07T22:40:39.262011] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-10-07T22:40:39.262157] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-07T22:40:39.264857] [INFO ] [MAIN ] Derivative Progress: 1035/1748 symbols completed. L took 1.2s. Estimated remaining: 4m 34s. Rate: 156.1 symbols/min [2025-10-07T22:40:39.266006] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:39.265872] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:39.266269] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:39.301625] [DEBUG] [LOCAL ] LAD: Loaded 23615 existing records from primary storage. [2025-10-07T22:40:39.315237] [INFO ] [MAIN ] LAD: Loaded 23615 primary data records. [2025-10-07T22:40:39.469588] [DEBUG] [LOCAL ] LADR: Loaded 39140 existing records from primary storage. [2025-10-07T22:40:39.471741] [DEBUG] [LOCAL ] LAC: Loaded 52426 existing records from primary storage. [2025-10-07T22:40:39.487792] [INFO ] [MAIN ] LADR: Loaded 39140 primary data records. [2025-10-07T22:40:39.487687] [INFO ] [MAIN ] LAC: Loaded 52426 primary data records. [2025-10-07T22:40:40.326818] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:40.328001] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 23615 primary records. [2025-10-07T22:40:40.328180] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-07T22:40:40.365958] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-10-07T22:40:40.367172] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-07T22:40:40.369112] [INFO ] [MAIN ] Derivative Progress: 1036/1748 symbols completed. LAD took 1.1s. Estimated remaining: 4m 34s. Rate: 155.8 symbols/min [2025-10-07T22:40:40.367076] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:40.369299] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:40.370413] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 39140 primary records. [2025-10-07T22:40:40.386341] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-07T22:40:40.387736] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:40.389021] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52426 primary records. [2025-10-07T22:40:40.389202] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-07T22:40:40.407021] [DEBUG] [LOCAL ] LANV: Loaded 2798 existing records from primary storage. [2025-10-07T22:40:40.407390] [INFO ] [MAIN ] LANV: Loaded 2798 primary data records. [2025-10-07T22:40:40.510667] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-07T22:40:40.542840] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-07T22:40:40.535771] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-07T22:40:40.548138] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-07T22:40:40.556041] [INFO ] [MAIN ] Derivative Progress: 1037/1748 symbols completed. LAC took 1.3s. Estimated remaining: 4m 34s. Rate: 155.9 symbols/min [2025-10-07T22:40:40.577487] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:40.586848] [INFO ] [MAIN ] Derivative Progress: 1038/1748 symbols completed. LADR took 1.3s. Estimated remaining: 4m 33s. Rate: 156.0 symbols/min [2025-10-07T22:40:40.738475] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:40.755386] [DEBUG] [LOCAL ] LAW: Loaded 14260 existing records from primary storage. [2025-10-07T22:40:40.755538] [INFO ] [MAIN ] LAW: Loaded 14260 primary data records. [2025-10-07T22:40:41.101879] [DEBUG] [LOCAL ] LAZ: Loaded 44783 existing records from primary storage. [2025-10-07T22:40:41.116722] [INFO ] [MAIN ] LAZ: Loaded 44783 primary data records. [2025-10-07T22:40:41.118057] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:40:41.151582] [INFO ] [MAIN ] LANV: Generated 1792 derivative records from 2798 primary records. [2025-10-07T22:40:41.157445] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-07T22:40:41.395195] [DEBUG] [LOCAL ] LANV: Derivative data saved (1792 records). [2025-10-07T22:40:41.507312] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-07T22:40:41.509415] [INFO ] [MAIN ] Derivative Progress: 1039/1748 symbols completed. LANV took 1.1s. Estimated remaining: 4m 33s. Rate: 155.8 symbols/min [2025-10-07T22:40:41.510267] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:41.532367] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:41.533820] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14260 primary records. [2025-10-07T22:40:41.533948] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-07T22:40:41.553511] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-07T22:40:41.553966] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-07T22:40:41.556245] [INFO ] [MAIN ] Derivative Progress: 1040/1748 symbols completed. LAW took 1.0s. Estimated remaining: 4m 32s. Rate: 155.9 symbols/min [2025-10-07T22:40:41.556543] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:41.583433] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:41.584140] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44783 primary records. [2025-10-07T22:40:41.584282] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-07T22:40:41.610937] [DEBUG] [LOCAL ] LB: Loaded 37759 existing records from primary storage. [2025-10-07T22:40:41.611508] [INFO ] [MAIN ] LB: Loaded 37759 primary data records. [2025-10-07T22:40:41.690746] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-07T22:40:41.696941] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-07T22:40:41.699704] [INFO ] [MAIN ] Derivative Progress: 1041/1748 symbols completed. LAZ took 1.0s. Estimated remaining: 4m 32s. Rate: 156.0 symbols/min [2025-10-07T22:40:41.700005] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:41.954002] [DEBUG] [LOCAL ] LBRT: Loaded 52933 existing records from primary storage. [2025-10-07T22:40:41.971445] [INFO ] [MAIN ] LBRT: Loaded 52933 primary data records. [2025-10-07T22:40:42.052267] [DEBUG] [LOCAL ] LCII: Loaded 27755 existing records from primary storage. [2025-10-07T22:40:42.082608] [INFO ] [MAIN ] LCII: Loaded 27755 primary data records. [2025-10-07T22:40:42.696672] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:42.697828] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37759 primary records. [2025-10-07T22:40:42.698163] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-07T22:40:42.725708] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-07T22:40:42.727200] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-07T22:40:42.729607] [INFO ] [MAIN ] Derivative Progress: 1042/1748 symbols completed. LB took 1.2s. Estimated remaining: 4m 32s. Rate: 155.8 symbols/min [2025-10-07T22:40:42.730943] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:42.748105] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:42.748949] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52933 primary records. [2025-10-07T22:40:42.749144] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-07T22:40:42.785895] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:42.785635] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-10-07T22:40:42.786058] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-07T22:40:42.786915] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 27755 primary records. [2025-10-07T22:40:42.789298] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-07T22:40:42.789183] [INFO ] [MAIN ] Derivative Progress: 1043/1748 symbols completed. LBRT took 1.2s. Estimated remaining: 4m 31s. Rate: 155.9 symbols/min [2025-10-07T22:40:42.790491] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:42.820108] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-10-07T22:40:42.820311] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-07T22:40:42.823220] [INFO ] [MAIN ] Derivative Progress: 1044/1748 symbols completed. LCII took 1.1s. Estimated remaining: 4m 31s. Rate: 156.0 symbols/min [2025-10-07T22:40:42.823592] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:42.839560] [DEBUG] [LOCAL ] LDI: Loaded 44391 existing records from primary storage. [2025-10-07T22:40:42.839974] [INFO ] [MAIN ] LDI: Loaded 44391 primary data records. [2025-10-07T22:40:42.952001] [DEBUG] [LOCAL ] LDP: Loaded 12973 existing records from primary storage. [2025-10-07T22:40:42.974705] [INFO ] [MAIN ] LDP: Loaded 12973 primary data records. [2025-10-07T22:40:43.303330] [DEBUG] [LOCAL ] LDOS: Loaded 45428 existing records from primary storage. [2025-10-07T22:40:43.316587] [INFO ] [MAIN ] LDOS: Loaded 45428 primary data records. [2025-10-07T22:40:43.922191] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:43.923871] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44391 primary records. [2025-10-07T22:40:43.924393] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-07T22:40:43.960916] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:43.962614] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12973 primary records. [2025-10-07T22:40:43.962996] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-07T22:40:43.964545] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-07T22:40:43.977369] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-07T22:40:43.981166] [INFO ] [MAIN ] Derivative Progress: 1045/1748 symbols completed. LDI took 1.3s. Estimated remaining: 4m 31s. Rate: 155.7 symbols/min [2025-10-07T22:40:43.985747] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:43.985042] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-07T22:40:43.986302] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-07T22:40:43.989340] [INFO ] [MAIN ] Derivative Progress: 1046/1748 symbols completed. LDP took 1.2s. Estimated remaining: 4m 30s. Rate: 155.9 symbols/min [2025-10-07T22:40:43.989729] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:44.004272] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:44.005304] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45428 primary records. [2025-10-07T22:40:44.005498] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-07T22:40:44.022841] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-07T22:40:44.023125] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-07T22:40:44.025137] [INFO ] [MAIN ] Derivative Progress: 1047/1748 symbols completed. LDOS took 1.2s. Estimated remaining: 4m 30s. Rate: 156.0 symbols/min [2025-10-07T22:40:44.025339] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:44.090414] [DEBUG] [LOCAL ] LEA: Loaded 41646 existing records from primary storage. [2025-10-07T22:40:44.089886] [DEBUG] [LOCAL ] LEG: Loaded 50216 existing records from primary storage. [2025-10-07T22:40:44.090570] [INFO ] [MAIN ] LEG: Loaded 50216 primary data records. [2025-10-07T22:40:44.090670] [INFO ] [MAIN ] LEA: Loaded 41646 primary data records. [2025-10-07T22:40:44.736154] [DEBUG] [LOCAL ] LEN: Loaded 53171 existing records from primary storage. [2025-10-07T22:40:44.738117] [INFO ] [MAIN ] LEN: Loaded 53171 primary data records. [2025-10-07T22:40:45.089681] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:45.097028] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:45.096286] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50216 primary records. [2025-10-07T22:40:45.097781] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41646 primary records. [2025-10-07T22:40:45.098078] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-07T22:40:45.099080] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-07T22:40:45.129597] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-07T22:40:45.131312] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-07T22:40:45.136154] [INFO ] [MAIN ] Derivative Progress: 1048/1748 symbols completed. LEG took 1.1s. Estimated remaining: 4m 30s. Rate: 155.7 symbols/min [2025-10-07T22:40:45.139931] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-07T22:40:45.140192] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-07T22:40:45.142401] [INFO ] [MAIN ] Derivative Progress: 1049/1748 symbols completed. LEA took 1.2s. Estimated remaining: 4m 29s. Rate: 155.9 symbols/min [2025-10-07T22:40:45.159735] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:45.160334] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53171 primary records. [2025-10-07T22:40:45.160394] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-07T22:40:45.176429] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-07T22:40:45.176520] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-07T22:40:45.179357] [INFO ] [MAIN ] Derivative Progress: 1050/1748 symbols completed. LEN took 1.2s. Estimated remaining: 4m 28s. Rate: 156.0 symbols/min [2025-10-07T22:40:45.179956] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:45.179850] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:45.180154] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:45.203951] [DEBUG] [LOCAL ] LEO: Loaded 16872 existing records from primary storage. [2025-10-07T22:40:45.204092] [INFO ] [MAIN ] LEO: Loaded 16872 primary data records. [2025-10-07T22:40:45.260984] [DEBUG] [LOCAL ] LFT: Loaded 18415 existing records from primary storage. [2025-10-07T22:40:45.294172] [INFO ] [MAIN ] LFT: Loaded 18415 primary data records. [2025-10-07T22:40:45.727590] [DEBUG] [LOCAL ] LEVI: Loaded 51650 existing records from primary storage. [2025-10-07T22:40:45.778751] [INFO ] [MAIN ] LEVI: Loaded 51650 primary data records. [2025-10-07T22:40:46.252051] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:46.253303] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 16872 primary records. [2025-10-07T22:40:46.254494] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-07T22:40:46.276554] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:46.281571] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18415 primary records. [2025-10-07T22:40:46.281782] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-07T22:40:46.286802] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-10-07T22:40:46.287183] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-07T22:40:46.296144] [INFO ] [MAIN ] Derivative Progress: 1051/1748 symbols completed. LEO took 1.1s. Estimated remaining: 4m 29s. Rate: 155.7 symbols/min [2025-10-07T22:40:46.301136] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:46.325094] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:46.326676] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51650 primary records. [2025-10-07T22:40:46.326807] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-07T22:40:46.325872] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-07T22:40:46.326932] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-07T22:40:46.330092] [INFO ] [MAIN ] Derivative Progress: 1052/1748 symbols completed. LFT took 1.2s. Estimated remaining: 4m 28s. Rate: 155.9 symbols/min [2025-10-07T22:40:46.330320] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:46.344510] [DEBUG] [LOCAL ] LGI: Loaded 9857 existing records from primary storage. [2025-10-07T22:40:46.348351] [INFO ] [MAIN ] LGI: Loaded 9857 primary data records. [2025-10-07T22:40:46.518530] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-10-07T22:40:46.550282] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-07T22:40:46.552664] [INFO ] [MAIN ] Derivative Progress: 1053/1748 symbols completed. LEVI took 1.4s. Estimated remaining: 4m 27s. Rate: 155.9 symbols/min [2025-10-07T22:40:46.663349] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:46.687672] [DEBUG] [LOCAL ] LH: Loaded 37744 existing records from primary storage. [2025-10-07T22:40:46.688063] [INFO ] [MAIN ] LH: Loaded 37744 primary data records. [2025-10-07T22:40:47.041370] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:47.056691] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 9857 primary records. [2025-10-07T22:40:47.057245] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-07T22:40:47.059291] [DEBUG] [LOCAL ] LHX: Loaded 48596 existing records from primary storage. [2025-10-07T22:40:47.059624] [INFO ] [MAIN ] LHX: Loaded 48596 primary data records. [2025-10-07T22:40:47.203127] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-07T22:40:47.224066] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-07T22:40:47.226320] [INFO ] [MAIN ] Derivative Progress: 1054/1748 symbols completed. LGI took 0.9s. Estimated remaining: 4m 27s. Rate: 155.8 symbols/min [2025-10-07T22:40:47.251614] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:47.419821] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:47.420757] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37744 primary records. [2025-10-07T22:40:47.420975] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-07T22:40:47.440608] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-07T22:40:47.440868] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-07T22:40:47.443039] [INFO ] [MAIN ] Derivative Progress: 1055/1748 symbols completed. LH took 1.1s. Estimated remaining: 4m 27s. Rate: 155.9 symbols/min [2025-10-07T22:40:47.443358] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:47.470152] [DEBUG] [LOCAL ] LII: Loaded 28025 existing records from primary storage. [2025-10-07T22:40:47.470577] [INFO ] [MAIN ] LII: Loaded 28025 primary data records. [2025-10-07T22:40:47.609746] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:47.631884] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48596 primary records. [2025-10-07T22:40:47.637301] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-07T22:40:47.870066] [DEBUG] [LOCAL ] LION: Loaded 45160 existing records from primary storage. [2025-10-07T22:40:47.872280] [INFO ] [MAIN ] LION: Loaded 45160 primary data records. [2025-10-07T22:40:47.895527] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-07T22:40:47.911843] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-07T22:40:47.933184] [INFO ] [MAIN ] Derivative Progress: 1056/1748 symbols completed. LHX took 1.3s. Estimated remaining: 4m 26s. Rate: 155.8 symbols/min [2025-10-07T22:40:47.959509] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:48.068358] [DEBUG] [LOCAL ] LITB: Loaded 4268 existing records from primary storage. [2025-10-07T22:40:48.069085] [INFO ] [MAIN ] LITB: Loaded 4268 primary data records. [2025-10-07T22:40:48.363472] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:48.394382] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 28025 primary records. [2025-10-07T22:40:48.395016] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-07T22:40:48.531143] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-07T22:40:48.531853] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-07T22:40:48.534472] [INFO ] [MAIN ] Derivative Progress: 1057/1748 symbols completed. LII took 1.3s. Estimated remaining: 4m 26s. Rate: 155.8 symbols/min [2025-10-07T22:40:48.535444] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:48.554456] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:48.555467] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 45160 primary records. [2025-10-07T22:40:48.555788] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-07T22:40:48.572405] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-07T22:40:48.572893] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-07T22:40:48.575060] [INFO ] [MAIN ] Derivative Progress: 1058/1748 symbols completed. LION took 1.1s. Estimated remaining: 4m 26s. Rate: 155.9 symbols/min [2025-10-07T22:40:48.575450] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:48.593258] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:48.594004] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4268 primary records. [2025-10-07T22:40:48.594129] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-07T22:40:48.608788] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-10-07T22:40:48.608985] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-07T22:40:48.611019] [INFO ] [MAIN ] Derivative Progress: 1059/1748 symbols completed. LITB took 0.7s. Estimated remaining: 4m 25s. Rate: 156.0 symbols/min [2025-10-07T22:40:48.624591] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:48.647423] [DEBUG] [LOCAL ] LLY: Loaded 53301 existing records from primary storage. [2025-10-07T22:40:48.647725] [INFO ] [MAIN ] LLY: Loaded 53301 primary data records. [2025-10-07T22:40:48.848741] [DEBUG] [LOCAL ] LMND: Loaded 51976 existing records from primary storage. [2025-10-07T22:40:48.873529] [INFO ] [MAIN ] LMND: Loaded 51976 primary data records. [2025-10-07T22:40:49.101741] [DEBUG] [LOCAL ] LMT: Loaded 49815 existing records from primary storage. [2025-10-07T22:40:49.115628] [INFO ] [MAIN ] LMT: Loaded 49815 primary data records. [2025-10-07T22:40:49.688118] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:49.689468] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53301 primary records. [2025-10-07T22:40:49.689879] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-07T22:40:49.709619] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-07T22:40:49.709871] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-07T22:40:49.712253] [INFO ] [MAIN ] Derivative Progress: 1060/1748 symbols completed. LLY took 1.2s. Estimated remaining: 4m 25s. Rate: 155.8 symbols/min [2025-10-07T22:40:49.712594] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:49.726148] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:49.727048] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51976 primary records. [2025-10-07T22:40:49.727447] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-07T22:40:49.746377] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-07T22:40:49.746796] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-07T22:40:49.749189] [INFO ] [MAIN ] Derivative Progress: 1061/1748 symbols completed. LMND took 1.2s. Estimated remaining: 4m 24s. Rate: 155.9 symbols/min [2025-10-07T22:40:49.749470] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:49.763256] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:49.764139] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49815 primary records. [2025-10-07T22:40:49.764344] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-07T22:40:49.783513] [DEBUG] [LOCAL ] LND: Loaded 4946 existing records from primary storage. [2025-10-07T22:40:49.783925] [INFO ] [MAIN ] LND: Loaded 4946 primary data records. [2025-10-07T22:40:49.843343] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-10-07T22:40:49.877203] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-07T22:40:49.902676] [INFO ] [MAIN ] Derivative Progress: 1062/1748 symbols completed. LMT took 1.3s. Estimated remaining: 4m 24s. Rate: 156.0 symbols/min [2025-10-07T22:40:49.912303] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:50.121832] [DEBUG] [LOCAL ] LNC: Loaded 51640 existing records from primary storage. [2025-10-07T22:40:50.122167] [INFO ] [MAIN ] LNC: Loaded 51640 primary data records. [2025-10-07T22:40:50.493609] [DEBUG] [LOCAL ] LNG: Loaded 51300 existing records from primary storage. [2025-10-07T22:40:50.494211] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:50.495036] [INFO ] [MAIN ] LNG: Loaded 51300 primary data records. [2025-10-07T22:40:50.526885] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4946 primary records. [2025-10-07T22:40:50.532256] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-07T22:40:50.613639] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-10-07T22:40:50.614113] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-07T22:40:50.642507] [INFO ] [MAIN ] Derivative Progress: 1063/1748 symbols completed. LND took 0.9s. Estimated remaining: 4m 24s. Rate: 155.8 symbols/min [2025-10-07T22:40:50.837772] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:50.838750] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51640 primary records. [2025-10-07T22:40:50.838918] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-07T22:40:50.858949] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-07T22:40:50.859560] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-07T22:40:50.861764] [INFO ] [MAIN ] Derivative Progress: 1064/1748 symbols completed. LNC took 1.1s. Estimated remaining: 4m 23s. Rate: 155.9 symbols/min [2025-10-07T22:40:50.881998] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:50.882617] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51300 primary records. [2025-10-07T22:40:50.882702] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-07T22:40:50.898051] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-07T22:40:50.898117] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-07T22:40:50.900100] [INFO ] [MAIN ] Derivative Progress: 1065/1748 symbols completed. LNG took 1.0s. Estimated remaining: 4m 23s. Rate: 156.0 symbols/min [2025-10-07T22:40:50.900759] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:50.900893] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:50.901226] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:50.926784] [DEBUG] [LOCAL ] LNN: Loaded 11291 existing records from primary storage. [2025-10-07T22:40:50.926944] [INFO ] [MAIN ] LNN: Loaded 11291 primary data records. [2025-10-07T22:40:51.037606] [DEBUG] [LOCAL ] LOB: Loaded 27203 existing records from primary storage. [2025-10-07T22:40:51.059066] [INFO ] [MAIN ] LOB: Loaded 27203 primary data records. [2025-10-07T22:40:51.297321] [DEBUG] [LOCAL ] LOAR: Loaded 42065 existing records from primary storage. [2025-10-07T22:40:51.425191] [INFO ] [MAIN ] LOAR: Loaded 42065 primary data records. [2025-10-07T22:40:52.055017] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:52.069289] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11291 primary records. [2025-10-07T22:40:52.069603] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-07T22:40:52.068297] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:52.070295] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27203 primary records. [2025-10-07T22:40:52.071724] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-07T22:40:52.104831] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-07T22:40:52.106164] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-10-07T22:40:52.106273] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-07T22:40:52.108546] [INFO ] [MAIN ] Derivative Progress: 1066/1748 symbols completed. LOB took 1.2s. Estimated remaining: 4m 23s. Rate: 155.7 symbols/min [2025-10-07T22:40:52.109692] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-07T22:40:52.112155] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:52.112376] [INFO ] [MAIN ] Derivative Progress: 1067/1748 symbols completed. LNN took 1.2s. Estimated remaining: 4m 22s. Rate: 155.9 symbols/min [2025-10-07T22:40:52.113133] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:52.132464] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:52.133548] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 42065 primary records. [2025-10-07T22:40:52.133693] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-07T22:40:52.137062] [DEBUG] [LOCAL ] LOCL: Loaded 3633 existing records from primary storage. [2025-10-07T22:40:52.137413] [INFO ] [MAIN ] LOCL: Loaded 3633 primary data records. [2025-10-07T22:40:52.284883] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-07T22:40:52.318274] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-07T22:40:52.351780] [INFO ] [MAIN ] Derivative Progress: 1068/1748 symbols completed. LOAR took 1.5s. Estimated remaining: 4m 22s. Rate: 155.9 symbols/min [2025-10-07T22:40:52.469777] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:52.483019] [DEBUG] [LOCAL ] LOMA: Loaded 32169 existing records from primary storage. [2025-10-07T22:40:52.483333] [INFO ] [MAIN ] LOMA: Loaded 32169 primary data records. [2025-10-07T22:40:52.867234] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:52.868774] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3633 primary records. [2025-10-07T22:40:52.882588] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-07T22:40:52.896545] [DEBUG] [LOCAL ] LOW: Loaded 52967 existing records from primary storage. [2025-10-07T22:40:52.898780] [INFO ] [MAIN ] LOW: Loaded 52967 primary data records. [2025-10-07T22:40:52.965392] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-10-07T22:40:52.982713] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-07T22:40:52.996377] [INFO ] [MAIN ] Derivative Progress: 1069/1748 symbols completed. LOCL took 0.9s. Estimated remaining: 4m 21s. Rate: 155.8 symbols/min [2025-10-07T22:40:53.007635] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:53.217033] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:53.228008] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32169 primary records. [2025-10-07T22:40:53.228292] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-07T22:40:53.256669] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-07T22:40:53.257344] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-07T22:40:53.259940] [INFO ] [MAIN ] Derivative Progress: 1070/1748 symbols completed. LOMA took 1.1s. Estimated remaining: 4m 21s. Rate: 155.9 symbols/min [2025-10-07T22:40:53.260162] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:53.275323] [DEBUG] [LOCAL ] LPG: Loaded 39729 existing records from primary storage. [2025-10-07T22:40:53.275550] [INFO ] [MAIN ] LPG: Loaded 39729 primary data records. [2025-10-07T22:40:53.643497] [DEBUG] [LOCAL ] LPL: Loaded 27148 existing records from primary storage. [2025-10-07T22:40:53.644446] [INFO ] [MAIN ] LPL: Loaded 27148 primary data records. [2025-10-07T22:40:53.694974] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:53.713238] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52967 primary records. [2025-10-07T22:40:53.718825] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-07T22:40:53.829346] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-07T22:40:53.840705] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-07T22:40:53.854602] [INFO ] [MAIN ] Derivative Progress: 1071/1748 symbols completed. LOW took 1.4s. Estimated remaining: 4m 21s. Rate: 155.8 symbols/min [2025-10-07T22:40:54.028239] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:54.062126] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:54.063678] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39729 primary records. [2025-10-07T22:40:54.063811] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-07T22:40:54.082359] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-07T22:40:54.082892] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-07T22:40:54.085167] [INFO ] [MAIN ] Derivative Progress: 1072/1748 symbols completed. LPG took 1.1s. Estimated remaining: 4m 20s. Rate: 155.9 symbols/min [2025-10-07T22:40:54.085507] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:54.116914] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:54.130399] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 27148 primary records. [2025-10-07T22:40:54.130586] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-07T22:40:54.132724] [DEBUG] [LOCAL ] LPX: Loaded 39780 existing records from primary storage. [2025-10-07T22:40:54.144158] [INFO ] [MAIN ] LPX: Loaded 39780 primary data records. [2025-10-07T22:40:54.168048] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-10-07T22:40:54.198522] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-07T22:40:54.207329] [INFO ] [MAIN ] Derivative Progress: 1073/1748 symbols completed. LPL took 0.9s. Estimated remaining: 4m 20s. Rate: 156.0 symbols/min [2025-10-07T22:40:54.247403] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:54.291293] [DEBUG] [LOCAL ] LRN: Loaded 39718 existing records from primary storage. [2025-10-07T22:40:54.291824] [INFO ] [MAIN ] LRN: Loaded 39718 primary data records. [2025-10-07T22:40:54.804209] [DEBUG] [LOCAL ] LSPD: Loaded 42822 existing records from primary storage. [2025-10-07T22:40:54.805034] [INFO ] [MAIN ] LSPD: Loaded 42822 primary data records. [2025-10-07T22:40:55.146271] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:55.152933] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39780 primary records. [2025-10-07T22:40:55.153294] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:55.153535] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-07T22:40:55.155132] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39718 primary records. [2025-10-07T22:40:55.155510] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-07T22:40:55.190219] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-07T22:40:55.190727] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-07T22:40:55.193375] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-07T22:40:55.193939] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-07T22:40:55.193269] [INFO ] [MAIN ] Derivative Progress: 1074/1748 symbols completed. LPX took 1.2s. Estimated remaining: 4m 20s. Rate: 155.7 symbols/min [2025-10-07T22:40:55.196466] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:55.197163] [INFO ] [MAIN ] Derivative Progress: 1075/1748 symbols completed. LRN took 1.1s. Estimated remaining: 4m 19s. Rate: 155.9 symbols/min [2025-10-07T22:40:55.197264] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:55.217011] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:55.217946] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42822 primary records. [2025-10-07T22:40:55.218088] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-07T22:40:55.237802] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-07T22:40:55.238025] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-07T22:40:55.240319] [INFO ] [MAIN ] Derivative Progress: 1076/1748 symbols completed. LSPD took 1.0s. Estimated remaining: 4m 18s. Rate: 156.0 symbols/min [2025-10-07T22:40:55.240553] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:55.277939] [DEBUG] [LOCAL ] LTC: Loaded 30225 existing records from primary storage. [2025-10-07T22:40:55.291962] [INFO ] [MAIN ] LTC: Loaded 30225 primary data records. [2025-10-07T22:40:55.312980] [DEBUG] [LOCAL ] LTH: Loaded 51727 existing records from primary storage. [2025-10-07T22:40:55.335855] [INFO ] [MAIN ] LTH: Loaded 51727 primary data records. [2025-10-07T22:40:55.521890] [DEBUG] [LOCAL ] LTM: Loaded 37710 existing records from primary storage. [2025-10-07T22:40:55.558703] [INFO ] [MAIN ] LTM: Loaded 37710 primary data records. [2025-10-07T22:40:56.307438] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:56.308375] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30225 primary records. [2025-10-07T22:40:56.321469] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-07T22:40:56.321856] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:56.323329] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51727 primary records. [2025-10-07T22:40:56.323829] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-07T22:40:56.368618] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:56.370811] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 37710 primary records. [2025-10-07T22:40:56.371611] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-07T22:40:56.373452] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-07T22:40:56.374077] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-07T22:40:56.376259] [INFO ] [MAIN ] Derivative Progress: 1077/1748 symbols completed. LTC took 1.2s. Estimated remaining: 4m 19s. Rate: 155.7 symbols/min [2025-10-07T22:40:56.377176] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:56.385639] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-07T22:40:56.385818] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-07T22:40:56.391547] [INFO ] [MAIN ] Derivative Progress: 1078/1748 symbols completed. LTH took 1.2s. Estimated remaining: 4m 18s. Rate: 155.9 symbols/min [2025-10-07T22:40:56.397452] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-07T22:40:56.397551] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-07T22:40:56.399817] [INFO ] [MAIN ] Derivative Progress: 1079/1748 symbols completed. LTM took 1.2s. Estimated remaining: 4m 17s. Rate: 156.0 symbols/min [2025-10-07T22:40:56.439077] [DEBUG] [LOCAL ] LU: Loaded 48938 existing records from primary storage. [2025-10-07T22:40:56.439238] [INFO ] [MAIN ] LU: Loaded 48938 primary data records. [2025-10-07T22:40:56.750072] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:56.751108] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48938 primary records. [2025-10-07T22:40:56.751172] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-07T22:40:56.767627] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-07T22:40:56.767782] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-07T22:40:56.769881] [INFO ] [MAIN ] Derivative Progress: 1080/1748 symbols completed. LU took 0.4s. Estimated remaining: 4m 17s. Rate: 156.0 symbols/min [2025-10-07T22:40:56.770829] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:56.770713] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:56.771394] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:56.801778] [DEBUG] [LOCAL ] LUCK: Loaded 24436 existing records from primary storage. [2025-10-07T22:40:56.801956] [INFO ] [MAIN ] LUCK: Loaded 24436 primary data records. [2025-10-07T22:40:57.055851] [DEBUG] [LOCAL ] LUMN: Loaded 53642 existing records from primary storage. [2025-10-07T22:40:57.172633] [INFO ] [MAIN ] LUMN: Loaded 53642 primary data records. [2025-10-07T22:40:57.172124] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-07T22:40:57.172891] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-07T22:40:57.840973] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:57.842131] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 24436 primary records. [2025-10-07T22:40:57.842684] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-07T22:40:57.861467] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-07T22:40:57.875565] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-07T22:40:57.875487] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:57.878704] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53642 primary records. [2025-10-07T22:40:57.877911] [INFO ] [MAIN ] Derivative Progress: 1081/1748 symbols completed. LUCK took 1.1s. Estimated remaining: 4m 17s. Rate: 155.7 symbols/min [2025-10-07T22:40:57.879121] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:57.880251] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-07T22:40:57.911982] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-07T22:40:57.912424] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-07T22:40:57.914614] [INFO ] [MAIN ] Derivative Progress: 1082/1748 symbols completed. LUMN took 1.1s. Estimated remaining: 4m 16s. Rate: 155.9 symbols/min [2025-10-07T22:40:57.912297] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:57.914799] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:57.916179] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-07T22:40:57.916297] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-07T22:40:57.941779] [DEBUG] [LOCAL ] LVWR: Loaded 18123 existing records from primary storage. [2025-10-07T22:40:57.942306] [INFO ] [MAIN ] LVWR: Loaded 18123 primary data records. [2025-10-07T22:40:57.987341] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-07T22:40:57.987521] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-07T22:40:58.001443] [INFO ] [MAIN ] Derivative Progress: 1083/1748 symbols completed. LUV took 1.2s. Estimated remaining: 4m 16s. Rate: 156.0 symbols/min [2025-10-07T22:40:58.026738] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:58.278302] [DEBUG] [LOCAL ] LW: Loaded 51208 existing records from primary storage. [2025-10-07T22:40:58.278574] [INFO ] [MAIN ] LW: Loaded 51208 primary data records. [2025-10-07T22:40:58.321243] [DEBUG] [LOCAL ] LXFR: Loaded 16763 existing records from primary storage. [2025-10-07T22:40:58.328588] [INFO ] [MAIN ] LXFR: Loaded 16763 primary data records. [2025-10-07T22:40:58.928800] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:58.930386] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 18123 primary records. [2025-10-07T22:40:58.930935] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-07T22:40:58.954060] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-07T22:40:58.954806] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-07T22:40:58.957106] [INFO ] [MAIN ] Derivative Progress: 1084/1748 symbols completed. LVWR took 1.1s. Estimated remaining: 4m 16s. Rate: 155.8 symbols/min [2025-10-07T22:40:58.957608] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:58.978906] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:58.982781] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51208 primary records. [2025-10-07T22:40:58.982926] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-07T22:40:59.018064] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-07T22:40:59.018446] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:40:59.018719] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-07T22:40:59.019523] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16763 primary records. [2025-10-07T22:40:59.019717] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-07T22:40:59.022468] [INFO ] [MAIN ] Derivative Progress: 1085/1748 symbols completed. LW took 1.1s. Estimated remaining: 4m 15s. Rate: 155.9 symbols/min [2025-10-07T22:40:59.051114] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:59.053770] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-07T22:40:59.053935] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-07T22:40:59.056183] [INFO ] [MAIN ] Derivative Progress: 1086/1748 symbols completed. LXFR took 1.0s. Estimated remaining: 4m 15s. Rate: 156.0 symbols/min [2025-10-07T22:40:59.056522] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:40:59.072788] [DEBUG] [LOCAL ] LXP: Loaded 50755 existing records from primary storage. [2025-10-07T22:40:59.073035] [INFO ] [MAIN ] LXP: Loaded 50755 primary data records. [2025-10-07T22:40:59.222567] [DEBUG] [LOCAL ] LXU: Loaded 31840 existing records from primary storage. [2025-10-07T22:40:59.243495] [INFO ] [MAIN ] LXU: Loaded 31840 primary data records. [2025-10-07T22:40:59.534675] [DEBUG] [LOCAL ] LYB: Loaded 53611 existing records from primary storage. [2025-10-07T22:40:59.551383] [INFO ] [MAIN ] LYB: Loaded 53611 primary data records. [2025-10-07T22:41:00.099728] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:00.101404] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50755 primary records. [2025-10-07T22:41:00.101717] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-07T22:41:00.126105] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-07T22:41:00.128074] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-07T22:41:00.130788] [INFO ] [MAIN ] Derivative Progress: 1087/1748 symbols completed. LXP took 1.2s. Estimated remaining: 4m 15s. Rate: 155.8 symbols/min [2025-10-07T22:41:00.144426] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:00.145664] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:00.146561] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31840 primary records. [2025-10-07T22:41:00.146676] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-07T22:41:00.179665] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:00.181407] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53611 primary records. [2025-10-07T22:41:00.181801] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-07T22:41:00.184024] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-07T22:41:00.184121] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-07T22:41:00.186259] [INFO ] [MAIN ] Derivative Progress: 1088/1748 symbols completed. LXU took 1.1s. Estimated remaining: 4m 14s. Rate: 155.9 symbols/min [2025-10-07T22:41:00.194213] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:00.203263] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-07T22:41:00.204021] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-07T22:41:00.207378] [INFO ] [MAIN ] Derivative Progress: 1089/1748 symbols completed. LYB took 1.2s. Estimated remaining: 4m 13s. Rate: 156.0 symbols/min [2025-10-07T22:41:00.207810] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:00.253635] [DEBUG] [LOCAL ] LYG: Loaded 52778 existing records from primary storage. [2025-10-07T22:41:00.253819] [INFO ] [MAIN ] LYG: Loaded 52778 primary data records. [2025-10-07T22:41:00.389341] [DEBUG] [LOCAL ] LZB: Loaded 35179 existing records from primary storage. [2025-10-07T22:41:00.389930] [INFO ] [MAIN ] LZB: Loaded 35179 primary data records. [2025-10-07T22:41:00.707469] [DEBUG] [LOCAL ] LYV: Loaded 51110 existing records from primary storage. [2025-10-07T22:41:00.713943] [INFO ] [MAIN ] LYV: Loaded 51110 primary data records. [2025-10-07T22:41:01.242062] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:01.244263] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52778 primary records. [2025-10-07T22:41:01.245131] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-07T22:41:01.272095] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:01.273556] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35179 primary records. [2025-10-07T22:41:01.273994] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-07T22:41:01.292555] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-07T22:41:01.294615] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-07T22:41:01.294378] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-07T22:41:01.297303] [INFO ] [MAIN ] Derivative Progress: 1090/1748 symbols completed. LYG took 1.2s. Estimated remaining: 4m 13s. Rate: 155.7 symbols/min [2025-10-07T22:41:01.297592] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:01.297693] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-07T22:41:01.300887] [INFO ] [MAIN ] Derivative Progress: 1091/1748 symbols completed. LZB took 1.1s. Estimated remaining: 4m 13s. Rate: 155.9 symbols/min [2025-10-07T22:41:01.302095] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:01.319688] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:01.320631] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51110 primary records. [2025-10-07T22:41:01.320877] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-07T22:41:01.346425] [DEBUG] [LOCAL ] LZM: Loaded 14267 existing records from primary storage. [2025-10-07T22:41:01.346732] [INFO ] [MAIN ] LZM: Loaded 14267 primary data records. [2025-10-07T22:41:01.370556] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-07T22:41:01.392580] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-07T22:41:01.406763] [INFO ] [MAIN ] Derivative Progress: 1092/1748 symbols completed. LYV took 1.2s. Estimated remaining: 4m 12s. Rate: 156.0 symbols/min [2025-10-07T22:41:01.426918] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:01.686528] [DEBUG] [LOCAL ] M: Loaded 53539 existing records from primary storage. [2025-10-07T22:41:01.687092] [INFO ] [MAIN ] M: Loaded 53539 primary data records. [2025-10-07T22:41:02.079210] [DEBUG] [LOCAL ] MA: Loaded 52508 existing records from primary storage. [2025-10-07T22:41:02.080456] [INFO ] [MAIN ] MA: Loaded 52508 primary data records. [2025-10-07T22:41:02.422485] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:02.423743] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 14267 primary records. [2025-10-07T22:41:02.424039] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-07T22:41:02.460135] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:02.462743] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-07T22:41:02.463672] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-07T22:41:02.462211] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53539 primary records. [2025-10-07T22:41:02.464115] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-07T22:41:02.467900] [INFO ] [MAIN ] Derivative Progress: 1093/1748 symbols completed. LZM took 1.2s. Estimated remaining: 4m 12s. Rate: 155.7 symbols/min [2025-10-07T22:41:02.485006] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-07T22:41:02.485150] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-07T22:41:02.487689] [INFO ] [MAIN ] Derivative Progress: 1094/1748 symbols completed. M took 1.2s. Estimated remaining: 4m 12s. Rate: 155.9 symbols/min [2025-10-07T22:41:02.511966] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:02.512920] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52508 primary records. [2025-10-07T22:41:02.513049] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-07T22:41:02.533136] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-07T22:41:02.533285] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-07T22:41:02.535805] [INFO ] [MAIN ] Derivative Progress: 1095/1748 symbols completed. MA took 1.1s. Estimated remaining: 4m 11s. Rate: 156.0 symbols/min [2025-10-07T22:41:02.536314] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:02.536611] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:02.536405] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:02.593931] [DEBUG] [LOCAL ] MAGN: Loaded 35542 existing records from primary storage. [2025-10-07T22:41:02.594150] [INFO ] [MAIN ] MAGN: Loaded 35542 primary data records. [2025-10-07T22:41:02.728732] [DEBUG] [LOCAL ] MAA: Loaded 42654 existing records from primary storage. [2025-10-07T22:41:02.740504] [DEBUG] [LOCAL ] MAIN: Loaded 41241 existing records from primary storage. [2025-10-07T22:41:02.756349] [INFO ] [MAIN ] MAIN: Loaded 41241 primary data records. [2025-10-07T22:41:02.756241] [INFO ] [MAIN ] MAA: Loaded 42654 primary data records. [2025-10-07T22:41:03.609815] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:03.612752] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 35542 primary records. [2025-10-07T22:41:03.613016] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-07T22:41:03.631815] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-07T22:41:03.632463] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-07T22:41:03.634458] [INFO ] [MAIN ] Derivative Progress: 1096/1748 symbols completed. MAGN took 1.1s. Estimated remaining: 4m 11s. Rate: 155.7 symbols/min [2025-10-07T22:41:03.635184] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:03.655214] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:03.656967] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41241 primary records. [2025-10-07T22:41:03.657193] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-07T22:41:03.679036] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:03.686618] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42654 primary records. [2025-10-07T22:41:03.688275] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-07T22:41:03.688157] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-07T22:41:03.689294] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-07T22:41:03.691613] [INFO ] [MAIN ] Derivative Progress: 1097/1748 symbols completed. MAIN took 1.2s. Estimated remaining: 4m 11s. Rate: 155.9 symbols/min [2025-10-07T22:41:03.692164] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:03.710173] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-07T22:41:03.719968] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-07T22:41:03.722011] [INFO ] [MAIN ] Derivative Progress: 1098/1748 symbols completed. MAA took 1.2s. Estimated remaining: 4m 10s. Rate: 156.0 symbols/min [2025-10-07T22:41:03.722222] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:03.746277] [DEBUG] [LOCAL ] MAN: Loaded 43640 existing records from primary storage. [2025-10-07T22:41:03.746605] [INFO ] [MAIN ] MAN: Loaded 43640 primary data records. [2025-10-07T22:41:03.810168] [DEBUG] [LOCAL ] MANU: Loaded 26728 existing records from primary storage. [2025-10-07T22:41:03.824971] [INFO ] [MAIN ] MANU: Loaded 26728 primary data records. [2025-10-07T22:41:04.281700] [DEBUG] [LOCAL ] MAS: Loaded 52291 existing records from primary storage. [2025-10-07T22:41:04.323852] [INFO ] [MAIN ] MAS: Loaded 52291 primary data records. [2025-10-07T22:41:04.775697] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:04.776837] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43640 primary records. [2025-10-07T22:41:04.777090] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-07T22:41:04.803926] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:04.808272] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 26728 primary records. [2025-10-07T22:41:04.809062] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-07T22:41:04.809206] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-07T22:41:04.808970] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-07T22:41:04.811448] [INFO ] [MAIN ] Derivative Progress: 1099/1748 symbols completed. MAN took 1.2s. Estimated remaining: 4m 10s. Rate: 155.7 symbols/min [2025-10-07T22:41:04.812482] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:04.830850] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-07T22:41:04.831077] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-07T22:41:04.834330] [INFO ] [MAIN ] Derivative Progress: 1100/1748 symbols completed. MANU took 1.1s. Estimated remaining: 4m 9s. Rate: 155.9 symbols/min [2025-10-07T22:41:04.834738] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:04.849635] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:04.850398] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52291 primary records. [2025-10-07T22:41:04.850517] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-07T22:41:04.867079] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-07T22:41:04.867622] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-07T22:41:04.869873] [INFO ] [MAIN ] Derivative Progress: 1101/1748 symbols completed. MAS took 1.1s. Estimated remaining: 4m 9s. Rate: 156.0 symbols/min [2025-10-07T22:41:04.870132] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:04.904552] [DEBUG] [LOCAL ] MATV: Loaded 36117 existing records from primary storage. [2025-10-07T22:41:04.904721] [INFO ] [MAIN ] MATV: Loaded 36117 primary data records. [2025-10-07T22:41:05.002208] [DEBUG] [LOCAL ] MATX: Loaded 31417 existing records from primary storage. [2025-10-07T22:41:05.022433] [INFO ] [MAIN ] MATX: Loaded 31417 primary data records. [2025-10-07T22:41:05.052936] [DEBUG] [LOCAL ] MAX: Loaded 30870 existing records from primary storage. [2025-10-07T22:41:05.067959] [INFO ] [MAIN ] MAX: Loaded 30870 primary data records. [2025-10-07T22:41:05.933831] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:05.934152] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:05.906373] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:05.935537] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 36117 primary records. [2025-10-07T22:41:05.934952] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30870 primary records. [2025-10-07T22:41:05.936211] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31417 primary records. [2025-10-07T22:41:05.936317] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-07T22:41:05.937157] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-07T22:41:05.936750] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-07T22:41:05.971159] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-10-07T22:41:05.973351] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-07T22:41:05.976278] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-10-07T22:41:05.980815] [INFO ] [MAIN ] Derivative Progress: 1102/1748 symbols completed. MATV took 1.2s. Estimated remaining: 4m 9s. Rate: 155.7 symbols/min [2025-10-07T22:41:05.981190] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:05.981780] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-07T22:41:05.984308] [INFO ] [MAIN ] Derivative Progress: 1103/1748 symbols completed. MATX took 1.1s. Estimated remaining: 4m 8s. Rate: 155.9 symbols/min [2025-10-07T22:41:05.984697] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:05.989171] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-07T22:41:05.989292] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-07T22:41:05.991677] [INFO ] [MAIN ] Derivative Progress: 1104/1748 symbols completed. MAX took 1.1s. Estimated remaining: 4m 8s. Rate: 156.0 symbols/min [2025-10-07T22:41:05.991913] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:06.013116] [DEBUG] [LOCAL ] MBI: Loaded 24208 existing records from primary storage. [2025-10-07T22:41:06.013264] [INFO ] [MAIN ] MBI: Loaded 24208 primary data records. [2025-10-07T22:41:06.349459] [DEBUG] [LOCAL ] MBC: Loaded 43468 existing records from primary storage. [2025-10-07T22:41:06.349707] [INFO ] [MAIN ] MBC: Loaded 43468 primary data records. [2025-10-07T22:41:06.350390] [DEBUG] [LOCAL ] MC: Loaded 43973 existing records from primary storage. [2025-10-07T22:41:06.371381] [INFO ] [MAIN ] MC: Loaded 43973 primary data records. [2025-10-07T22:41:06.959711] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:06.960834] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24208 primary records. [2025-10-07T22:41:06.961034] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-07T22:41:06.977803] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-07T22:41:06.978428] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-07T22:41:06.980827] [INFO ] [MAIN ] Derivative Progress: 1105/1748 symbols completed. MBI took 1.0s. Estimated remaining: 4m 8s. Rate: 155.8 symbols/min [2025-10-07T22:41:06.981097] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:07.010507] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:07.016259] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 43973 primary records. [2025-10-07T22:41:07.016767] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:07.016863] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-07T22:41:07.017674] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43468 primary records. [2025-10-07T22:41:07.018627] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-07T22:41:07.050829] [DEBUG] [LOCAL ] MCB: Loaded 11266 existing records from primary storage. [2025-10-07T22:41:07.051472] [INFO ] [MAIN ] MCB: Loaded 11266 primary data records. [2025-10-07T22:41:07.154517] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-07T22:41:07.158537] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-10-07T22:41:07.163883] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-07T22:41:07.164008] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-07T22:41:07.171279] [INFO ] [MAIN ] Derivative Progress: 1106/1748 symbols completed. MBC took 1.2s. Estimated remaining: 4m 7s. Rate: 155.9 symbols/min [2025-10-07T22:41:07.183872] [INFO ] [MAIN ] Derivative Progress: 1107/1748 symbols completed. MC took 1.2s. Estimated remaining: 4m 7s. Rate: 156.0 symbols/min [2025-10-07T22:41:07.178684] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:07.203356] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:07.361029] [DEBUG] [LOCAL ] MCI: Loaded 6479 existing records from primary storage. [2025-10-07T22:41:07.361699] [INFO ] [MAIN ] MCI: Loaded 6479 primary data records. [2025-10-07T22:41:07.683669] [DEBUG] [LOCAL ] MCK: Loaded 38963 existing records from primary storage. [2025-10-07T22:41:07.684152] [INFO ] [MAIN ] MCK: Loaded 38963 primary data records. [2025-10-07T22:41:07.830082] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:07.883270] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11266 primary records. [2025-10-07T22:41:08.038842] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-07T22:41:08.083352] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:08.084912] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6479 primary records. [2025-10-07T22:41:08.085009] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-07T22:41:08.085364] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-07T22:41:08.087077] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-07T22:41:08.089852] [INFO ] [MAIN ] Derivative Progress: 1108/1748 symbols completed. MCB took 1.1s. Estimated remaining: 4m 6s. Rate: 155.8 symbols/min [2025-10-07T22:41:08.105936] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-07T22:41:08.106113] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-07T22:41:08.108622] [INFO ] [MAIN ] Derivative Progress: 1109/1748 symbols completed. MCI took 0.9s. Estimated remaining: 4m 6s. Rate: 155.9 symbols/min [2025-10-07T22:41:08.123882] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:08.124516] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 38963 primary records. [2025-10-07T22:41:08.124594] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-07T22:41:08.140175] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-07T22:41:08.140233] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-07T22:41:08.142335] [INFO ] [MAIN ] Derivative Progress: 1110/1748 symbols completed. MCK took 0.9s. Estimated remaining: 4m 5s. Rate: 156.1 symbols/min [2025-10-07T22:41:08.142965] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:08.143149] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:08.143048] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:08.158487] [DEBUG] [LOCAL ] MCN: Loaded 8124 existing records from primary storage. [2025-10-07T22:41:08.162451] [DEBUG] [LOCAL ] MCR: Loaded 8883 existing records from primary storage. [2025-10-07T22:41:08.162787] [INFO ] [MAIN ] MCN: Loaded 8124 primary data records. [2025-10-07T22:41:08.183258] [INFO ] [MAIN ] MCR: Loaded 8883 primary data records. [2025-10-07T22:41:08.614400] [DEBUG] [LOCAL ] MCO: Loaded 39193 existing records from primary storage. [2025-10-07T22:41:08.628045] [INFO ] [MAIN ] MCO: Loaded 39193 primary data records. [2025-10-07T22:41:09.100318] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:09.103153] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8124 primary records. [2025-10-07T22:41:09.104017] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-07T22:41:09.133335] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-10-07T22:41:09.133684] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:09.133897] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-07T22:41:09.137007] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8883 primary records. [2025-10-07T22:41:09.137116] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-07T22:41:09.135980] [INFO ] [MAIN ] Derivative Progress: 1111/1748 symbols completed. MCN took 1.0s. Estimated remaining: 4m 5s. Rate: 155.8 symbols/min [2025-10-07T22:41:09.137283] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:09.169792] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-07T22:41:09.170270] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-07T22:41:09.172697] [INFO ] [MAIN ] Derivative Progress: 1112/1748 symbols completed. MCR took 1.0s. Estimated remaining: 4m 5s. Rate: 156.0 symbols/min [2025-10-07T22:41:09.170206] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:09.173721] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39193 primary records. [2025-10-07T22:41:09.173857] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:09.174021] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-07T22:41:09.204051] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-07T22:41:09.204235] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-07T22:41:09.207125] [INFO ] [MAIN ] Derivative Progress: 1113/1748 symbols completed. MCO took 1.1s. Estimated remaining: 4m 4s. Rate: 156.1 symbols/min [2025-10-07T22:41:09.204697] [DEBUG] [LOCAL ] MCS: Loaded 20960 existing records from primary storage. [2025-10-07T22:41:09.207589] [INFO ] [MAIN ] MCS: Loaded 20960 primary data records. [2025-10-07T22:41:09.207485] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:09.334358] [DEBUG] [LOCAL ] MCY: Loaded 24059 existing records from primary storage. [2025-10-07T22:41:09.350149] [INFO ] [MAIN ] MCY: Loaded 24059 primary data records. [2025-10-07T22:41:09.659429] [DEBUG] [LOCAL ] MD: Loaded 38498 existing records from primary storage. [2025-10-07T22:41:09.666381] [INFO ] [MAIN ] MD: Loaded 38498 primary data records. [2025-10-07T22:41:10.200249] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:10.201853] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 20960 primary records. [2025-10-07T22:41:10.202127] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-07T22:41:10.237926] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-07T22:41:10.238876] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:10.239670] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 24059 primary records. [2025-10-07T22:41:10.238953] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-07T22:41:10.241947] [INFO ] [MAIN ] Derivative Progress: 1114/1748 symbols completed. MCS took 1.1s. Estimated remaining: 4m 4s. Rate: 155.9 symbols/min [2025-10-07T22:41:10.242267] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-07T22:41:10.242202] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:10.275896] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:10.279975] [DEBUG] [LOCAL ] MDST: Loaded 5713 existing records from primary storage. [2025-10-07T22:41:10.279793] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38498 primary records. [2025-10-07T22:41:10.281349] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-10-07T22:41:10.280978] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-07T22:41:10.280079] [INFO ] [MAIN ] MDST: Loaded 5713 primary data records. [2025-10-07T22:41:10.281486] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-07T22:41:10.284281] [INFO ] [MAIN ] Derivative Progress: 1115/1748 symbols completed. MCY took 1.1s. Estimated remaining: 4m 3s. Rate: 156.0 symbols/min [2025-10-07T22:41:10.304916] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:10.416983] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-07T22:41:10.445949] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-07T22:41:10.465959] [INFO ] [MAIN ] Derivative Progress: 1116/1748 symbols completed. MD took 1.3s. Estimated remaining: 4m 3s. Rate: 156.1 symbols/min [2025-10-07T22:41:10.466774] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:10.642029] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-07T22:41:10.642490] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-07T22:41:10.967053] [DEBUG] [LOCAL ] MDU: Loaded 48006 existing records from primary storage. [2025-10-07T22:41:10.967974] [INFO ] [MAIN ] MDU: Loaded 48006 primary data records. [2025-10-07T22:41:11.036030] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:41:11.079500] [INFO ] [MAIN ] MDST: Generated 1793 derivative records from 5713 primary records. [2025-10-07T22:41:11.082597] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-07T22:41:11.290419] [DEBUG] [LOCAL ] MDST: Derivative data saved (1793 records). [2025-10-07T22:41:11.290677] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-07T22:41:11.293101] [INFO ] [MAIN ] Derivative Progress: 1117/1748 symbols completed. MDST took 1.1s. Estimated remaining: 4m 3s. Rate: 155.9 symbols/min [2025-10-07T22:41:11.293983] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:11.314256] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:11.315043] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-07T22:41:11.317468] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-07T22:41:11.336057] [DEBUG] [LOCAL ] MDV: Loaded 8514 existing records from primary storage. [2025-10-07T22:41:11.337233] [INFO ] [MAIN ] MDV: Loaded 8514 primary data records. [2025-10-07T22:41:11.428633] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-07T22:41:11.464523] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-07T22:41:11.501107] [INFO ] [MAIN ] Derivative Progress: 1118/1748 symbols completed. MDT took 1.2s. Estimated remaining: 4m 2s. Rate: 156.0 symbols/min [2025-10-07T22:41:11.518343] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:11.519093] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:11.542472] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 48006 primary records. [2025-10-07T22:41:11.542729] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-07T22:41:11.738257] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-07T22:41:11.737359] [DEBUG] [LOCAL ] MEC: Loaded 16219 existing records from primary storage. [2025-10-07T22:41:11.738707] [INFO ] [MAIN ] MEC: Loaded 16219 primary data records. [2025-10-07T22:41:11.738388] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-07T22:41:11.741435] [INFO ] [MAIN ] Derivative Progress: 1119/1748 symbols completed. MDU took 1.3s. Estimated remaining: 4m 2s. Rate: 156.0 symbols/min [2025-10-07T22:41:11.741956] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:12.078095] [DEBUG] [LOCAL ] MED: Loaded 21400 existing records from primary storage. [2025-10-07T22:41:12.079040] [INFO ] [MAIN ] MED: Loaded 21400 primary data records. [2025-10-07T22:41:12.225998] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:12.240986] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8514 primary records. [2025-10-07T22:41:12.260017] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-07T22:41:12.419733] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-07T22:41:12.420413] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-07T22:41:12.422975] [INFO ] [MAIN ] Derivative Progress: 1120/1748 symbols completed. MDV took 1.1s. Estimated remaining: 4m 2s. Rate: 155.9 symbols/min [2025-10-07T22:41:12.436266] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:12.436818] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:12.438214] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16219 primary records. [2025-10-07T22:41:12.438414] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-07T22:41:12.458268] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-07T22:41:12.458521] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-07T22:41:12.461078] [INFO ] [MAIN ] Derivative Progress: 1121/1748 symbols completed. MEC took 0.9s. Estimated remaining: 4m 1s. Rate: 156.0 symbols/min [2025-10-07T22:41:12.461395] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:12.479523] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:12.489032] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21400 primary records. [2025-10-07T22:41:12.489157] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-07T22:41:12.519758] [DEBUG] [LOCAL ] MEG: Loaded 31522 existing records from primary storage. [2025-10-07T22:41:12.520376] [INFO ] [MAIN ] MEG: Loaded 31522 primary data records. [2025-10-07T22:41:12.520739] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-07T22:41:12.544782] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-07T22:41:12.554118] [INFO ] [MAIN ] Derivative Progress: 1122/1748 symbols completed. MED took 0.8s. Estimated remaining: 4m 1s. Rate: 156.1 symbols/min [2025-10-07T22:41:12.564907] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:12.551871] [DEBUG] [LOCAL ] MEGI: Loaded 19956 existing records from primary storage. [2025-10-07T22:41:12.570231] [INFO ] [MAIN ] MEGI: Loaded 19956 primary data records. [2025-10-07T22:41:13.023816] [DEBUG] [LOCAL ] MEI: Loaded 31840 existing records from primary storage. [2025-10-07T22:41:13.144303] [INFO ] [MAIN ] MEI: Loaded 31840 primary data records. [2025-10-07T22:41:13.485487] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:13.485795] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:13.486860] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 19956 primary records. [2025-10-07T22:41:13.487033] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-07T22:41:13.487875] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31522 primary records. [2025-10-07T22:41:13.488407] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-07T22:41:13.520101] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-07T22:41:13.522004] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-07T22:41:13.524343] [INFO ] [MAIN ] Derivative Progress: 1123/1748 symbols completed. MEG took 1.1s. Estimated remaining: 4m 1s. Rate: 155.9 symbols/min [2025-10-07T22:41:13.525845] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-07T22:41:13.526024] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-07T22:41:13.528209] [INFO ] [MAIN ] Derivative Progress: 1124/1748 symbols completed. MEGI took 1.1s. Estimated remaining: 3m 60s. Rate: 156.1 symbols/min [2025-10-07T22:41:13.541509] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:13.542240] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 31840 primary records. [2025-10-07T22:41:13.542316] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-07T22:41:13.557804] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-07T22:41:13.557897] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-07T22:41:13.560101] [INFO ] [MAIN ] Derivative Progress: 1125/1748 symbols completed. MEI took 1.0s. Estimated remaining: 3m 59s. Rate: 156.2 symbols/min [2025-10-07T22:41:13.560569] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:13.560901] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:13.560819] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:13.569841] [DEBUG] [LOCAL ] MFAN: Loaded 4285 existing records from primary storage. [2025-10-07T22:41:13.570065] [INFO ] [MAIN ] MFAN: Loaded 4285 primary data records. [2025-10-07T22:41:13.936753] [DEBUG] [LOCAL ] MFA: Loaded 45634 existing records from primary storage. [2025-10-07T22:41:13.937141] [INFO ] [MAIN ] MFA: Loaded 45634 primary data records. [2025-10-07T22:41:14.056120] [DEBUG] [LOCAL ] MET: Loaded 53326 existing records from primary storage. [2025-10-07T22:41:14.072094] [INFO ] [MAIN ] MET: Loaded 53326 primary data records. [2025-10-07T22:41:14.564843] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:14.566162] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4285 primary records. [2025-10-07T22:41:14.566598] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-07T22:41:14.584270] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-10-07T22:41:14.584479] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-07T22:41:14.586889] [INFO ] [MAIN ] Derivative Progress: 1126/1748 symbols completed. MFAN took 1.0s. Estimated remaining: 3m 59s. Rate: 156.0 symbols/min [2025-10-07T22:41:14.587177] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:14.608179] [DEBUG] [LOCAL ] MFAO: Loaded 3908 existing records from primary storage. [2025-10-07T22:41:14.608480] [INFO ] [MAIN ] MFAO: Loaded 3908 primary data records. [2025-10-07T22:41:14.619927] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:14.629797] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45634 primary records. [2025-10-07T22:41:14.629972] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-07T22:41:14.724987] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:14.714616] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-07T22:41:14.731086] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53326 primary records. [2025-10-07T22:41:14.725131] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-07T22:41:14.740345] [INFO ] [MAIN ] Derivative Progress: 1127/1748 symbols completed. MFA took 1.2s. Estimated remaining: 3m 59s. Rate: 156.0 symbols/min [2025-10-07T22:41:14.740475] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-07T22:41:14.743689] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:14.966551] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-07T22:41:14.966709] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-07T22:41:14.968993] [INFO ] [MAIN ] Derivative Progress: 1128/1748 symbols completed. MET took 1.4s. Estimated remaining: 3m 58s. Rate: 156.1 symbols/min [2025-10-07T22:41:14.969548] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:15.015430] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:15.025944] [INFO ] [MAIN ] MFAO: Generated 1794 derivative records from 3908 primary records. [2025-10-07T22:41:15.026136] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-07T22:41:15.054876] [DEBUG] [LOCAL ] MFC: Loaded 51121 existing records from primary storage. [2025-10-07T22:41:15.068825] [INFO ] [MAIN ] MFC: Loaded 51121 primary data records. [2025-10-07T22:41:15.091798] [DEBUG] [LOCAL ] MFG: Loaded 49321 existing records from primary storage. [2025-10-07T22:41:15.107580] [INFO ] [MAIN ] MFG: Loaded 49321 primary data records. [2025-10-07T22:41:15.139758] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1794 records). [2025-10-07T22:41:15.218447] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-07T22:41:15.251162] [INFO ] [MAIN ] Derivative Progress: 1129/1748 symbols completed. MFAO took 0.7s. Estimated remaining: 3m 58s. Rate: 156.1 symbols/min [2025-10-07T22:41:15.283132] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:15.714090] [DEBUG] [LOCAL ] MFM: Loaded 14786 existing records from primary storage. [2025-10-07T22:41:15.714259] [INFO ] [MAIN ] MFM: Loaded 14786 primary data records. [2025-10-07T22:41:16.044391] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:16.058452] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49321 primary records. [2025-10-07T22:41:16.058756] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-07T22:41:16.057771] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:16.060151] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51121 primary records. [2025-10-07T22:41:16.060314] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-07T22:41:16.093146] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-07T22:41:16.101667] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-07T22:41:16.108748] [INFO ] [MAIN ] Derivative Progress: 1130/1748 symbols completed. MFG took 1.1s. Estimated remaining: 3m 58s. Rate: 156.0 symbols/min [2025-10-07T22:41:16.110004] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:16.109674] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:16.110124] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-07T22:41:16.111002] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14786 primary records. [2025-10-07T22:41:16.111070] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-07T22:41:16.111246] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-07T22:41:16.114577] [INFO ] [MAIN ] Derivative Progress: 1131/1748 symbols completed. MFC took 1.4s. Estimated remaining: 3m 57s. Rate: 156.1 symbols/min [2025-10-07T22:41:16.115362] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:16.132015] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-07T22:41:16.132265] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-07T22:41:16.137358] [INFO ] [MAIN ] Derivative Progress: 1132/1748 symbols completed. MFM took 0.9s. Estimated remaining: 3m 57s. Rate: 156.2 symbols/min [2025-10-07T22:41:16.137555] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:16.137846] [DEBUG] [LOCAL ] MFSG: Loaded 5506 existing records from primary storage. [2025-10-07T22:41:16.141628] [INFO ] [MAIN ] MFSG: Loaded 5506 primary data records. [2025-10-07T22:41:16.238754] [DEBUG] [LOCAL ] MFSI: Loaded 11719 existing records from primary storage. [2025-10-07T22:41:16.251520] [DEBUG] [LOCAL ] MFSV: Loaded 2650 existing records from primary storage. [2025-10-07T22:41:16.251682] [INFO ] [MAIN ] MFSI: Loaded 11719 primary data records. [2025-10-07T22:41:16.251778] [INFO ] [MAIN ] MFSV: Loaded 2650 primary data records. [2025-10-07T22:41:17.077952] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:17.079358] [INFO ] [MAIN ] MFSG: Generated 1794 derivative records from 5506 primary records. [2025-10-07T22:41:17.079554] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-07T22:41:17.093949] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:41:17.101330] [INFO ] [MAIN ] MFSV: Generated 1793 derivative records from 2650 primary records. [2025-10-07T22:41:17.106059] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-07T22:41:17.112547] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1794 records). [2025-10-07T22:41:17.118530] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-07T22:41:17.130509] [INFO ] [MAIN ] Derivative Progress: 1133/1748 symbols completed. MFSG took 1.0s. Estimated remaining: 3m 57s. Rate: 156.0 symbols/min [2025-10-07T22:41:17.141869] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1793 records). [2025-10-07T22:41:17.142036] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-07T22:41:17.142325] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:17.144484] [INFO ] [MAIN ] Derivative Progress: 1134/1748 symbols completed. MFSV took 1.0s. Estimated remaining: 3m 56s. Rate: 156.1 symbols/min [2025-10-07T22:41:17.145317] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:41:17.144973] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:17.146807] [INFO ] [MAIN ] MFSI: Generated 1792 derivative records from 11719 primary records. [2025-10-07T22:41:17.147059] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-07T22:41:17.174784] [DEBUG] [LOCAL ] MG: Loaded 16268 existing records from primary storage. [2025-10-07T22:41:17.175325] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1792 records). [2025-10-07T22:41:17.175415] [INFO ] [MAIN ] MG: Loaded 16268 primary data records. [2025-10-07T22:41:17.175498] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-07T22:41:17.198228] [INFO ] [MAIN ] Derivative Progress: 1135/1748 symbols completed. MFSI took 1.1s. Estimated remaining: 3m 55s. Rate: 156.3 symbols/min [2025-10-07T22:41:17.232252] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:17.325180] [DEBUG] [LOCAL ] MGF: Loaded 4308 existing records from primary storage. [2025-10-07T22:41:17.371802] [INFO ] [MAIN ] MGF: Loaded 4308 primary data records. [2025-10-07T22:41:17.630426] [DEBUG] [LOCAL ] MGA: Loaded 50687 existing records from primary storage. [2025-10-07T22:41:17.638400] [INFO ] [MAIN ] MGA: Loaded 50687 primary data records. [2025-10-07T22:41:18.157901] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:18.159300] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16268 primary records. [2025-10-07T22:41:18.159419] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-07T22:41:18.187847] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-07T22:41:18.193447] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-07T22:41:18.193305] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:41:18.194183] [INFO ] [MAIN ] MGF: Generated 1793 derivative records from 4308 primary records. [2025-10-07T22:41:18.197182] [INFO ] [MAIN ] Derivative Progress: 1136/1748 symbols completed. MG took 1.1s. Estimated remaining: 3m 55s. Rate: 156.0 symbols/min [2025-10-07T22:41:18.197303] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-07T22:41:18.198033] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:18.228957] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:18.230046] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50687 primary records. [2025-10-07T22:41:18.230542] [DEBUG] [LOCAL ] MGF: Derivative data saved (1793 records). [2025-10-07T22:41:18.230593] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-07T22:41:18.231112] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-07T22:41:18.233214] [INFO ] [MAIN ] Derivative Progress: 1137/1748 symbols completed. MGF took 1.0s. Estimated remaining: 3m 55s. Rate: 156.2 symbols/min [2025-10-07T22:41:18.233611] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:18.254733] [DEBUG] [LOCAL ] MGR: Loaded 5603 existing records from primary storage. [2025-10-07T22:41:18.255346] [INFO ] [MAIN ] MGR: Loaded 5603 primary data records. [2025-10-07T22:41:18.255607] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-07T22:41:18.276030] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-07T22:41:18.326004] [INFO ] [MAIN ] Derivative Progress: 1138/1748 symbols completed. MGA took 1.2s. Estimated remaining: 3m 54s. Rate: 156.3 symbols/min [2025-10-07T22:41:18.415334] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-07T22:41:18.436723] [INFO ] [MAIN ] MGM: Loaded 53607 primary data records. [2025-10-07T22:41:18.916961] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:18.917863] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5603 primary records. [2025-10-07T22:41:18.918127] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-07T22:41:18.933727] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-07T22:41:18.933826] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-07T22:41:18.936094] [INFO ] [MAIN ] Derivative Progress: 1139/1748 symbols completed. MGR took 0.7s. Estimated remaining: 3m 54s. Rate: 156.2 symbols/min [2025-10-07T22:41:18.951850] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:18.952473] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53607 primary records. [2025-10-07T22:41:18.952541] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-07T22:41:18.969466] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-07T22:41:18.969571] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-07T22:41:18.971795] [INFO ] [MAIN ] Derivative Progress: 1140/1748 symbols completed. MGM took 0.8s. Estimated remaining: 3m 53s. Rate: 156.3 symbols/min [2025-10-07T22:41:18.972225] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:18.972180] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:18.972407] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:18.977908] [DEBUG] [LOCAL ] MGRD: Loaded 2228 existing records from primary storage. [2025-10-07T22:41:18.981126] [INFO ] [MAIN ] MGRD: Loaded 2228 primary data records. [2025-10-07T22:41:19.015206] [DEBUG] [LOCAL ] MGRB: Loaded 4054 existing records from primary storage. [2025-10-07T22:41:19.053367] [INFO ] [MAIN ] MGRB: Loaded 4054 primary data records. [2025-10-07T22:41:19.062896] [DEBUG] [LOCAL ] MGRE: Loaded 6662 existing records from primary storage. [2025-10-07T22:41:19.124688] [INFO ] [MAIN ] MGRE: Loaded 6662 primary data records. [2025-10-07T22:41:19.988721] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:19.975374] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:19.991040] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2228 primary records. [2025-10-07T22:41:19.990421] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4054 primary records. [2025-10-07T22:41:19.991207] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-07T22:41:19.989620] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:19.992172] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6662 primary records. [2025-10-07T22:41:19.992245] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-07T22:41:19.993054] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-07T22:41:20.031154] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-07T22:41:20.032447] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-07T22:41:20.035283] [INFO ] [MAIN ] Derivative Progress: 1141/1748 symbols completed. MGRD took 1.1s. Estimated remaining: 3m 53s. Rate: 156.1 symbols/min [2025-10-07T22:41:20.035883] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:20.039311] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-10-07T22:41:20.040147] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-07T22:41:20.042512] [INFO ] [MAIN ] Derivative Progress: 1142/1748 symbols completed. MGRB took 1.1s. Estimated remaining: 3m 53s. Rate: 156.2 symbols/min [2025-10-07T22:41:20.043422] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:20.044459] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-07T22:41:20.044760] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-07T22:41:20.047058] [INFO ] [MAIN ] Derivative Progress: 1143/1748 symbols completed. MGRE took 1.1s. Estimated remaining: 3m 52s. Rate: 156.3 symbols/min [2025-10-07T22:41:20.047356] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:20.061563] [DEBUG] [LOCAL ] MHF: Loaded 8672 existing records from primary storage. [2025-10-07T22:41:20.061814] [INFO ] [MAIN ] MHF: Loaded 8672 primary data records. [2025-10-07T22:41:20.111488] [DEBUG] [LOCAL ] MHD: Loaded 12471 existing records from primary storage. [2025-10-07T22:41:20.139000] [INFO ] [MAIN ] MHD: Loaded 12471 primary data records. [2025-10-07T22:41:20.396636] [DEBUG] [LOCAL ] MGY: Loaded 52395 existing records from primary storage. [2025-10-07T22:41:20.418497] [INFO ] [MAIN ] MGY: Loaded 52395 primary data records. [2025-10-07T22:41:21.104513] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:21.105494] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8672 primary records. [2025-10-07T22:41:21.106234] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-07T22:41:21.140606] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-07T22:41:21.141506] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-07T22:41:21.141390] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:21.143718] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12471 primary records. [2025-10-07T22:41:21.146219] [INFO ] [MAIN ] Derivative Progress: 1144/1748 symbols completed. MHF took 1.1s. Estimated remaining: 3m 52s. Rate: 156.1 symbols/min [2025-10-07T22:41:21.143862] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-07T22:41:21.146876] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:21.168213] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:21.172845] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52395 primary records. [2025-10-07T22:41:21.173149] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-07T22:41:21.192817] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-10-07T22:41:21.192981] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-07T22:41:21.195574] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-07T22:41:21.195760] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-07T22:41:21.195465] [INFO ] [MAIN ] Derivative Progress: 1145/1748 symbols completed. MGY took 1.2s. Estimated remaining: 3m 52s. Rate: 156.2 symbols/min [2025-10-07T22:41:21.195884] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:21.198075] [INFO ] [MAIN ] Derivative Progress: 1146/1748 symbols completed. MHD took 1.2s. Estimated remaining: 3m 51s. Rate: 156.3 symbols/min [2025-10-07T22:41:21.198736] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:21.217960] [DEBUG] [LOCAL ] MHN: Loaded 7657 existing records from primary storage. [2025-10-07T22:41:21.218096] [INFO ] [MAIN ] MHN: Loaded 7657 primary data records. [2025-10-07T22:41:21.319213] [DEBUG] [LOCAL ] MHK: Loaded 42217 existing records from primary storage. [2025-10-07T22:41:21.347327] [INFO ] [MAIN ] MHK: Loaded 42217 primary data records. [2025-10-07T22:41:21.348626] [DEBUG] [LOCAL ] MHO: Loaded 23820 existing records from primary storage. [2025-10-07T22:41:21.359426] [INFO ] [MAIN ] MHO: Loaded 23820 primary data records. [2025-10-07T22:41:22.243151] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:22.244705] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7657 primary records. [2025-10-07T22:41:22.245208] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-07T22:41:22.265232] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-07T22:41:22.266552] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-07T22:41:22.269699] [INFO ] [MAIN ] Derivative Progress: 1147/1748 symbols completed. MHN took 1.1s. Estimated remaining: 3m 51s. Rate: 156.1 symbols/min [2025-10-07T22:41:22.278734] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:22.285020] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:22.286538] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42217 primary records. [2025-10-07T22:41:22.286854] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-07T22:41:22.316428] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:22.326123] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23820 primary records. [2025-10-07T22:41:22.327234] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-07T22:41:22.327116] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-07T22:41:22.328309] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-07T22:41:22.330598] [INFO ] [MAIN ] Derivative Progress: 1148/1748 symbols completed. MHK took 1.2s. Estimated remaining: 3m 50s. Rate: 156.2 symbols/min [2025-10-07T22:41:22.349980] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:22.351631] [DEBUG] [LOCAL ] MIN: Loaded 13484 existing records from primary storage. [2025-10-07T22:41:22.352428] [INFO ] [MAIN ] MIN: Loaded 13484 primary data records. [2025-10-07T22:41:22.392353] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-07T22:41:22.411113] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-07T22:41:22.413167] [INFO ] [MAIN ] Derivative Progress: 1149/1748 symbols completed. MHO took 1.2s. Estimated remaining: 3m 50s. Rate: 156.3 symbols/min [2025-10-07T22:41:22.434122] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:22.566576] [DEBUG] [LOCAL ] MITP: Loaded 2373 existing records from primary storage. [2025-10-07T22:41:22.681720] [INFO ] [MAIN ] MITP: Loaded 2373 primary data records. [2025-10-07T22:41:22.801578] [DEBUG] [LOCAL ] MIR: Loaded 51128 existing records from primary storage. [2025-10-07T22:41:22.812740] [INFO ] [MAIN ] MIR: Loaded 51128 primary data records. [2025-10-07T22:41:23.398030] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:23.399700] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13484 primary records. [2025-10-07T22:41:23.399956] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-07T22:41:23.424033] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-07T22:41:23.424442] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-07T22:41:23.426928] [INFO ] [MAIN ] Derivative Progress: 1150/1748 symbols completed. MIN took 1.1s. Estimated remaining: 3m 50s. Rate: 156.1 symbols/min [2025-10-07T22:41:23.440222] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:23.441343] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:41:23.442699] [INFO ] [MAIN ] MITP: Generated 1792 derivative records from 2373 primary records. [2025-10-07T22:41:23.442888] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-07T22:41:23.460058] [DEBUG] [LOCAL ] MITP: Derivative data saved (1792 records). [2025-10-07T22:41:23.473836] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-07T22:41:23.480712] [INFO ] [MAIN ] Derivative Progress: 1151/1748 symbols completed. MITP took 1.0s. Estimated remaining: 3m 49s. Rate: 156.2 symbols/min [2025-10-07T22:41:23.481244] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:23.482167] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:23.482049] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51128 primary records. [2025-10-07T22:41:23.482565] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-07T22:41:23.500570] [DEBUG] [LOCAL ] MITT: Loaded 22776 existing records from primary storage. [2025-10-07T22:41:23.505179] [INFO ] [MAIN ] MITT: Loaded 22776 primary data records. [2025-10-07T22:41:23.565891] [DEBUG] [LOCAL ] MIY: Loaded 6055 existing records from primary storage. [2025-10-07T22:41:23.575284] [INFO ] [MAIN ] MIY: Loaded 6055 primary data records. [2025-10-07T22:41:23.668044] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-07T22:41:23.685597] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-07T22:41:23.699042] [INFO ] [MAIN ] Derivative Progress: 1152/1748 symbols completed. MIR took 1.3s. Estimated remaining: 3m 49s. Rate: 156.3 symbols/min [2025-10-07T22:41:23.705032] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:24.186466] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:24.189967] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22776 primary records. [2025-10-07T22:41:24.190347] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-07T22:41:24.192543] [DEBUG] [LOCAL ] MKC: Loaded 52516 existing records from primary storage. [2025-10-07T22:41:24.192747] [INFO ] [MAIN ] MKC: Loaded 52516 primary data records. [2025-10-07T22:41:24.217763] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:24.219216] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6055 primary records. [2025-10-07T22:41:24.230896] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-07T22:41:24.346166] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-10-07T22:41:24.347474] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-07T22:41:24.348410] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-07T22:41:24.361885] [INFO ] [MAIN ] Derivative Progress: 1153/1748 symbols completed. MITT took 0.9s. Estimated remaining: 3m 49s. Rate: 156.2 symbols/min [2025-10-07T22:41:24.367399] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-07T22:41:24.369634] [INFO ] [MAIN ] Derivative Progress: 1154/1748 symbols completed. MIY took 0.9s. Estimated remaining: 3m 48s. Rate: 156.3 symbols/min [2025-10-07T22:41:24.585019] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:24.585798] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52516 primary records. [2025-10-07T22:41:24.585868] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-07T22:41:24.603344] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-07T22:41:24.603494] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-07T22:41:24.605825] [INFO ] [MAIN ] Derivative Progress: 1155/1748 symbols completed. MKC took 0.9s. Estimated remaining: 3m 48s. Rate: 156.4 symbols/min [2025-10-07T22:41:24.606470] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:24.606375] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:24.607151] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:24.669526] [DEBUG] [LOCAL ] MLM: Loaded 29541 existing records from primary storage. [2025-10-07T22:41:24.686189] [INFO ] [MAIN ] MLM: Loaded 29541 primary data records. [2025-10-07T22:41:24.717807] [DEBUG] [LOCAL ] MLI: Loaded 43511 existing records from primary storage. [2025-10-07T22:41:24.734031] [DEBUG] [LOCAL ] MKL: Loaded 34093 existing records from primary storage. [2025-10-07T22:41:24.734246] [INFO ] [MAIN ] MKL: Loaded 34093 primary data records. [2025-10-07T22:41:24.728055] [INFO ] [MAIN ] MLI: Loaded 43511 primary data records. [2025-10-07T22:41:25.996391] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:25.998206] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 29541 primary records. [2025-10-07T22:41:25.998437] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-07T22:41:26.034794] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-07T22:41:26.043426] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-07T22:41:26.050599] [INFO ] [MAIN ] Derivative Progress: 1156/1748 symbols completed. MLM took 1.4s. Estimated remaining: 3m 48s. Rate: 156.0 symbols/min [2025-10-07T22:41:26.035124] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:26.051021] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:26.052382] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43511 primary records. [2025-10-07T22:41:26.051521] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:26.052928] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-07T22:41:26.054341] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34093 primary records. [2025-10-07T22:41:26.054476] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-07T22:41:26.094722] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-07T22:41:26.095276] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-07T22:41:26.097706] [INFO ] [MAIN ] Derivative Progress: 1157/1748 symbols completed. MLI took 1.5s. Estimated remaining: 3m 47s. Rate: 156.1 symbols/min [2025-10-07T22:41:26.097851] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:26.095376] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-07T22:41:26.098494] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-07T22:41:26.100617] [INFO ] [MAIN ] Derivative Progress: 1158/1748 symbols completed. MKL took 1.5s. Estimated remaining: 3m 47s. Rate: 156.2 symbols/min [2025-10-07T22:41:26.101021] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:26.111492] [DEBUG] [LOCAL ] MLNK: Loaded 25703 existing records from primary storage. [2025-10-07T22:41:26.114382] [DEBUG] [LOCAL ] MLP: Loaded 3010 existing records from primary storage. [2025-10-07T22:41:26.114504] [INFO ] [MAIN ] MLP: Loaded 3010 primary data records. [2025-10-07T22:41:26.125842] [INFO ] [MAIN ] MLNK: Loaded 25703 primary data records. [2025-10-07T22:41:26.299539] [DEBUG] [LOCAL ] MLR: Loaded 12353 existing records from primary storage. [2025-10-07T22:41:26.319050] [INFO ] [MAIN ] MLR: Loaded 12353 primary data records. [2025-10-07T22:41:27.126529] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:27.127717] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 3010 primary records. [2025-10-07T22:41:27.129264] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-07T22:41:27.129166] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:27.132390] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25703 primary records. [2025-10-07T22:41:27.132764] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-07T22:41:27.158342] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:27.179620] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12353 primary records. [2025-10-07T22:41:27.178797] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-10-07T22:41:27.181589] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-07T22:41:27.180397] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-07T22:41:27.184310] [INFO ] [MAIN ] Derivative Progress: 1159/1748 symbols completed. MLP took 1.1s. Estimated remaining: 3m 47s. Rate: 156.0 symbols/min [2025-10-07T22:41:27.185700] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:27.202196] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-07T22:41:27.203023] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-07T22:41:27.206302] [INFO ] [MAIN ] Derivative Progress: 1160/1748 symbols completed. MLNK took 1.2s. Estimated remaining: 3m 46s. Rate: 156.1 symbols/min [2025-10-07T22:41:27.207134] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:27.211022] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-10-07T22:41:27.211110] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-07T22:41:27.213063] [INFO ] [MAIN ] Derivative Progress: 1161/1748 symbols completed. MLR took 1.1s. Estimated remaining: 3m 45s. Rate: 156.2 symbols/min [2025-10-07T22:41:27.213448] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:27.225723] [DEBUG] [LOCAL ] MMD: Loaded 11209 existing records from primary storage. [2025-10-07T22:41:27.225865] [INFO ] [MAIN ] MMD: Loaded 11209 primary data records. [2025-10-07T22:41:27.356355] [DEBUG] [LOCAL ] MMI: Loaded 15268 existing records from primary storage. [2025-10-07T22:41:27.372891] [INFO ] [MAIN ] MMI: Loaded 15268 primary data records. [2025-10-07T22:41:27.534722] [DEBUG] [LOCAL ] MMC: Loaded 51858 existing records from primary storage. [2025-10-07T22:41:27.677565] [INFO ] [MAIN ] MMC: Loaded 51858 primary data records. [2025-10-07T22:41:28.247431] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:28.249603] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11209 primary records. [2025-10-07T22:41:28.250779] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-07T22:41:28.279336] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:28.281007] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15268 primary records. [2025-10-07T22:41:28.281633] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-07T22:41:28.300842] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-07T22:41:28.301877] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-07T22:41:28.304115] [INFO ] [MAIN ] Derivative Progress: 1162/1748 symbols completed. MMD took 1.1s. Estimated remaining: 3m 45s. Rate: 156.0 symbols/min [2025-10-07T22:41:28.305670] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:28.308359] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-07T22:41:28.308747] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-07T22:41:28.311338] [INFO ] [MAIN ] Derivative Progress: 1163/1748 symbols completed. MMI took 1.1s. Estimated remaining: 3m 45s. Rate: 156.1 symbols/min [2025-10-07T22:41:28.311695] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:28.334413] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:28.335757] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51858 primary records. [2025-10-07T22:41:28.335959] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-07T22:41:28.357133] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-07T22:41:28.357363] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-07T22:41:28.360044] [INFO ] [MAIN ] Derivative Progress: 1164/1748 symbols completed. MMC took 1.2s. Estimated remaining: 3m 44s. Rate: 156.3 symbols/min [2025-10-07T22:41:28.360513] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:28.386054] [DEBUG] [LOCAL ] MMS: Loaded 34006 existing records from primary storage. [2025-10-07T22:41:28.401018] [INFO ] [MAIN ] MMS: Loaded 34006 primary data records. [2025-10-07T22:41:28.449125] [DEBUG] [LOCAL ] MMT: Loaded 10518 existing records from primary storage. [2025-10-07T22:41:28.493820] [INFO ] [MAIN ] MMT: Loaded 10518 primary data records. [2025-10-07T22:41:28.568418] [DEBUG] [LOCAL ] MMM: Loaded 53140 existing records from primary storage. [2025-10-07T22:41:28.611190] [INFO ] [MAIN ] MMM: Loaded 53140 primary data records. [2025-10-07T22:41:29.393089] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:29.394024] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 34006 primary records. [2025-10-07T22:41:29.394201] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-07T22:41:29.421160] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:29.425425] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10518 primary records. [2025-10-07T22:41:29.426073] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-07T22:41:29.453971] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:29.456008] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53140 primary records. [2025-10-07T22:41:29.456628] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-07T22:41:29.458677] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-10-07T22:41:29.459262] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-07T22:41:29.461525] [INFO ] [MAIN ] Derivative Progress: 1165/1748 symbols completed. MMS took 1.1s. Estimated remaining: 3m 44s. Rate: 156.0 symbols/min [2025-10-07T22:41:29.461966] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:29.480842] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-07T22:41:29.481464] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-07T22:41:29.481400] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-07T22:41:29.483928] [INFO ] [MAIN ] Derivative Progress: 1166/1748 symbols completed. MMT took 1.1s. Estimated remaining: 3m 44s. Rate: 156.1 symbols/min [2025-10-07T22:41:29.481690] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-07T22:41:29.486173] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:29.486811] [INFO ] [MAIN ] Derivative Progress: 1167/1748 symbols completed. MMM took 1.2s. Estimated remaining: 3m 43s. Rate: 156.3 symbols/min [2025-10-07T22:41:29.486905] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:29.500394] [DEBUG] [LOCAL ] MMU: Loaded 16773 existing records from primary storage. [2025-10-07T22:41:29.500551] [INFO ] [MAIN ] MMU: Loaded 16773 primary data records. [2025-10-07T22:41:29.708439] [DEBUG] [LOCAL ] MNR: Loaded 24441 existing records from primary storage. [2025-10-07T22:41:29.853941] [INFO ] [MAIN ] MNR: Loaded 24441 primary data records. [2025-10-07T22:41:29.919785] [DEBUG] [LOCAL ] MNSO: Loaded 44345 existing records from primary storage. [2025-10-07T22:41:29.948243] [INFO ] [MAIN ] MNSO: Loaded 44345 primary data records. [2025-10-07T22:41:30.391609] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:30.498466] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16773 primary records. [2025-10-07T22:41:30.512750] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-07T22:41:30.535900] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-07T22:41:30.537164] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-07T22:41:30.539816] [INFO ] [MAIN ] Derivative Progress: 1168/1748 symbols completed. MMU took 1.1s. Estimated remaining: 3m 43s. Rate: 156.0 symbols/min [2025-10-07T22:41:30.557614] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:30.558279] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24441 primary records. [2025-10-07T22:41:30.558428] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-07T22:41:30.577761] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-07T22:41:30.590608] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-07T22:41:30.590885] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:30.593103] [INFO ] [MAIN ] Derivative Progress: 1169/1748 symbols completed. MNR took 1.1s. Estimated remaining: 3m 42s. Rate: 156.1 symbols/min [2025-10-07T22:41:30.593812] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44345 primary records. [2025-10-07T22:41:30.594093] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-07T22:41:30.610305] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-07T22:41:30.610367] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-07T22:41:30.612419] [INFO ] [MAIN ] Derivative Progress: 1170/1748 symbols completed. MNSO took 1.1s. Estimated remaining: 3m 42s. Rate: 156.3 symbols/min [2025-10-07T22:41:30.613053] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:30.613133] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:30.613249] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:30.683510] [DEBUG] [LOCAL ] MODG: Loaded 51559 existing records from primary storage. [2025-10-07T22:41:30.695961] [INFO ] [MAIN ] MODG: Loaded 51559 primary data records. [2025-10-07T22:41:30.703802] [DEBUG] [LOCAL ] MOD: Loaded 45030 existing records from primary storage. [2025-10-07T22:41:30.744079] [INFO ] [MAIN ] MOD: Loaded 45030 primary data records. [2025-10-07T22:41:30.802013] [DEBUG] [LOCAL ] MOH: Loaded 42038 existing records from primary storage. [2025-10-07T22:41:30.840289] [INFO ] [MAIN ] MOH: Loaded 42038 primary data records. [2025-10-07T22:41:31.731464] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:31.732097] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:31.732984] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 45030 primary records. [2025-10-07T22:41:31.733681] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-07T22:41:31.733549] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51559 primary records. [2025-10-07T22:41:31.734413] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-07T22:41:31.764910] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-07T22:41:31.765619] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-07T22:41:31.768134] [INFO ] [MAIN ] Derivative Progress: 1171/1748 symbols completed. MODG took 1.2s. Estimated remaining: 3m 42s. Rate: 156.0 symbols/min [2025-10-07T22:41:31.768466] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:31.785214] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-07T22:41:31.785426] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-07T22:41:31.784809] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:31.788154] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 42038 primary records. [2025-10-07T22:41:31.787247] [INFO ] [MAIN ] Derivative Progress: 1172/1748 symbols completed. MOD took 1.2s. Estimated remaining: 3m 41s. Rate: 156.1 symbols/min [2025-10-07T22:41:31.788310] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-07T22:41:31.788427] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:31.806774] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-10-07T22:41:31.806982] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-07T22:41:31.809815] [INFO ] [MAIN ] Derivative Progress: 1173/1748 symbols completed. MOH took 1.2s. Estimated remaining: 3m 41s. Rate: 156.3 symbols/min [2025-10-07T22:41:31.810606] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:31.828247] [DEBUG] [LOCAL ] MOV: Loaded 21858 existing records from primary storage. [2025-10-07T22:41:31.828588] [INFO ] [MAIN ] MOV: Loaded 21858 primary data records. [2025-10-07T22:41:31.988666] [DEBUG] [LOCAL ] MOS: Loaded 53501 existing records from primary storage. [2025-10-07T22:41:32.008294] [INFO ] [MAIN ] MOS: Loaded 53501 primary data records. [2025-10-07T22:41:32.329027] [DEBUG] [LOCAL ] MP: Loaded 53690 existing records from primary storage. [2025-10-07T22:41:32.345040] [INFO ] [MAIN ] MP: Loaded 53690 primary data records. [2025-10-07T22:41:32.917435] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:32.918678] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 21858 primary records. [2025-10-07T22:41:32.919012] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-07T22:41:32.959338] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-10-07T22:41:32.959718] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:32.960186] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-07T22:41:32.962539] [INFO ] [MAIN ] Derivative Progress: 1174/1748 symbols completed. MOV took 1.2s. Estimated remaining: 3m 41s. Rate: 156.0 symbols/min [2025-10-07T22:41:32.964261] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53501 primary records. [2025-10-07T22:41:32.964459] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:32.965170] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-07T22:41:32.985955] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-10-07T22:41:32.986833] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-07T22:41:32.994453] [DEBUG] [LOCAL ] MPA: Loaded 5335 existing records from primary storage. [2025-10-07T22:41:32.996923] [INFO ] [MAIN ] Derivative Progress: 1175/1748 symbols completed. MOS took 1.2s. Estimated remaining: 3m 40s. Rate: 156.1 symbols/min [2025-10-07T22:41:32.997305] [INFO ] [MAIN ] MPA: Loaded 5335 primary data records. [2025-10-07T22:41:33.009403] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:33.104930] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:33.120963] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53690 primary records. [2025-10-07T22:41:33.145131] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-07T22:41:33.376107] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-10-07T22:41:33.376628] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-07T22:41:33.380203] [INFO ] [MAIN ] Derivative Progress: 1176/1748 symbols completed. MP took 1.6s. Estimated remaining: 3m 40s. Rate: 156.1 symbols/min [2025-10-07T22:41:33.380627] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:33.425319] [DEBUG] [LOCAL ] MPC: Loaded 52072 existing records from primary storage. [2025-10-07T22:41:33.425827] [INFO ] [MAIN ] MPC: Loaded 52072 primary data records. [2025-10-07T22:41:33.583277] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:33.584231] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5335 primary records. [2025-10-07T22:41:33.584781] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-07T22:41:33.640983] [DEBUG] [LOCAL ] MPLX: Loaded 50718 existing records from primary storage. [2025-10-07T22:41:33.661016] [INFO ] [MAIN ] MPLX: Loaded 50718 primary data records. [2025-10-07T22:41:33.863859] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-10-07T22:41:33.880003] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-07T22:41:33.887425] [INFO ] [MAIN ] Derivative Progress: 1177/1748 symbols completed. MPA took 0.9s. Estimated remaining: 3m 40s. Rate: 156.1 symbols/min [2025-10-07T22:41:33.887999] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:33.999445] [DEBUG] [LOCAL ] MPV: Loaded 4894 existing records from primary storage. [2025-10-07T22:41:34.051480] [INFO ] [MAIN ] MPV: Loaded 4894 primary data records. [2025-10-07T22:41:34.407004] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:34.411422] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52072 primary records. [2025-10-07T22:41:34.435933] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-07T22:41:34.588732] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-10-07T22:41:34.589838] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-07T22:41:34.593562] [INFO ] [MAIN ] Derivative Progress: 1178/1748 symbols completed. MPC took 1.6s. Estimated remaining: 3m 39s. Rate: 156.0 symbols/min [2025-10-07T22:41:34.594365] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:34.621708] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:34.622796] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50718 primary records. [2025-10-07T22:41:34.623066] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-07T22:41:34.628905] [DEBUG] [LOCAL ] MQT: Loaded 8668 existing records from primary storage. [2025-10-07T22:41:34.629960] [INFO ] [MAIN ] MQT: Loaded 8668 primary data records. [2025-10-07T22:41:34.748749] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-10-07T22:41:34.763634] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-07T22:41:34.766134] [INFO ] [MAIN ] Derivative Progress: 1179/1748 symbols completed. MPLX took 1.4s. Estimated remaining: 3m 39s. Rate: 156.0 symbols/min [2025-10-07T22:41:34.754374] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:34.776818] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:34.789672] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4894 primary records. [2025-10-07T22:41:34.798053] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-07T22:41:34.895872] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-10-07T22:41:34.912525] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-07T22:41:34.921974] [INFO ] [MAIN ] Derivative Progress: 1180/1748 symbols completed. MPV took 1.0s. Estimated remaining: 3m 38s. Rate: 156.1 symbols/min [2025-10-07T22:41:35.049778] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:35.070073] [DEBUG] [LOCAL ] MQY: Loaded 16958 existing records from primary storage. [2025-10-07T22:41:35.070948] [INFO ] [MAIN ] MQY: Loaded 16958 primary data records. [2025-10-07T22:41:35.268144] [DEBUG] [LOCAL ] MSD: Loaded 16021 existing records from primary storage. [2025-10-07T22:41:35.371543] [INFO ] [MAIN ] MSD: Loaded 16021 primary data records. [2025-10-07T22:41:35.590998] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:35.711823] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8668 primary records. [2025-10-07T22:41:35.712420] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-07T22:41:35.734483] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-10-07T22:41:35.735015] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-07T22:41:35.738523] [INFO ] [MAIN ] Derivative Progress: 1181/1748 symbols completed. MQT took 1.1s. Estimated remaining: 3m 38s. Rate: 156.0 symbols/min [2025-10-07T22:41:35.739487] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:35.755528] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:35.756819] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16958 primary records. [2025-10-07T22:41:35.757116] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-07T22:41:35.780210] [DEBUG] [LOCAL ] MUA: Loaded 11831 existing records from primary storage. [2025-10-07T22:41:35.781873] [INFO ] [MAIN ] MUA: Loaded 11831 primary data records. [2025-10-07T22:41:35.861800] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-10-07T22:41:35.876855] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-07T22:41:35.879625] [INFO ] [MAIN ] Derivative Progress: 1182/1748 symbols completed. MQY took 1.1s. Estimated remaining: 3m 38s. Rate: 156.0 symbols/min [2025-10-07T22:41:35.877364] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:35.880131] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:35.886478] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 16021 primary records. [2025-10-07T22:41:35.904410] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-07T22:41:36.163534] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-10-07T22:41:36.163804] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-07T22:41:36.167032] [INFO ] [MAIN ] Derivative Progress: 1183/1748 symbols completed. MSD took 1.1s. Estimated remaining: 3m 37s. Rate: 156.1 symbols/min [2025-10-07T22:41:36.183469] [DEBUG] [LOCAL ] MUC: Loaded 20533 existing records from primary storage. [2025-10-07T22:41:36.183615] [INFO ] [MAIN ] MUC: Loaded 20533 primary data records. [2025-10-07T22:41:36.510463] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:36.511606] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 11831 primary records. [2025-10-07T22:41:36.511731] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-07T22:41:36.528064] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-10-07T22:41:36.528157] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-07T22:41:36.530152] [INFO ] [MAIN ] Derivative Progress: 1184/1748 symbols completed. MUA took 0.8s. Estimated remaining: 3m 37s. Rate: 156.1 symbols/min [2025-10-07T22:41:36.547917] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:36.548462] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20533 primary records. [2025-10-07T22:41:36.548520] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-07T22:41:36.564358] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-10-07T22:41:36.564419] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-07T22:41:36.566399] [INFO ] [MAIN ] Derivative Progress: 1185/1748 symbols completed. MUC took 0.7s. Estimated remaining: 3m 36s. Rate: 156.2 symbols/min [2025-10-07T22:41:36.567346] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:36.567489] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:36.567588] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:36.590308] [DEBUG] [LOCAL ] MVF: Loaded 13069 existing records from primary storage. [2025-10-07T22:41:36.595289] [INFO ] [MAIN ] MVF: Loaded 13069 primary data records. [2025-10-07T22:41:36.595091] [DEBUG] [LOCAL ] MUE: Loaded 11979 existing records from primary storage. [2025-10-07T22:41:36.617465] [INFO ] [MAIN ] MUE: Loaded 11979 primary data records. [2025-10-07T22:41:36.726704] [DEBUG] [LOCAL ] MUJ: Loaded 13668 existing records from primary storage. [2025-10-07T22:41:36.787700] [INFO ] [MAIN ] MUJ: Loaded 13668 primary data records. [2025-10-07T22:41:37.546293] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:37.547276] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 13069 primary records. [2025-10-07T22:41:37.547405] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-07T22:41:37.578990] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:37.592446] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11979 primary records. [2025-10-07T22:41:37.593111] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:37.594274] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13668 primary records. [2025-10-07T22:41:37.593701] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-07T22:41:37.597269] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-10-07T22:41:37.597383] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-07T22:41:37.604775] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-07T22:41:37.611170] [INFO ] [MAIN ] Derivative Progress: 1186/1748 symbols completed. MVF took 1.0s. Estimated remaining: 3m 36s. Rate: 156.0 symbols/min [2025-10-07T22:41:37.611800] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:37.638082] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-10-07T22:41:37.638460] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-07T22:41:37.637802] [DEBUG] [LOCAL ] MVT: Loaded 10279 existing records from primary storage. [2025-10-07T22:41:37.640658] [INFO ] [MAIN ] Derivative Progress: 1187/1748 symbols completed. MUE took 1.1s. Estimated remaining: 3m 36s. Rate: 156.1 symbols/min [2025-10-07T22:41:37.641532] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:37.641074] [INFO ] [MAIN ] MVT: Loaded 10279 primary data records. [2025-10-07T22:41:37.673664] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-10-07T22:41:37.678997] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-07T22:41:37.714411] [INFO ] [MAIN ] Derivative Progress: 1188/1748 symbols completed. MUJ took 1.1s. Estimated remaining: 3m 35s. Rate: 156.2 symbols/min [2025-10-07T22:41:37.739333] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:37.747311] [DEBUG] [LOCAL ] MXF: Loaded 5662 existing records from primary storage. [2025-10-07T22:41:37.750882] [INFO ] [MAIN ] MXF: Loaded 5662 primary data records. [2025-10-07T22:41:38.041580] [DEBUG] [LOCAL ] MYD: Loaded 13349 existing records from primary storage. [2025-10-07T22:41:38.078259] [INFO ] [MAIN ] MYD: Loaded 13349 primary data records. [2025-10-07T22:41:38.634981] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:38.636936] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10279 primary records. [2025-10-07T22:41:38.645696] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-07T22:41:38.652638] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:41:38.667192] [INFO ] [MAIN ] MXF: Generated 1792 derivative records from 5662 primary records. [2025-10-07T22:41:38.667412] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-07T22:41:38.670379] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-10-07T22:41:38.671146] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-07T22:41:38.673906] [INFO ] [MAIN ] Derivative Progress: 1189/1748 symbols completed. MVT took 1.1s. Estimated remaining: 3m 35s. Rate: 156.0 symbols/min [2025-10-07T22:41:38.682396] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:38.707896] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:38.709209] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13349 primary records. [2025-10-07T22:41:38.709566] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-07T22:41:38.723750] [DEBUG] [LOCAL ] MXF: Derivative data saved (1792 records). [2025-10-07T22:41:38.725529] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-07T22:41:38.728013] [INFO ] [MAIN ] Derivative Progress: 1190/1748 symbols completed. MXF took 1.1s. Estimated remaining: 3m 34s. Rate: 156.1 symbols/min [2025-10-07T22:41:38.728179] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:38.737460] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-10-07T22:41:38.737686] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-07T22:41:38.739776] [INFO ] [MAIN ] Derivative Progress: 1191/1748 symbols completed. MYD took 1.0s. Estimated remaining: 3m 34s. Rate: 156.2 symbols/min [2025-10-07T22:41:38.740167] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:38.751935] [DEBUG] [LOCAL ] MYI: Loaded 19076 existing records from primary storage. [2025-10-07T22:41:38.752139] [INFO ] [MAIN ] MYI: Loaded 19076 primary data records. [2025-10-07T22:41:38.820348] [DEBUG] [LOCAL ] MYN: Loaded 9982 existing records from primary storage. [2025-10-07T22:41:38.854353] [INFO ] [MAIN ] MYN: Loaded 9982 primary data records. [2025-10-07T22:41:39.090431] [DEBUG] [LOCAL ] NAC: Loaded 24598 existing records from primary storage. [2025-10-07T22:41:39.224097] [INFO ] [MAIN ] NAC: Loaded 24598 primary data records. [2025-10-07T22:41:39.746260] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:39.753861] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19076 primary records. [2025-10-07T22:41:39.756312] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-07T22:41:39.784710] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:39.786995] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 9982 primary records. [2025-10-07T22:41:39.787357] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-07T22:41:39.807374] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-10-07T22:41:39.808188] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-07T22:41:39.813242] [INFO ] [MAIN ] Derivative Progress: 1192/1748 symbols completed. MYI took 1.1s. Estimated remaining: 3m 34s. Rate: 156.0 symbols/min [2025-10-07T22:41:39.813866] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:39.823347] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-10-07T22:41:39.828719] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:39.829530] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24598 primary records. [2025-10-07T22:41:39.828914] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-07T22:41:39.833732] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-07T22:41:39.833627] [INFO ] [MAIN ] Derivative Progress: 1193/1748 symbols completed. MYN took 1.1s. Estimated remaining: 3m 33s. Rate: 156.1 symbols/min [2025-10-07T22:41:39.834534] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:39.851530] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-10-07T22:41:39.851601] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-07T22:41:39.853564] [INFO ] [MAIN ] Derivative Progress: 1194/1748 symbols completed. NAC took 1.1s. Estimated remaining: 3m 33s. Rate: 156.3 symbols/min [2025-10-07T22:41:39.853764] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:39.867117] [DEBUG] [LOCAL ] NAN: Loaded 8456 existing records from primary storage. [2025-10-07T22:41:39.867328] [INFO ] [MAIN ] NAN: Loaded 8456 primary data records. [2025-10-07T22:41:39.915744] [DEBUG] [LOCAL ] NAZ: Loaded 2646 existing records from primary storage. [2025-10-07T22:41:39.922182] [INFO ] [MAIN ] NAZ: Loaded 2646 primary data records. [2025-10-07T22:41:40.194260] [DEBUG] [LOCAL ] NAD: Loaded 33873 existing records from primary storage. [2025-10-07T22:41:40.199902] [INFO ] [MAIN ] NAD: Loaded 33873 primary data records. [2025-10-07T22:41:40.839712] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:40.842742] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 8456 primary records. [2025-10-07T22:41:40.844372] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-07T22:41:40.875246] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:40.876785] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2646 primary records. [2025-10-07T22:41:40.877401] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-10-07T22:41:40.877881] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-07T22:41:40.878186] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-07T22:41:40.880885] [INFO ] [MAIN ] Derivative Progress: 1195/1748 symbols completed. NAN took 1.0s. Estimated remaining: 3m 33s. Rate: 156.0 symbols/min [2025-10-07T22:41:40.881361] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:40.911704] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-10-07T22:41:40.916864] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-07T22:41:40.919300] [INFO ] [MAIN ] Derivative Progress: 1196/1748 symbols completed. NAZ took 1.1s. Estimated remaining: 3m 32s. Rate: 156.2 symbols/min [2025-10-07T22:41:40.919803] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:40.925433] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 33873 primary records. [2025-10-07T22:41:40.925597] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-07T22:41:40.924383] [DEBUG] [LOCAL ] NBB: Loaded 9141 existing records from primary storage. [2025-10-07T22:41:40.924524] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:40.926893] [INFO ] [MAIN ] NBB: Loaded 9141 primary data records. [2025-10-07T22:41:41.048283] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-10-07T22:41:41.053523] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-07T22:41:41.064420] [DEBUG] [LOCAL ] NCA: Loaded 10064 existing records from primary storage. [2025-10-07T22:41:41.082203] [INFO ] [MAIN ] Derivative Progress: 1197/1748 symbols completed. NAD took 1.3s. Estimated remaining: 3m 32s. Rate: 156.2 symbols/min [2025-10-07T22:41:41.103992] [INFO ] [MAIN ] NCA: Loaded 10064 primary data records. [2025-10-07T22:41:41.104105] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:41.457933] [DEBUG] [LOCAL ] NCV: Loaded 13857 existing records from primary storage. [2025-10-07T22:41:41.462560] [INFO ] [MAIN ] NCV: Loaded 13857 primary data records. [2025-10-07T22:41:41.986181] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:41.987940] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9141 primary records. [2025-10-07T22:41:41.988275] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-07T22:41:42.005807] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-10-07T22:41:42.006433] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-07T22:41:42.008855] [INFO ] [MAIN ] Derivative Progress: 1198/1748 symbols completed. NBB took 1.1s. Estimated remaining: 3m 31s. Rate: 156.0 symbols/min [2025-10-07T22:41:42.030185] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:42.031103] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10064 primary records. [2025-10-07T22:41:42.031300] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-07T22:41:42.050880] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-10-07T22:41:42.065090] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-07T22:41:42.067233] [INFO ] [MAIN ] Derivative Progress: 1199/1748 symbols completed. NCA took 1.1s. Estimated remaining: 3m 31s. Rate: 156.2 symbols/min [2025-10-07T22:41:42.065031] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:42.068094] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13857 primary records. [2025-10-07T22:41:42.068160] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-07T22:41:42.083251] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-10-07T22:41:42.083314] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-07T22:41:42.085447] [INFO ] [MAIN ] Derivative Progress: 1200/1748 symbols completed. NCV took 1.0s. Estimated remaining: 3m 30s. Rate: 156.3 symbols/min [2025-10-07T22:41:42.085888] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:42.086043] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:42.085982] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:42.108378] [DEBUG] [LOCAL ] NCZ: Loaded 12108 existing records from primary storage. [2025-10-07T22:41:42.108592] [INFO ] [MAIN ] NCZ: Loaded 12108 primary data records. [2025-10-07T22:41:42.186499] [DEBUG] [LOCAL ] NFJ: Loaded 20463 existing records from primary storage. [2025-10-07T22:41:42.202611] [INFO ] [MAIN ] NFJ: Loaded 20463 primary data records. [2025-10-07T22:41:42.350377] [DEBUG] [LOCAL ] NEA: Loaded 35491 existing records from primary storage. [2025-10-07T22:41:42.365843] [INFO ] [MAIN ] NEA: Loaded 35491 primary data records. [2025-10-07T22:41:43.111825] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:43.115592] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 12108 primary records. [2025-10-07T22:41:43.124887] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-07T22:41:43.141348] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:43.145069] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20463 primary records. [2025-10-07T22:41:43.145526] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-07T22:41:43.163567] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-10-07T22:41:43.164151] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-07T22:41:43.174145] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:43.173568] [INFO ] [MAIN ] Derivative Progress: 1201/1748 symbols completed. NCZ took 1.1s. Estimated remaining: 3m 30s. Rate: 156.0 symbols/min [2025-10-07T22:41:43.174351] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:43.176297] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35491 primary records. [2025-10-07T22:41:43.184804] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-07T22:41:43.188849] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-10-07T22:41:43.196394] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-07T22:41:43.199124] [INFO ] [MAIN ] Derivative Progress: 1202/1748 symbols completed. NFJ took 1.1s. Estimated remaining: 3m 30s. Rate: 156.2 symbols/min [2025-10-07T22:41:43.199314] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:43.216267] [DEBUG] [LOCAL ] NIE: Loaded 11930 existing records from primary storage. [2025-10-07T22:41:43.217245] [INFO ] [MAIN ] NIE: Loaded 11930 primary data records. [2025-10-07T22:41:43.251944] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-10-07T22:41:43.264151] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-07T22:41:43.278916] [INFO ] [MAIN ] Derivative Progress: 1203/1748 symbols completed. NEA took 1.2s. Estimated remaining: 3m 29s. Rate: 156.3 symbols/min [2025-10-07T22:41:43.251838] [DEBUG] [LOCAL ] NIM: Loaded 3982 existing records from primary storage. [2025-10-07T22:41:43.299042] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:43.315468] [INFO ] [MAIN ] NIM: Loaded 3982 primary data records. [2025-10-07T22:41:43.496200] [DEBUG] [LOCAL ] NKX: Loaded 13597 existing records from primary storage. [2025-10-07T22:41:43.632344] [INFO ] [MAIN ] NKX: Loaded 13597 primary data records. [2025-10-07T22:41:44.228576] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:44.229532] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11930 primary records. [2025-10-07T22:41:44.229975] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-07T22:41:44.249099] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-10-07T22:41:44.250160] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-07T22:41:44.252525] [INFO ] [MAIN ] Derivative Progress: 1204/1748 symbols completed. NIE took 1.1s. Estimated remaining: 3m 29s. Rate: 156.1 symbols/min [2025-10-07T22:41:44.252916] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:44.267614] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:44.269811] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 3982 primary records. [2025-10-07T22:41:44.270126] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-07T22:41:44.279774] [DEBUG] [LOCAL ] NMI: Loaded 4057 existing records from primary storage. [2025-10-07T22:41:44.283636] [INFO ] [MAIN ] NMI: Loaded 4057 primary data records. [2025-10-07T22:41:44.390125] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-10-07T22:41:44.417242] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-07T22:41:44.417613] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:44.421255] [INFO ] [MAIN ] Derivative Progress: 1205/1748 symbols completed. NIM took 1.2s. Estimated remaining: 3m 29s. Rate: 156.1 symbols/min [2025-10-07T22:41:44.418512] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13597 primary records. [2025-10-07T22:41:44.421677] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:44.427355] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-07T22:41:44.516321] [DEBUG] [LOCAL ] NMS: Loaded 2824 existing records from primary storage. [2025-10-07T22:41:44.636800] [INFO ] [MAIN ] NMS: Loaded 2824 primary data records. [2025-10-07T22:41:44.720527] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-10-07T22:41:44.754019] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-07T22:41:44.772365] [INFO ] [MAIN ] Derivative Progress: 1206/1748 symbols completed. NKX took 1.5s. Estimated remaining: 3m 28s. Rate: 156.2 symbols/min [2025-10-07T22:41:44.805874] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:44.957965] [DEBUG] [LOCAL ] NMT: Loaded 2859 existing records from primary storage. [2025-10-07T22:41:44.958456] [INFO ] [MAIN ] NMT: Loaded 2859 primary data records. [2025-10-07T22:41:45.133908] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:45.294585] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4057 primary records. [2025-10-07T22:41:45.295749] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-07T22:41:45.314978] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-10-07T22:41:45.315784] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-07T22:41:45.318507] [INFO ] [MAIN ] Derivative Progress: 1207/1748 symbols completed. NMI took 1.1s. Estimated remaining: 3m 28s. Rate: 156.1 symbols/min [2025-10-07T22:41:45.319735] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:45.334254] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:45.335370] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2824 primary records. [2025-10-07T22:41:45.335497] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-07T22:41:45.359310] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-10-07T22:41:45.359907] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-07T22:41:45.362300] [INFO ] [MAIN ] Derivative Progress: 1208/1748 symbols completed. NMS took 0.9s. Estimated remaining: 3m 27s. Rate: 156.2 symbols/min [2025-10-07T22:41:45.362581] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:45.371685] [DEBUG] [LOCAL ] NMZ: Loaded 21641 existing records from primary storage. [2025-10-07T22:41:45.371973] [INFO ] [MAIN ] NMZ: Loaded 21641 primary data records. [2025-10-07T22:41:45.462851] [DEBUG] [LOCAL ] NNY: Loaded 5632 existing records from primary storage. [2025-10-07T22:41:45.474509] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:41:45.493682] [INFO ] [MAIN ] NNY: Loaded 5632 primary data records. [2025-10-07T22:41:45.486049] [INFO ] [MAIN ] NMT: Generated 1793 derivative records from 2859 primary records. [2025-10-07T22:41:45.497184] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-07T22:41:45.870265] [DEBUG] [LOCAL ] NMT: Derivative data saved (1793 records). [2025-10-07T22:41:45.876087] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-07T22:41:45.878339] [INFO ] [MAIN ] Derivative Progress: 1209/1748 symbols completed. NMT took 1.1s. Estimated remaining: 3m 27s. Rate: 156.2 symbols/min [2025-10-07T22:41:45.878684] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:46.064098] [DEBUG] [LOCAL ] NPV: Loaded 5136 existing records from primary storage. [2025-10-07T22:41:46.073219] [INFO ] [MAIN ] NPV: Loaded 5136 primary data records. [2025-10-07T22:41:46.399242] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:46.401338] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21641 primary records. [2025-10-07T22:41:46.402342] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-07T22:41:46.442723] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:46.444226] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5632 primary records. [2025-10-07T22:41:46.444719] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-07T22:41:46.457515] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-10-07T22:41:46.465562] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-07T22:41:46.468900] [INFO ] [MAIN ] Derivative Progress: 1210/1748 symbols completed. NMZ took 1.1s. Estimated remaining: 3m 27s. Rate: 156.1 symbols/min [2025-10-07T22:41:46.469325] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:46.485568] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:46.487244] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5136 primary records. [2025-10-07T22:41:46.488295] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-07T22:41:46.488437] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-10-07T22:41:46.491521] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-07T22:41:46.493958] [INFO ] [MAIN ] Derivative Progress: 1211/1748 symbols completed. NNY took 1.1s. Estimated remaining: 3m 26s. Rate: 156.2 symbols/min [2025-10-07T22:41:46.494193] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:46.509875] [DEBUG] [LOCAL ] NQP: Loaded 9263 existing records from primary storage. [2025-10-07T22:41:46.511289] [INFO ] [MAIN ] NQP: Loaded 9263 primary data records. [2025-10-07T22:41:46.632036] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-10-07T22:41:46.638189] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-07T22:41:46.640867] [INFO ] [MAIN ] Derivative Progress: 1212/1748 symbols completed. NPV took 0.8s. Estimated remaining: 3m 26s. Rate: 156.3 symbols/min [2025-10-07T22:41:46.632788] [DEBUG] [LOCAL ] NRK: Loaded 20033 existing records from primary storage. [2025-10-07T22:41:46.646201] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:46.690572] [INFO ] [MAIN ] NRK: Loaded 20033 primary data records. [2025-10-07T22:41:47.048954] [DEBUG] [LOCAL ] NUV: Loaded 23675 existing records from primary storage. [2025-10-07T22:41:47.158561] [INFO ] [MAIN ] NUV: Loaded 23675 primary data records. [2025-10-07T22:41:47.512795] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:47.515496] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9263 primary records. [2025-10-07T22:41:47.516072] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-07T22:41:47.532792] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-10-07T22:41:47.534490] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-07T22:41:47.537551] [INFO ] [MAIN ] Derivative Progress: 1213/1748 symbols completed. NQP took 1.1s. Estimated remaining: 3m 26s. Rate: 156.1 symbols/min [2025-10-07T22:41:47.552263] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:47.552961] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 20033 primary records. [2025-10-07T22:41:47.553123] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-07T22:41:47.569413] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-10-07T22:41:47.569481] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-07T22:41:47.571726] [INFO ] [MAIN ] Derivative Progress: 1214/1748 symbols completed. NRK took 1.1s. Estimated remaining: 3m 25s. Rate: 156.2 symbols/min [2025-10-07T22:41:47.587189] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:47.587754] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23675 primary records. [2025-10-07T22:41:47.587815] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-07T22:41:47.603560] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-10-07T22:41:47.603621] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-07T22:41:47.605712] [INFO ] [MAIN ] Derivative Progress: 1215/1748 symbols completed. NUV took 1.0s. Estimated remaining: 3m 25s. Rate: 156.4 symbols/min [2025-10-07T22:41:47.606072] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:47.606164] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:47.606432] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:47.616735] [DEBUG] [LOCAL ] NXC: Loaded 4130 existing records from primary storage. [2025-10-07T22:41:47.617043] [INFO ] [MAIN ] NXC: Loaded 4130 primary data records. [2025-10-07T22:41:47.657225] [DEBUG] [LOCAL ] NUW: Loaded 7179 existing records from primary storage. [2025-10-07T22:41:47.684578] [INFO ] [MAIN ] NUW: Loaded 7179 primary data records. [2025-10-07T22:41:47.913750] [DEBUG] [LOCAL ] NVG: Loaded 27429 existing records from primary storage. [2025-10-07T22:41:48.059800] [INFO ] [MAIN ] NVG: Loaded 27429 primary data records. [2025-10-07T22:41:48.598806] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:48.600098] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4130 primary records. [2025-10-07T22:41:48.600298] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-07T22:41:48.625024] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-10-07T22:41:48.634810] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-07T22:41:48.637396] [INFO ] [MAIN ] Derivative Progress: 1216/1748 symbols completed. NXC took 1.0s. Estimated remaining: 3m 24s. Rate: 156.1 symbols/min [2025-10-07T22:41:48.637561] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:48.635143] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:48.638756] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7179 primary records. [2025-10-07T22:41:48.638950] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-07T22:41:48.662128] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-10-07T22:41:48.662349] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-07T22:41:48.664841] [INFO ] [MAIN ] Derivative Progress: 1217/1748 symbols completed. NUW took 1.1s. Estimated remaining: 3m 24s. Rate: 156.3 symbols/min [2025-10-07T22:41:48.672985] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:48.678890] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:48.679567] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27429 primary records. [2025-10-07T22:41:48.680069] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-07T22:41:48.685166] [DEBUG] [LOCAL ] NXJ: Loaded 14999 existing records from primary storage. [2025-10-07T22:41:48.686891] [INFO ] [MAIN ] NXJ: Loaded 14999 primary data records. [2025-10-07T22:41:48.699626] [DEBUG] [LOCAL ] NXN: Loaded 2320 existing records from primary storage. [2025-10-07T22:41:48.711712] [INFO ] [MAIN ] NXN: Loaded 2320 primary data records. [2025-10-07T22:41:48.888051] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-10-07T22:41:48.908349] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-07T22:41:48.911146] [INFO ] [MAIN ] Derivative Progress: 1218/1748 symbols completed. NVG took 1.3s. Estimated remaining: 3m 23s. Rate: 156.3 symbols/min [2025-10-07T22:41:48.916585] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:49.308998] [DEBUG] [LOCAL ] NXP: Loaded 12442 existing records from primary storage. [2025-10-07T22:41:49.310432] [INFO ] [MAIN ] NXP: Loaded 12442 primary data records. [2025-10-07T22:41:49.695050] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:49.701947] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14999 primary records. [2025-10-07T22:41:49.702132] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-07T22:41:49.700981] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:49.717341] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2320 primary records. [2025-10-07T22:41:49.718604] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-07T22:41:49.721879] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-10-07T22:41:49.723212] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-07T22:41:49.725859] [INFO ] [MAIN ] Derivative Progress: 1219/1748 symbols completed. NXJ took 1.1s. Estimated remaining: 3m 23s. Rate: 156.2 symbols/min [2025-10-07T22:41:49.733611] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:49.741810] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-10-07T22:41:49.744674] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-07T22:41:49.747297] [INFO ] [MAIN ] Derivative Progress: 1220/1748 symbols completed. NXN took 1.1s. Estimated remaining: 3m 23s. Rate: 156.3 symbols/min [2025-10-07T22:41:49.747717] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:49.762758] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:49.763609] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12442 primary records. [2025-10-07T22:41:49.763704] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-07T22:41:49.784418] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-10-07T22:41:49.794561] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-07T22:41:49.796889] [INFO ] [MAIN ] Derivative Progress: 1221/1748 symbols completed. NXP took 0.9s. Estimated remaining: 3m 22s. Rate: 156.4 symbols/min [2025-10-07T22:41:49.797135] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:49.798185] [DEBUG] [LOCAL ] OIA: Loaded 13604 existing records from primary storage. [2025-10-07T22:41:49.798425] [INFO ] [MAIN ] OIA: Loaded 13604 primary data records. [2025-10-07T22:41:49.927316] [DEBUG] [LOCAL ] NZF: Loaded 29073 existing records from primary storage. [2025-10-07T22:41:49.927981] [INFO ] [MAIN ] NZF: Loaded 29073 primary data records. [2025-10-07T22:41:49.949110] [DEBUG] [LOCAL ] OPP: Loaded 11698 existing records from primary storage. [2025-10-07T22:41:49.974586] [INFO ] [MAIN ] OPP: Loaded 11698 primary data records. [2025-10-07T22:41:50.776434] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:50.777684] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13604 primary records. [2025-10-07T22:41:50.777927] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-07T22:41:50.797142] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:50.815712] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 29073 primary records. [2025-10-07T22:41:50.818468] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-07T22:41:50.837257] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-10-07T22:41:50.837696] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-07T22:41:50.838075] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:41:50.838965] [INFO ] [MAIN ] OPP: Generated 1793 derivative records from 11698 primary records. [2025-10-07T22:41:50.841735] [INFO ] [MAIN ] Derivative Progress: 1222/1748 symbols completed. OIA took 1.1s. Estimated remaining: 3m 22s. Rate: 156.2 symbols/min [2025-10-07T22:41:50.839072] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-07T22:41:50.851712] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:50.878631] [DEBUG] [LOCAL ] OPP: Derivative data saved (1793 records). [2025-10-07T22:41:50.878957] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-07T22:41:50.878030] [DEBUG] [LOCAL ] PAI: Loaded 2663 existing records from primary storage. [2025-10-07T22:41:50.882784] [INFO ] [MAIN ] PAI: Loaded 2663 primary data records. [2025-10-07T22:41:50.882584] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-10-07T22:41:50.882155] [INFO ] [MAIN ] Derivative Progress: 1223/1748 symbols completed. OPP took 1.1s. Estimated remaining: 3m 22s. Rate: 156.3 symbols/min [2025-10-07T22:41:50.896850] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-07T22:41:50.899490] [INFO ] [MAIN ] Derivative Progress: 1224/1748 symbols completed. NZF took 1.2s. Estimated remaining: 3m 21s. Rate: 156.4 symbols/min [2025-10-07T22:41:50.896975] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:50.922543] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:51.034070] [DEBUG] [LOCAL ] PCF: Loaded 8969 existing records from primary storage. [2025-10-07T22:41:51.098415] [INFO ] [MAIN ] PCF: Loaded 8969 primary data records. [2025-10-07T22:41:51.311099] [DEBUG] [LOCAL ] PAM: Loaded 28079 existing records from primary storage. [2025-10-07T22:41:51.323223] [INFO ] [MAIN ] PAM: Loaded 28079 primary data records. [2025-10-07T22:41:51.913533] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:51.915239] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2663 primary records. [2025-10-07T22:41:51.915559] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-07T22:41:51.952199] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:51.951973] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-10-07T22:41:51.953175] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8969 primary records. [2025-10-07T22:41:51.953400] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-07T22:41:51.953630] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-07T22:41:51.956101] [INFO ] [MAIN ] Derivative Progress: 1225/1748 symbols completed. PAI took 1.1s. Estimated remaining: 3m 21s. Rate: 156.2 symbols/min [2025-10-07T22:41:51.957511] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:51.974772] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-10-07T22:41:51.975108] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-07T22:41:51.990390] [INFO ] [MAIN ] Derivative Progress: 1226/1748 symbols completed. PCF took 1.1s. Estimated remaining: 3m 20s. Rate: 156.3 symbols/min [2025-10-07T22:41:51.990799] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:51.991725] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:51.991617] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 28079 primary records. [2025-10-07T22:41:51.992341] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-07T22:41:52.009487] [DEBUG] [LOCAL ] PCM: Loaded 6722 existing records from primary storage. [2025-10-07T22:41:52.012843] [INFO ] [MAIN ] PCM: Loaded 6722 primary data records. [2025-10-07T22:41:52.137490] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-10-07T22:41:52.139069] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-07T22:41:52.162133] [INFO ] [MAIN ] Derivative Progress: 1227/1748 symbols completed. PAM took 1.3s. Estimated remaining: 3m 20s. Rate: 156.4 symbols/min [2025-10-07T22:41:52.168006] [DEBUG] [LOCAL ] PCN: Loaded 24648 existing records from primary storage. [2025-10-07T22:41:52.191091] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:52.198450] [INFO ] [MAIN ] PCN: Loaded 24648 primary data records. [2025-10-07T22:41:52.458396] [DEBUG] [LOCAL ] PCQ: Loaded 12109 existing records from primary storage. [2025-10-07T22:41:52.464180] [INFO ] [MAIN ] PCQ: Loaded 12109 primary data records. [2025-10-07T22:41:53.037281] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:53.039269] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6722 primary records. [2025-10-07T22:41:53.039554] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-07T22:41:53.060290] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-10-07T22:41:53.060531] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-07T22:41:53.062917] [INFO ] [MAIN ] Derivative Progress: 1228/1748 symbols completed. PCM took 1.1s. Estimated remaining: 3m 20s. Rate: 156.2 symbols/min [2025-10-07T22:41:53.078166] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:53.078945] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24648 primary records. [2025-10-07T22:41:53.079156] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-07T22:41:53.096433] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-10-07T22:41:53.096676] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-07T22:41:53.099220] [INFO ] [MAIN ] Derivative Progress: 1229/1748 symbols completed. PCN took 1.1s. Estimated remaining: 3m 19s. Rate: 156.3 symbols/min [2025-10-07T22:41:53.115032] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:53.115716] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12109 primary records. [2025-10-07T22:41:53.115780] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-07T22:41:53.130672] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-10-07T22:41:53.130746] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-07T22:41:53.133038] [INFO ] [MAIN ] Derivative Progress: 1230/1748 symbols completed. PCQ took 0.9s. Estimated remaining: 3m 19s. Rate: 156.4 symbols/min [2025-10-07T22:41:53.133487] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:53.134134] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:53.133690] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:53.167697] [DEBUG] [LOCAL ] PDT: Loaded 17417 existing records from primary storage. [2025-10-07T22:41:53.167976] [INFO ] [MAIN ] PDT: Loaded 17417 primary data records. [2025-10-07T22:41:53.282987] [DEBUG] [LOCAL ] PDO: Loaded 31297 existing records from primary storage. [2025-10-07T22:41:53.300447] [INFO ] [MAIN ] PDO: Loaded 31297 primary data records. [2025-10-07T22:41:53.649021] [DEBUG] [LOCAL ] PDI: Loaded 50078 existing records from primary storage. [2025-10-07T22:41:53.672610] [INFO ] [MAIN ] PDI: Loaded 50078 primary data records. [2025-10-07T22:41:54.224949] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:54.238550] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17417 primary records. [2025-10-07T22:41:54.238831] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-07T22:41:54.240433] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:54.248545] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31297 primary records. [2025-10-07T22:41:54.252578] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-07T22:41:54.275554] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-10-07T22:41:54.276319] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-07T22:41:54.278962] [INFO ] [MAIN ] Derivative Progress: 1231/1748 symbols completed. PDO took 1.1s. Estimated remaining: 3m 19s. Rate: 156.2 symbols/min [2025-10-07T22:41:54.279679] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:54.281350] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-10-07T22:41:54.281578] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-07T22:41:54.284367] [INFO ] [MAIN ] Derivative Progress: 1232/1748 symbols completed. PDT took 1.2s. Estimated remaining: 3m 18s. Rate: 156.3 symbols/min [2025-10-07T22:41:54.287816] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:54.317473] [DEBUG] [LOCAL ] PEO: Loaded 11173 existing records from primary storage. [2025-10-07T22:41:54.317827] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:54.318691] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50078 primary records. [2025-10-07T22:41:54.318752] [INFO ] [MAIN ] PEO: Loaded 11173 primary data records. [2025-10-07T22:41:54.318922] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-07T22:41:54.419532] [DEBUG] [LOCAL ] PFD: Loaded 5325 existing records from primary storage. [2025-10-07T22:41:54.439503] [INFO ] [MAIN ] PFD: Loaded 5325 primary data records. [2025-10-07T22:41:54.537317] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-10-07T22:41:54.549489] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-07T22:41:54.579674] [INFO ] [MAIN ] Derivative Progress: 1233/1748 symbols completed. PDI took 1.4s. Estimated remaining: 3m 18s. Rate: 156.3 symbols/min [2025-10-07T22:41:54.597822] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:54.984344] [DEBUG] [LOCAL ] PFL: Loaded 13896 existing records from primary storage. [2025-10-07T22:41:54.985015] [INFO ] [MAIN ] PFL: Loaded 13896 primary data records. [2025-10-07T22:41:55.338586] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:55.340470] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11173 primary records. [2025-10-07T22:41:55.340852] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-07T22:41:55.368728] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-07T22:41:55.371720] [INFO ] [MAIN ] PFD: Generated 1791 derivative records from 5325 primary records. [2025-10-07T22:41:55.372178] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-07T22:41:55.389024] [DEBUG] [LOCAL ] PFD: Derivative data saved (1791 records). [2025-10-07T22:41:55.390003] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-10-07T22:41:55.390105] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-07T22:41:55.392909] [INFO ] [MAIN ] Derivative Progress: 1234/1748 symbols completed. PFD took 1.1s. Estimated remaining: 3m 17s. Rate: 156.2 symbols/min [2025-10-07T22:41:55.390360] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-07T22:41:55.395625] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:55.395780] [INFO ] [MAIN ] Derivative Progress: 1235/1748 symbols completed. PEO took 1.1s. Estimated remaining: 3m 17s. Rate: 156.3 symbols/min [2025-10-07T22:41:55.396507] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:55.414769] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:55.415723] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13896 primary records. [2025-10-07T22:41:55.415953] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-07T22:41:55.438509] [DEBUG] [LOCAL ] PFO: Loaded 6045 existing records from primary storage. [2025-10-07T22:41:55.439754] [INFO ] [MAIN ] PFO: Loaded 6045 primary data records. [2025-10-07T22:41:55.526969] [DEBUG] [LOCAL ] PFN: Loaded 22048 existing records from primary storage. [2025-10-07T22:41:55.526433] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-10-07T22:41:55.527193] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-07T22:41:55.532434] [INFO ] [MAIN ] PFN: Loaded 22048 primary data records. [2025-10-07T22:41:55.539834] [INFO ] [MAIN ] Derivative Progress: 1236/1748 symbols completed. PFL took 0.9s. Estimated remaining: 3m 16s. Rate: 156.4 symbols/min [2025-10-07T22:41:55.545389] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:55.740224] [DEBUG] [LOCAL ] PGP: Loaded 5630 existing records from primary storage. [2025-10-07T22:41:55.891627] [INFO ] [MAIN ] PGP: Loaded 5630 primary data records. [2025-10-07T22:41:56.440847] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:56.441862] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 6045 primary records. [2025-10-07T22:41:56.442208] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-07T22:41:56.493510] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:56.493624] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-10-07T22:41:56.494505] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 22048 primary records. [2025-10-07T22:41:56.495009] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-07T22:41:56.494925] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:56.495543] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-07T22:41:56.496763] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5630 primary records. [2025-10-07T22:41:56.497204] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-07T22:41:56.511325] [INFO ] [MAIN ] Derivative Progress: 1237/1748 symbols completed. PFO took 1.1s. Estimated remaining: 3m 16s. Rate: 156.2 symbols/min [2025-10-07T22:41:56.516599] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:56.516179] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-10-07T22:41:56.524720] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-07T22:41:56.527221] [INFO ] [MAIN ] Derivative Progress: 1238/1748 symbols completed. PFN took 1.1s. Estimated remaining: 3m 16s. Rate: 156.3 symbols/min [2025-10-07T22:41:56.530137] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:56.540184] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-10-07T22:41:56.540418] [DEBUG] [LOCAL ] PGZ: Loaded 5481 existing records from primary storage. [2025-10-07T22:41:56.540676] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-07T22:41:56.542781] [INFO ] [MAIN ] Derivative Progress: 1239/1748 symbols completed. PGP took 1.0s. Estimated remaining: 3m 15s. Rate: 156.5 symbols/min [2025-10-07T22:41:56.542966] [INFO ] [MAIN ] PGZ: Loaded 5481 primary data records. [2025-10-07T22:41:56.543149] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:56.626527] [DEBUG] [LOCAL ] PHD: Loaded 10759 existing records from primary storage. [2025-10-07T22:41:56.643422] [INFO ] [MAIN ] PHD: Loaded 10759 primary data records. [2025-10-07T22:41:56.813364] [DEBUG] [LOCAL ] PHK: Loaded 26549 existing records from primary storage. [2025-10-07T22:41:56.850966] [INFO ] [MAIN ] PHK: Loaded 26549 primary data records. [2025-10-07T22:41:57.556812] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:57.557927] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5481 primary records. [2025-10-07T22:41:57.558027] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-07T22:41:57.572465] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:57.586360] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 10759 primary records. [2025-10-07T22:41:57.586731] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-10-07T22:41:57.587994] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-10-07T22:41:57.588133] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-07T22:41:57.590874] [INFO ] [MAIN ] Derivative Progress: 1240/1748 symbols completed. PGZ took 1.1s. Estimated remaining: 3m 15s. Rate: 156.2 symbols/min [2025-10-07T22:41:57.593517] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:57.620758] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:57.622044] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26549 primary records. [2025-10-07T22:41:57.622470] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-07T22:41:57.625591] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-10-07T22:41:57.628707] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-10-07T22:41:57.631425] [INFO ] [MAIN ] Derivative Progress: 1241/1748 symbols completed. PHD took 1.1s. Estimated remaining: 3m 15s. Rate: 156.3 symbols/min [2025-10-07T22:41:57.631877] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:57.628588] [DEBUG] [LOCAL ] PIM: Loaded 4797 existing records from primary storage. [2025-10-07T22:41:57.640046] [INFO ] [MAIN ] PIM: Loaded 4797 primary data records. [2025-10-07T22:41:57.757306] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-10-07T22:41:57.757519] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-07T22:41:57.759606] [INFO ] [MAIN ] Derivative Progress: 1242/1748 symbols completed. PHK took 1.2s. Estimated remaining: 3m 14s. Rate: 156.4 symbols/min [2025-10-07T22:41:57.760221] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:57.808186] [DEBUG] [LOCAL ] PML: Loaded 21482 existing records from primary storage. [2025-10-07T22:41:57.844790] [INFO ] [MAIN ] PML: Loaded 21482 primary data records. [2025-10-07T22:41:58.021073] [DEBUG] [LOCAL ] PMM: Loaded 10674 existing records from primary storage. [2025-10-07T22:41:58.044527] [INFO ] [MAIN ] PMM: Loaded 10674 primary data records. [2025-10-07T22:41:58.621427] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:58.622440] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4797 primary records. [2025-10-07T22:41:58.623816] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-07T22:41:58.640378] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-10-07T22:41:58.640525] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-07T22:41:58.643103] [INFO ] [MAIN ] Derivative Progress: 1243/1748 symbols completed. PIM took 1.0s. Estimated remaining: 3m 14s. Rate: 156.3 symbols/min [2025-10-07T22:41:58.660570] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:58.662001] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21482 primary records. [2025-10-07T22:41:58.662696] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-07T22:41:58.685133] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:58.688295] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10674 primary records. [2025-10-07T22:41:58.689600] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-07T22:41:58.706552] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-10-07T22:41:58.707054] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-10-07T22:41:58.707139] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-07T22:41:58.707221] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-07T22:41:58.709183] [INFO ] [MAIN ] Derivative Progress: 1244/1748 symbols completed. PMM took 0.9s. Estimated remaining: 3m 13s. Rate: 156.4 symbols/min [2025-10-07T22:41:58.711707] [INFO ] [MAIN ] Derivative Progress: 1245/1748 symbols completed. PML took 1.1s. Estimated remaining: 3m 13s. Rate: 156.5 symbols/min [2025-10-07T22:41:58.712322] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:58.712433] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:58.712541] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:58.722895] [DEBUG] [LOCAL ] PNI: Loaded 6798 existing records from primary storage. [2025-10-07T22:41:58.723048] [INFO ] [MAIN ] PNI: Loaded 6798 primary data records. [2025-10-07T22:41:58.841979] [DEBUG] [LOCAL ] PMO: Loaded 10089 existing records from primary storage. [2025-10-07T22:41:58.848834] [DEBUG] [LOCAL ] PPT: Loaded 20071 existing records from primary storage. [2025-10-07T22:41:58.859220] [INFO ] [MAIN ] PPT: Loaded 20071 primary data records. [2025-10-07T22:41:58.843190] [INFO ] [MAIN ] PMO: Loaded 10089 primary data records. [2025-10-07T22:41:59.722081] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:59.723114] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6798 primary records. [2025-10-07T22:41:59.724113] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-07T22:41:59.754701] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:59.756351] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10089 primary records. [2025-10-07T22:41:59.756468] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-07T22:41:59.771803] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:41:59.772981] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 20071 primary records. [2025-10-07T22:41:59.779739] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-10-07T22:41:59.783695] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-07T22:41:59.783253] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-07T22:41:59.788574] [INFO ] [MAIN ] Derivative Progress: 1246/1748 symbols completed. PNI took 1.1s. Estimated remaining: 3m 13s. Rate: 156.3 symbols/min [2025-10-07T22:41:59.790097] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-10-07T22:41:59.789042] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:59.790226] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-07T22:41:59.793897] [INFO ] [MAIN ] Derivative Progress: 1247/1748 symbols completed. PMO took 1.1s. Estimated remaining: 3m 12s. Rate: 156.4 symbols/min [2025-10-07T22:41:59.801996] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:59.810038] [DEBUG] [LOCAL ] PRCS: Loaded 2749 existing records from primary storage. [2025-10-07T22:41:59.810897] [INFO ] [MAIN ] PRCS: Loaded 2749 primary data records. [2025-10-07T22:41:59.877933] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-10-07T22:41:59.902911] [DEBUG] [LOCAL ] PSF: Loaded 6979 existing records from primary storage. [2025-10-07T22:41:59.908580] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-07T22:41:59.910786] [INFO ] [MAIN ] Derivative Progress: 1248/1748 symbols completed. PPT took 1.2s. Estimated remaining: 3m 12s. Rate: 156.5 symbols/min [2025-10-07T22:41:59.926467] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:41:59.926803] [INFO ] [MAIN ] PSF: Loaded 6979 primary data records. [2025-10-07T22:42:00.454557] [DEBUG] [LOCAL ] PTY: Loaded 37381 existing records from primary storage. [2025-10-07T22:42:00.455676] [INFO ] [MAIN ] PTY: Loaded 37381 primary data records. [2025-10-07T22:42:00.777465] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:42:00.793063] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:00.793859] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6979 primary records. [2025-10-07T22:42:00.792109] [INFO ] [MAIN ] PRCS: Generated 1793 derivative records from 2749 primary records. [2025-10-07T22:42:00.793961] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-07T22:42:00.794605] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-07T22:42:00.820812] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-10-07T22:42:00.822165] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-07T22:42:00.825175] [INFO ] [MAIN ] Derivative Progress: 1249/1748 symbols completed. PSF took 1.0s. Estimated remaining: 3m 12s. Rate: 156.3 symbols/min [2025-10-07T22:42:00.825848] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:00.829688] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1793 records). [2025-10-07T22:42:00.829793] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-07T22:42:00.832142] [INFO ] [MAIN ] Derivative Progress: 1250/1748 symbols completed. PRCS took 1.0s. Estimated remaining: 3m 11s. Rate: 156.4 symbols/min [2025-10-07T22:42:00.832587] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:00.858292] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:00.859184] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37381 primary records. [2025-10-07T22:42:00.859359] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-07T22:42:00.864568] [DEBUG] [LOCAL ] RCS: Loaded 11963 existing records from primary storage. [2025-10-07T22:42:00.864863] [INFO ] [MAIN ] RCS: Loaded 11963 primary data records. [2025-10-07T22:42:00.918516] [DEBUG] [LOCAL ] RA: Loaded 21836 existing records from primary storage. [2025-10-07T22:42:00.948889] [INFO ] [MAIN ] RA: Loaded 21836 primary data records. [2025-10-07T22:42:00.977244] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-10-07T22:42:00.995496] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-07T22:42:00.997446] [INFO ] [MAIN ] Derivative Progress: 1251/1748 symbols completed. PTY took 1.1s. Estimated remaining: 3m 11s. Rate: 156.5 symbols/min [2025-10-07T22:42:01.008730] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:01.375928] [DEBUG] [LOCAL ] RFI: Loaded 10474 existing records from primary storage. [2025-10-07T22:42:01.376885] [INFO ] [MAIN ] RFI: Loaded 10474 primary data records. [2025-10-07T22:42:01.915105] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:01.917016] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11963 primary records. [2025-10-07T22:42:01.917532] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-07T22:42:01.939180] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-10-07T22:42:01.952126] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-07T22:42:01.961016] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:01.963510] [INFO ] [MAIN ] Derivative Progress: 1252/1748 symbols completed. RCS took 1.1s. Estimated remaining: 3m 10s. Rate: 156.3 symbols/min [2025-10-07T22:42:01.965203] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21836 primary records. [2025-10-07T22:42:01.965875] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:01.965595] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-07T22:42:01.994820] [DEBUG] [LOCAL ] RGT: Loaded 2723 existing records from primary storage. [2025-10-07T22:42:01.996882] [INFO ] [MAIN ] RGT: Loaded 2723 primary data records. [2025-10-07T22:42:02.057531] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-10-07T22:42:02.050486] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:02.085534] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10474 primary records. [2025-10-07T22:42:02.092339] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-07T22:42:02.092452] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-07T22:42:02.106480] [INFO ] [MAIN ] Derivative Progress: 1253/1748 symbols completed. RA took 1.3s. Estimated remaining: 3m 10s. Rate: 156.4 symbols/min [2025-10-07T22:42:02.136571] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:02.183299] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-10-07T22:42:02.203828] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-07T22:42:02.205867] [INFO ] [MAIN ] Derivative Progress: 1254/1748 symbols completed. RFI took 1.2s. Estimated remaining: 3m 9s. Rate: 156.5 symbols/min [2025-10-07T22:42:02.207892] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:02.357069] [DEBUG] [LOCAL ] RIV: Loaded 12477 existing records from primary storage. [2025-10-07T22:42:02.358278] [INFO ] [MAIN ] RIV: Loaded 12477 primary data records. [2025-10-07T22:42:02.486223] [DEBUG] [LOCAL ] RMT: Loaded 17377 existing records from primary storage. [2025-10-07T22:42:02.502881] [INFO ] [MAIN ] RMT: Loaded 17377 primary data records. [2025-10-07T22:42:03.010418] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:03.011624] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2723 primary records. [2025-10-07T22:42:03.012736] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-07T22:42:03.031133] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-10-07T22:42:03.031420] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-07T22:42:03.033985] [INFO ] [MAIN ] Derivative Progress: 1255/1748 symbols completed. RGT took 1.1s. Estimated remaining: 3m 9s. Rate: 156.3 symbols/min [2025-10-07T22:42:03.034177] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:03.062062] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:03.063206] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 12477 primary records. [2025-10-07T22:42:03.064212] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-07T22:42:03.072120] [DEBUG] [LOCAL ] RNP: Loaded 16007 existing records from primary storage. [2025-10-07T22:42:03.072334] [INFO ] [MAIN ] RNP: Loaded 16007 primary data records. [2025-10-07T22:42:03.167750] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:03.180916] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17377 primary records. [2025-10-07T22:42:03.193061] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-07T22:42:03.219914] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-10-07T22:42:03.221550] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-07T22:42:03.234736] [INFO ] [MAIN ] Derivative Progress: 1256/1748 symbols completed. RIV took 1.1s. Estimated remaining: 3m 9s. Rate: 156.4 symbols/min [2025-10-07T22:42:03.240780] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:03.275500] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-10-07T22:42:03.301934] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-07T22:42:03.307430] [INFO ] [MAIN ] Derivative Progress: 1257/1748 symbols completed. RMT took 1.1s. Estimated remaining: 3m 8s. Rate: 156.5 symbols/min [2025-10-07T22:42:03.443268] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:03.467762] [DEBUG] [LOCAL ] RSF: Loaded 4310 existing records from primary storage. [2025-10-07T22:42:03.468350] [INFO ] [MAIN ] RSF: Loaded 4310 primary data records. [2025-10-07T22:42:03.582126] [DEBUG] [LOCAL ] RQI: Loaded 29076 existing records from primary storage. [2025-10-07T22:42:03.608946] [INFO ] [MAIN ] RQI: Loaded 29076 primary data records. [2025-10-07T22:42:03.968039] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:04.010306] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 16007 primary records. [2025-10-07T22:42:04.122580] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-07T22:42:04.155354] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-10-07T22:42:04.155618] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-07T22:42:04.158599] [INFO ] [MAIN ] Derivative Progress: 1258/1748 symbols completed. RNP took 1.1s. Estimated remaining: 3m 8s. Rate: 156.3 symbols/min [2025-10-07T22:42:04.177890] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:04.178672] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4310 primary records. [2025-10-07T22:42:04.178968] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-07T22:42:04.207986] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:04.209464] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 29076 primary records. [2025-10-07T22:42:04.209848] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-07T22:42:04.212390] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-10-07T22:42:04.219792] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-07T22:42:04.226435] [INFO ] [MAIN ] Derivative Progress: 1259/1748 symbols completed. RSF took 0.8s. Estimated remaining: 3m 8s. Rate: 156.4 symbols/min [2025-10-07T22:42:04.231032] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-10-07T22:42:04.231107] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-07T22:42:04.233321] [INFO ] [MAIN ] Derivative Progress: 1260/1748 symbols completed. RQI took 1.0s. Estimated remaining: 3m 7s. Rate: 156.6 symbols/min [2025-10-07T22:42:04.233869] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:04.233799] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:04.234502] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:04.268308] [DEBUG] [LOCAL ] RVT: Loaded 26409 existing records from primary storage. [2025-10-07T22:42:04.268484] [INFO ] [MAIN ] RVT: Loaded 26409 primary data records. [2025-10-07T22:42:04.492757] [DEBUG] [LOCAL ] RY: Loaded 47824 existing records from primary storage. [2025-10-07T22:42:04.493425] [DEBUG] [LOCAL ] RXO: Loaded 48034 existing records from primary storage. [2025-10-07T22:42:04.606292] [INFO ] [MAIN ] RXO: Loaded 48034 primary data records. [2025-10-07T22:42:04.606991] [INFO ] [MAIN ] RY: Loaded 47824 primary data records. [2025-10-07T22:42:05.229038] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:05.230003] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 26409 primary records. [2025-10-07T22:42:05.230484] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-07T22:42:05.264835] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:05.266517] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 48034 primary records. [2025-10-07T22:42:05.267368] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-07T22:42:05.267967] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-10-07T22:42:05.269337] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-07T22:42:05.285346] [INFO ] [MAIN ] Derivative Progress: 1261/1748 symbols completed. RVT took 1.1s. Estimated remaining: 3m 7s. Rate: 156.4 symbols/min [2025-10-07T22:42:05.289291] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:05.299249] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-10-07T22:42:05.304615] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-07T22:42:05.304951] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:05.308185] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47824 primary records. [2025-10-07T22:42:05.308384] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-07T22:42:05.307335] [INFO ] [MAIN ] Derivative Progress: 1262/1748 symbols completed. RXO took 1.1s. Estimated remaining: 3m 6s. Rate: 156.5 symbols/min [2025-10-07T22:42:05.308557] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:05.327405] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-10-07T22:42:05.327611] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-07T22:42:05.329980] [INFO ] [MAIN ] Derivative Progress: 1263/1748 symbols completed. RY took 1.1s. Estimated remaining: 3m 6s. Rate: 156.6 symbols/min [2025-10-07T22:42:05.330265] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:05.372766] [DEBUG] [LOCAL ] RYAM: Loaded 35091 existing records from primary storage. [2025-10-07T22:42:05.373044] [INFO ] [MAIN ] RYAM: Loaded 35091 primary data records. [2025-10-07T22:42:05.455056] [DEBUG] [LOCAL ] RYI: Loaded 21623 existing records from primary storage. [2025-10-07T22:42:05.470704] [INFO ] [MAIN ] RYI: Loaded 21623 primary data records. [2025-10-07T22:42:05.577895] [DEBUG] [LOCAL ] RYAN: Loaded 44622 existing records from primary storage. [2025-10-07T22:42:05.693039] [INFO ] [MAIN ] RYAN: Loaded 44622 primary data records. [2025-10-07T22:42:06.347923] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:06.348779] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35091 primary records. [2025-10-07T22:42:06.348870] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-07T22:42:06.368692] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-10-07T22:42:06.368939] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-07T22:42:06.370865] [INFO ] [MAIN ] Derivative Progress: 1264/1748 symbols completed. RYAM took 1.1s. Estimated remaining: 3m 6s. Rate: 156.4 symbols/min [2025-10-07T22:42:06.371223] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:06.385717] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:06.386779] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21623 primary records. [2025-10-07T22:42:06.388785] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-07T22:42:06.410140] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-10-07T22:42:06.418417] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-07T22:42:06.426143] [INFO ] [MAIN ] Derivative Progress: 1265/1748 symbols completed. RYI took 1.1s. Estimated remaining: 3m 5s. Rate: 156.5 symbols/min [2025-10-07T22:42:06.423881] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:06.427320] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44622 primary records. [2025-10-07T22:42:06.426464] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:06.427448] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-07T22:42:06.445932] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-10-07T22:42:06.446137] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-07T22:42:06.448358] [INFO ] [MAIN ] Derivative Progress: 1266/1748 symbols completed. RYAN took 1.1s. Estimated remaining: 3m 5s. Rate: 156.6 symbols/min [2025-10-07T22:42:06.448686] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:06.452996] [DEBUG] [LOCAL ] RZB: Loaded 6054 existing records from primary storage. [2025-10-07T22:42:06.463069] [INFO ] [MAIN ] RZB: Loaded 6054 primary data records. [2025-10-07T22:42:06.579385] [DEBUG] [LOCAL ] RZC: Loaded 6766 existing records from primary storage. [2025-10-07T22:42:06.583319] [DEBUG] [LOCAL ] RYN: Loaded 45524 existing records from primary storage. [2025-10-07T22:42:06.583633] [INFO ] [MAIN ] RZC: Loaded 6766 primary data records. [2025-10-07T22:42:06.584247] [INFO ] [MAIN ] RYN: Loaded 45524 primary data records. [2025-10-07T22:42:07.453150] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:07.454367] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6054 primary records. [2025-10-07T22:42:07.454702] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-07T22:42:07.476147] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-10-07T22:42:07.476300] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-07T22:42:07.492887] [INFO ] [MAIN ] Derivative Progress: 1267/1748 symbols completed. RZB took 1.1s. Estimated remaining: 3m 5s. Rate: 156.4 symbols/min [2025-10-07T22:42:07.493491] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:07.494026] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:07.497291] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6766 primary records. [2025-10-07T22:42:07.497575] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-07T22:42:07.525521] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:07.527168] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45524 primary records. [2025-10-07T22:42:07.527771] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-07T22:42:07.549933] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-10-07T22:42:07.547869] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-10-07T22:42:07.550189] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-07T22:42:07.550273] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-07T22:42:07.552821] [INFO ] [MAIN ] Derivative Progress: 1268/1748 symbols completed. RZC took 1.1s. Estimated remaining: 3m 4s. Rate: 156.5 symbols/min [2025-10-07T22:42:07.555754] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:07.555879] [INFO ] [MAIN ] Derivative Progress: 1269/1748 symbols completed. RYN took 1.2s. Estimated remaining: 3m 4s. Rate: 156.6 symbols/min [2025-10-07T22:42:07.556403] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:07.569451] [DEBUG] [LOCAL ] SABA: Loaded 9275 existing records from primary storage. [2025-10-07T22:42:07.569754] [INFO ] [MAIN ] SABA: Loaded 9275 primary data records. [2025-10-07T22:42:07.780836] [DEBUG] [LOCAL ] S: Loaded 53532 existing records from primary storage. [2025-10-07T22:42:07.813071] [INFO ] [MAIN ] S: Loaded 53532 primary data records. [2025-10-07T22:42:07.819212] [DEBUG] [LOCAL ] SA: Loaded 43765 existing records from primary storage. [2025-10-07T22:42:07.935953] [INFO ] [MAIN ] SA: Loaded 43765 primary data records. [2025-10-07T22:42:08.562182] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:42:08.564129] [INFO ] [MAIN ] SABA: Generated 1793 derivative records from 9275 primary records. [2025-10-07T22:42:08.564738] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-07T22:42:08.583665] [DEBUG] [LOCAL ] SABA: Derivative data saved (1793 records). [2025-10-07T22:42:08.584104] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-07T22:42:08.586042] [INFO ] [MAIN ] Derivative Progress: 1270/1748 symbols completed. SABA took 1.0s. Estimated remaining: 3m 3s. Rate: 156.4 symbols/min [2025-10-07T22:42:08.586308] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:08.604140] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:08.605141] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53532 primary records. [2025-10-07T22:42:08.605507] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-07T22:42:08.647308] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-07T22:42:08.647402] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-07T22:42:08.647155] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:08.649811] [INFO ] [MAIN ] Derivative Progress: 1271/1748 symbols completed. S took 1.2s. Estimated remaining: 3m 3s. Rate: 156.5 symbols/min [2025-10-07T22:42:08.649972] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:08.651079] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43765 primary records. [2025-10-07T22:42:08.651666] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-07T22:42:08.676333] [DEBUG] [LOCAL ] SAFE: Loaded 30290 existing records from primary storage. [2025-10-07T22:42:08.679078] [INFO ] [MAIN ] SAFE: Loaded 30290 primary data records. [2025-10-07T22:42:08.721993] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-07T22:42:08.762724] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-07T22:42:08.793981] [INFO ] [MAIN ] Derivative Progress: 1272/1748 symbols completed. SA took 1.2s. Estimated remaining: 3m 2s. Rate: 156.6 symbols/min [2025-10-07T22:42:08.806993] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:08.816859] [DEBUG] [LOCAL ] SAH: Loaded 21676 existing records from primary storage. [2025-10-07T22:42:08.828487] [INFO ] [MAIN ] SAH: Loaded 21676 primary data records. [2025-10-07T22:42:09.150783] [DEBUG] [LOCAL ] SAM: Loaded 21368 existing records from primary storage. [2025-10-07T22:42:09.156709] [INFO ] [MAIN ] SAM: Loaded 21368 primary data records. [2025-10-07T22:42:09.718887] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:09.720175] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30290 primary records. [2025-10-07T22:42:09.720597] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-07T22:42:09.752818] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:09.755149] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 21676 primary records. [2025-10-07T22:42:09.755754] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-07T22:42:09.758332] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-07T22:42:09.766532] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-07T22:42:09.769397] [INFO ] [MAIN ] Derivative Progress: 1273/1748 symbols completed. SAFE took 1.2s. Estimated remaining: 3m 2s. Rate: 156.4 symbols/min [2025-10-07T22:42:09.790212] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-07T22:42:09.790392] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-07T22:42:09.792857] [INFO ] [MAIN ] Derivative Progress: 1274/1748 symbols completed. SAH took 1.1s. Estimated remaining: 3m 2s. Rate: 156.5 symbols/min [2025-10-07T22:42:09.790590] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:09.793615] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21368 primary records. [2025-10-07T22:42:09.793829] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-07T22:42:09.808905] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-07T22:42:09.808964] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-07T22:42:09.811113] [INFO ] [MAIN ] Derivative Progress: 1275/1748 symbols completed. SAM took 1.0s. Estimated remaining: 3m 1s. Rate: 156.6 symbols/min [2025-10-07T22:42:09.811519] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:09.811607] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:09.811470] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:09.885213] [DEBUG] [LOCAL ] SAP: Loaded 49931 existing records from primary storage. [2025-10-07T22:42:09.885391] [INFO ] [MAIN ] SAP: Loaded 49931 primary data records. [2025-10-07T22:42:10.027393] [DEBUG] [LOCAL ] SAN: Loaded 52981 existing records from primary storage. [2025-10-07T22:42:10.026678] [DEBUG] [LOCAL ] SAND: Loaded 51804 existing records from primary storage. [2025-10-07T22:42:10.027600] [INFO ] [MAIN ] SAN: Loaded 52981 primary data records. [2025-10-07T22:42:10.028130] [INFO ] [MAIN ] SAND: Loaded 51804 primary data records. [2025-10-07T22:42:10.857443] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:10.858907] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49931 primary records. [2025-10-07T22:42:10.859187] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-07T22:42:10.886390] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:10.891361] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52981 primary records. [2025-10-07T22:42:10.891536] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-07T22:42:10.890167] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-07T22:42:10.891807] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-07T22:42:10.894457] [INFO ] [MAIN ] Derivative Progress: 1276/1748 symbols completed. SAP took 1.1s. Estimated remaining: 3m 1s. Rate: 156.4 symbols/min [2025-10-07T22:42:10.905350] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:10.922576] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-07T22:42:10.923120] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:10.923337] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-07T22:42:10.926235] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51804 primary records. [2025-10-07T22:42:10.926343] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-07T22:42:10.925442] [INFO ] [MAIN ] Derivative Progress: 1277/1748 symbols completed. SAN took 1.1s. Estimated remaining: 3m 1s. Rate: 156.5 symbols/min [2025-10-07T22:42:10.927290] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:10.948324] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-10-07T22:42:10.948508] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-07T22:42:10.950741] [INFO ] [MAIN ] Derivative Progress: 1278/1748 symbols completed. SAND took 1.1s. Estimated remaining: 3m 0s. Rate: 156.6 symbols/min [2025-10-07T22:42:10.956419] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:10.957078] [DEBUG] [LOCAL ] SAR: Loaded 16626 existing records from primary storage. [2025-10-07T22:42:10.957312] [INFO ] [MAIN ] SAR: Loaded 16626 primary data records. [2025-10-07T22:42:11.343305] [DEBUG] [LOCAL ] SARO: Loaded 48570 existing records from primary storage. [2025-10-07T22:42:11.343552] [INFO ] [MAIN ] SARO: Loaded 48570 primary data records. [2025-10-07T22:42:11.344132] [DEBUG] [LOCAL ] SB: Loaded 33087 existing records from primary storage. [2025-10-07T22:42:11.350148] [INFO ] [MAIN ] SB: Loaded 33087 primary data records. [2025-10-07T22:42:11.986353] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:11.987590] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16626 primary records. [2025-10-07T22:42:11.987718] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-07T22:42:12.006887] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-10-07T22:42:12.007143] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-07T22:42:12.009227] [INFO ] [MAIN ] Derivative Progress: 1279/1748 symbols completed. SAR took 1.1s. Estimated remaining: 2m 60s. Rate: 156.4 symbols/min [2025-10-07T22:42:12.009601] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:12.027316] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:12.030244] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33087 primary records. [2025-10-07T22:42:12.030511] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-07T22:42:12.051352] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:12.055947] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48570 primary records. [2025-10-07T22:42:12.059961] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-07T22:42:12.061795] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-07T22:42:12.062080] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-07T22:42:12.071373] [INFO ] [MAIN ] Derivative Progress: 1280/1748 symbols completed. SB took 1.1s. Estimated remaining: 2m 59s. Rate: 156.5 symbols/min [2025-10-07T22:42:12.075169] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:12.096489] [DEBUG] [LOCAL ] SBI: Loaded 7424 existing records from primary storage. [2025-10-07T22:42:12.096189] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-10-07T22:42:12.096630] [INFO ] [MAIN ] SBI: Loaded 7424 primary data records. [2025-10-07T22:42:12.096766] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-07T22:42:12.110274] [INFO ] [MAIN ] Derivative Progress: 1281/1748 symbols completed. SARO took 1.2s. Estimated remaining: 2m 59s. Rate: 156.6 symbols/min [2025-10-07T22:42:12.175778] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:12.211035] [DEBUG] [LOCAL ] SBH: Loaded 49797 existing records from primary storage. [2025-10-07T22:42:12.214794] [INFO ] [MAIN ] SBH: Loaded 49797 primary data records. [2025-10-07T22:42:12.527798] [DEBUG] [LOCAL ] SBR: Loaded 7553 existing records from primary storage. [2025-10-07T22:42:12.527969] [INFO ] [MAIN ] SBR: Loaded 7553 primary data records. [2025-10-07T22:42:13.083253] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:13.084146] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7424 primary records. [2025-10-07T22:42:13.084350] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-07T22:42:13.101450] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-07T22:42:13.103064] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-07T22:42:13.105183] [INFO ] [MAIN ] Derivative Progress: 1282/1748 symbols completed. SBI took 1.0s. Estimated remaining: 2m 59s. Rate: 156.4 symbols/min [2025-10-07T22:42:13.105475] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:13.123622] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:13.124577] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49797 primary records. [2025-10-07T22:42:13.124696] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-07T22:42:13.154347] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-07T22:42:13.150299] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:13.154529] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-07T22:42:13.155328] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7553 primary records. [2025-10-07T22:42:13.155457] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-07T22:42:13.157761] [INFO ] [MAIN ] Derivative Progress: 1283/1748 symbols completed. SBH took 1.1s. Estimated remaining: 2m 58s. Rate: 156.5 symbols/min [2025-10-07T22:42:13.158387] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:13.174669] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-07T22:42:13.174909] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-07T22:42:13.176924] [INFO ] [MAIN ] Derivative Progress: 1284/1748 symbols completed. SBR took 1.0s. Estimated remaining: 2m 58s. Rate: 156.7 symbols/min [2025-10-07T22:42:13.177084] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:13.200155] [DEBUG] [LOCAL ] SBSI: Loaded 14852 existing records from primary storage. [2025-10-07T22:42:13.200386] [INFO ] [MAIN ] SBSI: Loaded 14852 primary data records. [2025-10-07T22:42:13.330745] [DEBUG] [LOCAL ] SBS: Loaded 49403 existing records from primary storage. [2025-10-07T22:42:13.346515] [INFO ] [MAIN ] SBS: Loaded 49403 primary data records. [2025-10-07T22:42:13.673131] [DEBUG] [LOCAL ] SBSW: Loaded 53069 existing records from primary storage. [2025-10-07T22:42:13.674755] [INFO ] [MAIN ] SBSW: Loaded 53069 primary data records. [2025-10-07T22:42:14.210114] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:14.211591] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14852 primary records. [2025-10-07T22:42:14.211964] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-07T22:42:14.234486] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-07T22:42:14.234775] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-07T22:42:14.237125] [INFO ] [MAIN ] Derivative Progress: 1285/1748 symbols completed. SBSI took 1.1s. Estimated remaining: 2m 58s. Rate: 156.4 symbols/min [2025-10-07T22:42:14.237367] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:14.251968] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:14.252604] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49403 primary records. [2025-10-07T22:42:14.252776] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-07T22:42:14.287281] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-07T22:42:14.287626] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:14.287813] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-07T22:42:14.291370] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53069 primary records. [2025-10-07T22:42:14.290077] [INFO ] [MAIN ] Derivative Progress: 1286/1748 symbols completed. SBS took 1.2s. Estimated remaining: 2m 57s. Rate: 156.5 symbols/min [2025-10-07T22:42:14.291740] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-07T22:42:14.291678] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:14.311295] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-07T22:42:14.311518] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-07T22:42:14.314038] [INFO ] [MAIN ] Derivative Progress: 1287/1748 symbols completed. SBSW took 1.1s. Estimated remaining: 2m 57s. Rate: 156.7 symbols/min [2025-10-07T22:42:14.317402] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:14.335178] [DEBUG] [LOCAL ] SCD: Loaded 13049 existing records from primary storage. [2025-10-07T22:42:14.335334] [INFO ] [MAIN ] SCD: Loaded 13049 primary data records. [2025-10-07T22:42:14.474290] [DEBUG] [LOCAL ] SCCO: Loaded 49563 existing records from primary storage. [2025-10-07T22:42:14.480513] [INFO ] [MAIN ] SCCO: Loaded 49563 primary data records. [2025-10-07T22:42:14.798219] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-07T22:42:14.822185] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-07T22:42:15.348236] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:15.349834] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 13049 primary records. [2025-10-07T22:42:15.350090] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-07T22:42:15.372487] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-07T22:42:15.372835] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-07T22:42:15.383168] [INFO ] [MAIN ] Derivative Progress: 1288/1748 symbols completed. SCD took 1.1s. Estimated remaining: 2m 56s. Rate: 156.4 symbols/min [2025-10-07T22:42:15.389004] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:15.389941] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49563 primary records. [2025-10-07T22:42:15.390088] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-07T22:42:15.421204] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:15.422856] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-07T22:42:15.423217] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-07T22:42:15.438442] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-07T22:42:15.438793] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-07T22:42:15.442691] [INFO ] [MAIN ] Derivative Progress: 1289/1748 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 56s. Rate: 156.5 symbols/min [2025-10-07T22:42:15.444934] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-07T22:42:15.445011] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-07T22:42:15.447091] [INFO ] [MAIN ] Derivative Progress: 1290/1748 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 55s. Rate: 156.7 symbols/min [2025-10-07T22:42:15.447452] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:15.447858] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:15.449102] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:15.471338] [DEBUG] [LOCAL ] SCL: Loaded 14865 existing records from primary storage. [2025-10-07T22:42:15.471542] [INFO ] [MAIN ] SCL: Loaded 14865 primary data records. [2025-10-07T22:42:15.548437] [DEBUG] [LOCAL ] SCM: Loaded 19820 existing records from primary storage. [2025-10-07T22:42:15.560455] [INFO ] [MAIN ] SCM: Loaded 19820 primary data records. [2025-10-07T22:42:15.984032] [DEBUG] [LOCAL ] SCI: Loaded 46524 existing records from primary storage. [2025-10-07T22:42:15.985158] [INFO ] [MAIN ] SCI: Loaded 46524 primary data records. [2025-10-07T22:42:16.431068] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:16.431993] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14865 primary records. [2025-10-07T22:42:16.432163] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-07T22:42:16.462512] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:16.464506] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19820 primary records. [2025-10-07T22:42:16.465005] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-07T22:42:16.484131] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-07T22:42:16.484497] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-07T22:42:16.484683] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-07T22:42:16.484776] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-07T22:42:16.486879] [INFO ] [MAIN ] Derivative Progress: 1291/1748 symbols completed. SCL took 1.0s. Estimated remaining: 2m 55s. Rate: 156.5 symbols/min [2025-10-07T22:42:16.489852] [INFO ] [MAIN ] Derivative Progress: 1292/1748 symbols completed. SCM took 1.0s. Estimated remaining: 2m 55s. Rate: 156.6 symbols/min [2025-10-07T22:42:16.489553] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:16.490237] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:16.508264] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:16.509046] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46524 primary records. [2025-10-07T22:42:16.509110] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-07T22:42:16.530778] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-07T22:42:16.530979] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-07T22:42:16.533395] [INFO ] [MAIN ] Derivative Progress: 1293/1748 symbols completed. SCI took 1.1s. Estimated remaining: 2m 54s. Rate: 156.7 symbols/min [2025-10-07T22:42:16.533705] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:16.553593] [DEBUG] [LOCAL ] SDHC: Loaded 10332 existing records from primary storage. [2025-10-07T22:42:16.553883] [INFO ] [MAIN ] SDHC: Loaded 10332 primary data records. [2025-10-07T22:42:16.674303] [DEBUG] [LOCAL ] SD: Loaded 28769 existing records from primary storage. [2025-10-07T22:42:16.677537] [INFO ] [MAIN ] SD: Loaded 28769 primary data records. [2025-10-07T22:42:16.762732] [DEBUG] [LOCAL ] SCS: Loaded 43572 existing records from primary storage. [2025-10-07T22:42:16.816712] [INFO ] [MAIN ] SCS: Loaded 43572 primary data records. [2025-10-07T22:42:17.826980] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:17.828623] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10332 primary records. [2025-10-07T22:42:17.828860] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-07T22:42:17.846577] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-07T22:42:17.847165] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-07T22:42:17.849294] [INFO ] [MAIN ] Derivative Progress: 1294/1748 symbols completed. SDHC took 1.3s. Estimated remaining: 2m 54s. Rate: 156.4 symbols/min [2025-10-07T22:42:17.850569] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:17.878882] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:17.880360] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28769 primary records. [2025-10-07T22:42:17.880536] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-07T22:42:17.898986] [DEBUG] [LOCAL ] SDHY: Loaded 10757 existing records from primary storage. [2025-10-07T22:42:17.900012] [INFO ] [MAIN ] SDHY: Loaded 10757 primary data records. [2025-10-07T22:42:17.971449] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-10-07T22:42:17.997090] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-07T22:42:17.997012] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:18.015557] [INFO ] [MAIN ] Derivative Progress: 1295/1748 symbols completed. SD took 1.5s. Estimated remaining: 2m 54s. Rate: 156.5 symbols/min [2025-10-07T22:42:18.027000] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43572 primary records. [2025-10-07T22:42:18.027365] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-07T22:42:18.027242] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:18.125059] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-07T22:42:18.170811] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-07T22:42:18.244172] [INFO ] [MAIN ] Derivative Progress: 1296/1748 symbols completed. SCS took 1.8s. Estimated remaining: 2m 53s. Rate: 156.5 symbols/min [2025-10-07T22:42:18.244507] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:18.295907] [DEBUG] [LOCAL ] SDRL: Loaded 41477 existing records from primary storage. [2025-10-07T22:42:18.294981] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:18.309813] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10757 primary records. [2025-10-07T22:42:18.308818] [INFO ] [MAIN ] SDRL: Loaded 41477 primary data records. [2025-10-07T22:42:18.309967] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-07T22:42:18.444989] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-07T22:42:18.450622] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-07T22:42:18.473170] [DEBUG] [LOCAL ] SE: Loaded 53329 existing records from primary storage. [2025-10-07T22:42:18.489311] [INFO ] [MAIN ] Derivative Progress: 1297/1748 symbols completed. SDHY took 0.6s. Estimated remaining: 2m 53s. Rate: 156.5 symbols/min [2025-10-07T22:42:18.522949] [INFO ] [MAIN ] SE: Loaded 53329 primary data records. [2025-10-07T22:42:18.528700] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:18.987550] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:18.989432] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41477 primary records. [2025-10-07T22:42:18.989722] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-07T22:42:19.007140] [DEBUG] [LOCAL ] SEE: Loaded 48226 existing records from primary storage. [2025-10-07T22:42:19.014450] [INFO ] [MAIN ] SEE: Loaded 48226 primary data records. [2025-10-07T22:42:19.142587] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-10-07T22:42:19.159061] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-07T22:42:19.179429] [INFO ] [MAIN ] Derivative Progress: 1298/1748 symbols completed. SDRL took 1.2s. Estimated remaining: 2m 53s. Rate: 156.5 symbols/min [2025-10-07T22:42:19.258723] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:19.259337] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:19.279397] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53329 primary records. [2025-10-07T22:42:19.339013] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-07T22:42:19.375126] [DEBUG] [LOCAL ] SEG: Loaded 13247 existing records from primary storage. [2025-10-07T22:42:19.375602] [INFO ] [MAIN ] SEG: Loaded 13247 primary data records. [2025-10-07T22:42:19.412377] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-10-07T22:42:19.445870] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-07T22:42:19.471754] [INFO ] [MAIN ] Derivative Progress: 1299/1748 symbols completed. SE took 1.2s. Estimated remaining: 2m 52s. Rate: 156.5 symbols/min [2025-10-07T22:42:19.482865] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:19.734243] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:19.735743] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48226 primary records. [2025-10-07T22:42:19.735892] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-07T22:42:19.768462] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-07T22:42:19.768903] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-07T22:42:19.771356] [INFO ] [MAIN ] Derivative Progress: 1300/1748 symbols completed. SEE took 1.2s. Estimated remaining: 2m 52s. Rate: 156.5 symbols/min [2025-10-07T22:42:19.772922] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:19.789942] [DEBUG] [LOCAL ] SEI: Loaded 49697 existing records from primary storage. [2025-10-07T22:42:19.790396] [INFO ] [MAIN ] SEI: Loaded 49697 primary data records. [2025-10-07T22:42:19.848490] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:19.883218] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13247 primary records. [2025-10-07T22:42:19.907570] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-07T22:42:20.143483] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-07T22:42:20.143636] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-07T22:42:20.146144] [INFO ] [MAIN ] Derivative Progress: 1301/1748 symbols completed. SEG took 0.9s. Estimated remaining: 2m 51s. Rate: 156.5 symbols/min [2025-10-07T22:42:20.146422] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:20.165483] [DEBUG] [LOCAL ] SEM: Loaded 42871 existing records from primary storage. [2025-10-07T22:42:20.166154] [INFO ] [MAIN ] SEM: Loaded 42871 primary data records. [2025-10-07T22:42:20.508935] [DEBUG] [LOCAL ] SEMR: Loaded 41770 existing records from primary storage. [2025-10-07T22:42:20.510371] [INFO ] [MAIN ] SEMR: Loaded 41770 primary data records. [2025-10-07T22:42:20.611722] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:20.642936] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49697 primary records. [2025-10-07T22:42:20.643155] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-07T22:42:20.860487] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-07T22:42:20.860896] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-07T22:42:20.863103] [INFO ] [MAIN ] Derivative Progress: 1302/1748 symbols completed. SEI took 1.4s. Estimated remaining: 2m 51s. Rate: 156.4 symbols/min [2025-10-07T22:42:20.864508] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:20.886249] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:20.888700] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42871 primary records. [2025-10-07T22:42:20.888957] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-07T22:42:20.907661] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-07T22:42:20.907831] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-07T22:42:20.910307] [INFO ] [MAIN ] Derivative Progress: 1303/1748 symbols completed. SEM took 1.1s. Estimated remaining: 2m 51s. Rate: 156.5 symbols/min [2025-10-07T22:42:20.927314] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:20.927993] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41770 primary records. [2025-10-07T22:42:20.928121] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-07T22:42:20.957672] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-07T22:42:20.957766] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-07T22:42:20.960229] [INFO ] [MAIN ] Derivative Progress: 1304/1748 symbols completed. SEMR took 0.8s. Estimated remaining: 2m 50s. Rate: 156.6 symbols/min [2025-10-07T22:42:20.978079] [DEBUG] [LOCAL ] SES: Loaded 51568 existing records from primary storage. [2025-10-07T22:42:20.978237] [INFO ] [MAIN ] SES: Loaded 51568 primary data records. [2025-10-07T22:42:21.284102] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:21.284782] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51568 primary records. [2025-10-07T22:42:21.284846] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-07T22:42:21.299994] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-07T22:42:21.300056] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-07T22:42:21.302086] [INFO ] [MAIN ] Derivative Progress: 1305/1748 symbols completed. SES took 0.4s. Estimated remaining: 2m 50s. Rate: 156.6 symbols/min [2025-10-07T22:42:21.302617] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:21.302785] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:21.302878] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:21.311486] [DEBUG] [LOCAL ] SFB: Loaded 4159 existing records from primary storage. [2025-10-07T22:42:21.311831] [INFO ] [MAIN ] SFB: Loaded 4159 primary data records. [2025-10-07T22:42:21.439154] [DEBUG] [LOCAL ] SFBS: Loaded 21147 existing records from primary storage. [2025-10-07T22:42:21.445534] [INFO ] [MAIN ] SFBS: Loaded 21147 primary data records. [2025-10-07T22:42:21.846119] [DEBUG] [LOCAL ] SF: Loaded 41637 existing records from primary storage. [2025-10-07T22:42:21.858124] [INFO ] [MAIN ] SF: Loaded 41637 primary data records. [2025-10-07T22:42:22.365365] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:22.366257] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4159 primary records. [2025-10-07T22:42:22.366677] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-07T22:42:22.385796] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-07T22:42:22.386137] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-07T22:42:22.388975] [INFO ] [MAIN ] Derivative Progress: 1306/1748 symbols completed. SFB took 1.1s. Estimated remaining: 2m 50s. Rate: 156.4 symbols/min [2025-10-07T22:42:22.389486] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:22.404261] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:22.405406] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21147 primary records. [2025-10-07T22:42:22.405484] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-07T22:42:22.436797] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-10-07T22:42:22.443906] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-07T22:42:22.446408] [INFO ] [MAIN ] Derivative Progress: 1307/1748 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 49s. Rate: 156.5 symbols/min [2025-10-07T22:42:22.446890] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:22.447186] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:22.448121] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41637 primary records. [2025-10-07T22:42:22.448727] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-07T22:42:22.493047] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-07T22:42:22.493336] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-07T22:42:22.494155] [DEBUG] [LOCAL ] SFL: Loaded 45130 existing records from primary storage. [2025-10-07T22:42:22.494265] [INFO ] [MAIN ] SFL: Loaded 45130 primary data records. [2025-10-07T22:42:22.497162] [INFO ] [MAIN ] Derivative Progress: 1308/1748 symbols completed. SF took 1.2s. Estimated remaining: 2m 49s. Rate: 156.6 symbols/min [2025-10-07T22:42:22.497558] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:22.843068] [DEBUG] [LOCAL ] SG: Loaded 53472 existing records from primary storage. [2025-10-07T22:42:22.855991] [INFO ] [MAIN ] SG: Loaded 53472 primary data records. [2025-10-07T22:42:22.939200] [DEBUG] [LOCAL ] SGHC: Loaded 46419 existing records from primary storage. [2025-10-07T22:42:22.957470] [INFO ] [MAIN ] SGHC: Loaded 46419 primary data records. [2025-10-07T22:42:23.388136] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:23.616045] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45130 primary records. [2025-10-07T22:42:23.617910] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-07T22:42:23.640429] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-07T22:42:23.642170] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-07T22:42:23.645397] [INFO ] [MAIN ] Derivative Progress: 1309/1748 symbols completed. SFL took 1.3s. Estimated remaining: 2m 48s. Rate: 156.4 symbols/min [2025-10-07T22:42:23.646388] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:23.662932] [DEBUG] [LOCAL ] SGU: Loaded 6620 existing records from primary storage. [2025-10-07T22:42:23.663167] [INFO ] [MAIN ] SGU: Loaded 6620 primary data records. [2025-10-07T22:42:23.717629] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:23.767919] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53472 primary records. [2025-10-07T22:42:23.796484] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-07T22:42:23.942855] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:24.075934] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-10-07T22:42:24.077041] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 46419 primary records. [2025-10-07T22:42:24.077238] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-07T22:42:24.077326] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-07T22:42:24.080780] [INFO ] [MAIN ] Derivative Progress: 1310/1748 symbols completed. SG took 1.6s. Estimated remaining: 2m 48s. Rate: 156.4 symbols/min [2025-10-07T22:42:24.081144] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:24.100687] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-10-07T22:42:24.100877] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-07T22:42:24.103121] [INFO ] [MAIN ] Derivative Progress: 1311/1748 symbols completed. SGHC took 1.6s. Estimated remaining: 2m 48s. Rate: 156.5 symbols/min [2025-10-07T22:42:24.103440] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:24.135721] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:42:24.136592] [INFO ] [MAIN ] SGU: Generated 1793 derivative records from 6620 primary records. [2025-10-07T22:42:24.136769] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-07T22:42:24.173530] [DEBUG] [LOCAL ] SGU: Derivative data saved (1793 records). [2025-10-07T22:42:24.172981] [DEBUG] [LOCAL ] SHCO: Loaded 25498 existing records from primary storage. [2025-10-07T22:42:24.173736] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-07T22:42:24.176182] [INFO ] [MAIN ] SHCO: Loaded 25498 primary data records. [2025-10-07T22:42:24.176053] [INFO ] [MAIN ] Derivative Progress: 1312/1748 symbols completed. SGU took 0.5s. Estimated remaining: 2m 47s. Rate: 156.6 symbols/min [2025-10-07T22:42:24.189883] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:24.343821] [DEBUG] [LOCAL ] SHAK: Loaded 48936 existing records from primary storage. [2025-10-07T22:42:24.359567] [INFO ] [MAIN ] SHAK: Loaded 48936 primary data records. [2025-10-07T22:42:24.747632] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-10-07T22:42:24.792332] [INFO ] [MAIN ] SHEL: Loaded 53672 primary data records. [2025-10-07T22:42:25.344805] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:25.347004] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25498 primary records. [2025-10-07T22:42:25.347395] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-07T22:42:25.385403] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:25.387359] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-10-07T22:42:25.388419] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48936 primary records. [2025-10-07T22:42:25.387522] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-07T22:42:25.391782] [INFO ] [MAIN ] Derivative Progress: 1313/1748 symbols completed. SHCO took 1.3s. Estimated remaining: 2m 47s. Rate: 156.3 symbols/min [2025-10-07T22:42:25.392003] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-07T22:42:25.393438] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:25.412483] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-10-07T22:42:25.412855] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-07T22:42:25.415225] [INFO ] [MAIN ] Derivative Progress: 1314/1748 symbols completed. SHAK took 1.3s. Estimated remaining: 2m 46s. Rate: 156.4 symbols/min [2025-10-07T22:42:25.415601] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:25.434073] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:25.442828] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53672 primary records. [2025-10-07T22:42:25.443013] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-07T22:42:25.466870] [DEBUG] [LOCAL ] SHG: Loaded 26280 existing records from primary storage. [2025-10-07T22:42:25.468435] [INFO ] [MAIN ] SHG: Loaded 26280 primary data records. [2025-10-07T22:42:25.470475] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-07T22:42:25.470686] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-07T22:42:25.501349] [INFO ] [MAIN ] Derivative Progress: 1315/1748 symbols completed. SHEL took 1.3s. Estimated remaining: 2m 46s. Rate: 156.5 symbols/min [2025-10-07T22:42:25.552400] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:25.626752] [DEBUG] [LOCAL ] SHOC: Loaded 3365 existing records from primary storage. [2025-10-07T22:42:25.656057] [INFO ] [MAIN ] SHOC: Loaded 3365 primary data records. [2025-10-07T22:42:25.719481] [DEBUG] [LOCAL ] SHO: Loaded 49629 existing records from primary storage. [2025-10-07T22:42:25.770916] [INFO ] [MAIN ] SHO: Loaded 49629 primary data records. [2025-10-07T22:42:26.572304] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:26.573732] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26280 primary records. [2025-10-07T22:42:26.574083] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-07T22:42:26.598122] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-07T22:42:26.599316] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-07T22:42:26.602299] [INFO ] [MAIN ] Derivative Progress: 1316/1748 symbols completed. SHG took 1.2s. Estimated remaining: 2m 46s. Rate: 156.3 symbols/min [2025-10-07T22:42:26.602594] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:26.631321] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:42:26.632977] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3365 primary records. [2025-10-07T22:42:26.631946] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:26.633163] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-07T22:42:26.634044] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49629 primary records. [2025-10-07T22:42:26.635031] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-07T22:42:26.661555] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-10-07T22:42:26.665291] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-07T22:42:26.668226] [INFO ] [MAIN ] Derivative Progress: 1317/1748 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 45s. Rate: 156.4 symbols/min [2025-10-07T22:42:26.668785] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:26.680834] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-07T22:42:26.680991] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-07T22:42:26.683097] [INFO ] [MAIN ] Derivative Progress: 1318/1748 symbols completed. SHO took 1.3s. Estimated remaining: 2m 45s. Rate: 156.5 symbols/min [2025-10-07T22:42:26.733589] [DEBUG] [LOCAL ] SHW: Loaded 50318 existing records from primary storage. [2025-10-07T22:42:26.733848] [INFO ] [MAIN ] SHW: Loaded 50318 primary data records. [2025-10-07T22:42:26.879770] [DEBUG] [LOCAL ] SID: Loaded 42365 existing records from primary storage. [2025-10-07T22:42:26.879999] [INFO ] [MAIN ] SID: Loaded 42365 primary data records. [2025-10-07T22:42:27.426674] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:27.428094] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50318 primary records. [2025-10-07T22:42:27.428317] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-07T22:42:27.461711] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:27.463046] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42365 primary records. [2025-10-07T22:42:27.464095] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-07T22:42:27.466346] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-07T22:42:27.466753] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-07T22:42:27.468761] [INFO ] [MAIN ] Derivative Progress: 1319/1748 symbols completed. SHW took 0.9s. Estimated remaining: 2m 45s. Rate: 156.4 symbols/min [2025-10-07T22:42:27.486300] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-07T22:42:27.486385] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-07T22:42:27.488576] [INFO ] [MAIN ] Derivative Progress: 1320/1748 symbols completed. SID took 0.8s. Estimated remaining: 2m 44s. Rate: 156.5 symbols/min [2025-10-07T22:42:27.489016] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:27.489217] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:27.489108] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:27.533409] [DEBUG] [LOCAL ] SII: Loaded 23648 existing records from primary storage. [2025-10-07T22:42:27.533536] [INFO ] [MAIN ] SII: Loaded 23648 primary data records. [2025-10-07T22:42:27.618304] [DEBUG] [LOCAL ] SILA: Loaded 30664 existing records from primary storage. [2025-10-07T22:42:27.651717] [INFO ] [MAIN ] SILA: Loaded 30664 primary data records. [2025-10-07T22:42:28.037960] [DEBUG] [LOCAL ] SIG: Loaded 45878 existing records from primary storage. [2025-10-07T22:42:28.044221] [INFO ] [MAIN ] SIG: Loaded 45878 primary data records. [2025-10-07T22:42:28.635978] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:28.636949] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23648 primary records. [2025-10-07T22:42:28.637123] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-07T22:42:28.656541] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-07T22:42:28.656714] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-07T22:42:28.658792] [INFO ] [MAIN ] Derivative Progress: 1321/1748 symbols completed. SII took 1.2s. Estimated remaining: 2m 44s. Rate: 156.2 symbols/min [2025-10-07T22:42:28.659070] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:28.675468] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:28.677998] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30664 primary records. [2025-10-07T22:42:28.678333] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-07T22:42:28.699994] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:28.704603] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 45878 primary records. [2025-10-07T22:42:28.705185] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-07T22:42:28.723483] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-10-07T22:42:28.724265] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-07T22:42:28.726691] [INFO ] [MAIN ] Derivative Progress: 1322/1748 symbols completed. SILA took 1.2s. Estimated remaining: 2m 43s. Rate: 156.3 symbols/min [2025-10-07T22:42:28.727480] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:28.728853] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-10-07T22:42:28.728937] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-07T22:42:28.730872] [INFO ] [MAIN ] Derivative Progress: 1323/1748 symbols completed. SIG took 1.2s. Estimated remaining: 2m 43s. Rate: 156.5 symbols/min [2025-10-07T22:42:28.741128] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:28.760046] [DEBUG] [LOCAL ] SITC: Loaded 41616 existing records from primary storage. [2025-10-07T22:42:28.760505] [INFO ] [MAIN ] SITC: Loaded 41616 primary data records. [2025-10-07T22:42:28.936737] [DEBUG] [LOCAL ] SITE: Loaded 35237 existing records from primary storage. [2025-10-07T22:42:28.967589] [INFO ] [MAIN ] SITE: Loaded 35237 primary data records. [2025-10-07T22:42:29.296351] [DEBUG] [LOCAL ] SJM: Loaded 50142 existing records from primary storage. [2025-10-07T22:42:29.307185] [INFO ] [MAIN ] SJM: Loaded 50142 primary data records. [2025-10-07T22:42:29.827265] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:29.829207] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41616 primary records. [2025-10-07T22:42:29.829752] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-07T22:42:29.850348] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-07T22:42:29.851277] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-07T22:42:29.853853] [INFO ] [MAIN ] Derivative Progress: 1324/1748 symbols completed. SITC took 1.2s. Estimated remaining: 2m 43s. Rate: 156.2 symbols/min [2025-10-07T22:42:29.854466] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:29.871768] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:42:29.872858] [INFO ] [MAIN ] SITE: Generated 1793 derivative records from 35237 primary records. [2025-10-07T22:42:29.873140] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-07T22:42:29.897312] [DEBUG] [LOCAL ] SITE: Derivative data saved (1793 records). [2025-10-07T22:42:29.899543] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-07T22:42:29.903284] [INFO ] [MAIN ] Derivative Progress: 1325/1748 symbols completed. SITE took 1.2s. Estimated remaining: 2m 42s. Rate: 156.3 symbols/min [2025-10-07T22:42:29.904253] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:29.924971] [DEBUG] [LOCAL ] SJT: Loaded 22383 existing records from primary storage. [2025-10-07T22:42:29.925749] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:29.925828] [INFO ] [MAIN ] SJT: Loaded 22383 primary data records. [2025-10-07T22:42:29.926758] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50142 primary records. [2025-10-07T22:42:29.932056] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-07T22:42:30.054992] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-07T22:42:30.068885] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-07T22:42:30.076968] [INFO ] [MAIN ] Derivative Progress: 1326/1748 symbols completed. SJM took 1.3s. Estimated remaining: 2m 42s. Rate: 156.4 symbols/min [2025-10-07T22:42:30.108327] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:30.351681] [DEBUG] [LOCAL ] SKIL: Loaded 6496 existing records from primary storage. [2025-10-07T22:42:30.348083] [DEBUG] [LOCAL ] SKE: Loaded 36214 existing records from primary storage. [2025-10-07T22:42:30.352967] [INFO ] [MAIN ] SKIL: Loaded 6496 primary data records. [2025-10-07T22:42:30.353367] [INFO ] [MAIN ] SKE: Loaded 36214 primary data records. [2025-10-07T22:42:31.025772] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:31.027165] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22383 primary records. [2025-10-07T22:42:31.027884] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-07T22:42:31.048367] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-07T22:42:31.048610] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-07T22:42:31.051426] [INFO ] [MAIN ] Derivative Progress: 1327/1748 symbols completed. SJT took 1.2s. Estimated remaining: 2m 42s. Rate: 156.2 symbols/min [2025-10-07T22:42:31.052183] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:31.089272] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:31.089465] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:31.091022] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 36214 primary records. [2025-10-07T22:42:31.090365] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6496 primary records. [2025-10-07T22:42:31.091176] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-07T22:42:31.091675] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-07T22:42:31.104385] [DEBUG] [LOCAL ] SKLZ: Loaded 11624 existing records from primary storage. [2025-10-07T22:42:31.118763] [INFO ] [MAIN ] SKLZ: Loaded 11624 primary data records. [2025-10-07T22:42:31.145308] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-10-07T22:42:31.157727] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-07T22:42:31.152277] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-07T22:42:31.157820] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-07T22:42:31.174026] [INFO ] [MAIN ] Derivative Progress: 1328/1748 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 41s. Rate: 156.3 symbols/min [2025-10-07T22:42:31.187319] [INFO ] [MAIN ] Derivative Progress: 1329/1748 symbols completed. SKE took 1.3s. Estimated remaining: 2m 41s. Rate: 156.4 symbols/min [2025-10-07T22:42:31.187456] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:31.187147] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:31.526018] [DEBUG] [LOCAL ] SKY: Loaded 38001 existing records from primary storage. [2025-10-07T22:42:31.526385] [INFO ] [MAIN ] SKY: Loaded 38001 primary data records. [2025-10-07T22:42:31.551772] [DEBUG] [LOCAL ] SKT: Loaded 42521 existing records from primary storage. [2025-10-07T22:42:31.578119] [INFO ] [MAIN ] SKT: Loaded 42521 primary data records. [2025-10-07T22:42:32.052315] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:32.074469] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11624 primary records. [2025-10-07T22:42:32.075376] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-07T22:42:32.204750] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-07T22:42:32.213105] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-07T22:42:32.216180] [INFO ] [MAIN ] Derivative Progress: 1330/1748 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 41s. Rate: 156.2 symbols/min [2025-10-07T22:42:32.217341] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:32.240129] [DEBUG] [LOCAL ] SKYH: Loaded 16609 existing records from primary storage. [2025-10-07T22:42:32.240637] [INFO ] [MAIN ] SKYH: Loaded 16609 primary data records. [2025-10-07T22:42:32.337779] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:32.360804] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 38001 primary records. [2025-10-07T22:42:32.384374] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-07T22:42:32.520084] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:32.642340] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-07T22:42:32.639527] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42521 primary records. [2025-10-07T22:42:32.642552] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-07T22:42:32.642684] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-07T22:42:32.644697] [INFO ] [MAIN ] Derivative Progress: 1331/1748 symbols completed. SKY took 1.5s. Estimated remaining: 2m 40s. Rate: 156.2 symbols/min [2025-10-07T22:42:32.647038] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:32.667639] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-10-07T22:42:32.668092] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-07T22:42:32.670223] [INFO ] [MAIN ] Derivative Progress: 1332/1748 symbols completed. SKT took 1.5s. Estimated remaining: 2m 40s. Rate: 156.3 symbols/min [2025-10-07T22:42:32.670506] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:32.689536] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:32.690397] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16609 primary records. [2025-10-07T22:42:32.690523] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-07T22:42:32.726839] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-07T22:42:32.726912] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-07T22:42:32.729035] [INFO ] [MAIN ] Derivative Progress: 1333/1748 symbols completed. SKYH took 0.5s. Estimated remaining: 2m 39s. Rate: 156.4 symbols/min [2025-10-07T22:42:32.769287] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-07T22:42:32.769483] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-07T22:42:32.770110] [DEBUG] [LOCAL ] SLF: Loaded 38723 existing records from primary storage. [2025-10-07T22:42:32.801502] [INFO ] [MAIN ] SLF: Loaded 38723 primary data records. [2025-10-07T22:42:33.421867] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:33.422867] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-10-07T22:42:33.423041] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-07T22:42:33.454619] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-10-07T22:42:33.454865] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:33.455070] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-07T22:42:33.457151] [INFO ] [MAIN ] Derivative Progress: 1334/1748 symbols completed. SLB took 0.8s. Estimated remaining: 2m 39s. Rate: 156.3 symbols/min [2025-10-07T22:42:33.457976] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38723 primary records. [2025-10-07T22:42:33.458279] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-07T22:42:33.473560] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-07T22:42:33.473679] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-07T22:42:33.475557] [INFO ] [MAIN ] Derivative Progress: 1335/1748 symbols completed. SLF took 0.8s. Estimated remaining: 2m 38s. Rate: 156.4 symbols/min [2025-10-07T22:42:33.476026] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:33.476127] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:33.476318] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:33.538088] [DEBUG] [LOCAL ] SLGN: Loaded 40559 existing records from primary storage. [2025-10-07T22:42:33.539552] [INFO ] [MAIN ] SLGN: Loaded 40559 primary data records. [2025-10-07T22:42:33.551552] [DEBUG] [LOCAL ] SLG: Loaded 45184 existing records from primary storage. [2025-10-07T22:42:33.622183] [INFO ] [MAIN ] SLG: Loaded 45184 primary data records. [2025-10-07T22:42:33.852984] [DEBUG] [LOCAL ] SLQT: Loaded 43504 existing records from primary storage. [2025-10-07T22:42:33.974337] [INFO ] [MAIN ] SLQT: Loaded 43504 primary data records. [2025-10-07T22:42:34.586377] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:34.588490] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40559 primary records. [2025-10-07T22:42:34.590204] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-07T22:42:34.614822] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:34.618372] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45184 primary records. [2025-10-07T22:42:34.618577] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-07T22:42:34.642079] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-07T22:42:34.642528] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-07T22:42:34.645151] [INFO ] [MAIN ] Derivative Progress: 1336/1748 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 38s. Rate: 156.2 symbols/min [2025-10-07T22:42:34.645450] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:34.643110] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-07T22:42:34.645737] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-07T22:42:34.648050] [INFO ] [MAIN ] Derivative Progress: 1337/1748 symbols completed. SLG took 1.2s. Estimated remaining: 2m 38s. Rate: 156.3 symbols/min [2025-10-07T22:42:34.663009] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:34.663475] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:34.664329] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43504 primary records. [2025-10-07T22:42:34.664748] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-07T22:42:34.690843] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-07T22:42:34.691065] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-07T22:42:34.693072] [INFO ] [MAIN ] Derivative Progress: 1338/1748 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 37s. Rate: 156.4 symbols/min [2025-10-07T22:42:34.693337] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:34.712858] [DEBUG] [LOCAL ] SMBK: Loaded 8173 existing records from primary storage. [2025-10-07T22:42:34.722699] [INFO ] [MAIN ] SMBK: Loaded 8173 primary data records. [2025-10-07T22:42:34.762028] [DEBUG] [LOCAL ] SLVM: Loaded 27995 existing records from primary storage. [2025-10-07T22:42:34.788351] [INFO ] [MAIN ] SLVM: Loaded 27995 primary data records. [2025-10-07T22:42:35.055816] [DEBUG] [LOCAL ] SM: Loaded 52319 existing records from primary storage. [2025-10-07T22:42:35.061907] [INFO ] [MAIN ] SM: Loaded 52319 primary data records. [2025-10-07T22:42:35.760202] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:35.765984] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:35.766841] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8173 primary records. [2025-10-07T22:42:35.766937] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-07T22:42:35.768054] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27995 primary records. [2025-10-07T22:42:35.768749] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-07T22:42:35.796435] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-10-07T22:42:35.796574] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-07T22:42:35.798897] [INFO ] [MAIN ] Derivative Progress: 1339/1748 symbols completed. SMBK took 1.1s. Estimated remaining: 2m 37s. Rate: 156.2 symbols/min [2025-10-07T22:42:35.799531] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:35.822614] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-07T22:42:35.822306] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:35.823704] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52319 primary records. [2025-10-07T22:42:35.823889] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-07T22:42:35.825988] [INFO ] [MAIN ] Derivative Progress: 1340/1748 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 37s. Rate: 156.3 symbols/min [2025-10-07T22:42:35.826108] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-07T22:42:35.828762] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:35.849679] [DEBUG] [LOCAL ] SMC: Loaded 11308 existing records from primary storage. [2025-10-07T22:42:35.850339] [INFO ] [MAIN ] SMC: Loaded 11308 primary data records. [2025-10-07T22:42:35.944969] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-07T22:42:35.957371] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-07T22:42:35.965105] [INFO ] [MAIN ] Derivative Progress: 1341/1748 symbols completed. SM took 1.3s. Estimated remaining: 2m 36s. Rate: 156.4 symbols/min [2025-10-07T22:42:35.981396] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:36.194577] [DEBUG] [LOCAL ] SMFG: Loaded 48186 existing records from primary storage. [2025-10-07T22:42:36.195488] [INFO ] [MAIN ] SMFG: Loaded 48186 primary data records. [2025-10-07T22:42:36.588324] [DEBUG] [LOCAL ] SMG: Loaded 43653 existing records from primary storage. [2025-10-07T22:42:36.589543] [INFO ] [MAIN ] SMG: Loaded 43653 primary data records. [2025-10-07T22:42:36.662298] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:36.702669] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11308 primary records. [2025-10-07T22:42:36.715361] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-07T22:42:36.939791] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-07T22:42:36.940009] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-07T22:42:36.942831] [INFO ] [MAIN ] Derivative Progress: 1342/1748 symbols completed. SMC took 1.1s. Estimated remaining: 2m 36s. Rate: 156.2 symbols/min [2025-10-07T22:42:36.944185] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:36.965512] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:36.966391] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48186 primary records. [2025-10-07T22:42:36.966707] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-07T22:42:36.993680] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-07T22:42:36.994067] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-07T22:42:36.996304] [INFO ] [MAIN ] Derivative Progress: 1343/1748 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 35s. Rate: 156.3 symbols/min [2025-10-07T22:42:36.997562] [DEBUG] [LOCAL ] SMHI: Loaded 13095 existing records from primary storage. [2025-10-07T22:42:36.996806] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:36.998000] [INFO ] [MAIN ] SMHI: Loaded 13095 primary data records. [2025-10-07T22:42:37.128135] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:37.148895] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43653 primary records. [2025-10-07T22:42:37.186689] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-07T22:42:37.187424] [DEBUG] [LOCAL ] SMP: Loaded 19030 existing records from primary storage. [2025-10-07T22:42:37.220890] [INFO ] [MAIN ] SMP: Loaded 19030 primary data records. [2025-10-07T22:42:37.570867] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-07T22:42:37.694636] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-07T22:42:37.697326] [INFO ] [MAIN ] Derivative Progress: 1344/1748 symbols completed. SMG took 1.7s. Estimated remaining: 2m 35s. Rate: 156.2 symbols/min [2025-10-07T22:42:37.698206] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:37.730022] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:37.731450] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13095 primary records. [2025-10-07T22:42:37.731765] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-07T22:42:37.767911] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-10-07T22:42:37.767817] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:37.781851] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-07T22:42:37.783073] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19030 primary records. [2025-10-07T22:42:37.783286] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-07T22:42:37.785787] [INFO ] [MAIN ] Derivative Progress: 1345/1748 symbols completed. SMHI took 0.8s. Estimated remaining: 2m 35s. Rate: 156.3 symbols/min [2025-10-07T22:42:37.786178] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:37.823910] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-07T22:42:37.823176] [DEBUG] [LOCAL ] SMR: Loaded 53798 existing records from primary storage. [2025-10-07T22:42:37.824101] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-07T22:42:37.826845] [INFO ] [MAIN ] Derivative Progress: 1346/1748 symbols completed. SMP took 0.8s. Estimated remaining: 2m 34s. Rate: 156.4 symbols/min [2025-10-07T22:42:37.827196] [INFO ] [MAIN ] SMR: Loaded 53798 primary data records. [2025-10-07T22:42:37.827095] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:38.083552] [DEBUG] [LOCAL ] SMRT: Loaded 44033 existing records from primary storage. [2025-10-07T22:42:38.200971] [INFO ] [MAIN ] SMRT: Loaded 44033 primary data records. [2025-10-07T22:42:38.200813] [DEBUG] [LOCAL ] SMWB: Loaded 32300 existing records from primary storage. [2025-10-07T22:42:38.201409] [INFO ] [MAIN ] SMWB: Loaded 32300 primary data records. [2025-10-07T22:42:38.915939] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:38.918814] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53798 primary records. [2025-10-07T22:42:38.919349] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-07T22:42:38.944484] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-10-07T22:42:38.944740] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-07T22:42:38.947069] [INFO ] [MAIN ] Derivative Progress: 1347/1748 symbols completed. SMR took 1.2s. Estimated remaining: 2m 34s. Rate: 156.2 symbols/min [2025-10-07T22:42:38.947557] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:38.967959] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:38.977360] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 44033 primary records. [2025-10-07T22:42:38.982920] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:38.983014] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-07T22:42:38.983672] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32300 primary records. [2025-10-07T22:42:38.984459] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-07T22:42:39.022737] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-07T22:42:39.023492] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-07T22:42:39.026005] [INFO ] [MAIN ] Derivative Progress: 1348/1748 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 34s. Rate: 156.2 symbols/min [2025-10-07T22:42:39.030308] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-10-07T22:42:39.030394] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-07T22:42:39.032594] [INFO ] [MAIN ] Derivative Progress: 1349/1748 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 33s. Rate: 156.4 symbols/min [2025-10-07T22:42:39.074856] [DEBUG] [LOCAL ] SN: Loaded 49906 existing records from primary storage. [2025-10-07T22:42:39.075047] [INFO ] [MAIN ] SN: Loaded 49906 primary data records. [2025-10-07T22:42:39.416955] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:39.417707] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49906 primary records. [2025-10-07T22:42:39.417789] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-07T22:42:39.434896] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-07T22:42:39.435037] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-07T22:42:39.437051] [INFO ] [MAIN ] Derivative Progress: 1350/1748 symbols completed. SN took 0.5s. Estimated remaining: 2m 33s. Rate: 156.4 symbols/min [2025-10-07T22:42:39.437509] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:39.437639] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:39.438758] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:39.448140] [DEBUG] [LOCAL ] SNDA: Loaded 4458 existing records from primary storage. [2025-10-07T22:42:39.448403] [INFO ] [MAIN ] SNDA: Loaded 4458 primary data records. [2025-10-07T22:42:39.757518] [DEBUG] [LOCAL ] SNA: Loaded 25689 existing records from primary storage. [2025-10-07T22:42:39.833038] [INFO ] [MAIN ] SNA: Loaded 25689 primary data records. [2025-10-07T22:42:39.847500] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-07T22:42:39.873677] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-07T22:42:40.510154] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:40.511458] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4458 primary records. [2025-10-07T22:42:40.511772] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-07T22:42:40.527963] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-10-07T22:42:40.528251] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-07T22:42:40.530580] [INFO ] [MAIN ] Derivative Progress: 1351/1748 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 33s. Rate: 156.1 symbols/min [2025-10-07T22:42:40.531189] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:40.554395] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:40.555528] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25689 primary records. [2025-10-07T22:42:40.556639] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-07T22:42:40.585755] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:40.588540] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-07T22:42:40.588704] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-07T22:42:40.589518] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-07T22:42:40.591730] [INFO ] [MAIN ] Derivative Progress: 1352/1748 symbols completed. SNA took 1.2s. Estimated remaining: 2m 32s. Rate: 156.2 symbols/min [2025-10-07T22:42:40.601560] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:40.601389] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-07T22:42:40.631963] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-07T22:42:40.632112] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-07T22:42:40.634330] [INFO ] [MAIN ] Derivative Progress: 1353/1748 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 32s. Rate: 156.3 symbols/min [2025-10-07T22:42:40.634546] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:40.635779] [DEBUG] [LOCAL ] SNDR: Loaded 41045 existing records from primary storage. [2025-10-07T22:42:40.636355] [INFO ] [MAIN ] SNDR: Loaded 41045 primary data records. [2025-10-07T22:42:40.984102] [DEBUG] [LOCAL ] SNN: Loaded 44165 existing records from primary storage. [2025-10-07T22:42:40.993783] [INFO ] [MAIN ] SNN: Loaded 44165 primary data records. [2025-10-07T22:42:41.182039] [DEBUG] [LOCAL ] SNOW: Loaded 53593 existing records from primary storage. [2025-10-07T22:42:41.207323] [INFO ] [MAIN ] SNOW: Loaded 53593 primary data records. [2025-10-07T22:42:41.656357] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:41.657968] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 41045 primary records. [2025-10-07T22:42:41.658361] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-07T22:42:41.678612] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-07T22:42:41.679897] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-07T22:42:41.682679] [INFO ] [MAIN ] Derivative Progress: 1354/1748 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 31s. Rate: 156.1 symbols/min [2025-10-07T22:42:41.690963] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:41.697085] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:41.697860] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44165 primary records. [2025-10-07T22:42:41.698029] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-07T22:42:41.732508] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:41.732194] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-07T22:42:41.732670] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-07T22:42:41.733398] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53593 primary records. [2025-10-07T22:42:41.735968] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-07T22:42:41.735785] [INFO ] [MAIN ] Derivative Progress: 1355/1748 symbols completed. SNN took 1.1s. Estimated remaining: 2m 31s. Rate: 156.2 symbols/min [2025-10-07T22:42:41.736573] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:41.764672] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-10-07T22:42:41.764892] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-07T22:42:41.767102] [INFO ] [MAIN ] Derivative Progress: 1356/1748 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 30s. Rate: 156.3 symbols/min [2025-10-07T22:42:41.767310] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:41.787257] [DEBUG] [LOCAL ] SNV: Loaded 48867 existing records from primary storage. [2025-10-07T22:42:41.787720] [INFO ] [MAIN ] SNV: Loaded 48867 primary data records. [2025-10-07T22:42:42.121750] [DEBUG] [LOCAL ] SNX: Loaded 40068 existing records from primary storage. [2025-10-07T22:42:42.131214] [INFO ] [MAIN ] SNX: Loaded 40068 primary data records. [2025-10-07T22:42:42.183688] [DEBUG] [LOCAL ] SO: Loaded 53607 existing records from primary storage. [2025-10-07T22:42:42.203331] [INFO ] [MAIN ] SO: Loaded 53607 primary data records. [2025-10-07T22:42:42.835306] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:42.836524] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48867 primary records. [2025-10-07T22:42:42.836908] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-07T22:42:42.858870] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-07T22:42:42.859639] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-07T22:42:42.861973] [INFO ] [MAIN ] Derivative Progress: 1357/1748 symbols completed. SNV took 1.2s. Estimated remaining: 2m 30s. Rate: 156.1 symbols/min [2025-10-07T22:42:42.862290] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:42.877129] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:42.877922] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 40068 primary records. [2025-10-07T22:42:42.879874] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-07T22:42:42.907409] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:42.908723] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53607 primary records. [2025-10-07T22:42:42.909054] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-07T22:42:42.929350] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-10-07T22:42:42.929271] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-07T22:42:42.937679] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-07T22:42:42.939697] [INFO ] [MAIN ] Derivative Progress: 1358/1748 symbols completed. SNX took 1.2s. Estimated remaining: 2m 30s. Rate: 156.2 symbols/min [2025-10-07T22:42:42.937612] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-07T22:42:42.942146] [INFO ] [MAIN ] Derivative Progress: 1359/1748 symbols completed. SO took 1.2s. Estimated remaining: 2m 29s. Rate: 156.3 symbols/min [2025-10-07T22:42:42.942025] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:42.942434] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:42.959143] [DEBUG] [LOCAL ] SOBO: Loaded 39360 existing records from primary storage. [2025-10-07T22:42:42.959465] [INFO ] [MAIN ] SOBO: Loaded 39360 primary data records. [2025-10-07T22:42:42.983314] [DEBUG] [LOCAL ] SOJC: Loaded 4996 existing records from primary storage. [2025-10-07T22:42:42.993994] [INFO ] [MAIN ] SOJC: Loaded 4996 primary data records. [2025-10-07T22:42:43.537947] [DEBUG] [LOCAL ] SOC: Loaded 50620 existing records from primary storage. [2025-10-07T22:42:43.596639] [INFO ] [MAIN ] SOC: Loaded 50620 primary data records. [2025-10-07T22:42:43.954455] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:43.955568] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39360 primary records. [2025-10-07T22:42:43.955797] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-07T22:42:43.986285] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-07T22:42:43.986195] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:43.988296] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 4996 primary records. [2025-10-07T22:42:43.987346] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-07T22:42:43.990923] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-07T22:42:43.990836] [INFO ] [MAIN ] Derivative Progress: 1360/1748 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 29s. Rate: 156.1 symbols/min [2025-10-07T22:42:44.000779] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:44.008872] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-10-07T22:42:44.009252] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-07T22:42:44.011872] [INFO ] [MAIN ] Derivative Progress: 1361/1748 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 29s. Rate: 156.2 symbols/min [2025-10-07T22:42:44.012182] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:44.035276] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:44.036100] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50620 primary records. [2025-10-07T22:42:44.036268] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-07T22:42:44.053066] [DEBUG] [LOCAL ] SOJD: Loaded 12988 existing records from primary storage. [2025-10-07T22:42:44.053365] [DEBUG] [LOCAL ] SOJE: Loaded 9118 existing records from primary storage. [2025-10-07T22:42:44.057243] [INFO ] [MAIN ] SOJD: Loaded 12988 primary data records. [2025-10-07T22:42:44.057607] [INFO ] [MAIN ] SOJE: Loaded 9118 primary data records. [2025-10-07T22:42:44.272600] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-07T22:42:44.293790] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-07T22:42:44.296047] [INFO ] [MAIN ] Derivative Progress: 1362/1748 symbols completed. SOC took 1.4s. Estimated remaining: 2m 28s. Rate: 156.3 symbols/min [2025-10-07T22:42:44.296203] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:44.730367] [DEBUG] [LOCAL ] SOL: Loaded 12966 existing records from primary storage. [2025-10-07T22:42:44.731194] [INFO ] [MAIN ] SOL: Loaded 12966 primary data records. [2025-10-07T22:42:45.075916] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:45.091308] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9118 primary records. [2025-10-07T22:42:45.092371] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:45.092596] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-07T22:42:45.093306] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12988 primary records. [2025-10-07T22:42:45.094347] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-07T22:42:45.125279] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-07T22:42:45.126886] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-07T22:42:45.129288] [INFO ] [MAIN ] Derivative Progress: 1363/1748 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 28s. Rate: 156.1 symbols/min [2025-10-07T22:42:45.132251] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-07T22:42:45.132386] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-07T22:42:45.134547] [INFO ] [MAIN ] Derivative Progress: 1364/1748 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 27s. Rate: 156.3 symbols/min [2025-10-07T22:42:45.151633] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:45.152322] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 12966 primary records. [2025-10-07T22:42:45.152383] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-07T22:42:45.168451] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-07T22:42:45.168554] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-07T22:42:45.170839] [INFO ] [MAIN ] Derivative Progress: 1365/1748 symbols completed. SOL took 0.9s. Estimated remaining: 2m 27s. Rate: 156.4 symbols/min [2025-10-07T22:42:45.171811] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:45.171910] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:45.172044] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:45.178992] [DEBUG] [LOCAL ] SOR: Loaded 2872 existing records from primary storage. [2025-10-07T22:42:45.179178] [INFO ] [MAIN ] SOR: Loaded 2872 primary data records. [2025-10-07T22:42:45.546158] [DEBUG] [LOCAL ] SON: Loaded 43009 existing records from primary storage. [2025-10-07T22:42:45.561668] [INFO ] [MAIN ] SON: Loaded 43009 primary data records. [2025-10-07T22:42:45.563218] [DEBUG] [LOCAL ] SONY: Loaded 53373 existing records from primary storage. [2025-10-07T22:42:45.563455] [INFO ] [MAIN ] SONY: Loaded 53373 primary data records. [2025-10-07T22:42:46.213180] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:46.215527] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2872 primary records. [2025-10-07T22:42:46.216299] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-07T22:42:46.234199] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-10-07T22:42:46.234823] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-07T22:42:46.237310] [INFO ] [MAIN ] Derivative Progress: 1366/1748 symbols completed. SOR took 1.1s. Estimated remaining: 2m 27s. Rate: 156.2 symbols/min [2025-10-07T22:42:46.237728] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:46.250923] [DEBUG] [LOCAL ] SOS: Loaded 9086 existing records from primary storage. [2025-10-07T22:42:46.251629] [INFO ] [MAIN ] SOS: Loaded 9086 primary data records. [2025-10-07T22:42:46.441873] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:46.586491] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53373 primary records. [2025-10-07T22:42:46.576814] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:46.588097] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43009 primary records. [2025-10-07T22:42:46.587199] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-07T22:42:46.589116] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-07T22:42:46.622905] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-07T22:42:46.623489] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-07T22:42:46.627531] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-07T22:42:46.626896] [INFO ] [MAIN ] Derivative Progress: 1367/1748 symbols completed. SONY took 1.5s. Estimated remaining: 2m 26s. Rate: 156.2 symbols/min [2025-10-07T22:42:46.627729] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-07T22:42:46.630079] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:46.631821] [INFO ] [MAIN ] Derivative Progress: 1368/1748 symbols completed. SON took 1.5s. Estimated remaining: 2m 26s. Rate: 156.3 symbols/min [2025-10-07T22:42:46.632006] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:46.652079] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:42:46.652795] [INFO ] [MAIN ] SOS: Generated 1793 derivative records from 9086 primary records. [2025-10-07T22:42:46.652908] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-07T22:42:46.670068] [DEBUG] [LOCAL ] SOS: Derivative data saved (1793 records). [2025-10-07T22:42:46.678271] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-07T22:42:46.680462] [INFO ] [MAIN ] Derivative Progress: 1369/1748 symbols completed. SOS took 0.4s. Estimated remaining: 2m 25s. Rate: 156.4 symbols/min [2025-10-07T22:42:46.680751] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:46.705212] [DEBUG] [LOCAL ] SPB: Loaded 34229 existing records from primary storage. [2025-10-07T22:42:46.705393] [INFO ] [MAIN ] SPB: Loaded 34229 primary data records. [2025-10-07T22:42:46.750539] [DEBUG] [LOCAL ] SPE: Loaded 6284 existing records from primary storage. [2025-10-07T22:42:46.763305] [INFO ] [MAIN ] SPE: Loaded 6284 primary data records. [2025-10-07T22:42:46.842592] [DEBUG] [LOCAL ] SPCE: Loaded 49928 existing records from primary storage. [2025-10-07T22:42:46.884455] [INFO ] [MAIN ] SPCE: Loaded 49928 primary data records. [2025-10-07T22:42:47.676715] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:47.677713] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34229 primary records. [2025-10-07T22:42:47.680423] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-07T22:42:47.707333] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:47.709856] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6284 primary records. [2025-10-07T22:42:47.711629] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-07T22:42:47.715420] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-07T22:42:47.722231] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-07T22:42:47.736845] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:47.741462] [INFO ] [MAIN ] Derivative Progress: 1370/1748 symbols completed. SPB took 1.1s. Estimated remaining: 2m 25s. Rate: 156.2 symbols/min [2025-10-07T22:42:47.741616] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:47.742359] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49928 primary records. [2025-10-07T22:42:47.743886] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-07T22:42:47.763293] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-10-07T22:42:47.764180] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-07T22:42:47.764074] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-07T22:42:47.764407] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-07T22:42:47.767019] [INFO ] [MAIN ] Derivative Progress: 1371/1748 symbols completed. SPE took 1.1s. Estimated remaining: 2m 25s. Rate: 156.3 symbols/min [2025-10-07T22:42:47.769543] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:47.769632] [INFO ] [MAIN ] Derivative Progress: 1372/1748 symbols completed. SPCE took 1.1s. Estimated remaining: 2m 24s. Rate: 156.4 symbols/min [2025-10-07T22:42:47.770092] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:47.789974] [DEBUG] [LOCAL ] SPH: Loaded 17016 existing records from primary storage. [2025-10-07T22:42:47.790121] [INFO ] [MAIN ] SPH: Loaded 17016 primary data records. [2025-10-07T22:42:47.982454] [DEBUG] [LOCAL ] SPGI: Loaded 45765 existing records from primary storage. [2025-10-07T22:42:48.018372] [INFO ] [MAIN ] SPGI: Loaded 45765 primary data records. [2025-10-07T22:42:48.139871] [DEBUG] [LOCAL ] SPG: Loaded 50253 existing records from primary storage. [2025-10-07T22:42:48.161274] [INFO ] [MAIN ] SPG: Loaded 50253 primary data records. [2025-10-07T22:42:48.826083] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:48.828991] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 17016 primary records. [2025-10-07T22:42:48.829497] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-07T22:42:48.848159] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-07T22:42:48.848630] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-07T22:42:48.850857] [INFO ] [MAIN ] Derivative Progress: 1373/1748 symbols completed. SPH took 1.1s. Estimated remaining: 2m 24s. Rate: 156.2 symbols/min [2025-10-07T22:42:48.851326] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:48.874710] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:48.876235] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45765 primary records. [2025-10-07T22:42:48.876527] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-07T22:42:48.902777] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:48.905513] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50253 primary records. [2025-10-07T22:42:48.909842] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-07T22:42:48.911609] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-07T22:42:48.911723] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-07T22:42:48.914095] [INFO ] [MAIN ] Derivative Progress: 1374/1748 symbols completed. SPGI took 1.1s. Estimated remaining: 2m 24s. Rate: 156.3 symbols/min [2025-10-07T22:42:48.925355] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:48.940505] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-07T22:42:48.940628] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-07T22:42:48.942927] [INFO ] [MAIN ] Derivative Progress: 1375/1748 symbols completed. SPG took 1.2s. Estimated remaining: 2m 23s. Rate: 156.4 symbols/min [2025-10-07T22:42:48.943148] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:48.960283] [DEBUG] [LOCAL ] SPHR: Loaded 40260 existing records from primary storage. [2025-10-07T22:42:48.960560] [INFO ] [MAIN ] SPHR: Loaded 40260 primary data records. [2025-10-07T22:42:49.000559] [DEBUG] [LOCAL ] SPMC: Loaded 5333 existing records from primary storage. [2025-10-07T22:42:49.019064] [INFO ] [MAIN ] SPMC: Loaded 5333 primary data records. [2025-10-07T22:42:49.254067] [DEBUG] [LOCAL ] SPIR: Loaded 37275 existing records from primary storage. [2025-10-07T22:42:49.281703] [INFO ] [MAIN ] SPIR: Loaded 37275 primary data records. [2025-10-07T22:42:49.968862] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:49.973389] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40260 primary records. [2025-10-07T22:42:49.973891] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-07T22:42:50.004125] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:42:50.006535] [INFO ] [MAIN ] SPMC: Generated 1793 derivative records from 5333 primary records. [2025-10-07T22:42:50.007261] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-07T22:42:50.009276] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-10-07T22:42:50.009516] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-07T22:42:50.011683] [INFO ] [MAIN ] Derivative Progress: 1376/1748 symbols completed. SPHR took 1.2s. Estimated remaining: 2m 23s. Rate: 156.2 symbols/min [2025-10-07T22:42:50.018427] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:50.031198] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1793 records). [2025-10-07T22:42:50.031404] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-07T22:42:50.034000] [INFO ] [MAIN ] Derivative Progress: 1377/1748 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 22s. Rate: 156.3 symbols/min [2025-10-07T22:42:50.048595] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:50.047821] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:50.049629] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37275 primary records. [2025-10-07T22:42:50.050107] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-07T22:42:50.067917] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-07T22:42:50.068062] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-07T22:42:50.071100] [INFO ] [MAIN ] Derivative Progress: 1378/1748 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 22s. Rate: 156.4 symbols/min [2025-10-07T22:42:50.098434] [DEBUG] [LOCAL ] SPNT: Loaded 34803 existing records from primary storage. [2025-10-07T22:42:50.098597] [INFO ] [MAIN ] SPNT: Loaded 34803 primary data records. [2025-10-07T22:42:50.431205] [DEBUG] [LOCAL ] SPOT: Loaded 50482 existing records from primary storage. [2025-10-07T22:42:50.431436] [INFO ] [MAIN ] SPOT: Loaded 50482 primary data records. [2025-10-07T22:42:50.804127] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:50.805690] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34803 primary records. [2025-10-07T22:42:50.805854] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-07T22:42:50.823733] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-07T22:42:50.823917] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-07T22:42:50.826126] [INFO ] [MAIN ] Derivative Progress: 1379/1748 symbols completed. SPNT took 0.8s. Estimated remaining: 2m 22s. Rate: 156.3 symbols/min [2025-10-07T22:42:50.842368] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:50.843109] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50482 primary records. [2025-10-07T22:42:50.843171] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-07T22:42:50.859207] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-10-07T22:42:50.859340] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-07T22:42:50.861607] [INFO ] [MAIN ] Derivative Progress: 1380/1748 symbols completed. SPOT took 0.8s. Estimated remaining: 2m 21s. Rate: 156.4 symbols/min [2025-10-07T22:42:50.862132] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:50.862290] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:50.862204] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:50.876038] [DEBUG] [LOCAL ] SPRU: Loaded 9437 existing records from primary storage. [2025-10-07T22:42:50.876171] [INFO ] [MAIN ] SPRU: Loaded 9437 primary data records. [2025-10-07T22:42:51.008201] [DEBUG] [LOCAL ] SPXC: Loaded 23293 existing records from primary storage. [2025-10-07T22:42:51.012527] [INFO ] [MAIN ] SPXC: Loaded 23293 primary data records. [2025-10-07T22:42:51.106302] [DEBUG] [LOCAL ] SPR: Loaded 41108 existing records from primary storage. [2025-10-07T22:42:51.184754] [INFO ] [MAIN ] SPR: Loaded 41108 primary data records. [2025-10-07T22:42:51.872444] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:51.873411] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 9437 primary records. [2025-10-07T22:42:51.873764] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-07T22:42:51.908628] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-07T22:42:51.910994] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-07T22:42:51.913102] [INFO ] [MAIN ] Derivative Progress: 1381/1748 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 21s. Rate: 156.2 symbols/min [2025-10-07T22:42:51.913316] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:51.910805] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:51.914489] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23293 primary records. [2025-10-07T22:42:51.914721] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-07T22:42:51.929623] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:51.930440] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41108 primary records. [2025-10-07T22:42:51.930791] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-07T22:42:51.959064] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-07T22:42:51.962241] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-07T22:42:51.964752] [INFO ] [MAIN ] Derivative Progress: 1382/1748 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 21s. Rate: 156.3 symbols/min [2025-10-07T22:42:51.965868] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:51.971398] [DEBUG] [LOCAL ] SPXX: Loaded 9407 existing records from primary storage. [2025-10-07T22:42:51.972212] [INFO ] [MAIN ] SPXX: Loaded 9407 primary data records. [2025-10-07T22:42:52.032032] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-07T22:42:52.053587] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-07T22:42:52.061108] [INFO ] [MAIN ] Derivative Progress: 1383/1748 symbols completed. SPR took 1.2s. Estimated remaining: 2m 20s. Rate: 156.4 symbols/min [2025-10-07T22:42:52.061343] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:52.312682] [DEBUG] [LOCAL ] SQM: Loaded 48616 existing records from primary storage. [2025-10-07T22:42:52.321064] [INFO ] [MAIN ] SQM: Loaded 48616 primary data records. [2025-10-07T22:42:52.322544] [DEBUG] [LOCAL ] SQNS: Loaded 26867 existing records from primary storage. [2025-10-07T22:42:52.322880] [INFO ] [MAIN ] SQNS: Loaded 26867 primary data records. [2025-10-07T22:42:53.003327] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:53.004586] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9407 primary records. [2025-10-07T22:42:53.005704] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-07T22:42:53.024372] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-07T22:42:53.024722] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-07T22:42:53.027004] [INFO ] [MAIN ] Derivative Progress: 1384/1748 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 20s. Rate: 156.2 symbols/min [2025-10-07T22:42:53.027584] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:53.049477] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:53.051067] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 26867 primary records. [2025-10-07T22:42:53.051349] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-07T22:42:53.077110] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:53.078616] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48616 primary records. [2025-10-07T22:42:53.081087] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-07T22:42:53.103419] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-07T22:42:53.104949] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-07T22:42:53.109367] [INFO ] [MAIN ] Derivative Progress: 1385/1748 symbols completed. SQNS took 1.0s. Estimated remaining: 2m 19s. Rate: 156.3 symbols/min [2025-10-07T22:42:53.110138] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:53.110561] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-10-07T22:42:53.110931] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-07T22:42:53.113724] [INFO ] [MAIN ] Derivative Progress: 1386/1748 symbols completed. SQM took 1.1s. Estimated remaining: 2m 19s. Rate: 156.4 symbols/min [2025-10-07T22:42:53.113963] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:53.125987] [DEBUG] [LOCAL ] SR: Loaded 32712 existing records from primary storage. [2025-10-07T22:42:53.126269] [INFO ] [MAIN ] SR: Loaded 32712 primary data records. [2025-10-07T22:42:53.247686] [DEBUG] [LOCAL ] SREA: Loaded 10251 existing records from primary storage. [2025-10-07T22:42:53.258687] [INFO ] [MAIN ] SREA: Loaded 10251 primary data records. [2025-10-07T22:42:53.646851] [DEBUG] [LOCAL ] SRE: Loaded 53416 existing records from primary storage. [2025-10-07T22:42:53.650767] [INFO ] [MAIN ] SRE: Loaded 53416 primary data records. [2025-10-07T22:42:54.098152] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:54.101064] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32712 primary records. [2025-10-07T22:42:54.101212] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-07T22:42:54.125850] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:54.129850] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10251 primary records. [2025-10-07T22:42:54.129964] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-07T22:42:54.150374] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-07T22:42:54.151628] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-10-07T22:42:54.151784] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-07T22:42:54.150615] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-07T22:42:54.154109] [INFO ] [MAIN ] Derivative Progress: 1387/1748 symbols completed. SR took 1.1s. Estimated remaining: 2m 19s. Rate: 156.2 symbols/min [2025-10-07T22:42:54.156685] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:54.157421] [INFO ] [MAIN ] Derivative Progress: 1388/1748 symbols completed. SREA took 1.0s. Estimated remaining: 2m 18s. Rate: 156.3 symbols/min [2025-10-07T22:42:54.158000] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:54.174558] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:54.175254] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53416 primary records. [2025-10-07T22:42:54.175317] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-07T22:42:54.202548] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-10-07T22:42:54.202820] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-07T22:42:54.206249] [DEBUG] [LOCAL ] SRG: Loaded 15472 existing records from primary storage. [2025-10-07T22:42:54.206479] [INFO ] [MAIN ] SRG: Loaded 15472 primary data records. [2025-10-07T22:42:54.205439] [INFO ] [MAIN ] Derivative Progress: 1389/1748 symbols completed. SRE took 1.1s. Estimated remaining: 2m 18s. Rate: 156.4 symbols/min [2025-10-07T22:42:54.239400] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:54.347601] [DEBUG] [LOCAL ] SRFM: Loaded 37579 existing records from primary storage. [2025-10-07T22:42:54.371767] [INFO ] [MAIN ] SRFM: Loaded 37579 primary data records. [2025-10-07T22:42:54.673472] [DEBUG] [LOCAL ] SRI: Loaded 26802 existing records from primary storage. [2025-10-07T22:42:54.673890] [INFO ] [MAIN ] SRI: Loaded 26802 primary data records. [2025-10-07T22:42:55.236247] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:42:55.237143] [INFO ] [MAIN ] SRG: Generated 1793 derivative records from 15472 primary records. [2025-10-07T22:42:55.237432] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-07T22:42:55.269767] [DEBUG] [LOCAL ] SRG: Derivative data saved (1793 records). [2025-10-07T22:42:55.270328] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:55.270061] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-07T22:42:55.273422] [INFO ] [MAIN ] Derivative Progress: 1390/1748 symbols completed. SRG took 1.1s. Estimated remaining: 2m 18s. Rate: 156.2 symbols/min [2025-10-07T22:42:55.271199] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 37579 primary records. [2025-10-07T22:42:55.273722] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-07T22:42:55.274867] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:55.306899] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:55.308639] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 26802 primary records. [2025-10-07T22:42:55.308988] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-07T22:42:55.321174] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-10-07T22:42:55.321482] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-07T22:42:55.321415] [DEBUG] [LOCAL ] SRV: Loaded 7351 existing records from primary storage. [2025-10-07T22:42:55.330310] [INFO ] [MAIN ] Derivative Progress: 1391/1748 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 17s. Rate: 156.3 symbols/min [2025-10-07T22:42:55.330985] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:55.330877] [INFO ] [MAIN ] SRV: Loaded 7351 primary data records. [2025-10-07T22:42:55.331734] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-07T22:42:55.343317] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-07T22:42:55.364706] [INFO ] [MAIN ] Derivative Progress: 1392/1748 symbols completed. SRI took 1.1s. Estimated remaining: 2m 17s. Rate: 156.4 symbols/min [2025-10-07T22:42:55.389972] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:55.662856] [DEBUG] [LOCAL ] SSD: Loaded 22498 existing records from primary storage. [2025-10-07T22:42:55.663762] [INFO ] [MAIN ] SSD: Loaded 22498 primary data records. [2025-10-07T22:42:55.769053] [DEBUG] [LOCAL ] SSB: Loaded 42687 existing records from primary storage. [2025-10-07T22:42:55.783737] [INFO ] [MAIN ] SSB: Loaded 42687 primary data records. [2025-10-07T22:42:56.173949] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:56.195826] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7351 primary records. [2025-10-07T22:42:56.196118] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-07T22:42:56.346147] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-07T22:42:56.346813] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-07T22:42:56.349242] [INFO ] [MAIN ] Derivative Progress: 1393/1748 symbols completed. SRV took 1.1s. Estimated remaining: 2m 16s. Rate: 156.2 symbols/min [2025-10-07T22:42:56.369855] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:56.370763] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22498 primary records. [2025-10-07T22:42:56.370971] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-07T22:42:56.402742] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:56.404210] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42687 primary records. [2025-10-07T22:42:56.404293] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-07T22:42:56.404701] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-10-07T22:42:56.405449] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-07T22:42:56.407775] [INFO ] [MAIN ] Derivative Progress: 1394/1748 symbols completed. SSD took 1.0s. Estimated remaining: 2m 16s. Rate: 156.3 symbols/min [2025-10-07T22:42:56.423394] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-07T22:42:56.423489] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-07T22:42:56.425638] [INFO ] [MAIN ] Derivative Progress: 1395/1748 symbols completed. SSB took 1.1s. Estimated remaining: 2m 15s. Rate: 156.4 symbols/min [2025-10-07T22:42:56.426114] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:56.426338] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:56.426242] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:56.451562] [DEBUG] [LOCAL ] SST: Loaded 11825 existing records from primary storage. [2025-10-07T22:42:56.451812] [INFO ] [MAIN ] SST: Loaded 11825 primary data records. [2025-10-07T22:42:56.551229] [DEBUG] [LOCAL ] SSTK: Loaded 25665 existing records from primary storage. [2025-10-07T22:42:56.585587] [DEBUG] [LOCAL ] SSL: Loaded 41347 existing records from primary storage. [2025-10-07T22:42:56.585730] [INFO ] [MAIN ] SSTK: Loaded 25665 primary data records. [2025-10-07T22:42:56.586339] [INFO ] [MAIN ] SSL: Loaded 41347 primary data records. [2025-10-07T22:42:57.469531] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:57.471031] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11825 primary records. [2025-10-07T22:42:57.471316] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-07T22:42:57.492027] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-10-07T22:42:57.505050] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-07T22:42:57.507140] [INFO ] [MAIN ] Derivative Progress: 1396/1748 symbols completed. SST took 1.1s. Estimated remaining: 2m 15s. Rate: 156.2 symbols/min [2025-10-07T22:42:57.515859] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:57.507526] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:57.521530] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 25665 primary records. [2025-10-07T22:42:57.522241] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:57.522325] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-07T22:42:57.522952] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41347 primary records. [2025-10-07T22:42:57.523288] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-07T22:42:57.554497] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-10-07T22:42:57.555112] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-07T22:42:57.558187] [INFO ] [MAIN ] Derivative Progress: 1397/1748 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 15s. Rate: 156.3 symbols/min [2025-10-07T22:42:57.558500] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:57.561009] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-07T22:42:57.562741] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-07T22:42:57.565058] [INFO ] [MAIN ] Derivative Progress: 1398/1748 symbols completed. SSL took 1.1s. Estimated remaining: 2m 14s. Rate: 156.4 symbols/min [2025-10-07T22:42:57.565543] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:57.602500] [DEBUG] [LOCAL ] STC: Loaded 17406 existing records from primary storage. [2025-10-07T22:42:57.602666] [INFO ] [MAIN ] STC: Loaded 17406 primary data records. [2025-10-07T22:42:57.748268] [DEBUG] [LOCAL ] ST: Loaded 49790 existing records from primary storage. [2025-10-07T22:42:57.779136] [INFO ] [MAIN ] ST: Loaded 49790 primary data records. [2025-10-07T22:42:58.024144] [DEBUG] [LOCAL ] STAG: Loaded 50117 existing records from primary storage. [2025-10-07T22:42:58.037479] [INFO ] [MAIN ] STAG: Loaded 50117 primary data records. [2025-10-07T22:42:58.593598] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:58.594905] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17406 primary records. [2025-10-07T22:42:58.595249] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-07T22:42:58.614467] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-07T22:42:58.615975] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-07T22:42:58.619707] [INFO ] [MAIN ] Derivative Progress: 1399/1748 symbols completed. STC took 1.1s. Estimated remaining: 2m 14s. Rate: 156.2 symbols/min [2025-10-07T22:42:58.621255] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:58.636862] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:58.637966] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49790 primary records. [2025-10-07T22:42:58.638183] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-07T22:42:58.671257] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:58.673328] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50117 primary records. [2025-10-07T22:42:58.672541] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-07T22:42:58.673539] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-07T22:42:58.673470] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-07T22:42:58.675878] [INFO ] [MAIN ] Derivative Progress: 1400/1748 symbols completed. ST took 1.2s. Estimated remaining: 2m 14s. Rate: 156.3 symbols/min [2025-10-07T22:42:58.676894] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:58.714984] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-07T22:42:58.715294] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-07T22:42:58.717500] [INFO ] [MAIN ] Derivative Progress: 1401/1748 symbols completed. STAG took 1.2s. Estimated remaining: 2m 13s. Rate: 156.4 symbols/min [2025-10-07T22:42:58.717741] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:58.718756] [DEBUG] [LOCAL ] STE: Loaded 35541 existing records from primary storage. [2025-10-07T22:42:58.725005] [INFO ] [MAIN ] STE: Loaded 35541 primary data records. [2025-10-07T22:42:58.803719] [DEBUG] [LOCAL ] STEL: Loaded 22963 existing records from primary storage. [2025-10-07T22:42:58.815245] [INFO ] [MAIN ] STEL: Loaded 22963 primary data records. [2025-10-07T22:42:59.187814] [DEBUG] [LOCAL ] STEM: Loaded 39149 existing records from primary storage. [2025-10-07T22:42:59.198887] [INFO ] [MAIN ] STEM: Loaded 39149 primary data records. [2025-10-07T22:42:59.736338] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:59.737264] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35541 primary records. [2025-10-07T22:42:59.737828] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-07T22:42:59.769549] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:59.771074] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 22963 primary records. [2025-10-07T22:42:59.771454] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-07T22:42:59.781156] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-10-07T22:42:59.784757] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-07T22:42:59.788412] [INFO ] [MAIN ] Derivative Progress: 1402/1748 symbols completed. STE took 1.2s. Estimated remaining: 2m 13s. Rate: 156.2 symbols/min [2025-10-07T22:42:59.789255] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:59.795349] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-07T22:42:59.795766] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-07T22:42:59.798243] [INFO ] [MAIN ] Derivative Progress: 1403/1748 symbols completed. STEL took 1.1s. Estimated remaining: 2m 12s. Rate: 156.3 symbols/min [2025-10-07T22:42:59.798679] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:42:59.814110] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:42:59.815058] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 39149 primary records. [2025-10-07T22:42:59.815186] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-07T22:42:59.849633] [DEBUG] [LOCAL ] STK: Loaded 9561 existing records from primary storage. [2025-10-07T22:42:59.850430] [INFO ] [MAIN ] STK: Loaded 9561 primary data records. [2025-10-07T22:42:59.848923] [DEBUG] [LOCAL ] STEW: Loaded 16168 existing records from primary storage. [2025-10-07T22:42:59.850576] [INFO ] [MAIN ] STEW: Loaded 16168 primary data records. [2025-10-07T22:42:59.850777] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-07T22:42:59.881718] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-07T22:42:59.937777] [INFO ] [MAIN ] Derivative Progress: 1404/1748 symbols completed. STEM took 1.2s. Estimated remaining: 2m 12s. Rate: 156.4 symbols/min [2025-10-07T22:42:59.970247] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:00.483343] [DEBUG] [LOCAL ] STLA: Loaded 53552 existing records from primary storage. [2025-10-07T22:43:00.484182] [INFO ] [MAIN ] STLA: Loaded 53552 primary data records. [2025-10-07T22:43:00.795964] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:00.867878] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16168 primary records. [2025-10-07T22:43:00.868046] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-07T22:43:00.866704] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:00.878283] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9561 primary records. [2025-10-07T22:43:00.881548] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-07T22:43:00.902590] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-07T22:43:00.902949] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-07T22:43:00.906225] [INFO ] [MAIN ] Derivative Progress: 1405/1748 symbols completed. STEW took 1.1s. Estimated remaining: 2m 12s. Rate: 156.3 symbols/min [2025-10-07T22:43:00.907547] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:00.909444] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-07T22:43:00.909834] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-07T22:43:00.912204] [INFO ] [MAIN ] Derivative Progress: 1406/1748 symbols completed. STK took 1.1s. Estimated remaining: 2m 11s. Rate: 156.4 symbols/min [2025-10-07T22:43:00.912362] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:00.932851] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:00.933420] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53552 primary records. [2025-10-07T22:43:00.933480] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-07T22:43:00.957423] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-07T22:43:00.957757] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-07T22:43:00.960023] [INFO ] [MAIN ] Derivative Progress: 1407/1748 symbols completed. STLA took 1.0s. Estimated remaining: 2m 11s. Rate: 156.5 symbols/min [2025-10-07T22:43:00.960220] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:00.984395] [DEBUG] [LOCAL ] STN: Loaded 22825 existing records from primary storage. [2025-10-07T22:43:00.984672] [INFO ] [MAIN ] STN: Loaded 22825 primary data records. [2025-10-07T22:43:01.125893] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-07T22:43:01.131316] [INFO ] [MAIN ] STM: Loaded 53573 primary data records. [2025-10-07T22:43:01.376598] [DEBUG] [LOCAL ] STNG: Loaded 43696 existing records from primary storage. [2025-10-07T22:43:01.403227] [INFO ] [MAIN ] STNG: Loaded 43696 primary data records. [2025-10-07T22:43:01.953507] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:01.954972] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22825 primary records. [2025-10-07T22:43:01.955183] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-07T22:43:01.991188] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:01.992981] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53573 primary records. [2025-10-07T22:43:01.993468] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-07T22:43:01.994169] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-07T22:43:01.994738] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-07T22:43:01.997417] [INFO ] [MAIN ] Derivative Progress: 1408/1748 symbols completed. STN took 1.1s. Estimated remaining: 2m 11s. Rate: 156.3 symbols/min [2025-10-07T22:43:02.026938] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:02.029095] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43696 primary records. [2025-10-07T22:43:02.029180] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-07T22:43:02.044100] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-07T22:43:02.044960] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-07T22:43:02.047623] [INFO ] [MAIN ] Derivative Progress: 1409/1748 symbols completed. STM took 1.1s. Estimated remaining: 2m 10s. Rate: 156.4 symbols/min [2025-10-07T22:43:02.050524] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-07T22:43:02.050604] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-07T22:43:02.052684] [INFO ] [MAIN ] Derivative Progress: 1410/1748 symbols completed. STNG took 1.1s. Estimated remaining: 2m 10s. Rate: 156.5 symbols/min [2025-10-07T22:43:02.053319] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:02.053440] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:02.053242] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:02.070808] [DEBUG] [LOCAL ] STRV: Loaded 11304 existing records from primary storage. [2025-10-07T22:43:02.071025] [INFO ] [MAIN ] STRV: Loaded 11304 primary data records. [2025-10-07T22:43:02.218084] [DEBUG] [LOCAL ] STVN: Loaded 26531 existing records from primary storage. [2025-10-07T22:43:02.240451] [INFO ] [MAIN ] STVN: Loaded 26531 primary data records. [2025-10-07T22:43:02.448475] [DEBUG] [LOCAL ] STT: Loaded 50964 existing records from primary storage. [2025-10-07T22:43:02.449039] [INFO ] [MAIN ] STT: Loaded 50964 primary data records. [2025-10-07T22:43:03.249013] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:43:03.250837] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:03.251780] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11304 primary records. [2025-10-07T22:43:03.252935] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26531 primary records. [2025-10-07T22:43:03.253210] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-07T22:43:03.253041] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-07T22:43:03.283737] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-10-07T22:43:03.284136] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-07T22:43:03.286195] [INFO ] [MAIN ] Derivative Progress: 1411/1748 symbols completed. STRV took 1.2s. Estimated remaining: 2m 9s. Rate: 156.2 symbols/min [2025-10-07T22:43:03.287255] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:03.294159] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-07T22:43:03.294546] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-07T22:43:03.296874] [INFO ] [MAIN ] Derivative Progress: 1412/1748 symbols completed. STVN took 1.2s. Estimated remaining: 2m 9s. Rate: 156.3 symbols/min [2025-10-07T22:43:03.297326] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:03.314143] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:03.315154] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 50964 primary records. [2025-10-07T22:43:03.315421] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-07T22:43:03.317192] [DEBUG] [LOCAL ] STXD: Loaded 1255 existing records from primary storage. [2025-10-07T22:43:03.317335] [INFO ] [MAIN ] STXD: Loaded 1255 primary data records. [2025-10-07T22:43:03.535422] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-10-07T22:43:03.674671] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-07T22:43:03.677085] [INFO ] [MAIN ] Derivative Progress: 1413/1748 symbols completed. STT took 1.6s. Estimated remaining: 2m 9s. Rate: 156.3 symbols/min [2025-10-07T22:43:03.677370] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:03.699121] [DEBUG] [LOCAL ] STXE: Loaded 2102 existing records from primary storage. [2025-10-07T22:43:03.699703] [INFO ] [MAIN ] STXE: Loaded 2102 primary data records. [2025-10-07T22:43:03.726760] [DEBUG] [LOCAL ] STWD: Loaded 51920 existing records from primary storage. [2025-10-07T22:43:03.743333] [INFO ] [MAIN ] STWD: Loaded 51920 primary data records. [2025-10-07T22:43:04.336135] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:43:04.337914] [INFO ] [MAIN ] STXD: Generated 1792 derivative records from 1255 primary records. [2025-10-07T22:43:04.338874] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-07T22:43:04.355714] [DEBUG] [LOCAL ] STXD: Derivative data saved (1792 records). [2025-10-07T22:43:04.356424] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-07T22:43:04.358968] [INFO ] [MAIN ] Derivative Progress: 1414/1748 symbols completed. STXD took 1.1s. Estimated remaining: 2m 8s. Rate: 156.3 symbols/min [2025-10-07T22:43:04.359322] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:04.366277] [DEBUG] [LOCAL ] STXG: Loaded 2465 existing records from primary storage. [2025-10-07T22:43:04.367873] [INFO ] [MAIN ] STXG: Loaded 2465 primary data records. [2025-10-07T22:43:04.467902] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:43:04.484877] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2102 primary records. [2025-10-07T22:43:04.496624] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-07T22:43:04.702796] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:04.712416] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51920 primary records. [2025-10-07T22:43:04.713583] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-07T22:43:04.732578] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-10-07T22:43:04.734109] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-07T22:43:04.734694] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-07T22:43:04.737140] [INFO ] [MAIN ] Derivative Progress: 1415/1748 symbols completed. STXE took 1.1s. Estimated remaining: 2m 8s. Rate: 156.3 symbols/min [2025-10-07T22:43:04.737735] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-07T22:43:04.737587] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:04.740505] [INFO ] [MAIN ] Derivative Progress: 1416/1748 symbols completed. STWD took 1.5s. Estimated remaining: 2m 7s. Rate: 156.4 symbols/min [2025-10-07T22:43:04.740749] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:04.747552] [DEBUG] [LOCAL ] STXK: Loaded 1500 existing records from primary storage. [2025-10-07T22:43:04.748220] [INFO ] [MAIN ] STXK: Loaded 1500 primary data records. [2025-10-07T22:43:04.770493] [DEBUG] [LOCAL ] STXT: Loaded 2495 existing records from primary storage. [2025-10-07T22:43:04.786036] [INFO ] [MAIN ] STXT: Loaded 2495 primary data records. [2025-10-07T22:43:05.282053] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:43:05.365476] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2465 primary records. [2025-10-07T22:43:05.398615] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-07T22:43:05.418907] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-07T22:43:05.419281] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-07T22:43:05.421808] [INFO ] [MAIN ] Derivative Progress: 1417/1748 symbols completed. STXG took 1.1s. Estimated remaining: 2m 7s. Rate: 156.3 symbols/min [2025-10-07T22:43:05.422955] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:05.430175] [DEBUG] [LOCAL ] STXV: Loaded 1552 existing records from primary storage. [2025-10-07T22:43:05.438707] [INFO ] [MAIN ] STXV: Loaded 1552 primary data records. [2025-10-07T22:43:05.498974] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:43:05.515128] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1500 primary records. [2025-10-07T22:43:05.515316] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-07T22:43:05.565514] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:43:05.572731] [INFO ] [MAIN ] STXT: Generated 1792 derivative records from 2495 primary records. [2025-10-07T22:43:05.573813] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-07T22:43:05.760727] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-10-07T22:43:05.783581] [DEBUG] [LOCAL ] STXT: Derivative data saved (1792 records). [2025-10-07T22:43:05.783724] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-07T22:43:05.785939] [INFO ] [MAIN ] Derivative Progress: 1418/1748 symbols completed. STXT took 1.0s. Estimated remaining: 2m 7s. Rate: 156.3 symbols/min [2025-10-07T22:43:05.783203] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-07T22:43:05.789165] [INFO ] [MAIN ] Derivative Progress: 1419/1748 symbols completed. STXK took 1.1s. Estimated remaining: 2m 6s. Rate: 156.4 symbols/min [2025-10-07T22:43:05.789407] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:05.786820] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:05.824839] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:43:05.825871] [INFO ] [MAIN ] STXV: Generated 1792 derivative records from 1552 primary records. [2025-10-07T22:43:05.826883] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-07T22:43:05.842740] [DEBUG] [LOCAL ] STXV: Derivative data saved (1792 records). [2025-10-07T22:43:05.842982] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-07T22:43:05.858356] [INFO ] [MAIN ] Derivative Progress: 1420/1748 symbols completed. STXV took 0.4s. Estimated remaining: 2m 6s. Rate: 156.5 symbols/min [2025-10-07T22:43:05.858779] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:05.893377] [DEBUG] [LOCAL ] SU: Loaded 53435 existing records from primary storage. [2025-10-07T22:43:05.894222] [INFO ] [MAIN ] SU: Loaded 53435 primary data records. [2025-10-07T22:43:05.977727] [DEBUG] [LOCAL ] STZ: Loaded 52326 existing records from primary storage. [2025-10-07T22:43:05.989713] [INFO ] [MAIN ] STZ: Loaded 52326 primary data records. [2025-10-07T22:43:06.389576] [DEBUG] [LOCAL ] SUI: Loaded 41630 existing records from primary storage. [2025-10-07T22:43:06.417526] [INFO ] [MAIN ] SUI: Loaded 41630 primary data records. [2025-10-07T22:43:06.955960] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:06.958157] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53435 primary records. [2025-10-07T22:43:06.959721] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-07T22:43:06.994489] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:06.996479] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52326 primary records. [2025-10-07T22:43:06.997779] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-07T22:43:07.027630] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-07T22:43:07.029325] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-07T22:43:07.032735] [INFO ] [MAIN ] Derivative Progress: 1421/1748 symbols completed. SU took 1.2s. Estimated remaining: 2m 6s. Rate: 156.3 symbols/min [2025-10-07T22:43:07.042181] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:07.049626] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:07.051095] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41630 primary records. [2025-10-07T22:43:07.051444] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-07T22:43:07.054210] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-10-07T22:43:07.062245] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-07T22:43:07.068392] [INFO ] [MAIN ] Derivative Progress: 1422/1748 symbols completed. STZ took 1.3s. Estimated remaining: 2m 5s. Rate: 156.4 symbols/min [2025-10-07T22:43:07.071712] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:07.079178] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-07T22:43:07.079411] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-07T22:43:07.081841] [INFO ] [MAIN ] Derivative Progress: 1423/1748 symbols completed. SUI took 1.2s. Estimated remaining: 2m 5s. Rate: 156.5 symbols/min [2025-10-07T22:43:07.114143] [DEBUG] [LOCAL ] SUN: Loaded 37843 existing records from primary storage. [2025-10-07T22:43:07.114353] [INFO ] [MAIN ] SUN: Loaded 37843 primary data records. [2025-10-07T22:43:07.434628] [DEBUG] [LOCAL ] SUPV: Loaded 47407 existing records from primary storage. [2025-10-07T22:43:07.465389] [INFO ] [MAIN ] SUPV: Loaded 47407 primary data records. [2025-10-07T22:43:07.801589] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:07.802802] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37843 primary records. [2025-10-07T22:43:07.803722] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-07T22:43:07.838434] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:07.840034] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47407 primary records. [2025-10-07T22:43:07.840285] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-07T22:43:07.841187] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-07T22:43:07.841578] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-07T22:43:07.843846] [INFO ] [MAIN ] Derivative Progress: 1424/1748 symbols completed. SUN took 0.8s. Estimated remaining: 2m 4s. Rate: 156.4 symbols/min [2025-10-07T22:43:07.859048] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-07T22:43:07.859118] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-07T22:43:07.861116] [INFO ] [MAIN ] Derivative Progress: 1425/1748 symbols completed. SUPV took 0.8s. Estimated remaining: 2m 4s. Rate: 156.5 symbols/min [2025-10-07T22:43:07.861909] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:07.861844] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:07.861772] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:07.953226] [DEBUG] [LOCAL ] SVV: Loaded 39888 existing records from primary storage. [2025-10-07T22:43:07.954714] [DEBUG] [LOCAL ] SUZ: Loaded 45520 existing records from primary storage. [2025-10-07T22:43:07.955037] [INFO ] [MAIN ] SVV: Loaded 39888 primary data records. [2025-10-07T22:43:07.955754] [INFO ] [MAIN ] SUZ: Loaded 45520 primary data records. [2025-10-07T22:43:08.186324] [DEBUG] [LOCAL ] SW: Loaded 53183 existing records from primary storage. [2025-10-07T22:43:08.212506] [INFO ] [MAIN ] SW: Loaded 53183 primary data records. [2025-10-07T22:43:08.965986] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:08.967132] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39888 primary records. [2025-10-07T22:43:08.967444] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-07T22:43:08.990085] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:08.997208] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45520 primary records. [2025-10-07T22:43:08.999784] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-07T22:43:09.003294] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-07T22:43:09.010953] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-07T22:43:09.027449] [INFO ] [MAIN ] Derivative Progress: 1426/1748 symbols completed. SVV took 1.2s. Estimated remaining: 2m 4s. Rate: 156.2 symbols/min [2025-10-07T22:43:09.031121] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:09.033595] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:09.035913] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53183 primary records. [2025-10-07T22:43:09.036705] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-07T22:43:09.050519] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-07T22:43:09.050940] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-07T22:43:09.053244] [INFO ] [MAIN ] Derivative Progress: 1427/1748 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 3s. Rate: 156.3 symbols/min [2025-10-07T22:43:09.053725] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:09.058807] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-07T22:43:09.058879] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-07T22:43:09.061065] [INFO ] [MAIN ] Derivative Progress: 1428/1748 symbols completed. SW took 1.2s. Estimated remaining: 2m 3s. Rate: 156.4 symbols/min [2025-10-07T22:43:09.061338] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:09.071143] [DEBUG] [LOCAL ] SWZ: Loaded 6079 existing records from primary storage. [2025-10-07T22:43:09.071306] [INFO ] [MAIN ] SWZ: Loaded 6079 primary data records. [2025-10-07T22:43:09.212714] [DEBUG] [LOCAL ] SWK: Loaded 52434 existing records from primary storage. [2025-10-07T22:43:09.238051] [INFO ] [MAIN ] SWK: Loaded 52434 primary data records. [2025-10-07T22:43:09.288535] [DEBUG] [LOCAL ] SWX: Loaded 31242 existing records from primary storage. [2025-10-07T22:43:09.347155] [INFO ] [MAIN ] SWX: Loaded 31242 primary data records. [2025-10-07T22:43:10.093983] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:43:10.095392] [INFO ] [MAIN ] SWZ: Generated 1793 derivative records from 6079 primary records. [2025-10-07T22:43:10.095936] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-07T22:43:10.114959] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1793 records). [2025-10-07T22:43:10.128448] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-07T22:43:10.131153] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:10.130844] [INFO ] [MAIN ] Derivative Progress: 1429/1748 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 2s. Rate: 156.2 symbols/min [2025-10-07T22:43:10.132330] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52434 primary records. [2025-10-07T22:43:10.132503] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-07T22:43:10.131510] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:10.152553] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-07T22:43:10.152814] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-07T22:43:10.154941] [INFO ] [MAIN ] Derivative Progress: 1430/1748 symbols completed. SWK took 1.1s. Estimated remaining: 2m 2s. Rate: 156.4 symbols/min [2025-10-07T22:43:10.155406] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:10.169757] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:10.170433] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31242 primary records. [2025-10-07T22:43:10.170518] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-07T22:43:10.203952] [DEBUG] [LOCAL ] SXI: Loaded 11693 existing records from primary storage. [2025-10-07T22:43:10.204742] [INFO ] [MAIN ] SXI: Loaded 11693 primary data records. [2025-10-07T22:43:10.204672] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-07T22:43:10.241582] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-07T22:43:10.293107] [INFO ] [MAIN ] Derivative Progress: 1431/1748 symbols completed. SWX took 1.2s. Estimated remaining: 2m 2s. Rate: 156.4 symbols/min [2025-10-07T22:43:10.309824] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:10.304375] [DEBUG] [LOCAL ] SXC: Loaded 41436 existing records from primary storage. [2025-10-07T22:43:10.321681] [INFO ] [MAIN ] SXC: Loaded 41436 primary data records. [2025-10-07T22:43:10.853385] [DEBUG] [LOCAL ] SXT: Loaded 29823 existing records from primary storage. [2025-10-07T22:43:10.871934] [INFO ] [MAIN ] SXT: Loaded 29823 primary data records. [2025-10-07T22:43:11.199512] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:11.200982] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11693 primary records. [2025-10-07T22:43:11.201183] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-07T22:43:11.224030] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-07T22:43:11.224260] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-07T22:43:11.227309] [INFO ] [MAIN ] Derivative Progress: 1432/1748 symbols completed. SXI took 1.1s. Estimated remaining: 2m 1s. Rate: 156.3 symbols/min [2025-10-07T22:43:11.227619] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:11.242735] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:11.243975] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41436 primary records. [2025-10-07T22:43:11.244218] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-07T22:43:11.262410] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-07T22:43:11.262867] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-07T22:43:11.265059] [INFO ] [MAIN ] Derivative Progress: 1433/1748 symbols completed. SXC took 1.1s. Estimated remaining: 2m 1s. Rate: 156.4 symbols/min [2025-10-07T22:43:11.265535] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:11.283189] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:11.283933] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29823 primary records. [2025-10-07T22:43:11.283997] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-07T22:43:11.300625] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-07T22:43:11.300900] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-07T22:43:11.302998] [INFO ] [MAIN ] Derivative Progress: 1434/1748 symbols completed. SXT took 1.0s. Estimated remaining: 2m 0s. Rate: 156.5 symbols/min [2025-10-07T22:43:11.303224] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:11.351550] [DEBUG] [LOCAL ] SYF: Loaded 53443 existing records from primary storage. [2025-10-07T22:43:11.351851] [INFO ] [MAIN ] SYF: Loaded 53443 primary data records. [2025-10-07T22:43:11.488916] [DEBUG] [LOCAL ] SYK: Loaded 46879 existing records from primary storage. [2025-10-07T22:43:11.489151] [INFO ] [MAIN ] SYK: Loaded 46879 primary data records. [2025-10-07T22:43:11.680420] [DEBUG] [LOCAL ] SYY: Loaded 53232 existing records from primary storage. [2025-10-07T22:43:11.723887] [INFO ] [MAIN ] SYY: Loaded 53232 primary data records. [2025-10-07T22:43:12.324355] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:12.325684] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53443 primary records. [2025-10-07T22:43:12.326561] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-07T22:43:12.355743] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:12.356919] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46879 primary records. [2025-10-07T22:43:12.357228] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-07T22:43:12.376065] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-10-07T22:43:12.376206] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-07T22:43:12.378465] [INFO ] [MAIN ] Derivative Progress: 1435/1748 symbols completed. SYK took 1.1s. Estimated remaining: 2m 0s. Rate: 156.3 symbols/min [2025-10-07T22:43:12.378900] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:12.381612] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-10-07T22:43:12.382867] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-07T22:43:12.385454] [INFO ] [MAIN ] Derivative Progress: 1436/1748 symbols completed. SYF took 1.2s. Estimated remaining: 1m 60s. Rate: 156.4 symbols/min [2025-10-07T22:43:12.385697] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:12.400219] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:12.401020] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53232 primary records. [2025-10-07T22:43:12.401178] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-07T22:43:12.418783] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-07T22:43:12.418969] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-07T22:43:12.421135] [INFO ] [MAIN ] Derivative Progress: 1437/1748 symbols completed. SYY took 1.1s. Estimated remaining: 1m 59s. Rate: 156.5 symbols/min [2025-10-07T22:43:12.421362] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:12.465217] [DEBUG] [LOCAL ] TAC: Loaded 42620 existing records from primary storage. [2025-10-07T22:43:12.479923] [INFO ] [MAIN ] TAC: Loaded 42620 primary data records. [2025-10-07T22:43:12.480689] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-07T22:43:12.500928] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-07T22:43:12.804883] [DEBUG] [LOCAL ] TAK: Loaded 50004 existing records from primary storage. [2025-10-07T22:43:12.839450] [INFO ] [MAIN ] TAK: Loaded 50004 primary data records. [2025-10-07T22:43:13.514571] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:13.517126] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42620 primary records. [2025-10-07T22:43:13.517666] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-07T22:43:13.537571] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-07T22:43:13.551593] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-07T22:43:13.553826] [INFO ] [MAIN ] Derivative Progress: 1438/1748 symbols completed. TAC took 1.2s. Estimated remaining: 1m 59s. Rate: 156.3 symbols/min [2025-10-07T22:43:13.555370] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:13.556454] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-07T22:43:13.557253] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-07T22:43:13.585335] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:13.586785] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 50004 primary records. [2025-10-07T22:43:13.586871] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-07T22:43:13.605167] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-07T22:43:13.605593] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-07T22:43:13.605714] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-07T22:43:13.607893] [INFO ] [MAIN ] Derivative Progress: 1439/1748 symbols completed. TAK took 1.2s. Estimated remaining: 1m 59s. Rate: 156.4 symbols/min [2025-10-07T22:43:13.608010] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-07T22:43:13.610613] [INFO ] [MAIN ] Derivative Progress: 1440/1748 symbols completed. T took 1.2s. Estimated remaining: 1m 58s. Rate: 156.5 symbols/min [2025-10-07T22:43:13.611296] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:13.611515] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:13.611205] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:13.685082] [DEBUG] [LOCAL ] TAP: Loaded 52914 existing records from primary storage. [2025-10-07T22:43:13.685861] [INFO ] [MAIN ] TAP: Loaded 52914 primary data records. [2025-10-07T22:43:13.775405] [DEBUG] [LOCAL ] TALO: Loaded 50818 existing records from primary storage. [2025-10-07T22:43:13.798806] [INFO ] [MAIN ] TALO: Loaded 50818 primary data records. [2025-10-07T22:43:13.848176] [DEBUG] [LOCAL ] TAL: Loaded 51852 existing records from primary storage. [2025-10-07T22:43:13.868397] [INFO ] [MAIN ] TAL: Loaded 51852 primary data records. [2025-10-07T22:43:14.684465] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:14.685800] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52914 primary records. [2025-10-07T22:43:14.687050] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-07T22:43:14.703668] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:14.716736] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50818 primary records. [2025-10-07T22:43:14.721223] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-07T22:43:14.721525] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-07T22:43:14.723885] [INFO ] [MAIN ] Derivative Progress: 1441/1748 symbols completed. TAP took 1.1s. Estimated remaining: 1m 58s. Rate: 156.3 symbols/min [2025-10-07T22:43:14.721854] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-07T22:43:14.724142] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:14.739773] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:14.749689] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51852 primary records. [2025-10-07T22:43:14.752521] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-07T22:43:14.761426] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-07T22:43:14.773016] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-07T22:43:14.777738] [INFO ] [MAIN ] Derivative Progress: 1442/1748 symbols completed. TALO took 1.2s. Estimated remaining: 1m 57s. Rate: 156.3 symbols/min [2025-10-07T22:43:14.777919] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:14.784410] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-07T22:43:14.784570] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-07T22:43:14.787140] [INFO ] [MAIN ] Derivative Progress: 1443/1748 symbols completed. TAL took 1.2s. Estimated remaining: 1m 57s. Rate: 156.5 symbols/min [2025-10-07T22:43:14.785020] [DEBUG] [LOCAL ] TBB: Loaded 11674 existing records from primary storage. [2025-10-07T22:43:14.787784] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:14.788022] [INFO ] [MAIN ] TBB: Loaded 11674 primary data records. [2025-10-07T22:43:14.996001] [DEBUG] [LOCAL ] TBI: Loaded 22538 existing records from primary storage. [2025-10-07T22:43:15.002949] [INFO ] [MAIN ] TBI: Loaded 22538 primary data records. [2025-10-07T22:43:15.251476] [DEBUG] [LOCAL ] TBBB: Loaded 35662 existing records from primary storage. [2025-10-07T22:43:15.279112] [INFO ] [MAIN ] TBBB: Loaded 35662 primary data records. [2025-10-07T22:43:15.799721] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:15.801789] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11674 primary records. [2025-10-07T22:43:15.801923] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-07T22:43:15.822347] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-10-07T22:43:15.824188] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-07T22:43:15.826504] [INFO ] [MAIN ] Derivative Progress: 1444/1748 symbols completed. TBB took 1.1s. Estimated remaining: 1m 57s. Rate: 156.3 symbols/min [2025-10-07T22:43:15.826942] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:15.842454] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:15.843530] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22538 primary records. [2025-10-07T22:43:15.844909] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-07T22:43:15.856935] [DEBUG] [LOCAL ] TBN: Loaded 3840 existing records from primary storage. [2025-10-07T22:43:15.859689] [INFO ] [MAIN ] TBN: Loaded 3840 primary data records. [2025-10-07T22:43:15.960566] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-07T22:43:15.985579] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-07T22:43:15.987715] [INFO ] [MAIN ] Derivative Progress: 1445/1748 symbols completed. TBI took 1.2s. Estimated remaining: 1m 56s. Rate: 156.3 symbols/min [2025-10-07T22:43:15.966791] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:15.992263] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:15.992114] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35662 primary records. [2025-10-07T22:43:16.003859] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-07T22:43:16.210396] [DEBUG] [LOCAL ] TCBX: Loaded 10211 existing records from primary storage. [2025-10-07T22:43:16.215413] [INFO ] [MAIN ] TCBX: Loaded 10211 primary data records. [2025-10-07T22:43:16.227581] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-07T22:43:16.252981] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-07T22:43:16.261559] [INFO ] [MAIN ] Derivative Progress: 1446/1748 symbols completed. TBBB took 1.5s. Estimated remaining: 1m 56s. Rate: 156.4 symbols/min [2025-10-07T22:43:16.282890] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:16.540328] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:43:16.555899] [INFO ] [MAIN ] TBN: Generated 1792 derivative records from 3840 primary records. [2025-10-07T22:43:16.556318] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-07T22:43:16.588450] [DEBUG] [LOCAL ] TBN: Derivative data saved (1792 records). [2025-10-07T22:43:16.591800] [DEBUG] [LOCAL ] TD: Loaded 52350 existing records from primary storage. [2025-10-07T22:43:16.592202] [INFO ] [MAIN ] TD: Loaded 52350 primary data records. [2025-10-07T22:43:16.592124] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-07T22:43:16.594519] [INFO ] [MAIN ] Derivative Progress: 1447/1748 symbols completed. TBN took 0.8s. Estimated remaining: 1m 55s. Rate: 156.4 symbols/min [2025-10-07T22:43:16.615382] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:16.684872] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:16.692828] [INFO ] [MAIN ] TCBX: Generated 1794 derivative records from 10211 primary records. [2025-10-07T22:43:16.698248] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-07T22:43:16.788393] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1794 records). [2025-10-07T22:43:16.810987] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-07T22:43:16.819114] [INFO ] [MAIN ] Derivative Progress: 1448/1748 symbols completed. TCBX took 0.8s. Estimated remaining: 1m 55s. Rate: 156.4 symbols/min [2025-10-07T22:43:16.819463] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:16.984967] [DEBUG] [LOCAL ] TDF: Loaded 6251 existing records from primary storage. [2025-10-07T22:43:16.996157] [INFO ] [MAIN ] TDF: Loaded 6251 primary data records. [2025-10-07T22:43:17.157198] [DEBUG] [LOCAL ] TDC: Loaded 46588 existing records from primary storage. [2025-10-07T22:43:17.195600] [INFO ] [MAIN ] TDC: Loaded 46588 primary data records. [2025-10-07T22:43:17.445789] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:17.466845] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52350 primary records. [2025-10-07T22:43:17.473995] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-07T22:43:17.523838] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-07T22:43:17.555082] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-07T22:43:17.593217] [INFO ] [MAIN ] Derivative Progress: 1449/1748 symbols completed. TD took 1.3s. Estimated remaining: 1m 55s. Rate: 156.3 symbols/min [2025-10-07T22:43:17.597794] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:17.759845] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:17.761197] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6251 primary records. [2025-10-07T22:43:17.761719] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-07T22:43:17.794135] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-07T22:43:17.794761] [DEBUG] [LOCAL ] TDG: Loaded 22105 existing records from primary storage. [2025-10-07T22:43:17.794356] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-07T22:43:17.795038] [INFO ] [MAIN ] TDG: Loaded 22105 primary data records. [2025-10-07T22:43:17.797520] [INFO ] [MAIN ] Derivative Progress: 1450/1748 symbols completed. TDF took 1.0s. Estimated remaining: 1m 54s. Rate: 156.4 symbols/min [2025-10-07T22:43:17.827937] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:18.126336] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:18.129100] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46588 primary records. [2025-10-07T22:43:18.129693] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-07T22:43:18.165768] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-07T22:43:18.166286] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-07T22:43:18.167276] [DEBUG] [LOCAL ] TDOC: Loaded 53349 existing records from primary storage. [2025-10-07T22:43:18.167417] [INFO ] [MAIN ] TDOC: Loaded 53349 primary data records. [2025-10-07T22:43:18.169823] [INFO ] [MAIN ] Derivative Progress: 1451/1748 symbols completed. TDC took 1.6s. Estimated remaining: 1m 54s. Rate: 156.4 symbols/min [2025-10-07T22:43:18.170258] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:18.376161] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:18.483779] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22105 primary records. [2025-10-07T22:43:18.492634] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-07T22:43:18.524412] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-07T22:43:18.523604] [DEBUG] [LOCAL ] TDS: Loaded 42731 existing records from primary storage. [2025-10-07T22:43:18.524564] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-07T22:43:18.527019] [INFO ] [MAIN ] Derivative Progress: 1452/1748 symbols completed. TDG took 0.9s. Estimated remaining: 1m 54s. Rate: 156.4 symbols/min [2025-10-07T22:43:18.524716] [INFO ] [MAIN ] TDS: Loaded 42731 primary data records. [2025-10-07T22:43:18.527559] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:18.858135] [DEBUG] [LOCAL ] TDW: Loaded 45134 existing records from primary storage. [2025-10-07T22:43:18.867389] [INFO ] [MAIN ] TDW: Loaded 45134 primary data records. [2025-10-07T22:43:18.903621] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:18.928218] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53349 primary records. [2025-10-07T22:43:18.937082] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-07T22:43:19.010837] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-10-07T22:43:19.021429] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-07T22:43:19.023522] [INFO ] [MAIN ] Derivative Progress: 1453/1748 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 53s. Rate: 156.3 symbols/min [2025-10-07T22:43:19.260855] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:19.261739] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42731 primary records. [2025-10-07T22:43:19.262333] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-07T22:43:19.279677] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-07T22:43:19.279780] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-07T22:43:19.281922] [INFO ] [MAIN ] Derivative Progress: 1454/1748 symbols completed. TDS took 1.1s. Estimated remaining: 1m 53s. Rate: 156.4 symbols/min [2025-10-07T22:43:19.301807] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:19.302392] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45134 primary records. [2025-10-07T22:43:19.302450] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-07T22:43:19.317520] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-07T22:43:19.317579] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-07T22:43:19.320262] [INFO ] [MAIN ] Derivative Progress: 1455/1748 symbols completed. TDW took 0.8s. Estimated remaining: 1m 52s. Rate: 156.5 symbols/min [2025-10-07T22:43:19.321067] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:19.321180] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:19.320952] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:19.331447] [DEBUG] [LOCAL ] TEAF: Loaded 7527 existing records from primary storage. [2025-10-07T22:43:19.331767] [INFO ] [MAIN ] TEAF: Loaded 7527 primary data records. [2025-10-07T22:43:19.463004] [DEBUG] [LOCAL ] TDY: Loaded 22459 existing records from primary storage. [2025-10-07T22:43:19.473562] [INFO ] [MAIN ] TDY: Loaded 22459 primary data records. [2025-10-07T22:43:20.040860] [DEBUG] [LOCAL ] TECK: Loaded 53438 existing records from primary storage. [2025-10-07T22:43:20.041847] [INFO ] [MAIN ] TECK: Loaded 53438 primary data records. [2025-10-07T22:43:20.386106] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:20.388055] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7527 primary records. [2025-10-07T22:43:20.388200] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-07T22:43:20.403349] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:20.411702] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22459 primary records. [2025-10-07T22:43:20.413627] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-07T22:43:20.434864] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-07T22:43:20.435717] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-07T22:43:20.439134] [INFO ] [MAIN ] Derivative Progress: 1456/1748 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 52s. Rate: 156.3 symbols/min [2025-10-07T22:43:20.439835] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:20.444611] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-07T22:43:20.445390] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-07T22:43:20.447761] [INFO ] [MAIN ] Derivative Progress: 1457/1748 symbols completed. TDY took 1.1s. Estimated remaining: 1m 52s. Rate: 156.4 symbols/min [2025-10-07T22:43:20.448496] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:20.466815] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:20.467500] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53438 primary records. [2025-10-07T22:43:20.467562] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-07T22:43:20.500131] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-07T22:43:20.500415] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-07T22:43:20.503686] [INFO ] [MAIN ] Derivative Progress: 1458/1748 symbols completed. TECK took 1.2s. Estimated remaining: 1m 51s. Rate: 156.5 symbols/min [2025-10-07T22:43:20.504032] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:20.515568] [DEBUG] [LOCAL ] TEI: Loaded 21350 existing records from primary storage. [2025-10-07T22:43:20.516228] [INFO ] [MAIN ] TEI: Loaded 21350 primary data records. [2025-10-07T22:43:20.582052] [DEBUG] [LOCAL ] TEF: Loaded 37196 existing records from primary storage. [2025-10-07T22:43:20.603366] [INFO ] [MAIN ] TEF: Loaded 37196 primary data records. [2025-10-07T22:43:21.247002] [DEBUG] [LOCAL ] TEL: Loaded 51095 existing records from primary storage. [2025-10-07T22:43:21.247257] [INFO ] [MAIN ] TEL: Loaded 51095 primary data records. [2025-10-07T22:43:21.586621] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:21.587887] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 21350 primary records. [2025-10-07T22:43:21.588206] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-07T22:43:21.607179] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-10-07T22:43:21.608758] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-07T22:43:21.610878] [INFO ] [MAIN ] Derivative Progress: 1459/1748 symbols completed. TEI took 1.2s. Estimated remaining: 1m 51s. Rate: 156.3 symbols/min [2025-10-07T22:43:21.612774] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:21.628968] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:21.629912] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37196 primary records. [2025-10-07T22:43:21.630186] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-07T22:43:21.648495] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-07T22:43:21.648587] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-07T22:43:21.651598] [INFO ] [MAIN ] Derivative Progress: 1460/1748 symbols completed. TEF took 1.2s. Estimated remaining: 1m 51s. Rate: 156.4 symbols/min [2025-10-07T22:43:21.651836] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:21.688246] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:21.689004] [DEBUG] [LOCAL ] TEN: Loaded 30447 existing records from primary storage. [2025-10-07T22:43:21.689754] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51095 primary records. [2025-10-07T22:43:21.689863] [INFO ] [MAIN ] TEN: Loaded 30447 primary data records. [2025-10-07T22:43:21.689962] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-07T22:43:21.756830] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-07T22:43:21.808437] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-07T22:43:21.821432] [INFO ] [MAIN ] Derivative Progress: 1461/1748 symbols completed. TEL took 1.3s. Estimated remaining: 1m 50s. Rate: 156.4 symbols/min [2025-10-07T22:43:21.838534] [DEBUG] [LOCAL ] TEO: Loaded 22300 existing records from primary storage. [2025-10-07T22:43:21.842900] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:21.843393] [INFO ] [MAIN ] TEO: Loaded 22300 primary data records. [2025-10-07T22:43:22.370125] [DEBUG] [LOCAL ] TEX: Loaded 44018 existing records from primary storage. [2025-10-07T22:43:22.370973] [INFO ] [MAIN ] TEX: Loaded 44018 primary data records. [2025-10-07T22:43:22.699913] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:22.702007] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30447 primary records. [2025-10-07T22:43:22.702172] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-07T22:43:22.740136] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:22.741992] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22300 primary records. [2025-10-07T22:43:22.742678] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-07T22:43:22.742244] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-07T22:43:22.743801] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-07T22:43:22.746186] [INFO ] [MAIN ] Derivative Progress: 1462/1748 symbols completed. TEN took 1.1s. Estimated remaining: 1m 50s. Rate: 156.3 symbols/min [2025-10-07T22:43:22.746637] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:22.763988] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-07T22:43:22.764214] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-07T22:43:22.766388] [INFO ] [MAIN ] Derivative Progress: 1463/1748 symbols completed. TEO took 1.1s. Estimated remaining: 1m 49s. Rate: 156.4 symbols/min [2025-10-07T22:43:22.766666] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:22.784673] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:22.785389] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 44018 primary records. [2025-10-07T22:43:22.786012] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-07T22:43:22.812100] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-07T22:43:22.812224] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-07T22:43:22.814518] [INFO ] [MAIN ] Derivative Progress: 1464/1748 symbols completed. TEX took 1.0s. Estimated remaining: 1m 49s. Rate: 156.5 symbols/min [2025-10-07T22:43:22.814850] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:22.839695] [DEBUG] [LOCAL ] TFII: Loaded 33427 existing records from primary storage. [2025-10-07T22:43:22.839861] [INFO ] [MAIN ] TFII: Loaded 33427 primary data records. [2025-10-07T22:43:22.974044] [DEBUG] [LOCAL ] TFIN: Loaded 23508 existing records from primary storage. [2025-10-07T22:43:22.975197] [INFO ] [MAIN ] TFIN: Loaded 23508 primary data records. [2025-10-07T22:43:22.974968] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-07T22:43:22.975889] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-07T22:43:23.879348] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:23.880632] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 33427 primary records. [2025-10-07T22:43:23.880920] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-07T22:43:23.917830] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-07T22:43:23.911313] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:23.919114] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-07T22:43:23.920637] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-10-07T22:43:23.920793] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-07T22:43:23.924330] [INFO ] [MAIN ] Derivative Progress: 1465/1748 symbols completed. TFII took 1.2s. Estimated remaining: 1m 49s. Rate: 156.3 symbols/min [2025-10-07T22:43:23.933311] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:23.947739] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:23.951997] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23508 primary records. [2025-10-07T22:43:23.952392] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-07T22:43:23.971559] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-07T22:43:23.971717] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-07T22:43:23.974425] [INFO ] [MAIN ] Derivative Progress: 1466/1748 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 48s. Rate: 156.3 symbols/min [2025-10-07T22:43:23.974985] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:23.977325] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-10-07T22:43:23.977410] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-07T22:43:23.979603] [INFO ] [MAIN ] Derivative Progress: 1467/1748 symbols completed. TFC took 1.2s. Estimated remaining: 1m 48s. Rate: 156.5 symbols/min [2025-10-07T22:43:23.982826] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:24.010356] [DEBUG] [LOCAL ] TG: Loaded 10390 existing records from primary storage. [2025-10-07T22:43:24.021924] [INFO ] [MAIN ] TG: Loaded 10390 primary data records. [2025-10-07T22:43:24.065676] [DEBUG] [LOCAL ] TFPM: Loaded 38362 existing records from primary storage. [2025-10-07T22:43:24.132414] [INFO ] [MAIN ] TFPM: Loaded 38362 primary data records. [2025-10-07T22:43:24.249777] [DEBUG] [LOCAL ] TFX: Loaded 36913 existing records from primary storage. [2025-10-07T22:43:24.277183] [INFO ] [MAIN ] TFX: Loaded 36913 primary data records. [2025-10-07T22:43:24.986985] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:24.988278] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10390 primary records. [2025-10-07T22:43:24.988817] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-07T22:43:25.015257] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:25.018921] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 38362 primary records. [2025-10-07T22:43:25.019480] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-07T22:43:25.049976] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-07T22:43:25.050093] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-07T22:43:25.052449] [INFO ] [MAIN ] Derivative Progress: 1468/1748 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 48s. Rate: 156.3 symbols/min [2025-10-07T22:43:25.059853] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:25.059946] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-07T22:43:25.060866] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 36913 primary records. [2025-10-07T22:43:25.060958] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-07T22:43:25.061061] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-07T22:43:25.063572] [INFO ] [MAIN ] Derivative Progress: 1469/1748 symbols completed. TG took 1.1s. Estimated remaining: 1m 47s. Rate: 156.4 symbols/min [2025-10-07T22:43:25.080109] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-07T22:43:25.080242] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-07T22:43:25.082407] [INFO ] [MAIN ] Derivative Progress: 1470/1748 symbols completed. TFX took 1.1s. Estimated remaining: 1m 47s. Rate: 156.5 symbols/min [2025-10-07T22:43:25.082879] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:25.083061] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:25.082973] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:25.131951] [DEBUG] [LOCAL ] TGLS: Loaded 27698 existing records from primary storage. [2025-10-07T22:43:25.133147] [DEBUG] [LOCAL ] TGS: Loaded 32906 existing records from primary storage. [2025-10-07T22:43:25.133519] [INFO ] [MAIN ] TGS: Loaded 32906 primary data records. [2025-10-07T22:43:25.133254] [INFO ] [MAIN ] TGLS: Loaded 27698 primary data records. [2025-10-07T22:43:25.387453] [DEBUG] [LOCAL ] TGNA: Loaded 48672 existing records from primary storage. [2025-10-07T22:43:25.388099] [INFO ] [MAIN ] TGNA: Loaded 48672 primary data records. [2025-10-07T22:43:26.438714] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:26.438107] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:26.440008] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32906 primary records. [2025-10-07T22:43:26.440817] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27698 primary records. [2025-10-07T22:43:26.441116] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-07T22:43:26.441180] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-07T22:43:26.470126] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-07T22:43:26.482056] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-07T22:43:26.494266] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:26.500288] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48672 primary records. [2025-10-07T22:43:26.505012] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-07T22:43:26.493584] [INFO ] [MAIN ] Derivative Progress: 1471/1748 symbols completed. TGS took 1.4s. Estimated remaining: 1m 46s. Rate: 156.2 symbols/min [2025-10-07T22:43:26.506374] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:26.504768] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-07T22:43:26.507344] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-07T22:43:26.521812] [INFO ] [MAIN ] Derivative Progress: 1472/1748 symbols completed. TGLS took 1.4s. Estimated remaining: 1m 46s. Rate: 156.3 symbols/min [2025-10-07T22:43:26.526964] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:26.532822] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-07T22:43:26.533026] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-07T22:43:26.535082] [INFO ] [MAIN ] Derivative Progress: 1473/1748 symbols completed. TGNA took 1.5s. Estimated remaining: 1m 46s. Rate: 156.4 symbols/min [2025-10-07T22:43:26.535300] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:26.585845] [DEBUG] [LOCAL ] THG: Loaded 21623 existing records from primary storage. [2025-10-07T22:43:26.586861] [INFO ] [MAIN ] THG: Loaded 21623 primary data records. [2025-10-07T22:43:26.687191] [DEBUG] [LOCAL ] THC: Loaded 47471 existing records from primary storage. [2025-10-07T22:43:26.726173] [INFO ] [MAIN ] THC: Loaded 47471 primary data records. [2025-10-07T22:43:26.745618] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-07T22:43:26.793031] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-10-07T22:43:27.671202] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:27.672943] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21623 primary records. [2025-10-07T22:43:27.673495] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-07T22:43:27.697998] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-07T22:43:27.698224] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-07T22:43:27.700243] [INFO ] [MAIN ] Derivative Progress: 1474/1748 symbols completed. THG took 1.2s. Estimated remaining: 1m 45s. Rate: 156.2 symbols/min [2025-10-07T22:43:27.700717] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:27.710573] [DEBUG] [LOCAL ] THIR: Loaded 2271 existing records from primary storage. [2025-10-07T22:43:27.724427] [INFO ] [MAIN ] THIR: Loaded 2271 primary data records. [2025-10-07T22:43:27.749521] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:27.770215] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:27.776347] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47471 primary records. [2025-10-07T22:43:27.805146] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-10-07T22:43:27.795624] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-07T22:43:27.823191] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-07T22:43:28.074193] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-07T22:43:28.075733] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-07T22:43:28.075236] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-07T22:43:28.078319] [INFO ] [MAIN ] Derivative Progress: 1475/1748 symbols completed. THC took 1.6s. Estimated remaining: 1m 45s. Rate: 156.2 symbols/min [2025-10-07T22:43:28.078460] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-07T22:43:28.081405] [INFO ] [MAIN ] Derivative Progress: 1476/1748 symbols completed. TGT took 1.6s. Estimated remaining: 1m 44s. Rate: 156.3 symbols/min [2025-10-07T22:43:28.078660] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:28.082529] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:28.087750] [DEBUG] [LOCAL ] THLV: Loaded 1542 existing records from primary storage. [2025-10-07T22:43:28.087906] [INFO ] [MAIN ] THLV: Loaded 1542 primary data records. [2025-10-07T22:43:28.450097] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7829 incomplete bins [2025-10-07T22:43:28.451320] [INFO ] [MAIN ] THIR: Generated 1785 derivative records from 2271 primary records. [2025-10-07T22:43:28.451969] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-07T22:43:28.453122] [DEBUG] [LOCAL ] THO: Loaded 41733 existing records from primary storage. [2025-10-07T22:43:28.453363] [INFO ] [MAIN ] THO: Loaded 41733 primary data records. [2025-10-07T22:43:28.573614] [DEBUG] [LOCAL ] THIR: Derivative data saved (1785 records). [2025-10-07T22:43:28.601094] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-07T22:43:28.658312] [INFO ] [MAIN ] Derivative Progress: 1477/1748 symbols completed. THIR took 1.0s. Estimated remaining: 1m 44s. Rate: 156.2 symbols/min [2025-10-07T22:43:28.777150] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:28.801811] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:43:28.802735] [INFO ] [MAIN ] THLV: Generated 1793 derivative records from 1542 primary records. [2025-10-07T22:43:28.803366] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-07T22:43:28.826284] [DEBUG] [LOCAL ] THLV: Derivative data saved (1793 records). [2025-10-07T22:43:28.833612] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-07T22:43:28.838367] [DEBUG] [LOCAL ] THQ: Loaded 25172 existing records from primary storage. [2025-10-07T22:43:28.837288] [INFO ] [MAIN ] Derivative Progress: 1478/1748 symbols completed. THLV took 0.8s. Estimated remaining: 1m 44s. Rate: 156.3 symbols/min [2025-10-07T22:43:28.838668] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:28.839133] [INFO ] [MAIN ] THQ: Loaded 25172 primary data records. [2025-10-07T22:43:28.971388] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:28.999343] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41733 primary records. [2025-10-07T22:43:29.030419] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-07T22:43:29.030180] [DEBUG] [LOCAL ] THR: Loaded 19876 existing records from primary storage. [2025-10-07T22:43:29.105698] [INFO ] [MAIN ] THR: Loaded 19876 primary data records. [2025-10-07T22:43:29.365676] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-07T22:43:29.537919] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-07T22:43:29.541215] [INFO ] [MAIN ] Derivative Progress: 1479/1748 symbols completed. THO took 1.5s. Estimated remaining: 1m 43s. Rate: 156.2 symbols/min [2025-10-07T22:43:29.541770] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:29.568000] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:29.569402] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 25172 primary records. [2025-10-07T22:43:29.569726] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-07T22:43:29.615832] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-07T22:43:29.616140] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:29.626751] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19876 primary records. [2025-10-07T22:43:29.625984] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-07T22:43:29.627784] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-07T22:43:29.630743] [INFO ] [MAIN ] Derivative Progress: 1480/1748 symbols completed. THQ took 0.9s. Estimated remaining: 1m 43s. Rate: 156.3 symbols/min [2025-10-07T22:43:29.632162] [DEBUG] [LOCAL ] THS: Loaded 38487 existing records from primary storage. [2025-10-07T22:43:29.630953] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:29.639366] [INFO ] [MAIN ] THS: Loaded 38487 primary data records. [2025-10-07T22:43:29.679085] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-10-07T22:43:29.704863] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-07T22:43:29.722686] [INFO ] [MAIN ] Derivative Progress: 1481/1748 symbols completed. THR took 0.9s. Estimated remaining: 1m 42s. Rate: 156.4 symbols/min [2025-10-07T22:43:29.740588] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:29.965969] [DEBUG] [LOCAL ] THW: Loaded 19643 existing records from primary storage. [2025-10-07T22:43:29.966712] [INFO ] [MAIN ] THW: Loaded 19643 primary data records. [2025-10-07T22:43:30.145872] [DEBUG] [LOCAL ] TIMB: Loaded 35692 existing records from primary storage. [2025-10-07T22:43:30.290909] [INFO ] [MAIN ] TIMB: Loaded 35692 primary data records. [2025-10-07T22:43:30.606072] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:30.607073] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38487 primary records. [2025-10-07T22:43:30.607764] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-07T22:43:30.627192] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-07T22:43:30.628362] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-07T22:43:30.631249] [INFO ] [MAIN ] Derivative Progress: 1482/1748 symbols completed. THS took 1.1s. Estimated remaining: 1m 42s. Rate: 156.2 symbols/min [2025-10-07T22:43:30.633346] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:30.650021] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:30.651121] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19643 primary records. [2025-10-07T22:43:30.652496] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-07T22:43:30.669557] [DEBUG] [LOCAL ] TISI: Loaded 3531 existing records from primary storage. [2025-10-07T22:43:30.672309] [INFO ] [MAIN ] TISI: Loaded 3531 primary data records. [2025-10-07T22:43:30.732023] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:30.741340] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 35692 primary records. [2025-10-07T22:43:30.747049] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-07T22:43:30.755576] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-07T22:43:30.789033] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-07T22:43:30.783741] [INFO ] [MAIN ] Derivative Progress: 1483/1748 symbols completed. THW took 1.2s. Estimated remaining: 1m 42s. Rate: 156.3 symbols/min [2025-10-07T22:43:30.862717] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-07T22:43:30.878403] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-07T22:43:30.891673] [INFO ] [MAIN ] Derivative Progress: 1484/1748 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 41s. Rate: 156.3 symbols/min [2025-10-07T22:43:31.086617] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:31.087291] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3531 primary records. [2025-10-07T22:43:31.087352] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-07T22:43:31.100582] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-10-07T22:43:31.100663] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-07T22:43:31.102698] [INFO ] [MAIN ] Derivative Progress: 1485/1748 symbols completed. TISI took 0.5s. Estimated remaining: 1m 41s. Rate: 156.4 symbols/min [2025-10-07T22:43:31.103464] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:31.103568] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:31.103854] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:31.138779] [DEBUG] [LOCAL ] TIXT: Loaded 31839 existing records from primary storage. [2025-10-07T22:43:31.148589] [INFO ] [MAIN ] TIXT: Loaded 31839 primary data records. [2025-10-07T22:43:31.257446] [DEBUG] [LOCAL ] TK: Loaded 39309 existing records from primary storage. [2025-10-07T22:43:31.257587] [INFO ] [MAIN ] TK: Loaded 39309 primary data records. [2025-10-07T22:43:31.431073] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-07T22:43:31.512961] [INFO ] [MAIN ] TJX: Loaded 53668 primary data records. [2025-10-07T22:43:32.180215] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:32.182604] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39309 primary records. [2025-10-07T22:43:32.183625] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-07T22:43:32.212195] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:32.214109] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31839 primary records. [2025-10-07T22:43:32.214617] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-07T22:43:32.235566] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-07T22:43:32.234701] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-10-07T22:43:32.235788] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-07T22:43:32.251106] [INFO ] [MAIN ] Derivative Progress: 1486/1748 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 41s. Rate: 156.2 symbols/min [2025-10-07T22:43:32.251633] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:32.248981] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-07T22:43:32.254006] [INFO ] [MAIN ] Derivative Progress: 1487/1748 symbols completed. TK took 1.2s. Estimated remaining: 1m 40s. Rate: 156.3 symbols/min [2025-10-07T22:43:32.254984] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53668 primary records. [2025-10-07T22:43:32.254174] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:32.251779] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:32.255395] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-07T22:43:32.278710] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-10-07T22:43:32.278947] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-07T22:43:32.281038] [INFO ] [MAIN ] Derivative Progress: 1488/1748 symbols completed. TJX took 1.2s. Estimated remaining: 1m 40s. Rate: 156.4 symbols/min [2025-10-07T22:43:32.281265] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:32.330468] [DEBUG] [LOCAL ] TKC: Loaded 38994 existing records from primary storage. [2025-10-07T22:43:32.330637] [INFO ] [MAIN ] TKC: Loaded 38994 primary data records. [2025-10-07T22:43:32.456630] [DEBUG] [LOCAL ] TKR: Loaded 39915 existing records from primary storage. [2025-10-07T22:43:32.483580] [INFO ] [MAIN ] TKR: Loaded 39915 primary data records. [2025-10-07T22:43:32.711998] [DEBUG] [LOCAL ] TLK: Loaded 38847 existing records from primary storage. [2025-10-07T22:43:32.746694] [INFO ] [MAIN ] TLK: Loaded 38847 primary data records. [2025-10-07T22:43:33.304962] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:33.306751] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 38994 primary records. [2025-10-07T22:43:33.307052] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-07T22:43:33.327851] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-07T22:43:33.328087] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-07T22:43:33.330301] [INFO ] [MAIN ] Derivative Progress: 1489/1748 symbols completed. TKC took 1.1s. Estimated remaining: 1m 39s. Rate: 156.2 symbols/min [2025-10-07T22:43:33.330531] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:33.345250] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:33.346119] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 39915 primary records. [2025-10-07T22:43:33.346311] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-07T22:43:33.370674] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-07T22:43:33.370953] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-07T22:43:33.373253] [INFO ] [MAIN ] Derivative Progress: 1490/1748 symbols completed. TKR took 1.1s. Estimated remaining: 1m 39s. Rate: 156.3 symbols/min [2025-10-07T22:43:33.373449] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:33.394282] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:33.395296] [DEBUG] [LOCAL ] TLYS: Loaded 16491 existing records from primary storage. [2025-10-07T22:43:33.396160] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 38847 primary records. [2025-10-07T22:43:33.396423] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-07T22:43:33.397377] [INFO ] [MAIN ] TLYS: Loaded 16491 primary data records. [2025-10-07T22:43:33.485680] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-07T22:43:33.497467] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-07T22:43:33.518156] [INFO ] [MAIN ] Derivative Progress: 1491/1748 symbols completed. TLK took 1.2s. Estimated remaining: 1m 39s. Rate: 156.4 symbols/min [2025-10-07T22:43:33.521506] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:33.791552] [DEBUG] [LOCAL ] TM: Loaded 36326 existing records from primary storage. [2025-10-07T22:43:33.791873] [INFO ] [MAIN ] TM: Loaded 36326 primary data records. [2025-10-07T22:43:34.128098] [DEBUG] [LOCAL ] TME: Loaded 53178 existing records from primary storage. [2025-10-07T22:43:34.128695] [INFO ] [MAIN ] TME: Loaded 53178 primary data records. [2025-10-07T22:43:34.330725] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:34.438960] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16491 primary records. [2025-10-07T22:43:34.447836] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-07T22:43:34.466177] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-07T22:43:34.467048] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-07T22:43:34.469206] [INFO ] [MAIN ] Derivative Progress: 1492/1748 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 38s. Rate: 156.2 symbols/min [2025-10-07T22:43:34.469726] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:34.489904] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:34.490899] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36326 primary records. [2025-10-07T22:43:34.491056] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-07T22:43:34.508943] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-07T22:43:34.509032] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-07T22:43:34.511281] [INFO ] [MAIN ] Derivative Progress: 1493/1748 symbols completed. TM took 1.1s. Estimated remaining: 1m 38s. Rate: 156.3 symbols/min [2025-10-07T22:43:34.511621] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:34.542772] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:34.543561] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53178 primary records. [2025-10-07T22:43:34.543740] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-07T22:43:34.573871] [DEBUG] [LOCAL ] TMHC: Loaded 45302 existing records from primary storage. [2025-10-07T22:43:34.573219] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-07T22:43:34.574065] [INFO ] [MAIN ] TMHC: Loaded 45302 primary data records. [2025-10-07T22:43:34.574152] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-07T22:43:34.576241] [INFO ] [MAIN ] Derivative Progress: 1494/1748 symbols completed. TME took 1.1s. Estimated remaining: 1m 37s. Rate: 156.4 symbols/min [2025-10-07T22:43:34.587733] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:34.900329] [DEBUG] [LOCAL ] TNC: Loaded 14698 existing records from primary storage. [2025-10-07T22:43:34.915726] [INFO ] [MAIN ] TNC: Loaded 14698 primary data records. [2025-10-07T22:43:34.928744] [DEBUG] [LOCAL ] TMO: Loaded 52414 existing records from primary storage. [2025-10-07T22:43:34.955758] [INFO ] [MAIN ] TMO: Loaded 52414 primary data records. [2025-10-07T22:43:35.611537] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:35.612510] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45302 primary records. [2025-10-07T22:43:35.612893] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-07T22:43:35.631462] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-07T22:43:35.631710] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-07T22:43:35.634034] [INFO ] [MAIN ] Derivative Progress: 1495/1748 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 37s. Rate: 156.2 symbols/min [2025-10-07T22:43:35.636738] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:35.666264] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:35.667841] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14698 primary records. [2025-10-07T22:43:35.667971] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-07T22:43:35.666757] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:35.669787] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52414 primary records. [2025-10-07T22:43:35.676978] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-07T22:43:35.693219] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-07T22:43:35.694540] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-07T22:43:35.696952] [INFO ] [MAIN ] Derivative Progress: 1496/1748 symbols completed. TNC took 1.1s. Estimated remaining: 1m 37s. Rate: 156.3 symbols/min [2025-10-07T22:43:35.711700] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-07T22:43:35.704066] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:35.712059] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-07T22:43:35.714380] [INFO ] [MAIN ] Derivative Progress: 1497/1748 symbols completed. TMO took 1.2s. Estimated remaining: 1m 36s. Rate: 156.4 symbols/min [2025-10-07T22:43:35.714693] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:35.726732] [DEBUG] [LOCAL ] TNET: Loaded 28339 existing records from primary storage. [2025-10-07T22:43:35.726887] [INFO ] [MAIN ] TNET: Loaded 28339 primary data records. [2025-10-07T22:43:36.052576] [DEBUG] [LOCAL ] TNK: Loaded 35156 existing records from primary storage. [2025-10-07T22:43:36.053463] [INFO ] [MAIN ] TNK: Loaded 35156 primary data records. [2025-10-07T22:43:36.179452] [DEBUG] [LOCAL ] TNL: Loaded 41746 existing records from primary storage. [2025-10-07T22:43:36.223282] [INFO ] [MAIN ] TNL: Loaded 41746 primary data records. [2025-10-07T22:43:36.700258] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:36.701111] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28339 primary records. [2025-10-07T22:43:36.701289] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-07T22:43:36.722926] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-07T22:43:36.723918] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-07T22:43:36.727446] [INFO ] [MAIN ] Derivative Progress: 1498/1748 symbols completed. TNET took 1.1s. Estimated remaining: 1m 36s. Rate: 156.2 symbols/min [2025-10-07T22:43:36.745151] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:36.745925] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35156 primary records. [2025-10-07T22:43:36.746104] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-07T22:43:36.763745] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-07T22:43:36.763834] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-07T22:43:36.766326] [INFO ] [MAIN ] Derivative Progress: 1499/1748 symbols completed. TNK took 1.1s. Estimated remaining: 1m 36s. Rate: 156.3 symbols/min [2025-10-07T22:43:36.781237] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:36.781893] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41746 primary records. [2025-10-07T22:43:36.781955] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-07T22:43:36.797372] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-10-07T22:43:36.797430] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-07T22:43:36.799465] [INFO ] [MAIN ] Derivative Progress: 1500/1748 symbols completed. TNL took 1.1s. Estimated remaining: 1m 35s. Rate: 156.4 symbols/min [2025-10-07T22:43:36.799914] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:36.800116] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:36.800624] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:36.829444] [DEBUG] [LOCAL ] TPB: Loaded 25450 existing records from primary storage. [2025-10-07T22:43:36.829594] [INFO ] [MAIN ] TPB: Loaded 25450 primary data records. [2025-10-07T22:43:37.191165] [DEBUG] [LOCAL ] TOST: Loaded 53683 existing records from primary storage. [2025-10-07T22:43:37.192122] [INFO ] [MAIN ] TOST: Loaded 53683 primary data records. [2025-10-07T22:43:37.192019] [DEBUG] [LOCAL ] TOL: Loaded 50749 existing records from primary storage. [2025-10-07T22:43:37.192444] [INFO ] [MAIN ] TOL: Loaded 50749 primary data records. [2025-10-07T22:43:37.892915] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:37.894206] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 25450 primary records. [2025-10-07T22:43:37.894625] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-07T22:43:37.914669] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-10-07T22:43:37.915559] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-07T22:43:37.917951] [INFO ] [MAIN ] Derivative Progress: 1501/1748 symbols completed. TPB took 1.1s. Estimated remaining: 1m 35s. Rate: 156.2 symbols/min [2025-10-07T22:43:37.919231] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:37.934621] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:37.935683] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50749 primary records. [2025-10-07T22:43:37.935845] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-07T22:43:37.950493] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:37.959896] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53683 primary records. [2025-10-07T22:43:37.963100] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-07T22:43:37.967776] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-07T22:43:37.968207] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-07T22:43:37.970113] [INFO ] [MAIN ] Derivative Progress: 1502/1748 symbols completed. TOL took 1.2s. Estimated remaining: 1m 34s. Rate: 156.3 symbols/min [2025-10-07T22:43:37.970522] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:37.987401] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-07T22:43:37.996327] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-07T22:43:37.998369] [INFO ] [MAIN ] Derivative Progress: 1503/1748 symbols completed. TOST took 1.2s. Estimated remaining: 1m 34s. Rate: 156.4 symbols/min [2025-10-07T22:43:37.998630] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:38.017596] [DEBUG] [LOCAL ] TPC: Loaded 38914 existing records from primary storage. [2025-10-07T22:43:38.017929] [INFO ] [MAIN ] TPC: Loaded 38914 primary data records. [2025-10-07T22:43:38.104333] [DEBUG] [LOCAL ] TPL: Loaded 12376 existing records from primary storage. [2025-10-07T22:43:38.115609] [INFO ] [MAIN ] TPL: Loaded 12376 primary data records. [2025-10-07T22:43:38.316086] [DEBUG] [LOCAL ] TPH: Loaded 44886 existing records from primary storage. [2025-10-07T22:43:38.341246] [INFO ] [MAIN ] TPH: Loaded 44886 primary data records. [2025-10-07T22:43:39.003349] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:39.004254] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38914 primary records. [2025-10-07T22:43:39.004345] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-07T22:43:39.038980] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-07T22:43:39.039922] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-07T22:43:39.042681] [INFO ] [MAIN ] Derivative Progress: 1504/1748 symbols completed. TPC took 1.1s. Estimated remaining: 1m 34s. Rate: 156.2 symbols/min [2025-10-07T22:43:39.040536] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:39.043035] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:39.051790] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12376 primary records. [2025-10-07T22:43:39.056721] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-07T22:43:39.058301] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:39.059103] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44886 primary records. [2025-10-07T22:43:39.066352] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-07T22:43:39.087973] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-07T22:43:39.088680] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-07T22:43:39.090556] [INFO ] [MAIN ] Derivative Progress: 1505/1748 symbols completed. TPH took 1.1s. Estimated remaining: 1m 33s. Rate: 156.3 symbols/min [2025-10-07T22:43:39.091042] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:39.094744] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-07T22:43:39.094842] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-07T22:43:39.096971] [INFO ] [MAIN ] Derivative Progress: 1506/1748 symbols completed. TPL took 1.1s. Estimated remaining: 1m 33s. Rate: 156.4 symbols/min [2025-10-07T22:43:39.097251] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:39.109167] [DEBUG] [LOCAL ] TPYP: Loaded 7898 existing records from primary storage. [2025-10-07T22:43:39.109346] [INFO ] [MAIN ] TPYP: Loaded 7898 primary data records. [2025-10-07T22:43:39.269214] [DEBUG] [LOCAL ] TPVG: Loaded 26934 existing records from primary storage. [2025-10-07T22:43:39.279869] [INFO ] [MAIN ] TPVG: Loaded 26934 primary data records. [2025-10-07T22:43:39.362765] [DEBUG] [LOCAL ] TPR: Loaded 53452 existing records from primary storage. [2025-10-07T22:43:39.517604] [INFO ] [MAIN ] TPR: Loaded 53452 primary data records. [2025-10-07T22:43:40.143576] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:40.144781] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7898 primary records. [2025-10-07T22:43:40.145005] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-07T22:43:40.177614] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:40.179262] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 26934 primary records. [2025-10-07T22:43:40.180102] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-07T22:43:40.181310] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-10-07T22:43:40.181914] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-07T22:43:40.194312] [INFO ] [MAIN ] Derivative Progress: 1507/1748 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 33s. Rate: 156.2 symbols/min [2025-10-07T22:43:40.194739] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:40.200363] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-07T22:43:40.200496] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-07T22:43:40.203436] [INFO ] [MAIN ] Derivative Progress: 1508/1748 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 32s. Rate: 156.3 symbols/min [2025-10-07T22:43:40.204091] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:40.224818] [DEBUG] [LOCAL ] TPZ: Loaded 4876 existing records from primary storage. [2025-10-07T22:43:40.225593] [INFO ] [MAIN ] TPZ: Loaded 4876 primary data records. [2025-10-07T22:43:40.225495] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:40.226532] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53452 primary records. [2025-10-07T22:43:40.257340] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-07T22:43:40.361003] [DEBUG] [LOCAL ] TR: Loaded 18745 existing records from primary storage. [2025-10-07T22:43:40.363199] [INFO ] [MAIN ] TR: Loaded 18745 primary data records. [2025-10-07T22:43:40.647871] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-10-07T22:43:40.664316] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-07T22:43:40.671398] [INFO ] [MAIN ] Derivative Progress: 1509/1748 symbols completed. TPR took 1.6s. Estimated remaining: 1m 32s. Rate: 156.3 symbols/min [2025-10-07T22:43:40.672124] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:40.888019] [DEBUG] [LOCAL ] TRAK: Loaded 9557 existing records from primary storage. [2025-10-07T22:43:40.888220] [INFO ] [MAIN ] TRAK: Loaded 9557 primary data records. [2025-10-07T22:43:41.229333] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:41.230762] [INFO ] [MAIN ] TPZ: Generated 1794 derivative records from 4876 primary records. [2025-10-07T22:43:41.232490] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-07T22:43:41.264453] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1794 records). [2025-10-07T22:43:41.264390] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:41.265302] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-07T22:43:41.265221] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18745 primary records. [2025-10-07T22:43:41.267692] [INFO ] [MAIN ] Derivative Progress: 1510/1748 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 31s. Rate: 156.2 symbols/min [2025-10-07T22:43:41.268026] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:41.268123] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-07T22:43:41.301716] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-07T22:43:41.316638] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-07T22:43:41.316521] [DEBUG] [LOCAL ] TRC: Loaded 15658 existing records from primary storage. [2025-10-07T22:43:41.316796] [INFO ] [MAIN ] TRC: Loaded 15658 primary data records. [2025-10-07T22:43:41.319020] [INFO ] [MAIN ] Derivative Progress: 1511/1748 symbols completed. TR took 1.1s. Estimated remaining: 1m 31s. Rate: 156.3 symbols/min [2025-10-07T22:43:41.319209] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:41.351712] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:41.386794] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9557 primary records. [2025-10-07T22:43:41.410867] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-07T22:43:41.520821] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-07T22:43:41.526763] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-07T22:43:41.684675] [INFO ] [MAIN ] Derivative Progress: 1512/1748 symbols completed. TRAK took 1.0s. Estimated remaining: 1m 31s. Rate: 156.3 symbols/min [2025-10-07T22:43:41.696711] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:41.721414] [DEBUG] [LOCAL ] TREX: Loaded 49939 existing records from primary storage. [2025-10-07T22:43:41.721888] [INFO ] [MAIN ] TREX: Loaded 49939 primary data records. [2025-10-07T22:43:41.943989] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:41.949713] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15658 primary records. [2025-10-07T22:43:41.949867] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-07T22:43:42.099756] [DEBUG] [LOCAL ] TRGP: Loaded 50761 existing records from primary storage. [2025-10-07T22:43:42.099978] [INFO ] [MAIN ] TRGP: Loaded 50761 primary data records. [2025-10-07T22:43:42.098429] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-07T22:43:42.100719] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-07T22:43:42.140603] [INFO ] [MAIN ] Derivative Progress: 1513/1748 symbols completed. TRC took 0.9s. Estimated remaining: 1m 30s. Rate: 156.3 symbols/min [2025-10-07T22:43:42.427382] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:42.428722] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49939 primary records. [2025-10-07T22:43:42.429512] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-07T22:43:42.447219] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-07T22:43:42.447543] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-07T22:43:42.449761] [INFO ] [MAIN ] Derivative Progress: 1514/1748 symbols completed. TREX took 1.1s. Estimated remaining: 1m 30s. Rate: 156.3 symbols/min [2025-10-07T22:43:42.468069] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:42.468686] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50761 primary records. [2025-10-07T22:43:42.468750] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-07T22:43:42.488826] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-10-07T22:43:42.488915] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-07T22:43:42.490946] [INFO ] [MAIN ] Derivative Progress: 1515/1748 symbols completed. TRGP took 0.8s. Estimated remaining: 1m 29s. Rate: 156.4 symbols/min [2025-10-07T22:43:42.491833] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:42.491766] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:42.491619] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:42.574287] [DEBUG] [LOCAL ] TRN: Loaded 36812 existing records from primary storage. [2025-10-07T22:43:42.575426] [INFO ] [MAIN ] TRN: Loaded 36812 primary data records. [2025-10-07T22:43:42.575290] [DEBUG] [LOCAL ] TROX: Loaded 51959 existing records from primary storage. [2025-10-07T22:43:42.596553] [INFO ] [MAIN ] TROX: Loaded 51959 primary data records. [2025-10-07T22:43:42.674689] [DEBUG] [LOCAL ] TRNO: Loaded 43993 existing records from primary storage. [2025-10-07T22:43:42.712934] [INFO ] [MAIN ] TRNO: Loaded 43993 primary data records. [2025-10-07T22:43:43.594667] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:43.595883] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51959 primary records. [2025-10-07T22:43:43.596105] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-07T22:43:43.611853] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:43.628069] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 36812 primary records. [2025-10-07T22:43:43.628837] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-07T22:43:43.629204] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-10-07T22:43:43.629333] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-07T22:43:43.632277] [INFO ] [MAIN ] Derivative Progress: 1516/1748 symbols completed. TROX took 1.1s. Estimated remaining: 1m 29s. Rate: 156.2 symbols/min [2025-10-07T22:43:43.632609] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:43.661859] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:43.663395] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43993 primary records. [2025-10-07T22:43:43.663935] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-07T22:43:43.684071] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-07T22:43:43.684444] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-07T22:43:43.686701] [INFO ] [MAIN ] Derivative Progress: 1517/1748 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 29s. Rate: 156.3 symbols/min [2025-10-07T22:43:43.687079] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:43.689222] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-07T22:43:43.689393] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-07T22:43:43.691357] [INFO ] [MAIN ] Derivative Progress: 1518/1748 symbols completed. TRN took 1.2s. Estimated remaining: 1m 28s. Rate: 156.4 symbols/min [2025-10-07T22:43:43.691710] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:43.748016] [DEBUG] [LOCAL ] TRP: Loaded 52123 existing records from primary storage. [2025-10-07T22:43:43.760257] [INFO ] [MAIN ] TRP: Loaded 52123 primary data records. [2025-10-07T22:43:43.809576] [DEBUG] [LOCAL ] TRTX: Loaded 37568 existing records from primary storage. [2025-10-07T22:43:43.848351] [INFO ] [MAIN ] TRTX: Loaded 37568 primary data records. [2025-10-07T22:43:43.959384] [DEBUG] [LOCAL ] TRU: Loaded 51320 existing records from primary storage. [2025-10-07T22:43:44.037972] [INFO ] [MAIN ] TRU: Loaded 51320 primary data records. [2025-10-07T22:43:44.737263] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:44.738599] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52123 primary records. [2025-10-07T22:43:44.751636] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-07T22:43:44.752662] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:44.753499] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37568 primary records. [2025-10-07T22:43:44.754082] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-07T22:43:44.785324] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-07T22:43:44.786110] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-07T22:43:44.786278] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-07T22:43:44.786209] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-07T22:43:44.788363] [INFO ] [MAIN ] Derivative Progress: 1519/1748 symbols completed. TRP took 1.2s. Estimated remaining: 1m 28s. Rate: 156.2 symbols/min [2025-10-07T22:43:44.788521] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:44.791510] [INFO ] [MAIN ] Derivative Progress: 1520/1748 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 28s. Rate: 156.3 symbols/min [2025-10-07T22:43:44.792377] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:44.807561] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:44.808528] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51320 primary records. [2025-10-07T22:43:44.808742] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-07T22:43:44.828238] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-10-07T22:43:44.828449] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-07T22:43:44.830880] [INFO ] [MAIN ] Derivative Progress: 1521/1748 symbols completed. TRU took 1.1s. Estimated remaining: 1m 27s. Rate: 156.4 symbols/min [2025-10-07T22:43:44.831345] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:44.866523] [DEBUG] [LOCAL ] TRV: Loaded 47572 existing records from primary storage. [2025-10-07T22:43:44.866745] [INFO ] [MAIN ] TRV: Loaded 47572 primary data records. [2025-10-07T22:43:45.069434] [DEBUG] [LOCAL ] TSE: Loaded 27970 existing records from primary storage. [2025-10-07T22:43:45.202004] [INFO ] [MAIN ] TSE: Loaded 27970 primary data records. [2025-10-07T22:43:45.202927] [DEBUG] [LOCAL ] TS: Loaded 51687 existing records from primary storage. [2025-10-07T22:43:45.203164] [INFO ] [MAIN ] TS: Loaded 51687 primary data records. [2025-10-07T22:43:45.872592] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:45.873427] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47572 primary records. [2025-10-07T22:43:45.873724] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-07T22:43:45.895120] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-07T22:43:45.895535] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-07T22:43:45.898011] [INFO ] [MAIN ] Derivative Progress: 1522/1748 symbols completed. TRV took 1.1s. Estimated remaining: 1m 27s. Rate: 156.2 symbols/min [2025-10-07T22:43:45.898579] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:45.916759] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:45.917552] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51687 primary records. [2025-10-07T22:43:45.920004] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-07T22:43:45.934140] [DEBUG] [LOCAL ] TSI: Loaded 7438 existing records from primary storage. [2025-10-07T22:43:45.946889] [INFO ] [MAIN ] TSI: Loaded 7438 primary data records. [2025-10-07T22:43:45.984845] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:45.991092] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 27970 primary records. [2025-10-07T22:43:45.998193] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-07T22:43:46.073674] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-07T22:43:46.089956] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-07T22:43:46.097691] [INFO ] [MAIN ] Derivative Progress: 1523/1748 symbols completed. TS took 1.3s. Estimated remaining: 1m 26s. Rate: 156.3 symbols/min [2025-10-07T22:43:46.103446] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:46.161431] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-10-07T22:43:46.161554] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-07T22:43:46.279092] [INFO ] [MAIN ] Derivative Progress: 1524/1748 symbols completed. TSE took 1.4s. Estimated remaining: 1m 26s. Rate: 156.3 symbols/min [2025-10-07T22:43:46.280284] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:46.320210] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:46.320999] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 7438 primary records. [2025-10-07T22:43:46.321073] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-07T22:43:46.347245] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-10-07T22:43:46.345441] [DEBUG] [LOCAL ] TSLX: Loaded 35356 existing records from primary storage. [2025-10-07T22:43:46.347425] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-07T22:43:46.349692] [INFO ] [MAIN ] Derivative Progress: 1525/1748 symbols completed. TSI took 0.5s. Estimated remaining: 1m 26s. Rate: 156.4 symbols/min [2025-10-07T22:43:46.349974] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:46.347569] [INFO ] [MAIN ] TSLX: Loaded 35356 primary data records. [2025-10-07T22:43:46.541559] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-07T22:43:46.690097] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-07T22:43:46.839209] [DEBUG] [LOCAL ] TSN: Loaded 52938 existing records from primary storage. [2025-10-07T22:43:46.850019] [INFO ] [MAIN ] TSN: Loaded 52938 primary data records. [2025-10-07T22:43:47.381755] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:47.384259] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35356 primary records. [2025-10-07T22:43:47.384900] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-07T22:43:47.402290] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-07T22:43:47.402510] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-07T22:43:47.405062] [INFO ] [MAIN ] Derivative Progress: 1526/1748 symbols completed. TSLX took 1.3s. Estimated remaining: 1m 25s. Rate: 156.2 symbols/min [2025-10-07T22:43:47.405240] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:47.424209] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:47.425434] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-07T22:43:47.425772] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-07T22:43:47.448842] [DEBUG] [LOCAL ] TSQ: Loaded 11798 existing records from primary storage. [2025-10-07T22:43:47.450246] [INFO ] [MAIN ] TSQ: Loaded 11798 primary data records. [2025-10-07T22:43:47.528848] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:47.541352] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52938 primary records. [2025-10-07T22:43:47.541773] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-07T22:43:47.559160] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-07T22:43:47.569775] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-07T22:43:47.573009] [INFO ] [MAIN ] Derivative Progress: 1527/1748 symbols completed. TSM took 1.3s. Estimated remaining: 1m 25s. Rate: 156.3 symbols/min [2025-10-07T22:43:47.581728] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:47.622987] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-07T22:43:47.653701] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-07T22:43:47.659711] [INFO ] [MAIN ] Derivative Progress: 1528/1748 symbols completed. TSN took 1.3s. Estimated remaining: 1m 24s. Rate: 156.4 symbols/min [2025-10-07T22:43:47.892865] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:47.893689] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11798 primary records. [2025-10-07T22:43:47.893838] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-07T22:43:47.921990] [DEBUG] [LOCAL ] TT: Loaded 47532 existing records from primary storage. [2025-10-07T22:43:47.922825] [INFO ] [MAIN ] TT: Loaded 47532 primary data records. [2025-10-07T22:43:47.998364] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-07T22:43:48.014295] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-07T22:43:48.026515] [INFO ] [MAIN ] Derivative Progress: 1529/1748 symbols completed. TSQ took 0.6s. Estimated remaining: 1m 24s. Rate: 156.4 symbols/min [2025-10-07T22:43:48.241929] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:48.242752] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47532 primary records. [2025-10-07T22:43:48.242827] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-07T22:43:48.258252] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-10-07T22:43:48.258320] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-07T22:43:48.260312] [INFO ] [MAIN ] Derivative Progress: 1530/1748 symbols completed. TT took 0.7s. Estimated remaining: 1m 24s. Rate: 156.4 symbols/min [2025-10-07T22:43:48.260804] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:48.260972] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:48.260866] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:48.332268] [DEBUG] [LOCAL ] TTC: Loaded 42053 existing records from primary storage. [2025-10-07T22:43:48.358575] [INFO ] [MAIN ] TTC: Loaded 42053 primary data records. [2025-10-07T22:43:48.359533] [DEBUG] [LOCAL ] TTE: Loaded 51602 existing records from primary storage. [2025-10-07T22:43:48.370707] [INFO ] [MAIN ] TTE: Loaded 51602 primary data records. [2025-10-07T22:43:48.402008] [DEBUG] [LOCAL ] TTI: Loaded 45892 existing records from primary storage. [2025-10-07T22:43:48.421967] [INFO ] [MAIN ] TTI: Loaded 45892 primary data records. [2025-10-07T22:43:49.269422] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:49.283994] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51602 primary records. [2025-10-07T22:43:49.284299] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:49.284420] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-07T22:43:49.285257] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42053 primary records. [2025-10-07T22:43:49.285751] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-07T22:43:49.313711] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-07T22:43:49.314674] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-07T22:43:49.316964] [INFO ] [MAIN ] Derivative Progress: 1531/1748 symbols completed. TTE took 1.1s. Estimated remaining: 1m 23s. Rate: 156.2 symbols/min [2025-10-07T22:43:49.317451] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:49.332501] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:49.333488] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45892 primary records. [2025-10-07T22:43:49.333855] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-07T22:43:49.349075] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-07T22:43:49.351096] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-07T22:43:49.352156] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-07T22:43:49.352352] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-07T22:43:49.354485] [INFO ] [MAIN ] Derivative Progress: 1532/1748 symbols completed. TTI took 1.1s. Estimated remaining: 1m 23s. Rate: 156.3 symbols/min [2025-10-07T22:43:49.356793] [INFO ] [MAIN ] Derivative Progress: 1533/1748 symbols completed. TTC took 1.1s. Estimated remaining: 1m 22s. Rate: 156.4 symbols/min [2025-10-07T22:43:49.356681] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:49.357428] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:49.415725] [DEBUG] [LOCAL ] TU: Loaded 49853 existing records from primary storage. [2025-10-07T22:43:49.424093] [INFO ] [MAIN ] TU: Loaded 49853 primary data records. [2025-10-07T22:43:49.551861] [DEBUG] [LOCAL ] TV: Loaded 42192 existing records from primary storage. [2025-10-07T22:43:49.574122] [INFO ] [MAIN ] TV: Loaded 42192 primary data records. [2025-10-07T22:43:49.563702] [DEBUG] [LOCAL ] TUYA: Loaded 46045 existing records from primary storage. [2025-10-07T22:43:49.590811] [INFO ] [MAIN ] TUYA: Loaded 46045 primary data records. [2025-10-07T22:43:50.411400] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:50.412426] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49853 primary records. [2025-10-07T22:43:50.415457] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-07T22:43:50.447734] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-07T22:43:50.444495] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:50.450107] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 42192 primary records. [2025-10-07T22:43:50.448624] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-07T22:43:50.452242] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-07T22:43:50.452149] [INFO ] [MAIN ] Derivative Progress: 1534/1748 symbols completed. TU took 1.1s. Estimated remaining: 1m 22s. Rate: 156.2 symbols/min [2025-10-07T22:43:50.453414] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:50.469760] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:50.478377] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46045 primary records. [2025-10-07T22:43:50.483317] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-07T22:43:50.499385] [DEBUG] [LOCAL ] TVC: Loaded 3323 existing records from primary storage. [2025-10-07T22:43:50.503122] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-07T22:43:50.504542] [INFO ] [MAIN ] TVC: Loaded 3323 primary data records. [2025-10-07T22:43:50.511174] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-07T22:43:50.521422] [INFO ] [MAIN ] Derivative Progress: 1535/1748 symbols completed. TV took 1.2s. Estimated remaining: 1m 22s. Rate: 156.3 symbols/min [2025-10-07T22:43:50.547089] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:50.554992] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-07T22:43:50.566965] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-07T22:43:50.569419] [INFO ] [MAIN ] Derivative Progress: 1536/1748 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 21s. Rate: 156.4 symbols/min [2025-10-07T22:43:50.591046] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:50.619990] [DEBUG] [LOCAL ] TVE: Loaded 2782 existing records from primary storage. [2025-10-07T22:43:50.620150] [INFO ] [MAIN ] TVE: Loaded 2782 primary data records. [2025-10-07T22:43:51.152222] [DEBUG] [LOCAL ] TWI: Loaded 34116 existing records from primary storage. [2025-10-07T22:43:51.153205] [INFO ] [MAIN ] TWI: Loaded 34116 primary data records. [2025-10-07T22:43:51.479543] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-07T22:43:51.480579] [INFO ] [MAIN ] TVC: Generated 1792 derivative records from 3323 primary records. [2025-10-07T22:43:51.483810] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-07T22:43:51.514352] [DEBUG] [LOCAL ] TVC: Derivative data saved (1792 records). [2025-10-07T22:43:51.510610] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:51.514701] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-07T22:43:51.515690] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2782 primary records. [2025-10-07T22:43:51.517854] [INFO ] [MAIN ] Derivative Progress: 1537/1748 symbols completed. TVC took 1.1s. Estimated remaining: 1m 21s. Rate: 156.3 symbols/min [2025-10-07T22:43:51.517959] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-07T22:43:51.518330] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:51.535543] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-10-07T22:43:51.535869] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-07T22:43:51.539788] [INFO ] [MAIN ] Derivative Progress: 1538/1748 symbols completed. TVE took 1.0s. Estimated remaining: 1m 21s. Rate: 156.4 symbols/min [2025-10-07T22:43:51.541486] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:51.556076] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:51.556884] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34116 primary records. [2025-10-07T22:43:51.558011] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-07T22:43:51.573963] [DEBUG] [LOCAL ] TWN: Loaded 3192 existing records from primary storage. [2025-10-07T22:43:51.575129] [INFO ] [MAIN ] TWN: Loaded 3192 primary data records. [2025-10-07T22:43:51.696925] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-10-07T22:43:51.697397] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-07T22:43:51.705240] [INFO ] [MAIN ] Derivative Progress: 1539/1748 symbols completed. TWI took 1.1s. Estimated remaining: 1m 20s. Rate: 156.4 symbols/min [2025-10-07T22:43:51.749457] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:51.940317] [DEBUG] [LOCAL ] TWLO: Loaded 52746 existing records from primary storage. [2025-10-07T22:43:51.940679] [INFO ] [MAIN ] TWLO: Loaded 52746 primary data records. [2025-10-07T22:43:52.286604] [DEBUG] [LOCAL ] TWO: Loaded 48513 existing records from primary storage. [2025-10-07T22:43:52.287367] [INFO ] [MAIN ] TWO: Loaded 48513 primary data records. [2025-10-07T22:43:52.355921] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:52.393246] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3192 primary records. [2025-10-07T22:43:52.426422] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-07T22:43:52.621914] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-10-07T22:43:52.622706] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-07T22:43:52.624967] [INFO ] [MAIN ] Derivative Progress: 1540/1748 symbols completed. TWN took 1.1s. Estimated remaining: 1m 20s. Rate: 156.3 symbols/min [2025-10-07T22:43:52.633478] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:52.639936] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:52.641043] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52746 primary records. [2025-10-07T22:43:52.641613] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-07T22:43:52.660124] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-10-07T22:43:52.660333] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-07T22:43:52.662570] [INFO ] [MAIN ] Derivative Progress: 1541/1748 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 19s. Rate: 156.4 symbols/min [2025-10-07T22:43:52.663086] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:52.698965] [DEBUG] [LOCAL ] TX: Loaded 23434 existing records from primary storage. [2025-10-07T22:43:52.699683] [INFO ] [MAIN ] TX: Loaded 23434 primary data records. [2025-10-07T22:43:52.699556] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:52.705927] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48513 primary records. [2025-10-07T22:43:52.713381] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-07T22:43:52.819718] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-07T22:43:52.842136] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-07T22:43:52.844323] [INFO ] [MAIN ] Derivative Progress: 1542/1748 symbols completed. TWO took 1.1s. Estimated remaining: 1m 19s. Rate: 156.4 symbols/min [2025-10-07T22:43:52.862562] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:52.937470] [DEBUG] [LOCAL ] TXNM: Loaded 43424 existing records from primary storage. [2025-10-07T22:43:52.961450] [INFO ] [MAIN ] TXNM: Loaded 43424 primary data records. [2025-10-07T22:43:53.153638] [DEBUG] [LOCAL ] TXO: Loaded 19125 existing records from primary storage. [2025-10-07T22:43:53.164720] [INFO ] [MAIN ] TXO: Loaded 19125 primary data records. [2025-10-07T22:43:53.739944] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:53.740979] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23434 primary records. [2025-10-07T22:43:53.741158] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-07T22:43:53.761526] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-07T22:43:53.761876] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-07T22:43:53.763984] [INFO ] [MAIN ] Derivative Progress: 1543/1748 symbols completed. TX took 1.1s. Estimated remaining: 1m 19s. Rate: 156.3 symbols/min [2025-10-07T22:43:53.777556] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:53.778529] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43424 primary records. [2025-10-07T22:43:53.778614] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-07T22:43:53.807624] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:53.808911] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 19125 primary records. [2025-10-07T22:43:53.809307] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-07T22:43:53.824317] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-10-07T22:43:53.824876] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-07T22:43:53.827884] [INFO ] [MAIN ] Derivative Progress: 1544/1748 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 18s. Rate: 156.4 symbols/min [2025-10-07T22:43:53.830344] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-07T22:43:53.830406] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-07T22:43:53.832513] [INFO ] [MAIN ] Derivative Progress: 1545/1748 symbols completed. TXO took 1.0s. Estimated remaining: 1m 18s. Rate: 156.5 symbols/min [2025-10-07T22:43:53.833079] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:53.833171] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:53.833673] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:53.845058] [DEBUG] [LOCAL ] TY: Loaded 7612 existing records from primary storage. [2025-10-07T22:43:53.848585] [INFO ] [MAIN ] TY: Loaded 7612 primary data records. [2025-10-07T22:43:53.950689] [DEBUG] [LOCAL ] TYG: Loaded 13917 existing records from primary storage. [2025-10-07T22:43:53.953915] [INFO ] [MAIN ] TYG: Loaded 13917 primary data records. [2025-10-07T22:43:54.290010] [DEBUG] [LOCAL ] TXT: Loaded 49726 existing records from primary storage. [2025-10-07T22:43:54.300697] [INFO ] [MAIN ] TXT: Loaded 49726 primary data records. [2025-10-07T22:43:54.792889] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:54.795310] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7612 primary records. [2025-10-07T22:43:54.796061] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-07T22:43:54.823784] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:54.825386] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 13917 primary records. [2025-10-07T22:43:54.825481] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-07T22:43:54.836840] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-07T22:43:54.836935] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-07T22:43:54.842606] [INFO ] [MAIN ] Derivative Progress: 1546/1748 symbols completed. TY took 1.0s. Estimated remaining: 1m 18s. Rate: 156.3 symbols/min [2025-10-07T22:43:54.846842] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-07T22:43:54.846960] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:54.847404] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-07T22:43:54.849686] [INFO ] [MAIN ] Derivative Progress: 1547/1748 symbols completed. TYG took 1.0s. Estimated remaining: 1m 17s. Rate: 156.4 symbols/min [2025-10-07T22:43:54.850241] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:54.871589] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:54.872459] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49726 primary records. [2025-10-07T22:43:54.872597] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-07T22:43:54.904545] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-10-07T22:43:54.918091] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-07T22:43:54.905098] [DEBUG] [LOCAL ] TYL: Loaded 22251 existing records from primary storage. [2025-10-07T22:43:54.920752] [INFO ] [MAIN ] Derivative Progress: 1548/1748 symbols completed. TXT took 1.1s. Estimated remaining: 1m 17s. Rate: 156.5 symbols/min [2025-10-07T22:43:54.920965] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:54.918385] [INFO ] [MAIN ] TYL: Loaded 22251 primary data records. [2025-10-07T22:43:55.061153] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-07T22:43:55.112594] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-07T22:43:55.365853] [DEBUG] [LOCAL ] UA: Loaded 50453 existing records from primary storage. [2025-10-07T22:43:55.387406] [INFO ] [MAIN ] UA: Loaded 50453 primary data records. [2025-10-07T22:43:55.926590] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:55.936772] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22251 primary records. [2025-10-07T22:43:55.936942] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-07T22:43:55.957402] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-07T22:43:55.957620] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-07T22:43:55.959813] [INFO ] [MAIN ] Derivative Progress: 1549/1748 symbols completed. TYL took 1.1s. Estimated remaining: 1m 16s. Rate: 156.3 symbols/min [2025-10-07T22:43:55.960272] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:55.979821] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:55.981043] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-07T22:43:55.981247] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-07T22:43:56.018542] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-07T22:43:56.018895] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:56.019046] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-07T22:43:56.021526] [INFO ] [MAIN ] Derivative Progress: 1550/1748 symbols completed. U took 1.2s. Estimated remaining: 1m 16s. Rate: 156.4 symbols/min [2025-10-07T22:43:56.022380] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50453 primary records. [2025-10-07T22:43:56.022538] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-07T22:43:56.022786] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:56.055594] [DEBUG] [LOCAL ] UAN: Loaded 5439 existing records from primary storage. [2025-10-07T22:43:56.069310] [INFO ] [MAIN ] UAN: Loaded 5439 primary data records. [2025-10-07T22:43:56.122881] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-10-07T22:43:56.145819] [INFO ] [MAIN ] UAA: Loaded 53509 primary data records. [2025-10-07T22:43:56.163683] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-07T22:43:56.211470] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-07T22:43:56.227276] [INFO ] [MAIN ] Derivative Progress: 1551/1748 symbols completed. UA took 1.3s. Estimated remaining: 1m 16s. Rate: 156.4 symbols/min [2025-10-07T22:43:56.244707] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:56.729065] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-07T22:43:56.729570] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-07T22:43:56.868965] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:56.916243] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:56.907070] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5439 primary records. [2025-10-07T22:43:56.926529] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-07T22:43:56.943513] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53509 primary records. [2025-10-07T22:43:56.947613] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-07T22:43:57.096137] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-10-07T22:43:57.097190] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-07T22:43:57.100471] [INFO ] [MAIN ] Derivative Progress: 1552/1748 symbols completed. UAN took 1.1s. Estimated remaining: 1m 15s. Rate: 156.3 symbols/min [2025-10-07T22:43:57.102076] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:57.103208] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-07T22:43:57.103426] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-07T22:43:57.106102] [INFO ] [MAIN ] Derivative Progress: 1553/1748 symbols completed. UAA took 1.1s. Estimated remaining: 1m 15s. Rate: 156.4 symbols/min [2025-10-07T22:43:57.106360] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:57.126241] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:57.127060] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-07T22:43:57.127375] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-07T22:43:57.143284] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-07T22:43:57.143532] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-07T22:43:57.146850] [INFO ] [MAIN ] Derivative Progress: 1554/1748 symbols completed. UBER took 0.9s. Estimated remaining: 1m 14s. Rate: 156.5 symbols/min [2025-10-07T22:43:57.147218] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:57.189631] [DEBUG] [LOCAL ] UCB: Loaded 37828 existing records from primary storage. [2025-10-07T22:43:57.189823] [INFO ] [MAIN ] UCB: Loaded 37828 primary data records. [2025-10-07T22:43:57.321599] [DEBUG] [LOCAL ] UBS: Loaded 52354 existing records from primary storage. [2025-10-07T22:43:57.327553] [INFO ] [MAIN ] UBS: Loaded 52354 primary data records. [2025-10-07T22:43:57.484425] [DEBUG] [LOCAL ] UDR: Loaded 51890 existing records from primary storage. [2025-10-07T22:43:57.561095] [INFO ] [MAIN ] UDR: Loaded 51890 primary data records. [2025-10-07T22:43:58.227377] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:58.228291] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37828 primary records. [2025-10-07T22:43:58.229169] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-07T22:43:58.247444] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-10-07T22:43:58.255861] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-07T22:43:58.261179] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:58.263206] [INFO ] [MAIN ] Derivative Progress: 1555/1748 symbols completed. UCB took 1.2s. Estimated remaining: 1m 14s. Rate: 156.3 symbols/min [2025-10-07T22:43:58.264023] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52354 primary records. [2025-10-07T22:43:58.264492] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:58.264402] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-07T22:43:58.292905] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-07T22:43:58.298516] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-07T22:43:58.298449] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:58.300602] [INFO ] [MAIN ] Derivative Progress: 1556/1748 symbols completed. UBS took 1.2s. Estimated remaining: 1m 14s. Rate: 156.4 symbols/min [2025-10-07T22:43:58.301427] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51890 primary records. [2025-10-07T22:43:58.301615] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-07T22:43:58.301563] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:58.333911] [DEBUG] [LOCAL ] UFI: Loaded 8117 existing records from primary storage. [2025-10-07T22:43:58.334695] [INFO ] [MAIN ] UFI: Loaded 8117 primary data records. [2025-10-07T22:43:58.335045] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-07T22:43:58.346485] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-07T22:43:58.368281] [INFO ] [MAIN ] Derivative Progress: 1557/1748 symbols completed. UDR took 1.2s. Estimated remaining: 1m 13s. Rate: 156.5 symbols/min [2025-10-07T22:43:58.381217] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:58.456961] [DEBUG] [LOCAL ] UE: Loaded 42693 existing records from primary storage. [2025-10-07T22:43:58.484250] [INFO ] [MAIN ] UE: Loaded 42693 primary data records. [2025-10-07T22:43:58.992893] [DEBUG] [LOCAL ] UGI: Loaded 50531 existing records from primary storage. [2025-10-07T22:43:58.995414] [INFO ] [MAIN ] UGI: Loaded 50531 primary data records. [2025-10-07T22:43:59.321052] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:59.322750] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8117 primary records. [2025-10-07T22:43:59.323048] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-07T22:43:59.355893] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:59.357332] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42693 primary records. [2025-10-07T22:43:59.357699] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-07T22:43:59.357930] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-07T22:43:59.358107] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-07T22:43:59.360437] [INFO ] [MAIN ] Derivative Progress: 1558/1748 symbols completed. UFI took 1.1s. Estimated remaining: 1m 13s. Rate: 156.3 symbols/min [2025-10-07T22:43:59.377707] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-07T22:43:59.377806] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-07T22:43:59.379999] [INFO ] [MAIN ] Derivative Progress: 1559/1748 symbols completed. UE took 1.1s. Estimated remaining: 1m 12s. Rate: 156.4 symbols/min [2025-10-07T22:43:59.395457] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:43:59.396028] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50531 primary records. [2025-10-07T22:43:59.396087] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-07T22:43:59.411790] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-07T22:43:59.411851] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-07T22:43:59.413625] [INFO ] [MAIN ] Derivative Progress: 1560/1748 symbols completed. UGI took 1.0s. Estimated remaining: 1m 12s. Rate: 156.5 symbols/min [2025-10-07T22:43:59.414266] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:59.414192] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:59.414363] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:43:59.434733] [DEBUG] [LOCAL ] UHAL: Loaded 16716 existing records from primary storage. [2025-10-07T22:43:59.434910] [INFO ] [MAIN ] UHAL: Loaded 16716 primary data records. [2025-10-07T22:43:59.816561] [DEBUG] [LOCAL ] UGP: Loaded 42867 existing records from primary storage. [2025-10-07T22:43:59.816868] [INFO ] [MAIN ] UGP: Loaded 42867 primary data records. [2025-10-07T22:43:59.829029] [DEBUG] [LOCAL ] UHS: Loaded 40668 existing records from primary storage. [2025-10-07T22:43:59.849121] [INFO ] [MAIN ] UHS: Loaded 40668 primary data records. [2025-10-07T22:44:00.454230] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:00.456410] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16716 primary records. [2025-10-07T22:44:00.456861] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-07T22:44:00.477330] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-07T22:44:00.477694] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-07T22:44:00.481735] [INFO ] [MAIN ] Derivative Progress: 1561/1748 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 12s. Rate: 156.3 symbols/min [2025-10-07T22:44:00.483007] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:00.497474] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:00.511360] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42867 primary records. [2025-10-07T22:44:00.512232] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-07T22:44:00.512580] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:00.514444] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40668 primary records. [2025-10-07T22:44:00.522010] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-07T22:44:00.545673] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-07T22:44:00.546520] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-07T22:44:00.549155] [INFO ] [MAIN ] Derivative Progress: 1562/1748 symbols completed. UGP took 1.1s. Estimated remaining: 1m 11s. Rate: 156.4 symbols/min [2025-10-07T22:44:00.549578] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:00.557736] [DEBUG] [LOCAL ] UHT: Loaded 10020 existing records from primary storage. [2025-10-07T22:44:00.558404] [INFO ] [MAIN ] UHT: Loaded 10020 primary data records. [2025-10-07T22:44:00.591528] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-07T22:44:00.615804] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-07T22:44:00.665145] [INFO ] [MAIN ] Derivative Progress: 1563/1748 symbols completed. UHS took 1.3s. Estimated remaining: 1m 11s. Rate: 156.5 symbols/min [2025-10-07T22:44:00.668719] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:00.751852] [DEBUG] [LOCAL ] UI: Loaded 13335 existing records from primary storage. [2025-10-07T22:44:00.874599] [INFO ] [MAIN ] UI: Loaded 13335 primary data records. [2025-10-07T22:44:01.059186] [DEBUG] [LOCAL ] UIS: Loaded 36972 existing records from primary storage. [2025-10-07T22:44:01.079963] [INFO ] [MAIN ] UIS: Loaded 36972 primary data records. [2025-10-07T22:44:01.612233] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:01.615475] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10020 primary records. [2025-10-07T22:44:01.616183] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-07T22:44:01.636894] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-10-07T22:44:01.639837] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-07T22:44:01.644241] [INFO ] [MAIN ] Derivative Progress: 1564/1748 symbols completed. UHT took 1.2s. Estimated remaining: 1m 11s. Rate: 156.3 symbols/min [2025-10-07T22:44:01.645240] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:01.661713] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:01.662699] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 13335 primary records. [2025-10-07T22:44:01.662990] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-07T22:44:01.683770] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-07T22:44:01.683913] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-07T22:44:01.686288] [INFO ] [MAIN ] Derivative Progress: 1565/1748 symbols completed. UI took 1.1s. Estimated remaining: 1m 10s. Rate: 156.4 symbols/min [2025-10-07T22:44:01.699971] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:01.700317] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:01.702042] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36972 primary records. [2025-10-07T22:44:01.702165] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-07T22:44:01.734153] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-07T22:44:01.734468] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-07T22:44:01.736763] [INFO ] [MAIN ] Derivative Progress: 1566/1748 symbols completed. UIS took 1.1s. Estimated remaining: 1m 10s. Rate: 156.5 symbols/min [2025-10-07T22:44:01.740429] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:01.760212] [DEBUG] [LOCAL ] UL: Loaded 53074 existing records from primary storage. [2025-10-07T22:44:01.768938] [INFO ] [MAIN ] UL: Loaded 53074 primary data records. [2025-10-07T22:44:01.884694] [DEBUG] [LOCAL ] ULS: Loaded 39452 existing records from primary storage. [2025-10-07T22:44:01.910852] [INFO ] [MAIN ] ULS: Loaded 39452 primary data records. [2025-10-07T22:44:02.220755] [DEBUG] [LOCAL ] UMC: Loaded 52716 existing records from primary storage. [2025-10-07T22:44:02.242078] [INFO ] [MAIN ] UMC: Loaded 52716 primary data records. [2025-10-07T22:44:02.745377] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:02.747131] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53074 primary records. [2025-10-07T22:44:02.747974] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-07T22:44:02.766859] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-07T22:44:02.767404] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-07T22:44:02.769451] [INFO ] [MAIN ] Derivative Progress: 1567/1748 symbols completed. UL took 1.1s. Estimated remaining: 1m 9s. Rate: 156.3 symbols/min [2025-10-07T22:44:02.783321] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:02.783748] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:02.785168] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39452 primary records. [2025-10-07T22:44:02.785462] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-07T22:44:02.806095] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-07T22:44:02.819755] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-07T22:44:02.820084] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:02.822455] [INFO ] [MAIN ] Derivative Progress: 1568/1748 symbols completed. ULS took 1.1s. Estimated remaining: 1m 9s. Rate: 156.4 symbols/min [2025-10-07T22:44:02.823901] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52716 primary records. [2025-10-07T22:44:02.823977] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-07T22:44:02.824436] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:02.850474] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-07T22:44:02.850729] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-07T22:44:02.852910] [INFO ] [MAIN ] Derivative Progress: 1569/1748 symbols completed. UMC took 1.1s. Estimated remaining: 1m 9s. Rate: 156.5 symbols/min [2025-10-07T22:44:02.853139] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:02.873518] [DEBUG] [LOCAL ] UNF: Loaded 12129 existing records from primary storage. [2025-10-07T22:44:02.873867] [INFO ] [MAIN ] UNF: Loaded 12129 primary data records. [2025-10-07T22:44:02.874327] [DEBUG] [LOCAL ] UMH: Loaded 33804 existing records from primary storage. [2025-10-07T22:44:02.885728] [INFO ] [MAIN ] UMH: Loaded 33804 primary data records. [2025-10-07T22:44:03.174204] [DEBUG] [LOCAL ] UNFI: Loaded 42313 existing records from primary storage. [2025-10-07T22:44:03.189944] [INFO ] [MAIN ] UNFI: Loaded 42313 primary data records. [2025-10-07T22:44:03.892523] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:03.895468] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 12129 primary records. [2025-10-07T22:44:03.895853] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-07T22:44:03.917877] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:03.919085] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33804 primary records. [2025-10-07T22:44:03.920193] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-07T22:44:03.941984] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-10-07T22:44:03.942595] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-07T22:44:03.944911] [INFO ] [MAIN ] Derivative Progress: 1570/1748 symbols completed. UNF took 1.1s. Estimated remaining: 1m 8s. Rate: 156.3 symbols/min [2025-10-07T22:44:03.945301] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:03.962917] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:03.964393] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 42313 primary records. [2025-10-07T22:44:03.964498] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-07T22:44:03.966609] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-07T22:44:03.967058] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-07T22:44:03.977753] [INFO ] [MAIN ] Derivative Progress: 1571/1748 symbols completed. UMH took 1.2s. Estimated remaining: 1m 8s. Rate: 156.4 symbols/min [2025-10-07T22:44:03.979276] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:03.989997] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-07T22:44:03.990089] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-07T22:44:03.992137] [INFO ] [MAIN ] Derivative Progress: 1572/1748 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 7s. Rate: 156.5 symbols/min [2025-10-07T22:44:03.992415] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:04.003060] [DEBUG] [LOCAL ] UNMA: Loaded 3517 existing records from primary storage. [2025-10-07T22:44:04.003342] [INFO ] [MAIN ] UNMA: Loaded 3517 primary data records. [2025-10-07T22:44:04.174010] [DEBUG] [LOCAL ] UNH: Loaded 53802 existing records from primary storage. [2025-10-07T22:44:04.189808] [INFO ] [MAIN ] UNH: Loaded 53802 primary data records. [2025-10-07T22:44:04.339002] [DEBUG] [LOCAL ] UNM: Loaded 48288 existing records from primary storage. [2025-10-07T22:44:04.470294] [INFO ] [MAIN ] UNM: Loaded 48288 primary data records. [2025-10-07T22:44:05.023187] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-10-07T22:44:05.024143] [INFO ] [MAIN ] UNMA: Generated 1791 derivative records from 3517 primary records. [2025-10-07T22:44:05.024579] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-07T22:44:05.060094] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:05.062068] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53802 primary records. [2025-10-07T22:44:05.062392] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-07T22:44:05.091098] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1791 records). [2025-10-07T22:44:05.094766] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-07T22:44:05.091461] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:05.094679] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-07T22:44:05.094958] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-07T22:44:05.099888] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48288 primary records. [2025-10-07T22:44:05.097148] [INFO ] [MAIN ] Derivative Progress: 1573/1748 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 7s. Rate: 156.3 symbols/min [2025-10-07T22:44:05.100004] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-07T22:44:05.101021] [INFO ] [MAIN ] Derivative Progress: 1574/1748 symbols completed. UNH took 1.2s. Estimated remaining: 1m 7s. Rate: 156.4 symbols/min [2025-10-07T22:44:05.116066] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-07T22:44:05.116131] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-07T22:44:05.118108] [INFO ] [MAIN ] Derivative Progress: 1575/1748 symbols completed. UNM took 1.1s. Estimated remaining: 1m 6s. Rate: 156.5 symbols/min [2025-10-07T22:44:05.118566] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:05.118509] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:05.118779] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:05.198580] [DEBUG] [LOCAL ] UP: Loaded 43547 existing records from primary storage. [2025-10-07T22:44:05.198763] [INFO ] [MAIN ] UP: Loaded 43547 primary data records. [2025-10-07T22:44:05.330533] [DEBUG] [LOCAL ] UPS: Loaded 53717 existing records from primary storage. [2025-10-07T22:44:05.357675] [DEBUG] [LOCAL ] UNP: Loaded 53301 existing records from primary storage. [2025-10-07T22:44:05.379539] [INFO ] [MAIN ] UNP: Loaded 53301 primary data records. [2025-10-07T22:44:05.357841] [INFO ] [MAIN ] UPS: Loaded 53717 primary data records. [2025-10-07T22:44:06.190471] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:06.192169] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43547 primary records. [2025-10-07T22:44:06.192574] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-07T22:44:06.214847] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-07T22:44:06.215589] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-07T22:44:06.217989] [INFO ] [MAIN ] Derivative Progress: 1576/1748 symbols completed. UP took 1.1s. Estimated remaining: 1m 6s. Rate: 156.3 symbols/min [2025-10-07T22:44:06.218382] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:06.240983] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:06.247281] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53301 primary records. [2025-10-07T22:44:06.247726] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:06.248613] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-07T22:44:06.248536] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53717 primary records. [2025-10-07T22:44:06.249696] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-07T22:44:06.279677] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-10-07T22:44:06.280336] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-07T22:44:06.282841] [INFO ] [MAIN ] Derivative Progress: 1577/1748 symbols completed. UPS took 1.2s. Estimated remaining: 1m 6s. Rate: 156.4 symbols/min [2025-10-07T22:44:06.283479] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:06.285856] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-07T22:44:06.286062] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-07T22:44:06.288677] [INFO ] [MAIN ] Derivative Progress: 1578/1748 symbols completed. UNP took 1.2s. Estimated remaining: 1m 5s. Rate: 156.5 symbols/min [2025-10-07T22:44:06.289233] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:06.338189] [DEBUG] [LOCAL ] URI: Loaded 35287 existing records from primary storage. [2025-10-07T22:44:06.338429] [INFO ] [MAIN ] URI: Loaded 35287 primary data records. [2025-10-07T22:44:06.435976] [DEBUG] [LOCAL ] USAC: Loaded 21747 existing records from primary storage. [2025-10-07T22:44:06.447179] [DEBUG] [LOCAL ] USA: Loaded 35975 existing records from primary storage. [2025-10-07T22:44:06.457845] [INFO ] [MAIN ] USAC: Loaded 21747 primary data records. [2025-10-07T22:44:06.463550] [INFO ] [MAIN ] USA: Loaded 35975 primary data records. [2025-10-07T22:44:07.300601] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:07.301772] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 35287 primary records. [2025-10-07T22:44:07.302247] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-07T22:44:07.332096] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:07.333944] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 21747 primary records. [2025-10-07T22:44:07.334529] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-07T22:44:07.352195] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-10-07T22:44:07.352747] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-07T22:44:07.363448] [INFO ] [MAIN ] Derivative Progress: 1579/1748 symbols completed. URI took 1.1s. Estimated remaining: 1m 5s. Rate: 156.3 symbols/min [2025-10-07T22:44:07.370039] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:07.369887] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:07.372301] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 35975 primary records. [2025-10-07T22:44:07.372703] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-10-07T22:44:07.372800] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-07T22:44:07.372393] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-07T22:44:07.375136] [INFO ] [MAIN ] Derivative Progress: 1580/1748 symbols completed. USAC took 1.1s. Estimated remaining: 1m 4s. Rate: 156.4 symbols/min [2025-10-07T22:44:07.375897] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:07.393997] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-07T22:44:07.394070] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-07T22:44:07.396125] [INFO ] [MAIN ] Derivative Progress: 1581/1748 symbols completed. USA took 1.1s. Estimated remaining: 1m 4s. Rate: 156.5 symbols/min [2025-10-07T22:44:07.396425] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:07.432299] [DEBUG] [LOCAL ] USNA: Loaded 17715 existing records from primary storage. [2025-10-07T22:44:07.432441] [INFO ] [MAIN ] USNA: Loaded 17715 primary data records. [2025-10-07T22:44:07.567742] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-07T22:44:07.573724] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-07T22:44:07.701842] [DEBUG] [LOCAL ] USFD: Loaded 51191 existing records from primary storage. [2025-10-07T22:44:07.707277] [INFO ] [MAIN ] USFD: Loaded 51191 primary data records. [2025-10-07T22:44:08.441180] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:08.442320] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17715 primary records. [2025-10-07T22:44:08.444264] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-07T22:44:08.472552] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:08.473842] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-07T22:44:08.474321] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-07T22:44:08.500935] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-07T22:44:08.506716] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-07T22:44:08.509203] [INFO ] [MAIN ] Derivative Progress: 1582/1748 symbols completed. USNA took 1.1s. Estimated remaining: 1m 4s. Rate: 156.3 symbols/min [2025-10-07T22:44:08.507051] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:08.509599] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:08.510853] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51191 primary records. [2025-10-07T22:44:08.511666] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-07T22:44:08.523363] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-07T22:44:08.523614] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-07T22:44:08.528363] [INFO ] [MAIN ] Derivative Progress: 1583/1748 symbols completed. USB took 1.2s. Estimated remaining: 1m 3s. Rate: 156.4 symbols/min [2025-10-07T22:44:08.528635] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:08.533412] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-07T22:44:08.533586] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-07T22:44:08.536202] [INFO ] [MAIN ] Derivative Progress: 1584/1748 symbols completed. USFD took 1.2s. Estimated remaining: 1m 3s. Rate: 156.5 symbols/min [2025-10-07T22:44:08.536710] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:08.554507] [DEBUG] [LOCAL ] USPH: Loaded 17004 existing records from primary storage. [2025-10-07T22:44:08.562062] [INFO ] [MAIN ] USPH: Loaded 17004 primary data records. [2025-10-07T22:44:08.695202] [DEBUG] [LOCAL ] UTF: Loaded 29954 existing records from primary storage. [2025-10-07T22:44:08.701452] [INFO ] [MAIN ] UTF: Loaded 29954 primary data records. [2025-10-07T22:44:09.035217] [DEBUG] [LOCAL ] UTI: Loaded 40611 existing records from primary storage. [2025-10-07T22:44:09.041193] [INFO ] [MAIN ] UTI: Loaded 40611 primary data records. [2025-10-07T22:44:09.621574] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:09.622923] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 17004 primary records. [2025-10-07T22:44:09.623320] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-07T22:44:09.642979] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-07T22:44:09.643596] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-07T22:44:09.645804] [INFO ] [MAIN ] Derivative Progress: 1585/1748 symbols completed. USPH took 1.1s. Estimated remaining: 1m 3s. Rate: 156.3 symbols/min [2025-10-07T22:44:09.654150] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:09.659956] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:09.660941] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 29954 primary records. [2025-10-07T22:44:09.661443] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-07T22:44:09.697201] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-07T22:44:09.697693] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:09.698530] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40611 primary records. [2025-10-07T22:44:09.698726] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-07T22:44:09.697853] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-07T22:44:09.700927] [INFO ] [MAIN ] Derivative Progress: 1586/1748 symbols completed. UTF took 1.2s. Estimated remaining: 1m 2s. Rate: 156.4 symbols/min [2025-10-07T22:44:09.701603] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:09.715139] [DEBUG] [LOCAL ] UTL: Loaded 11505 existing records from primary storage. [2025-10-07T22:44:09.717817] [INFO ] [MAIN ] UTL: Loaded 11505 primary data records. [2025-10-07T22:44:09.837113] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-10-07T22:44:09.883502] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-07T22:44:09.894948] [INFO ] [MAIN ] Derivative Progress: 1587/1748 symbols completed. UTI took 1.4s. Estimated remaining: 1m 2s. Rate: 156.5 symbols/min [2025-10-07T22:44:09.921451] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:10.062541] [DEBUG] [LOCAL ] UTZ: Loaded 44644 existing records from primary storage. [2025-10-07T22:44:10.063471] [INFO ] [MAIN ] UTZ: Loaded 44644 primary data records. [2025-10-07T22:44:10.182351] [DEBUG] [LOCAL ] UVE: Loaded 21933 existing records from primary storage. [2025-10-07T22:44:10.209614] [INFO ] [MAIN ] UVE: Loaded 21933 primary data records. [2025-10-07T22:44:10.599125] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:10.599911] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11505 primary records. [2025-10-07T22:44:10.717869] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-07T22:44:10.737773] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-07T22:44:10.738976] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-07T22:44:10.741299] [INFO ] [MAIN ] Derivative Progress: 1588/1748 symbols completed. UTL took 1.1s. Estimated remaining: 1m 1s. Rate: 156.4 symbols/min [2025-10-07T22:44:10.761994] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:10.762903] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44644 primary records. [2025-10-07T22:44:10.763103] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-07T22:44:10.781583] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-07T22:44:10.782451] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-07T22:44:10.784403] [INFO ] [MAIN ] Derivative Progress: 1589/1748 symbols completed. UTZ took 1.1s. Estimated remaining: 1m 1s. Rate: 156.4 symbols/min [2025-10-07T22:44:10.798501] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:10.799110] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21933 primary records. [2025-10-07T22:44:10.799172] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-07T22:44:10.814472] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-10-07T22:44:10.814531] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-07T22:44:10.816679] [INFO ] [MAIN ] Derivative Progress: 1590/1748 symbols completed. UVE took 0.9s. Estimated remaining: 1m 1s. Rate: 156.5 symbols/min [2025-10-07T22:44:10.817094] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:10.817543] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:10.817482] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:10.828953] [DEBUG] [LOCAL ] UZD: Loaded 6429 existing records from primary storage. [2025-10-07T22:44:10.829166] [INFO ] [MAIN ] UZD: Loaded 6429 primary data records. [2025-10-07T22:44:10.917069] [DEBUG] [LOCAL ] UVV: Loaded 22653 existing records from primary storage. [2025-10-07T22:44:10.929420] [INFO ] [MAIN ] UVV: Loaded 22653 primary data records. [2025-10-07T22:44:11.328815] [DEBUG] [LOCAL ] UWMC: Loaded 52849 existing records from primary storage. [2025-10-07T22:44:11.340737] [INFO ] [MAIN ] UWMC: Loaded 52849 primary data records. [2025-10-07T22:44:11.913148] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:11.915062] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6429 primary records. [2025-10-07T22:44:11.915196] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-07T22:44:11.948507] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:11.950297] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22653 primary records. [2025-10-07T22:44:11.950980] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-07T22:44:11.951166] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-07T22:44:11.951948] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-07T22:44:11.955409] [INFO ] [MAIN ] Derivative Progress: 1591/1748 symbols completed. UZD took 1.1s. Estimated remaining: 1m 0s. Rate: 156.3 symbols/min [2025-10-07T22:44:11.962999] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:11.975786] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-07T22:44:11.976939] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-07T22:44:11.979009] [INFO ] [MAIN ] Derivative Progress: 1592/1748 symbols completed. UVV took 1.2s. Estimated remaining: 59.8s. Rate: 156.4 symbols/min [2025-10-07T22:44:11.979311] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:11.985867] [DEBUG] [LOCAL ] UZE: Loaded 7430 existing records from primary storage. [2025-10-07T22:44:11.986042] [INFO ] [MAIN ] UZE: Loaded 7430 primary data records. [2025-10-07T22:44:12.074104] [DEBUG] [LOCAL ] UZF: Loaded 6344 existing records from primary storage. [2025-10-07T22:44:12.080521] [INFO ] [MAIN ] UZF: Loaded 6344 primary data records. [2025-10-07T22:44:12.065617] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:12.096593] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52849 primary records. [2025-10-07T22:44:12.123753] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-07T22:44:12.614812] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-07T22:44:12.615117] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-07T22:44:12.617463] [INFO ] [MAIN ] Derivative Progress: 1593/1748 symbols completed. UWMC took 1.8s. Estimated remaining: 59.5s. Rate: 156.4 symbols/min [2025-10-07T22:44:12.618264] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:12.646695] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:12.647821] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7430 primary records. [2025-10-07T22:44:12.647953] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-07T22:44:12.691667] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:12.693203] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6344 primary records. [2025-10-07T22:44:12.693836] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-07T22:44:12.711239] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-07T22:44:12.725556] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-07T22:44:12.728961] [INFO ] [MAIN ] Derivative Progress: 1594/1748 symbols completed. UZE took 0.8s. Estimated remaining: 59.1s. Rate: 156.4 symbols/min [2025-10-07T22:44:12.729144] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:12.712179] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-10-07T22:44:12.729431] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-07T22:44:12.732298] [INFO ] [MAIN ] Derivative Progress: 1595/1748 symbols completed. UZF took 0.8s. Estimated remaining: 58.6s. Rate: 156.5 symbols/min [2025-10-07T22:44:12.732758] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:12.734045] [DEBUG] [LOCAL ] V: Loaded 53752 existing records from primary storage. [2025-10-07T22:44:12.734482] [INFO ] [MAIN ] V: Loaded 53752 primary data records. [2025-10-07T22:44:13.069145] [DEBUG] [LOCAL ] VAC: Loaded 34356 existing records from primary storage. [2025-10-07T22:44:13.070421] [INFO ] [MAIN ] VAC: Loaded 34356 primary data records. [2025-10-07T22:44:13.145180] [DEBUG] [LOCAL ] VAL: Loaded 50229 existing records from primary storage. [2025-10-07T22:44:13.165675] [INFO ] [MAIN ] VAL: Loaded 50229 primary data records. [2025-10-07T22:44:13.752744] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:13.754006] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53752 primary records. [2025-10-07T22:44:13.754238] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-07T22:44:13.777317] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-07T22:44:13.777519] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-07T22:44:13.779854] [INFO ] [MAIN ] Derivative Progress: 1596/1748 symbols completed. V took 1.2s. Estimated remaining: 58.3s. Rate: 156.4 symbols/min [2025-10-07T22:44:13.780464] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:13.815274] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:13.815523] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:13.816669] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50229 primary records. [2025-10-07T22:44:13.816844] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-07T22:44:13.817796] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34356 primary records. [2025-10-07T22:44:13.819115] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-07T22:44:13.850241] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-07T22:44:13.850456] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-07T22:44:13.853343] [INFO ] [MAIN ] Derivative Progress: 1597/1748 symbols completed. VAL took 1.1s. Estimated remaining: 57.9s. Rate: 156.4 symbols/min [2025-10-07T22:44:13.853989] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:13.853859] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-07T22:44:13.854628] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-07T22:44:13.856826] [INFO ] [MAIN ] Derivative Progress: 1598/1748 symbols completed. VAC took 1.1s. Estimated remaining: 57.5s. Rate: 156.5 symbols/min [2025-10-07T22:44:13.857138] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:13.878291] [DEBUG] [LOCAL ] VATE: Loaded 5256 existing records from primary storage. [2025-10-07T22:44:13.878617] [INFO ] [MAIN ] VATE: Loaded 5256 primary data records. [2025-10-07T22:44:13.968201] [DEBUG] [LOCAL ] VBF: Loaded 6876 existing records from primary storage. [2025-10-07T22:44:14.015240] [INFO ] [MAIN ] VBF: Loaded 6876 primary data records. [2025-10-07T22:44:14.027766] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-07T22:44:14.038340] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-07T22:44:14.934024] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:14.936964] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5256 primary records. [2025-10-07T22:44:14.937542] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-07T22:44:14.955484] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-07T22:44:14.955708] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-07T22:44:14.960443] [INFO ] [MAIN ] Derivative Progress: 1599/1748 symbols completed. VATE took 1.1s. Estimated remaining: 57.2s. Rate: 156.4 symbols/min [2025-10-07T22:44:14.961711] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:14.977154] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:14.978585] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 6876 primary records. [2025-10-07T22:44:14.980389] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-07T22:44:15.007374] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:15.010133] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53693 primary records. [2025-10-07T22:44:15.010401] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-07T22:44:15.039208] [DEBUG] [LOCAL ] VCV: Loaded 13606 existing records from primary storage. [2025-10-07T22:44:15.040896] [INFO ] [MAIN ] VCV: Loaded 13606 primary data records. [2025-10-07T22:44:15.077450] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-07T22:44:15.083414] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-07T22:44:15.092962] [INFO ] [MAIN ] Derivative Progress: 1600/1748 symbols completed. VBF took 1.2s. Estimated remaining: 56.8s. Rate: 156.4 symbols/min [2025-10-07T22:44:15.114411] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:15.131486] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-07T22:44:15.144421] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-07T22:44:15.146832] [INFO ] [MAIN ] Derivative Progress: 1601/1748 symbols completed. VALE took 1.4s. Estimated remaining: 56.4s. Rate: 156.5 symbols/min [2025-10-07T22:44:15.157911] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:15.363796] [DEBUG] [LOCAL ] VEL: Loaded 12530 existing records from primary storage. [2025-10-07T22:44:15.364007] [INFO ] [MAIN ] VEL: Loaded 12530 primary data records. [2025-10-07T22:44:15.509322] [DEBUG] [LOCAL ] VEEV: Loaded 47173 existing records from primary storage. [2025-10-07T22:44:15.514826] [INFO ] [MAIN ] VEEV: Loaded 47173 primary data records. [2025-10-07T22:44:16.072468] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:16.073402] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13606 primary records. [2025-10-07T22:44:16.075418] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-07T22:44:16.104463] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-07T22:44:16.106988] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-07T22:44:16.109567] [INFO ] [MAIN ] Derivative Progress: 1602/1748 symbols completed. VCV took 1.1s. Estimated remaining: 56.0s. Rate: 156.4 symbols/min [2025-10-07T22:44:16.110013] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:16.127583] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:16.129075] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 12530 primary records. [2025-10-07T22:44:16.129163] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-07T22:44:16.150737] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-10-07T22:44:16.151131] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-07T22:44:16.153755] [INFO ] [MAIN ] Derivative Progress: 1603/1748 symbols completed. VEL took 1.0s. Estimated remaining: 55.6s. Rate: 156.4 symbols/min [2025-10-07T22:44:16.167358] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:16.168280] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47173 primary records. [2025-10-07T22:44:16.168353] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-07T22:44:16.185019] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-07T22:44:16.185151] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-07T22:44:16.187245] [INFO ] [MAIN ] Derivative Progress: 1604/1748 symbols completed. VEEV took 1.1s. Estimated remaining: 55.2s. Rate: 156.5 symbols/min [2025-10-07T22:44:16.215503] [DEBUG] [LOCAL ] VET: Loaded 43950 existing records from primary storage. [2025-10-07T22:44:16.215729] [INFO ] [MAIN ] VET: Loaded 43950 primary data records. [2025-10-07T22:44:16.529150] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:16.529833] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 43950 primary records. [2025-10-07T22:44:16.529897] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-07T22:44:16.546303] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-07T22:44:16.546426] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-07T22:44:16.548546] [INFO ] [MAIN ] Derivative Progress: 1605/1748 symbols completed. VET took 0.4s. Estimated remaining: 54.8s. Rate: 156.5 symbols/min [2025-10-07T22:44:16.549121] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:16.548984] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:16.549449] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:16.559749] [DEBUG] [LOCAL ] VGI: Loaded 5160 existing records from primary storage. [2025-10-07T22:44:16.559965] [INFO ] [MAIN ] VGI: Loaded 5160 primary data records. [2025-10-07T22:44:16.697380] [DEBUG] [LOCAL ] VGM: Loaded 18411 existing records from primary storage. [2025-10-07T22:44:16.708045] [INFO ] [MAIN ] VGM: Loaded 18411 primary data records. [2025-10-07T22:44:17.043212] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-07T22:44:17.081007] [INFO ] [MAIN ] VFC: Loaded 53607 primary data records. [2025-10-07T22:44:17.560404] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:17.561586] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5160 primary records. [2025-10-07T22:44:17.561947] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-07T22:44:17.592668] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:17.594900] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18411 primary records. [2025-10-07T22:44:17.595252] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-07T22:44:17.597207] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-07T22:44:17.604352] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-07T22:44:17.610969] [INFO ] [MAIN ] Derivative Progress: 1606/1748 symbols completed. VGI took 1.1s. Estimated remaining: 54.5s. Rate: 156.4 symbols/min [2025-10-07T22:44:17.613380] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:17.615728] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-07T22:44:17.615830] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-07T22:44:17.618425] [INFO ] [MAIN ] Derivative Progress: 1607/1748 symbols completed. VGM took 1.1s. Estimated remaining: 54.1s. Rate: 156.5 symbols/min [2025-10-07T22:44:17.619122] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:17.625560] [DEBUG] [LOCAL ] VHI: Loaded 2686 existing records from primary storage. [2025-10-07T22:44:17.626034] [INFO ] [MAIN ] VHI: Loaded 2686 primary data records. [2025-10-07T22:44:17.776862] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:17.825136] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53607 primary records. [2025-10-07T22:44:17.977836] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-07T22:44:18.036257] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-07T22:44:18.036559] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-07T22:44:18.037635] [DEBUG] [LOCAL ] VICI: Loaded 53649 existing records from primary storage. [2025-10-07T22:44:18.041243] [INFO ] [MAIN ] VICI: Loaded 53649 primary data records. [2025-10-07T22:44:18.041160] [INFO ] [MAIN ] Derivative Progress: 1608/1748 symbols completed. VFC took 1.5s. Estimated remaining: 53.7s. Rate: 156.5 symbols/min [2025-10-07T22:44:18.041732] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:18.379518] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:18.380740] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2686 primary records. [2025-10-07T22:44:18.380846] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-07T22:44:18.400020] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-10-07T22:44:18.402405] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-07T22:44:18.405566] [INFO ] [MAIN ] Derivative Progress: 1609/1748 symbols completed. VHI took 0.8s. Estimated remaining: 53.3s. Rate: 156.5 symbols/min [2025-10-07T22:44:18.420977] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:18.423419] [DEBUG] [LOCAL ] VIK: Loaded 52468 existing records from primary storage. [2025-10-07T22:44:18.423990] [INFO ] [MAIN ] VIK: Loaded 52468 primary data records. [2025-10-07T22:44:18.806103] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:18.890867] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53649 primary records. [2025-10-07T22:44:18.911187] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-07T22:44:18.893071] [DEBUG] [LOCAL ] VIPS: Loaded 51250 existing records from primary storage. [2025-10-07T22:44:18.912949] [INFO ] [MAIN ] VIPS: Loaded 51250 primary data records. [2025-10-07T22:44:19.033287] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-07T22:44:19.049864] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-07T22:44:19.099192] [INFO ] [MAIN ] Derivative Progress: 1610/1748 symbols completed. VICI took 1.5s. Estimated remaining: 52.9s. Rate: 156.4 symbols/min [2025-10-07T22:44:19.115097] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:19.383701] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:19.384572] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52468 primary records. [2025-10-07T22:44:19.384798] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-07T22:44:19.407563] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-10-07T22:44:19.420928] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-07T22:44:19.423445] [INFO ] [MAIN ] Derivative Progress: 1611/1748 symbols completed. VIK took 1.4s. Estimated remaining: 52.6s. Rate: 156.4 symbols/min [2025-10-07T22:44:19.423960] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:19.450120] [DEBUG] [LOCAL ] VIRT: Loaded 46744 existing records from primary storage. [2025-10-07T22:44:19.453882] [INFO ] [MAIN ] VIRT: Loaded 46744 primary data records. [2025-10-07T22:44:19.551081] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:19.582218] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51250 primary records. [2025-10-07T22:44:19.595435] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-07T22:44:19.878457] [DEBUG] [LOCAL ] VIST: Loaded 46125 existing records from primary storage. [2025-10-07T22:44:19.880557] [INFO ] [MAIN ] VIST: Loaded 46125 primary data records. [2025-10-07T22:44:19.886731] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-10-07T22:44:19.919010] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-07T22:44:19.971398] [INFO ] [MAIN ] Derivative Progress: 1612/1748 symbols completed. VIPS took 1.6s. Estimated remaining: 52.2s. Rate: 156.4 symbols/min [2025-10-07T22:44:19.990288] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:20.265216] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:20.266365] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46744 primary records. [2025-10-07T22:44:20.266629] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-07T22:44:20.303951] [DEBUG] [LOCAL ] VIV: Loaded 44825 existing records from primary storage. [2025-10-07T22:44:20.305488] [INFO ] [MAIN ] VIV: Loaded 44825 primary data records. [2025-10-07T22:44:20.323797] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-10-07T22:44:20.337213] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-07T22:44:20.355053] [INFO ] [MAIN ] Derivative Progress: 1613/1748 symbols completed. VIRT took 1.2s. Estimated remaining: 51.8s. Rate: 156.4 symbols/min [2025-10-07T22:44:20.362000] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:20.495277] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:20.534740] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46125 primary records. [2025-10-07T22:44:20.651195] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-07T22:44:20.652569] [DEBUG] [LOCAL ] VKQ: Loaded 17408 existing records from primary storage. [2025-10-07T22:44:20.653778] [INFO ] [MAIN ] VKQ: Loaded 17408 primary data records. [2025-10-07T22:44:20.829583] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-07T22:44:20.851675] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-07T22:44:20.960848] [INFO ] [MAIN ] Derivative Progress: 1614/1748 symbols completed. VIST took 1.5s. Estimated remaining: 51.4s. Rate: 156.3 symbols/min [2025-10-07T22:44:20.975298] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:21.000564] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:21.001567] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44825 primary records. [2025-10-07T22:44:21.003207] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-07T22:44:21.044739] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-07T22:44:21.043724] [DEBUG] [LOCAL ] VLN: Loaded 29562 existing records from primary storage. [2025-10-07T22:44:21.045082] [INFO ] [MAIN ] VLN: Loaded 29562 primary data records. [2025-10-07T22:44:21.045131] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-07T22:44:21.083817] [INFO ] [MAIN ] Derivative Progress: 1615/1748 symbols completed. VIV took 1.1s. Estimated remaining: 51.0s. Rate: 156.4 symbols/min [2025-10-07T22:44:21.103141] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:21.169127] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:21.170258] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17408 primary records. [2025-10-07T22:44:21.170336] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-07T22:44:21.247061] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-07T22:44:21.267331] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-07T22:44:21.273690] [INFO ] [MAIN ] Derivative Progress: 1616/1748 symbols completed. VKQ took 0.9s. Estimated remaining: 50.6s. Rate: 156.4 symbols/min [2025-10-07T22:44:21.377024] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:21.443871] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:21.444938] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 29562 primary records. [2025-10-07T22:44:21.462547] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-07T22:44:21.464678] [DEBUG] [LOCAL ] VLO: Loaded 53084 existing records from primary storage. [2025-10-07T22:44:21.465531] [INFO ] [MAIN ] VLO: Loaded 53084 primary data records. [2025-10-07T22:44:21.578180] [DEBUG] [LOCAL ] VLRS: Loaded 40224 existing records from primary storage. [2025-10-07T22:44:21.584708] [INFO ] [MAIN ] VLRS: Loaded 40224 primary data records. [2025-10-07T22:44:21.646491] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-07T22:44:21.651888] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-07T22:44:21.707418] [INFO ] [MAIN ] Derivative Progress: 1617/1748 symbols completed. VLN took 0.7s. Estimated remaining: 50.3s. Rate: 156.4 symbols/min [2025-10-07T22:44:21.832858] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:22.188091] [DEBUG] [LOCAL ] VLT: Loaded 4609 existing records from primary storage. [2025-10-07T22:44:22.188477] [INFO ] [MAIN ] VLT: Loaded 4609 primary data records. [2025-10-07T22:44:22.518617] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:22.520681] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53084 primary records. [2025-10-07T22:44:22.535063] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-07T22:44:22.534819] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:22.537057] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40224 primary records. [2025-10-07T22:44:22.547548] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-07T22:44:22.570792] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-07T22:44:22.571353] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-07T22:44:22.573766] [INFO ] [MAIN ] Derivative Progress: 1618/1748 symbols completed. VLRS took 1.2s. Estimated remaining: 49.9s. Rate: 156.3 symbols/min [2025-10-07T22:44:22.578254] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-07T22:44:22.579132] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-07T22:44:22.581799] [INFO ] [MAIN ] Derivative Progress: 1619/1748 symbols completed. VLO took 1.5s. Estimated remaining: 49.5s. Rate: 156.4 symbols/min [2025-10-07T22:44:22.595198] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:22.595808] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4609 primary records. [2025-10-07T22:44:22.595870] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-07T22:44:22.610511] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-07T22:44:22.610579] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-07T22:44:22.612725] [INFO ] [MAIN ] Derivative Progress: 1620/1748 symbols completed. VLT took 0.8s. Estimated remaining: 49.1s. Rate: 156.5 symbols/min [2025-10-07T22:44:22.613137] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:22.613231] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:22.613356] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:22.633979] [DEBUG] [LOCAL ] VMI: Loaded 15480 existing records from primary storage. [2025-10-07T22:44:22.634076] [INFO ] [MAIN ] VMI: Loaded 15480 primary data records. [2025-10-07T22:44:22.983878] [DEBUG] [LOCAL ] VLTO: Loaded 46108 existing records from primary storage. [2025-10-07T22:44:22.984185] [INFO ] [MAIN ] VLTO: Loaded 46108 primary data records. [2025-10-07T22:44:23.004831] [DEBUG] [LOCAL ] VMC: Loaded 43009 existing records from primary storage. [2025-10-07T22:44:23.028497] [INFO ] [MAIN ] VMC: Loaded 43009 primary data records. [2025-10-07T22:44:23.670545] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:44:23.672235] [INFO ] [MAIN ] VMI: Generated 1793 derivative records from 15480 primary records. [2025-10-07T22:44:23.672588] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-07T22:44:23.693124] [DEBUG] [LOCAL ] VMI: Derivative data saved (1793 records). [2025-10-07T22:44:23.694985] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-07T22:44:23.697580] [INFO ] [MAIN ] Derivative Progress: 1621/1748 symbols completed. VMI took 1.1s. Estimated remaining: 48.8s. Rate: 156.3 symbols/min [2025-10-07T22:44:23.697972] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:23.712580] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:23.713817] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46108 primary records. [2025-10-07T22:44:23.714693] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-07T22:44:23.742024] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-07T22:44:23.747071] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-07T22:44:23.749281] [INFO ] [MAIN ] Derivative Progress: 1622/1748 symbols completed. VLTO took 1.1s. Estimated remaining: 48.3s. Rate: 156.4 symbols/min [2025-10-07T22:44:23.749502] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:23.749988] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:23.751188] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 43009 primary records. [2025-10-07T22:44:23.757071] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-07T22:44:23.780625] [DEBUG] [LOCAL ] VMO: Loaded 20921 existing records from primary storage. [2025-10-07T22:44:23.781510] [INFO ] [MAIN ] VMO: Loaded 20921 primary data records. [2025-10-07T22:44:23.786723] [DEBUG] [LOCAL ] VNCE: Loaded 8460 existing records from primary storage. [2025-10-07T22:44:23.798703] [INFO ] [MAIN ] VNCE: Loaded 8460 primary data records. [2025-10-07T22:44:23.808172] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-07T22:44:23.850181] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-07T22:44:23.870333] [INFO ] [MAIN ] Derivative Progress: 1623/1748 symbols completed. VMC took 1.3s. Estimated remaining: 47.9s. Rate: 156.4 symbols/min [2025-10-07T22:44:23.901423] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:24.486924] [DEBUG] [LOCAL ] VNO: Loaded 48869 existing records from primary storage. [2025-10-07T22:44:24.487895] [INFO ] [MAIN ] VNO: Loaded 48869 primary data records. [2025-10-07T22:44:24.837187] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:24.851996] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20921 primary records. [2025-10-07T22:44:24.852299] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-07T22:44:24.853225] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:24.854530] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 8460 primary records. [2025-10-07T22:44:24.854895] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-07T22:44:24.889419] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-10-07T22:44:24.888611] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-10-07T22:44:24.889769] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-07T22:44:24.891905] [INFO ] [MAIN ] Derivative Progress: 1624/1748 symbols completed. VMO took 1.2s. Estimated remaining: 47.6s. Rate: 156.3 symbols/min [2025-10-07T22:44:24.889602] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-07T22:44:24.894273] [INFO ] [MAIN ] Derivative Progress: 1625/1748 symbols completed. VNCE took 1.1s. Estimated remaining: 47.2s. Rate: 156.4 symbols/min [2025-10-07T22:44:24.892153] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:24.894610] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:24.917138] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:24.917980] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48869 primary records. [2025-10-07T22:44:24.918128] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-07T22:44:24.922532] [DEBUG] [LOCAL ] VOC: Loaded 9003 existing records from primary storage. [2025-10-07T22:44:24.922823] [INFO ] [MAIN ] VOC: Loaded 9003 primary data records. [2025-10-07T22:44:25.084595] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-07T22:44:25.100125] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-07T22:44:25.194915] [INFO ] [MAIN ] Derivative Progress: 1626/1748 symbols completed. VNO took 1.3s. Estimated remaining: 46.8s. Rate: 156.4 symbols/min [2025-10-07T22:44:25.269417] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:25.270708] [DEBUG] [LOCAL ] VNT: Loaded 43576 existing records from primary storage. [2025-10-07T22:44:25.270954] [INFO ] [MAIN ] VNT: Loaded 43576 primary data records. [2025-10-07T22:44:25.615219] [DEBUG] [LOCAL ] VOYA: Loaded 42301 existing records from primary storage. [2025-10-07T22:44:25.616717] [INFO ] [MAIN ] VOYA: Loaded 42301 primary data records. [2025-10-07T22:44:25.676786] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:25.682900] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 9003 primary records. [2025-10-07T22:44:25.683001] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-07T22:44:25.784756] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-07T22:44:25.805844] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-07T22:44:25.836466] [INFO ] [MAIN ] Derivative Progress: 1627/1748 symbols completed. VOC took 0.9s. Estimated remaining: 46.4s. Rate: 156.3 symbols/min [2025-10-07T22:44:25.858334] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:25.994772] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:25.995757] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43576 primary records. [2025-10-07T22:44:25.995920] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-07T22:44:26.026424] [DEBUG] [LOCAL ] VPG: Loaded 17127 existing records from primary storage. [2025-10-07T22:44:26.026884] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-07T22:44:26.027689] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-07T22:44:26.029839] [INFO ] [MAIN ] Derivative Progress: 1628/1748 symbols completed. VNT took 1.1s. Estimated remaining: 46.0s. Rate: 156.4 symbols/min [2025-10-07T22:44:26.027583] [INFO ] [MAIN ] VPG: Loaded 17127 primary data records. [2025-10-07T22:44:26.030494] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:26.166131] [DEBUG] [LOCAL ] VPV: Loaded 5390 existing records from primary storage. [2025-10-07T22:44:26.178580] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:26.178706] [INFO ] [MAIN ] VPV: Loaded 5390 primary data records. [2025-10-07T22:44:26.179423] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42301 primary records. [2025-10-07T22:44:26.195503] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-07T22:44:26.609166] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-07T22:44:26.673731] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-07T22:44:26.723511] [INFO ] [MAIN ] Derivative Progress: 1629/1748 symbols completed. VOYA took 1.5s. Estimated remaining: 45.7s. Rate: 156.3 symbols/min [2025-10-07T22:44:26.732761] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:26.763124] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:26.763968] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17127 primary records. [2025-10-07T22:44:26.764461] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-07T22:44:26.794555] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-07T22:44:26.794885] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-07T22:44:26.797259] [INFO ] [MAIN ] Derivative Progress: 1630/1748 symbols completed. VPG took 0.9s. Estimated remaining: 45.3s. Rate: 156.4 symbols/min [2025-10-07T22:44:26.812580] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:26.813130] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:26.814254] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5390 primary records. [2025-10-07T22:44:26.814418] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-07T22:44:26.842854] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-07T22:44:26.843012] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-07T22:44:26.846384] [DEBUG] [LOCAL ] VRE: Loaded 35134 existing records from primary storage. [2025-10-07T22:44:26.845381] [INFO ] [MAIN ] Derivative Progress: 1631/1748 symbols completed. VPV took 0.8s. Estimated remaining: 44.9s. Rate: 156.5 symbols/min [2025-10-07T22:44:26.846744] [INFO ] [MAIN ] VRE: Loaded 35134 primary data records. [2025-10-07T22:44:26.846892] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:27.039690] [DEBUG] [LOCAL ] VRTS: Loaded 9316 existing records from primary storage. [2025-10-07T22:44:27.146976] [INFO ] [MAIN ] VRTS: Loaded 9316 primary data records. [2025-10-07T22:44:27.297749] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-07T22:44:27.298016] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-07T22:44:27.825599] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:27.827147] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 35134 primary records. [2025-10-07T22:44:27.827400] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-07T22:44:27.849159] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-07T22:44:27.849594] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-07T22:44:27.860112] [INFO ] [MAIN ] Derivative Progress: 1632/1748 symbols completed. VRE took 1.1s. Estimated remaining: 44.5s. Rate: 156.3 symbols/min [2025-10-07T22:44:27.866414] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:27.866301] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:27.868406] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9316 primary records. [2025-10-07T22:44:27.868590] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-07T22:44:27.901040] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-10-07T22:44:27.901453] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-07T22:44:27.903409] [INFO ] [MAIN ] Derivative Progress: 1633/1748 symbols completed. VRTS took 1.1s. Estimated remaining: 44.1s. Rate: 156.4 symbols/min [2025-10-07T22:44:27.901389] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:27.905008] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-07T22:44:27.905207] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-07T22:44:27.922107] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-07T22:44:27.922223] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-07T22:44:27.924473] [INFO ] [MAIN ] Derivative Progress: 1634/1748 symbols completed. VRT took 1.1s. Estimated remaining: 43.7s. Rate: 156.5 symbols/min [2025-10-07T22:44:27.959463] [DEBUG] [LOCAL ] VSCO: Loaded 52750 existing records from primary storage. [2025-10-07T22:44:27.959615] [INFO ] [MAIN ] VSCO: Loaded 52750 primary data records. [2025-10-07T22:44:28.294566] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:28.295219] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52750 primary records. [2025-10-07T22:44:28.295281] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-07T22:44:28.311524] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-07T22:44:28.311595] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-07T22:44:28.313785] [INFO ] [MAIN ] Derivative Progress: 1635/1748 symbols completed. VSCO took 0.4s. Estimated remaining: 43.3s. Rate: 156.5 symbols/min [2025-10-07T22:44:28.314564] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:28.314636] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:28.314490] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:28.395938] [DEBUG] [LOCAL ] VSH: Loaded 48274 existing records from primary storage. [2025-10-07T22:44:28.423609] [INFO ] [MAIN ] VSH: Loaded 48274 primary data records. [2025-10-07T22:44:28.424500] [DEBUG] [LOCAL ] VST: Loaded 53716 existing records from primary storage. [2025-10-07T22:44:28.425339] [DEBUG] [LOCAL ] VSTS: Loaded 49012 existing records from primary storage. [2025-10-07T22:44:28.436623] [INFO ] [MAIN ] VSTS: Loaded 49012 primary data records. [2025-10-07T22:44:28.446545] [INFO ] [MAIN ] VST: Loaded 53716 primary data records. [2025-10-07T22:44:29.397329] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:29.399246] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48274 primary records. [2025-10-07T22:44:29.399457] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-07T22:44:29.433500] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:29.433188] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-07T22:44:29.433712] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-07T22:44:29.434605] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53716 primary records. [2025-10-07T22:44:29.436558] [INFO ] [MAIN ] Derivative Progress: 1636/1748 symbols completed. VSH took 1.1s. Estimated remaining: 43.0s. Rate: 156.3 symbols/min [2025-10-07T22:44:29.450386] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-07T22:44:29.450763] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:29.450134] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:29.452509] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49012 primary records. [2025-10-07T22:44:29.460381] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-07T22:44:29.480273] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-07T22:44:29.484082] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-07T22:44:29.486344] [INFO ] [MAIN ] Derivative Progress: 1637/1748 symbols completed. VST took 1.2s. Estimated remaining: 42.6s. Rate: 156.4 symbols/min [2025-10-07T22:44:29.487138] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:29.493325] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-10-07T22:44:29.493739] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-07T22:44:29.496359] [INFO ] [MAIN ] Derivative Progress: 1638/1748 symbols completed. VSTS took 1.2s. Estimated remaining: 42.2s. Rate: 156.5 symbols/min [2025-10-07T22:44:29.496721] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:29.531203] [DEBUG] [LOCAL ] VTEX: Loaded 43025 existing records from primary storage. [2025-10-07T22:44:29.536587] [INFO ] [MAIN ] VTEX: Loaded 43025 primary data records. [2025-10-07T22:44:29.623084] [DEBUG] [LOCAL ] VTMX: Loaded 17599 existing records from primary storage. [2025-10-07T22:44:29.644380] [INFO ] [MAIN ] VTMX: Loaded 17599 primary data records. [2025-10-07T22:44:29.845590] [DEBUG] [LOCAL ] VTLE: Loaded 48329 existing records from primary storage. [2025-10-07T22:44:29.953343] [INFO ] [MAIN ] VTLE: Loaded 48329 primary data records. [2025-10-07T22:44:30.569988] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:30.570998] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43025 primary records. [2025-10-07T22:44:30.571479] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-07T22:44:30.592612] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:30.599511] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17599 primary records. [2025-10-07T22:44:30.600284] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-07T22:44:30.611505] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-07T22:44:30.614234] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-07T22:44:30.616300] [INFO ] [MAIN ] Derivative Progress: 1639/1748 symbols completed. VTEX took 1.2s. Estimated remaining: 41.8s. Rate: 156.3 symbols/min [2025-10-07T22:44:30.616967] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:30.624452] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-07T22:44:30.626966] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-07T22:44:30.628903] [INFO ] [MAIN ] Derivative Progress: 1640/1748 symbols completed. VTMX took 1.1s. Estimated remaining: 41.4s. Rate: 156.4 symbols/min [2025-10-07T22:44:30.632753] [DEBUG] [LOCAL ] VTN: Loaded 7010 existing records from primary storage. [2025-10-07T22:44:30.629172] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:30.632909] [INFO ] [MAIN ] VTN: Loaded 7010 primary data records. [2025-10-07T22:44:30.732699] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:30.751030] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48329 primary records. [2025-10-07T22:44:30.751417] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-07T22:44:30.852113] [DEBUG] [LOCAL ] VTOL: Loaded 19549 existing records from primary storage. [2025-10-07T22:44:30.960615] [INFO ] [MAIN ] VTOL: Loaded 19549 primary data records. [2025-10-07T22:44:31.084377] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-07T22:44:31.160784] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-07T22:44:31.192689] [INFO ] [MAIN ] Derivative Progress: 1641/1748 symbols completed. VTLE took 1.7s. Estimated remaining: 41.1s. Rate: 156.3 symbols/min [2025-10-07T22:44:31.272481] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:31.304791] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:31.305706] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7010 primary records. [2025-10-07T22:44:31.305797] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-07T22:44:31.323366] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-07T22:44:31.323928] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-07T22:44:31.325958] [INFO ] [MAIN ] Derivative Progress: 1642/1748 symbols completed. VTN took 0.7s. Estimated remaining: 40.7s. Rate: 156.4 symbols/min [2025-10-07T22:44:31.326128] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:31.359769] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:31.360449] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19549 primary records. [2025-10-07T22:44:31.360541] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-07T22:44:31.378337] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-07T22:44:31.379509] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-07T22:44:31.388033] [INFO ] [MAIN ] Derivative Progress: 1643/1748 symbols completed. VTOL took 0.8s. Estimated remaining: 40.3s. Rate: 156.5 symbols/min [2025-10-07T22:44:31.388378] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:31.404544] [DEBUG] [LOCAL ] VTR: Loaded 52793 existing records from primary storage. [2025-10-07T22:44:31.404901] [INFO ] [MAIN ] VTR: Loaded 52793 primary data records. [2025-10-07T22:44:31.473542] [DEBUG] [LOCAL ] VTS: Loaded 30231 existing records from primary storage. [2025-10-07T22:44:31.519354] [INFO ] [MAIN ] VTS: Loaded 30231 primary data records. [2025-10-07T22:44:31.844349] [DEBUG] [LOCAL ] VVR: Loaded 31655 existing records from primary storage. [2025-10-07T22:44:31.861093] [INFO ] [MAIN ] VVR: Loaded 31655 primary data records. [2025-10-07T22:44:32.416583] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:32.417782] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52793 primary records. [2025-10-07T22:44:32.417990] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-07T22:44:32.435533] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-07T22:44:32.437434] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-07T22:44:32.439594] [INFO ] [MAIN ] Derivative Progress: 1644/1748 symbols completed. VTR took 1.2s. Estimated remaining: 39.9s. Rate: 156.3 symbols/min [2025-10-07T22:44:32.440436] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:32.455493] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:32.456493] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30231 primary records. [2025-10-07T22:44:32.456578] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-07T22:44:32.484105] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-07T22:44:32.489271] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-07T22:44:32.491451] [INFO ] [MAIN ] Derivative Progress: 1645/1748 symbols completed. VTS took 1.2s. Estimated remaining: 39.5s. Rate: 156.4 symbols/min [2025-10-07T22:44:32.489525] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:32.491761] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:32.492800] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31655 primary records. [2025-10-07T22:44:32.492920] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-07T22:44:32.512926] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-07T22:44:32.513172] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-07T22:44:32.515377] [INFO ] [MAIN ] Derivative Progress: 1646/1748 symbols completed. VVR took 1.1s. Estimated remaining: 39.1s. Rate: 156.5 symbols/min [2025-10-07T22:44:32.521331] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:32.541204] [DEBUG] [LOCAL ] VVX: Loaded 22950 existing records from primary storage. [2025-10-07T22:44:32.541352] [INFO ] [MAIN ] VVX: Loaded 22950 primary data records. [2025-10-07T22:44:32.686136] [DEBUG] [LOCAL ] VVV: Loaded 50285 existing records from primary storage. [2025-10-07T22:44:32.732866] [INFO ] [MAIN ] VVV: Loaded 50285 primary data records. [2025-10-07T22:44:33.007689] [DEBUG] [LOCAL ] VYX: Loaded 48640 existing records from primary storage. [2025-10-07T22:44:33.041203] [INFO ] [MAIN ] VYX: Loaded 48640 primary data records. [2025-10-07T22:44:33.496187] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:33.497518] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 22950 primary records. [2025-10-07T22:44:33.497796] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-07T22:44:33.515514] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-07T22:44:33.515835] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-07T22:44:33.518729] [INFO ] [MAIN ] Derivative Progress: 1647/1748 symbols completed. VVX took 1.0s. Estimated remaining: 38.8s. Rate: 156.3 symbols/min [2025-10-07T22:44:33.519906] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:33.536928] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:33.537832] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50285 primary records. [2025-10-07T22:44:33.538091] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-07T22:44:33.554957] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-07T22:44:33.555120] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-07T22:44:33.557275] [INFO ] [MAIN ] Derivative Progress: 1648/1748 symbols completed. VVV took 1.1s. Estimated remaining: 38.4s. Rate: 156.4 symbols/min [2025-10-07T22:44:33.574604] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:33.575405] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48640 primary records. [2025-10-07T22:44:33.575569] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-07T22:44:33.592126] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-07T22:44:33.592201] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-07T22:44:33.594221] [INFO ] [MAIN ] Derivative Progress: 1649/1748 symbols completed. VYX took 1.1s. Estimated remaining: 38.0s. Rate: 156.5 symbols/min [2025-10-07T22:44:33.631515] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-07T22:44:33.631684] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-07T22:44:33.943637] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:33.944276] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-07T22:44:33.944338] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-07T22:44:33.960405] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-07T22:44:33.960480] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-07T22:44:33.962358] [INFO ] [MAIN ] Derivative Progress: 1650/1748 symbols completed. VZ took 0.4s. Estimated remaining: 37.6s. Rate: 156.5 symbols/min [2025-10-07T22:44:33.963117] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:33.963522] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:33.963044] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:34.042120] [DEBUG] [LOCAL ] WAB: Loaded 44063 existing records from primary storage. [2025-10-07T22:44:34.042317] [INFO ] [MAIN ] WAB: Loaded 44063 primary data records. [2025-10-07T22:44:34.056117] [DEBUG] [LOCAL ] WAL: Loaded 45135 existing records from primary storage. [2025-10-07T22:44:34.078412] [INFO ] [MAIN ] WAL: Loaded 45135 primary data records. [2025-10-07T22:44:34.170482] [DEBUG] [LOCAL ] W: Loaded 53447 existing records from primary storage. [2025-10-07T22:44:34.207715] [INFO ] [MAIN ] W: Loaded 53447 primary data records. [2025-10-07T22:44:35.021903] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:35.022710] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44063 primary records. [2025-10-07T22:44:35.022952] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-07T22:44:35.038936] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:35.050549] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45135 primary records. [2025-10-07T22:44:35.051341] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-07T22:44:35.073192] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:35.075496] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53447 primary records. [2025-10-07T22:44:35.075833] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-07T22:44:35.098406] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-07T22:44:35.099069] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-07T22:44:35.101579] [INFO ] [MAIN ] Derivative Progress: 1651/1748 symbols completed. W took 1.1s. Estimated remaining: 37.2s. Rate: 156.3 symbols/min [2025-10-07T22:44:35.101997] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:35.103252] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-07T22:44:35.099632] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-10-07T22:44:35.103400] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-07T22:44:35.103461] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-07T22:44:35.105669] [INFO ] [MAIN ] Derivative Progress: 1652/1748 symbols completed. WAL took 1.1s. Estimated remaining: 36.8s. Rate: 156.4 symbols/min [2025-10-07T22:44:35.107578] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:35.108088] [INFO ] [MAIN ] Derivative Progress: 1653/1748 symbols completed. WAB took 1.1s. Estimated remaining: 36.4s. Rate: 156.5 symbols/min [2025-10-07T22:44:35.108345] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:35.121074] [DEBUG] [LOCAL ] WBX: Loaded 11031 existing records from primary storage. [2025-10-07T22:44:35.121261] [INFO ] [MAIN ] WBX: Loaded 11031 primary data records. [2025-10-07T22:44:35.466012] [DEBUG] [LOCAL ] WAT: Loaded 35443 existing records from primary storage. [2025-10-07T22:44:35.466801] [INFO ] [MAIN ] WAT: Loaded 35443 primary data records. [2025-10-07T22:44:35.546141] [DEBUG] [LOCAL ] WBS: Loaded 48692 existing records from primary storage. [2025-10-07T22:44:35.567397] [INFO ] [MAIN ] WBS: Loaded 48692 primary data records. [2025-10-07T22:44:36.117224] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:36.118366] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 11031 primary records. [2025-10-07T22:44:36.119213] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-07T22:44:36.140534] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-07T22:44:36.142200] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-07T22:44:36.145924] [INFO ] [MAIN ] Derivative Progress: 1654/1748 symbols completed. WBX took 1.0s. Estimated remaining: 36.1s. Rate: 156.3 symbols/min [2025-10-07T22:44:36.146756] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:36.161455] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:36.162305] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35443 primary records. [2025-10-07T22:44:36.162436] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-07T22:44:36.181856] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-07T22:44:36.182224] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-07T22:44:36.192347] [INFO ] [MAIN ] Derivative Progress: 1655/1748 symbols completed. WAT took 1.1s. Estimated remaining: 35.7s. Rate: 156.4 symbols/min [2025-10-07T22:44:36.192703] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:36.198768] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:36.199516] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48692 primary records. [2025-10-07T22:44:36.199807] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-07T22:44:36.227503] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-07T22:44:36.227783] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-07T22:44:36.229787] [INFO ] [MAIN ] Derivative Progress: 1656/1748 symbols completed. WBS took 1.1s. Estimated remaining: 35.3s. Rate: 156.5 symbols/min [2025-10-07T22:44:36.230051] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:36.247140] [DEBUG] [LOCAL ] WCC: Loaded 39191 existing records from primary storage. [2025-10-07T22:44:36.247427] [INFO ] [MAIN ] WCC: Loaded 39191 primary data records. [2025-10-07T22:44:36.372503] [DEBUG] [LOCAL ] WD: Loaded 23197 existing records from primary storage. [2025-10-07T22:44:36.378384] [INFO ] [MAIN ] WD: Loaded 23197 primary data records. [2025-10-07T22:44:36.548322] [DEBUG] [LOCAL ] WCN: Loaded 47941 existing records from primary storage. [2025-10-07T22:44:36.605012] [INFO ] [MAIN ] WCN: Loaded 47941 primary data records. [2025-10-07T22:44:37.262066] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:37.264177] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39191 primary records. [2025-10-07T22:44:37.264373] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-07T22:44:37.294150] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:37.296258] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23197 primary records. [2025-10-07T22:44:37.296769] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-07T22:44:37.315252] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-07T22:44:37.316856] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-07T22:44:37.319544] [INFO ] [MAIN ] Derivative Progress: 1657/1748 symbols completed. WD took 1.1s. Estimated remaining: 34.9s. Rate: 156.3 symbols/min [2025-10-07T22:44:37.320290] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-07T22:44:37.320506] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:37.320603] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-07T22:44:37.325687] [INFO ] [MAIN ] Derivative Progress: 1658/1748 symbols completed. WCC took 1.2s. Estimated remaining: 34.5s. Rate: 156.4 symbols/min [2025-10-07T22:44:37.326173] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:37.340943] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:37.341720] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47941 primary records. [2025-10-07T22:44:37.341853] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-07T22:44:37.363044] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-07T22:44:37.363285] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-07T22:44:37.365212] [INFO ] [MAIN ] Derivative Progress: 1659/1748 symbols completed. WCN took 1.2s. Estimated remaining: 34.1s. Rate: 156.5 symbols/min [2025-10-07T22:44:37.365459] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:37.378288] [DEBUG] [LOCAL ] WDH: Loaded 17899 existing records from primary storage. [2025-10-07T22:44:37.378437] [INFO ] [MAIN ] WDH: Loaded 17899 primary data records. [2025-10-07T22:44:37.487092] [DEBUG] [LOCAL ] WDI: Loaded 21117 existing records from primary storage. [2025-10-07T22:44:37.487393] [INFO ] [MAIN ] WDI: Loaded 21117 primary data records. [2025-10-07T22:44:37.843323] [DEBUG] [LOCAL ] WDS: Loaded 43122 existing records from primary storage. [2025-10-07T22:44:37.854311] [INFO ] [MAIN ] WDS: Loaded 43122 primary data records. [2025-10-07T22:44:38.412363] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:38.414626] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 17899 primary records. [2025-10-07T22:44:38.415036] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-07T22:44:38.441924] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-07T22:44:38.446658] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-07T22:44:38.449203] [INFO ] [MAIN ] Derivative Progress: 1660/1748 symbols completed. WDH took 1.1s. Estimated remaining: 33.8s. Rate: 156.3 symbols/min [2025-10-07T22:44:38.449620] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:38.450923] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:38.451719] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21117 primary records. [2025-10-07T22:44:38.451929] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-07T22:44:38.478905] [DEBUG] [LOCAL ] WEA: Loaded 7396 existing records from primary storage. [2025-10-07T22:44:38.487922] [INFO ] [MAIN ] WEA: Loaded 7396 primary data records. [2025-10-07T22:44:38.518553] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:38.535171] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43122 primary records. [2025-10-07T22:44:38.535583] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-07T22:44:38.603753] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-07T22:44:38.613178] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-07T22:44:38.619830] [INFO ] [MAIN ] Derivative Progress: 1661/1748 symbols completed. WDI took 1.3s. Estimated remaining: 33.4s. Rate: 156.4 symbols/min [2025-10-07T22:44:38.620454] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:38.847572] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-10-07T22:44:38.847956] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-07T22:44:38.850312] [INFO ] [MAIN ] Derivative Progress: 1662/1748 symbols completed. WDS took 1.5s. Estimated remaining: 33.0s. Rate: 156.4 symbols/min [2025-10-07T22:44:38.850693] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:38.883600] [DEBUG] [LOCAL ] WEAV: Loaded 41854 existing records from primary storage. [2025-10-07T22:44:38.884082] [INFO ] [MAIN ] WEAV: Loaded 41854 primary data records. [2025-10-07T22:44:39.254186] [DEBUG] [LOCAL ] WEC: Loaded 52184 existing records from primary storage. [2025-10-07T22:44:39.259906] [INFO ] [MAIN ] WEC: Loaded 52184 primary data records. [2025-10-07T22:44:39.293481] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:39.307362] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7396 primary records. [2025-10-07T22:44:39.312846] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-07T22:44:39.402330] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-07T22:44:39.408053] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-07T22:44:39.420981] [INFO ] [MAIN ] Derivative Progress: 1663/1748 symbols completed. WEA took 1.0s. Estimated remaining: 32.6s. Rate: 156.4 symbols/min [2025-10-07T22:44:39.655904] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:39.657607] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 41854 primary records. [2025-10-07T22:44:39.658081] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-07T22:44:39.675905] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-07T22:44:39.676021] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-07T22:44:39.678222] [INFO ] [MAIN ] Derivative Progress: 1664/1748 symbols completed. WEAV took 1.1s. Estimated remaining: 32.2s. Rate: 156.4 symbols/min [2025-10-07T22:44:39.700738] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:39.701663] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52184 primary records. [2025-10-07T22:44:39.701737] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-07T22:44:39.719587] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-07T22:44:39.719705] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-07T22:44:39.722598] [INFO ] [MAIN ] Derivative Progress: 1665/1748 symbols completed. WEC took 0.9s. Estimated remaining: 31.8s. Rate: 156.5 symbols/min [2025-10-07T22:44:39.723115] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:39.723270] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:39.723467] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:39.809735] [DEBUG] [LOCAL ] WEX: Loaded 33836 existing records from primary storage. [2025-10-07T22:44:39.810622] [DEBUG] [LOCAL ] WES: Loaded 48242 existing records from primary storage. [2025-10-07T22:44:39.810932] [INFO ] [MAIN ] WEX: Loaded 33836 primary data records. [2025-10-07T22:44:39.811069] [INFO ] [MAIN ] WES: Loaded 48242 primary data records. [2025-10-07T22:44:40.022309] [DEBUG] [LOCAL ] WELL: Loaded 52351 existing records from primary storage. [2025-10-07T22:44:40.034033] [INFO ] [MAIN ] WELL: Loaded 52351 primary data records. [2025-10-07T22:44:40.854467] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:40.862813] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48242 primary records. [2025-10-07T22:44:40.863662] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-07T22:44:40.861290] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:40.864549] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 33836 primary records. [2025-10-07T22:44:40.865266] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-07T22:44:40.905459] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:40.906947] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52351 primary records. [2025-10-07T22:44:40.907291] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-07T22:44:40.907566] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-07T22:44:40.907991] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-07T22:44:40.910389] [INFO ] [MAIN ] Derivative Progress: 1666/1748 symbols completed. WES took 1.2s. Estimated remaining: 31.5s. Rate: 156.3 symbols/min [2025-10-07T22:44:40.910829] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:40.928602] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-07T22:44:40.929161] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-07T22:44:40.931383] [INFO ] [MAIN ] Derivative Progress: 1667/1748 symbols completed. WEX took 1.2s. Estimated remaining: 31.1s. Rate: 156.4 symbols/min [2025-10-07T22:44:40.932100] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:40.938124] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-10-07T22:44:40.938271] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-07T22:44:40.941325] [INFO ] [MAIN ] Derivative Progress: 1668/1748 symbols completed. WELL took 1.2s. Estimated remaining: 30.7s. Rate: 156.5 symbols/min [2025-10-07T22:44:40.941582] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:40.946876] [DEBUG] [LOCAL ] WF: Loaded 10762 existing records from primary storage. [2025-10-07T22:44:40.947029] [INFO ] [MAIN ] WF: Loaded 10762 primary data records. [2025-10-07T22:44:41.158835] [DEBUG] [LOCAL ] WFG: Loaded 24810 existing records from primary storage. [2025-10-07T22:44:41.272735] [INFO ] [MAIN ] WFG: Loaded 24810 primary data records. [2025-10-07T22:44:41.331504] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-07T22:44:41.353295] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-07T22:44:41.899117] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:41.900026] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10762 primary records. [2025-10-07T22:44:41.900184] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-07T22:44:41.921026] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-10-07T22:44:41.921259] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-07T22:44:41.923553] [INFO ] [MAIN ] Derivative Progress: 1669/1748 symbols completed. WF took 1.0s. Estimated remaining: 30.3s. Rate: 156.3 symbols/min [2025-10-07T22:44:41.924712] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:41.955561] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:41.955973] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:41.956707] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24810 primary records. [2025-10-07T22:44:41.957406] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-07T22:44:41.957481] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-07T22:44:41.957561] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-07T22:44:41.985700] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-07T22:44:41.985866] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-07T22:44:41.987989] [INFO ] [MAIN ] Derivative Progress: 1670/1748 symbols completed. WFG took 1.0s. Estimated remaining: 29.9s. Rate: 156.4 symbols/min [2025-10-07T22:44:41.988209] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:41.993621] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-07T22:44:41.993747] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-07T22:44:41.995733] [INFO ] [MAIN ] Derivative Progress: 1671/1748 symbols completed. WFC took 1.1s. Estimated remaining: 29.5s. Rate: 156.5 symbols/min [2025-10-07T22:44:42.005631] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:42.022314] [DEBUG] [LOCAL ] WGO: Loaded 38584 existing records from primary storage. [2025-10-07T22:44:42.022506] [INFO ] [MAIN ] WGO: Loaded 38584 primary data records. [2025-10-07T22:44:42.236406] [DEBUG] [LOCAL ] WH: Loaded 45319 existing records from primary storage. [2025-10-07T22:44:42.241334] [INFO ] [MAIN ] WH: Loaded 45319 primary data records. [2025-10-07T22:44:42.410946] [DEBUG] [LOCAL ] WHD: Loaded 40105 existing records from primary storage. [2025-10-07T22:44:42.424010] [INFO ] [MAIN ] WHD: Loaded 40105 primary data records. [2025-10-07T22:44:43.015497] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:43.017584] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 38584 primary records. [2025-10-07T22:44:43.017734] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-07T22:44:43.035121] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-07T22:44:43.035315] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-07T22:44:43.037917] [INFO ] [MAIN ] Derivative Progress: 1672/1748 symbols completed. WGO took 1.1s. Estimated remaining: 29.2s. Rate: 156.3 symbols/min [2025-10-07T22:44:43.038216] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:43.047863] [DEBUG] [LOCAL ] WHG: Loaded 3250 existing records from primary storage. [2025-10-07T22:44:43.048179] [INFO ] [MAIN ] WHG: Loaded 3250 primary data records. [2025-10-07T22:44:43.141958] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:43.159548] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45319 primary records. [2025-10-07T22:44:43.159711] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-07T22:44:43.222238] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:43.236823] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40105 primary records. [2025-10-07T22:44:43.236946] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-07T22:44:43.413726] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-10-07T22:44:43.414830] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-07T22:44:43.417494] [INFO ] [MAIN ] Derivative Progress: 1673/1748 symbols completed. WH took 1.4s. Estimated remaining: 28.8s. Rate: 156.3 symbols/min [2025-10-07T22:44:43.417996] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:43.421199] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-07T22:44:43.421504] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-07T22:44:43.423516] [INFO ] [MAIN ] Derivative Progress: 1674/1748 symbols completed. WHD took 1.4s. Estimated remaining: 28.4s. Rate: 156.4 symbols/min [2025-10-07T22:44:43.424174] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:43.434290] [DEBUG] [LOCAL ] WIA: Loaded 4903 existing records from primary storage. [2025-10-07T22:44:43.434684] [INFO ] [MAIN ] WIA: Loaded 4903 primary data records. [2025-10-07T22:44:43.777569] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:43.778987] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3250 primary records. [2025-10-07T22:44:43.779866] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-07T22:44:43.783896] [DEBUG] [LOCAL ] WHR: Loaded 48284 existing records from primary storage. [2025-10-07T22:44:43.790940] [INFO ] [MAIN ] WHR: Loaded 48284 primary data records. [2025-10-07T22:44:43.914585] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-10-07T22:44:43.960488] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-07T22:44:43.984965] [INFO ] [MAIN ] Derivative Progress: 1675/1748 symbols completed. WHG took 0.9s. Estimated remaining: 28.0s. Rate: 156.4 symbols/min [2025-10-07T22:44:44.113400] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:44.114516] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:44.115441] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4903 primary records. [2025-10-07T22:44:44.115951] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-07T22:44:44.139685] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-07T22:44:44.146023] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-07T22:44:44.145793] [DEBUG] [LOCAL ] WINN: Loaded 11566 existing records from primary storage. [2025-10-07T22:44:44.148049] [INFO ] [MAIN ] Derivative Progress: 1676/1748 symbols completed. WIA took 0.7s. Estimated remaining: 27.6s. Rate: 156.5 symbols/min [2025-10-07T22:44:44.148401] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:44.148805] [INFO ] [MAIN ] WINN: Loaded 11566 primary data records. [2025-10-07T22:44:44.390915] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:44.482782] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48284 primary records. [2025-10-07T22:44:44.558760] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-07T22:44:44.592836] [DEBUG] [LOCAL ] WIT: Loaded 52389 existing records from primary storage. [2025-10-07T22:44:44.593703] [INFO ] [MAIN ] WIT: Loaded 52389 primary data records. [2025-10-07T22:44:44.606808] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-07T22:44:44.650165] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-07T22:44:44.672341] [INFO ] [MAIN ] Derivative Progress: 1677/1748 symbols completed. WHR took 1.3s. Estimated remaining: 27.2s. Rate: 156.4 symbols/min [2025-10-07T22:44:44.683368] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:44.924455] [DEBUG] [LOCAL ] WIW: Loaded 20492 existing records from primary storage. [2025-10-07T22:44:44.925106] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-07T22:44:44.926242] [INFO ] [MAIN ] WIW: Loaded 20492 primary data records. [2025-10-07T22:44:44.927138] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11566 primary records. [2025-10-07T22:44:44.927548] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-07T22:44:45.042637] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-10-07T22:44:45.046429] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-07T22:44:45.048997] [INFO ] [MAIN ] Derivative Progress: 1678/1748 symbols completed. WINN took 0.9s. Estimated remaining: 26.9s. Rate: 156.4 symbols/min [2025-10-07T22:44:45.259857] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:45.260701] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52389 primary records. [2025-10-07T22:44:45.261625] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-07T22:44:45.279929] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-07T22:44:45.280043] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-07T22:44:45.282092] [INFO ] [MAIN ] Derivative Progress: 1679/1748 symbols completed. WIT took 1.1s. Estimated remaining: 26.5s. Rate: 156.5 symbols/min [2025-10-07T22:44:45.300637] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:45.301247] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20492 primary records. [2025-10-07T22:44:45.301329] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-07T22:44:45.316544] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-07T22:44:45.316607] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-07T22:44:45.318715] [INFO ] [MAIN ] Derivative Progress: 1680/1748 symbols completed. WIW took 0.6s. Estimated remaining: 26.1s. Rate: 156.5 symbols/min [2025-10-07T22:44:45.319323] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:45.319434] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:45.319266] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:45.389166] [DEBUG] [LOCAL ] WKC: Loaded 34750 existing records from primary storage. [2025-10-07T22:44:45.389409] [INFO ] [MAIN ] WKC: Loaded 34750 primary data records. [2025-10-07T22:44:45.389923] [DEBUG] [LOCAL ] WK: Loaded 37238 existing records from primary storage. [2025-10-07T22:44:45.410542] [INFO ] [MAIN ] WK: Loaded 37238 primary data records. [2025-10-07T22:44:45.583664] [DEBUG] [LOCAL ] WLK: Loaded 45565 existing records from primary storage. [2025-10-07T22:44:45.615359] [INFO ] [MAIN ] WLK: Loaded 45565 primary data records. [2025-10-07T22:44:46.430420] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:46.432477] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34750 primary records. [2025-10-07T22:44:46.432702] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-07T22:44:46.453164] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-07T22:44:46.453507] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-07T22:44:46.455563] [INFO ] [MAIN ] Derivative Progress: 1681/1748 symbols completed. WKC took 1.1s. Estimated remaining: 25.7s. Rate: 156.4 symbols/min [2025-10-07T22:44:46.468141] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:46.472580] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:46.473898] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37238 primary records. [2025-10-07T22:44:46.474120] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-07T22:44:46.500698] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:46.504488] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45565 primary records. [2025-10-07T22:44:46.505294] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-07T22:44:46.509939] [DEBUG] [LOCAL ] WLKP: Loaded 6905 existing records from primary storage. [2025-10-07T22:44:46.511119] [INFO ] [MAIN ] WLKP: Loaded 6905 primary data records. [2025-10-07T22:44:46.573420] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-07T22:44:46.585884] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-07T22:44:46.601938] [INFO ] [MAIN ] Derivative Progress: 1682/1748 symbols completed. WLK took 1.3s. Estimated remaining: 25.3s. Rate: 156.4 symbols/min [2025-10-07T22:44:46.614414] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:46.627963] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-07T22:44:46.639610] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-07T22:44:46.642176] [INFO ] [MAIN ] Derivative Progress: 1683/1748 symbols completed. WK took 1.3s. Estimated remaining: 24.9s. Rate: 156.5 symbols/min [2025-10-07T22:44:46.658029] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:46.862927] [DEBUG] [LOCAL ] WLY: Loaded 29501 existing records from primary storage. [2025-10-07T22:44:46.863538] [INFO ] [MAIN ] WLY: Loaded 29501 primary data records. [2025-10-07T22:44:47.042088] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:47.106516] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6905 primary records. [2025-10-07T22:44:47.114256] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-07T22:44:47.263733] [DEBUG] [LOCAL ] WM: Loaded 50967 existing records from primary storage. [2025-10-07T22:44:47.286157] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-07T22:44:47.287112] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-07T22:44:47.289121] [INFO ] [MAIN ] Derivative Progress: 1684/1748 symbols completed. WLKP took 0.8s. Estimated remaining: 24.5s. Rate: 156.4 symbols/min [2025-10-07T22:44:47.289455] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:47.286990] [INFO ] [MAIN ] WM: Loaded 50967 primary data records. [2025-10-07T22:44:47.693067] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-07T22:44:47.698803] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-07T22:44:47.699298] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:47.721100] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29501 primary records. [2025-10-07T22:44:47.721245] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-07T22:44:47.820751] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-07T22:44:47.821516] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-07T22:44:47.829456] [INFO ] [MAIN ] Derivative Progress: 1685/1748 symbols completed. WLY took 1.2s. Estimated remaining: 24.2s. Rate: 156.4 symbols/min [2025-10-07T22:44:47.834789] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:48.042681] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:48.050700] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50967 primary records. [2025-10-07T22:44:48.049483] [DEBUG] [LOCAL ] WMK: Loaded 14558 existing records from primary storage. [2025-10-07T22:44:48.050979] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-07T22:44:48.051059] [INFO ] [MAIN ] WMK: Loaded 14558 primary data records. [2025-10-07T22:44:48.211436] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-07T22:44:48.245351] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-07T22:44:48.293132] [INFO ] [MAIN ] Derivative Progress: 1686/1748 symbols completed. WM took 1.6s. Estimated remaining: 23.8s. Rate: 156.4 symbols/min [2025-10-07T22:44:48.460325] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:48.494992] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:48.495991] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53672 primary records. [2025-10-07T22:44:48.496104] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-07T22:44:48.518012] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-07T22:44:48.518207] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-07T22:44:48.520383] [INFO ] [MAIN ] Derivative Progress: 1687/1748 symbols completed. WMB took 1.2s. Estimated remaining: 23.4s. Rate: 156.4 symbols/min [2025-10-07T22:44:48.520598] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:48.556962] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:48.561376] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14558 primary records. [2025-10-07T22:44:48.562179] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-07T22:44:48.588270] [DEBUG] [LOCAL ] WMS: Loaded 39589 existing records from primary storage. [2025-10-07T22:44:48.588990] [INFO ] [MAIN ] WMS: Loaded 39589 primary data records. [2025-10-07T22:44:48.726933] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-07T22:44:48.732369] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-07T22:44:48.775508] [INFO ] [MAIN ] Derivative Progress: 1688/1748 symbols completed. WMK took 0.9s. Estimated remaining: 23.0s. Rate: 156.4 symbols/min [2025-10-07T22:44:48.783065] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:48.801060] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-07T22:44:48.924015] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-07T22:44:49.248568] [DEBUG] [LOCAL ] WNC: Loaded 38981 existing records from primary storage. [2025-10-07T22:44:49.249099] [INFO ] [MAIN ] WNC: Loaded 38981 primary data records. [2025-10-07T22:44:49.320392] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:49.341428] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39589 primary records. [2025-10-07T22:44:49.364699] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-07T22:44:49.586874] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-07T22:44:49.590026] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-07T22:44:49.593128] [INFO ] [MAIN ] Derivative Progress: 1689/1748 symbols completed. WMS took 1.1s. Estimated remaining: 22.6s. Rate: 156.3 symbols/min [2025-10-07T22:44:49.593440] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:49.610114] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:49.611020] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-07T22:44:49.611199] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-07T22:44:49.631828] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-07T22:44:49.632153] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-07T22:44:49.634448] [INFO ] [MAIN ] Derivative Progress: 1690/1748 symbols completed. WMT took 1.1s. Estimated remaining: 22.2s. Rate: 156.4 symbols/min [2025-10-07T22:44:49.635611] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:49.662294] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:49.663173] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 38981 primary records. [2025-10-07T22:44:49.663326] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-07T22:44:49.692751] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-07T22:44:49.693706] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-07T22:44:49.695949] [INFO ] [MAIN ] Derivative Progress: 1691/1748 symbols completed. WNC took 0.9s. Estimated remaining: 21.9s. Rate: 156.5 symbols/min [2025-10-07T22:44:49.696275] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:49.693558] [DEBUG] [LOCAL ] WNS: Loaded 39883 existing records from primary storage. [2025-10-07T22:44:49.697131] [INFO ] [MAIN ] WNS: Loaded 39883 primary data records. [2025-10-07T22:44:49.924190] [DEBUG] [LOCAL ] WOLF: Loaded 53173 existing records from primary storage. [2025-10-07T22:44:50.031899] [DEBUG] [LOCAL ] WOR: Loaded 24817 existing records from primary storage. [2025-10-07T22:44:50.032433] [INFO ] [MAIN ] WOR: Loaded 24817 primary data records. [2025-10-07T22:44:50.042164] [INFO ] [MAIN ] WOLF: Loaded 53173 primary data records. [2025-10-07T22:44:50.776036] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:50.778666] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 39883 primary records. [2025-10-07T22:44:50.779567] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-07T22:44:50.802215] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-10-07T22:44:50.802609] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-07T22:44:50.805603] [INFO ] [MAIN ] Derivative Progress: 1692/1748 symbols completed. WNS took 1.2s. Estimated remaining: 21.5s. Rate: 156.3 symbols/min [2025-10-07T22:44:50.806092] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:50.822340] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:50.840993] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24817 primary records. [2025-10-07T22:44:50.841679] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-07T22:44:50.842773] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:50.844757] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53173 primary records. [2025-10-07T22:44:50.844854] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-07T22:44:50.894849] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-10-07T22:44:50.894141] [DEBUG] [LOCAL ] WOW: Loaded 30449 existing records from primary storage. [2025-10-07T22:44:50.895057] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-07T22:44:50.898093] [INFO ] [MAIN ] Derivative Progress: 1693/1748 symbols completed. WOLF took 1.3s. Estimated remaining: 21.1s. Rate: 156.4 symbols/min [2025-10-07T22:44:50.895842] [INFO ] [MAIN ] WOW: Loaded 30449 primary data records. [2025-10-07T22:44:50.963336] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-07T22:44:50.979513] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-07T22:44:51.002687] [INFO ] [MAIN ] Derivative Progress: 1694/1748 symbols completed. WOR took 1.3s. Estimated remaining: 20.7s. Rate: 156.5 symbols/min [2025-10-07T22:44:51.212379] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:51.213077] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30449 primary records. [2025-10-07T22:44:51.213142] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-07T22:44:51.228783] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-07T22:44:51.228881] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-07T22:44:51.230892] [INFO ] [MAIN ] Derivative Progress: 1695/1748 symbols completed. WOW took 0.4s. Estimated remaining: 20.3s. Rate: 156.5 symbols/min [2025-10-07T22:44:51.232080] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:51.231936] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:51.231732] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:51.268779] [DEBUG] [LOCAL ] WPP: Loaded 34096 existing records from primary storage. [2025-10-07T22:44:51.269084] [INFO ] [MAIN ] WPP: Loaded 34096 primary data records. [2025-10-07T22:44:51.466926] [DEBUG] [LOCAL ] WPM: Loaded 52727 existing records from primary storage. [2025-10-07T22:44:51.476175] [INFO ] [MAIN ] WPM: Loaded 52727 primary data records. [2025-10-07T22:44:51.757246] [DEBUG] [LOCAL ] WPC: Loaded 48338 existing records from primary storage. [2025-10-07T22:44:51.768632] [INFO ] [MAIN ] WPC: Loaded 48338 primary data records. [2025-10-07T22:44:52.259224] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:52.261696] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 34096 primary records. [2025-10-07T22:44:52.262005] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-07T22:44:52.287745] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-07T22:44:52.288296] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-07T22:44:52.290696] [INFO ] [MAIN ] Derivative Progress: 1696/1748 symbols completed. WPP took 1.1s. Estimated remaining: 20.0s. Rate: 156.3 symbols/min [2025-10-07T22:44:52.291156] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:52.307442] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:52.308522] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52727 primary records. [2025-10-07T22:44:52.308728] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-07T22:44:52.339937] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:52.341601] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48338 primary records. [2025-10-07T22:44:52.342110] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-07T22:44:52.362061] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-07T22:44:52.362964] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-07T22:44:52.362740] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-07T22:44:52.363178] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-07T22:44:52.365576] [INFO ] [MAIN ] Derivative Progress: 1697/1748 symbols completed. WPC took 1.1s. Estimated remaining: 19.6s. Rate: 156.4 symbols/min [2025-10-07T22:44:52.368743] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:52.369087] [INFO ] [MAIN ] Derivative Progress: 1698/1748 symbols completed. WPM took 1.1s. Estimated remaining: 19.2s. Rate: 156.5 symbols/min [2025-10-07T22:44:52.384751] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:52.407298] [DEBUG] [LOCAL ] WRB: Loaded 50663 existing records from primary storage. [2025-10-07T22:44:52.407561] [INFO ] [MAIN ] WRB: Loaded 50663 primary data records. [2025-10-07T22:44:52.566995] [DEBUG] [LOCAL ] WS: Loaded 23733 existing records from primary storage. [2025-10-07T22:44:52.621853] [INFO ] [MAIN ] WS: Loaded 23733 primary data records. [2025-10-07T22:44:52.821251] [DEBUG] [LOCAL ] WRBY: Loaded 50721 existing records from primary storage. [2025-10-07T22:44:52.851798] [INFO ] [MAIN ] WRBY: Loaded 50721 primary data records. [2025-10-07T22:44:53.449121] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:53.450267] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50663 primary records. [2025-10-07T22:44:53.450511] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-07T22:44:53.488989] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-07T22:44:53.489886] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:53.492305] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-07T22:44:53.493325] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23733 primary records. [2025-10-07T22:44:53.495793] [INFO ] [MAIN ] Derivative Progress: 1699/1748 symbols completed. WRB took 1.2s. Estimated remaining: 18.8s. Rate: 156.3 symbols/min [2025-10-07T22:44:53.496093] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-07T22:44:53.496516] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:53.524229] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:53.525827] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50721 primary records. [2025-10-07T22:44:53.525945] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-07T22:44:53.544931] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-07T22:44:53.546056] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-07T22:44:53.548579] [INFO ] [MAIN ] Derivative Progress: 1700/1748 symbols completed. WRBY took 1.2s. Estimated remaining: 18.4s. Rate: 156.4 symbols/min [2025-10-07T22:44:53.550008] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:53.552497] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-07T22:44:53.552633] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-07T22:44:53.555077] [INFO ] [MAIN ] Derivative Progress: 1701/1748 symbols completed. WS took 1.2s. Estimated remaining: 18.0s. Rate: 156.5 symbols/min [2025-10-07T22:44:53.555826] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:53.614147] [DEBUG] [LOCAL ] WSM: Loaded 49404 existing records from primary storage. [2025-10-07T22:44:53.612349] [DEBUG] [LOCAL ] WSR: Loaded 22960 existing records from primary storage. [2025-10-07T22:44:53.622163] [INFO ] [MAIN ] WSR: Loaded 22960 primary data records. [2025-10-07T22:44:53.622350] [INFO ] [MAIN ] WSM: Loaded 49404 primary data records. [2025-10-07T22:44:53.622888] [DEBUG] [LOCAL ] WSO: Loaded 24962 existing records from primary storage. [2025-10-07T22:44:53.634047] [INFO ] [MAIN ] WSO: Loaded 24962 primary data records. [2025-10-07T22:44:54.640035] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:54.654693] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49404 primary records. [2025-10-07T22:44:54.654951] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-07T22:44:54.655300] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:54.656003] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24962 primary records. [2025-10-07T22:44:54.669237] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-07T22:44:54.669507] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:54.670320] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 22960 primary records. [2025-10-07T22:44:54.677689] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-07T22:44:54.686372] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-07T22:44:54.702174] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-07T22:44:54.710975] [INFO ] [MAIN ] Derivative Progress: 1702/1748 symbols completed. WSM took 1.2s. Estimated remaining: 17.7s. Rate: 156.3 symbols/min [2025-10-07T22:44:54.711365] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:54.720879] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-07T22:44:54.720564] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-07T22:44:54.720986] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-07T22:44:54.723124] [INFO ] [MAIN ] Derivative Progress: 1703/1748 symbols completed. WSR took 1.2s. Estimated remaining: 17.3s. Rate: 156.4 symbols/min [2025-10-07T22:44:54.723259] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-07T22:44:54.725450] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:54.725599] [INFO ] [MAIN ] Derivative Progress: 1704/1748 symbols completed. WSO took 1.2s. Estimated remaining: 16.9s. Rate: 156.5 symbols/min [2025-10-07T22:44:54.726210] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:54.763747] [DEBUG] [LOCAL ] WST: Loaded 36985 existing records from primary storage. [2025-10-07T22:44:54.764129] [INFO ] [MAIN ] WST: Loaded 36985 primary data records. [2025-10-07T22:44:54.924505] [DEBUG] [LOCAL ] WTI: Loaded 44045 existing records from primary storage. [2025-10-07T22:44:54.970778] [INFO ] [MAIN ] WTI: Loaded 44045 primary data records. [2025-10-07T22:44:55.136242] [DEBUG] [LOCAL ] WT: Loaded 47866 existing records from primary storage. [2025-10-07T22:44:55.149143] [INFO ] [MAIN ] WT: Loaded 47866 primary data records. [2025-10-07T22:44:55.766557] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:55.769616] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 36985 primary records. [2025-10-07T22:44:55.769824] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-07T22:44:55.792581] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-07T22:44:55.793138] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-07T22:44:55.796724] [INFO ] [MAIN ] Derivative Progress: 1705/1748 symbols completed. WST took 1.1s. Estimated remaining: 16.5s. Rate: 156.3 symbols/min [2025-10-07T22:44:55.797084] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:55.817390] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:55.818380] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 44045 primary records. [2025-10-07T22:44:55.831559] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:55.831273] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-07T22:44:55.832317] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47866 primary records. [2025-10-07T22:44:55.832396] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-07T22:44:55.863197] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-07T22:44:55.863915] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-07T22:44:55.866545] [INFO ] [MAIN ] Derivative Progress: 1706/1748 symbols completed. WTI took 1.1s. Estimated remaining: 16.1s. Rate: 156.4 symbols/min [2025-10-07T22:44:55.866940] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-07T22:44:55.867188] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:55.867595] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-07T22:44:55.869871] [INFO ] [MAIN ] Derivative Progress: 1707/1748 symbols completed. WT took 1.1s. Estimated remaining: 15.7s. Rate: 156.5 symbols/min [2025-10-07T22:44:55.870245] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:55.913306] [DEBUG] [LOCAL ] WTS: Loaded 17856 existing records from primary storage. [2025-10-07T22:44:55.913486] [INFO ] [MAIN ] WTS: Loaded 17856 primary data records. [2025-10-07T22:44:55.991055] [DEBUG] [LOCAL ] WTRG: Loaded 50967 existing records from primary storage. [2025-10-07T22:44:56.002810] [INFO ] [MAIN ] WTRG: Loaded 50967 primary data records. [2025-10-07T22:44:56.305417] [DEBUG] [LOCAL ] WTTR: Loaded 44737 existing records from primary storage. [2025-10-07T22:44:56.358684] [INFO ] [MAIN ] WTTR: Loaded 44737 primary data records. [2025-10-07T22:44:56.931706] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:56.932830] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 17856 primary records. [2025-10-07T22:44:56.934143] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-07T22:44:56.968992] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-10-07T22:44:56.969307] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:56.970365] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50967 primary records. [2025-10-07T22:44:56.970489] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-07T22:44:56.970584] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-07T22:44:56.972845] [INFO ] [MAIN ] Derivative Progress: 1708/1748 symbols completed. WTS took 1.1s. Estimated remaining: 15.4s. Rate: 156.3 symbols/min [2025-10-07T22:44:56.989681] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-07T22:44:56.989875] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-07T22:44:56.992315] [INFO ] [MAIN ] Derivative Progress: 1709/1748 symbols completed. WTRG took 1.2s. Estimated remaining: 15.0s. Rate: 156.4 symbols/min [2025-10-07T22:44:57.008880] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:57.009429] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44737 primary records. [2025-10-07T22:44:57.009490] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-07T22:44:57.025531] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-07T22:44:57.025631] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-07T22:44:57.027842] [INFO ] [MAIN ] Derivative Progress: 1710/1748 symbols completed. WTTR took 1.2s. Estimated remaining: 14.6s. Rate: 156.5 symbols/min [2025-10-07T22:44:57.028386] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:57.028279] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:57.028890] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:57.111815] [DEBUG] [LOCAL ] WWW: Loaded 49242 existing records from primary storage. [2025-10-07T22:44:57.125727] [INFO ] [MAIN ] WWW: Loaded 49242 primary data records. [2025-10-07T22:44:57.147783] [DEBUG] [LOCAL ] WY: Loaded 53141 existing records from primary storage. [2025-10-07T22:44:57.163198] [INFO ] [MAIN ] WY: Loaded 53141 primary data records. [2025-10-07T22:44:57.268884] [DEBUG] [LOCAL ] WU: Loaded 53464 existing records from primary storage. [2025-10-07T22:44:57.318094] [INFO ] [MAIN ] WU: Loaded 53464 primary data records. [2025-10-07T22:44:58.086227] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:58.087199] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49242 primary records. [2025-10-07T22:44:58.087473] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-07T22:44:58.119067] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:58.121206] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53141 primary records. [2025-10-07T22:44:58.121501] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-07T22:44:58.133667] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-07T22:44:58.133829] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-07T22:44:58.136512] [INFO ] [MAIN ] Derivative Progress: 1711/1748 symbols completed. WWW took 1.1s. Estimated remaining: 14.2s. Rate: 156.3 symbols/min [2025-10-07T22:44:58.139379] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:58.157752] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:58.159563] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53464 primary records. [2025-10-07T22:44:58.160210] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-07T22:44:58.162109] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-07T22:44:58.162298] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-07T22:44:58.164791] [INFO ] [MAIN ] Derivative Progress: 1712/1748 symbols completed. WY took 1.1s. Estimated remaining: 13.8s. Rate: 156.4 symbols/min [2025-10-07T22:44:58.173372] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:58.186020] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-07T22:44:58.186202] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-07T22:44:58.188561] [INFO ] [MAIN ] Derivative Progress: 1713/1748 symbols completed. WU took 1.2s. Estimated remaining: 13.4s. Rate: 156.5 symbols/min [2025-10-07T22:44:58.188805] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:58.212510] [DEBUG] [LOCAL ] XFLT: Loaded 29908 existing records from primary storage. [2025-10-07T22:44:58.212704] [INFO ] [MAIN ] XFLT: Loaded 29908 primary data records. [2025-10-07T22:44:58.555489] [DEBUG] [LOCAL ] XHR: Loaded 43731 existing records from primary storage. [2025-10-07T22:44:58.555741] [INFO ] [MAIN ] XHR: Loaded 43731 primary data records. [2025-10-07T22:44:58.691062] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-07T22:44:58.702121] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-07T22:44:59.268978] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:59.270448] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29908 primary records. [2025-10-07T22:44:59.270702] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-07T22:44:59.295073] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-07T22:44:59.303381] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-07T22:44:59.305772] [INFO ] [MAIN ] Derivative Progress: 1714/1748 symbols completed. XFLT took 1.2s. Estimated remaining: 13.1s. Rate: 156.3 symbols/min [2025-10-07T22:44:59.311104] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:59.311587] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:59.312854] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43731 primary records. [2025-10-07T22:44:59.312947] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-07T22:44:59.331528] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-07T22:44:59.331681] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-07T22:44:59.333689] [INFO ] [MAIN ] Derivative Progress: 1715/1748 symbols completed. XHR took 1.2s. Estimated remaining: 12.7s. Rate: 156.4 symbols/min [2025-10-07T22:44:59.333977] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:59.351557] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:44:59.360971] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-07T22:44:59.361147] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-07T22:44:59.386002] [DEBUG] [LOCAL ] XPER: Loaded 30096 existing records from primary storage. [2025-10-07T22:44:59.386819] [INFO ] [MAIN ] XPER: Loaded 30096 primary data records. [2025-10-07T22:44:59.388469] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-07T22:44:59.409714] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-07T22:44:59.411987] [INFO ] [MAIN ] Derivative Progress: 1716/1748 symbols completed. XOM took 1.2s. Estimated remaining: 12.3s. Rate: 156.5 symbols/min [2025-10-07T22:44:59.428777] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:44:59.723995] [DEBUG] [LOCAL ] XPEV: Loaded 53634 existing records from primary storage. [2025-10-07T22:44:59.724338] [INFO ] [MAIN ] XPEV: Loaded 53634 primary data records. [2025-10-07T22:44:59.894508] [DEBUG] [LOCAL ] XPO: Loaded 47792 existing records from primary storage. [2025-10-07T22:44:59.924843] [INFO ] [MAIN ] XPO: Loaded 47792 primary data records. [2025-10-07T22:45:00.402070] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:00.403077] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 30096 primary records. [2025-10-07T22:45:00.403198] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-07T22:45:00.422863] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-07T22:45:00.423620] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-07T22:45:00.427456] [INFO ] [MAIN ] Derivative Progress: 1717/1748 symbols completed. XPER took 1.1s. Estimated remaining: 11.9s. Rate: 156.3 symbols/min [2025-10-07T22:45:00.429529] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:00.445631] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:00.446816] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53634 primary records. [2025-10-07T22:45:00.447071] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-07T22:45:00.491715] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:00.491297] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-07T22:45:00.492750] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-07T22:45:00.494923] [INFO ] [MAIN ] Derivative Progress: 1718/1748 symbols completed. XPEV took 1.2s. Estimated remaining: 11.5s. Rate: 156.4 symbols/min [2025-10-07T22:45:00.492614] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47792 primary records. [2025-10-07T22:45:00.495192] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:00.495818] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-07T22:45:00.523489] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-10-07T22:45:00.525131] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-07T22:45:00.527203] [INFO ] [MAIN ] Derivative Progress: 1719/1748 symbols completed. XPO took 1.1s. Estimated remaining: 11.1s. Rate: 156.5 symbols/min [2025-10-07T22:45:00.524968] [DEBUG] [LOCAL ] XPOF: Loaded 37710 existing records from primary storage. [2025-10-07T22:45:00.527704] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:00.527451] [INFO ] [MAIN ] XPOF: Loaded 37710 primary data records. [2025-10-07T22:45:00.739371] [DEBUG] [LOCAL ] XYF: Loaded 28404 existing records from primary storage. [2025-10-07T22:45:00.878057] [INFO ] [MAIN ] XYF: Loaded 28404 primary data records. [2025-10-07T22:45:00.994385] [DEBUG] [LOCAL ] XPRO: Loaded 45854 existing records from primary storage. [2025-10-07T22:45:01.005634] [INFO ] [MAIN ] XPRO: Loaded 45854 primary data records. [2025-10-07T22:45:01.539924] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:01.541032] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 37710 primary records. [2025-10-07T22:45:01.541579] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-07T22:45:01.561945] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-07T22:45:01.562522] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-07T22:45:01.565361] [INFO ] [MAIN ] Derivative Progress: 1720/1748 symbols completed. XPOF took 1.1s. Estimated remaining: 10.7s. Rate: 156.3 symbols/min [2025-10-07T22:45:01.565878] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:01.585694] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:01.586469] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28404 primary records. [2025-10-07T22:45:01.586674] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-07T22:45:01.625256] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:01.626052] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45854 primary records. [2025-10-07T22:45:01.626216] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-07T22:45:01.625041] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-10-07T22:45:01.626997] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-07T22:45:01.629065] [INFO ] [MAIN ] Derivative Progress: 1721/1748 symbols completed. XYF took 1.1s. Estimated remaining: 10.4s. Rate: 156.4 symbols/min [2025-10-07T22:45:01.636616] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:01.656246] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-07T22:45:01.656383] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-07T22:45:01.658590] [INFO ] [MAIN ] Derivative Progress: 1722/1748 symbols completed. XPRO took 1.2s. Estimated remaining: 10.0s. Rate: 156.5 symbols/min [2025-10-07T22:45:01.658831] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:01.675827] [DEBUG] [LOCAL ] XYL: Loaded 47930 existing records from primary storage. [2025-10-07T22:45:01.675995] [INFO ] [MAIN ] XYL: Loaded 47930 primary data records. [2025-10-07T22:45:01.892463] [DEBUG] [LOCAL ] YALA: Loaded 37001 existing records from primary storage. [2025-10-07T22:45:01.918751] [INFO ] [MAIN ] YALA: Loaded 37001 primary data records. [2025-10-07T22:45:02.134083] [DEBUG] [LOCAL ] YELP: Loaded 45418 existing records from primary storage. [2025-10-07T22:45:02.145204] [INFO ] [MAIN ] YELP: Loaded 45418 primary data records. [2025-10-07T22:45:02.704110] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:02.705613] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47930 primary records. [2025-10-07T22:45:02.706047] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-07T22:45:02.726673] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-07T22:45:02.727360] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-07T22:45:02.729753] [INFO ] [MAIN ] Derivative Progress: 1723/1748 symbols completed. XYL took 1.2s. Estimated remaining: 9.6s. Rate: 156.3 symbols/min [2025-10-07T22:45:02.747361] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:02.748169] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37001 primary records. [2025-10-07T22:45:02.748327] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-07T22:45:02.779281] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:02.781504] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45418 primary records. [2025-10-07T22:45:02.781612] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-07T22:45:02.783380] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-07T22:45:02.783778] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-07T22:45:02.786039] [INFO ] [MAIN ] Derivative Progress: 1724/1748 symbols completed. YALA took 1.1s. Estimated remaining: 9.2s. Rate: 156.4 symbols/min [2025-10-07T22:45:02.801441] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-07T22:45:02.801571] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-07T22:45:02.803832] [INFO ] [MAIN ] Derivative Progress: 1725/1748 symbols completed. YELP took 1.1s. Estimated remaining: 8.8s. Rate: 156.5 symbols/min [2025-10-07T22:45:02.804342] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:02.804416] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:02.804507] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:02.904934] [DEBUG] [LOCAL ] YETI: Loaded 52471 existing records from primary storage. [2025-10-07T22:45:02.905238] [INFO ] [MAIN ] YETI: Loaded 52471 primary data records. [2025-10-07T22:45:02.960393] [DEBUG] [LOCAL ] YEXT: Loaded 43125 existing records from primary storage. [2025-10-07T22:45:02.981892] [INFO ] [MAIN ] YEXT: Loaded 43125 primary data records. [2025-10-07T22:45:03.147425] [DEBUG] [LOCAL ] YMM: Loaded 52632 existing records from primary storage. [2025-10-07T22:45:03.238308] [INFO ] [MAIN ] YMM: Loaded 52632 primary data records. [2025-10-07T22:45:03.936206] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:03.937289] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52471 primary records. [2025-10-07T22:45:03.937588] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-07T22:45:03.956882] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-07T22:45:03.964932] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-07T22:45:03.966958] [INFO ] [MAIN ] Derivative Progress: 1726/1748 symbols completed. YETI took 1.2s. Estimated remaining: 8.4s. Rate: 156.3 symbols/min [2025-10-07T22:45:03.967131] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:03.973244] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:03.974181] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43125 primary records. [2025-10-07T22:45:03.974554] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-07T22:45:04.004140] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:04.005471] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52632 primary records. [2025-10-07T22:45:04.005604] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-07T22:45:04.020257] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-07T22:45:04.020400] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-07T22:45:04.024558] [INFO ] [MAIN ] Derivative Progress: 1727/1748 symbols completed. YEXT took 1.2s. Estimated remaining: 8.1s. Rate: 156.4 symbols/min [2025-10-07T22:45:04.024805] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:04.027999] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-07T22:45:04.028113] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-07T22:45:04.030370] [INFO ] [MAIN ] Derivative Progress: 1728/1748 symbols completed. YMM took 1.2s. Estimated remaining: 7.7s. Rate: 156.5 symbols/min [2025-10-07T22:45:04.030594] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:04.062977] [DEBUG] [LOCAL ] YRD: Loaded 12101 existing records from primary storage. [2025-10-07T22:45:04.063147] [INFO ] [MAIN ] YRD: Loaded 12101 primary data records. [2025-10-07T22:45:04.180483] [DEBUG] [LOCAL ] YOU: Loaded 49694 existing records from primary storage. [2025-10-07T22:45:04.201971] [INFO ] [MAIN ] YOU: Loaded 49694 primary data records. [2025-10-07T22:45:04.400147] [DEBUG] [LOCAL ] YPF: Loaded 50491 existing records from primary storage. [2025-10-07T22:45:04.517440] [INFO ] [MAIN ] YPF: Loaded 50491 primary data records. [2025-10-07T22:45:05.106403] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:05.107479] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12101 primary records. [2025-10-07T22:45:05.107584] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-07T22:45:05.124690] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-10-07T22:45:05.124878] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-07T22:45:05.128523] [INFO ] [MAIN ] Derivative Progress: 1729/1748 symbols completed. YRD took 1.1s. Estimated remaining: 7.3s. Rate: 156.3 symbols/min [2025-10-07T22:45:05.129785] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:05.144254] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:05.145035] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49694 primary records. [2025-10-07T22:45:05.145220] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-07T22:45:05.187307] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:05.188832] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50491 primary records. [2025-10-07T22:45:05.189703] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-10-07T22:45:05.189947] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-07T22:45:05.192023] [INFO ] [MAIN ] Derivative Progress: 1730/1748 symbols completed. YOU took 1.2s. Estimated remaining: 6.9s. Rate: 156.4 symbols/min [2025-10-07T22:45:05.192209] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:05.190027] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-07T22:45:05.214253] [DEBUG] [LOCAL ] YSG: Loaded 25368 existing records from primary storage. [2025-10-07T22:45:05.215876] [INFO ] [MAIN ] YSG: Loaded 25368 primary data records. [2025-10-07T22:45:05.286946] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-07T22:45:05.304431] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-07T22:45:05.328422] [INFO ] [MAIN ] Derivative Progress: 1731/1748 symbols completed. YPF took 1.3s. Estimated remaining: 6.5s. Rate: 156.4 symbols/min [2025-10-07T22:45:05.350879] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:05.566796] [DEBUG] [LOCAL ] YUM: Loaded 51221 existing records from primary storage. [2025-10-07T22:45:05.567122] [INFO ] [MAIN ] YUM: Loaded 51221 primary data records. [2025-10-07T22:45:05.789248] [DEBUG] [LOCAL ] YUMC: Loaded 52606 existing records from primary storage. [2025-10-07T22:45:05.904017] [INFO ] [MAIN ] YUMC: Loaded 52606 primary data records. [2025-10-07T22:45:05.949729] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:05.975514] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25368 primary records. [2025-10-07T22:45:05.996739] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-07T22:45:06.052325] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-10-07T22:45:06.079787] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-07T22:45:06.128611] [INFO ] [MAIN ] Derivative Progress: 1732/1748 symbols completed. YSG took 1.0s. Estimated remaining: 6.1s. Rate: 156.3 symbols/min [2025-10-07T22:45:06.252474] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:06.275001] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:06.275902] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51221 primary records. [2025-10-07T22:45:06.276055] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-07T22:45:06.294858] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-07T22:45:06.295475] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-07T22:45:06.298361] [INFO ] [MAIN ] Derivative Progress: 1733/1748 symbols completed. YUM took 1.1s. Estimated remaining: 5.8s. Rate: 156.4 symbols/min [2025-10-07T22:45:06.298915] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:06.331714] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:06.332447] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52606 primary records. [2025-10-07T22:45:06.332589] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-07T22:45:06.371342] [DEBUG] [LOCAL ] ZEPP: Loaded 18118 existing records from primary storage. [2025-10-07T22:45:06.372928] [DEBUG] [LOCAL ] ZBH: Loaded 50905 existing records from primary storage. [2025-10-07T22:45:06.373509] [INFO ] [MAIN ] ZEPP: Loaded 18118 primary data records. [2025-10-07T22:45:06.384782] [INFO ] [MAIN ] ZBH: Loaded 50905 primary data records. [2025-10-07T22:45:06.484580] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-07T22:45:06.516903] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-07T22:45:06.539392] [INFO ] [MAIN ] Derivative Progress: 1734/1748 symbols completed. YUMC took 1.2s. Estimated remaining: 5.4s. Rate: 156.4 symbols/min [2025-10-07T22:45:06.544694] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:07.072341] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:07.073766] [DEBUG] [LOCAL ] ZETA: Loaded 53603 existing records from primary storage. [2025-10-07T22:45:07.075812] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 18118 primary records. [2025-10-07T22:45:07.075898] [INFO ] [MAIN ] ZETA: Loaded 53603 primary data records. [2025-10-07T22:45:07.077066] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-07T22:45:07.174227] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-10-07T22:45:07.198334] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:07.207122] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-07T22:45:07.218596] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 50905 primary records. [2025-10-07T22:45:07.220837] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-07T22:45:07.220718] [INFO ] [MAIN ] Derivative Progress: 1735/1748 symbols completed. ZEPP took 0.9s. Estimated remaining: 5.0s. Rate: 156.3 symbols/min [2025-10-07T22:45:07.221907] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:07.431868] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-07T22:45:07.440257] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-07T22:45:07.442612] [INFO ] [MAIN ] Derivative Progress: 1736/1748 symbols completed. ZBH took 1.2s. Estimated remaining: 4.6s. Rate: 156.4 symbols/min [2025-10-07T22:45:07.442974] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:07.494247] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:07.494869] [DEBUG] [LOCAL ] ZH: Loaded 26008 existing records from primary storage. [2025-10-07T22:45:07.496213] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53603 primary records. [2025-10-07T22:45:07.507668] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-07T22:45:07.507799] [INFO ] [MAIN ] ZH: Loaded 26008 primary data records. [2025-10-07T22:45:07.546891] [DEBUG] [LOCAL ] ZGN: Loaded 40715 existing records from primary storage. [2025-10-07T22:45:07.593065] [INFO ] [MAIN ] ZGN: Loaded 40715 primary data records. [2025-10-07T22:45:07.632895] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-07T22:45:07.654791] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-07T22:45:07.695980] [INFO ] [MAIN ] Derivative Progress: 1737/1748 symbols completed. ZETA took 1.2s. Estimated remaining: 4.2s. Rate: 156.4 symbols/min [2025-10-07T22:45:07.728102] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:08.192978] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:08.195728] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 26008 primary records. [2025-10-07T22:45:08.196114] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-07T22:45:08.226074] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:08.237426] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40715 primary records. [2025-10-07T22:45:08.240118] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-07T22:45:08.241827] [DEBUG] [LOCAL ] ZIM: Loaded 53506 existing records from primary storage. [2025-10-07T22:45:08.242488] [INFO ] [MAIN ] ZIM: Loaded 53506 primary data records. [2025-10-07T22:45:08.254677] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-07T22:45:08.275991] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-07T22:45:08.300868] [INFO ] [MAIN ] Derivative Progress: 1738/1748 symbols completed. ZH took 0.9s. Estimated remaining: 3.8s. Rate: 156.4 symbols/min [2025-10-07T22:45:08.369140] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-07T22:45:08.379500] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-07T22:45:08.386248] [INFO ] [MAIN ] Derivative Progress: 1739/1748 symbols completed. ZGN took 1.2s. Estimated remaining: 3.5s. Rate: 156.4 symbols/min [2025-10-07T22:45:08.578210] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:08.578920] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53506 primary records. [2025-10-07T22:45:08.578984] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-07T22:45:08.594320] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-10-07T22:45:08.594391] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-07T22:45:08.596341] [INFO ] [MAIN ] Derivative Progress: 1740/1748 symbols completed. ZIM took 0.9s. Estimated remaining: 3.1s. Rate: 156.5 symbols/min [2025-10-07T22:45:08.596791] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:08.597207] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:08.597164] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:08.607865] [DEBUG] [LOCAL ] ZKH: Loaded 7612 existing records from primary storage. [2025-10-07T22:45:08.608074] [INFO ] [MAIN ] ZKH: Loaded 7612 primary data records. [2025-10-07T22:45:08.978765] [DEBUG] [LOCAL ] ZK: Loaded 39203 existing records from primary storage. [2025-10-07T22:45:08.979052] [INFO ] [MAIN ] ZK: Loaded 39203 primary data records. [2025-10-07T22:45:09.090085] [DEBUG] [LOCAL ] ZIP: Loaded 43958 existing records from primary storage. [2025-10-07T22:45:09.106161] [INFO ] [MAIN ] ZIP: Loaded 43958 primary data records. [2025-10-07T22:45:09.664468] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:09.665581] [INFO ] [MAIN ] ZKH: Generated 1794 derivative records from 7612 primary records. [2025-10-07T22:45:09.666121] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-07T22:45:09.683431] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1794 records). [2025-10-07T22:45:09.684341] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-07T22:45:09.686679] [INFO ] [MAIN ] Derivative Progress: 1741/1748 symbols completed. ZKH took 1.1s. Estimated remaining: 2.7s. Rate: 156.3 symbols/min [2025-10-07T22:45:09.687204] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:09.701090] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:09.701960] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39203 primary records. [2025-10-07T22:45:09.702135] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-07T22:45:09.718863] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-07T22:45:09.719099] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-07T22:45:09.721230] [INFO ] [MAIN ] Derivative Progress: 1742/1748 symbols completed. ZK took 1.1s. Estimated remaining: 2.3s. Rate: 156.4 symbols/min [2025-10-07T22:45:09.722502] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:09.738436] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:09.739430] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 43958 primary records. [2025-10-07T22:45:09.739666] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-07T22:45:09.760356] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-07T22:45:09.760490] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-07T22:45:09.762482] [INFO ] [MAIN ] Derivative Progress: 1743/1748 symbols completed. ZIP took 1.2s. Estimated remaining: 1.9s. Rate: 156.5 symbols/min [2025-10-07T22:45:09.762790] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:09.781037] [DEBUG] [LOCAL ] ZTR: Loaded 16783 existing records from primary storage. [2025-10-07T22:45:09.781196] [INFO ] [MAIN ] ZTR: Loaded 16783 primary data records. [2025-10-07T22:45:09.901591] [DEBUG] [LOCAL ] ZTO: Loaded 49596 existing records from primary storage. [2025-10-07T22:45:09.912986] [INFO ] [MAIN ] ZTO: Loaded 49596 primary data records. [2025-10-07T22:45:10.434966] [DEBUG] [LOCAL ] ZTS: Loaded 53058 existing records from primary storage. [2025-10-07T22:45:10.444046] [INFO ] [MAIN ] ZTS: Loaded 53058 primary data records. [2025-10-07T22:45:10.789368] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:10.791455] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16783 primary records. [2025-10-07T22:45:10.791968] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-07T22:45:10.823839] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-07T22:45:10.825211] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-07T22:45:10.845299] [INFO ] [MAIN ] Derivative Progress: 1744/1748 symbols completed. ZTR took 1.1s. Estimated remaining: 1.5s. Rate: 156.3 symbols/min [2025-10-07T22:45:10.851832] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:10.853573] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49596 primary records. [2025-10-07T22:45:10.854237] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:10.854375] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-07T22:45:10.903786] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:10.904940] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53058 primary records. [2025-10-07T22:45:10.905105] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-07T22:45:10.891460] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-07T22:45:10.905385] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-07T22:45:10.909402] [INFO ] [MAIN ] Derivative Progress: 1745/1748 symbols completed. ZTO took 1.2s. Estimated remaining: 1.2s. Rate: 156.4 symbols/min [2025-10-07T22:45:10.919009] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-07T22:45:10.945317] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-10-07T22:45:10.945545] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-07T22:45:10.949057] [INFO ] [MAIN ] Derivative Progress: 1746/1748 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 156.5 symbols/min [2025-10-07T22:45:10.971038] [DEBUG] [LOCAL ] ZVIA: Loaded 35376 existing records from primary storage. [2025-10-07T22:45:10.971488] [INFO ] [MAIN ] ZVIA: Loaded 35376 primary data records. [2025-10-07T22:45:11.292222] [DEBUG] [LOCAL ] ZWS: Loaded 42335 existing records from primary storage. [2025-10-07T22:45:11.292415] [INFO ] [MAIN ] ZWS: Loaded 42335 primary data records. [2025-10-07T22:45:11.877855] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:11.878864] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35376 primary records. [2025-10-07T22:45:11.878982] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-07T22:45:11.896337] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-10-07T22:45:11.896572] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-07T22:45:11.898724] [INFO ] [MAIN ] Derivative Progress: 1747/1748 symbols completed. ZVIA took 1.0s. Estimated remaining: 0.4s. Rate: 156.3 symbols/min [2025-10-07T22:45:11.914961] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-07T22:45:11.915828] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42335 primary records. [2025-10-07T22:45:11.915895] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-07T22:45:11.930920] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-07T22:45:11.930980] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-07T22:45:11.933075] [INFO ] [MAIN ] Derivative Progress: 1748/1748 symbols completed. ZWS took 1.0s. Estimated remaining: 0.0s. Rate: 156.4 symbols/min [2025-10-07T22:45:11.933916] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 11s [2025-10-07T22:45:11.933994] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1748/1748 symbols) [2025-10-07T22:45:12.626906] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1748/1748 @ 100.00%)' [2025-10-07T22:45:12.627501] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-07T22:45:12.629696] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-07T22:45:12.630037] [INFO ] [STATE ] Last completion updated: 2025-10-07T22:45:12.629806